2024-09-12T12:05:23.867 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T12:05:23.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T12:05:23.986 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901717 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/suites/iogen}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7901717' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported dry_run: true install: ceph: flavor: default sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc kclient: client.0: mount_subvol_num: 1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 481 sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc sleep_before_teardown: 0 subset: 57/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi033.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJPZ0LNPLDZDfDIfFGJF1wowsMsaWg81caQSe1icU3lXM1adb0d4LYO/4XX+cH3HQhi1KPJmGhUtVv17eMYy0NY= smithi043.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBGGQ/Jo5ynvcnmDx5EnK3P0pE3bSQoQo1xZRfJS3Xe3jwsA8aYKyS7CiYiYU2sUQoAFG/UcZlMQ6d0zlhMNc/c= smithi102.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM6GeYiiAG6+A3u91/JiBugJYxDIYPkSkto/wjEoDZ2iwtnfph0HunCuFeicis67+VU9ZQS6yYLctXxhmahJWEM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - ceph-fuse: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - workunit: clients: all: - suites/iogen.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T12:05:23.986 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa; will attempt to use it 2024-09-12T12:05:23.987 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks 2024-09-12T12:05:23.987 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T12:05:23.989 INFO:teuthology.task.internal:Checking packages... 2024-09-12T12:05:24.012 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc' 2024-09-12T12:05:24.012 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T12:05:24.012 INFO:teuthology.packaging:ref: None 2024-09-12T12:05:24.012 INFO:teuthology.packaging:tag: None 2024-09-12T12:05:24.012 INFO:teuthology.packaging:branch: squid 2024-09-12T12:05:24.013 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T12:05:24.013 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-12T12:05:24.254 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-314.g086c737f 2024-09-12T12:05:24.256 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T12:05:24.263 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T12:05:24.263 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T12:05:24.277 INFO:teuthology.task.internal:Saving configuration 2024-09-12T12:05:24.296 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T12:05:24.303 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T12:05:24.334 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi033.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901717', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 12:00:37.707065', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJPZ0LNPLDZDfDIfFGJF1wowsMsaWg81caQSe1icU3lXM1adb0d4LYO/4XX+cH3HQhi1KPJmGhUtVv17eMYy0NY='} 2024-09-12T12:05:24.367 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi043.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901717', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 12:00:37.709924', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBGGQ/Jo5ynvcnmDx5EnK3P0pE3bSQoQo1xZRfJS3Xe3jwsA8aYKyS7CiYiYU2sUQoAFG/UcZlMQ6d0zlhMNc/c='} 2024-09-12T12:05:24.400 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901717', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 12:00:37.708834', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM6GeYiiAG6+A3u91/JiBugJYxDIYPkSkto/wjEoDZ2iwtnfph0HunCuFeicis67+VU9ZQS6yYLctXxhmahJWEM='} 2024-09-12T12:05:24.400 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T12:05:24.406 INFO:teuthology.task.internal:roles: ubuntu@smithi033.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-12T12:05:24.407 INFO:teuthology.task.internal:roles: ubuntu@smithi043.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-12T12:05:24.407 INFO:teuthology.task.internal:roles: ubuntu@smithi102.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-12T12:05:24.407 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T12:05:24.558 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff951563be0>, signals=[15]) 2024-09-12T12:05:24.558 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T12:05:24.565 INFO:teuthology.task.internal:Opening connections... 2024-09-12T12:05:24.565 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi033.front.sepia.ceph.com 2024-09-12T12:05:24.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T12:05:24.651 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi043.front.sepia.ceph.com 2024-09-12T12:05:24.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T12:05:24.732 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi102.front.sepia.ceph.com 2024-09-12T12:05:24.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T12:05:24.818 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T12:05:24.827 DEBUG:teuthology.orchestra.run.smithi033:> uname -m 2024-09-12T12:05:24.845 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64 2024-09-12T12:05:24.846 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2024-09-12T12:05:24.904 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="CentOS Stream" 2024-09-12T12:05:24.904 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="9" 2024-09-12T12:05:24.904 INFO:teuthology.orchestra.run.smithi033.stdout:ID="centos" 2024-09-12T12:05:24.904 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="rhel fedora" 2024-09-12T12:05:24.904 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="9" 2024-09-12T12:05:24.904 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el9" 2024-09-12T12:05:24.904 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T12:05:24.904 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2024-09-12T12:05:24.904 INFO:teuthology.orchestra.run.smithi033.stdout:LOGO="fedora-logo-icon" 2024-09-12T12:05:24.904 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T12:05:24.904 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://centos.org/" 2024-09-12T12:05:24.904 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T12:05:24.905 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T12:05:24.905 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T12:05:24.905 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2024-09-12T12:05:24.931 DEBUG:teuthology.orchestra.run.smithi043:> uname -m 2024-09-12T12:05:24.949 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64 2024-09-12T12:05:24.950 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release 2024-09-12T12:05:25.008 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="CentOS Stream" 2024-09-12T12:05:25.008 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="9" 2024-09-12T12:05:25.008 INFO:teuthology.orchestra.run.smithi043.stdout:ID="centos" 2024-09-12T12:05:25.008 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="rhel fedora" 2024-09-12T12:05:25.008 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="9" 2024-09-12T12:05:25.008 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el9" 2024-09-12T12:05:25.008 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T12:05:25.008 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31" 2024-09-12T12:05:25.008 INFO:teuthology.orchestra.run.smithi043.stdout:LOGO="fedora-logo-icon" 2024-09-12T12:05:25.009 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T12:05:25.009 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://centos.org/" 2024-09-12T12:05:25.009 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T12:05:25.009 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T12:05:25.009 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T12:05:25.009 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2024-09-12T12:05:25.039 DEBUG:teuthology.orchestra.run.smithi102:> uname -m 2024-09-12T12:05:25.058 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64 2024-09-12T12:05:25.058 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2024-09-12T12:05:25.116 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Stream" 2024-09-12T12:05:25.116 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="9" 2024-09-12T12:05:25.116 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos" 2024-09-12T12:05:25.116 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora" 2024-09-12T12:05:25.116 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="9" 2024-09-12T12:05:25.116 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el9" 2024-09-12T12:05:25.116 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T12:05:25.116 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2024-09-12T12:05:25.116 INFO:teuthology.orchestra.run.smithi102.stdout:LOGO="fedora-logo-icon" 2024-09-12T12:05:25.117 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T12:05:25.117 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://centos.org/" 2024-09-12T12:05:25.117 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T12:05:25.117 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T12:05:25.117 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T12:05:25.117 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2024-09-12T12:05:25.148 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T12:05:25.158 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T12:05:25.163 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T12:05:25.164 DEBUG:teuthology.orchestra.run.smithi033:> test '!' -e /home/ubuntu/cephtest 2024-09-12T12:05:25.166 DEBUG:teuthology.orchestra.run.smithi043:> test '!' -e /home/ubuntu/cephtest 2024-09-12T12:05:25.168 DEBUG:teuthology.orchestra.run.smithi102:> test '!' -e /home/ubuntu/cephtest 2024-09-12T12:05:25.185 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T12:05:25.191 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T12:05:25.191 DEBUG:teuthology.orchestra.run.smithi033:> test -z $(ls -A /var/lib/ceph) 2024-09-12T12:05:25.224 DEBUG:teuthology.orchestra.run.smithi043:> test -z $(ls -A /var/lib/ceph) 2024-09-12T12:05:25.226 DEBUG:teuthology.orchestra.run.smithi102:> test -z $(ls -A /var/lib/ceph) 2024-09-12T12:05:25.332 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T12:05:25.438 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T12:05:25.452 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-12T12:05:25.453 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}, 'mon.c': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-12T12:05:25.453 DEBUG:teuthology.orchestra.run.smithi033:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T12:05:25.454 DEBUG:teuthology.orchestra.run.smithi043:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T12:05:25.454 DEBUG:teuthology.orchestra.run.smithi102:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T12:05:25.471 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:05:25.471 DEBUG:teuthology.orchestra.run.smithi043:> uname -r 2024-09-12T12:05:25.472 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:05:25.472 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:05:25.473 DEBUG:teuthology.orchestra.run.smithi033:> uname -r 2024-09-12T12:05:25.473 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2024-09-12T12:05:25.530 INFO:teuthology.orchestra.run.smithi043.stdout:5.14.0-503.el9.x86_64 2024-09-12T12:05:25.530 INFO:teuthology.task.kernel:Running kernel on smithi043: 5.14.0-503.el9.x86_64 2024-09-12T12:05:25.530 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum install -y kernel 2024-09-12T12:05:25.531 INFO:teuthology.orchestra.run.smithi033.stdout:5.14.0-503.el9.x86_64 2024-09-12T12:05:25.531 INFO:teuthology.task.kernel:Running kernel on smithi033: 5.14.0-503.el9.x86_64 2024-09-12T12:05:25.532 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum install -y kernel 2024-09-12T12:05:25.532 INFO:teuthology.orchestra.run.smithi102.stdout:5.14.0-503.el9.x86_64 2024-09-12T12:05:25.533 INFO:teuthology.task.kernel:Running kernel on smithi102: 5.14.0-503.el9.x86_64 2024-09-12T12:05:25.533 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum install -y kernel 2024-09-12T12:05:27.969 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-12T12:05:28.841 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - BaseOS 5.2 MB/s | 8.2 MB 00:01 2024-09-12T12:05:29.398 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - BaseOS 4.0 MB/s | 8.2 MB 00:02 2024-09-12T12:05:29.745 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - AppStream 31 MB/s | 20 MB 00:00 2024-09-12T12:05:32.059 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - AppStream 9.9 MB/s | 20 MB 00:02 2024-09-12T12:05:34.746 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - CRB 5.8 MB/s | 6.5 MB 00:01 2024-09-12T12:05:36.205 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - Extras packages 80 kB/s | 19 kB 00:00 2024-09-12T12:05:36.701 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - CRB 9.4 MB/s | 6.5 MB 00:00 2024-09-12T12:05:37.126 INFO:teuthology.orchestra.run.smithi102.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-12T12:05:38.243 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - Extras packages 74 kB/s | 19 kB 00:00 2024-09-12T12:05:39.139 INFO:teuthology.orchestra.run.smithi043.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-12T12:05:42.523 INFO:teuthology.orchestra.run.smithi102.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-12T12:05:44.472 INFO:teuthology.orchestra.run.smithi102.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T12:05:44.472 INFO:teuthology.orchestra.run.smithi102.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T12:05:44.576 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-12T12:05:44.582 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-12T12:05:44.582 INFO:teuthology.orchestra.run.smithi102.stdout: Package Architecture Version Repository Size 2024-09-12T12:05:44.582 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-12T12:05:44.582 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-12T12:05:44.582 INFO:teuthology.orchestra.run.smithi102.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T12:05:44.582 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-09-12T12:05:44.583 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T12:05:44.583 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T12:05:44.583 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T12:05:44.583 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T12:05:44.583 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-12T12:05:44.583 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-12T12:05:44.583 INFO:teuthology.orchestra.run.smithi102.stdout:Install 4 Packages 2024-09-12T12:05:44.583 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T12:05:44.584 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 79 M 2024-09-12T12:05:44.584 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 126 M 2024-09-12T12:05:44.584 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-12T12:05:44.778 INFO:teuthology.orchestra.run.smithi043.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-12T12:05:44.791 INFO:teuthology.orchestra.run.smithi102.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 248 kB/s | 23 kB 00:00 2024-09-12T12:05:45.175 INFO:teuthology.orchestra.run.smithi102.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2024-09-12T12:05:45.550 INFO:teuthology.orchestra.run.smithi102.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 38 MB/s | 29 MB 00:00 2024-09-12T12:05:45.859 INFO:teuthology.orchestra.run.smithi102.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 30 MB/s | 35 MB 00:01 2024-09-12T12:05:45.859 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-12T12:05:45.859 INFO:teuthology.orchestra.run.smithi102.stdout:Total 62 MB/s | 79 MB 00:01 2024-09-12T12:05:46.549 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-12T12:05:46.834 INFO:teuthology.orchestra.run.smithi043.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T12:05:46.835 INFO:teuthology.orchestra.run.smithi043.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T12:05:46.913 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-12T12:05:46.913 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-12T12:05:46.922 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-09-12T12:05:46.927 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-12T12:05:46.927 INFO:teuthology.orchestra.run.smithi043.stdout: Package Architecture Version Repository Size 2024-09-12T12:05:46.927 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-12T12:05:46.927 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2024-09-12T12:05:46.927 INFO:teuthology.orchestra.run.smithi043.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T12:05:46.927 INFO:teuthology.orchestra.run.smithi043.stdout:Installing dependencies: 2024-09-12T12:05:46.927 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T12:05:46.928 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T12:05:46.928 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T12:05:46.928 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T12:05:46.928 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2024-09-12T12:05:46.928 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-12T12:05:46.928 INFO:teuthology.orchestra.run.smithi043.stdout:Install 4 Packages 2024-09-12T12:05:46.928 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T12:05:46.929 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 79 M 2024-09-12T12:05:46.929 INFO:teuthology.orchestra.run.smithi043.stdout:Installed size: 126 M 2024-09-12T12:05:46.929 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2024-09-12T12:05:47.063 INFO:teuthology.orchestra.run.smithi043.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 264 kB/s | 23 kB 00:00 2024-09-12T12:05:47.878 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-12T12:05:47.878 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-12T12:05:49.947 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 20 MB 00:19 2024-09-12T12:05:50.328 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-12T12:05:50.970 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T12:05:51.060 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T12:05:51.096 INFO:teuthology.orchestra.run.smithi043.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 3.8 MB/s | 16 MB 00:04 2024-09-12T12:05:53.862 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T12:05:53.989 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T12:05:54.255 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - CRB 17 MB/s | 6.5 MB 00:00 2024-09-12T12:05:54.512 INFO:teuthology.orchestra.run.smithi043.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 3.8 MB/s | 29 MB 00:07 2024-09-12T12:05:56.112 INFO:teuthology.orchestra.run.smithi043.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 3.8 MB/s | 35 MB 00:09 2024-09-12T12:05:56.113 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2024-09-12T12:05:56.113 INFO:teuthology.orchestra.run.smithi043.stdout:Total 8.6 MB/s | 79 MB 00:09 2024-09-12T12:05:56.164 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - Extras packages 28 kB/s | 19 kB 00:00 2024-09-12T12:05:56.825 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2024-09-12T12:05:57.202 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2024-09-12T12:05:57.202 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2024-09-12T12:05:57.235 INFO:teuthology.orchestra.run.smithi033.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-12T12:05:58.171 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2024-09-12T12:05:58.171 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2024-09-12T12:05:58.838 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T12:05:58.956 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T12:06:00.855 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2024-09-12T12:06:01.525 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T12:06:01.690 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T12:06:02.816 INFO:teuthology.orchestra.run.smithi033.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-12T12:06:03.789 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T12:06:04.486 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T12:06:04.617 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T12:06:04.872 INFO:teuthology.orchestra.run.smithi033.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T12:06:04.872 INFO:teuthology.orchestra.run.smithi033.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T12:06:04.965 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-09-12T12:06:04.971 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-09-12T12:06:04.972 INFO:teuthology.orchestra.run.smithi033.stdout: Package Architecture Version Repository Size 2024-09-12T12:06:04.972 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-09-12T12:06:04.972 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2024-09-12T12:06:04.972 INFO:teuthology.orchestra.run.smithi033.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T12:06:04.972 INFO:teuthology.orchestra.run.smithi033.stdout:Installing dependencies: 2024-09-12T12:06:04.972 INFO:teuthology.orchestra.run.smithi033.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T12:06:04.972 INFO:teuthology.orchestra.run.smithi033.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T12:06:04.972 INFO:teuthology.orchestra.run.smithi033.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T12:06:04.972 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:06:04.972 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-09-12T12:06:04.972 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-09-12T12:06:04.972 INFO:teuthology.orchestra.run.smithi033.stdout:Install 4 Packages 2024-09-12T12:06:04.973 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:06:04.973 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 79 M 2024-09-12T12:06:04.973 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 126 M 2024-09-12T12:06:04.973 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-09-12T12:06:05.084 INFO:teuthology.orchestra.run.smithi033.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 252 kB/s | 23 kB 00:00 2024-09-12T12:06:05.476 INFO:teuthology.orchestra.run.smithi033.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-09-12T12:06:05.868 INFO:teuthology.orchestra.run.smithi033.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 40 MB/s | 35 MB 00:00 2024-09-12T12:06:06.276 INFO:teuthology.orchestra.run.smithi033.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 24 MB/s | 29 MB 00:01 2024-09-12T12:06:06.277 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-09-12T12:06:06.277 INFO:teuthology.orchestra.run.smithi033.stdout:Total 60 MB/s | 79 MB 00:01 2024-09-12T12:06:06.990 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-09-12T12:06:07.373 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-09-12T12:06:07.373 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-09-12T12:06:08.363 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-09-12T12:06:08.363 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-09-12T12:06:09.751 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T12:06:09.792 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T12:06:10.946 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-09-12T12:06:11.646 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T12:06:11.726 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T12:06:14.506 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T12:06:14.631 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T12:06:14.944 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T12:06:19.753 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T12:06:19.798 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T12:06:24.954 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T12:06:42.269 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T12:06:42.314 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T12:06:42.664 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T12:06:42.665 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T12:06:42.665 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T12:06:42.665 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T12:06:43.482 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T12:06:43.482 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T12:06:43.482 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-12T12:06:43.483 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T12:06:43.483 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T12:06:43.483 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T12:06:43.483 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T12:06:43.483 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T12:06:43.483 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-12T12:06:43.857 DEBUG:teuthology.orchestra.run.smithi102:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T12:06:43.927 INFO:teuthology.orchestra.run.smithi102.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T12:06:43.928 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T12:06:43.928 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T12:06:43.928 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T12:06:43.929 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T12:06:43.929 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2024-09-12T12:06:43.929 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi102.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T12:06:43.929 DEBUG:teuthology.orchestra.run.smithi102:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T12:06:43.987 INFO:teuthology.orchestra.run.smithi102.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T12:06:43.987 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T12:06:43.987 DEBUG:teuthology.orchestra.run.smithi102:> sudo rpm -qi grub2-tools 2024-09-12T12:06:44.018 INFO:teuthology.orchestra.run.smithi102.stdout:Name : grub2-tools 2024-09-12T12:06:44.019 INFO:teuthology.orchestra.run.smithi102.stdout:Epoch : 1 2024-09-12T12:06:44.019 INFO:teuthology.orchestra.run.smithi102.stdout:Version : 2.06 2024-09-12T12:06:44.019 INFO:teuthology.orchestra.run.smithi102.stdout:Release : 82.el9 2024-09-12T12:06:44.019 INFO:teuthology.orchestra.run.smithi102.stdout:Architecture: x86_64 2024-09-12T12:06:44.019 INFO:teuthology.orchestra.run.smithi102.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T12:06:44.019 INFO:teuthology.orchestra.run.smithi102.stdout:Group : Unspecified 2024-09-12T12:06:44.019 INFO:teuthology.orchestra.run.smithi102.stdout:Size : 8274670 2024-09-12T12:06:44.019 INFO:teuthology.orchestra.run.smithi102.stdout:License : GPLv3+ 2024-09-12T12:06:44.019 INFO:teuthology.orchestra.run.smithi102.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T12:06:44.019 INFO:teuthology.orchestra.run.smithi102.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T12:06:44.019 INFO:teuthology.orchestra.run.smithi102.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T12:06:44.019 INFO:teuthology.orchestra.run.smithi102.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T12:06:44.019 INFO:teuthology.orchestra.run.smithi102.stdout:Packager : builder@centos.org 2024-09-12T12:06:44.020 INFO:teuthology.orchestra.run.smithi102.stdout:Vendor : CentOS 2024-09-12T12:06:44.020 INFO:teuthology.orchestra.run.smithi102.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T12:06:44.020 INFO:teuthology.orchestra.run.smithi102.stdout:Summary : Support tools for GRUB. 2024-09-12T12:06:44.020 INFO:teuthology.orchestra.run.smithi102.stdout:Description : 2024-09-12T12:06:44.020 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T12:06:44.020 INFO:teuthology.orchestra.run.smithi102.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T12:06:44.020 INFO:teuthology.orchestra.run.smithi102.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T12:06:44.020 INFO:teuthology.orchestra.run.smithi102.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T12:06:44.020 INFO:teuthology.orchestra.run.smithi102.stdout:hardware devices. 2024-09-12T12:06:44.020 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T12:06:44.020 INFO:teuthology.orchestra.run.smithi102.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T12:06:44.021 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T12:06:44.021 INFO:teuthology.task.kernel:Updating grub on smithi102 to boot 5.14.0-505.el9.x86_64 2024-09-12T12:06:44.022 DEBUG:teuthology.orchestra.run.smithi102:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T12:06:44.756 INFO:teuthology.orchestra.run.smithi102.stderr:Generating grub configuration file ... 2024-09-12T12:06:46.042 INFO:teuthology.orchestra.run.smithi102.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T12:06:46.071 INFO:teuthology.orchestra.run.smithi102.stderr:done 2024-09-12T12:06:46.073 DEBUG:teuthology.orchestra.run.smithi102:> mktemp 2024-09-12T12:06:46.089 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.QuKu6eAeu2 2024-09-12T12:06:46.089 DEBUG:teuthology.orchestra.run.smithi102:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.QuKu6eAeu2 2024-09-12T12:06:46.157 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0666 /tmp/tmp.QuKu6eAeu2 2024-09-12T12:06:46.292 DEBUG:teuthology.orchestra.remote:smithi102:/tmp/tmp.QuKu6eAeu2 is 6KB 2024-09-12T12:06:46.339 DEBUG:teuthology.orchestra.run.smithi102:> rm -fr /tmp/tmp.QuKu6eAeu2 2024-09-12T12:06:46.355 DEBUG:teuthology.orchestra.run.smithi102:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T12:06:46.421 INFO:teuthology.orchestra.run.smithi102.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T12:06:46.421 INFO:teuthology.orchestra.run.smithi102.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T12:06:46.421 INFO:teuthology.orchestra.run.smithi102.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T12:06:46.421 INFO:teuthology.orchestra.run.smithi102.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T12:06:46.423 DEBUG:teuthology.orchestra.run.smithi102:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T12:06:46.575 DEBUG:teuthology.orchestra.run.smithi102:> sudo shutdown -r now 2024-09-12T12:06:53.846 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T12:06:53.888 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T12:06:54.235 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T12:06:54.235 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T12:06:54.235 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T12:06:54.235 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T12:06:55.116 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T12:06:55.116 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T12:06:55.116 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2024-09-12T12:06:55.116 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T12:06:55.116 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T12:06:55.117 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T12:06:55.117 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T12:06:55.117 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T12:06:55.117 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-09-12T12:06:55.480 DEBUG:teuthology.orchestra.run.smithi043:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T12:06:55.563 INFO:teuthology.orchestra.run.smithi043.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T12:06:55.563 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T12:06:55.563 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T12:06:55.563 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T12:06:55.563 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T12:06:55.563 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-12T12:06:55.563 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi043.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T12:06:55.564 DEBUG:teuthology.orchestra.run.smithi043:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T12:06:55.622 INFO:teuthology.orchestra.run.smithi043.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T12:06:55.622 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T12:06:55.622 DEBUG:teuthology.orchestra.run.smithi043:> sudo rpm -qi grub2-tools 2024-09-12T12:06:55.658 INFO:teuthology.orchestra.run.smithi043.stdout:Name : grub2-tools 2024-09-12T12:06:55.658 INFO:teuthology.orchestra.run.smithi043.stdout:Epoch : 1 2024-09-12T12:06:55.658 INFO:teuthology.orchestra.run.smithi043.stdout:Version : 2.06 2024-09-12T12:06:55.658 INFO:teuthology.orchestra.run.smithi043.stdout:Release : 82.el9 2024-09-12T12:06:55.658 INFO:teuthology.orchestra.run.smithi043.stdout:Architecture: x86_64 2024-09-12T12:06:55.658 INFO:teuthology.orchestra.run.smithi043.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T12:06:55.658 INFO:teuthology.orchestra.run.smithi043.stdout:Group : Unspecified 2024-09-12T12:06:55.659 INFO:teuthology.orchestra.run.smithi043.stdout:Size : 8274670 2024-09-12T12:06:55.659 INFO:teuthology.orchestra.run.smithi043.stdout:License : GPLv3+ 2024-09-12T12:06:55.659 INFO:teuthology.orchestra.run.smithi043.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T12:06:55.659 INFO:teuthology.orchestra.run.smithi043.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T12:06:55.659 INFO:teuthology.orchestra.run.smithi043.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T12:06:55.659 INFO:teuthology.orchestra.run.smithi043.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T12:06:55.659 INFO:teuthology.orchestra.run.smithi043.stdout:Packager : builder@centos.org 2024-09-12T12:06:55.659 INFO:teuthology.orchestra.run.smithi043.stdout:Vendor : CentOS 2024-09-12T12:06:55.659 INFO:teuthology.orchestra.run.smithi043.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T12:06:55.659 INFO:teuthology.orchestra.run.smithi043.stdout:Summary : Support tools for GRUB. 2024-09-12T12:06:55.659 INFO:teuthology.orchestra.run.smithi043.stdout:Description : 2024-09-12T12:06:55.659 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T12:06:55.659 INFO:teuthology.orchestra.run.smithi043.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T12:06:55.659 INFO:teuthology.orchestra.run.smithi043.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T12:06:55.660 INFO:teuthology.orchestra.run.smithi043.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T12:06:55.660 INFO:teuthology.orchestra.run.smithi043.stdout:hardware devices. 2024-09-12T12:06:55.660 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T12:06:55.660 INFO:teuthology.orchestra.run.smithi043.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T12:06:55.661 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T12:06:55.661 INFO:teuthology.task.kernel:Updating grub on smithi043 to boot 5.14.0-505.el9.x86_64 2024-09-12T12:06:55.661 DEBUG:teuthology.orchestra.run.smithi043:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T12:06:56.292 INFO:teuthology.orchestra.run.smithi043.stderr:Generating grub configuration file ... 2024-09-12T12:06:57.603 INFO:teuthology.orchestra.run.smithi043.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T12:06:57.629 INFO:teuthology.orchestra.run.smithi043.stderr:done 2024-09-12T12:06:57.631 DEBUG:teuthology.orchestra.run.smithi043:> mktemp 2024-09-12T12:06:57.646 INFO:teuthology.orchestra.run.smithi043.stdout:/tmp/tmp.o08fx68Fpp 2024-09-12T12:06:57.647 DEBUG:teuthology.orchestra.run.smithi043:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.o08fx68Fpp 2024-09-12T12:06:57.713 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0666 /tmp/tmp.o08fx68Fpp 2024-09-12T12:06:57.849 DEBUG:teuthology.orchestra.remote:smithi043:/tmp/tmp.o08fx68Fpp is 6KB 2024-09-12T12:06:57.900 DEBUG:teuthology.orchestra.run.smithi043:> rm -fr /tmp/tmp.o08fx68Fpp 2024-09-12T12:06:57.914 DEBUG:teuthology.orchestra.run.smithi043:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T12:06:57.976 INFO:teuthology.orchestra.run.smithi043.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T12:06:57.977 INFO:teuthology.orchestra.run.smithi043.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T12:06:57.977 INFO:teuthology.orchestra.run.smithi043.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T12:06:57.977 INFO:teuthology.orchestra.run.smithi043.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T12:06:57.978 DEBUG:teuthology.orchestra.run.smithi043:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T12:06:58.142 DEBUG:teuthology.orchestra.run.smithi043:> sudo shutdown -r now 2024-09-12T12:07:04.426 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T12:07:04.466 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T12:07:04.808 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T12:07:04.808 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T12:07:04.809 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T12:07:04.809 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T12:07:05.670 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T12:07:05.670 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:07:05.670 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-09-12T12:07:05.670 INFO:teuthology.orchestra.run.smithi033.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T12:07:05.670 INFO:teuthology.orchestra.run.smithi033.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T12:07:05.670 INFO:teuthology.orchestra.run.smithi033.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T12:07:05.670 INFO:teuthology.orchestra.run.smithi033.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T12:07:05.670 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:07:05.670 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-09-12T12:07:06.045 DEBUG:teuthology.orchestra.run.smithi033:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T12:07:06.131 INFO:teuthology.orchestra.run.smithi033.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T12:07:06.131 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T12:07:06.131 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T12:07:06.131 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T12:07:06.131 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T12:07:06.132 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-12T12:07:06.132 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi033.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T12:07:06.132 DEBUG:teuthology.orchestra.run.smithi033:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T12:07:06.190 INFO:teuthology.orchestra.run.smithi033.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T12:07:06.190 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T12:07:06.191 DEBUG:teuthology.orchestra.run.smithi033:> sudo rpm -qi grub2-tools 2024-09-12T12:07:06.222 INFO:teuthology.orchestra.run.smithi033.stdout:Name : grub2-tools 2024-09-12T12:07:06.222 INFO:teuthology.orchestra.run.smithi033.stdout:Epoch : 1 2024-09-12T12:07:06.222 INFO:teuthology.orchestra.run.smithi033.stdout:Version : 2.06 2024-09-12T12:07:06.222 INFO:teuthology.orchestra.run.smithi033.stdout:Release : 82.el9 2024-09-12T12:07:06.222 INFO:teuthology.orchestra.run.smithi033.stdout:Architecture: x86_64 2024-09-12T12:07:06.222 INFO:teuthology.orchestra.run.smithi033.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T12:07:06.222 INFO:teuthology.orchestra.run.smithi033.stdout:Group : Unspecified 2024-09-12T12:07:06.223 INFO:teuthology.orchestra.run.smithi033.stdout:Size : 8274670 2024-09-12T12:07:06.223 INFO:teuthology.orchestra.run.smithi033.stdout:License : GPLv3+ 2024-09-12T12:07:06.223 INFO:teuthology.orchestra.run.smithi033.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T12:07:06.223 INFO:teuthology.orchestra.run.smithi033.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T12:07:06.223 INFO:teuthology.orchestra.run.smithi033.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T12:07:06.223 INFO:teuthology.orchestra.run.smithi033.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T12:07:06.223 INFO:teuthology.orchestra.run.smithi033.stdout:Packager : builder@centos.org 2024-09-12T12:07:06.223 INFO:teuthology.orchestra.run.smithi033.stdout:Vendor : CentOS 2024-09-12T12:07:06.223 INFO:teuthology.orchestra.run.smithi033.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T12:07:06.223 INFO:teuthology.orchestra.run.smithi033.stdout:Summary : Support tools for GRUB. 2024-09-12T12:07:06.223 INFO:teuthology.orchestra.run.smithi033.stdout:Description : 2024-09-12T12:07:06.223 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:07:06.223 INFO:teuthology.orchestra.run.smithi033.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T12:07:06.224 INFO:teuthology.orchestra.run.smithi033.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T12:07:06.224 INFO:teuthology.orchestra.run.smithi033.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T12:07:06.224 INFO:teuthology.orchestra.run.smithi033.stdout:hardware devices. 2024-09-12T12:07:06.224 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:07:06.224 INFO:teuthology.orchestra.run.smithi033.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T12:07:06.225 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T12:07:06.225 INFO:teuthology.task.kernel:Updating grub on smithi033 to boot 5.14.0-505.el9.x86_64 2024-09-12T12:07:06.225 DEBUG:teuthology.orchestra.run.smithi033:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T12:07:06.771 INFO:teuthology.orchestra.run.smithi033.stderr:Generating grub configuration file ... 2024-09-12T12:07:08.089 INFO:teuthology.orchestra.run.smithi033.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T12:07:08.128 INFO:teuthology.orchestra.run.smithi033.stderr:done 2024-09-12T12:07:08.135 DEBUG:teuthology.orchestra.run.smithi033:> mktemp 2024-09-12T12:07:08.150 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/tmp.jysxEzdNMS 2024-09-12T12:07:08.151 DEBUG:teuthology.orchestra.run.smithi033:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.jysxEzdNMS 2024-09-12T12:07:08.228 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 0666 /tmp/tmp.jysxEzdNMS 2024-09-12T12:07:08.382 DEBUG:teuthology.orchestra.remote:smithi033:/tmp/tmp.jysxEzdNMS is 6KB 2024-09-12T12:07:08.431 DEBUG:teuthology.orchestra.run.smithi033:> rm -fr /tmp/tmp.jysxEzdNMS 2024-09-12T12:07:08.445 DEBUG:teuthology.orchestra.run.smithi033:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T12:07:08.508 INFO:teuthology.orchestra.run.smithi033.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T12:07:08.509 INFO:teuthology.orchestra.run.smithi033.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T12:07:08.509 INFO:teuthology.orchestra.run.smithi033.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T12:07:08.509 INFO:teuthology.orchestra.run.smithi033.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T12:07:08.510 DEBUG:teuthology.orchestra.run.smithi033:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T12:07:08.658 DEBUG:teuthology.orchestra.run.smithi033:> sudo shutdown -r now 2024-09-12T12:07:16.585 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-09-12T12:07:16.585 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-12T12:07:16.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T12:07:28.153 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-12T12:07:28.153 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-09-12T12:07:28.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T12:07:34.973 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-09-12T12:07:38.664 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-12T12:07:38.665 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-09-12T12:07:38.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T12:07:43.978 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-12T12:07:43.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T12:07:46.493 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.43 2024-09-12T12:07:55.502 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-09-12T12:07:55.502 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T12:08:38.717 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T12:08:43.993 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T12:08:47.719 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-09-12T12:08:47.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T12:08:48.090 DEBUG:teuthology.orchestra.run.smithi033:> true 2024-09-12T12:08:48.452 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-09-12T12:08:48.452 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-12T12:08:48.453 DEBUG:teuthology.orchestra.run.smithi033:> uname -r 2024-09-12T12:08:48.469 INFO:teuthology.orchestra.run.smithi033.stdout:5.14.0-505.el9.x86_64 2024-09-12T12:08:48.469 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T12:08:48.469 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T12:08:48.469 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T12:08:49.470 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-12T12:08:49.471 DEBUG:teuthology.orchestra.run.smithi033:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T12:08:49.540 INFO:teuthology.orchestra.run.smithi033.stdout:ttyS1 2024-09-12T12:08:49.567 DEBUG:teuthology.parallel:result is None 2024-09-12T12:08:55.530 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T12:08:55.994 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-12T12:08:55.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T12:08:56.380 DEBUG:teuthology.orchestra.run.smithi102:> true 2024-09-12T12:08:56.756 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-12T12:08:56.756 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-505.el9.x86_64"... 2024-09-12T12:08:56.756 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2024-09-12T12:08:56.772 INFO:teuthology.orchestra.run.smithi102.stdout:5.14.0-505.el9.x86_64 2024-09-12T12:08:56.772 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T12:08:56.772 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T12:08:56.772 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T12:08:57.773 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-09-12T12:08:57.773 DEBUG:teuthology.orchestra.run.smithi102:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T12:08:57.849 INFO:teuthology.orchestra.run.smithi102.stdout:ttyS1 2024-09-12T12:08:57.871 DEBUG:teuthology.parallel:result is None 2024-09-12T12:09:07.531 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-09-12T12:09:07.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T12:09:07.990 DEBUG:teuthology.orchestra.run.smithi043:> true 2024-09-12T12:09:08.368 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-09-12T12:09:08.368 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-12T12:09:08.368 DEBUG:teuthology.orchestra.run.smithi043:> uname -r 2024-09-12T12:09:08.385 INFO:teuthology.orchestra.run.smithi043.stdout:5.14.0-505.el9.x86_64 2024-09-12T12:09:08.386 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T12:09:08.386 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T12:09:08.386 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T12:09:09.387 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-12T12:09:09.387 DEBUG:teuthology.orchestra.run.smithi043:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T12:09:09.460 INFO:teuthology.orchestra.run.smithi043.stdout:ttyS1 2024-09-12T12:09:09.490 DEBUG:teuthology.parallel:result is None 2024-09-12T12:09:09.490 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T12:09:09.498 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T12:09:09.498 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T12:09:09.501 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T12:09:09.504 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T12:09:09.522 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T12:09:09.589 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T12:09:09.595 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T12:09:09.595 DEBUG:teuthology.orchestra.run.smithi033:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T12:09:09.598 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T12:09:09.600 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T12:09:09.634 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T12:09:09.640 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T12:09:09.641 DEBUG:teuthology.orchestra.run.smithi033:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T12:09:09.668 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T12:09:09.671 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T12:09:09.702 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T12:09:09.703 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T12:09:09.706 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T12:09:09.714 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T12:09:09.715 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T12:09:09.717 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T12:09:09.719 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T12:09:09.726 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T12:09:09.726 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T12:09:09.759 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T12:09:09.762 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T12:09:09.791 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T12:09:09.802 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T12:09:09.803 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T12:09:09.829 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T12:09:09.832 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T12:09:09.850 DEBUG:teuthology.orchestra.run.smithi033:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T12:09:09.939 DEBUG:teuthology.orchestra.run.smithi033:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T12:09:09.982 DEBUG:teuthology.orchestra.run.smithi033:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T12:09:10.136 DEBUG:teuthology.orchestra.run.smithi033:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T12:09:10.173 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T12:09:10.173 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T12:09:10.239 DEBUG:teuthology.orchestra.run.smithi043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T12:09:10.298 DEBUG:teuthology.orchestra.run.smithi043:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T12:09:10.345 DEBUG:teuthology.orchestra.run.smithi043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T12:09:10.434 DEBUG:teuthology.orchestra.run.smithi043:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T12:09:10.475 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T12:09:10.475 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T12:09:10.544 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T12:09:10.596 DEBUG:teuthology.orchestra.run.smithi102:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T12:09:10.641 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T12:09:10.733 DEBUG:teuthology.orchestra.run.smithi102:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T12:09:10.767 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-12T12:09:10.767 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T12:09:10.834 DEBUG:teuthology.orchestra.run.smithi033:> sudo service rsyslog restart 2024-09-12T12:09:10.836 DEBUG:teuthology.orchestra.run.smithi043:> sudo service rsyslog restart 2024-09-12T12:09:10.839 DEBUG:teuthology.orchestra.run.smithi102:> sudo service rsyslog restart 2024-09-12T12:09:10.884 INFO:teuthology.orchestra.run.smithi033.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T12:09:10.887 INFO:teuthology.orchestra.run.smithi043.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T12:09:10.917 INFO:teuthology.orchestra.run.smithi102.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T12:09:11.427 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T12:09:11.435 INFO:teuthology.task.internal:Starting timer... 2024-09-12T12:09:11.435 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T12:09:11.445 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T12:09:11.452 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-12T12:09:11.452 DEBUG:teuthology.orchestra.run.smithi033:> sudo service auditd rotate 2024-09-12T12:09:11.533 INFO:teuthology.orchestra.run.smithi033.stdout:Rotating logs: 2024-09-12T12:09:11.535 DEBUG:teuthology.orchestra.run.smithi043:> sudo service auditd rotate 2024-09-12T12:09:11.602 INFO:teuthology.orchestra.run.smithi043.stdout:Rotating logs: 2024-09-12T12:09:11.604 DEBUG:teuthology.orchestra.run.smithi102:> sudo service auditd rotate 2024-09-12T12:09:11.659 INFO:teuthology.orchestra.run.smithi102.stdout:Rotating logs: 2024-09-12T12:09:11.661 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T12:09:11.661 DEBUG:teuthology.orchestra.run.smithi033:> /usr/sbin/getenforce 2024-09-12T12:09:11.686 INFO:teuthology.orchestra.run.smithi033.stdout:Permissive 2024-09-12T12:09:11.686 DEBUG:teuthology.orchestra.run.smithi043:> /usr/sbin/getenforce 2024-09-12T12:09:11.712 INFO:teuthology.orchestra.run.smithi043.stdout:Permissive 2024-09-12T12:09:11.712 DEBUG:teuthology.orchestra.run.smithi102:> /usr/sbin/getenforce 2024-09-12T12:09:11.751 INFO:teuthology.orchestra.run.smithi102.stdout:Permissive 2024-09-12T12:09:11.751 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi033.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi043.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi102.front.sepia.ceph.com': 'permissive'} 2024-09-12T12:09:11.751 DEBUG:teuthology.orchestra.run.smithi033:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T12:09:11.780 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:09:11.780 DEBUG:teuthology.orchestra.run.smithi043:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T12:09:11.810 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:09:11.811 DEBUG:teuthology.orchestra.run.smithi102:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T12:09:11.841 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:09:11.842 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T12:09:11.842 DEBUG:teuthology.orchestra.run.smithi033:> sudo /usr/sbin/setenforce permissive 2024-09-12T12:09:11.875 DEBUG:teuthology.orchestra.run.smithi043:> sudo /usr/sbin/setenforce permissive 2024-09-12T12:09:11.911 DEBUG:teuthology.orchestra.run.smithi102:> sudo /usr/sbin/setenforce permissive 2024-09-12T12:09:11.950 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T12:09:11.960 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T12:09:11.971 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T12:09:11.972 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi033.front.sepia.ceph.com,smithi043.front.sepia.ceph.com,smithi102.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T12:13:13.039 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi033.front.sepia.ceph.com'), Remote(name='ubuntu@smithi043.front.sepia.ceph.com'), Remote(name='ubuntu@smithi102.front.sepia.ceph.com')] 2024-09-12T12:13:13.040 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-09-12T12:13:13.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T12:13:13.190 DEBUG:teuthology.orchestra.run.smithi033:> true 2024-09-12T12:13:13.275 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-09-12T12:13:13.275 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-09-12T12:13:13.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T12:13:13.360 DEBUG:teuthology.orchestra.run.smithi043:> true 2024-09-12T12:13:13.451 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-09-12T12:13:13.451 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-12T12:13:13.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T12:13:13.537 DEBUG:teuthology.orchestra.run.smithi102:> true 2024-09-12T12:13:13.618 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-12T12:13:13.619 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T12:13:13.629 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T12:13:13.629 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T12:13:13.629 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T12:13:13.632 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T12:13:13.632 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T12:13:13.634 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T12:13:13.634 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T12:13:13.660 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T12:13:13.668 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T12:13:13.676 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T12:13:13.684 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T12:13:13.692 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T12:13:13.702 INFO:teuthology.orchestra.run.smithi033.stderr:sudo: ntpd: command not found 2024-09-12T12:13:13.707 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T12:13:13.712 INFO:teuthology.orchestra.run.smithi043.stderr:sudo: ntpd: command not found 2024-09-12T12:13:13.714 INFO:teuthology.orchestra.run.smithi033.stdout:506 Cannot talk to daemon 2024-09-12T12:13:13.724 INFO:teuthology.orchestra.run.smithi043.stdout:506 Cannot talk to daemon 2024-09-12T12:13:13.730 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T12:13:13.733 INFO:teuthology.orchestra.run.smithi102.stderr:sudo: ntpd: command not found 2024-09-12T12:13:13.740 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T12:13:13.745 INFO:teuthology.orchestra.run.smithi102.stdout:506 Cannot talk to daemon 2024-09-12T12:13:13.746 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T12:13:13.756 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T12:13:13.759 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T12:13:13.773 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T12:13:13.812 INFO:teuthology.orchestra.run.smithi033.stderr:bash: line 1: ntpq: command not found 2024-09-12T12:13:13.813 INFO:teuthology.orchestra.run.smithi043.stderr:bash: line 1: ntpq: command not found 2024-09-12T12:13:13.816 INFO:teuthology.orchestra.run.smithi033.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T12:13:13.817 INFO:teuthology.orchestra.run.smithi033.stdout:=============================================================================== 2024-09-12T12:13:13.817 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T12:13:13.817 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T12:13:13.817 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T12:13:13.817 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T12:13:13.818 INFO:teuthology.orchestra.run.smithi043.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T12:13:13.818 INFO:teuthology.orchestra.run.smithi043.stdout:=============================================================================== 2024-09-12T12:13:13.819 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T12:13:13.819 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T12:13:13.819 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T12:13:13.819 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T12:13:13.845 INFO:teuthology.orchestra.run.smithi102.stderr:bash: line 1: ntpq: command not found 2024-09-12T12:13:13.849 INFO:teuthology.orchestra.run.smithi102.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T12:13:13.849 INFO:teuthology.orchestra.run.smithi102.stdout:=============================================================================== 2024-09-12T12:13:13.849 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T12:13:13.849 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T12:13:13.849 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T12:13:13.850 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T12:13:13.850 INFO:teuthology.run_tasks:Running task install... 2024-09-12T12:13:13.861 DEBUG:teuthology.task.install:project ceph 2024-09-12T12:13:13.861 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}} 2024-09-12T12:13:13.862 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'} 2024-09-12T12:13:13.862 INFO:teuthology.task.install:Using flavor: default 2024-09-12T12:13:13.868 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T12:13:13.869 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-12T12:13:13.873 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T12:13:13.873 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T12:13:13.875 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T12:13:13.876 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T12:13:13.877 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T12:13:13.877 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T12:13:14.033 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T12:13:14.033 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T12:13:14.052 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T12:13:14.053 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T12:13:14.064 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T12:13:14.065 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T12:13:14.171 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T12:13:14.172 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T12:13:14.172 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T12:13:14.174 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T12:13:14.174 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-12T12:13:14.174 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T12:13:14.189 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T12:13:14.189 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T12:13:14.189 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T12:13:14.200 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T12:13:14.201 DEBUG:teuthology.orchestra.run.smithi102:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T12:13:14.202 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T12:13:14.202 DEBUG:teuthology.orchestra.run.smithi033:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T12:13:14.217 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T12:13:14.218 DEBUG:teuthology.orchestra.run.smithi043:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T12:13:14.265 DEBUG:teuthology.orchestra.run.smithi102:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T12:13:14.268 DEBUG:teuthology.orchestra.run.smithi033:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T12:13:14.286 DEBUG:teuthology.orchestra.run.smithi043:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T12:13:14.340 DEBUG:teuthology.orchestra.run.smithi102:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T12:13:14.344 DEBUG:teuthology.orchestra.run.smithi033:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T12:13:14.364 DEBUG:teuthology.orchestra.run.smithi043:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T12:13:14.405 INFO:teuthology.orchestra.run.smithi102.stdout:check_obsoletes = 1 2024-09-12T12:13:14.406 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum clean all 2024-09-12T12:13:14.410 INFO:teuthology.orchestra.run.smithi033.stdout:check_obsoletes = 1 2024-09-12T12:13:14.411 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum clean all 2024-09-12T12:13:14.432 INFO:teuthology.orchestra.run.smithi043.stdout:check_obsoletes = 1 2024-09-12T12:13:14.433 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum clean all 2024-09-12T12:13:14.634 INFO:teuthology.orchestra.run.smithi102.stdout:45 files removed 2024-09-12T12:13:14.649 INFO:teuthology.orchestra.run.smithi033.stdout:45 files removed 2024-09-12T12:13:14.661 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T12:13:14.678 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T12:13:14.679 INFO:teuthology.orchestra.run.smithi043.stdout:45 files removed 2024-09-12T12:13:14.707 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T12:13:15.216 INFO:teuthology.orchestra.run.smithi102.stdout:ceph packages for x86_64 309 kB/s | 84 kB 00:00 2024-09-12T12:13:15.254 INFO:teuthology.orchestra.run.smithi033.stdout:ceph packages for x86_64 306 kB/s | 84 kB 00:00 2024-09-12T12:13:15.288 INFO:teuthology.orchestra.run.smithi043.stdout:ceph packages for x86_64 297 kB/s | 84 kB 00:00 2024-09-12T12:13:15.500 INFO:teuthology.orchestra.run.smithi102.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-12T12:13:15.546 INFO:teuthology.orchestra.run.smithi033.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-09-12T12:13:15.581 INFO:teuthology.orchestra.run.smithi043.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-09-12T12:13:15.778 INFO:teuthology.orchestra.run.smithi102.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-12T12:13:15.822 INFO:teuthology.orchestra.run.smithi033.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-12T12:13:15.856 INFO:teuthology.orchestra.run.smithi043.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-12T12:13:17.531 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - BaseOS 5.0 MB/s | 8.2 MB 00:01 2024-09-12T12:13:17.578 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.2 MB 00:01 2024-09-12T12:13:17.647 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.2 MB 00:01 2024-09-12T12:13:19.474 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - AppStream 26 MB/s | 20 MB 00:00 2024-09-12T12:13:19.638 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - AppStream 21 MB/s | 20 MB 00:00 2024-09-12T12:13:21.998 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - AppStream 6.4 MB/s | 20 MB 00:03 2024-09-12T12:13:23.942 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-12T12:13:24.039 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-12T12:13:25.498 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - Extras packages 81 kB/s | 19 kB 00:00 2024-09-12T12:13:26.192 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 19 kB 00:00 2024-09-12T12:13:26.415 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-12T12:13:26.562 INFO:teuthology.orchestra.run.smithi102.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-12T12:13:27.122 INFO:teuthology.orchestra.run.smithi043.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-12T12:13:28.141 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 19 kB 00:00 2024-09-12T12:13:29.270 INFO:teuthology.orchestra.run.smithi033.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-12T12:13:31.992 INFO:teuthology.orchestra.run.smithi102.stdout:lab-extras 47 kB/s | 1.7 kB 00:00 2024-09-12T12:13:32.711 INFO:teuthology.orchestra.run.smithi043.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-12T12:13:34.277 INFO:teuthology.orchestra.run.smithi102.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T12:13:34.278 INFO:teuthology.orchestra.run.smithi102.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T12:13:34.289 INFO:teuthology.orchestra.run.smithi102.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T12:13:34.290 INFO:teuthology.orchestra.run.smithi102.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T12:13:34.291 INFO:teuthology.orchestra.run.smithi102.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T12:13:34.292 INFO:teuthology.orchestra.run.smithi102.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T12:13:34.294 INFO:teuthology.orchestra.run.smithi102.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T12:13:34.296 INFO:teuthology.orchestra.run.smithi102.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T12:13:34.297 INFO:teuthology.orchestra.run.smithi102.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T12:13:34.359 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-12T12:13:34.374 INFO:teuthology.orchestra.run.smithi102.stdout:====================================================================================== 2024-09-12T12:13:34.374 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-09-12T12:13:34.374 INFO:teuthology.orchestra.run.smithi102.stdout:====================================================================================== 2024-09-12T12:13:34.374 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-12T12:13:34.374 INFO:teuthology.orchestra.run.smithi102.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T12:13:34.374 INFO:teuthology.orchestra.run.smithi102.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T12:13:34.374 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T12:13:34.374 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T12:13:34.374 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T12:13:34.375 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T12:13:34.375 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T12:13:34.375 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T12:13:34.375 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T12:13:34.375 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T12:13:34.375 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T12:13:34.375 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T12:13:34.375 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T12:13:34.375 INFO:teuthology.orchestra.run.smithi102.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T12:13:34.375 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T12:13:34.376 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T12:13:34.376 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T12:13:34.376 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T12:13:34.376 INFO:teuthology.orchestra.run.smithi102.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T12:13:34.376 INFO:teuthology.orchestra.run.smithi102.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T12:13:34.376 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T12:13:34.376 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T12:13:34.376 INFO:teuthology.orchestra.run.smithi102.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T12:13:34.376 INFO:teuthology.orchestra.run.smithi102.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T12:13:34.376 INFO:teuthology.orchestra.run.smithi102.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T12:13:34.376 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T12:13:34.376 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T12:13:34.377 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T12:13:34.377 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T12:13:34.377 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T12:13:34.377 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T12:13:34.377 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T12:13:34.377 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T12:13:34.377 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T12:13:34.377 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T12:13:34.377 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T12:13:34.377 INFO:teuthology.orchestra.run.smithi102.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T12:13:34.377 INFO:teuthology.orchestra.run.smithi102.stdout:Upgrading: 2024-09-12T12:13:34.378 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T12:13:34.378 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T12:13:34.378 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T12:13:34.378 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T12:13:34.378 INFO:teuthology.orchestra.run.smithi102.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T12:13:34.378 INFO:teuthology.orchestra.run.smithi102.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T12:13:34.378 INFO:teuthology.orchestra.run.smithi102.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T12:13:34.378 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T12:13:34.378 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-09-12T12:13:34.378 INFO:teuthology.orchestra.run.smithi102.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T12:13:34.378 INFO:teuthology.orchestra.run.smithi102.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T12:13:34.378 INFO:teuthology.orchestra.run.smithi102.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T12:13:34.379 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T12:13:34.379 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T12:13:34.379 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T12:13:34.379 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T12:13:34.379 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T12:13:34.379 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T12:13:34.379 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T12:13:34.379 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T12:13:34.379 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T12:13:34.379 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T12:13:34.379 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T12:13:34.379 INFO:teuthology.orchestra.run.smithi102.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T12:13:34.380 INFO:teuthology.orchestra.run.smithi102.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T12:13:34.380 INFO:teuthology.orchestra.run.smithi102.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T12:13:34.380 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T12:13:34.380 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T12:13:34.380 INFO:teuthology.orchestra.run.smithi102.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T12:13:34.380 INFO:teuthology.orchestra.run.smithi102.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T12:13:34.380 INFO:teuthology.orchestra.run.smithi102.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T12:13:34.380 INFO:teuthology.orchestra.run.smithi102.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T12:13:34.380 INFO:teuthology.orchestra.run.smithi102.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T12:13:34.380 INFO:teuthology.orchestra.run.smithi102.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T12:13:34.380 INFO:teuthology.orchestra.run.smithi102.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T12:13:34.380 INFO:teuthology.orchestra.run.smithi102.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T12:13:34.380 INFO:teuthology.orchestra.run.smithi102.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T12:13:34.380 INFO:teuthology.orchestra.run.smithi102.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T12:13:34.381 INFO:teuthology.orchestra.run.smithi102.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T12:13:34.381 INFO:teuthology.orchestra.run.smithi102.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T12:13:34.381 INFO:teuthology.orchestra.run.smithi102.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T12:13:34.381 INFO:teuthology.orchestra.run.smithi102.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T12:13:34.381 INFO:teuthology.orchestra.run.smithi102.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T12:13:34.381 INFO:teuthology.orchestra.run.smithi102.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T12:13:34.381 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T12:13:34.381 INFO:teuthology.orchestra.run.smithi102.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T12:13:34.381 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T12:13:34.381 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T12:13:34.381 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T12:13:34.381 INFO:teuthology.orchestra.run.smithi102.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T12:13:34.381 INFO:teuthology.orchestra.run.smithi102.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T12:13:34.382 INFO:teuthology.orchestra.run.smithi102.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T12:13:34.382 INFO:teuthology.orchestra.run.smithi102.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T12:13:34.382 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T12:13:34.382 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T12:13:34.382 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T12:13:34.382 INFO:teuthology.orchestra.run.smithi102.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T12:13:34.382 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T12:13:34.382 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T12:13:34.382 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T12:13:34.382 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T12:13:34.382 INFO:teuthology.orchestra.run.smithi102.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T12:13:34.382 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T12:13:34.382 INFO:teuthology.orchestra.run.smithi102.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T12:13:34.383 INFO:teuthology.orchestra.run.smithi102.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T12:13:34.383 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T12:13:34.383 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T12:13:34.383 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T12:13:34.383 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T12:13:34.383 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T12:13:34.383 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T12:13:34.383 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T12:13:34.383 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T12:13:34.383 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T12:13:34.383 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T12:13:34.383 INFO:teuthology.orchestra.run.smithi102.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T12:13:34.383 INFO:teuthology.orchestra.run.smithi102.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T12:13:34.383 INFO:teuthology.orchestra.run.smithi102.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T12:13:34.384 INFO:teuthology.orchestra.run.smithi102.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T12:13:34.384 INFO:teuthology.orchestra.run.smithi102.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T12:13:34.384 INFO:teuthology.orchestra.run.smithi102.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T12:13:34.384 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T12:13:34.384 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T12:13:34.384 INFO:teuthology.orchestra.run.smithi102.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T12:13:34.384 INFO:teuthology.orchestra.run.smithi102.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T12:13:34.384 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T12:13:34.384 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T12:13:34.384 INFO:teuthology.orchestra.run.smithi102.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T12:13:34.384 INFO:teuthology.orchestra.run.smithi102.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T12:13:34.384 INFO:teuthology.orchestra.run.smithi102.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T12:13:34.385 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T12:13:34.385 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T12:13:34.385 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T12:13:34.385 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T12:13:34.385 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T12:13:34.385 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T12:13:34.385 INFO:teuthology.orchestra.run.smithi102.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T12:13:34.385 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T12:13:34.385 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T12:13:34.385 INFO:teuthology.orchestra.run.smithi102.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T12:13:34.385 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T12:13:34.385 INFO:teuthology.orchestra.run.smithi102.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T12:13:34.385 INFO:teuthology.orchestra.run.smithi102.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T12:13:34.385 INFO:teuthology.orchestra.run.smithi102.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T12:13:34.386 INFO:teuthology.orchestra.run.smithi102.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T12:13:34.386 INFO:teuthology.orchestra.run.smithi102.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T12:13:34.386 INFO:teuthology.orchestra.run.smithi102.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T12:13:34.386 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T12:13:34.386 INFO:teuthology.orchestra.run.smithi102.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T12:13:34.386 INFO:teuthology.orchestra.run.smithi102.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T12:13:34.386 INFO:teuthology.orchestra.run.smithi102.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T12:13:34.387 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T12:13:34.387 INFO:teuthology.orchestra.run.smithi102.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T12:13:34.387 INFO:teuthology.orchestra.run.smithi102.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T12:13:34.387 INFO:teuthology.orchestra.run.smithi102.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T12:13:34.387 INFO:teuthology.orchestra.run.smithi102.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T12:13:34.387 INFO:teuthology.orchestra.run.smithi102.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T12:13:34.387 INFO:teuthology.orchestra.run.smithi102.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T12:13:34.387 INFO:teuthology.orchestra.run.smithi102.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T12:13:34.387 INFO:teuthology.orchestra.run.smithi102.stdout:Installing weak dependencies: 2024-09-12T12:13:34.387 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T12:13:34.387 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T12:13:34.387 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-12T12:13:34.388 INFO:teuthology.orchestra.run.smithi102.stdout:====================================================================================== 2024-09-12T12:13:34.388 INFO:teuthology.orchestra.run.smithi102.stdout:Install 148 Packages 2024-09-12T12:13:34.388 INFO:teuthology.orchestra.run.smithi102.stdout:Upgrade 8 Packages 2024-09-12T12:13:34.388 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T12:13:34.388 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 226 M 2024-09-12T12:13:34.388 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-12T12:13:34.826 INFO:teuthology.orchestra.run.smithi102.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 51 kB/s | 6.5 kB 00:00 2024-09-12T12:13:34.975 INFO:teuthology.orchestra.run.smithi033.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-12T12:13:35.035 INFO:teuthology.orchestra.run.smithi102.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 4.2 MB/s | 897 kB 00:00 2024-09-12T12:13:35.090 INFO:teuthology.orchestra.run.smithi043.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T12:13:35.091 INFO:teuthology.orchestra.run.smithi043.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T12:13:35.101 INFO:teuthology.orchestra.run.smithi102.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 2.1 MB/s | 145 kB 00:00 2024-09-12T12:13:35.106 INFO:teuthology.orchestra.run.smithi043.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T12:13:35.107 INFO:teuthology.orchestra.run.smithi043.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T12:13:35.108 INFO:teuthology.orchestra.run.smithi043.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T12:13:35.109 INFO:teuthology.orchestra.run.smithi043.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T12:13:35.111 INFO:teuthology.orchestra.run.smithi043.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T12:13:35.114 INFO:teuthology.orchestra.run.smithi043.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T12:13:35.115 INFO:teuthology.orchestra.run.smithi043.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T12:13:35.185 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-09-12T12:13:35.206 INFO:teuthology.orchestra.run.smithi043.stdout:====================================================================================== 2024-09-12T12:13:35.206 INFO:teuthology.orchestra.run.smithi043.stdout: Package Arch Version Repository Size 2024-09-12T12:13:35.207 INFO:teuthology.orchestra.run.smithi043.stdout:====================================================================================== 2024-09-12T12:13:35.207 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2024-09-12T12:13:35.207 INFO:teuthology.orchestra.run.smithi043.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T12:13:35.207 INFO:teuthology.orchestra.run.smithi043.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T12:13:35.207 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T12:13:35.207 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T12:13:35.207 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T12:13:35.207 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T12:13:35.207 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T12:13:35.207 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T12:13:35.207 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T12:13:35.207 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T12:13:35.207 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T12:13:35.208 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T12:13:35.208 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T12:13:35.208 INFO:teuthology.orchestra.run.smithi043.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T12:13:35.208 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T12:13:35.208 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T12:13:35.208 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T12:13:35.208 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T12:13:35.208 INFO:teuthology.orchestra.run.smithi043.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T12:13:35.208 INFO:teuthology.orchestra.run.smithi043.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T12:13:35.208 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T12:13:35.208 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T12:13:35.208 INFO:teuthology.orchestra.run.smithi043.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T12:13:35.208 INFO:teuthology.orchestra.run.smithi043.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T12:13:35.209 INFO:teuthology.orchestra.run.smithi043.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T12:13:35.209 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T12:13:35.209 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T12:13:35.209 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T12:13:35.209 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T12:13:35.209 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T12:13:35.209 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T12:13:35.209 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T12:13:35.209 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T12:13:35.209 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T12:13:35.209 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T12:13:35.209 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T12:13:35.210 INFO:teuthology.orchestra.run.smithi043.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T12:13:35.210 INFO:teuthology.orchestra.run.smithi043.stdout:Upgrading: 2024-09-12T12:13:35.210 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T12:13:35.210 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T12:13:35.210 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T12:13:35.210 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T12:13:35.210 INFO:teuthology.orchestra.run.smithi043.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T12:13:35.210 INFO:teuthology.orchestra.run.smithi043.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T12:13:35.210 INFO:teuthology.orchestra.run.smithi043.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T12:13:35.210 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T12:13:35.210 INFO:teuthology.orchestra.run.smithi043.stdout:Installing dependencies: 2024-09-12T12:13:35.210 INFO:teuthology.orchestra.run.smithi043.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T12:13:35.211 INFO:teuthology.orchestra.run.smithi043.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T12:13:35.211 INFO:teuthology.orchestra.run.smithi043.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T12:13:35.211 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T12:13:35.211 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T12:13:35.211 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T12:13:35.211 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T12:13:35.211 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T12:13:35.211 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T12:13:35.211 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T12:13:35.211 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T12:13:35.211 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T12:13:35.211 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T12:13:35.211 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T12:13:35.211 INFO:teuthology.orchestra.run.smithi043.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T12:13:35.212 INFO:teuthology.orchestra.run.smithi043.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T12:13:35.212 INFO:teuthology.orchestra.run.smithi043.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T12:13:35.212 INFO:teuthology.orchestra.run.smithi043.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T12:13:35.212 INFO:teuthology.orchestra.run.smithi043.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T12:13:35.212 INFO:teuthology.orchestra.run.smithi043.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T12:13:35.212 INFO:teuthology.orchestra.run.smithi043.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T12:13:35.212 INFO:teuthology.orchestra.run.smithi043.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T12:13:35.212 INFO:teuthology.orchestra.run.smithi043.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T12:13:35.212 INFO:teuthology.orchestra.run.smithi043.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T12:13:35.212 INFO:teuthology.orchestra.run.smithi043.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T12:13:35.212 INFO:teuthology.orchestra.run.smithi043.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T12:13:35.212 INFO:teuthology.orchestra.run.smithi043.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T12:13:35.212 INFO:teuthology.orchestra.run.smithi043.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T12:13:35.213 INFO:teuthology.orchestra.run.smithi043.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T12:13:35.213 INFO:teuthology.orchestra.run.smithi043.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T12:13:35.213 INFO:teuthology.orchestra.run.smithi043.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T12:13:35.213 INFO:teuthology.orchestra.run.smithi043.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T12:13:35.213 INFO:teuthology.orchestra.run.smithi043.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T12:13:35.213 INFO:teuthology.orchestra.run.smithi043.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T12:13:35.213 INFO:teuthology.orchestra.run.smithi043.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T12:13:35.213 INFO:teuthology.orchestra.run.smithi043.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T12:13:35.213 INFO:teuthology.orchestra.run.smithi043.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T12:13:35.213 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T12:13:35.213 INFO:teuthology.orchestra.run.smithi043.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T12:13:35.213 INFO:teuthology.orchestra.run.smithi043.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T12:13:35.213 INFO:teuthology.orchestra.run.smithi043.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T12:13:35.214 INFO:teuthology.orchestra.run.smithi043.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T12:13:35.214 INFO:teuthology.orchestra.run.smithi043.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T12:13:35.214 INFO:teuthology.orchestra.run.smithi043.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T12:13:35.214 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T12:13:35.214 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T12:13:35.214 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T12:13:35.214 INFO:teuthology.orchestra.run.smithi043.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T12:13:35.214 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T12:13:35.214 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T12:13:35.215 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T12:13:35.215 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T12:13:35.215 INFO:teuthology.orchestra.run.smithi043.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T12:13:35.215 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T12:13:35.215 INFO:teuthology.orchestra.run.smithi043.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T12:13:35.215 INFO:teuthology.orchestra.run.smithi043.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T12:13:35.215 INFO:teuthology.orchestra.run.smithi043.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T12:13:35.215 INFO:teuthology.orchestra.run.smithi043.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T12:13:35.215 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T12:13:35.215 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T12:13:35.215 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T12:13:35.215 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T12:13:35.215 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T12:13:35.216 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T12:13:35.216 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T12:13:35.216 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T12:13:35.216 INFO:teuthology.orchestra.run.smithi043.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T12:13:35.216 INFO:teuthology.orchestra.run.smithi043.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T12:13:35.216 INFO:teuthology.orchestra.run.smithi043.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T12:13:35.216 INFO:teuthology.orchestra.run.smithi043.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T12:13:35.216 INFO:teuthology.orchestra.run.smithi043.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T12:13:35.216 INFO:teuthology.orchestra.run.smithi043.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T12:13:35.216 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T12:13:35.216 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T12:13:35.216 INFO:teuthology.orchestra.run.smithi043.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T12:13:35.216 INFO:teuthology.orchestra.run.smithi043.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T12:13:35.216 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T12:13:35.217 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T12:13:35.217 INFO:teuthology.orchestra.run.smithi043.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T12:13:35.217 INFO:teuthology.orchestra.run.smithi043.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T12:13:35.217 INFO:teuthology.orchestra.run.smithi043.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T12:13:35.217 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T12:13:35.217 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T12:13:35.217 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T12:13:35.217 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T12:13:35.217 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T12:13:35.217 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T12:13:35.217 INFO:teuthology.orchestra.run.smithi043.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T12:13:35.217 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T12:13:35.218 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T12:13:35.218 INFO:teuthology.orchestra.run.smithi043.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T12:13:35.218 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T12:13:35.218 INFO:teuthology.orchestra.run.smithi043.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T12:13:35.218 INFO:teuthology.orchestra.run.smithi043.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T12:13:35.218 INFO:teuthology.orchestra.run.smithi043.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T12:13:35.218 INFO:teuthology.orchestra.run.smithi043.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T12:13:35.218 INFO:teuthology.orchestra.run.smithi043.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T12:13:35.218 INFO:teuthology.orchestra.run.smithi043.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T12:13:35.218 INFO:teuthology.orchestra.run.smithi043.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T12:13:35.218 INFO:teuthology.orchestra.run.smithi043.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T12:13:35.218 INFO:teuthology.orchestra.run.smithi043.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T12:13:35.218 INFO:teuthology.orchestra.run.smithi043.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T12:13:35.218 INFO:teuthology.orchestra.run.smithi043.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T12:13:35.219 INFO:teuthology.orchestra.run.smithi043.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T12:13:35.219 INFO:teuthology.orchestra.run.smithi043.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T12:13:35.219 INFO:teuthology.orchestra.run.smithi043.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T12:13:35.219 INFO:teuthology.orchestra.run.smithi043.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T12:13:35.219 INFO:teuthology.orchestra.run.smithi043.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T12:13:35.219 INFO:teuthology.orchestra.run.smithi043.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T12:13:35.219 INFO:teuthology.orchestra.run.smithi043.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T12:13:35.220 INFO:teuthology.orchestra.run.smithi043.stdout:Installing weak dependencies: 2024-09-12T12:13:35.220 INFO:teuthology.orchestra.run.smithi043.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T12:13:35.220 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T12:13:35.220 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2024-09-12T12:13:35.220 INFO:teuthology.orchestra.run.smithi043.stdout:====================================================================================== 2024-09-12T12:13:35.220 INFO:teuthology.orchestra.run.smithi043.stdout:Install 148 Packages 2024-09-12T12:13:35.220 INFO:teuthology.orchestra.run.smithi043.stdout:Upgrade 8 Packages 2024-09-12T12:13:35.220 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T12:13:35.221 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 226 M 2024-09-12T12:13:35.221 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2024-09-12T12:13:35.235 INFO:teuthology.orchestra.run.smithi102.stdout:(4/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 10 MB/s | 5.4 MB 00:00 2024-09-12T12:13:35.319 INFO:teuthology.orchestra.run.smithi102.stdout:(5/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 11 MB/s | 2.4 MB 00:00 2024-09-12T12:13:35.369 INFO:teuthology.orchestra.run.smithi102.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 11 MB/s | 1.5 MB 00:00 2024-09-12T12:13:35.703 INFO:teuthology.orchestra.run.smithi102.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 12 MB/s | 4.7 MB 00:00 2024-09-12T12:13:35.804 INFO:teuthology.orchestra.run.smithi043.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 33 kB/s | 6.5 kB 00:00 2024-09-12T12:13:35.986 INFO:teuthology.orchestra.run.smithi102.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 16 MB/s | 21 MB 00:01 2024-09-12T12:13:36.045 INFO:teuthology.orchestra.run.smithi102.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 433 kB/s | 25 kB 00:00 2024-09-12T12:13:36.271 INFO:teuthology.orchestra.run.smithi043.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.9 MB/s | 897 kB 00:00 2024-09-12T12:13:36.388 INFO:teuthology.orchestra.run.smithi043.stdout:(3/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 6.9 MB/s | 5.4 MB 00:00 2024-09-12T12:13:36.413 INFO:teuthology.orchestra.run.smithi043.stdout:(4/156): ceph-immutable-object-cache-19.1.1-298 1.0 MB/s | 145 kB 00:00 2024-09-12T12:13:36.437 INFO:teuthology.orchestra.run.smithi102.stdout:(10/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 16 MB/s | 17 MB 00:01 2024-09-12T12:13:36.554 INFO:teuthology.orchestra.run.smithi102.stdout:(11/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 12 MB/s | 11 MB 00:00 2024-09-12T12:13:36.555 INFO:teuthology.orchestra.run.smithi043.stdout:(5/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 14 MB/s | 2.4 MB 00:00 2024-09-12T12:13:36.579 INFO:teuthology.orchestra.run.smithi102.stdout:(12/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 1.6 MB/s | 228 kB 00:00 2024-09-12T12:13:36.604 INFO:teuthology.orchestra.run.smithi102.stdout:(13/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 540 kB/s | 27 kB 00:00 2024-09-12T12:13:36.638 INFO:teuthology.orchestra.run.smithi102.stdout:(14/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 542 kB/s | 32 kB 00:00 2024-09-12T12:13:36.705 INFO:teuthology.orchestra.run.smithi102.stdout:(15/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 7.3 MB/s | 752 kB 00:00 2024-09-12T12:13:36.730 INFO:teuthology.orchestra.run.smithi102.stdout:(16/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 1.7 MB/s | 163 kB 00:00 2024-09-12T12:13:36.763 INFO:teuthology.orchestra.run.smithi102.stdout:(17/156): librados-devel-19.1.1-298.gb53b6d3e.e 2.1 MB/s | 127 kB 00:00 2024-09-12T12:13:36.764 INFO:teuthology.orchestra.run.smithi043.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 4.3 MB/s | 1.5 MB 00:00 2024-09-12T12:13:36.797 INFO:teuthology.orchestra.run.smithi102.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 7.4 MB/s | 506 kB 00:00 2024-09-12T12:13:36.881 INFO:teuthology.orchestra.run.smithi102.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 541 kB/s | 45 kB 00:00 2024-09-12T12:13:36.955 INFO:teuthology.orchestra.run.smithi043.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 12 MB/s | 4.7 MB 00:00 2024-09-12T12:13:36.956 INFO:teuthology.orchestra.run.smithi102.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 1.8 MB/s | 136 kB 00:00 2024-09-12T12:13:37.049 INFO:teuthology.orchestra.run.smithi102.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 1.7 MB/s | 162 kB 00:00 2024-09-12T12:13:37.132 INFO:teuthology.orchestra.run.smithi102.stdout:(22/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 15 MB/s | 5.3 MB 00:00 2024-09-12T12:13:37.157 INFO:teuthology.orchestra.run.smithi102.stdout:(23/156): python3-rados-19.1.1-298.gb53b6d3e.el 2.9 MB/s | 321 kB 00:00 2024-09-12T12:13:37.216 INFO:teuthology.orchestra.run.smithi102.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 3.5 MB/s | 301 kB 00:00 2024-09-12T12:13:37.241 INFO:teuthology.orchestra.run.smithi102.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.2 MB/s | 100 kB 00:00 2024-09-12T12:13:37.283 INFO:teuthology.orchestra.run.smithi102.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.2 MB/s | 85 kB 00:00 2024-09-12T12:13:37.354 INFO:teuthology.orchestra.run.smithi033.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T12:13:37.355 INFO:teuthology.orchestra.run.smithi033.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T12:13:37.366 INFO:teuthology.orchestra.run.smithi102.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 2.0 MB/s | 171 kB 00:00 2024-09-12T12:13:37.367 INFO:teuthology.orchestra.run.smithi033.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T12:13:37.368 INFO:teuthology.orchestra.run.smithi033.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T12:13:37.369 INFO:teuthology.orchestra.run.smithi033.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T12:13:37.370 INFO:teuthology.orchestra.run.smithi033.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T12:13:37.371 INFO:teuthology.orchestra.run.smithi033.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T12:13:37.374 INFO:teuthology.orchestra.run.smithi033.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T12:13:37.375 INFO:teuthology.orchestra.run.smithi033.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T12:13:37.443 INFO:teuthology.orchestra.run.smithi102.stdout:(28/156): ceph-grafana-dashboards-19.1.1-298.gb 425 kB/s | 32 kB 00:00 2024-09-12T12:13:37.444 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-09-12T12:13:37.458 INFO:teuthology.orchestra.run.smithi033.stdout:====================================================================================== 2024-09-12T12:13:37.459 INFO:teuthology.orchestra.run.smithi033.stdout: Package Arch Version Repository Size 2024-09-12T12:13:37.459 INFO:teuthology.orchestra.run.smithi033.stdout:====================================================================================== 2024-09-12T12:13:37.459 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2024-09-12T12:13:37.459 INFO:teuthology.orchestra.run.smithi033.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T12:13:37.459 INFO:teuthology.orchestra.run.smithi033.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T12:13:37.459 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T12:13:37.459 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T12:13:37.459 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T12:13:37.459 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T12:13:37.459 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T12:13:37.459 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T12:13:37.459 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T12:13:37.460 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T12:13:37.460 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T12:13:37.460 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T12:13:37.460 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T12:13:37.460 INFO:teuthology.orchestra.run.smithi033.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T12:13:37.460 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T12:13:37.460 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T12:13:37.460 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T12:13:37.460 INFO:teuthology.orchestra.run.smithi033.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T12:13:37.460 INFO:teuthology.orchestra.run.smithi033.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T12:13:37.461 INFO:teuthology.orchestra.run.smithi033.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T12:13:37.461 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T12:13:37.461 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T12:13:37.461 INFO:teuthology.orchestra.run.smithi033.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T12:13:37.461 INFO:teuthology.orchestra.run.smithi033.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T12:13:37.461 INFO:teuthology.orchestra.run.smithi033.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T12:13:37.461 INFO:teuthology.orchestra.run.smithi033.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T12:13:37.461 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T12:13:37.462 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T12:13:37.462 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T12:13:37.462 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T12:13:37.462 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T12:13:37.462 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T12:13:37.462 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T12:13:37.462 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T12:13:37.462 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T12:13:37.462 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T12:13:37.462 INFO:teuthology.orchestra.run.smithi033.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T12:13:37.462 INFO:teuthology.orchestra.run.smithi033.stdout:Upgrading: 2024-09-12T12:13:37.462 INFO:teuthology.orchestra.run.smithi033.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T12:13:37.462 INFO:teuthology.orchestra.run.smithi033.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T12:13:37.463 INFO:teuthology.orchestra.run.smithi033.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T12:13:37.463 INFO:teuthology.orchestra.run.smithi033.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T12:13:37.463 INFO:teuthology.orchestra.run.smithi033.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T12:13:37.463 INFO:teuthology.orchestra.run.smithi033.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T12:13:37.463 INFO:teuthology.orchestra.run.smithi033.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T12:13:37.463 INFO:teuthology.orchestra.run.smithi033.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T12:13:37.463 INFO:teuthology.orchestra.run.smithi033.stdout:Installing dependencies: 2024-09-12T12:13:37.463 INFO:teuthology.orchestra.run.smithi033.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T12:13:37.464 INFO:teuthology.orchestra.run.smithi033.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T12:13:37.464 INFO:teuthology.orchestra.run.smithi033.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T12:13:37.464 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T12:13:37.464 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T12:13:37.464 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T12:13:37.464 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T12:13:37.464 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T12:13:37.464 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T12:13:37.464 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T12:13:37.464 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T12:13:37.464 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T12:13:37.464 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T12:13:37.465 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T12:13:37.465 INFO:teuthology.orchestra.run.smithi033.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T12:13:37.465 INFO:teuthology.orchestra.run.smithi033.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T12:13:37.465 INFO:teuthology.orchestra.run.smithi033.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T12:13:37.465 INFO:teuthology.orchestra.run.smithi033.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T12:13:37.465 INFO:teuthology.orchestra.run.smithi033.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T12:13:37.465 INFO:teuthology.orchestra.run.smithi033.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T12:13:37.465 INFO:teuthology.orchestra.run.smithi033.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T12:13:37.465 INFO:teuthology.orchestra.run.smithi033.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T12:13:37.465 INFO:teuthology.orchestra.run.smithi033.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T12:13:37.465 INFO:teuthology.orchestra.run.smithi033.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T12:13:37.465 INFO:teuthology.orchestra.run.smithi033.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T12:13:37.466 INFO:teuthology.orchestra.run.smithi033.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T12:13:37.466 INFO:teuthology.orchestra.run.smithi033.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T12:13:37.466 INFO:teuthology.orchestra.run.smithi033.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T12:13:37.466 INFO:teuthology.orchestra.run.smithi033.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T12:13:37.466 INFO:teuthology.orchestra.run.smithi033.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T12:13:37.466 INFO:teuthology.orchestra.run.smithi033.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T12:13:37.466 INFO:teuthology.orchestra.run.smithi033.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T12:13:37.466 INFO:teuthology.orchestra.run.smithi033.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T12:13:37.466 INFO:teuthology.orchestra.run.smithi033.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T12:13:37.466 INFO:teuthology.orchestra.run.smithi033.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T12:13:37.466 INFO:teuthology.orchestra.run.smithi033.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T12:13:37.466 INFO:teuthology.orchestra.run.smithi033.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T12:13:37.467 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T12:13:37.467 INFO:teuthology.orchestra.run.smithi033.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T12:13:37.467 INFO:teuthology.orchestra.run.smithi033.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T12:13:37.467 INFO:teuthology.orchestra.run.smithi033.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T12:13:37.467 INFO:teuthology.orchestra.run.smithi033.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T12:13:37.467 INFO:teuthology.orchestra.run.smithi033.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T12:13:37.467 INFO:teuthology.orchestra.run.smithi033.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T12:13:37.467 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T12:13:37.467 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T12:13:37.467 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T12:13:37.467 INFO:teuthology.orchestra.run.smithi033.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T12:13:37.467 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T12:13:37.467 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T12:13:37.467 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T12:13:37.467 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T12:13:37.468 INFO:teuthology.orchestra.run.smithi033.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T12:13:37.468 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T12:13:37.468 INFO:teuthology.orchestra.run.smithi033.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T12:13:37.468 INFO:teuthology.orchestra.run.smithi033.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T12:13:37.468 INFO:teuthology.orchestra.run.smithi033.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T12:13:37.468 INFO:teuthology.orchestra.run.smithi033.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T12:13:37.468 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T12:13:37.468 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T12:13:37.468 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T12:13:37.468 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T12:13:37.468 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T12:13:37.468 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T12:13:37.468 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T12:13:37.468 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T12:13:37.469 INFO:teuthology.orchestra.run.smithi033.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T12:13:37.469 INFO:teuthology.orchestra.run.smithi033.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T12:13:37.469 INFO:teuthology.orchestra.run.smithi033.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T12:13:37.469 INFO:teuthology.orchestra.run.smithi033.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T12:13:37.469 INFO:teuthology.orchestra.run.smithi033.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T12:13:37.469 INFO:teuthology.orchestra.run.smithi033.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T12:13:37.469 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T12:13:37.469 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T12:13:37.469 INFO:teuthology.orchestra.run.smithi033.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T12:13:37.469 INFO:teuthology.orchestra.run.smithi033.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T12:13:37.469 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T12:13:37.469 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T12:13:37.469 INFO:teuthology.orchestra.run.smithi033.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T12:13:37.469 INFO:teuthology.orchestra.run.smithi033.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T12:13:37.470 INFO:teuthology.orchestra.run.smithi033.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T12:13:37.470 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T12:13:37.470 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T12:13:37.470 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T12:13:37.470 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T12:13:37.470 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T12:13:37.470 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T12:13:37.470 INFO:teuthology.orchestra.run.smithi033.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T12:13:37.470 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T12:13:37.470 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T12:13:37.470 INFO:teuthology.orchestra.run.smithi033.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T12:13:37.470 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T12:13:37.470 INFO:teuthology.orchestra.run.smithi033.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T12:13:37.470 INFO:teuthology.orchestra.run.smithi033.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T12:13:37.470 INFO:teuthology.orchestra.run.smithi033.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T12:13:37.471 INFO:teuthology.orchestra.run.smithi033.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T12:13:37.471 INFO:teuthology.orchestra.run.smithi033.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T12:13:37.471 INFO:teuthology.orchestra.run.smithi033.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T12:13:37.471 INFO:teuthology.orchestra.run.smithi033.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T12:13:37.471 INFO:teuthology.orchestra.run.smithi033.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T12:13:37.471 INFO:teuthology.orchestra.run.smithi033.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T12:13:37.471 INFO:teuthology.orchestra.run.smithi033.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T12:13:37.471 INFO:teuthology.orchestra.run.smithi033.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T12:13:37.471 INFO:teuthology.orchestra.run.smithi033.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T12:13:37.471 INFO:teuthology.orchestra.run.smithi033.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T12:13:37.471 INFO:teuthology.orchestra.run.smithi033.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T12:13:37.471 INFO:teuthology.orchestra.run.smithi033.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T12:13:37.471 INFO:teuthology.orchestra.run.smithi033.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T12:13:37.472 INFO:teuthology.orchestra.run.smithi033.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T12:13:37.472 INFO:teuthology.orchestra.run.smithi033.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T12:13:37.472 INFO:teuthology.orchestra.run.smithi033.stdout:Installing weak dependencies: 2024-09-12T12:13:37.472 INFO:teuthology.orchestra.run.smithi033.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T12:13:37.472 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:13:37.472 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-09-12T12:13:37.472 INFO:teuthology.orchestra.run.smithi033.stdout:====================================================================================== 2024-09-12T12:13:37.472 INFO:teuthology.orchestra.run.smithi033.stdout:Install 148 Packages 2024-09-12T12:13:37.472 INFO:teuthology.orchestra.run.smithi033.stdout:Upgrade 8 Packages 2024-09-12T12:13:37.472 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:13:37.473 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 226 M 2024-09-12T12:13:37.473 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-09-12T12:13:37.525 INFO:teuthology.orchestra.run.smithi102.stdout:(29/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 1.7 MB/s | 146 kB 00:00 2024-09-12T12:13:37.667 INFO:teuthology.orchestra.run.smithi102.stdout:(30/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 7.3 MB/s | 3.1 MB 00:00 2024-09-12T12:13:37.909 INFO:teuthology.orchestra.run.smithi102.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 9.3 MB/s | 3.6 MB 00:00 2024-09-12T12:13:37.993 INFO:teuthology.orchestra.run.smithi102.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 2.9 MB/s | 249 kB 00:00 2024-09-12T12:13:38.052 INFO:teuthology.orchestra.run.smithi102.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 845 kB/s | 49 kB 00:00 2024-09-12T12:13:38.072 INFO:teuthology.orchestra.run.smithi043.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 8.6 MB/s | 21 MB 00:02 2024-09-12T12:13:38.093 INFO:teuthology.orchestra.run.smithi102.stdout:(34/156): ceph-prometheus-alerts-19.1.1-298.gb5 397 kB/s | 16 kB 00:00 2024-09-12T12:13:38.127 INFO:teuthology.orchestra.run.smithi033.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 38 kB/s | 6.5 kB 00:00 2024-09-12T12:13:38.181 INFO:teuthology.orchestra.run.smithi043.stdout:(9/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9. 8.7 MB/s | 11 MB 00:01 2024-09-12T12:13:38.185 INFO:teuthology.orchestra.run.smithi102.stdout:(35/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 3.0 MB/s | 285 kB 00:00 2024-09-12T12:13:38.206 INFO:teuthology.orchestra.run.smithi043.stdout:(10/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9 189 kB/s | 25 kB 00:00 2024-09-12T12:13:38.290 INFO:teuthology.orchestra.run.smithi043.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 2.7 MB/s | 228 kB 00:00 2024-09-12T12:13:38.373 INFO:teuthology.orchestra.run.smithi043.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 325 kB/s | 27 kB 00:00 2024-09-12T12:13:38.449 INFO:teuthology.orchestra.run.smithi043.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 422 kB/s | 32 kB 00:00 2024-09-12T12:13:38.469 INFO:teuthology.orchestra.run.smithi102.stdout:(36/156): ceph-mgr-diskprediction-local-19.1.1- 9.2 MB/s | 7.4 MB 00:00 2024-09-12T12:13:38.494 INFO:teuthology.orchestra.run.smithi102.stdout:(37/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 2.4 MB/s | 765 kB 00:00 2024-09-12T12:13:38.553 INFO:teuthology.orchestra.run.smithi102.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 218 kB/s | 18 kB 00:00 2024-09-12T12:13:38.574 INFO:teuthology.orchestra.run.smithi043.stdout:(14/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 5.9 MB/s | 752 kB 00:00 2024-09-12T12:13:38.628 INFO:teuthology.orchestra.run.smithi102.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 597 kB/s | 80 kB 00:00 2024-09-12T12:13:38.649 INFO:teuthology.orchestra.run.smithi043.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.1 MB/s | 163 kB 00:00 2024-09-12T12:13:38.712 INFO:teuthology.orchestra.run.smithi102.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-12T12:13:38.718 INFO:teuthology.orchestra.run.smithi033.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.5 MB/s | 897 kB 00:00 2024-09-12T12:13:38.794 INFO:teuthology.orchestra.run.smithi033.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 1.9 MB/s | 145 kB 00:00 2024-09-12T12:13:38.795 INFO:teuthology.orchestra.run.smithi102.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-09-12T12:13:38.857 INFO:teuthology.orchestra.run.smithi102.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.6 MB/s | 801 kB 00:00 2024-09-12T12:13:38.925 INFO:teuthology.orchestra.run.smithi043.stdout:(16/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 7.8 MB/s | 17 MB 00:02 2024-09-12T12:13:38.950 INFO:teuthology.orchestra.run.smithi043.stdout:(17/156): librados-devel-19.1.1-298.gb53b6d3e.e 421 kB/s | 127 kB 00:00 2024-09-12T12:13:38.992 INFO:teuthology.orchestra.run.smithi043.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 7.4 MB/s | 506 kB 00:00 2024-09-12T12:13:39.059 INFO:teuthology.orchestra.run.smithi043.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 679 kB/s | 45 kB 00:00 2024-09-12T12:13:39.126 INFO:teuthology.orchestra.run.smithi043.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 2.0 MB/s | 136 kB 00:00 2024-09-12T12:13:39.193 INFO:teuthology.orchestra.run.smithi043.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 2.4 MB/s | 162 kB 00:00 2024-09-12T12:13:39.244 INFO:teuthology.orchestra.run.smithi033.stdout:(4/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 5.3 MB/s | 2.4 MB 00:00 2024-09-12T12:13:39.260 INFO:teuthology.orchestra.run.smithi043.stdout:(22/156): python3-rados-19.1.1-298.gb53b6d3e.el 4.7 MB/s | 321 kB 00:00 2024-09-12T12:13:39.279 INFO:teuthology.orchestra.run.smithi102.stdout:(43/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 15 MB/s | 49 MB 00:03 2024-09-12T12:13:39.305 INFO:teuthology.orchestra.run.smithi102.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 236 kB/s | 106 kB 00:00 2024-09-12T12:13:39.335 INFO:teuthology.orchestra.run.smithi043.stdout:(23/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 14 MB/s | 5.3 MB 00:00 2024-09-12T12:13:39.360 INFO:teuthology.orchestra.run.smithi043.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 2.9 MB/s | 301 kB 00:00 2024-09-12T12:13:39.386 INFO:teuthology.orchestra.run.smithi043.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.9 MB/s | 100 kB 00:00 2024-09-12T12:13:39.397 INFO:teuthology.orchestra.run.smithi102.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-09-12T12:13:39.411 INFO:teuthology.orchestra.run.smithi043.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-12T12:13:39.411 INFO:teuthology.orchestra.run.smithi033.stdout:(5/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 3.7 MB/s | 5.4 MB 00:01 2024-09-12T12:13:39.464 INFO:teuthology.orchestra.run.smithi102.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 736 kB/s | 135 kB 00:00 2024-09-12T12:13:39.473 INFO:teuthology.orchestra.run.smithi033.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 6.8 MB/s | 1.5 MB 00:00 2024-09-12T12:13:39.486 INFO:teuthology.orchestra.run.smithi043.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 2.2 MB/s | 171 kB 00:00 2024-09-12T12:13:39.488 INFO:teuthology.orchestra.run.smithi102.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-09-12T12:13:39.556 INFO:teuthology.orchestra.run.smithi102.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 1.6 MB/s | 1.2 MB 00:00 2024-09-12T12:13:39.561 INFO:teuthology.orchestra.run.smithi043.stdout:(28/156): ceph-grafana-dashboards-19.1.1-298.gb 426 kB/s | 32 kB 00:00 2024-09-12T12:13:39.612 INFO:teuthology.orchestra.run.smithi043.stdout:(29/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 14 MB/s | 3.1 MB 00:00 2024-09-12T12:13:39.637 INFO:teuthology.orchestra.run.smithi043.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 1.9 MB/s | 146 kB 00:00 2024-09-12T12:13:39.971 INFO:teuthology.orchestra.run.smithi043.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 9.9 MB/s | 3.6 MB 00:00 2024-09-12T12:13:40.053 INFO:teuthology.orchestra.run.smithi033.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 7.3 MB/s | 4.7 MB 00:00 2024-09-12T12:13:40.054 INFO:teuthology.orchestra.run.smithi043.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 2.9 MB/s | 249 kB 00:00 2024-09-12T12:13:40.138 INFO:teuthology.orchestra.run.smithi043.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 591 kB/s | 49 kB 00:00 2024-09-12T12:13:40.239 INFO:teuthology.orchestra.run.smithi102.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 156 kB/s | 107 kB 00:00 2024-09-12T12:13:40.247 INFO:teuthology.orchestra.run.smithi043.stdout:(34/156): ceph-mgr-diskprediction-local-19.1.1- 12 MB/s | 7.4 MB 00:00 2024-09-12T12:13:40.263 INFO:teuthology.orchestra.run.smithi043.stdout:(35/156): ceph-prometheus-alerts-19.1.1-298.gb5 131 kB/s | 16 kB 00:00 2024-09-12T12:13:40.330 INFO:teuthology.orchestra.run.smithi043.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 3.3 MB/s | 285 kB 00:00 2024-09-12T12:13:40.356 INFO:teuthology.orchestra.run.smithi102.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 772 kB/s | 689 kB 00:00 2024-09-12T12:13:40.364 INFO:teuthology.orchestra.run.smithi043.stdout:(37/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 7.4 MB/s | 765 kB 00:00 2024-09-12T12:13:40.390 INFO:teuthology.orchestra.run.smithi102.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 1.0 MB/s | 943 kB 00:00 2024-09-12T12:13:40.406 INFO:teuthology.orchestra.run.smithi043.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 243 kB/s | 18 kB 00:00 2024-09-12T12:13:40.473 INFO:teuthology.orchestra.run.smithi043.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 735 kB/s | 80 kB 00:00 2024-09-12T12:13:40.548 INFO:teuthology.orchestra.run.smithi043.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 2.5 MB/s | 191 kB 00:00 2024-09-12T12:13:40.590 INFO:teuthology.orchestra.run.smithi043.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 4.3 MB/s | 801 kB 00:00 2024-09-12T12:13:40.615 INFO:teuthology.orchestra.run.smithi043.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-09-12T12:13:40.657 INFO:teuthology.orchestra.run.smithi043.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-12T12:13:40.699 INFO:teuthology.orchestra.run.smithi043.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.2 MB 00:00 2024-09-12T12:13:40.725 INFO:teuthology.orchestra.run.smithi043.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-09-12T12:13:40.750 INFO:teuthology.orchestra.run.smithi043.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-12T12:13:40.784 INFO:teuthology.orchestra.run.smithi043.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-12T12:13:40.806 INFO:teuthology.orchestra.run.smithi102.stdout:(52/156): elfutils-libelf-devel-0.191-4.el9.x86 38 kB/s | 22 kB 00:00 2024-09-12T12:13:40.828 INFO:teuthology.orchestra.run.smithi033.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 7.4 MB/s | 21 MB 00:02 2024-09-12T12:13:40.948 INFO:teuthology.orchestra.run.smithi102.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 59 kB/s | 33 kB 00:00 2024-09-12T12:13:40.962 INFO:teuthology.orchestra.run.smithi033.stdout:(9/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9. 12 MB/s | 11 MB 00:00 2024-09-12T12:13:40.967 INFO:teuthology.orchestra.run.smithi043.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 3.1 MB/s | 689 kB 00:00 2024-09-12T12:13:40.987 INFO:teuthology.orchestra.run.smithi033.stdout:(10/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9 159 kB/s | 25 kB 00:00 2024-09-12T12:13:41.001 INFO:teuthology.orchestra.run.smithi043.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 4.2 MB/s | 943 kB 00:00 2024-09-12T12:13:41.035 INFO:teuthology.orchestra.run.smithi043.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-09-12T12:13:41.060 INFO:teuthology.orchestra.run.smithi043.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 371 kB/s | 22 kB 00:00 2024-09-12T12:13:41.085 INFO:teuthology.orchestra.run.smithi043.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-09-12T12:13:41.110 INFO:teuthology.orchestra.run.smithi043.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 651 kB/s | 33 kB 00:00 2024-09-12T12:13:41.149 INFO:teuthology.orchestra.run.smithi102.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 396 kB/s | 313 kB 00:00 2024-09-12T12:13:41.152 INFO:teuthology.orchestra.run.smithi043.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 436 kB/s | 18 kB 00:00 2024-09-12T12:13:41.162 INFO:teuthology.orchestra.run.smithi033.stdout:(11/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 10 MB/s | 17 MB 00:01 2024-09-12T12:13:41.188 INFO:teuthology.orchestra.run.smithi033.stdout:(12/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 1.1 MB/s | 228 kB 00:00 2024-09-12T12:13:41.194 INFO:teuthology.orchestra.run.smithi043.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 269 kB/s | 11 kB 00:00 2024-09-12T12:13:41.204 INFO:teuthology.orchestra.run.smithi033.stdout:(13/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 649 kB/s | 27 kB 00:00 2024-09-12T12:13:41.230 INFO:teuthology.orchestra.run.smithi033.stdout:(14/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 755 kB/s | 32 kB 00:00 2024-09-12T12:13:41.245 INFO:teuthology.orchestra.run.smithi043.stdout:(56/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 19 MB/s | 3.0 MB 00:00 2024-09-12T12:13:41.270 INFO:teuthology.orchestra.run.smithi043.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-09-12T12:13:41.280 INFO:teuthology.orchestra.run.smithi033.stdout:(15/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 9.7 MB/s | 752 kB 00:00 2024-09-12T12:13:41.295 INFO:teuthology.orchestra.run.smithi043.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 906 kB/s | 45 kB 00:00 2024-09-12T12:13:41.306 INFO:teuthology.orchestra.run.smithi033.stdout:(16/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.1 MB/s | 163 kB 00:00 2024-09-12T12:13:41.339 INFO:teuthology.orchestra.run.smithi033.stdout:(17/156): librados-devel-19.1.1-298.gb53b6d3e.e 2.1 MB/s | 127 kB 00:00 2024-09-12T12:13:41.381 INFO:teuthology.orchestra.run.smithi033.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 6.6 MB/s | 506 kB 00:00 2024-09-12T12:13:41.450 INFO:teuthology.orchestra.run.smithi102.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 36 kB/s | 18 kB 00:00 2024-09-12T12:13:41.456 INFO:teuthology.orchestra.run.smithi033.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 602 kB/s | 45 kB 00:00 2024-09-12T12:13:41.532 INFO:teuthology.orchestra.run.smithi033.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 1.8 MB/s | 136 kB 00:00 2024-09-12T12:13:41.607 INFO:teuthology.orchestra.run.smithi033.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 2.1 MB/s | 162 kB 00:00 2024-09-12T12:13:41.641 INFO:teuthology.orchestra.run.smithi102.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 23 kB/s | 11 kB 00:00 2024-09-12T12:13:41.707 INFO:teuthology.orchestra.run.smithi033.stdout:(22/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 15 MB/s | 5.3 MB 00:00 2024-09-12T12:13:41.729 INFO:teuthology.orchestra.run.smithi043.stdout:(59/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 14 MB/s | 49 MB 00:03 2024-09-12T12:13:41.732 INFO:teuthology.orchestra.run.smithi033.stdout:(23/156): python3-rados-19.1.1-298.gb53b6d3e.el 2.5 MB/s | 321 kB 00:00 2024-09-12T12:13:41.754 INFO:teuthology.orchestra.run.smithi043.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 1.3 MB/s | 662 kB 00:00 2024-09-12T12:13:41.757 INFO:teuthology.orchestra.run.smithi033.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 5.9 MB/s | 301 kB 00:00 2024-09-12T12:13:41.783 INFO:teuthology.orchestra.run.smithi033.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.9 MB/s | 100 kB 00:00 2024-09-12T12:13:41.788 INFO:teuthology.orchestra.run.smithi043.stdout:(61/156): libtool-2.4.6-46.el9.x86_64.rpm 1.2 MB/s | 581 kB 00:00 2024-09-12T12:13:41.808 INFO:teuthology.orchestra.run.smithi033.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-12T12:13:41.813 INFO:teuthology.orchestra.run.smithi043.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 813 kB/s | 47 kB 00:00 2024-09-12T12:13:41.838 INFO:teuthology.orchestra.run.smithi043.stdout:(63/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 225 kB/s | 24 kB 00:00 2024-09-12T12:13:41.864 INFO:teuthology.orchestra.run.smithi043.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-12T12:13:41.867 INFO:teuthology.orchestra.run.smithi033.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 2.9 MB/s | 171 kB 00:00 2024-09-12T12:13:41.889 INFO:teuthology.orchestra.run.smithi043.stdout:(65/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-12T12:13:41.906 INFO:teuthology.orchestra.run.smithi043.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 573 kB/s | 38 kB 00:00 2024-09-12T12:13:41.967 INFO:teuthology.orchestra.run.smithi033.stdout:(28/156): ceph-grafana-dashboards-19.1.1-298.gb 319 kB/s | 32 kB 00:00 2024-09-12T12:13:41.983 INFO:teuthology.orchestra.run.smithi102.stdout:(57/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.5 MB/s | 3.0 MB 00:01 2024-09-12T12:13:41.998 INFO:teuthology.orchestra.run.smithi043.stdout:(67/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-09-12T12:13:42.034 INFO:teuthology.orchestra.run.smithi033.stdout:(29/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 12 MB/s | 3.1 MB 00:00 2024-09-12T12:13:42.065 INFO:teuthology.orchestra.run.smithi043.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 25 MB/s | 4.9 MB 00:00 2024-09-12T12:13:42.068 INFO:teuthology.orchestra.run.smithi033.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 1.4 MB/s | 146 kB 00:00 2024-09-12T12:13:42.098 INFO:teuthology.orchestra.run.smithi043.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 8.9 MB/s | 910 kB 00:00 2024-09-12T12:13:42.124 INFO:teuthology.orchestra.run.smithi043.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-12T12:13:42.166 INFO:teuthology.orchestra.run.smithi043.stdout:(71/156): postgresql-13.16-1.el9.x86_64.rpm 6.1 MB/s | 1.6 MB 00:00 2024-09-12T12:13:42.167 INFO:teuthology.orchestra.run.smithi102.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 223 kB/s | 160 kB 00:00 2024-09-12T12:13:42.199 INFO:teuthology.orchestra.run.smithi043.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-12T12:13:42.224 INFO:teuthology.orchestra.run.smithi043.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-12T12:13:42.259 INFO:teuthology.orchestra.run.smithi102.stdout:(59/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 73 kB/s | 45 kB 00:00 2024-09-12T12:13:42.267 INFO:teuthology.orchestra.run.smithi043.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-12T12:13:42.342 INFO:teuthology.orchestra.run.smithi043.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 24 MB/s | 5.8 MB 00:00 2024-09-12T12:13:42.376 INFO:teuthology.orchestra.run.smithi043.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-09-12T12:13:42.401 INFO:teuthology.orchestra.run.smithi043.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.1 MB/s | 248 kB 00:00 2024-09-12T12:13:42.418 INFO:teuthology.orchestra.run.smithi043.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 614 kB/s | 26 kB 00:00 2024-09-12T12:13:42.435 INFO:teuthology.orchestra.run.smithi043.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 573 kB/s | 19 kB 00:00 2024-09-12T12:13:42.485 INFO:teuthology.orchestra.run.smithi033.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 7.9 MB/s | 3.6 MB 00:00 2024-09-12T12:13:42.568 INFO:teuthology.orchestra.run.smithi033.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 2.9 MB/s | 249 kB 00:00 2024-09-12T12:13:42.610 INFO:teuthology.orchestra.run.smithi043.stdout:(80/156): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-12T12:13:42.627 INFO:teuthology.orchestra.run.smithi043.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 181 kB/s | 35 kB 00:00 2024-09-12T12:13:42.652 INFO:teuthology.orchestra.run.smithi043.stdout:(82/156): python3-mako-1.1.4-6.el9.noarch.rpm 735 kB/s | 172 kB 00:00 2024-09-12T12:13:42.668 INFO:teuthology.orchestra.run.smithi033.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 493 kB/s | 49 kB 00:00 2024-09-12T12:13:42.733 INFO:teuthology.orchestra.run.smithi043.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-12T12:13:42.761 INFO:teuthology.orchestra.run.smithi043.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.0 MB/s | 222 kB 00:00 2024-09-12T12:13:42.786 INFO:teuthology.orchestra.run.smithi043.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.4 MB/s | 77 kB 00:00 2024-09-12T12:13:42.809 INFO:teuthology.orchestra.run.smithi102.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 44 kB/s | 24 kB 00:00 2024-09-12T12:13:42.812 INFO:teuthology.orchestra.run.smithi043.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 840 kB/s | 42 kB 00:00 2024-09-12T12:13:42.837 INFO:teuthology.orchestra.run.smithi043.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-09-12T12:13:42.842 INFO:teuthology.orchestra.run.smithi102.stdout:(61/156): librdkafka-1.6.1-102.el9.x86_64.rpm 772 kB/s | 662 kB 00:00 2024-09-12T12:13:42.862 INFO:teuthology.orchestra.run.smithi043.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-12T12:13:42.887 INFO:teuthology.orchestra.run.smithi043.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-12T12:13:42.913 INFO:teuthology.orchestra.run.smithi043.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-12T12:13:42.938 INFO:teuthology.orchestra.run.smithi043.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-12T12:13:43.022 INFO:teuthology.orchestra.run.smithi043.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-12T12:13:43.026 INFO:teuthology.orchestra.run.smithi102.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 677 kB/s | 581 kB 00:00 2024-09-12T12:13:43.047 INFO:teuthology.orchestra.run.smithi043.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 384 kB/s | 42 kB 00:00 2024-09-12T12:13:43.072 INFO:teuthology.orchestra.run.smithi043.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 884 kB/s | 44 kB 00:00 2024-09-12T12:13:43.098 INFO:teuthology.orchestra.run.smithi043.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-12T12:13:43.123 INFO:teuthology.orchestra.run.smithi043.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 713 kB/s | 36 kB 00:00 2024-09-12T12:13:43.135 INFO:teuthology.orchestra.run.smithi033.stdout:(34/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 22 MB/s | 49 MB 00:02 2024-09-12T12:13:43.148 INFO:teuthology.orchestra.run.smithi043.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-12T12:13:43.161 INFO:teuthology.orchestra.run.smithi033.stdout:(35/156): ceph-prometheus-alerts-19.1.1-298.gb5 33 kB/s | 16 kB 00:00 2024-09-12T12:13:43.182 INFO:teuthology.orchestra.run.smithi043.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-12T12:13:43.207 INFO:teuthology.orchestra.run.smithi043.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 990 kB/s | 58 kB 00:00 2024-09-12T12:13:43.232 INFO:teuthology.orchestra.run.smithi043.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-12T12:13:43.253 INFO:teuthology.orchestra.run.smithi033.stdout:(36/156): ceph-mgr-diskprediction-local-19.1.1- 6.3 MB/s | 7.4 MB 00:01 2024-09-12T12:13:43.257 INFO:teuthology.orchestra.run.smithi043.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-12T12:13:43.278 INFO:teuthology.orchestra.run.smithi033.stdout:(37/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 2.0 MB/s | 285 kB 00:00 2024-09-12T12:13:43.282 INFO:teuthology.orchestra.run.smithi043.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 894 kB/s | 45 kB 00:00 2024-09-12T12:13:43.320 INFO:teuthology.orchestra.run.smithi033.stdout:(38/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 4.7 MB/s | 765 kB 00:00 2024-09-12T12:13:43.345 INFO:teuthology.orchestra.run.smithi033.stdout:(39/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 199 kB/s | 18 kB 00:00 2024-09-12T12:13:43.391 INFO:teuthology.orchestra.run.smithi043.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 167 kB/s | 22 kB 00:00 2024-09-12T12:13:43.393 INFO:teuthology.orchestra.run.smithi102.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 81 kB/s | 47 kB 00:00 2024-09-12T12:13:43.450 INFO:teuthology.orchestra.run.smithi043.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-12T12:13:43.484 INFO:teuthology.orchestra.run.smithi043.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.0 MB/s | 308 kB 00:00 2024-09-12T12:13:43.509 INFO:teuthology.orchestra.run.smithi043.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 784 kB/s | 19 kB 00:00 2024-09-12T12:13:43.551 INFO:teuthology.orchestra.run.smithi043.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.1 MB/s | 863 kB 00:00 2024-09-12T12:13:43.610 INFO:teuthology.orchestra.run.smithi102.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 381 kB/s | 292 kB 00:00 2024-09-12T12:13:43.718 INFO:teuthology.orchestra.run.smithi043.stdout:(108/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 20 MB/s | 16 MB 00:00 2024-09-12T12:13:43.760 INFO:teuthology.orchestra.run.smithi043.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 125 kB/s | 26 kB 00:00 2024-09-12T12:13:43.768 INFO:teuthology.orchestra.run.smithi102.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 256 kB/s | 188 kB 00:00 2024-09-12T12:13:43.785 INFO:teuthology.orchestra.run.smithi043.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.9 MB/s | 67 kB 00:00 2024-09-12T12:13:43.810 INFO:teuthology.orchestra.run.smithi043.stdout:(111/156): liboath-2.6.7-2.el9.x86_64.rpm 580 kB/s | 49 kB 00:00 2024-09-12T12:13:43.836 INFO:teuthology.orchestra.run.smithi043.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-12T12:13:43.886 INFO:teuthology.orchestra.run.smithi043.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-09-12T12:13:43.929 INFO:teuthology.orchestra.run.smithi033.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 123 kB/s | 80 kB 00:00 2024-09-12T12:13:43.931 INFO:teuthology.orchestra.run.smithi043.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 975 kB/s | 43 kB 00:00 2024-09-12T12:13:43.994 INFO:teuthology.orchestra.run.smithi102.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 64 kB/s | 38 kB 00:00 2024-09-12T12:13:44.087 INFO:teuthology.orchestra.run.smithi043.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 206 kB/s | 32 kB 00:00 2024-09-12T12:13:44.137 INFO:teuthology.orchestra.run.smithi043.stdout:(116/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 2.5 MB/s | 839 kB 00:00 2024-09-12T12:13:44.137 INFO:teuthology.orchestra.run.smithi033.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 241 kB/s | 191 kB 00:00 2024-09-12T12:13:44.162 INFO:teuthology.orchestra.run.smithi043.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 190 kB/s | 14 kB 00:00 2024-09-12T12:13:44.187 INFO:teuthology.orchestra.run.smithi043.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.4 MB/s | 172 kB 00:00 2024-09-12T12:13:44.204 INFO:teuthology.orchestra.run.smithi033.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 906 kB/s | 801 kB 00:00 2024-09-12T12:13:44.221 INFO:teuthology.orchestra.run.smithi043.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-12T12:13:44.246 INFO:teuthology.orchestra.run.smithi043.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-12T12:13:44.280 INFO:teuthology.orchestra.run.smithi043.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-12T12:13:44.322 INFO:teuthology.orchestra.run.smithi043.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 3.4 MB/s | 144 kB 00:00 2024-09-12T12:13:44.338 INFO:teuthology.orchestra.run.smithi043.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 651 kB/s | 11 kB 00:00 2024-09-12T12:13:44.364 INFO:teuthology.orchestra.run.smithi043.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 709 kB/s | 18 kB 00:00 2024-09-12T12:13:44.389 INFO:teuthology.orchestra.run.smithi043.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 930 kB/s | 23 kB 00:00 2024-09-12T12:13:44.414 INFO:teuthology.orchestra.run.smithi043.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 778 kB/s | 19 kB 00:00 2024-09-12T12:13:44.440 INFO:teuthology.orchestra.run.smithi043.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 793 kB/s | 20 kB 00:00 2024-09-12T12:13:44.515 INFO:teuthology.orchestra.run.smithi043.stdout:(128/156): libarrow-9.0.0-11.el9.x86_64.rpm 4.4 MB/s | 4.4 MB 00:01 2024-09-12T12:13:44.540 INFO:teuthology.orchestra.run.smithi043.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T12:13:44.565 INFO:teuthology.orchestra.run.smithi043.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T12:13:44.591 INFO:teuthology.orchestra.run.smithi043.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T12:13:44.624 INFO:teuthology.orchestra.run.smithi043.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 5.5 MB/s | 1.0 MB 00:00 2024-09-12T12:13:44.675 INFO:teuthology.orchestra.run.smithi043.stdout:(133/156): python3-grpcio-1.46.7-10.el9.x86_64. 4.8 MB/s | 2.0 MB 00:00 2024-09-12T12:13:44.688 INFO:teuthology.orchestra.run.smithi033.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 334 kB/s | 253 kB 00:00 2024-09-12T12:13:44.700 INFO:teuthology.orchestra.run.smithi043.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 218 kB/s | 16 kB 00:00 2024-09-12T12:13:44.725 INFO:teuthology.orchestra.run.smithi043.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-12T12:13:44.728 INFO:teuthology.orchestra.run.smithi102.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 4.4 MB/s | 4.9 MB 00:01 2024-09-12T12:13:45.116 INFO:teuthology.orchestra.run.smithi033.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 159 kB/s | 106 kB 00:00 2024-09-12T12:13:45.116 INFO:teuthology.orchestra.run.smithi033.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 1.3 MB/s | 1.2 MB 00:00 2024-09-12T12:13:45.117 INFO:teuthology.orchestra.run.smithi102.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 4.0 MB/s | 4.4 MB 00:01 2024-09-12T12:13:45.117 INFO:teuthology.orchestra.run.smithi102.stdout:(69/156): postgresql-13.16-1.el9.x86_64.rpm 1.7 MB/s | 1.6 MB 00:00 2024-09-12T12:13:45.118 INFO:teuthology.orchestra.run.smithi043.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-12T12:13:45.118 INFO:teuthology.orchestra.run.smithi043.stdout:(137/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.4 MB/s | 272 kB 00:00 2024-09-12T12:13:45.118 INFO:teuthology.orchestra.run.smithi043.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 408 kB/s | 31 kB 00:00 2024-09-12T12:13:45.118 INFO:teuthology.orchestra.run.smithi043.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-12T12:13:45.118 INFO:teuthology.orchestra.run.smithi043.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 606 kB/s | 36 kB 00:00 2024-09-12T12:13:45.118 INFO:teuthology.orchestra.run.smithi043.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.1 MB/s | 74 kB 00:00 2024-09-12T12:13:45.118 INFO:teuthology.orchestra.run.smithi043.stdout:(142/156): python3-routes-2.5.1-5.el9.noarch.rp 1.1 MB/s | 188 kB 00:00 2024-09-12T12:13:45.118 INFO:teuthology.orchestra.run.smithi043.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-12T12:13:45.119 INFO:teuthology.orchestra.run.smithi043.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-12T12:13:45.119 INFO:teuthology.orchestra.run.smithi043.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-09-12T12:13:45.119 INFO:teuthology.orchestra.run.smithi043.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T12:13:45.119 INFO:teuthology.orchestra.run.smithi043.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-12T12:13:45.119 INFO:teuthology.orchestra.run.smithi043.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-12T12:13:45.280 INFO:teuthology.orchestra.run.smithi043.stdout:(149/156): NetworkManager-1.49.90-1.el9.x86_64. 13 MB/s | 2.3 MB 00:00 2024-09-12T12:13:45.347 INFO:teuthology.orchestra.run.smithi043.stdout:(150/156): NetworkManager-libnm-1.49.90-1.el9.x 27 MB/s | 1.8 MB 00:00 2024-09-12T12:13:45.388 INFO:teuthology.orchestra.run.smithi043.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 986 kB/s | 41 kB 00:00 2024-09-12T12:13:45.430 INFO:teuthology.orchestra.run.smithi043.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 5.9 MB/s | 249 kB 00:00 2024-09-12T12:13:45.438 INFO:teuthology.orchestra.run.smithi033.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 180 kB/s | 135 kB 00:00 2024-09-12T12:13:45.489 INFO:teuthology.orchestra.run.smithi043.stdout:(153/156): openssl-3.2.2-6.el9.x86_64.rpm 23 MB/s | 1.4 MB 00:00 2024-09-12T12:13:45.555 INFO:teuthology.orchestra.run.smithi033.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 184 kB/s | 125 kB 00:00 2024-09-12T12:13:45.570 INFO:teuthology.orchestra.run.smithi102.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 199 kB/s | 137 kB 00:00 2024-09-12T12:13:45.573 INFO:teuthology.orchestra.run.smithi043.stdout:(154/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 29 MB/s | 2.4 MB 00:00 2024-09-12T12:13:45.698 INFO:teuthology.orchestra.run.smithi043.stdout:(155/156): librados2-19.1.1-298.gb53b6d3e.el9.x 5.1 MB/s | 3.4 MB 00:00 2024-09-12T12:13:45.703 INFO:teuthology.orchestra.run.smithi102.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 933 kB/s | 910 kB 00:00 2024-09-12T12:13:45.831 INFO:teuthology.orchestra.run.smithi033.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 280 kB/s | 215 kB 00:00 2024-09-12T12:13:45.973 INFO:teuthology.orchestra.run.smithi043.stdout:(156/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 3.4 MB/s | 3.2 MB 00:00 2024-09-12T12:13:45.979 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2024-09-12T12:13:45.979 INFO:teuthology.orchestra.run.smithi043.stdout:Total 21 MB/s | 226 MB 00:10 2024-09-12T12:13:46.078 INFO:teuthology.orchestra.run.smithi102.stdout:(72/156): postgresql-server-13.16-1.el9.x86_64. 5.1 MB/s | 5.8 MB 00:01 2024-09-12T12:13:46.331 INFO:teuthology.orchestra.run.smithi033.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 773 kB/s | 689 kB 00:00 2024-09-12T12:13:46.370 INFO:teuthology.orchestra.run.smithi102.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 131 kB/s | 87 kB 00:00 2024-09-12T12:13:46.529 INFO:teuthology.orchestra.run.smithi102.stdout:(74/156): protobuf-3.14.0-13.el9.x86_64.rpm 1.1 MB/s | 1.0 MB 00:00 2024-09-12T12:13:46.548 INFO:teuthology.orchestra.run.smithi033.stdout:(50/156): bison-3.7.4-5.el9.x86_64.rpm 951 kB/s | 943 kB 00:00 2024-09-12T12:13:46.573 INFO:teuthology.orchestra.run.smithi033.stdout:(51/156): boost-program-options-1.75.0-8.el9.x8 144 kB/s | 107 kB 00:00 2024-09-12T12:13:46.940 INFO:teuthology.orchestra.run.smithi033.stdout:(52/156): elfutils-libelf-devel-0.191-4.el9.x86 36 kB/s | 22 kB 00:00 2024-09-12T12:13:46.987 INFO:teuthology.orchestra.run.smithi102.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 99 kB/s | 61 kB 00:00 2024-09-12T12:13:47.124 INFO:teuthology.orchestra.run.smithi033.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 59 kB/s | 33 kB 00:00 2024-09-12T12:13:47.229 INFO:teuthology.orchestra.run.smithi102.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 5.2 MB/s | 6.0 MB 00:01 2024-09-12T12:13:47.259 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2024-09-12T12:13:47.363 INFO:teuthology.orchestra.run.smithi102.stdout:(77/156): python3-devel-3.9.19-8.el9.x86_64.rpm 294 kB/s | 245 kB 00:00 2024-09-12T12:13:47.407 INFO:teuthology.orchestra.run.smithi033.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 365 kB/s | 313 kB 00:00 2024-09-12T12:13:47.429 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2024-09-12T12:13:47.429 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2024-09-12T12:13:47.632 INFO:teuthology.orchestra.run.smithi033.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 36 kB/s | 18 kB 00:00 2024-09-12T12:13:47.771 INFO:teuthology.orchestra.run.smithi102.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 48 kB/s | 26 kB 00:00 2024-09-12T12:13:47.822 INFO:teuthology.orchestra.run.smithi102.stdout:(79/156): python3-jinja2-2.11.3-6.el9.noarch.rp 298 kB/s | 248 kB 00:00 2024-09-12T12:13:47.847 INFO:teuthology.orchestra.run.smithi102.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 40 kB/s | 19 kB 00:00 2024-09-12T12:13:47.899 INFO:teuthology.orchestra.run.smithi033.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 23 kB/s | 11 kB 00:00 2024-09-12T12:13:48.091 INFO:teuthology.orchestra.run.smithi033.stdout:(57/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.6 MB/s | 3.0 MB 00:01 2024-09-12T12:13:48.372 INFO:teuthology.orchestra.run.smithi102.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 63 kB/s | 35 kB 00:00 2024-09-12T12:13:48.408 INFO:teuthology.orchestra.run.smithi033.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 209 kB/s | 160 kB 00:00 2024-09-12T12:13:48.506 INFO:teuthology.orchestra.run.smithi102.stdout:(82/156): python3-mako-1.1.4-6.el9.noarch.rpm 235 kB/s | 172 kB 00:00 2024-09-12T12:13:48.533 INFO:teuthology.orchestra.run.smithi033.stdout:(59/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 71 kB/s | 45 kB 00:00 2024-09-12T12:13:48.964 INFO:teuthology.orchestra.run.smithi102.stdout:(83/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.6 MB/s | 5.1 MB 00:01 2024-09-12T12:13:48.975 INFO:teuthology.orchestra.run.smithi033.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 750 kB/s | 662 kB 00:00 2024-09-12T12:13:49.117 INFO:teuthology.orchestra.run.smithi033.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 42 kB/s | 24 kB 00:00 2024-09-12T12:13:49.148 INFO:teuthology.orchestra.run.smithi102.stdout:(84/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 323 kB/s | 250 kB 00:00 2024-09-12T12:13:49.273 INFO:teuthology.orchestra.run.smithi102.stdout:(85/156): python3-oauthlib-3.1.1-5.el9.noarch.r 289 kB/s | 222 kB 00:00 2024-09-12T12:13:49.284 INFO:teuthology.orchestra.run.smithi033.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 664 kB/s | 581 kB 00:00 2024-09-12T12:13:49.602 INFO:teuthology.orchestra.run.smithi033.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 76 kB/s | 47 kB 00:00 2024-09-12T12:13:49.615 INFO:teuthology.orchestra.run.smithi102.stdout:(86/156): python3-packaging-20.9-5.el9.noarch.r 119 kB/s | 77 kB 00:00 2024-09-12T12:13:49.724 INFO:teuthology.orchestra.run.smithi102.stdout:(87/156): python3-prettytable-0.7.2-27.el9.noar 73 kB/s | 42 kB 00:00 2024-09-12T12:13:49.788 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2024-09-12T12:13:49.788 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2024-09-12T12:13:50.037 INFO:teuthology.orchestra.run.smithi033.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 318 kB/s | 292 kB 00:00 2024-09-12T12:13:50.083 INFO:teuthology.orchestra.run.smithi102.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 333 kB/s | 269 kB 00:00 2024-09-12T12:13:50.087 INFO:teuthology.orchestra.run.smithi033.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 235 kB/s | 188 kB 00:00 2024-09-12T12:13:50.235 INFO:teuthology.orchestra.run.smithi033.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 61 kB/s | 38 kB 00:00 2024-09-12T12:13:50.383 INFO:teuthology.orchestra.run.smithi102.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 207 kB/s | 159 kB 00:00 2024-09-12T12:13:50.500 INFO:teuthology.orchestra.run.smithi102.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 360 kB/s | 279 kB 00:00 2024-09-12T12:13:50.767 INFO:teuthology.orchestra.run.smithi102.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 75 kB/s | 51 kB 00:00 2024-09-12T12:13:51.009 INFO:teuthology.orchestra.run.smithi102.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 86 kB/s | 54 kB 00:00 2024-09-12T12:13:51.143 INFO:teuthology.orchestra.run.smithi033.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 4.5 MB/s | 4.9 MB 00:01 2024-09-12T12:13:51.219 INFO:teuthology.orchestra.run.smithi033.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 1.6 MB/s | 1.6 MB 00:00 2024-09-12T12:13:51.294 INFO:teuthology.orchestra.run.smithi033.stdout:(69/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.7 MB/s | 4.4 MB 00:01 2024-09-12T12:13:51.409 INFO:teuthology.orchestra.run.smithi102.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 65 kB/s | 42 kB 00:00 2024-09-12T12:13:51.667 INFO:teuthology.orchestra.run.smithi102.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 68 kB/s | 44 kB 00:00 2024-09-12T12:13:51.902 INFO:teuthology.orchestra.run.smithi033.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 201 kB/s | 137 kB 00:00 2024-09-12T12:13:52.044 INFO:teuthology.orchestra.run.smithi033.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 1.0 MB/s | 910 kB 00:00 2024-09-12T12:13:52.059 INFO:teuthology.orchestra.run.smithi102.stdout:(95/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 10 MB/s | 16 MB 00:01 2024-09-12T12:13:52.309 INFO:teuthology.orchestra.run.smithi102.stdout:(96/156): qatlib-24.02.0-1.el9.x86_64.rpm 245 kB/s | 221 kB 00:00 2024-09-12T12:13:52.335 INFO:teuthology.orchestra.run.smithi102.stdout:(97/156): qatlib-service-24.02.0-1.el9.x86_64.r 54 kB/s | 36 kB 00:00 2024-09-12T12:13:52.444 INFO:teuthology.orchestra.run.smithi033.stdout:(72/156): postgresql-server-13.16-1.el9.x86_64. 5.0 MB/s | 5.8 MB 00:01 2024-09-12T12:13:52.677 INFO:teuthology.orchestra.run.smithi102.stdout:(98/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 77 kB/s | 47 kB 00:00 2024-09-12T12:13:52.737 INFO:teuthology.orchestra.run.smithi033.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 126 kB/s | 87 kB 00:00 2024-09-12T12:13:52.853 INFO:teuthology.orchestra.run.smithi033.stdout:(74/156): protobuf-3.14.0-13.el9.x86_64.rpm 1.1 MB/s | 1.0 MB 00:00 2024-09-12T12:13:53.027 INFO:teuthology.orchestra.run.smithi102.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 84 kB/s | 58 kB 00:00 2024-09-12T12:13:53.094 INFO:teuthology.orchestra.run.smithi102.stdout:(100/156): socat-1.7.4.1-6.el9.x86_64.rpm 388 kB/s | 304 kB 00:00 2024-09-12T12:13:53.327 INFO:teuthology.orchestra.run.smithi102.stdout:(101/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 147 kB/s | 96 kB 00:00 2024-09-12T12:13:53.345 INFO:teuthology.orchestra.run.smithi033.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 101 kB/s | 61 kB 00:00 2024-09-12T12:13:53.604 INFO:teuthology.orchestra.run.smithi033.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 5.1 MB/s | 6.0 MB 00:01 2024-09-12T12:13:53.638 INFO:teuthology.orchestra.run.smithi033.stdout:(77/156): python3-devel-3.9.19-8.el9.x86_64.rpm 312 kB/s | 245 kB 00:00 2024-09-12T12:13:53.661 INFO:teuthology.orchestra.run.smithi102.stdout:(102/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 100 kB/s | 64 kB 00:00 2024-09-12T12:13:53.694 INFO:teuthology.orchestra.run.smithi102.stdout:(103/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 75 kB/s | 45 kB 00:00 2024-09-12T12:13:53.753 INFO:teuthology.orchestra.run.smithi102.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-12T12:13:53.787 INFO:teuthology.orchestra.run.smithi102.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-12T12:13:53.812 INFO:teuthology.orchestra.run.smithi102.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 776 kB/s | 19 kB 00:00 2024-09-12T12:13:53.929 INFO:teuthology.orchestra.run.smithi102.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-09-12T12:13:53.963 INFO:teuthology.orchestra.run.smithi102.stdout:(108/156): lua-devel-5.4.4-4.el9.x86_64.rpm 36 kB/s | 22 kB 00:00 2024-09-12T12:13:53.988 INFO:teuthology.orchestra.run.smithi102.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 516 kB/s | 26 kB 00:00 2024-09-12T12:13:54.022 INFO:teuthology.orchestra.run.smithi102.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.5 MB/s | 67 kB 00:00 2024-09-12T12:13:54.055 INFO:teuthology.orchestra.run.smithi102.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.8 MB/s | 151 kB 00:00 2024-09-12T12:13:54.080 INFO:teuthology.orchestra.run.smithi102.stdout:(112/156): liboath-2.6.7-2.el9.x86_64.rpm 414 kB/s | 49 kB 00:00 2024-09-12T12:13:54.121 INFO:teuthology.orchestra.run.smithi033.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 40 kB/s | 19 kB 00:00 2024-09-12T12:13:54.122 INFO:teuthology.orchestra.run.smithi102.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-12T12:13:54.139 INFO:teuthology.orchestra.run.smithi102.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.5 MB/s | 43 kB 00:00 2024-09-12T12:13:54.155 INFO:teuthology.orchestra.run.smithi033.stdout:(79/156): python3-jinja2-2.11.3-6.el9.noarch.rp 307 kB/s | 248 kB 00:00 2024-09-12T12:13:54.156 INFO:teuthology.orchestra.run.smithi102.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-12T12:13:54.173 INFO:teuthology.orchestra.run.smithi102.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 842 kB/s | 14 kB 00:00 2024-09-12T12:13:54.197 INFO:teuthology.orchestra.run.smithi033.stdout:(80/156): python3-jsonpatch-1.21-16.el9.noarch. 44 kB/s | 26 kB 00:00 2024-09-12T12:13:54.207 INFO:teuthology.orchestra.run.smithi102.stdout:(117/156): python3-asyncssh-2.13.2-5.el9.noarch 4.2 MB/s | 548 kB 00:00 2024-09-12T12:13:54.232 INFO:teuthology.orchestra.run.smithi102.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-12T12:13:54.266 INFO:teuthology.orchestra.run.smithi102.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 8.9 MB/s | 303 kB 00:00 2024-09-12T12:13:54.291 INFO:teuthology.orchestra.run.smithi102.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-09-12T12:13:54.316 INFO:teuthology.orchestra.run.smithi102.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-12T12:13:54.350 INFO:teuthology.orchestra.run.smithi102.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-12T12:13:54.375 INFO:teuthology.orchestra.run.smithi102.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-12T12:13:54.401 INFO:teuthology.orchestra.run.smithi102.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 706 kB/s | 18 kB 00:00 2024-09-12T12:13:54.426 INFO:teuthology.orchestra.run.smithi102.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 931 kB/s | 23 kB 00:00 2024-09-12T12:13:54.451 INFO:teuthology.orchestra.run.smithi102.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 784 kB/s | 19 kB 00:00 2024-09-12T12:13:54.476 INFO:teuthology.orchestra.run.smithi102.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 791 kB/s | 20 kB 00:00 2024-09-12T12:13:54.535 INFO:teuthology.orchestra.run.smithi102.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 8.4 MB/s | 2.0 MB 00:00 2024-09-12T12:13:54.560 INFO:teuthology.orchestra.run.smithi102.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T12:13:54.586 INFO:teuthology.orchestra.run.smithi102.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T12:13:54.619 INFO:teuthology.orchestra.run.smithi102.stdout:(131/156): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-09-12T12:13:54.645 INFO:teuthology.orchestra.run.smithi102.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 985 kB/s | 58 kB 00:00 2024-09-12T12:13:54.670 INFO:teuthology.orchestra.run.smithi102.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 663 kB/s | 16 kB 00:00 2024-09-12T12:13:54.712 INFO:teuthology.orchestra.run.smithi102.stdout:(134/156): protobuf-compiler-3.14.0-13.el9.x86_ 823 kB/s | 863 kB 00:01 2024-09-12T12:13:54.722 INFO:teuthology.orchestra.run.smithi033.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 61 kB/s | 35 kB 00:00 2024-09-12T12:13:54.737 INFO:teuthology.orchestra.run.smithi102.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-09-12T12:13:54.770 INFO:teuthology.orchestra.run.smithi102.stdout:(136/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-12T12:13:54.796 INFO:teuthology.orchestra.run.smithi102.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 604 kB/s | 31 kB 00:00 2024-09-12T12:13:54.821 INFO:teuthology.orchestra.run.smithi102.stdout:(138/156): python3-pyperclip-1.8.2-2.el9.noarch 259 kB/s | 28 kB 00:00 2024-09-12T12:13:54.847 INFO:teuthology.orchestra.run.smithi102.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-12T12:13:54.872 INFO:teuthology.orchestra.run.smithi102.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 711 kB/s | 36 kB 00:00 2024-09-12T12:13:54.889 INFO:teuthology.orchestra.run.smithi033.stdout:(82/156): python3-mako-1.1.4-6.el9.noarch.rpm 224 kB/s | 172 kB 00:00 2024-09-12T12:13:54.897 INFO:teuthology.orchestra.run.smithi102.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-12T12:13:54.922 INFO:teuthology.orchestra.run.smithi102.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 986 kB/s | 74 kB 00:00 2024-09-12T12:13:54.939 INFO:teuthology.orchestra.run.smithi102.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 2.1 MB/s | 90 kB 00:00 2024-09-12T12:13:54.973 INFO:teuthology.orchestra.run.smithi102.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-12T12:13:54.998 INFO:teuthology.orchestra.run.smithi102.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 340 kB/s | 20 kB 00:00 2024-09-12T12:13:55.024 INFO:teuthology.orchestra.run.smithi102.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T12:13:55.057 INFO:teuthology.orchestra.run.smithi102.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-12T12:13:55.107 INFO:teuthology.orchestra.run.smithi102.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-12T12:13:55.374 INFO:teuthology.orchestra.run.smithi102.stdout:(149/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 10 MB/s | 3.2 MB 00:00 2024-09-12T12:13:55.406 INFO:teuthology.orchestra.run.smithi033.stdout:(83/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.2 MB/s | 5.1 MB 00:01 2024-09-12T12:13:55.425 INFO:teuthology.orchestra.run.smithi102.stdout:(150/156): NetworkManager-1.49.90-1.el9.x86_64. 7.3 MB/s | 2.3 MB 00:00 2024-09-12T12:13:55.475 INFO:teuthology.orchestra.run.smithi102.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 817 kB/s | 41 kB 00:00 2024-09-12T12:13:55.523 INFO:teuthology.orchestra.run.smithi033.stdout:(84/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 313 kB/s | 250 kB 00:00 2024-09-12T12:13:55.525 INFO:teuthology.orchestra.run.smithi102.stdout:(152/156): librados2-19.1.1-298.gb53b6d3e.el9.x 6.8 MB/s | 3.4 MB 00:00 2024-09-12T12:13:55.550 INFO:teuthology.orchestra.run.smithi102.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 3.2 MB/s | 249 kB 00:00 2024-09-12T12:13:55.689 INFO:teuthology.orchestra.run.smithi033.stdout:(85/156): python3-oauthlib-3.1.1-5.el9.noarch.r 278 kB/s | 222 kB 00:00 2024-09-12T12:13:55.692 INFO:teuthology.orchestra.run.smithi102.stdout:(154/156): NetworkManager-libnm-1.49.90-1.el9.x 5.7 MB/s | 1.8 MB 00:00 2024-09-12T12:13:55.734 INFO:teuthology.orchestra.run.smithi102.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 13 MB/s | 2.4 MB 00:00 2024-09-12T12:13:55.801 INFO:teuthology.orchestra.run.smithi102.stdout:(156/156): openssl-3.2.2-6.el9.x86_64.rpm 4.9 MB/s | 1.4 MB 00:00 2024-09-12T12:13:55.806 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-12T12:13:55.806 INFO:teuthology.orchestra.run.smithi102.stdout:Total 11 MB/s | 226 MB 00:21 2024-09-12T12:13:56.040 INFO:teuthology.orchestra.run.smithi033.stdout:(86/156): python3-packaging-20.9-5.el9.noarch.r 122 kB/s | 77 kB 00:00 2024-09-12T12:13:56.115 INFO:teuthology.orchestra.run.smithi033.stdout:(87/156): python3-prettytable-0.7.2-27.el9.noar 71 kB/s | 42 kB 00:00 2024-09-12T12:13:56.457 INFO:teuthology.orchestra.run.smithi033.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 351 kB/s | 269 kB 00:00 2024-09-12T12:13:56.543 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2024-09-12T12:13:56.652 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T12:13:56.691 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T12:13:56.754 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T12:13:56.757 INFO:teuthology.orchestra.run.smithi033.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 221 kB/s | 159 kB 00:00 2024-09-12T12:13:56.803 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T12:13:56.836 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T12:13:56.890 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T12:13:56.941 INFO:teuthology.orchestra.run.smithi033.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 338 kB/s | 279 kB 00:00 2024-09-12T12:13:57.011 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-12T12:13:57.066 INFO:teuthology.orchestra.run.smithi033.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 84 kB/s | 51 kB 00:00 2024-09-12T12:13:57.161 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-12T12:13:57.161 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-12T12:13:57.235 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T12:13:57.345 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T12:13:57.408 INFO:teuthology.orchestra.run.smithi033.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 83 kB/s | 54 kB 00:00 2024-09-12T12:13:57.471 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T12:13:57.497 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T12:13:57.589 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T12:13:57.618 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T12:13:57.633 INFO:teuthology.orchestra.run.smithi033.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 74 kB/s | 42 kB 00:00 2024-09-12T12:13:57.786 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T12:13:57.832 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T12:13:57.867 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T12:13:57.973 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T12:13:58.000 INFO:teuthology.orchestra.run.smithi033.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 75 kB/s | 44 kB 00:00 2024-09-12T12:13:58.010 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T12:13:58.098 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T12:13:58.137 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T12:13:58.163 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T12:13:58.365 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T12:13:58.392 INFO:teuthology.orchestra.run.smithi033.stdout:(95/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-12T12:13:58.417 INFO:teuthology.orchestra.run.smithi033.stdout:(96/156): qatlib-24.02.0-1.el9.x86_64.rpm 282 kB/s | 221 kB 00:00 2024-09-12T12:13:58.579 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T12:13:58.667 INFO:teuthology.orchestra.run.smithi033.stdout:(97/156): qatlib-service-24.02.0-1.el9.x86_64.r 54 kB/s | 36 kB 00:00 2024-09-12T12:13:58.693 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T12:13:58.798 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T12:13:58.894 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T12:13:58.968 INFO:teuthology.orchestra.run.smithi033.stdout:(98/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 83 kB/s | 47 kB 00:00 2024-09-12T12:13:59.123 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T12:13:59.193 INFO:teuthology.orchestra.run.smithi033.stdout:(99/156): socat-1.7.4.1-6.el9.x86_64.rpm 392 kB/s | 304 kB 00:00 2024-09-12T12:13:59.237 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T12:13:59.301 INFO:teuthology.orchestra.run.smithi033.stdout:(100/156): uuid-1.6.2-55.el9.x86_64.rpm 91 kB/s | 58 kB 00:00 2024-09-12T12:13:59.335 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T12:13:59.347 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-12T12:13:59.347 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-12T12:13:59.366 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T12:13:59.409 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T12:13:59.485 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T12:13:59.544 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T12:13:59.592 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T12:13:59.636 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T12:13:59.660 INFO:teuthology.orchestra.run.smithi033.stdout:(101/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 138 kB/s | 96 kB 00:00 2024-09-12T12:13:59.669 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T12:13:59.696 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T12:13:59.767 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T12:13:59.820 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T12:13:59.835 INFO:teuthology.orchestra.run.smithi033.stdout:(102/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 99 kB/s | 64 kB 00:00 2024-09-12T12:13:59.850 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T12:13:59.860 INFO:teuthology.orchestra.run.smithi033.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 111 kB/s | 22 kB 00:00 2024-09-12T12:13:59.893 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T12:13:59.945 INFO:teuthology.orchestra.run.smithi033.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 6.4 MB/s | 548 kB 00:00 2024-09-12T12:13:59.969 INFO:teuthology.orchestra.run.smithi033.stdout:(105/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 67 kB/s | 45 kB 00:00 2024-09-12T12:13:59.972 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T12:14:00.011 INFO:teuthology.orchestra.run.smithi033.stdout:(106/156): gperftools-libs-2.9.1-3.el9.x86_64.r 4.6 MB/s | 308 kB 00:00 2024-09-12T12:14:00.012 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T12:14:00.036 INFO:teuthology.orchestra.run.smithi033.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 290 kB/s | 19 kB 00:00 2024-09-12T12:14:00.056 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T12:14:00.062 INFO:teuthology.orchestra.run.smithi033.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T12:14:00.083 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T12:14:00.087 INFO:teuthology.orchestra.run.smithi033.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T12:14:00.121 INFO:teuthology.orchestra.run.smithi033.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-12T12:14:00.154 INFO:teuthology.orchestra.run.smithi033.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-12T12:14:00.157 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T12:14:00.199 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T12:14:00.213 INFO:teuthology.orchestra.run.smithi033.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-12T12:14:00.278 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T12:14:00.423 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T12:14:00.478 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T12:14:00.488 INFO:teuthology.orchestra.run.smithi033.stdout:(113/156): libarrow-9.0.0-11.el9.x86_64.rpm 9.3 MB/s | 4.4 MB 00:00 2024-09-12T12:14:00.563 INFO:teuthology.orchestra.run.smithi033.stdout:(114/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.2 MB/s | 863 kB 00:00 2024-09-12T12:14:00.589 INFO:teuthology.orchestra.run.smithi033.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 435 kB/s | 43 kB 00:00 2024-09-12T12:14:00.622 INFO:teuthology.orchestra.run.smithi033.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 972 kB/s | 32 kB 00:00 2024-09-12T12:14:00.648 INFO:teuthology.orchestra.run.smithi033.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 242 kB/s | 14 kB 00:00 2024-09-12T12:14:00.673 INFO:teuthology.orchestra.run.smithi033.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.5 MB/s | 172 kB 00:00 2024-09-12T12:14:00.698 INFO:teuthology.orchestra.run.smithi033.stdout:(119/156): python3-asyncssh-2.13.2-5.el9.noarch 1.1 MB/s | 548 kB 00:00 2024-09-12T12:14:00.723 INFO:teuthology.orchestra.run.smithi033.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 4.6 MB/s | 358 kB 00:00 2024-09-12T12:14:00.749 INFO:teuthology.orchestra.run.smithi033.stdout:(121/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-09-12T12:14:00.774 INFO:teuthology.orchestra.run.smithi033.stdout:(122/156): python3-google-auth-2.34.0-1.el9.noa 2.9 MB/s | 220 kB 00:00 2024-09-12T12:14:00.799 INFO:teuthology.orchestra.run.smithi033.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 430 kB/s | 11 kB 00:00 2024-09-12T12:14:00.824 INFO:teuthology.orchestra.run.smithi033.stdout:(124/156): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-09-12T12:14:00.850 INFO:teuthology.orchestra.run.smithi033.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-09-12T12:14:00.875 INFO:teuthology.orchestra.run.smithi033.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-12T12:14:00.900 INFO:teuthology.orchestra.run.smithi033.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-12T12:14:00.917 INFO:teuthology.orchestra.run.smithi033.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 469 kB/s | 20 kB 00:00 2024-09-12T12:14:00.934 INFO:teuthology.orchestra.run.smithi033.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 2.8 MB/s | 46 kB 00:00 2024-09-12T12:14:00.968 INFO:teuthology.orchestra.run.smithi033.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-12T12:14:00.993 INFO:teuthology.orchestra.run.smithi033.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T12:14:01.027 INFO:teuthology.orchestra.run.smithi033.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 8.1 MB/s | 1.0 MB 00:00 2024-09-12T12:14:01.045 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T12:14:01.052 INFO:teuthology.orchestra.run.smithi033.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 4.6 MB/s | 272 kB 00:00 2024-09-12T12:14:01.069 INFO:teuthology.orchestra.run.smithi033.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 391 kB/s | 16 kB 00:00 2024-09-12T12:14:01.094 INFO:teuthology.orchestra.run.smithi033.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.1 MB/s | 90 kB 00:00 2024-09-12T12:14:01.120 INFO:teuthology.orchestra.run.smithi033.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 560 kB/s | 28 kB 00:00 2024-09-12T12:14:01.133 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T12:14:01.162 INFO:teuthology.orchestra.run.smithi033.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 458 kB/s | 31 kB 00:00 2024-09-12T12:14:01.167 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T12:14:01.204 INFO:teuthology.orchestra.run.smithi033.stdout:(138/156): python3-grpcio-1.46.7-10.el9.x86_64. 4.2 MB/s | 2.0 MB 00:00 2024-09-12T12:14:01.210 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T12:14:01.229 INFO:teuthology.orchestra.run.smithi033.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 884 kB/s | 59 kB 00:00 2024-09-12T12:14:01.249 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T12:14:01.254 INFO:teuthology.orchestra.run.smithi033.stdout:(140/156): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-09-12T12:14:01.279 INFO:teuthology.orchestra.run.smithi033.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 474 kB/s | 36 kB 00:00 2024-09-12T12:14:01.291 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T12:14:01.305 INFO:teuthology.orchestra.run.smithi033.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 989 kB/s | 74 kB 00:00 2024-09-12T12:14:01.330 INFO:teuthology.orchestra.run.smithi033.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-12T12:14:01.355 INFO:teuthology.orchestra.run.smithi033.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-12T12:14:01.380 INFO:teuthology.orchestra.run.smithi033.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-09-12T12:14:01.406 INFO:teuthology.orchestra.run.smithi033.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T12:14:01.439 INFO:teuthology.orchestra.run.smithi033.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-12T12:14:01.445 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T12:14:01.489 INFO:teuthology.orchestra.run.smithi033.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-12T12:14:01.502 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T12:14:01.558 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T12:14:01.641 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T12:14:01.677 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T12:14:01.690 INFO:teuthology.orchestra.run.smithi033.stdout:(149/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 13 MB/s | 3.2 MB 00:00 2024-09-12T12:14:01.713 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T12:14:01.740 INFO:teuthology.orchestra.run.smithi033.stdout:(150/156): librados2-19.1.1-298.gb53b6d3e.el9.x 10 MB/s | 3.4 MB 00:00 2024-09-12T12:14:01.762 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T12:14:01.796 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T12:14:01.910 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T12:14:02.151 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T12:14:02.298 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T12:14:02.342 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T12:14:02.349 INFO:teuthology.orchestra.run.smithi033.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 67 kB/s | 41 kB 00:00 2024-09-12T12:14:02.383 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T12:14:02.491 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T12:14:02.528 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T12:14:02.569 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T12:14:02.582 INFO:teuthology.orchestra.run.smithi033.stdout:(152/156): NetworkManager-1.49.90-1.el9.x86_64. 2.1 MB/s | 2.3 MB 00:01 2024-09-12T12:14:02.601 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-12T12:14:02.626 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T12:14:02.728 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T12:14:02.783 INFO:teuthology.orchestra.run.smithi033.stdout:(153/156): NetworkManager-libnm-1.49.90-1.el9.x 1.7 MB/s | 1.8 MB 00:01 2024-09-12T12:14:02.875 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T12:14:02.909 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T12:14:02.950 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T12:14:02.999 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T12:14:03.035 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T12:14:03.075 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T12:14:03.105 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T12:14:03.139 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T12:14:03.181 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T12:14:03.216 INFO:teuthology.orchestra.run.smithi033.stdout:(154/156): NetworkManager-tui-1.49.90-1.el9.x86 287 kB/s | 249 kB 00:00 2024-09-12T12:14:03.223 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T12:14:03.257 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T12:14:03.348 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T12:14:03.405 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T12:14:03.436 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T12:14:03.533 INFO:teuthology.orchestra.run.smithi033.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 1.4 MB/s | 1.4 MB 00:00 2024-09-12T12:14:03.545 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T12:14:03.604 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T12:14:03.791 INFO:teuthology.orchestra.run.smithi033.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.4 MB/s | 2.4 MB 00:01 2024-09-12T12:14:03.799 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-09-12T12:14:03.799 INFO:teuthology.orchestra.run.smithi033.stdout:Total 8.6 MB/s | 226 MB 00:26 2024-09-12T12:14:04.370 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T12:14:04.425 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T12:14:04.459 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T12:14:04.566 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T12:14:04.615 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T12:14:04.668 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T12:14:04.760 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T12:14:04.795 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T12:14:04.985 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T12:14:05.016 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-09-12T12:14:05.017 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T12:14:05.101 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T12:14:05.186 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-09-12T12:14:05.187 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-09-12T12:14:05.813 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T12:14:05.906 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-12T12:14:05.929 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T12:14:06.014 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T12:14:06.055 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T12:14:06.114 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T12:14:06.147 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T12:14:06.173 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T12:14:06.231 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T12:14:06.560 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T12:14:06.667 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T12:14:06.773 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T12:14:06.802 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T12:14:06.894 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T12:14:06.923 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T12:14:07.089 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T12:14:07.145 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T12:14:07.172 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T12:14:07.264 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T12:14:07.270 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T12:14:07.298 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T12:14:07.345 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T12:14:07.345 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T12:14:07.366 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T12:14:07.374 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T12:14:07.392 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T12:14:07.407 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T12:14:07.485 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-09-12T12:14:07.486 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-09-12T12:14:07.593 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T12:14:07.733 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T12:14:07.762 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T12:14:07.780 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T12:14:07.864 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T12:14:07.893 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T12:14:07.898 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T12:14:07.933 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T12:14:08.008 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T12:14:08.099 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T12:14:08.320 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T12:14:08.427 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T12:14:08.435 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T12:14:08.475 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T12:14:08.531 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T12:14:08.563 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T12:14:08.597 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T12:14:08.661 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T12:14:08.706 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T12:14:08.739 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T12:14:08.772 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T12:14:08.782 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T12:14:08.823 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T12:14:08.851 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T12:14:08.902 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T12:14:08.919 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T12:14:08.973 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T12:14:09.005 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T12:14:09.048 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T12:14:09.124 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T12:14:09.158 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T12:14:09.202 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T12:14:09.230 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T12:14:09.299 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T12:14:09.353 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T12:14:09.427 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T12:14:09.561 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T12:14:09.622 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T12:14:10.149 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T12:14:10.234 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T12:14:10.264 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T12:14:10.306 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T12:14:10.345 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T12:14:10.395 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T12:14:10.546 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T12:14:10.623 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T12:14:10.677 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T12:14:10.758 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T12:14:10.790 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T12:14:10.826 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T12:14:10.872 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T12:14:10.909 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T12:14:10.960 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T12:14:11.003 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T12:14:11.153 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T12:14:11.188 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T12:14:11.228 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T12:14:11.280 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T12:14:11.314 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T12:14:11.330 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T12:14:11.372 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T12:14:11.413 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T12:14:11.437 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-12T12:14:11.461 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T12:14:11.567 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T12:14:11.694 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T12:14:11.727 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T12:14:11.754 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T12:14:11.798 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T12:14:11.836 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T12:14:11.868 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T12:14:11.894 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T12:14:11.898 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T12:14:11.926 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T12:14:11.932 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T12:14:11.966 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T12:14:12.007 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T12:14:12.019 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T12:14:12.019 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T12:14:12.019 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T12:14:12.019 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T12:14:12.057 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T12:14:12.061 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T12:14:12.139 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T12:14:12.192 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T12:14:12.224 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T12:14:12.325 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T12:14:12.374 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T12:14:13.086 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T12:14:13.138 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T12:14:13.172 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T12:14:13.269 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T12:14:13.319 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T12:14:13.363 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T12:14:13.449 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T12:14:13.533 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T12:14:13.715 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T12:14:13.747 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T12:14:13.834 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T12:14:14.031 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-09-12T12:14:14.128 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T12:14:14.186 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T12:14:14.247 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T12:14:14.288 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T12:14:14.313 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T12:14:14.371 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T12:14:14.481 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T12:14:14.596 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T12:14:14.713 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T12:14:14.831 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T12:14:14.955 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T12:14:14.981 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T12:14:15.058 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T12:14:15.086 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T12:14:15.262 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T12:14:15.316 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T12:14:15.344 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T12:14:15.433 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T12:14:15.462 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T12:14:15.525 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T12:14:15.554 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T12:14:15.577 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T12:14:15.769 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T12:14:15.816 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T12:14:15.903 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T12:14:15.931 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T12:14:15.962 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T12:14:15.972 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T12:14:16.086 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T12:14:16.192 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T12:14:16.262 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T12:14:16.284 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T12:14:16.319 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T12:14:16.410 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T12:14:16.440 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T12:14:16.477 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T12:14:16.488 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T12:14:16.596 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T12:14:16.700 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T12:14:16.734 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T12:14:16.769 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T12:14:16.844 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T12:14:16.895 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T12:14:16.935 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T12:14:16.957 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T12:14:16.988 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T12:14:16.988 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T12:14:17.020 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T12:14:17.047 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T12:14:17.059 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T12:14:17.090 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T12:14:17.118 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T12:14:17.306 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T12:14:17.459 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T12:14:17.502 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T12:14:17.581 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T12:14:17.613 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T12:14:17.654 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T12:14:17.685 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T12:14:17.766 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T12:14:17.808 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T12:14:17.885 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T12:14:18.030 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T12:14:18.086 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T12:14:18.647 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T12:14:18.733 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T12:14:18.768 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T12:14:18.811 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T12:14:18.849 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T12:14:18.891 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T12:14:19.056 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T12:14:19.111 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T12:14:19.166 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T12:14:19.241 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T12:14:19.278 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T12:14:19.314 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T12:14:19.362 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T12:14:19.388 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T12:14:19.397 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T12:14:19.440 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T12:14:19.483 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T12:14:19.578 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T12:14:19.651 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T12:14:19.701 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T12:14:19.742 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T12:14:19.848 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T12:14:19.885 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T12:14:19.924 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T12:14:19.957 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-12T12:14:19.982 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T12:14:20.091 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T12:14:20.129 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T12:14:20.165 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T12:14:20.222 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T12:14:20.251 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T12:14:20.251 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T12:14:20.251 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T12:14:20.251 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T12:14:20.264 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T12:14:20.291 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T12:14:20.293 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T12:14:20.331 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T12:14:20.375 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T12:14:20.414 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T12:14:20.444 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T12:14:20.482 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T12:14:20.515 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T12:14:20.557 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T12:14:20.591 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T12:14:20.681 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T12:14:20.731 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T12:14:20.769 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T12:14:20.877 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T12:14:20.930 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T12:14:21.688 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T12:14:21.742 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T12:14:21.776 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T12:14:21.880 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T12:14:21.933 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T12:14:21.985 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T12:14:22.077 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T12:14:22.112 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T12:14:22.303 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T12:14:22.335 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T12:14:22.415 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T12:14:23.112 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T12:14:23.262 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T12:14:24.195 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T12:14:24.195 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /sys 2024-09-12T12:14:24.195 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /proc 2024-09-12T12:14:24.195 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /mnt 2024-09-12T12:14:24.195 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /var/tmp 2024-09-12T12:14:24.196 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /home 2024-09-12T12:14:24.196 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /root 2024-09-12T12:14:24.196 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /tmp 2024-09-12T12:14:24.196 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T12:14:24.374 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T12:14:24.392 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T12:14:24.392 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:14:24.392 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T12:14:24.393 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T12:14:24.566 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T12:14:24.646 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T12:14:24.675 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T12:14:24.708 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T12:14:25.036 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T12:14:25.078 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T12:14:25.170 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T12:14:25.202 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T12:14:25.239 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T12:14:25.745 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T12:14:25.775 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T12:14:25.847 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T12:14:25.876 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T12:14:25.927 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T12:14:25.956 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T12:14:25.956 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:14:25.956 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T12:14:25.957 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T12:14:25.957 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T12:14:25.957 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T12:14:26.194 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T12:14:26.220 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T12:14:26.221 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:14:26.221 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T12:14:26.221 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T12:14:26.221 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T12:14:26.221 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T12:14:26.679 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T12:14:26.704 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T12:14:26.704 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:14:26.704 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T12:14:26.704 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T12:14:26.704 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T12:14:26.704 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T12:14:26.809 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T12:14:26.867 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T12:14:26.931 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T12:14:27.133 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T12:14:27.188 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T12:14:27.269 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T12:14:27.358 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T12:14:27.508 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T12:14:27.565 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T12:14:27.603 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T12:14:27.639 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T12:14:28.091 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T12:14:28.121 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T12:14:28.153 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T12:14:28.217 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T12:14:28.252 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T12:14:28.277 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T12:14:28.314 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T12:14:28.895 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T12:14:28.926 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T12:14:29.018 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T12:14:29.019 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T12:14:29.019 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T12:14:29.019 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:14:29.053 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T12:14:29.356 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T12:14:29.396 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T12:14:30.411 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T12:14:30.438 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T12:14:30.547 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T12:14:30.715 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T12:14:30.740 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T12:14:30.765 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T12:14:30.765 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:14:30.765 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T12:14:30.765 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T12:14:30.765 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T12:14:30.766 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T12:14:30.815 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T12:14:30.828 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T12:14:30.929 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T12:14:30.989 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T12:14:31.882 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T12:14:31.882 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /sys 2024-09-12T12:14:31.882 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /proc 2024-09-12T12:14:31.882 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /mnt 2024-09-12T12:14:31.883 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /var/tmp 2024-09-12T12:14:31.883 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /home 2024-09-12T12:14:31.883 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /root 2024-09-12T12:14:31.883 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /tmp 2024-09-12T12:14:31.883 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T12:14:31.973 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T12:14:32.009 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T12:14:32.035 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T12:14:32.035 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:14:32.036 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T12:14:32.036 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T12:14:32.036 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T12:14:32.036 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T12:14:32.055 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T12:14:32.072 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T12:14:32.072 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:14:32.072 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T12:14:32.072 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T12:14:32.076 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T12:14:32.101 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T12:14:32.102 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:14:32.102 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T12:14:32.102 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T12:14:32.152 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T12:14:32.177 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T12:14:32.177 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:14:32.177 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T12:14:32.177 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T12:14:32.178 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T12:14:32.178 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T12:14:32.495 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T12:14:32.520 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T12:14:32.520 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:14:32.520 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T12:14:32.520 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T12:14:32.520 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T12:14:32.520 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T12:14:33.592 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T12:14:33.618 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T12:14:33.618 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:14:33.619 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T12:14:33.619 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T12:14:33.619 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T12:14:33.619 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T12:14:33.843 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T12:14:33.866 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T12:14:33.866 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:14:33.866 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T12:14:33.866 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T12:14:33.866 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T12:14:33.866 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T12:14:34.310 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T12:14:34.333 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T12:14:34.333 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:14:34.333 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T12:14:34.333 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T12:14:34.333 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T12:14:34.333 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T12:14:34.449 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T12:14:34.505 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T12:14:34.561 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T12:14:34.748 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T12:14:34.802 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T12:14:34.880 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T12:14:34.969 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T12:14:35.108 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T12:14:35.158 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T12:14:35.201 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T12:14:35.229 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T12:14:35.571 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T12:14:35.619 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T12:14:35.651 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T12:14:35.712 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T12:14:35.750 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T12:14:36.812 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T12:14:36.852 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T12:14:37.349 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T12:14:37.390 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T12:14:37.440 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T12:14:37.480 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T12:14:37.507 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T12:14:37.715 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T12:14:37.762 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T12:14:37.792 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T12:14:37.822 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T12:14:37.837 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T12:14:37.868 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T12:14:37.869 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T12:14:37.971 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T12:14:38.133 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T12:14:38.163 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T12:14:38.186 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T12:14:38.187 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:14:38.187 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T12:14:38.187 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T12:14:38.187 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T12:14:38.187 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T12:14:38.231 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T12:14:38.242 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T12:14:38.342 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T12:14:38.402 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T12:14:38.464 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T12:14:38.507 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T12:14:38.528 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T12:14:39.337 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T12:14:39.366 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T12:14:39.390 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T12:14:39.390 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:14:39.390 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T12:14:39.390 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T12:14:39.390 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T12:14:39.390 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T12:14:39.433 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T12:14:39.442 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T12:14:39.457 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T12:14:39.457 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:14:39.457 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T12:14:39.457 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T12:14:39.526 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T12:14:39.545 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T12:14:39.549 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T12:14:39.549 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:14:39.549 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T12:14:39.549 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T12:14:39.549 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T12:14:39.549 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T12:14:39.591 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T12:14:39.691 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T12:14:39.731 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T12:14:39.757 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T12:14:39.783 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T12:14:39.783 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T12:14:39.851 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T12:14:39.875 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T12:14:39.875 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:14:39.875 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T12:14:39.875 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T12:14:39.875 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T12:14:39.875 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T12:14:39.875 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T12:14:39.876 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T12:14:39.976 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T12:14:40.001 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T12:14:40.007 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T12:14:40.007 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T12:14:40.194 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T12:14:40.194 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T12:14:40.270 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T12:14:40.339 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T12:14:41.309 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T12:14:41.309 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /sys 2024-09-12T12:14:41.309 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /proc 2024-09-12T12:14:41.309 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /mnt 2024-09-12T12:14:41.309 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /var/tmp 2024-09-12T12:14:41.310 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /home 2024-09-12T12:14:41.310 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /root 2024-09-12T12:14:41.310 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /tmp 2024-09-12T12:14:41.310 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:14:41.497 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T12:14:41.514 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T12:14:41.514 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:14:41.514 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T12:14:41.514 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:14:43.042 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T12:14:43.070 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T12:14:43.070 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:14:43.070 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T12:14:43.070 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T12:14:43.070 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T12:14:43.070 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:14:43.309 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T12:14:43.333 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T12:14:43.334 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:14:43.334 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T12:14:43.334 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T12:14:43.334 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T12:14:43.334 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:14:43.793 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T12:14:43.818 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T12:14:43.818 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:14:43.818 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T12:14:43.818 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T12:14:43.818 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T12:14:43.818 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:14:43.924 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T12:14:43.998 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T12:14:44.063 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T12:14:44.257 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T12:14:44.303 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T12:14:44.384 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T12:14:44.481 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T12:14:44.539 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T12:14:44.580 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T12:14:44.621 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T12:14:44.624 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T12:14:44.661 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T12:14:44.667 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T12:14:44.688 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T12:14:44.709 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T12:14:44.737 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T12:14:44.889 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T12:14:44.944 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T12:14:44.974 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T12:14:45.003 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T12:14:45.050 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T12:14:45.198 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T12:14:45.227 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T12:14:45.259 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T12:14:45.323 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T12:14:45.350 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T12:14:45.656 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T12:14:45.689 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T12:14:45.710 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T12:14:46.079 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T12:14:46.079 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T12:14:46.079 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T12:14:46.080 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T12:14:46.080 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T12:14:46.080 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T12:14:46.080 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T12:14:46.080 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T12:14:46.080 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T12:14:46.080 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T12:14:46.080 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T12:14:46.080 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T12:14:46.080 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T12:14:46.080 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T12:14:46.080 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T12:14:46.081 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T12:14:46.081 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T12:14:46.081 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T12:14:46.081 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T12:14:46.081 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T12:14:46.081 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T12:14:46.081 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T12:14:46.081 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T12:14:46.081 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T12:14:46.081 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T12:14:46.081 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T12:14:46.081 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T12:14:46.081 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T12:14:46.094 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T12:14:46.094 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T12:14:46.094 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T12:14:46.094 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T12:14:46.094 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T12:14:46.094 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T12:14:46.094 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T12:14:46.094 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T12:14:46.094 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T12:14:46.094 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T12:14:46.095 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T12:14:46.095 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T12:14:46.095 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T12:14:46.095 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T12:14:46.095 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T12:14:46.095 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T12:14:46.095 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T12:14:46.095 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T12:14:46.095 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T12:14:46.095 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T12:14:46.095 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T12:14:46.095 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T12:14:46.096 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T12:14:46.096 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T12:14:46.096 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T12:14:46.096 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T12:14:46.096 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T12:14:46.096 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T12:14:46.096 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T12:14:46.096 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T12:14:46.096 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T12:14:46.096 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T12:14:46.096 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T12:14:46.096 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T12:14:46.096 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T12:14:46.097 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T12:14:46.097 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T12:14:46.097 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T12:14:46.097 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T12:14:46.097 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T12:14:46.097 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T12:14:46.097 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T12:14:46.097 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T12:14:46.097 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T12:14:46.097 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T12:14:46.097 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T12:14:46.097 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T12:14:46.098 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T12:14:46.098 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T12:14:46.098 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T12:14:46.098 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T12:14:46.098 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T12:14:46.098 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T12:14:46.098 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T12:14:46.098 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T12:14:46.098 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T12:14:46.098 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T12:14:46.098 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T12:14:46.098 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T12:14:46.098 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T12:14:46.099 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T12:14:46.099 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T12:14:46.099 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T12:14:46.099 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T12:14:46.099 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T12:14:46.099 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T12:14:46.099 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T12:14:46.099 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T12:14:46.099 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T12:14:46.099 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T12:14:46.099 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T12:14:46.099 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T12:14:46.099 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T12:14:46.100 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T12:14:46.100 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T12:14:46.100 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T12:14:46.100 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T12:14:46.100 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T12:14:46.100 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T12:14:46.100 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-12T12:14:46.100 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T12:14:46.100 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T12:14:46.100 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T12:14:46.100 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T12:14:46.100 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T12:14:46.101 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T12:14:46.101 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T12:14:46.101 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T12:14:46.101 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T12:14:46.101 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T12:14:46.101 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T12:14:46.101 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T12:14:46.101 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T12:14:46.101 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T12:14:46.101 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T12:14:46.101 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T12:14:46.101 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T12:14:46.101 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T12:14:46.102 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T12:14:46.102 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T12:14:46.102 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T12:14:46.102 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T12:14:46.102 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T12:14:46.102 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T12:14:46.102 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T12:14:46.102 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T12:14:46.102 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T12:14:46.102 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T12:14:46.102 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T12:14:46.102 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T12:14:46.102 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T12:14:46.103 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T12:14:46.103 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T12:14:46.103 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T12:14:46.103 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T12:14:46.103 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T12:14:46.103 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T12:14:46.103 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T12:14:46.103 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T12:14:46.103 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T12:14:46.103 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T12:14:46.103 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T12:14:46.103 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T12:14:46.103 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T12:14:46.103 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T12:14:46.104 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T12:14:46.104 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T12:14:46.104 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T12:14:46.104 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T12:14:46.104 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T12:14:46.104 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T12:14:46.104 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T12:14:46.104 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T12:14:46.104 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T12:14:46.104 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T12:14:46.105 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T12:14:46.450 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T12:14:46.485 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T12:14:46.529 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T12:14:46.611 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T12:14:46.662 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T12:14:46.754 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T12:14:46.789 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T12:14:46.815 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T12:14:46.841 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T12:14:46.841 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T12:14:46.908 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T12:14:46.908 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T12:14:46.992 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T12:14:47.017 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T12:14:47.022 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T12:14:47.022 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T12:14:47.202 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T12:14:47.202 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T12:14:47.286 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T12:14:47.376 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T12:14:47.503 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T12:14:47.527 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T12:14:47.634 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T12:14:47.805 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T12:14:47.829 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T12:14:47.854 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T12:14:47.854 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:14:47.854 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T12:14:47.854 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T12:14:47.855 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T12:14:47.855 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:14:47.905 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T12:14:47.916 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T12:14:48.018 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T12:14:48.073 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T12:14:48.775 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T12:14:48.775 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T12:14:48.775 INFO:teuthology.orchestra.run.smithi043.stdout:Upgraded: 2024-09-12T12:14:48.775 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T12:14:48.775 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T12:14:48.775 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T12:14:48.775 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T12:14:48.775 INFO:teuthology.orchestra.run.smithi043.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:48.776 INFO:teuthology.orchestra.run.smithi043.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:48.776 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T12:14:48.776 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T12:14:48.776 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2024-09-12T12:14:48.776 INFO:teuthology.orchestra.run.smithi043.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T12:14:48.776 INFO:teuthology.orchestra.run.smithi043.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T12:14:48.776 INFO:teuthology.orchestra.run.smithi043.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T12:14:48.776 INFO:teuthology.orchestra.run.smithi043.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T12:14:48.776 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:48.776 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:48.776 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:48.776 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:48.777 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:14:48.777 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:48.777 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:48.777 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:48.777 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:14:48.777 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:14:48.777 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:14:48.777 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:14:48.777 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:14:48.777 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:48.777 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:48.777 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:14:48.777 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:48.778 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:48.778 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:48.778 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:14:48.778 INFO:teuthology.orchestra.run.smithi043.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:14:48.778 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:48.778 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:48.778 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:14:48.778 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T12:14:48.778 INFO:teuthology.orchestra.run.smithi043.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T12:14:48.778 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T12:14:48.778 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T12:14:48.778 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T12:14:48.778 INFO:teuthology.orchestra.run.smithi043.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T12:14:48.779 INFO:teuthology.orchestra.run.smithi043.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T12:14:48.779 INFO:teuthology.orchestra.run.smithi043.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T12:14:48.779 INFO:teuthology.orchestra.run.smithi043.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T12:14:48.779 INFO:teuthology.orchestra.run.smithi043.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T12:14:48.779 INFO:teuthology.orchestra.run.smithi043.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T12:14:48.779 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:48.779 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:48.779 INFO:teuthology.orchestra.run.smithi043.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:48.779 INFO:teuthology.orchestra.run.smithi043.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T12:14:48.779 INFO:teuthology.orchestra.run.smithi043.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T12:14:48.779 INFO:teuthology.orchestra.run.smithi043.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T12:14:48.780 INFO:teuthology.orchestra.run.smithi043.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T12:14:48.780 INFO:teuthology.orchestra.run.smithi043.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T12:14:48.780 INFO:teuthology.orchestra.run.smithi043.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:48.780 INFO:teuthology.orchestra.run.smithi043.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:48.780 INFO:teuthology.orchestra.run.smithi043.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T12:14:48.780 INFO:teuthology.orchestra.run.smithi043.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:48.780 INFO:teuthology.orchestra.run.smithi043.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T12:14:48.780 INFO:teuthology.orchestra.run.smithi043.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T12:14:48.780 INFO:teuthology.orchestra.run.smithi043.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T12:14:48.780 INFO:teuthology.orchestra.run.smithi043.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T12:14:48.780 INFO:teuthology.orchestra.run.smithi043.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T12:14:48.780 INFO:teuthology.orchestra.run.smithi043.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T12:14:48.781 INFO:teuthology.orchestra.run.smithi043.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T12:14:48.781 INFO:teuthology.orchestra.run.smithi043.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T12:14:48.781 INFO:teuthology.orchestra.run.smithi043.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T12:14:48.781 INFO:teuthology.orchestra.run.smithi043.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T12:14:48.781 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T12:14:48.781 INFO:teuthology.orchestra.run.smithi043.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T12:14:48.781 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T12:14:48.781 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T12:14:48.781 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T12:14:48.781 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T12:14:48.781 INFO:teuthology.orchestra.run.smithi043.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T12:14:48.781 INFO:teuthology.orchestra.run.smithi043.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T12:14:48.782 INFO:teuthology.orchestra.run.smithi043.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T12:14:48.782 INFO:teuthology.orchestra.run.smithi043.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T12:14:48.782 INFO:teuthology.orchestra.run.smithi043.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T12:14:48.782 INFO:teuthology.orchestra.run.smithi043.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T12:14:48.782 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T12:14:48.782 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:48.782 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:48.782 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:48.783 INFO:teuthology.orchestra.run.smithi043.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T12:14:48.783 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T12:14:48.783 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T12:14:48.783 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T12:14:48.783 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T12:14:48.783 INFO:teuthology.orchestra.run.smithi043.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T12:14:48.783 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T12:14:48.783 INFO:teuthology.orchestra.run.smithi043.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T12:14:48.783 INFO:teuthology.orchestra.run.smithi043.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T12:14:48.783 INFO:teuthology.orchestra.run.smithi043.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T12:14:48.783 INFO:teuthology.orchestra.run.smithi043.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T12:14:48.784 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T12:14:48.784 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T12:14:48.784 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T12:14:48.784 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T12:14:48.784 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T12:14:48.784 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T12:14:48.784 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T12:14:48.784 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T12:14:48.784 INFO:teuthology.orchestra.run.smithi043.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T12:14:48.784 INFO:teuthology.orchestra.run.smithi043.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T12:14:48.785 INFO:teuthology.orchestra.run.smithi043.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T12:14:48.785 INFO:teuthology.orchestra.run.smithi043.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T12:14:48.785 INFO:teuthology.orchestra.run.smithi043.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T12:14:48.785 INFO:teuthology.orchestra.run.smithi043.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T12:14:48.785 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T12:14:48.785 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T12:14:48.785 INFO:teuthology.orchestra.run.smithi043.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T12:14:48.785 INFO:teuthology.orchestra.run.smithi043.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T12:14:48.785 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T12:14:48.785 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T12:14:48.785 INFO:teuthology.orchestra.run.smithi043.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T12:14:48.785 INFO:teuthology.orchestra.run.smithi043.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T12:14:48.786 INFO:teuthology.orchestra.run.smithi043.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T12:14:48.786 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T12:14:48.786 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T12:14:48.786 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T12:14:48.786 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T12:14:48.786 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T12:14:48.786 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T12:14:48.786 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:48.786 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:48.786 INFO:teuthology.orchestra.run.smithi043.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T12:14:48.786 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T12:14:48.786 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T12:14:48.786 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:48.787 INFO:teuthology.orchestra.run.smithi043.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T12:14:48.787 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T12:14:48.787 INFO:teuthology.orchestra.run.smithi043.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T12:14:48.787 INFO:teuthology.orchestra.run.smithi043.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T12:14:48.787 INFO:teuthology.orchestra.run.smithi043.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T12:14:48.787 INFO:teuthology.orchestra.run.smithi043.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T12:14:48.787 INFO:teuthology.orchestra.run.smithi043.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T12:14:48.787 INFO:teuthology.orchestra.run.smithi043.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T12:14:48.787 INFO:teuthology.orchestra.run.smithi043.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T12:14:48.788 INFO:teuthology.orchestra.run.smithi043.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T12:14:48.788 INFO:teuthology.orchestra.run.smithi043.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T12:14:48.788 INFO:teuthology.orchestra.run.smithi043.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T12:14:48.788 INFO:teuthology.orchestra.run.smithi043.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T12:14:48.788 INFO:teuthology.orchestra.run.smithi043.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T12:14:48.788 INFO:teuthology.orchestra.run.smithi043.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T12:14:48.788 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:48.788 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:48.788 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:48.788 INFO:teuthology.orchestra.run.smithi043.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T12:14:48.788 INFO:teuthology.orchestra.run.smithi043.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T12:14:48.788 INFO:teuthology.orchestra.run.smithi043.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T12:14:48.788 INFO:teuthology.orchestra.run.smithi043.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T12:14:48.788 INFO:teuthology.orchestra.run.smithi043.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T12:14:48.789 INFO:teuthology.orchestra.run.smithi043.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T12:14:48.789 INFO:teuthology.orchestra.run.smithi043.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T12:14:48.789 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T12:14:48.789 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-09-12T12:14:49.049 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T12:14:49.082 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T12:14:49.107 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T12:14:49.107 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:14:49.107 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T12:14:49.108 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T12:14:49.108 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T12:14:49.108 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:14:49.150 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T12:14:49.176 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T12:14:49.177 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:14:49.177 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T12:14:49.177 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:14:49.191 DEBUG:teuthology.parallel:result is None 2024-09-12T12:14:49.225 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T12:14:49.249 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T12:14:49.249 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:14:49.249 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T12:14:49.250 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T12:14:49.250 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T12:14:49.250 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:14:49.567 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T12:14:49.592 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T12:14:49.592 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:14:49.592 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T12:14:49.592 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T12:14:49.592 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T12:14:49.592 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:14:53.074 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T12:14:53.075 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T12:14:53.075 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T12:14:53.075 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T12:14:53.075 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T12:14:53.075 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T12:14:53.075 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T12:14:53.075 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T12:14:53.075 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T12:14:53.075 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T12:14:53.075 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T12:14:53.075 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T12:14:53.075 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T12:14:53.076 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T12:14:53.076 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T12:14:53.076 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T12:14:53.076 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T12:14:53.076 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T12:14:53.076 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T12:14:53.076 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T12:14:53.076 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T12:14:53.076 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T12:14:53.076 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T12:14:53.076 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T12:14:53.076 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T12:14:53.076 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T12:14:53.076 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T12:14:53.077 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T12:14:53.077 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T12:14:53.077 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T12:14:53.077 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T12:14:53.077 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T12:14:53.077 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T12:14:53.077 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T12:14:53.077 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T12:14:53.077 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T12:14:53.077 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T12:14:53.077 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T12:14:53.077 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T12:14:53.077 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T12:14:53.078 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T12:14:53.078 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T12:14:53.078 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T12:14:53.078 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T12:14:53.078 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T12:14:53.078 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T12:14:53.078 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T12:14:53.078 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T12:14:53.078 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T12:14:53.078 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T12:14:53.078 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T12:14:53.078 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T12:14:53.078 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T12:14:53.078 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T12:14:53.079 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T12:14:53.079 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T12:14:53.079 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T12:14:53.079 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T12:14:53.079 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T12:14:53.079 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T12:14:53.079 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T12:14:53.079 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T12:14:53.079 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T12:14:53.080 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T12:14:53.080 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T12:14:53.080 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T12:14:53.080 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T12:14:53.080 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T12:14:53.080 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T12:14:53.080 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T12:14:53.080 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T12:14:53.081 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T12:14:53.081 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T12:14:53.081 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T12:14:53.081 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T12:14:53.081 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T12:14:53.081 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T12:14:53.081 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T12:14:53.081 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T12:14:53.081 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T12:14:53.081 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T12:14:53.081 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T12:14:53.082 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T12:14:53.082 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T12:14:53.082 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T12:14:53.082 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T12:14:53.082 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T12:14:53.082 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T12:14:53.082 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T12:14:53.082 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T12:14:53.082 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T12:14:53.082 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T12:14:53.082 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T12:14:53.082 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T12:14:53.082 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T12:14:53.083 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T12:14:53.083 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T12:14:53.083 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T12:14:53.083 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T12:14:53.083 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T12:14:53.083 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T12:14:53.083 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T12:14:53.083 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T12:14:53.083 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T12:14:53.083 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T12:14:53.084 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T12:14:53.084 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T12:14:53.084 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-12T12:14:53.084 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T12:14:53.084 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T12:14:53.084 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T12:14:53.084 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T12:14:53.084 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T12:14:53.084 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T12:14:53.084 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T12:14:53.084 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T12:14:53.084 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T12:14:53.084 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T12:14:53.085 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T12:14:53.085 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T12:14:53.085 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T12:14:53.085 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T12:14:53.085 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T12:14:53.085 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T12:14:53.085 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T12:14:53.085 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T12:14:53.085 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T12:14:53.085 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T12:14:53.085 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T12:14:53.085 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T12:14:53.085 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T12:14:53.085 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T12:14:53.086 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T12:14:53.086 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T12:14:53.086 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T12:14:53.086 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T12:14:53.086 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T12:14:53.086 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T12:14:53.086 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T12:14:53.086 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T12:14:53.086 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T12:14:53.086 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T12:14:53.086 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T12:14:53.086 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T12:14:53.087 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T12:14:53.087 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T12:14:53.087 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T12:14:53.087 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T12:14:53.087 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T12:14:53.087 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T12:14:53.087 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T12:14:53.087 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T12:14:53.087 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T12:14:53.087 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T12:14:53.087 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T12:14:53.087 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T12:14:53.087 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T12:14:53.087 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T12:14:53.087 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T12:14:53.088 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T12:14:53.088 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T12:14:53.088 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T12:14:53.088 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T12:14:53.088 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T12:14:54.421 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T12:14:54.463 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T12:14:54.504 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T12:14:54.535 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T12:14:54.562 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T12:14:54.765 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T12:14:54.809 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T12:14:54.839 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T12:14:54.869 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T12:14:54.915 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T12:14:55.416 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T12:14:55.416 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T12:14:55.416 INFO:teuthology.orchestra.run.smithi102.stdout:Upgraded: 2024-09-12T12:14:55.416 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T12:14:55.416 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T12:14:55.416 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T12:14:55.416 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T12:14:55.416 INFO:teuthology.orchestra.run.smithi102.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:55.417 INFO:teuthology.orchestra.run.smithi102.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:55.417 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T12:14:55.417 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T12:14:55.417 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-12T12:14:55.417 INFO:teuthology.orchestra.run.smithi102.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T12:14:55.417 INFO:teuthology.orchestra.run.smithi102.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T12:14:55.417 INFO:teuthology.orchestra.run.smithi102.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T12:14:55.417 INFO:teuthology.orchestra.run.smithi102.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T12:14:55.417 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:55.417 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:55.417 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:55.417 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:55.417 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:14:55.418 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:55.418 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:55.418 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:55.418 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:14:55.418 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:14:55.418 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:14:55.418 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:14:55.418 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:14:55.418 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:55.418 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:55.418 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:14:55.418 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:55.419 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:55.419 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:55.419 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:14:55.419 INFO:teuthology.orchestra.run.smithi102.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:14:55.419 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:55.419 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:55.419 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:14:55.419 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T12:14:55.419 INFO:teuthology.orchestra.run.smithi102.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T12:14:55.419 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T12:14:55.419 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T12:14:55.419 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T12:14:55.419 INFO:teuthology.orchestra.run.smithi102.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T12:14:55.420 INFO:teuthology.orchestra.run.smithi102.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T12:14:55.420 INFO:teuthology.orchestra.run.smithi102.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T12:14:55.420 INFO:teuthology.orchestra.run.smithi102.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T12:14:55.420 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T12:14:55.420 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T12:14:55.420 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:55.420 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:55.420 INFO:teuthology.orchestra.run.smithi102.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:55.420 INFO:teuthology.orchestra.run.smithi102.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T12:14:55.420 INFO:teuthology.orchestra.run.smithi102.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T12:14:55.420 INFO:teuthology.orchestra.run.smithi102.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T12:14:55.420 INFO:teuthology.orchestra.run.smithi102.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T12:14:55.420 INFO:teuthology.orchestra.run.smithi102.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T12:14:55.421 INFO:teuthology.orchestra.run.smithi102.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:55.421 INFO:teuthology.orchestra.run.smithi102.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:55.421 INFO:teuthology.orchestra.run.smithi102.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T12:14:55.421 INFO:teuthology.orchestra.run.smithi102.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:55.421 INFO:teuthology.orchestra.run.smithi102.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T12:14:55.421 INFO:teuthology.orchestra.run.smithi102.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T12:14:55.421 INFO:teuthology.orchestra.run.smithi102.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T12:14:55.421 INFO:teuthology.orchestra.run.smithi102.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T12:14:55.421 INFO:teuthology.orchestra.run.smithi102.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T12:14:55.421 INFO:teuthology.orchestra.run.smithi102.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T12:14:55.421 INFO:teuthology.orchestra.run.smithi102.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T12:14:55.421 INFO:teuthology.orchestra.run.smithi102.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T12:14:55.421 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T12:14:55.422 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T12:14:55.422 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T12:14:55.422 INFO:teuthology.orchestra.run.smithi102.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T12:14:55.422 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T12:14:55.422 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T12:14:55.422 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T12:14:55.422 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T12:14:55.422 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T12:14:55.422 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T12:14:55.422 INFO:teuthology.orchestra.run.smithi102.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T12:14:55.422 INFO:teuthology.orchestra.run.smithi102.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T12:14:55.422 INFO:teuthology.orchestra.run.smithi102.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T12:14:55.423 INFO:teuthology.orchestra.run.smithi102.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T12:14:55.423 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T12:14:55.423 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:55.423 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:55.423 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:55.423 INFO:teuthology.orchestra.run.smithi102.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T12:14:55.423 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T12:14:55.423 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T12:14:55.423 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T12:14:55.423 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T12:14:55.423 INFO:teuthology.orchestra.run.smithi102.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T12:14:55.423 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T12:14:55.423 INFO:teuthology.orchestra.run.smithi102.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T12:14:55.423 INFO:teuthology.orchestra.run.smithi102.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T12:14:55.424 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T12:14:55.424 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T12:14:55.424 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T12:14:55.424 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T12:14:55.424 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T12:14:55.424 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T12:14:55.424 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T12:14:55.424 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T12:14:55.424 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T12:14:55.424 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T12:14:55.424 INFO:teuthology.orchestra.run.smithi102.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T12:14:55.424 INFO:teuthology.orchestra.run.smithi102.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T12:14:55.424 INFO:teuthology.orchestra.run.smithi102.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T12:14:55.425 INFO:teuthology.orchestra.run.smithi102.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T12:14:55.425 INFO:teuthology.orchestra.run.smithi102.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T12:14:55.425 INFO:teuthology.orchestra.run.smithi102.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T12:14:55.425 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T12:14:55.425 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T12:14:55.425 INFO:teuthology.orchestra.run.smithi102.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T12:14:55.425 INFO:teuthology.orchestra.run.smithi102.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T12:14:55.425 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T12:14:55.425 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T12:14:55.425 INFO:teuthology.orchestra.run.smithi102.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T12:14:55.425 INFO:teuthology.orchestra.run.smithi102.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T12:14:55.425 INFO:teuthology.orchestra.run.smithi102.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T12:14:55.425 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T12:14:55.426 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T12:14:55.426 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T12:14:55.426 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T12:14:55.426 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T12:14:55.426 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T12:14:55.426 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:55.426 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:55.426 INFO:teuthology.orchestra.run.smithi102.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T12:14:55.426 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T12:14:55.426 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T12:14:55.426 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:55.426 INFO:teuthology.orchestra.run.smithi102.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T12:14:55.426 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T12:14:55.427 INFO:teuthology.orchestra.run.smithi102.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T12:14:55.427 INFO:teuthology.orchestra.run.smithi102.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T12:14:55.427 INFO:teuthology.orchestra.run.smithi102.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T12:14:55.427 INFO:teuthology.orchestra.run.smithi102.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T12:14:55.427 INFO:teuthology.orchestra.run.smithi102.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T12:14:55.427 INFO:teuthology.orchestra.run.smithi102.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T12:14:55.427 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T12:14:55.427 INFO:teuthology.orchestra.run.smithi102.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T12:14:55.427 INFO:teuthology.orchestra.run.smithi102.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T12:14:55.427 INFO:teuthology.orchestra.run.smithi102.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T12:14:55.427 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T12:14:55.427 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T12:14:55.427 INFO:teuthology.orchestra.run.smithi102.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T12:14:55.427 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:55.428 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:55.428 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:14:55.428 INFO:teuthology.orchestra.run.smithi102.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T12:14:55.428 INFO:teuthology.orchestra.run.smithi102.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T12:14:55.428 INFO:teuthology.orchestra.run.smithi102.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T12:14:55.428 INFO:teuthology.orchestra.run.smithi102.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T12:14:55.428 INFO:teuthology.orchestra.run.smithi102.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T12:14:55.428 INFO:teuthology.orchestra.run.smithi102.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T12:14:55.429 INFO:teuthology.orchestra.run.smithi102.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T12:14:55.429 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T12:14:55.429 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-12T12:14:55.554 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T12:14:55.588 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T12:14:55.609 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T12:14:55.831 DEBUG:teuthology.parallel:result is None 2024-09-12T12:14:56.524 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T12:14:56.617 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T12:14:56.666 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T12:14:56.759 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T12:14:56.795 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T12:14:56.821 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T12:14:56.863 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T12:14:56.863 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T12:14:56.955 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T12:14:56.955 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T12:14:57.023 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T12:14:57.048 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T12:14:57.054 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T12:14:57.054 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T12:14:57.241 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T12:14:57.241 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T12:14:57.326 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T12:14:57.394 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T12:15:03.192 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T12:15:03.193 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T12:15:03.193 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T12:15:03.193 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T12:15:03.193 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T12:15:03.193 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T12:15:03.193 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T12:15:03.193 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T12:15:03.193 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T12:15:03.193 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T12:15:03.193 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T12:15:03.193 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T12:15:03.194 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T12:15:03.194 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T12:15:03.194 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T12:15:03.194 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T12:15:03.194 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T12:15:03.194 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T12:15:03.194 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T12:15:03.194 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T12:15:03.194 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T12:15:03.194 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T12:15:03.194 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T12:15:03.194 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T12:15:03.194 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T12:15:03.194 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T12:15:03.195 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T12:15:03.195 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T12:15:03.195 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T12:15:03.208 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T12:15:03.208 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T12:15:03.208 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T12:15:03.208 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T12:15:03.208 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T12:15:03.208 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T12:15:03.208 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T12:15:03.208 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T12:15:03.208 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T12:15:03.208 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T12:15:03.209 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T12:15:03.209 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T12:15:03.209 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T12:15:03.209 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T12:15:03.209 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T12:15:03.209 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T12:15:03.209 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T12:15:03.209 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T12:15:03.209 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T12:15:03.209 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T12:15:03.209 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T12:15:03.209 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T12:15:03.209 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T12:15:03.210 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T12:15:03.210 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T12:15:03.210 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T12:15:03.210 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T12:15:03.210 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T12:15:03.210 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T12:15:03.210 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T12:15:03.210 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T12:15:03.210 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T12:15:03.210 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T12:15:03.210 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T12:15:03.210 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T12:15:03.210 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T12:15:03.210 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T12:15:03.211 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T12:15:03.211 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T12:15:03.211 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T12:15:03.211 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T12:15:03.211 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T12:15:03.211 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T12:15:03.211 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T12:15:03.211 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T12:15:03.211 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T12:15:03.211 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T12:15:03.211 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T12:15:03.211 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T12:15:03.211 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T12:15:03.212 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T12:15:03.212 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T12:15:03.212 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T12:15:03.212 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T12:15:03.212 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T12:15:03.212 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T12:15:03.212 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T12:15:03.212 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T12:15:03.212 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T12:15:03.212 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T12:15:03.212 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T12:15:03.212 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T12:15:03.212 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T12:15:03.213 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T12:15:03.213 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T12:15:03.213 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T12:15:03.213 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T12:15:03.213 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T12:15:03.213 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T12:15:03.213 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T12:15:03.213 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T12:15:03.213 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T12:15:03.213 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T12:15:03.213 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T12:15:03.213 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T12:15:03.213 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T12:15:03.214 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T12:15:03.214 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T12:15:03.214 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-12T12:15:03.214 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T12:15:03.214 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T12:15:03.214 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T12:15:03.214 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T12:15:03.214 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T12:15:03.214 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T12:15:03.214 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T12:15:03.214 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T12:15:03.214 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T12:15:03.214 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T12:15:03.214 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T12:15:03.215 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T12:15:03.215 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T12:15:03.215 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T12:15:03.215 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T12:15:03.215 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T12:15:03.215 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T12:15:03.215 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T12:15:03.215 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T12:15:03.215 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T12:15:03.215 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T12:15:03.215 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T12:15:03.215 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T12:15:03.215 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T12:15:03.215 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T12:15:03.216 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T12:15:03.216 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T12:15:03.216 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T12:15:03.216 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T12:15:03.216 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T12:15:03.216 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T12:15:03.216 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T12:15:03.216 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T12:15:03.216 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T12:15:03.216 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T12:15:03.216 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T12:15:03.216 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T12:15:03.216 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T12:15:03.217 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T12:15:03.217 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T12:15:03.217 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T12:15:03.217 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T12:15:03.217 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T12:15:03.217 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T12:15:03.217 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T12:15:03.217 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T12:15:03.217 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T12:15:03.217 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T12:15:03.217 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T12:15:03.217 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T12:15:03.217 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T12:15:03.217 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T12:15:03.218 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T12:15:03.218 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T12:15:03.218 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T12:15:03.218 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T12:15:05.774 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T12:15:05.774 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:15:05.774 INFO:teuthology.orchestra.run.smithi033.stdout:Upgraded: 2024-09-12T12:15:05.774 INFO:teuthology.orchestra.run.smithi033.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T12:15:05.774 INFO:teuthology.orchestra.run.smithi033.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T12:15:05.774 INFO:teuthology.orchestra.run.smithi033.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T12:15:05.774 INFO:teuthology.orchestra.run.smithi033.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T12:15:05.774 INFO:teuthology.orchestra.run.smithi033.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:15:05.774 INFO:teuthology.orchestra.run.smithi033.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:15:05.775 INFO:teuthology.orchestra.run.smithi033.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T12:15:05.775 INFO:teuthology.orchestra.run.smithi033.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T12:15:05.775 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-09-12T12:15:05.775 INFO:teuthology.orchestra.run.smithi033.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T12:15:05.775 INFO:teuthology.orchestra.run.smithi033.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T12:15:05.775 INFO:teuthology.orchestra.run.smithi033.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T12:15:05.775 INFO:teuthology.orchestra.run.smithi033.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T12:15:05.775 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:15:05.775 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:15:05.775 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:15:05.775 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:15:05.775 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:15:05.776 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:15:05.776 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:15:05.776 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:15:05.776 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:15:05.776 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:15:05.776 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:15:05.776 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:15:05.776 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:15:05.776 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:15:05.776 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:15:05.776 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:15:05.776 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:15:05.777 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:15:05.777 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:15:05.777 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:15:05.777 INFO:teuthology.orchestra.run.smithi033.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:15:05.777 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:15:05.777 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:15:05.777 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:15:05.777 INFO:teuthology.orchestra.run.smithi033.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T12:15:05.777 INFO:teuthology.orchestra.run.smithi033.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T12:15:05.777 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T12:15:05.777 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T12:15:05.778 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T12:15:05.778 INFO:teuthology.orchestra.run.smithi033.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T12:15:05.778 INFO:teuthology.orchestra.run.smithi033.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T12:15:05.778 INFO:teuthology.orchestra.run.smithi033.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T12:15:05.778 INFO:teuthology.orchestra.run.smithi033.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T12:15:05.778 INFO:teuthology.orchestra.run.smithi033.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T12:15:05.778 INFO:teuthology.orchestra.run.smithi033.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T12:15:05.778 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:15:05.778 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:15:05.778 INFO:teuthology.orchestra.run.smithi033.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:15:05.778 INFO:teuthology.orchestra.run.smithi033.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T12:15:05.778 INFO:teuthology.orchestra.run.smithi033.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T12:15:05.779 INFO:teuthology.orchestra.run.smithi033.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T12:15:05.779 INFO:teuthology.orchestra.run.smithi033.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T12:15:05.779 INFO:teuthology.orchestra.run.smithi033.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T12:15:05.779 INFO:teuthology.orchestra.run.smithi033.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:15:05.779 INFO:teuthology.orchestra.run.smithi033.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:15:05.779 INFO:teuthology.orchestra.run.smithi033.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T12:15:05.779 INFO:teuthology.orchestra.run.smithi033.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:15:05.779 INFO:teuthology.orchestra.run.smithi033.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T12:15:05.779 INFO:teuthology.orchestra.run.smithi033.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T12:15:05.779 INFO:teuthology.orchestra.run.smithi033.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T12:15:05.779 INFO:teuthology.orchestra.run.smithi033.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T12:15:05.779 INFO:teuthology.orchestra.run.smithi033.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T12:15:05.779 INFO:teuthology.orchestra.run.smithi033.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T12:15:05.780 INFO:teuthology.orchestra.run.smithi033.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T12:15:05.780 INFO:teuthology.orchestra.run.smithi033.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T12:15:05.780 INFO:teuthology.orchestra.run.smithi033.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T12:15:05.780 INFO:teuthology.orchestra.run.smithi033.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T12:15:05.780 INFO:teuthology.orchestra.run.smithi033.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T12:15:05.780 INFO:teuthology.orchestra.run.smithi033.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T12:15:05.780 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T12:15:05.780 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T12:15:05.780 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T12:15:05.780 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T12:15:05.780 INFO:teuthology.orchestra.run.smithi033.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T12:15:05.780 INFO:teuthology.orchestra.run.smithi033.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T12:15:05.780 INFO:teuthology.orchestra.run.smithi033.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T12:15:05.781 INFO:teuthology.orchestra.run.smithi033.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T12:15:05.781 INFO:teuthology.orchestra.run.smithi033.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T12:15:05.781 INFO:teuthology.orchestra.run.smithi033.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T12:15:05.781 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T12:15:05.781 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:15:05.781 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:15:05.783 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:15:05.784 INFO:teuthology.orchestra.run.smithi033.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T12:15:05.784 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T12:15:05.784 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T12:15:05.784 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T12:15:05.784 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T12:15:05.784 INFO:teuthology.orchestra.run.smithi033.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T12:15:05.785 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T12:15:05.785 INFO:teuthology.orchestra.run.smithi033.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T12:15:05.785 INFO:teuthology.orchestra.run.smithi033.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T12:15:05.785 INFO:teuthology.orchestra.run.smithi033.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T12:15:05.785 INFO:teuthology.orchestra.run.smithi033.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T12:15:05.785 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T12:15:05.785 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T12:15:05.785 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T12:15:05.785 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T12:15:05.785 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T12:15:05.785 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T12:15:05.785 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T12:15:05.785 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T12:15:05.786 INFO:teuthology.orchestra.run.smithi033.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T12:15:05.786 INFO:teuthology.orchestra.run.smithi033.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T12:15:05.786 INFO:teuthology.orchestra.run.smithi033.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T12:15:05.786 INFO:teuthology.orchestra.run.smithi033.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T12:15:05.786 INFO:teuthology.orchestra.run.smithi033.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T12:15:05.786 INFO:teuthology.orchestra.run.smithi033.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T12:15:05.786 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T12:15:05.786 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T12:15:05.786 INFO:teuthology.orchestra.run.smithi033.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T12:15:05.786 INFO:teuthology.orchestra.run.smithi033.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T12:15:05.786 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T12:15:05.786 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T12:15:05.787 INFO:teuthology.orchestra.run.smithi033.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T12:15:05.787 INFO:teuthology.orchestra.run.smithi033.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T12:15:05.787 INFO:teuthology.orchestra.run.smithi033.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T12:15:05.788 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T12:15:05.788 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T12:15:05.788 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T12:15:05.788 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T12:15:05.788 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T12:15:05.788 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T12:15:05.788 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:15:05.788 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:15:05.789 INFO:teuthology.orchestra.run.smithi033.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T12:15:05.789 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T12:15:05.789 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T12:15:05.789 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:15:05.789 INFO:teuthology.orchestra.run.smithi033.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T12:15:05.789 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T12:15:05.789 INFO:teuthology.orchestra.run.smithi033.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T12:15:05.789 INFO:teuthology.orchestra.run.smithi033.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T12:15:05.789 INFO:teuthology.orchestra.run.smithi033.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T12:15:05.790 INFO:teuthology.orchestra.run.smithi033.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T12:15:05.790 INFO:teuthology.orchestra.run.smithi033.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T12:15:05.790 INFO:teuthology.orchestra.run.smithi033.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T12:15:05.790 INFO:teuthology.orchestra.run.smithi033.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T12:15:05.790 INFO:teuthology.orchestra.run.smithi033.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T12:15:05.790 INFO:teuthology.orchestra.run.smithi033.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T12:15:05.790 INFO:teuthology.orchestra.run.smithi033.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T12:15:05.790 INFO:teuthology.orchestra.run.smithi033.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T12:15:05.790 INFO:teuthology.orchestra.run.smithi033.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T12:15:05.791 INFO:teuthology.orchestra.run.smithi033.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T12:15:05.791 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:15:05.791 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:15:05.791 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:15:05.791 INFO:teuthology.orchestra.run.smithi033.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T12:15:05.791 INFO:teuthology.orchestra.run.smithi033.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T12:15:05.791 INFO:teuthology.orchestra.run.smithi033.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T12:15:05.791 INFO:teuthology.orchestra.run.smithi033.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T12:15:05.791 INFO:teuthology.orchestra.run.smithi033.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T12:15:05.791 INFO:teuthology.orchestra.run.smithi033.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T12:15:05.792 INFO:teuthology.orchestra.run.smithi033.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T12:15:05.792 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:15:05.792 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-09-12T12:15:06.190 DEBUG:teuthology.parallel:result is None 2024-09-12T12:15:06.192 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T12:15:06.351 DEBUG:teuthology.orchestra.run.smithi033:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T12:15:06.375 INFO:teuthology.orchestra.run.smithi033.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T12:15:06.376 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T12:15:06.376 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T12:15:06.378 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T12:15:06.527 DEBUG:teuthology.orchestra.run.smithi043:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T12:15:06.555 INFO:teuthology.orchestra.run.smithi043.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T12:15:06.555 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T12:15:06.555 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T12:15:06.557 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T12:15:06.704 DEBUG:teuthology.orchestra.run.smithi102:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T12:15:06.730 INFO:teuthology.orchestra.run.smithi102.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T12:15:06.730 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T12:15:06.730 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T12:15:06.733 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T12:15:06.733 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T12:15:06.733 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T12:15:06.764 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T12:15:06.764 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T12:15:06.799 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-12T12:15:06.799 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T12:15:06.830 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T12:15:06.830 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T12:15:06.831 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T12:15:06.859 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T12:15:06.928 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T12:15:06.928 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T12:15:06.959 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T12:15:07.029 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-12T12:15:07.030 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T12:15:07.057 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T12:15:07.121 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T12:15:07.122 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T12:15:07.122 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T12:15:07.151 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T12:15:07.219 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T12:15:07.219 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T12:15:07.246 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T12:15:07.312 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-12T12:15:07.312 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T12:15:07.336 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T12:15:07.401 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T12:15:07.402 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T12:15:07.402 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T12:15:07.431 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T12:15:07.501 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T12:15:07.501 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T12:15:07.527 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T12:15:07.593 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-12T12:15:07.594 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T12:15:07.619 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T12:15:07.684 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-12T12:15:07.793 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-12T12:15:07.793 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T12:15:07.794 INFO:tasks.cephadm:Cluster fsid is a66dfafc-7100-11ef-bcea-c7b262605968 2024-09-12T12:15:07.794 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-12T12:15:07.794 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.33', 'mon.b': '172.21.15.43', 'mon.c': '172.21.15.102'} 2024-09-12T12:15:07.794 INFO:tasks.cephadm:First mon is mon.a on smithi033 2024-09-12T12:15:07.794 INFO:tasks.cephadm:First mgr is x 2024-09-12T12:15:07.794 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-12T12:15:07.794 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname $(hostname -s) 2024-09-12T12:15:07.826 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname $(hostname -s) 2024-09-12T12:15:07.854 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname $(hostname -s) 2024-09-12T12:15:07.879 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-12T12:15:07.880 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T12:15:08.040 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56038/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-298-gb53b6d3e', 'node_name': '172.21.5.36+adami06', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-298.gb53b6d3e'}, 'url': 'https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-09 17:24:58.599585', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-12T12:15:08.190 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref squid, sha1 b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T12:15:08.191 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm 2024-09-12T12:15:08.191 INFO:tasks.cephadm:Downloading cephadm from url: https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm 2024-09-12T12:15:08.192 DEBUG:teuthology.orchestra.run.smithi033:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-12T12:15:08.566 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 12 12:15 /home/ubuntu/cephtest/cephadm 2024-09-12T12:15:08.566 DEBUG:teuthology.orchestra.run.smithi043:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-12T12:15:08.938 INFO:teuthology.orchestra.run.smithi043.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 12 12:15 /home/ubuntu/cephtest/cephadm 2024-09-12T12:15:08.938 DEBUG:teuthology.orchestra.run.smithi102:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-12T12:15:09.337 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 12 12:15 /home/ubuntu/cephtest/cephadm 2024-09-12T12:15:09.337 DEBUG:teuthology.orchestra.run.smithi033:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-12T12:15:09.357 DEBUG:teuthology.orchestra.run.smithi043:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-12T12:15:09.377 DEBUG:teuthology.orchestra.run.smithi102:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-12T12:15:09.416 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc on all hosts... 2024-09-12T12:15:09.416 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-12T12:15:09.419 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-12T12:15:09.422 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-12T12:15:11.049 INFO:teuthology.orchestra.run.smithi043.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T12:15:11.107 INFO:teuthology.orchestra.run.smithi102.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T12:15:11.163 INFO:teuthology.orchestra.run.smithi033.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T12:15:44.237 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:15:44.237 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T12:15:44.237 INFO:teuthology.orchestra.run.smithi033.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-12T12:15:44.237 INFO:teuthology.orchestra.run.smithi033.stdout: "repo_digests": [ 2024-09-12T12:15:44.237 INFO:teuthology.orchestra.run.smithi033.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-12T12:15:44.238 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-09-12T12:15:44.238 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:15:59.690 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-12T12:15:59.690 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T12:15:59.690 INFO:teuthology.orchestra.run.smithi102.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-12T12:15:59.691 INFO:teuthology.orchestra.run.smithi102.stdout: "repo_digests": [ 2024-09-12T12:15:59.691 INFO:teuthology.orchestra.run.smithi102.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-12T12:15:59.691 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-12T12:15:59.691 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-12T12:16:02.922 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-12T12:16:02.922 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T12:16:02.923 INFO:teuthology.orchestra.run.smithi043.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-12T12:16:02.923 INFO:teuthology.orchestra.run.smithi043.stdout: "repo_digests": [ 2024-09-12T12:16:02.923 INFO:teuthology.orchestra.run.smithi043.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-12T12:16:02.923 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-09-12T12:16:02.923 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-12T12:16:02.952 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /etc/ceph 2024-09-12T12:16:02.987 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /etc/ceph 2024-09-12T12:16:03.018 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /etc/ceph 2024-09-12T12:16:03.051 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 777 /etc/ceph 2024-09-12T12:16:03.081 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 777 /etc/ceph 2024-09-12T12:16:03.110 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 777 /etc/ceph 2024-09-12T12:16:03.138 INFO:tasks.cephadm:Writing seed config... 2024-09-12T12:16:03.140 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-12T12:16:03.140 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-12T12:16:03.140 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-12T12:16:03.140 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-12T12:16:03.140 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-12T12:16:03.140 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-12T12:16:03.140 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-12T12:16:03.140 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-12T12:16:03.140 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-12T12:16:03.140 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-12T12:16:03.140 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-12T12:16:03.140 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-12T12:16:03.141 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-12T12:16:03.141 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-12T12:16:03.141 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-12T12:16:03.141 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-12T12:16:03.141 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-12T12:16:03.141 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-12T12:16:03.141 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-12T12:16:03.141 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-12T12:16:03.141 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-12T12:16:03.141 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-12T12:16:03.141 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-12T12:16:03.141 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-12T12:16:03.142 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-12T12:16:03.142 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-12T12:16:03.142 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-12T12:16:03.142 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-12T12:16:03.142 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-12T12:16:03.142 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-12T12:16:03.142 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-12T12:16:03.142 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-12T12:16:03.142 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-12T12:16:03.142 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-12T12:16:03.142 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-12T12:16:03.142 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-12T12:16:03.142 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-12T12:16:03.142 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-12T12:16:03.143 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-12T12:16:03.143 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-12T12:16:03.143 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-12T12:16:03.143 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-12T12:16:03.143 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-12T12:16:03.143 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-12T12:16:03.143 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-12T12:16:03.144 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T12:16:03.144 DEBUG:teuthology.orchestra.run.smithi033:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-12T12:16:03.163 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = a66dfafc-7100-11ef-bcea-c7b262605968 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-12T12:16:03.164 DEBUG:teuthology.orchestra.run.smithi033:mon.a> sudo journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mon.a.service 2024-09-12T12:16:03.207 DEBUG:teuthology.orchestra.run.smithi033:mgr.x> sudo journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mgr.x.service 2024-09-12T12:16:03.250 INFO:tasks.cephadm:Bootstrapping... 2024-09-12T12:16:03.250 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -v bootstrap --fsid a66dfafc-7100-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.33 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-12T12:16:03.467 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-09-12T12:16:03.467 INFO:teuthology.orchestra.run.smithi033.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', '-v', 'bootstrap', '--fsid', 'a66dfafc-7100-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.33', '--skip-admin-label'] 2024-09-12T12:16:03.467 INFO:teuthology.orchestra.run.smithi033.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-12T12:16:03.467 INFO:teuthology.orchestra.run.smithi033.stdout:Verifying podman|docker is present... 2024-09-12T12:16:03.492 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stdout 5.2.2 2024-09-12T12:16:03.493 INFO:teuthology.orchestra.run.smithi033.stdout:Verifying lvm2 is present... 2024-09-12T12:16:03.493 INFO:teuthology.orchestra.run.smithi033.stdout:Verifying time synchronization is in place... 2024-09-12T12:16:03.501 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-12T12:16:03.502 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-12T12:16:03.510 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-12T12:16:03.510 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout inactive 2024-09-12T12:16:03.518 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout enabled 2024-09-12T12:16:03.527 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout active 2024-09-12T12:16:03.527 INFO:teuthology.orchestra.run.smithi033.stdout:Unit chronyd.service is enabled and running 2024-09-12T12:16:03.527 INFO:teuthology.orchestra.run.smithi033.stdout:Repeating the final host check... 2024-09-12T12:16:03.557 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stdout 5.2.2 2024-09-12T12:16:03.558 INFO:teuthology.orchestra.run.smithi033.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-12T12:16:03.558 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl is present 2024-09-12T12:16:03.559 INFO:teuthology.orchestra.run.smithi033.stdout:lvcreate is present 2024-09-12T12:16:03.564 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-12T12:16:03.564 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-12T12:16:03.571 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-12T12:16:03.571 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout inactive 2024-09-12T12:16:03.578 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout enabled 2024-09-12T12:16:03.587 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout active 2024-09-12T12:16:03.587 INFO:teuthology.orchestra.run.smithi033.stdout:Unit chronyd.service is enabled and running 2024-09-12T12:16:03.587 INFO:teuthology.orchestra.run.smithi033.stdout:Host looks OK 2024-09-12T12:16:03.587 INFO:teuthology.orchestra.run.smithi033.stdout:Cluster fsid: a66dfafc-7100-11ef-bcea-c7b262605968 2024-09-12T12:16:03.587 INFO:teuthology.orchestra.run.smithi033.stdout:Acquiring lock 140350573077504 on /run/cephadm/a66dfafc-7100-11ef-bcea-c7b262605968.lock 2024-09-12T12:16:03.587 INFO:teuthology.orchestra.run.smithi033.stdout:Lock 140350573077504 acquired on /run/cephadm/a66dfafc-7100-11ef-bcea-c7b262605968.lock 2024-09-12T12:16:03.588 INFO:teuthology.orchestra.run.smithi033.stdout:Verifying IP 172.21.15.33 port 3300 ... 2024-09-12T12:16:03.588 INFO:teuthology.orchestra.run.smithi033.stdout:Verifying IP 172.21.15.33 port 6789 ... 2024-09-12T12:16:03.588 INFO:teuthology.orchestra.run.smithi033.stdout:Base mon IP(s) is [172.21.15.33:3300, 172.21.15.33:6789], mon addrv is [v2:172.21.15.33:3300,v1:172.21.15.33:6789] 2024-09-12T12:16:03.591 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.33 metric 100 2024-09-12T12:16:03.591 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.33 metric 100 2024-09-12T12:16:03.594 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-12T12:16:03.595 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-12T12:16:03.595 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1792sec hoplimit 64 pref medium 2024-09-12T12:16:03.597 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-12T12:16:03.598 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-12T12:16:03.598 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-12T12:16:03.598 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-12T12:16:03.598 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout inet6 fe80::ae1f:6bff:fea5:d294/64 scope link 2024-09-12T12:16:03.598 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-12T12:16:03.598 INFO:teuthology.orchestra.run.smithi033.stdout:Mon IP `172.21.15.33` is in CIDR network `172.21.0.0/20` 2024-09-12T12:16:03.598 INFO:teuthology.orchestra.run.smithi033.stdout:Mon IP `172.21.15.33` is in CIDR network `172.21.0.0/20` 2024-09-12T12:16:03.599 INFO:teuthology.orchestra.run.smithi033.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-12T12:16:03.599 INFO:teuthology.orchestra.run.smithi033.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-12T12:16:03.600 INFO:teuthology.orchestra.run.smithi033.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T12:16:04.078 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stdout 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 2024-09-12T12:16:04.079 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T12:16:04.079 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stderr Getting image source signatures 2024-09-12T12:16:04.079 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stderr Copying blob sha256:60180723200353b4e13b39fd162aecaf1bc097c859c7c6537324229e97c78567 2024-09-12T12:16:04.079 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-12T12:16:04.079 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stderr Copying config sha256:54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 2024-09-12T12:16:04.079 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-12T12:16:04.976 INFO:teuthology.orchestra.run.smithi033.stdout:ceph: stdout ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-12T12:16:04.977 INFO:teuthology.orchestra.run.smithi033.stdout:Ceph version: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-12T12:16:04.977 INFO:teuthology.orchestra.run.smithi033.stdout:Extracting ceph user uid/gid from container image... 2024-09-12T12:16:05.967 INFO:teuthology.orchestra.run.smithi033.stdout:stat: stdout 167 167 2024-09-12T12:16:05.967 INFO:teuthology.orchestra.run.smithi033.stdout:Creating initial keys... 2024-09-12T12:16:06.805 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph-authtool: stdout AQCG2+JmshQJEBAAwJeDq+VnVVstSRzJc+xtxQ== 2024-09-12T12:16:07.653 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph-authtool: stdout AQCH2+Jm+6LeBRAAeoc9PdjDvW2Vifnr7u6wmA== 2024-09-12T12:16:08.577 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph-authtool: stdout AQCI2+Jml4hBABAAPiVZknQ+f8x63gn7SpAZ/Q== 2024-09-12T12:16:08.578 INFO:teuthology.orchestra.run.smithi033.stdout:Creating initial monmap... 2024-09-12T12:16:09.559 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-12T12:16:09.559 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-12T12:16:09.559 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to a66dfafc-7100-11ef-bcea-c7b262605968 2024-09-12T12:16:09.559 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-12T12:16:09.559 INFO:teuthology.orchestra.run.smithi033.stdout:monmaptool for a [v2:172.21.15.33:3300,v1:172.21.15.33:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-12T12:16:09.559 INFO:teuthology.orchestra.run.smithi033.stdout:setting min_mon_release = quincy 2024-09-12T12:16:09.559 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/monmaptool: set fsid to a66dfafc-7100-11ef-bcea-c7b262605968 2024-09-12T12:16:09.560 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-12T12:16:09.560 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:16:09.560 INFO:teuthology.orchestra.run.smithi033.stdout:Creating mon... 2024-09-12T12:16:10.407 INFO:teuthology.orchestra.run.smithi033.stdout:create mon.a on 2024-09-12T12:16:10.633 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-12T12:16:10.780 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-12T12:16:10.988 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-a66dfafc-7100-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-a66dfafc-7100-11ef-bcea-c7b262605968.target. 2024-09-12T12:16:10.988 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-a66dfafc-7100-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-a66dfafc-7100-11ef-bcea-c7b262605968.target. 2024-09-12T12:16:11.225 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mon.a 2024-09-12T12:16:11.225 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Failed to reset failed state of unit ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mon.a.service: Unit ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mon.a.service not loaded. 2024-09-12T12:16:11.406 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-a66dfafc-7100-11ef-bcea-c7b262605968.target.wants/ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mon.a.service → /etc/systemd/system/ceph-a66dfafc-7100-11ef-bcea-c7b262605968@.service. 2024-09-12T12:16:11.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:11 smithi033 podman[30860]: 2024-09-12 12:16:11.549900535 +0000 UTC m=+0.016893438 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T12:16:11.949 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T12:16:11.949 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout disabled 2024-09-12T12:16:11.955 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T12:16:11.956 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout inactive 2024-09-12T12:16:11.956 INFO:teuthology.orchestra.run.smithi033.stdout:firewalld.service is not enabled 2024-09-12T12:16:11.956 INFO:teuthology.orchestra.run.smithi033.stdout:Not possible to enable service . firewalld.service is not available 2024-09-12T12:16:11.956 INFO:teuthology.orchestra.run.smithi033.stdout:Waiting for mon to start... 2024-09-12T12:16:11.956 INFO:teuthology.orchestra.run.smithi033.stdout:Waiting for mon... 2024-09-12T12:16:12.080 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:11 smithi033 podman[30860]: 2024-09-12 12:16:11.86006251 +0000 UTC m=+0.327055413 container init 3a998fa9acc65d894db28631c6be205845e35a8f7d8e20be9f414614a719a022 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-12T12:16:12.080 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:11 smithi033 podman[30860]: 2024-09-12 12:16:11.863325924 +0000 UTC m=+0.330318830 container start 3a998fa9acc65d894db28631c6be205845e35a8f7d8e20be9f414614a719a022 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mon-a, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-12T12:16:12.080 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:11 smithi033 ceph-mon[30879]: mkfs a66dfafc-7100-11ef-bcea-c7b262605968 2024-09-12T12:16:12.080 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:11 smithi033 ceph-mon[30879]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-12T12:16:12.080 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:11 smithi033 bash[30860]: 3a998fa9acc65d894db28631c6be205845e35a8f7d8e20be9f414614a719a022 2024-09-12T12:16:12.081 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:11 smithi033 systemd[1]: Started Ceph mon.a for a66dfafc-7100-11ef-bcea-c7b262605968. 2024-09-12T12:16:13.036 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout cluster: 2024-09-12T12:16:13.036 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout id: a66dfafc-7100-11ef-bcea-c7b262605968 2024-09-12T12:16:13.037 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-12T12:16:13.037 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-09-12T12:16:13.037 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout services: 2024-09-12T12:16:13.037 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.577634s) 2024-09-12T12:16:13.037 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-12T12:16:13.037 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-12T12:16:13.037 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-09-12T12:16:13.037 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout data: 2024-09-12T12:16:13.037 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-12T12:16:13.037 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-12T12:16:13.037 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-12T12:16:13.037 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout pgs: 2024-09-12T12:16:13.038 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-09-12T12:16:13.038 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.410+0000 7f2e056cf640 1 Processor -- start 2024-09-12T12:16:13.038 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.410+0000 7f2e056cf640 1 -- start start 2024-09-12T12:16:13.038 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.410+0000 7f2e056cf640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e00105d00 0x7f2e00106100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:13.038 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.410+0000 7f2e056cf640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2e00075800 con 0x7f2e00105d00 2024-09-12T12:16:13.038 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.411+0000 7f2dfeffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e00105d00 0x7f2e00106100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:13.038 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.411+0000 7f2dfeffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e00105d00 0x7f2e00106100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45292/0 (socket says 172.21.15.33:45292) 2024-09-12T12:16:13.038 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.411+0000 7f2dfeffd640 1 -- 172.21.15.33:0/3710736446 learned_addr learned my addr 172.21.15.33:0/3710736446 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:13.038 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.411+0000 7f2dfeffd640 1 -- 172.21.15.33:0/3710736446 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e00106640 con 0x7f2e00105d00 2024-09-12T12:16:13.038 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.413+0000 7f2dfeffd640 1 --2- 172.21.15.33:0/3710736446 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e00105d00 0x7f2e00106100 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2df0009e80 tx=0x7f2df002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=527c3ef0ec20dfdf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:13.038 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.413+0000 7f2dfdffb640 1 -- 172.21.15.33:0/3710736446 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2df0036070 con 0x7f2e00105d00 2024-09-12T12:16:13.038 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.413+0000 7f2dfdffb640 1 -- 172.21.15.33:0/3710736446 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2df0031400 con 0x7f2e00105d00 2024-09-12T12:16:13.039 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.413+0000 7f2dfdffb640 1 -- 172.21.15.33:0/3710736446 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2df0031700 con 0x7f2e00105d00 2024-09-12T12:16:13.039 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.414+0000 7f2e056cf640 1 -- 172.21.15.33:0/3710736446 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e00105d00 msgr2=0x7f2e00106100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:13.039 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.414+0000 7f2e056cf640 1 --2- 172.21.15.33:0/3710736446 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e00105d00 0x7f2e00106100 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2df0009e80 tx=0x7f2df002a7a0 comp rx=0 tx=0).stop 2024-09-12T12:16:13.039 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.414+0000 7f2e056cf640 1 -- 172.21.15.33:0/3710736446 shutdown_connections 2024-09-12T12:16:13.039 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.414+0000 7f2e056cf640 1 --2- 172.21.15.33:0/3710736446 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e00105d00 0x7f2e00106100 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:13.039 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.414+0000 7f2e056cf640 1 -- 172.21.15.33:0/3710736446 >> 172.21.15.33:0/3710736446 conn(0x7f2e00101a90 msgr2=0x7f2e00103ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:13.039 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.414+0000 7f2e056cf640 1 -- 172.21.15.33:0/3710736446 shutdown_connections 2024-09-12T12:16:13.039 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.414+0000 7f2e056cf640 1 -- 172.21.15.33:0/3710736446 wait complete. 2024-09-12T12:16:13.039 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.414+0000 7f2e056cf640 1 Processor -- start 2024-09-12T12:16:13.039 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.415+0000 7f2e056cf640 1 -- start start 2024-09-12T12:16:13.039 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.415+0000 7f2e056cf640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e00105d00 0x7f2e0019cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:13.039 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.415+0000 7f2e056cf640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2e00106be0 con 0x7f2e00105d00 2024-09-12T12:16:13.040 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.415+0000 7f2dfeffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e00105d00 0x7f2e0019cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:13.040 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.415+0000 7f2dfeffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e00105d00 0x7f2e0019cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45296/0 (socket says 172.21.15.33:45296) 2024-09-12T12:16:13.040 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.415+0000 7f2dfeffd640 1 -- 172.21.15.33:0/1752002934 learned_addr learned my addr 172.21.15.33:0/1752002934 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:13.040 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.415+0000 7f2dfeffd640 1 -- 172.21.15.33:0/1752002934 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e0019d2e0 con 0x7f2e00105d00 2024-09-12T12:16:13.040 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.415+0000 7f2dfeffd640 1 --2- 172.21.15.33:0/1752002934 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e00105d00 0x7f2e0019cda0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2df0034040 tx=0x7f2df0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:13.040 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.415+0000 7f2de7fff640 1 -- 172.21.15.33:0/1752002934 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2df0041070 con 0x7f2e00105d00 2024-09-12T12:16:13.040 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.415+0000 7f2de7fff640 1 -- 172.21.15.33:0/1752002934 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2df003c650 con 0x7f2e00105d00 2024-09-12T12:16:13.040 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.415+0000 7f2e056cf640 1 -- 172.21.15.33:0/1752002934 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e0019d570 con 0x7f2e00105d00 2024-09-12T12:16:13.040 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.416+0000 7f2de7fff640 1 -- 172.21.15.33:0/1752002934 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2df0036040 con 0x7f2e00105d00 2024-09-12T12:16:13.040 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.416+0000 7f2e056cf640 1 -- 172.21.15.33:0/1752002934 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e001a0260 con 0x7f2e00105d00 2024-09-12T12:16:13.040 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.416+0000 7f2de7fff640 1 -- 172.21.15.33:0/1752002934 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2df0044070 con 0x7f2e00105d00 2024-09-12T12:16:13.040 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.416+0000 7f2de7fff640 1 -- 172.21.15.33:0/1752002934 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2df0046c10 con 0x7f2e00105d00 2024-09-12T12:16:13.041 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.416+0000 7f2e056cf640 1 -- 172.21.15.33:0/1752002934 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e00106100 con 0x7f2e00105d00 2024-09-12T12:16:13.041 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.419+0000 7f2de7fff640 1 -- 172.21.15.33:0/1752002934 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f2df003c950 con 0x7f2e00105d00 2024-09-12T12:16:13.041 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.480+0000 7f2e056cf640 1 -- 172.21.15.33:0/1752002934 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f2e001a07c0 con 0x7f2e00105d00 2024-09-12T12:16:13.041 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.481+0000 7f2de7fff640 1 -- 172.21.15.33:0/1752002934 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f2df003cb30 con 0x7f2e00105d00 2024-09-12T12:16:13.041 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.481+0000 7f2e056cf640 1 -- 172.21.15.33:0/1752002934 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e00105d00 msgr2=0x7f2e0019cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:13.041 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.481+0000 7f2e056cf640 1 --2- 172.21.15.33:0/1752002934 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e00105d00 0x7f2e0019cda0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2df0034040 tx=0x7f2df0004a40 comp rx=0 tx=0).stop 2024-09-12T12:16:13.041 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.481+0000 7f2e056cf640 1 -- 172.21.15.33:0/1752002934 shutdown_connections 2024-09-12T12:16:13.041 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.481+0000 7f2e056cf640 1 --2- 172.21.15.33:0/1752002934 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e00105d00 0x7f2e0019cda0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:13.041 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.481+0000 7f2e056cf640 1 -- 172.21.15.33:0/1752002934 >> 172.21.15.33:0/1752002934 conn(0x7f2e00101a90 msgr2=0x7f2e00193380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:13.041 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.481+0000 7f2e056cf640 1 -- 172.21.15.33:0/1752002934 shutdown_connections 2024-09-12T12:16:13.041 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:12.481+0000 7f2e056cf640 1 -- 172.21.15.33:0/1752002934 wait complete. 2024-09-12T12:16:13.041 INFO:teuthology.orchestra.run.smithi033.stdout:mon is available 2024-09-12T12:16:13.042 INFO:teuthology.orchestra.run.smithi033.stdout:Assimilating anything we can from ceph.conf... 2024-09-12T12:16:13.134 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:12 smithi033 ceph-mon[30879]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-12T12:16:13.134 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:12 smithi033 ceph-mon[30879]: monmap epoch 1 2024-09-12T12:16:13.135 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:12 smithi033 ceph-mon[30879]: fsid a66dfafc-7100-11ef-bcea-c7b262605968 2024-09-12T12:16:13.135 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:12 smithi033 ceph-mon[30879]: last_changed 2024-09-12T12:16:08.918919+0000 2024-09-12T12:16:13.135 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:12 smithi033 ceph-mon[30879]: created 2024-09-12T12:16:08.918919+0000 2024-09-12T12:16:13.135 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:12 smithi033 ceph-mon[30879]: min_mon_release 19 (squid) 2024-09-12T12:16:13.135 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:12 smithi033 ceph-mon[30879]: election_strategy: 1 2024-09-12T12:16:13.135 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:12 smithi033 ceph-mon[30879]: 0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T12:16:13.135 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:12 smithi033 ceph-mon[30879]: fsmap 2024-09-12T12:16:13.135 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:12 smithi033 ceph-mon[30879]: osdmap e1: 0 total, 0 up, 0 in 2024-09-12T12:16:13.135 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:12 smithi033 ceph-mon[30879]: mgrmap e1: no daemons active 2024-09-12T12:16:13.135 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:12 smithi033 ceph-mon[30879]: from='client.? 172.21.15.33:0/1752002934' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-12T12:16:14.073 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:13 smithi033 ceph-mon[30879]: from='client.? 172.21.15.33:0/124911190' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-12T12:16:14.073 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:13 smithi033 ceph-mon[30879]: from='client.? 172.21.15.33:0/124911190' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-12T12:16:14.081 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-09-12T12:16:14.082 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout [global] 2024-09-12T12:16:14.082 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout fsid = a66dfafc-7100-11ef-bcea-c7b262605968 2024-09-12T12:16:14.082 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.33:3300,v1:172.21.15.33:6789] 2024-09-12T12:16:14.082 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-12T12:16:14.082 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-12T12:16:14.082 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-12T12:16:14.082 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-12T12:16:14.082 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-09-12T12:16:14.082 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-12T12:16:14.082 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-12T12:16:14.082 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-09-12T12:16:14.082 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout [osd] 2024-09-12T12:16:14.082 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-12T12:16:14.083 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-12T12:16:14.083 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-12T12:16:14.083 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-12T12:16:14.083 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-12T12:16:14.083 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.457+0000 7fe39201a640 1 Processor -- start 2024-09-12T12:16:14.083 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.457+0000 7fe39201a640 1 -- start start 2024-09-12T12:16:14.083 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.457+0000 7fe39201a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe38c106310 0x7fe38c106710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:14.083 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.457+0000 7fe39201a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe38c106ce0 con 0x7fe38c106310 2024-09-12T12:16:14.083 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.457+0000 7fe38b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe38c106310 0x7fe38c106710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:14.083 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.457+0000 7fe38b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe38c106310 0x7fe38c106710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45310/0 (socket says 172.21.15.33:45310) 2024-09-12T12:16:14.084 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.457+0000 7fe38b7fe640 1 -- 172.21.15.33:0/2430858952 learned_addr learned my addr 172.21.15.33:0/2430858952 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:14.084 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.458+0000 7fe38b7fe640 1 -- 172.21.15.33:0/2430858952 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe38c107510 con 0x7fe38c106310 2024-09-12T12:16:14.084 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.458+0000 7fe38b7fe640 1 --2- 172.21.15.33:0/2430858952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe38c106310 0x7fe38c106710 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fe37c009820 tx=0x7fe37c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bad72bcf9da0e6f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:14.084 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.458+0000 7fe38a7fc640 1 -- 172.21.15.33:0/2430858952 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe37c037070 con 0x7fe38c106310 2024-09-12T12:16:14.084 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.459+0000 7fe38a7fc640 1 -- 172.21.15.33:0/2430858952 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe37c032440 con 0x7fe38c106310 2024-09-12T12:16:14.084 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.459+0000 7fe38a7fc640 1 -- 172.21.15.33:0/2430858952 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe37c032740 con 0x7fe38c106310 2024-09-12T12:16:14.084 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.459+0000 7fe39201a640 1 -- 172.21.15.33:0/2430858952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe38c106310 msgr2=0x7fe38c106710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:14.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.459+0000 7fe39201a640 1 --2- 172.21.15.33:0/2430858952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe38c106310 0x7fe38c106710 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fe37c009820 tx=0x7fe37c02a270 comp rx=0 tx=0).stop 2024-09-12T12:16:14.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.459+0000 7fe39201a640 1 -- 172.21.15.33:0/2430858952 shutdown_connections 2024-09-12T12:16:14.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.459+0000 7fe39201a640 1 --2- 172.21.15.33:0/2430858952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe38c106310 0x7fe38c106710 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.459+0000 7fe39201a640 1 -- 172.21.15.33:0/2430858952 >> 172.21.15.33:0/2430858952 conn(0x7fe38c101ae0 msgr2=0x7fe38c103f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:14.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.459+0000 7fe39201a640 1 -- 172.21.15.33:0/2430858952 shutdown_connections 2024-09-12T12:16:14.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.459+0000 7fe39201a640 1 -- 172.21.15.33:0/2430858952 wait complete. 2024-09-12T12:16:14.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.460+0000 7fe39201a640 1 Processor -- start 2024-09-12T12:16:14.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.460+0000 7fe39201a640 1 -- start start 2024-09-12T12:16:14.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.460+0000 7fe39201a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe38c106310 0x7fe38c07b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:14.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.460+0000 7fe39201a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe38c107ab0 con 0x7fe38c106310 2024-09-12T12:16:14.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.460+0000 7fe38b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe38c106310 0x7fe38c07b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:14.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.460+0000 7fe38b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe38c106310 0x7fe38c07b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45318/0 (socket says 172.21.15.33:45318) 2024-09-12T12:16:14.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.460+0000 7fe38b7fe640 1 -- 172.21.15.33:0/124911190 learned_addr learned my addr 172.21.15.33:0/124911190 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:14.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.460+0000 7fe38b7fe640 1 -- 172.21.15.33:0/124911190 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe38c19d900 con 0x7fe38c106310 2024-09-12T12:16:14.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.460+0000 7fe38b7fe640 1 --2- 172.21.15.33:0/124911190 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe38c106310 0x7fe38c07b9f0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fe37c0090b0 tx=0x7fe37c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:14.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.461+0000 7fe388ff9640 1 -- 172.21.15.33:0/124911190 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe37c041070 con 0x7fe38c106310 2024-09-12T12:16:14.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.461+0000 7fe388ff9640 1 -- 172.21.15.33:0/124911190 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe37c03c7a0 con 0x7fe38c106310 2024-09-12T12:16:14.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.461+0000 7fe39201a640 1 -- 172.21.15.33:0/124911190 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe38c19dad0 con 0x7fe38c106310 2024-09-12T12:16:14.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.461+0000 7fe388ff9640 1 -- 172.21.15.33:0/124911190 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe37c037040 con 0x7fe38c106310 2024-09-12T12:16:14.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.461+0000 7fe39201a640 1 -- 172.21.15.33:0/124911190 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe38c19de70 con 0x7fe38c106310 2024-09-12T12:16:14.088 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.461+0000 7fe388ff9640 1 -- 172.21.15.33:0/124911190 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe37c044070 con 0x7fe38c106310 2024-09-12T12:16:14.088 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.461+0000 7fe388ff9640 1 -- 172.21.15.33:0/124911190 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe37c03d3f0 con 0x7fe38c106310 2024-09-12T12:16:14.088 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.462+0000 7fe39201a640 1 -- 172.21.15.33:0/124911190 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe38c108100 con 0x7fe38c106310 2024-09-12T12:16:14.088 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.464+0000 7fe388ff9640 1 -- 172.21.15.33:0/124911190 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fe37c046450 con 0x7fe38c106310 2024-09-12T12:16:14.088 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.524+0000 7fe39201a640 1 -- 172.21.15.33:0/124911190 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fe38c19e2e0 con 0x7fe38c106310 2024-09-12T12:16:14.088 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.527+0000 7fe388ff9640 1 -- 172.21.15.33:0/124911190 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7fe37c046630 con 0x7fe38c106310 2024-09-12T12:16:14.089 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.528+0000 7fe388ff9640 1 -- 172.21.15.33:0/124911190 <== mon.0 v2:172.21.15.33:3300/0 8 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fe37c056070 con 0x7fe38c106310 2024-09-12T12:16:14.089 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.529+0000 7fe39201a640 1 -- 172.21.15.33:0/124911190 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe38c106310 msgr2=0x7fe38c07b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:14.089 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.529+0000 7fe39201a640 1 --2- 172.21.15.33:0/124911190 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe38c106310 0x7fe38c07b9f0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fe37c0090b0 tx=0x7fe37c0046c0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.089 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.529+0000 7fe39201a640 1 -- 172.21.15.33:0/124911190 shutdown_connections 2024-09-12T12:16:14.089 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.529+0000 7fe39201a640 1 --2- 172.21.15.33:0/124911190 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe38c106310 0x7fe38c07b9f0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.089 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.529+0000 7fe39201a640 1 -- 172.21.15.33:0/124911190 >> 172.21.15.33:0/124911190 conn(0x7fe38c101ae0 msgr2=0x7fe38c18dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:14.089 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.529+0000 7fe39201a640 1 -- 172.21.15.33:0/124911190 shutdown_connections 2024-09-12T12:16:14.089 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:13.529+0000 7fe39201a640 1 -- 172.21.15.33:0/124911190 wait complete. 2024-09-12T12:16:14.089 INFO:teuthology.orchestra.run.smithi033.stdout:Generating new minimal ceph.conf... 2024-09-12T12:16:15.014 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:14 smithi033 ceph-mon[30879]: from='client.? 172.21.15.33:0/906553805' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:15.021 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.463+0000 7f32e453e640 1 Processor -- start 2024-09-12T12:16:15.021 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.463+0000 7f32e453e640 1 -- start start 2024-09-12T12:16:15.021 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.463+0000 7f32e453e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32dc109810 0x7f32dc109c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:15.021 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.463+0000 7f32e453e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f32dc10a200 con 0x7f32dc109810 2024-09-12T12:16:15.021 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.464+0000 7f32e22da640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32dc109810 0x7f32dc109c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:15.021 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.464+0000 7f32e22da640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32dc109810 0x7f32dc109c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45324/0 (socket says 172.21.15.33:45324) 2024-09-12T12:16:15.021 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.464+0000 7f32e22da640 1 -- 172.21.15.33:0/2099071922 learned_addr learned my addr 172.21.15.33:0/2099071922 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:15.021 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.464+0000 7f32e22da640 1 -- 172.21.15.33:0/2099071922 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32dc10a380 con 0x7f32dc109810 2024-09-12T12:16:15.022 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.464+0000 7f32e22da640 1 --2- 172.21.15.33:0/2099071922 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32dc109810 0x7f32dc109c30 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f32d8009820 tx=0x7f32d802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=836b29195303fe92 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:15.022 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.465+0000 7f32e12d8640 1 -- 172.21.15.33:0/2099071922 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32d8037070 con 0x7f32dc109810 2024-09-12T12:16:15.022 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.465+0000 7f32e12d8640 1 -- 172.21.15.33:0/2099071922 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f32d80328d0 con 0x7f32dc109810 2024-09-12T12:16:15.022 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.465+0000 7f32e12d8640 1 -- 172.21.15.33:0/2099071922 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32d80307d0 con 0x7f32dc109810 2024-09-12T12:16:15.022 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.465+0000 7f32e453e640 1 -- 172.21.15.33:0/2099071922 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32dc109810 msgr2=0x7f32dc109c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:15.022 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.465+0000 7f32e453e640 1 --2- 172.21.15.33:0/2099071922 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32dc109810 0x7f32dc109c30 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f32d8009820 tx=0x7f32d802a270 comp rx=0 tx=0).stop 2024-09-12T12:16:15.022 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.465+0000 7f32e453e640 1 -- 172.21.15.33:0/2099071922 shutdown_connections 2024-09-12T12:16:15.022 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.465+0000 7f32e453e640 1 --2- 172.21.15.33:0/2099071922 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32dc109810 0x7f32dc109c30 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:15.022 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.465+0000 7f32e453e640 1 -- 172.21.15.33:0/2099071922 >> 172.21.15.33:0/2099071922 conn(0x7f32dc07cc10 msgr2=0x7f32dc07d020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:15.022 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.465+0000 7f32e453e640 1 -- 172.21.15.33:0/2099071922 shutdown_connections 2024-09-12T12:16:15.022 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.465+0000 7f32e453e640 1 -- 172.21.15.33:0/2099071922 wait complete. 2024-09-12T12:16:15.022 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.466+0000 7f32e453e640 1 Processor -- start 2024-09-12T12:16:15.023 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.466+0000 7f32e453e640 1 -- start start 2024-09-12T12:16:15.023 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.466+0000 7f32e453e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32dc109810 0x7f32dc19d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:15.023 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.466+0000 7f32e453e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f32dc10da60 con 0x7f32dc109810 2024-09-12T12:16:15.023 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.466+0000 7f32e22da640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32dc109810 0x7f32dc19d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:15.023 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.466+0000 7f32e22da640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32dc109810 0x7f32dc19d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45336/0 (socket says 172.21.15.33:45336) 2024-09-12T12:16:15.023 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.466+0000 7f32e22da640 1 -- 172.21.15.33:0/906553805 learned_addr learned my addr 172.21.15.33:0/906553805 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:15.023 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.467+0000 7f32e22da640 1 -- 172.21.15.33:0/906553805 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32dc19dae0 con 0x7f32dc109810 2024-09-12T12:16:15.023 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.467+0000 7f32e22da640 1 --2- 172.21.15.33:0/906553805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32dc109810 0x7f32dc19d5a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f32d80097f0 tx=0x7f32d8030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:15.023 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.467+0000 7f32d37fe640 1 -- 172.21.15.33:0/906553805 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32d8037040 con 0x7f32dc109810 2024-09-12T12:16:15.023 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.467+0000 7f32d37fe640 1 -- 172.21.15.33:0/906553805 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f32d8032bb0 con 0x7f32dc109810 2024-09-12T12:16:15.023 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.467+0000 7f32e453e640 1 -- 172.21.15.33:0/906553805 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32dc19dd70 con 0x7f32dc109810 2024-09-12T12:16:15.023 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.467+0000 7f32d37fe640 1 -- 172.21.15.33:0/906553805 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32d803a390 con 0x7f32dc109810 2024-09-12T12:16:15.024 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.467+0000 7f32e453e640 1 -- 172.21.15.33:0/906553805 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32dc1a0a60 con 0x7f32dc109810 2024-09-12T12:16:15.024 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.467+0000 7f32d37fe640 1 -- 172.21.15.33:0/906553805 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f32d803a580 con 0x7f32dc109810 2024-09-12T12:16:15.024 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.467+0000 7f32d37fe640 1 -- 172.21.15.33:0/906553805 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f32d8044b50 con 0x7f32dc109810 2024-09-12T12:16:15.024 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.468+0000 7f32e453e640 1 -- 172.21.15.33:0/906553805 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32dc10dbe0 con 0x7f32dc109810 2024-09-12T12:16:15.024 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.470+0000 7f32d37fe640 1 -- 172.21.15.33:0/906553805 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f32d8032d60 con 0x7f32dc109810 2024-09-12T12:16:15.024 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.530+0000 7f32e453e640 1 -- 172.21.15.33:0/906553805 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f32dc109cb0 con 0x7f32dc109810 2024-09-12T12:16:15.024 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.530+0000 7f32d37fe640 1 -- 172.21.15.33:0/906553805 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f32dc109cb0 con 0x7f32dc109810 2024-09-12T12:16:15.024 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.531+0000 7f32e453e640 1 -- 172.21.15.33:0/906553805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32dc109810 msgr2=0x7f32dc19d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:15.024 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.531+0000 7f32e453e640 1 --2- 172.21.15.33:0/906553805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32dc109810 0x7f32dc19d5a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f32d80097f0 tx=0x7f32d8030d00 comp rx=0 tx=0).stop 2024-09-12T12:16:15.024 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.531+0000 7f32e453e640 1 -- 172.21.15.33:0/906553805 shutdown_connections 2024-09-12T12:16:15.024 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.531+0000 7f32e453e640 1 --2- 172.21.15.33:0/906553805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32dc109810 0x7f32dc19d5a0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:15.025 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.531+0000 7f32e453e640 1 -- 172.21.15.33:0/906553805 >> 172.21.15.33:0/906553805 conn(0x7f32dc07cc10 msgr2=0x7f32dc1074a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:15.025 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.531+0000 7f32e453e640 1 -- 172.21.15.33:0/906553805 shutdown_connections 2024-09-12T12:16:15.025 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:14.531+0000 7f32e453e640 1 -- 172.21.15.33:0/906553805 wait complete. 2024-09-12T12:16:15.025 INFO:teuthology.orchestra.run.smithi033.stdout:Restarting the monitor... 2024-09-12T12:16:15.268 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:15 smithi033 systemd[1]: Stopping Ceph mon.a for a66dfafc-7100-11ef-bcea-c7b262605968... 2024-09-12T12:16:15.617 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:15 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mon-a[30875]: 2024-09-12T12:16:15.267+0000 7faa70b4e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:16:15.617 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:15 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mon-a[30875]: 2024-09-12T12:16:15.267+0000 7faa70b4e640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-12T12:16:15.617 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:15 smithi033 podman[31122]: 2024-09-12 12:16:15.339871437 +0000 UTC m=+0.154354461 container died 3a998fa9acc65d894db28631c6be205845e35a8f7d8e20be9f414614a719a022 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mon-a, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-b53b6d3) 2024-09-12T12:16:15.617 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:15 smithi033 podman[31122]: 2024-09-12 12:16:15.617538594 +0000 UTC m=+0.432021657 container cleanup 3a998fa9acc65d894db28631c6be205845e35a8f7d8e20be9f414614a719a022 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731) 2024-09-12T12:16:15.869 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:15 smithi033 bash[31122]: ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mon-a 2024-09-12T12:16:15.870 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:15 smithi033 podman[31135]: 2024-09-12 12:16:15.85187413 +0000 UTC m=+0.511191561 container remove 3a998fa9acc65d894db28631c6be205845e35a8f7d8e20be9f414614a719a022 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mon-a, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3) 2024-09-12T12:16:16.193 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:15 smithi033 systemd[1]: ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-12T12:16:16.193 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:15 smithi033 systemd[1]: Stopped Ceph mon.a for a66dfafc-7100-11ef-bcea-c7b262605968. 2024-09-12T12:16:16.193 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:15 smithi033 systemd[1]: Starting Ceph mon.a for a66dfafc-7100-11ef-bcea-c7b262605968... 2024-09-12T12:16:16.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 podman[31227]: 2024-09-12 12:16:16.194358724 +0000 UTC m=+0.101365991 container create 9782252fc41214a4bf7a90e72311ab5dc113602681d9fe9950ff2dc35b43ee38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mon-a, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-12T12:16:16.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 podman[31227]: 2024-09-12 12:16:16.109227339 +0000 UTC m=+0.016234622 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T12:16:16.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 podman[31227]: 2024-09-12 12:16:16.4055614 +0000 UTC m=+0.312568668 container init 9782252fc41214a4bf7a90e72311ab5dc113602681d9fe9950ff2dc35b43ee38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mon-a, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-12T12:16:16.482 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 podman[31227]: 2024-09-12 12:16:16.408743532 +0000 UTC m=+0.315750799 container start 9782252fc41214a4bf7a90e72311ab5dc113602681d9fe9950ff2dc35b43ee38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mon-a, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-12T12:16:16.482 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: set uid:gid to 167:167 (ceph:ceph) 2024-09-12T12:16:16.482 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable), process ceph-mon, pid 2 2024-09-12T12:16:16.482 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: pidfile_write: ignore empty --pid-file 2024-09-12T12:16:16.482 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: load: jerasure load: lrc 2024-09-12T12:16:16.482 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: RocksDB version: 7.9.2 2024-09-12T12:16:16.482 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Git sha 0 2024-09-12T12:16:16.482 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Compile date 2024-09-09 16:23:28 2024-09-12T12:16:16.482 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: DB SUMMARY 2024-09-12T12:16:16.482 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: DB Session ID: 12V37MN4NIAT7JFWI729 2024-09-12T12:16:16.482 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: CURRENT file: CURRENT 2024-09-12T12:16:16.482 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: IDENTITY file: IDENTITY 2024-09-12T12:16:16.482 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-12T12:16:16.483 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-12T12:16:16.483 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 104246 ; 2024-09-12T12:16:16.483 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.error_if_exists: 0 2024-09-12T12:16:16.484 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.create_if_missing: 0 2024-09-12T12:16:16.484 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.paranoid_checks: 1 2024-09-12T12:16:16.484 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-12T12:16:16.484 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-12T12:16:16.485 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-12T12:16:16.485 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.env: 0x5606f96b1940 2024-09-12T12:16:16.485 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.fs: PosixFileSystem 2024-09-12T12:16:16.485 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.info_log: 0x5606fb9356e0 2024-09-12T12:16:16.485 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.max_file_opening_threads: 16 2024-09-12T12:16:16.485 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.statistics: (nil) 2024-09-12T12:16:16.485 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.use_fsync: 0 2024-09-12T12:16:16.485 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.max_log_file_size: 0 2024-09-12T12:16:16.485 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-12T12:16:16.485 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-12T12:16:16.485 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.keep_log_file_num: 1000 2024-09-12T12:16:16.486 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.recycle_log_file_num: 0 2024-09-12T12:16:16.486 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.allow_fallocate: 1 2024-09-12T12:16:16.486 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.allow_mmap_reads: 0 2024-09-12T12:16:16.486 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.allow_mmap_writes: 0 2024-09-12T12:16:16.486 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.use_direct_reads: 0 2024-09-12T12:16:16.486 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-12T12:16:16.486 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.create_missing_column_families: 0 2024-09-12T12:16:16.486 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.db_log_dir: 2024-09-12T12:16:16.486 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.wal_dir: 2024-09-12T12:16:16.486 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-12T12:16:16.486 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-12T12:16:16.486 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-12T12:16:16.486 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-12T12:16:16.487 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-12T12:16:16.487 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-12T12:16:16.487 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.advise_random_on_open: 1 2024-09-12T12:16:16.487 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.db_write_buffer_size: 0 2024-09-12T12:16:16.487 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.write_buffer_manager: 0x5606fb944dc0 2024-09-12T12:16:16.487 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-12T12:16:16.487 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-12T12:16:16.487 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-12T12:16:16.487 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.rate_limiter: (nil) 2024-09-12T12:16:16.488 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-12T12:16:16.488 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.wal_recovery_mode: 2 2024-09-12T12:16:16.488 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.enable_thread_tracking: 0 2024-09-12T12:16:16.488 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.enable_pipelined_write: 0 2024-09-12T12:16:16.488 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.unordered_write: 0 2024-09-12T12:16:16.488 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-12T12:16:16.488 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-12T12:16:16.488 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-12T12:16:16.488 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-12T12:16:16.488 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.row_cache: None 2024-09-12T12:16:16.488 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.wal_filter: None 2024-09-12T12:16:16.489 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-12T12:16:16.489 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.allow_ingest_behind: 0 2024-09-12T12:16:16.489 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.two_write_queues: 0 2024-09-12T12:16:16.489 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.manual_wal_flush: 0 2024-09-12T12:16:16.489 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.wal_compression: 0 2024-09-12T12:16:16.489 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.atomic_flush: 0 2024-09-12T12:16:16.490 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-12T12:16:16.490 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-12T12:16:16.490 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-12T12:16:16.490 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.log_readahead_size: 0 2024-09-12T12:16:16.490 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-12T12:16:16.490 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.best_efforts_recovery: 0 2024-09-12T12:16:16.490 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-12T12:16:16.490 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-12T12:16:16.491 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.allow_data_in_errors: 0 2024-09-12T12:16:16.491 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.db_host_id: __hostname__ 2024-09-12T12:16:16.491 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-12T12:16:16.491 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.max_background_jobs: 2 2024-09-12T12:16:16.491 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.max_background_compactions: -1 2024-09-12T12:16:16.491 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.max_subcompactions: 1 2024-09-12T12:16:16.491 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-12T12:16:16.491 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-12T12:16:16.491 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-12T12:16:16.491 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.max_total_wal_size: 0 2024-09-12T12:16:16.491 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-12T12:16:16.491 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-12T12:16:16.491 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-12T12:16:16.491 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-12T12:16:16.492 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.max_open_files: -1 2024-09-12T12:16:16.492 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.bytes_per_sync: 0 2024-09-12T12:16:16.492 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-12T12:16:16.492 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-12T12:16:16.492 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.compaction_readahead_size: 0 2024-09-12T12:16:16.492 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.max_background_flushes: -1 2024-09-12T12:16:16.492 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Compression algorithms supported: 2024-09-12T12:16:16.492 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: kZSTD supported: 0 2024-09-12T12:16:16.492 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: kXpressCompression supported: 0 2024-09-12T12:16:16.492 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: kBZip2Compression supported: 0 2024-09-12T12:16:16.492 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-12T12:16:16.492 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: kLZ4Compression supported: 1 2024-09-12T12:16:16.493 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: kZlibCompression supported: 1 2024-09-12T12:16:16.493 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: kLZ4HCCompression supported: 1 2024-09-12T12:16:16.493 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: kSnappyCompression supported: 1 2024-09-12T12:16:16.493 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-12T12:16:16.493 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-12T12:16:16.493 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-12T12:16:16.493 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-12T12:16:16.493 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-12T12:16:16.493 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.merge_operator: 2024-09-12T12:16:16.493 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.compaction_filter: None 2024-09-12T12:16:16.493 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.compaction_filter_factory: None 2024-09-12T12:16:16.493 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.sst_partitioner_factory: None 2024-09-12T12:16:16.493 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-12T12:16:16.493 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-12T12:16:16.494 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5606fb935320) 2024-09-12T12:16:16.494 INFO:journalctl@ceph.mon.a.smithi033.stdout: cache_index_and_filter_blocks: 1 2024-09-12T12:16:16.494 INFO:journalctl@ceph.mon.a.smithi033.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-12T12:16:16.494 INFO:journalctl@ceph.mon.a.smithi033.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-12T12:16:16.494 INFO:journalctl@ceph.mon.a.smithi033.stdout: pin_top_level_index_and_filter: 1 2024-09-12T12:16:16.494 INFO:journalctl@ceph.mon.a.smithi033.stdout: index_type: 0 2024-09-12T12:16:16.494 INFO:journalctl@ceph.mon.a.smithi033.stdout: data_block_index_type: 0 2024-09-12T12:16:16.494 INFO:journalctl@ceph.mon.a.smithi033.stdout: index_shortening: 1 2024-09-12T12:16:16.494 INFO:journalctl@ceph.mon.a.smithi033.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-12T12:16:16.494 INFO:journalctl@ceph.mon.a.smithi033.stdout: checksum: 4 2024-09-12T12:16:16.494 INFO:journalctl@ceph.mon.a.smithi033.stdout: no_block_cache: 0 2024-09-12T12:16:16.494 INFO:journalctl@ceph.mon.a.smithi033.stdout: block_cache: 0x5606fb9291f0 2024-09-12T12:16:16.494 INFO:journalctl@ceph.mon.a.smithi033.stdout: block_cache_name: BinnedLRUCache 2024-09-12T12:16:16.494 INFO:journalctl@ceph.mon.a.smithi033.stdout: block_cache_options: 2024-09-12T12:16:16.495 INFO:journalctl@ceph.mon.a.smithi033.stdout: capacity : 536870912 2024-09-12T12:16:16.495 INFO:journalctl@ceph.mon.a.smithi033.stdout: num_shard_bits : 4 2024-09-12T12:16:16.495 INFO:journalctl@ceph.mon.a.smithi033.stdout: strict_capacity_limit : 0 2024-09-12T12:16:16.495 INFO:journalctl@ceph.mon.a.smithi033.stdout: high_pri_pool_ratio: 0.000 2024-09-12T12:16:16.495 INFO:journalctl@ceph.mon.a.smithi033.stdout: block_cache_compressed: (nil) 2024-09-12T12:16:16.495 INFO:journalctl@ceph.mon.a.smithi033.stdout: persistent_cache: (nil) 2024-09-12T12:16:16.495 INFO:journalctl@ceph.mon.a.smithi033.stdout: block_size: 4096 2024-09-12T12:16:16.495 INFO:journalctl@ceph.mon.a.smithi033.stdout: block_size_deviation: 10 2024-09-12T12:16:16.495 INFO:journalctl@ceph.mon.a.smithi033.stdout: block_restart_interval: 16 2024-09-12T12:16:16.495 INFO:journalctl@ceph.mon.a.smithi033.stdout: index_block_restart_interval: 1 2024-09-12T12:16:16.495 INFO:journalctl@ceph.mon.a.smithi033.stdout: metadata_block_size: 4096 2024-09-12T12:16:16.495 INFO:journalctl@ceph.mon.a.smithi033.stdout: partition_filters: 0 2024-09-12T12:16:16.495 INFO:journalctl@ceph.mon.a.smithi033.stdout: use_delta_encoding: 1 2024-09-12T12:16:16.496 INFO:journalctl@ceph.mon.a.smithi033.stdout: filter_policy: bloomfilter 2024-09-12T12:16:16.496 INFO:journalctl@ceph.mon.a.smithi033.stdout: whole_key_filtering: 1 2024-09-12T12:16:16.496 INFO:journalctl@ceph.mon.a.smithi033.stdout: verify_compression: 0 2024-09-12T12:16:16.496 INFO:journalctl@ceph.mon.a.smithi033.stdout: read_amp_bytes_per_bit: 0 2024-09-12T12:16:16.496 INFO:journalctl@ceph.mon.a.smithi033.stdout: format_version: 5 2024-09-12T12:16:16.496 INFO:journalctl@ceph.mon.a.smithi033.stdout: enable_index_compression: 1 2024-09-12T12:16:16.496 INFO:journalctl@ceph.mon.a.smithi033.stdout: block_align: 0 2024-09-12T12:16:16.496 INFO:journalctl@ceph.mon.a.smithi033.stdout: max_auto_readahead_size: 262144 2024-09-12T12:16:16.496 INFO:journalctl@ceph.mon.a.smithi033.stdout: prepopulate_block_cache: 0 2024-09-12T12:16:16.496 INFO:journalctl@ceph.mon.a.smithi033.stdout: initial_auto_readahead_size: 8192 2024-09-12T12:16:16.496 INFO:journalctl@ceph.mon.a.smithi033.stdout: num_file_reads_for_auto_readahead: 2 2024-09-12T12:16:16.496 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.write_buffer_size: 33554432 2024-09-12T12:16:16.496 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.max_write_buffer_number: 2 2024-09-12T12:16:16.497 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.compression: NoCompression 2024-09-12T12:16:16.497 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.bottommost_compression: Disabled 2024-09-12T12:16:16.497 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.prefix_extractor: nullptr 2024-09-12T12:16:16.497 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-12T12:16:16.497 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.num_levels: 7 2024-09-12T12:16:16.497 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-12T12:16:16.497 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-12T12:16:16.497 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-12T12:16:16.497 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-12T12:16:16.497 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-12T12:16:16.497 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-12T12:16:16.497 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-12T12:16:16.497 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-12T12:16:16.497 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-12T12:16:16.498 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-12T12:16:16.498 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-12T12:16:16.498 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-12T12:16:16.498 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-12T12:16:16.498 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.compression_opts.level: 32767 2024-09-12T12:16:16.498 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.compression_opts.strategy: 0 2024-09-12T12:16:16.498 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-12T12:16:16.498 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-12T12:16:16.498 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-12T12:16:16.498 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-12T12:16:16.499 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.compression_opts.enabled: false 2024-09-12T12:16:16.499 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-12T12:16:16.499 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-12T12:16:16.499 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-12T12:16:16.499 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-12T12:16:16.499 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.target_file_size_base: 67108864 2024-09-12T12:16:16.499 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-12T12:16:16.499 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-12T12:16:16.499 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-12T12:16:16.499 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-12T12:16:16.499 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-12T12:16:16.499 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-12T12:16:16.500 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-12T12:16:16.500 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-12T12:16:16.500 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-12T12:16:16.500 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-12T12:16:16.500 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-12T12:16:16.500 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-12T12:16:16.500 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-12T12:16:16.500 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-12T12:16:16.500 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.arena_block_size: 1048576 2024-09-12T12:16:16.500 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-12T12:16:16.500 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-12T12:16:16.500 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.disable_auto_compactions: 0 2024-09-12T12:16:16.500 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-12T12:16:16.501 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-12T12:16:16.501 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-12T12:16:16.501 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-12T12:16:16.501 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-12T12:16:16.501 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-12T12:16:16.501 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-12T12:16:16.501 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-12T12:16:16.501 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-12T12:16:16.501 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-12T12:16:16.501 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-12T12:16:16.501 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.inplace_update_support: 0 2024-09-12T12:16:16.501 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-12T12:16:16.501 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-12T12:16:16.501 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-12T12:16:16.502 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-12T12:16:16.502 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.bloom_locality: 0 2024-09-12T12:16:16.502 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.max_successive_merges: 0 2024-09-12T12:16:16.502 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-12T12:16:16.502 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.paranoid_file_checks: 0 2024-09-12T12:16:16.502 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.force_consistency_checks: 1 2024-09-12T12:16:16.502 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.report_bg_io_stats: 0 2024-09-12T12:16:16.502 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.ttl: 2592000 2024-09-12T12:16:16.502 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-12T12:16:16.502 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-12T12:16:16.502 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-12T12:16:16.502 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.enable_blob_files: false 2024-09-12T12:16:16.502 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.min_blob_size: 0 2024-09-12T12:16:16.502 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.blob_file_size: 268435456 2024-09-12T12:16:16.503 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-12T12:16:16.503 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-12T12:16:16.503 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-12T12:16:16.503 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-12T12:16:16.503 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-12T12:16:16.503 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.blob_file_starting_level: 0 2024-09-12T12:16:16.503 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-12T12:16:16.503 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-12T12:16:16.503 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-12T12:16:16.503 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 65081ee8-c654-4cbf-8f80-4d581ac58ff2 2024-09-12T12:16:16.503 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726143376435602, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-12T12:16:16.503 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-12T12:16:16.503 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726143376436698, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 99482, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 324, "table_properties": {"data_size": 97376, "index_size": 298, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14044, "raw_average_key_size": 49, "raw_value_size": 89697, "raw_average_value_size": 316, "num_data_blocks": 12, "num_entries": 283, "num_filter_entries": 283, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726143376, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "65081ee8-c654-4cbf-8f80-4d581ac58ff2", "db_session_id": "12V37MN4NIAT7JFWI729", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-12T12:16:16.504 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726143376436798, "job": 1, "event": "recovery_finished"} 2024-09-12T12:16:16.504 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-12T12:16:16.504 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-12T12:16:16.504 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5606fb956e00 2024-09-12T12:16:16.504 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: DB pointer 0x5606fba52000 2024-09-12T12:16:16.504 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-12T12:16:16.504 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-12T12:16:16.504 INFO:journalctl@ceph.mon.a.smithi033.stdout: ** DB Stats ** 2024-09-12T12:16:16.504 INFO:journalctl@ceph.mon.a.smithi033.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T12:16:16.504 INFO:journalctl@ceph.mon.a.smithi033.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-12T12:16:16.504 INFO:journalctl@ceph.mon.a.smithi033.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T12:16:16.504 INFO:journalctl@ceph.mon.a.smithi033.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T12:16:16.504 INFO:journalctl@ceph.mon.a.smithi033.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-12T12:16:16.504 INFO:journalctl@ceph.mon.a.smithi033.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T12:16:16.505 INFO:journalctl@ceph.mon.a.smithi033.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T12:16:16.505 INFO:journalctl@ceph.mon.a.smithi033.stdout: 2024-09-12T12:16:16.505 INFO:journalctl@ceph.mon.a.smithi033.stdout: ** Compaction Stats [default] ** 2024-09-12T12:16:16.505 INFO:journalctl@ceph.mon.a.smithi033.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T12:16:16.505 INFO:journalctl@ceph.mon.a.smithi033.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-12T12:16:16.505 INFO:journalctl@ceph.mon.a.smithi033.stdout: L0 2/0 99.01 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 138.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T12:16:16.505 INFO:journalctl@ceph.mon.a.smithi033.stdout: Sum 2/0 99.01 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 138.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T12:16:16.505 INFO:journalctl@ceph.mon.a.smithi033.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 138.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T12:16:16.505 INFO:journalctl@ceph.mon.a.smithi033.stdout: 2024-09-12T12:16:16.505 INFO:journalctl@ceph.mon.a.smithi033.stdout: ** Compaction Stats [default] ** 2024-09-12T12:16:16.505 INFO:journalctl@ceph.mon.a.smithi033.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T12:16:16.505 INFO:journalctl@ceph.mon.a.smithi033.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-12T12:16:16.506 INFO:journalctl@ceph.mon.a.smithi033.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 138.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T12:16:16.506 INFO:journalctl@ceph.mon.a.smithi033.stdout: 2024-09-12T12:16:16.506 INFO:journalctl@ceph.mon.a.smithi033.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-12T12:16:16.506 INFO:journalctl@ceph.mon.a.smithi033.stdout: 2024-09-12T12:16:16.506 INFO:journalctl@ceph.mon.a.smithi033.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T12:16:16.506 INFO:journalctl@ceph.mon.a.smithi033.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-12T12:16:16.506 INFO:journalctl@ceph.mon.a.smithi033.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-12T12:16:16.506 INFO:journalctl@ceph.mon.a.smithi033.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-12T12:16:16.506 INFO:journalctl@ceph.mon.a.smithi033.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-12T12:16:16.506 INFO:journalctl@ceph.mon.a.smithi033.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-12T12:16:16.506 INFO:journalctl@ceph.mon.a.smithi033.stdout: Cumulative compaction: 0.00 GB write, 29.16 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T12:16:16.506 INFO:journalctl@ceph.mon.a.smithi033.stdout: Interval compaction: 0.00 GB write, 29.16 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T12:16:16.506 INFO:journalctl@ceph.mon.a.smithi033.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-12T12:16:16.507 INFO:journalctl@ceph.mon.a.smithi033.stdout: Block cache BinnedLRUCache@0x5606fb9291f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-12T12:16:16.507 INFO:journalctl@ceph.mon.a.smithi033.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-12T12:16:16.507 INFO:journalctl@ceph.mon.a.smithi033.stdout: 2024-09-12T12:16:16.507 INFO:journalctl@ceph.mon.a.smithi033.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-12T12:16:16.507 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: starting mon.a rank 0 at public addrs [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] at bind addrs [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid a66dfafc-7100-11ef-bcea-c7b262605968 2024-09-12T12:16:16.507 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: mon.a@-1(???) e1 preinit fsid a66dfafc-7100-11ef-bcea-c7b262605968 2024-09-12T12:16:16.507 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: mon.a@-1(???).mds e1 new map 2024-09-12T12:16:16.507 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: mon.a@-1(???).mds e1 print_map 2024-09-12T12:16:16.507 INFO:journalctl@ceph.mon.a.smithi033.stdout: e1 2024-09-12T12:16:16.507 INFO:journalctl@ceph.mon.a.smithi033.stdout: btime 2024-09-12T12:16:11:904584+0000 2024-09-12T12:16:16.507 INFO:journalctl@ceph.mon.a.smithi033.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T12:16:16.507 INFO:journalctl@ceph.mon.a.smithi033.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T12:16:16.507 INFO:journalctl@ceph.mon.a.smithi033.stdout: legacy client fscid: -1 2024-09-12T12:16:16.507 INFO:journalctl@ceph.mon.a.smithi033.stdout: 2024-09-12T12:16:16.508 INFO:journalctl@ceph.mon.a.smithi033.stdout: No filesystems configured 2024-09-12T12:16:16.508 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-12T12:16:16.508 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T12:16:16.508 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T12:16:16.508 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T12:16:16.508 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-12T12:16:16.509 INFO:teuthology.orchestra.run.smithi033.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-12T12:16:16.783 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 bash[31227]: 9782252fc41214a4bf7a90e72311ab5dc113602681d9fe9950ff2dc35b43ee38 2024-09-12T12:16:16.783 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 systemd[1]: Started Ceph mon.a for a66dfafc-7100-11ef-bcea-c7b262605968. 2024-09-12T12:16:16.783 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-12T12:16:16.783 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: monmap epoch 1 2024-09-12T12:16:16.783 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: fsid a66dfafc-7100-11ef-bcea-c7b262605968 2024-09-12T12:16:16.784 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: last_changed 2024-09-12T12:16:08.918919+0000 2024-09-12T12:16:16.784 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: created 2024-09-12T12:16:08.918919+0000 2024-09-12T12:16:16.784 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: min_mon_release 19 (squid) 2024-09-12T12:16:16.784 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: election_strategy: 1 2024-09-12T12:16:16.784 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: 0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T12:16:16.784 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: fsmap 2024-09-12T12:16:16.784 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: osdmap e1: 0 total, 0 up, 0 in 2024-09-12T12:16:16.784 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:16 smithi033 ceph-mon[31246]: mgrmap e1: no daemons active 2024-09-12T12:16:17.502 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.866+0000 7f690a14a640 1 Processor -- start 2024-09-12T12:16:17.502 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.867+0000 7f690a14a640 1 -- start start 2024-09-12T12:16:17.502 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.867+0000 7f690a14a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6904107e90 0x7f690410a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:17.502 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.867+0000 7f690a14a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6904075880 con 0x7f6904107e90 2024-09-12T12:16:17.502 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.867+0000 7f69037fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6904107e90 0x7f690410a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:17.502 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.867+0000 7f69037fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6904107e90 0x7f690410a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45342/0 (socket says 172.21.15.33:45342) 2024-09-12T12:16:17.502 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.867+0000 7f69037fe640 1 -- 172.21.15.33:0/1182903668 learned_addr learned my addr 172.21.15.33:0/1182903668 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:17.502 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.867+0000 7f69037fe640 1 -- 172.21.15.33:0/1182903668 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f690410a7c0 con 0x7f6904107e90 2024-09-12T12:16:17.502 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.869+0000 7f69037fe640 1 --2- 172.21.15.33:0/1182903668 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6904107e90 0x7f690410a280 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f68f4009820 tx=0x7f68f402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54da5bcf441b161e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:17.502 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.869+0000 7f69027fc640 1 -- 172.21.15.33:0/1182903668 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68f4037070 con 0x7f6904107e90 2024-09-12T12:16:17.502 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.869+0000 7f69027fc640 1 -- 172.21.15.33:0/1182903668 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f68f40328d0 con 0x7f6904107e90 2024-09-12T12:16:17.503 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.869+0000 7f69027fc640 1 -- 172.21.15.33:0/1182903668 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68f40307d0 con 0x7f6904107e90 2024-09-12T12:16:17.503 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.870+0000 7f690a14a640 1 -- 172.21.15.33:0/1182903668 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6904107e90 msgr2=0x7f690410a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:17.503 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.870+0000 7f690a14a640 1 --2- 172.21.15.33:0/1182903668 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6904107e90 0x7f690410a280 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f68f4009820 tx=0x7f68f402a270 comp rx=0 tx=0).stop 2024-09-12T12:16:17.503 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.870+0000 7f690a14a640 1 -- 172.21.15.33:0/1182903668 shutdown_connections 2024-09-12T12:16:17.503 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.870+0000 7f690a14a640 1 --2- 172.21.15.33:0/1182903668 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6904107e90 0x7f690410a280 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.503 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.870+0000 7f690a14a640 1 -- 172.21.15.33:0/1182903668 >> 172.21.15.33:0/1182903668 conn(0x7f6904101a90 msgr2=0x7f6904103ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:17.503 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.870+0000 7f690a14a640 1 -- 172.21.15.33:0/1182903668 shutdown_connections 2024-09-12T12:16:17.503 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.870+0000 7f690a14a640 1 -- 172.21.15.33:0/1182903668 wait complete. 2024-09-12T12:16:17.503 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.871+0000 7f690a14a640 1 Processor -- start 2024-09-12T12:16:17.503 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.871+0000 7f690a14a640 1 -- start start 2024-09-12T12:16:17.503 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.871+0000 7f690a14a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6904107e90 0x7f690419b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:17.503 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.871+0000 7f690a14a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f690410b800 con 0x7f6904107e90 2024-09-12T12:16:17.503 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.871+0000 7f69037fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6904107e90 0x7f690419b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:17.504 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.871+0000 7f69037fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6904107e90 0x7f690419b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45350/0 (socket says 172.21.15.33:45350) 2024-09-12T12:16:17.504 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.871+0000 7f69037fe640 1 -- 172.21.15.33:0/3567497788 learned_addr learned my addr 172.21.15.33:0/3567497788 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:17.504 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.871+0000 7f69037fe640 1 -- 172.21.15.33:0/3567497788 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f690419b8a0 con 0x7f6904107e90 2024-09-12T12:16:17.504 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.871+0000 7f69037fe640 1 --2- 172.21.15.33:0/3567497788 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6904107e90 0x7f690419b360 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f68f4032e10 tx=0x7f68f4032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:17.504 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.872+0000 7f6900ff9640 1 -- 172.21.15.33:0/3567497788 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68f4042070 con 0x7f6904107e90 2024-09-12T12:16:17.504 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.872+0000 7f6900ff9640 1 -- 172.21.15.33:0/3567497788 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f68f4030c80 con 0x7f6904107e90 2024-09-12T12:16:17.504 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.872+0000 7f690a14a640 1 -- 172.21.15.33:0/3567497788 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f690419bb30 con 0x7f6904107e90 2024-09-12T12:16:17.504 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.872+0000 7f6900ff9640 1 -- 172.21.15.33:0/3567497788 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68f4037040 con 0x7f6904107e90 2024-09-12T12:16:17.504 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.872+0000 7f690a14a640 1 -- 172.21.15.33:0/3567497788 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f690419e820 con 0x7f6904107e90 2024-09-12T12:16:17.504 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.872+0000 7f6900ff9640 1 -- 172.21.15.33:0/3567497788 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f68f4045070 con 0x7f6904107e90 2024-09-12T12:16:17.504 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.872+0000 7f6900ff9640 1 -- 172.21.15.33:0/3567497788 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f68f4047a20 con 0x7f6904107e90 2024-09-12T12:16:17.504 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.873+0000 7f690a14a640 1 -- 172.21.15.33:0/3567497788 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69041082f0 con 0x7f6904107e90 2024-09-12T12:16:17.505 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.875+0000 7f6900ff9640 1 -- 172.21.15.33:0/3567497788 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f68f403c5f0 con 0x7f6904107e90 2024-09-12T12:16:17.505 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.934+0000 7f690a14a640 1 -- 172.21.15.33:0/3567497788 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f690419ee00 con 0x7f6904107e90 2024-09-12T12:16:17.505 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.937+0000 7f6900ff9640 1 -- 172.21.15.33:0/3567497788 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f68f403c7d0 con 0x7f6904107e90 2024-09-12T12:16:17.505 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.938+0000 7f690a14a640 1 -- 172.21.15.33:0/3567497788 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6904107e90 msgr2=0x7f690419b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:17.505 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.938+0000 7f690a14a640 1 --2- 172.21.15.33:0/3567497788 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6904107e90 0x7f690419b360 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f68f4032e10 tx=0x7f68f4032e40 comp rx=0 tx=0).stop 2024-09-12T12:16:17.505 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.938+0000 7f690a14a640 1 -- 172.21.15.33:0/3567497788 shutdown_connections 2024-09-12T12:16:17.505 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.938+0000 7f690a14a640 1 --2- 172.21.15.33:0/3567497788 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6904107e90 0x7f690419b360 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.505 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.938+0000 7f690a14a640 1 -- 172.21.15.33:0/3567497788 >> 172.21.15.33:0/3567497788 conn(0x7f6904101a90 msgr2=0x7f69041025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:17.505 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.938+0000 7f690a14a640 1 -- 172.21.15.33:0/3567497788 shutdown_connections 2024-09-12T12:16:17.505 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:16.938+0000 7f690a14a640 1 -- 172.21.15.33:0/3567497788 wait complete. 2024-09-12T12:16:17.505 INFO:teuthology.orchestra.run.smithi033.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-12T12:16:17.528 INFO:teuthology.orchestra.run.smithi033.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-12T12:16:17.528 INFO:teuthology.orchestra.run.smithi033.stdout:Creating mgr... 2024-09-12T12:16:17.528 INFO:teuthology.orchestra.run.smithi033.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-12T12:16:17.529 INFO:teuthology.orchestra.run.smithi033.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-12T12:16:17.783 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mgr.x 2024-09-12T12:16:17.783 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Failed to reset failed state of unit ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mgr.x.service: Unit ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mgr.x.service not loaded. 2024-09-12T12:16:17.938 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-a66dfafc-7100-11ef-bcea-c7b262605968.target.wants/ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-a66dfafc-7100-11ef-bcea-c7b262605968@.service. 2024-09-12T12:16:18.172 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:17 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/3567497788' entity='client.admin' 2024-09-12T12:16:18.173 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:17 smithi033 systemd[1]: Starting Ceph mgr.x for a66dfafc-7100-11ef-bcea-c7b262605968... 2024-09-12T12:16:18.450 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:18 smithi033 podman[31458]: 2024-09-12 12:16:18.172912479 +0000 UTC m=+0.112300670 container create 9b12cb9dca8aea219654b28b05bc4602a5dd7fa89ca4c6706ac35c29ee0f059a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-12T12:16:18.450 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:18 smithi033 podman[31458]: 2024-09-12 12:16:18.077290347 +0000 UTC m=+0.016678548 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T12:16:18.451 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:18 smithi033 podman[31458]: 2024-09-12 12:16:18.375349339 +0000 UTC m=+0.314737540 container init 9b12cb9dca8aea219654b28b05bc4602a5dd7fa89ca4c6706ac35c29ee0f059a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-12T12:16:18.451 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:18 smithi033 podman[31458]: 2024-09-12 12:16:18.378178166 +0000 UTC m=+0.317566368 container start 9b12cb9dca8aea219654b28b05bc4602a5dd7fa89ca4c6706ac35c29ee0f059a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-12T12:16:18.451 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:18 smithi033 bash[31458]: 9b12cb9dca8aea219654b28b05bc4602a5dd7fa89ca4c6706ac35c29ee0f059a 2024-09-12T12:16:18.467 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T12:16:18.467 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout disabled 2024-09-12T12:16:18.476 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T12:16:18.476 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout inactive 2024-09-12T12:16:18.476 INFO:teuthology.orchestra.run.smithi033.stdout:firewalld.service is not enabled 2024-09-12T12:16:18.476 INFO:teuthology.orchestra.run.smithi033.stdout:Not possible to enable service . firewalld.service is not available 2024-09-12T12:16:18.487 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T12:16:18.487 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout disabled 2024-09-12T12:16:18.496 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T12:16:18.496 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout inactive 2024-09-12T12:16:18.496 INFO:teuthology.orchestra.run.smithi033.stdout:firewalld.service is not enabled 2024-09-12T12:16:18.496 INFO:teuthology.orchestra.run.smithi033.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-12T12:16:18.496 INFO:teuthology.orchestra.run.smithi033.stdout:Waiting for mgr to start... 2024-09-12T12:16:18.496 INFO:teuthology.orchestra.run.smithi033.stdout:Waiting for mgr... 2024-09-12T12:16:18.707 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:18 smithi033 systemd[1]: Started Ceph mgr.x for a66dfafc-7100-11ef-bcea-c7b262605968. 2024-09-12T12:16:18.707 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:18 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:18.512+0000 7fc8c0560040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T12:16:18.707 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:18 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:18.573+0000 7fc8c0560040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T12:16:18.964 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:18 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:18.734+0000 7fc8c0560040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T12:16:18.964 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:18 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:18.804+0000 7fc8c0560040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T12:16:18.965 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:18 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:18.964+0000 7fc8c0560040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T12:16:19.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:19 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/827108394' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-12T12:16:19.231 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:19 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:19.116+0000 7fc8c0560040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T12:16:19.532 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:19 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:19.451+0000 7fc8c0560040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T12:16:19.532 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:19 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:19.516+0000 7fc8c0560040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T12:16:19.537 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-09-12T12:16:19.537 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout { 2024-09-12T12:16:19.537 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "fsid": "a66dfafc-7100-11ef-bcea-c7b262605968", 2024-09-12T12:16:19.537 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "health": { 2024-09-12T12:16:19.537 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-12T12:16:19.537 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-12T12:16:19.537 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-12T12:16:19.538 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:16:19.538 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-12T12:16:19.538 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-12T12:16:19.538 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 0 2024-09-12T12:16:19.538 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-09-12T12:16:19.538 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-12T12:16:19.538 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "a" 2024-09-12T12:16:19.538 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-09-12T12:16:19.538 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-12T12:16:19.538 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-12T12:16:19.538 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T12:16:19.538 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-12T12:16:19.538 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-12T12:16:19.538 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:16:19.539 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-12T12:16:19.539 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T12:16:19.539 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-12T12:16:19.539 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-12T12:16:19.539 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-12T12:16:19.546 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-12T12:16:19.546 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-12T12:16:19.546 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-12T12:16:19.546 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:16:19.547 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-12T12:16:19.547 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-12T12:16:19.547 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-12T12:16:19.547 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-12T12:16:19.547 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-12T12:16:19.547 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-12T12:16:19.547 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-12T12:16:19.547 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-12T12:16:19.547 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-12T12:16:19.547 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:16:19.547 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-12T12:16:19.547 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T12:16:19.547 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "btime": "2024-09-12T12:16:11:904584+0000", 2024-09-12T12:16:19.548 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-12T12:16:19.548 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-12T12:16:19.548 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:16:19.548 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-12T12:16:19.548 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-12T12:16:19.548 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-12T12:16:19.548 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-12T12:16:19.548 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-12T12:16:19.548 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-12T12:16:19.548 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "restful" 2024-09-12T12:16:19.548 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-09-12T12:16:19.548 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T12:16:19.548 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:16:19.549 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-12T12:16:19.549 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T12:16:19.549 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "modified": "2024-09-12T12:16:11.905401+0000", 2024-09-12T12:16:19.549 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T12:16:19.549 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:16:19.549 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-12T12:16:19.549 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout } 2024-09-12T12:16:19.549 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.901+0000 7fd85a7c7640 1 Processor -- start 2024-09-12T12:16:19.549 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.901+0000 7fd85a7c7640 1 -- start start 2024-09-12T12:16:19.549 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.901+0000 7fd85a7c7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd85407cd70 0x7fd85407b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:19.549 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.901+0000 7fd85a7c7640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd85407b7a0 con 0x7fd85407cd70 2024-09-12T12:16:19.549 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.902+0000 7fd853fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd85407cd70 0x7fd85407b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:19.549 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.902+0000 7fd853fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd85407cd70 0x7fd85407b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45384/0 (socket says 172.21.15.33:45384) 2024-09-12T12:16:19.550 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.902+0000 7fd853fff640 1 -- 172.21.15.33:0/218136907 learned_addr learned my addr 172.21.15.33:0/218136907 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:19.550 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.902+0000 7fd853fff640 1 -- 172.21.15.33:0/218136907 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd85407b920 con 0x7fd85407cd70 2024-09-12T12:16:19.550 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.903+0000 7fd853fff640 1 --2- 172.21.15.33:0/218136907 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd85407cd70 0x7fd85407b1d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd844009820 tx=0x7fd84402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0f0f6c373f021b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:19.550 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.903+0000 7fd852ffd640 1 -- 172.21.15.33:0/218136907 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd844037070 con 0x7fd85407cd70 2024-09-12T12:16:19.550 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.903+0000 7fd852ffd640 1 -- 172.21.15.33:0/218136907 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fd8440328d0 con 0x7fd85407cd70 2024-09-12T12:16:19.550 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.903+0000 7fd852ffd640 1 -- 172.21.15.33:0/218136907 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8440307d0 con 0x7fd85407cd70 2024-09-12T12:16:19.550 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.904+0000 7fd85a7c7640 1 -- 172.21.15.33:0/218136907 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd85407cd70 msgr2=0x7fd85407b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:19.550 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.904+0000 7fd85a7c7640 1 --2- 172.21.15.33:0/218136907 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd85407cd70 0x7fd85407b1d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd844009820 tx=0x7fd84402a270 comp rx=0 tx=0).stop 2024-09-12T12:16:19.550 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.904+0000 7fd85a7c7640 1 -- 172.21.15.33:0/218136907 shutdown_connections 2024-09-12T12:16:19.550 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.904+0000 7fd85a7c7640 1 --2- 172.21.15.33:0/218136907 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd85407cd70 0x7fd85407b1d0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.550 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.904+0000 7fd85a7c7640 1 -- 172.21.15.33:0/218136907 >> 172.21.15.33:0/218136907 conn(0x7fd854102bc0 msgr2=0x7fd854104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:19.550 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.904+0000 7fd85a7c7640 1 -- 172.21.15.33:0/218136907 shutdown_connections 2024-09-12T12:16:19.551 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.904+0000 7fd85a7c7640 1 -- 172.21.15.33:0/218136907 wait complete. 2024-09-12T12:16:19.551 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.905+0000 7fd85a7c7640 1 Processor -- start 2024-09-12T12:16:19.551 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.905+0000 7fd85a7c7640 1 -- start start 2024-09-12T12:16:19.551 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.905+0000 7fd85a7c7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd85407cd70 0x7fd85419d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:19.551 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.905+0000 7fd85a7c7640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd85410d9e0 con 0x7fd85407cd70 2024-09-12T12:16:19.551 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.905+0000 7fd853fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd85407cd70 0x7fd85419d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:19.551 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.905+0000 7fd853fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd85407cd70 0x7fd85419d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45390/0 (socket says 172.21.15.33:45390) 2024-09-12T12:16:19.551 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.905+0000 7fd853fff640 1 -- 172.21.15.33:0/827108394 learned_addr learned my addr 172.21.15.33:0/827108394 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:19.551 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.905+0000 7fd853fff640 1 -- 172.21.15.33:0/827108394 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd85419dad0 con 0x7fd85407cd70 2024-09-12T12:16:19.551 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.906+0000 7fd853fff640 1 --2- 172.21.15.33:0/827108394 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd85407cd70 0x7fd85419d590 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd844009940 tx=0x7fd844032e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:19.551 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.906+0000 7fd8517fa640 1 -- 172.21.15.33:0/827108394 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd844042070 con 0x7fd85407cd70 2024-09-12T12:16:19.551 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.906+0000 7fd8517fa640 1 -- 172.21.15.33:0/827108394 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fd844030c80 con 0x7fd85407cd70 2024-09-12T12:16:19.551 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.906+0000 7fd8517fa640 1 -- 172.21.15.33:0/827108394 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd844037040 con 0x7fd85407cd70 2024-09-12T12:16:19.552 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.906+0000 7fd85a7c7640 1 -- 172.21.15.33:0/827108394 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd85419dd60 con 0x7fd85407cd70 2024-09-12T12:16:19.552 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.906+0000 7fd85a7c7640 1 -- 172.21.15.33:0/827108394 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8541a0a50 con 0x7fd85407cd70 2024-09-12T12:16:19.552 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.906+0000 7fd8517fa640 1 -- 172.21.15.33:0/827108394 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd844045070 con 0x7fd85407cd70 2024-09-12T12:16:19.552 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.906+0000 7fd8517fa640 1 -- 172.21.15.33:0/827108394 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd8440479e0 con 0x7fd85407cd70 2024-09-12T12:16:19.552 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.907+0000 7fd85a7c7640 1 -- 172.21.15.33:0/827108394 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd85407b250 con 0x7fd85407cd70 2024-09-12T12:16:19.552 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.909+0000 7fd8517fa640 1 -- 172.21.15.33:0/827108394 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fd84403c5f0 con 0x7fd85407cd70 2024-09-12T12:16:19.552 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.971+0000 7fd85a7c7640 1 -- 172.21.15.33:0/827108394 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fd8541a0fc0 con 0x7fd85407cd70 2024-09-12T12:16:19.552 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.972+0000 7fd8517fa640 1 -- 172.21.15.33:0/827108394 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fd84403c7d0 con 0x7fd85407cd70 2024-09-12T12:16:19.552 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.973+0000 7fd85a7c7640 1 -- 172.21.15.33:0/827108394 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd85407cd70 msgr2=0x7fd85419d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:19.552 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.973+0000 7fd85a7c7640 1 --2- 172.21.15.33:0/827108394 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd85407cd70 0x7fd85419d590 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd844009940 tx=0x7fd844032e10 comp rx=0 tx=0).stop 2024-09-12T12:16:19.552 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.973+0000 7fd85a7c7640 1 -- 172.21.15.33:0/827108394 shutdown_connections 2024-09-12T12:16:19.552 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.973+0000 7fd85a7c7640 1 --2- 172.21.15.33:0/827108394 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd85407cd70 0x7fd85419d590 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.552 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.973+0000 7fd85a7c7640 1 -- 172.21.15.33:0/827108394 >> 172.21.15.33:0/827108394 conn(0x7fd854102bc0 msgr2=0x7fd8541036d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:19.553 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.973+0000 7fd85a7c7640 1 -- 172.21.15.33:0/827108394 shutdown_connections 2024-09-12T12:16:19.553 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:18.973+0000 7fd85a7c7640 1 -- 172.21.15.33:0/827108394 wait complete. 2024-09-12T12:16:19.553 INFO:teuthology.orchestra.run.smithi033.stdout:mgr not available, waiting (1/15)... 2024-09-12T12:16:19.980 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:19 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:19.711+0000 7fc8c0560040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T12:16:20.980 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:20 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:20.641+0000 7fc8c0560040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T12:16:20.980 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:20 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:20.712+0000 7fc8c0560040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T12:16:21.607 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:21 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:21.480+0000 7fc8c0560040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T12:16:21.860 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:21 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:21.607+0000 7fc8c0560040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T12:16:21.860 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:21 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:21.762+0000 7fc8c0560040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T12:16:21.860 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:21 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:21.827+0000 7fc8c0560040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T12:16:22.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:22 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/2971345173' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-12T12:16:22.131 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:21 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:21.989+0000 7fc8c0560040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T12:16:22.131 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:22 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:22.067+0000 7fc8c0560040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T12:16:22.131 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:22 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:22.130+0000 7fc8c0560040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T12:16:22.389 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:22 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:22.299+0000 7fc8c0560040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T12:16:22.389 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:22 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:22.367+0000 7fc8c0560040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T12:16:22.650 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:22 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:22.438+0000 7fc8c0560040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T12:16:22.650 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:22 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:22.525+0000 7fc8c0560040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T12:16:22.650 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:22 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:22.588+0000 7fc8c0560040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T12:16:22.650 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:22 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:22.650+0000 7fc8c0560040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T12:16:22.696 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-09-12T12:16:22.696 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout { 2024-09-12T12:16:22.696 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "fsid": "a66dfafc-7100-11ef-bcea-c7b262605968", 2024-09-12T12:16:22.696 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "health": { 2024-09-12T12:16:22.696 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-12T12:16:22.696 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-12T12:16:22.696 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-12T12:16:22.696 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:16:22.697 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-12T12:16:22.697 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-12T12:16:22.697 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 0 2024-09-12T12:16:22.697 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-09-12T12:16:22.697 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-12T12:16:22.697 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "a" 2024-09-12T12:16:22.697 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-09-12T12:16:22.697 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-12T12:16:22.697 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-12T12:16:22.697 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T12:16:22.697 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-12T12:16:22.697 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-12T12:16:22.697 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:16:22.698 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-12T12:16:22.698 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T12:16:22.698 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-12T12:16:22.698 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-12T12:16:22.698 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-12T12:16:22.698 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-12T12:16:22.698 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-12T12:16:22.698 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-12T12:16:22.698 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:16:22.698 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-12T12:16:22.698 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-12T12:16:22.698 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-12T12:16:22.698 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-12T12:16:22.699 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-12T12:16:22.699 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-12T12:16:22.699 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-12T12:16:22.699 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-12T12:16:22.699 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-12T12:16:22.699 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:16:22.699 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-12T12:16:22.699 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T12:16:22.699 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "btime": "2024-09-12T12:16:11:904584+0000", 2024-09-12T12:16:22.699 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-12T12:16:22.699 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-12T12:16:22.699 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:16:22.700 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-12T12:16:22.700 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-12T12:16:22.700 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-12T12:16:22.700 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-12T12:16:22.700 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-12T12:16:22.700 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-12T12:16:22.700 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "restful" 2024-09-12T12:16:22.700 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-09-12T12:16:22.700 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T12:16:22.700 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:16:22.700 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-12T12:16:22.700 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T12:16:22.701 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "modified": "2024-09-12T12:16:11.905401+0000", 2024-09-12T12:16:22.701 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T12:16:22.701 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:16:22.701 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-12T12:16:22.701 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout } 2024-09-12T12:16:22.701 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:21.940+0000 7fb4be12a640 1 Processor -- start 2024-09-12T12:16:22.701 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:21.940+0000 7fb4be12a640 1 -- start start 2024-09-12T12:16:22.701 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:21.940+0000 7fb4be12a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4b807cd50 0x7fb4b807b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:22.701 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:21.940+0000 7fb4be12a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb4b807b780 con 0x7fb4b807cd50 2024-09-12T12:16:22.701 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:21.940+0000 7fb4b77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4b807cd50 0x7fb4b807b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:22.701 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:21.940+0000 7fb4b77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4b807cd50 0x7fb4b807b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58468/0 (socket says 172.21.15.33:58468) 2024-09-12T12:16:22.701 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:21.940+0000 7fb4b77fe640 1 -- 172.21.15.33:0/4085655850 learned_addr learned my addr 172.21.15.33:0/4085655850 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:22.701 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:21.940+0000 7fb4b77fe640 1 -- 172.21.15.33:0/4085655850 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4b807b900 con 0x7fb4b807cd50 2024-09-12T12:16:22.701 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:21.941+0000 7fb4b77fe640 1 --2- 172.21.15.33:0/4085655850 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4b807cd50 0x7fb4b807b1b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8009820 tx=0x7fb4a802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2546e8b80fcbf0f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:22.702 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:21.941+0000 7fb4b6ffd640 1 -- 172.21.15.33:0/4085655850 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4a8037070 con 0x7fb4b807cd50 2024-09-12T12:16:22.702 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:21.941+0000 7fb4b6ffd640 1 -- 172.21.15.33:0/4085655850 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fb4a80328d0 con 0x7fb4b807cd50 2024-09-12T12:16:22.702 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:21.941+0000 7fb4b6ffd640 1 -- 172.21.15.33:0/4085655850 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4a80307d0 con 0x7fb4b807cd50 2024-09-12T12:16:22.702 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:21.942+0000 7fb4be12a640 1 -- 172.21.15.33:0/4085655850 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4b807cd50 msgr2=0x7fb4b807b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:22.702 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:21.942+0000 7fb4be12a640 1 --2- 172.21.15.33:0/4085655850 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4b807cd50 0x7fb4b807b1b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8009820 tx=0x7fb4a802a270 comp rx=0 tx=0).stop 2024-09-12T12:16:22.702 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:21.942+0000 7fb4be12a640 1 -- 172.21.15.33:0/4085655850 shutdown_connections 2024-09-12T12:16:22.702 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:21.942+0000 7fb4be12a640 1 --2- 172.21.15.33:0/4085655850 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4b807cd50 0x7fb4b807b1b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:22.702 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:21.942+0000 7fb4be12a640 1 -- 172.21.15.33:0/4085655850 >> 172.21.15.33:0/4085655850 conn(0x7fb4b8102bc0 msgr2=0x7fb4b8104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:22.702 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:21.942+0000 7fb4be12a640 1 -- 172.21.15.33:0/4085655850 shutdown_connections 2024-09-12T12:16:22.702 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:21.942+0000 7fb4be12a640 1 -- 172.21.15.33:0/4085655850 wait complete. 2024-09-12T12:16:22.702 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:21.943+0000 7fb4be12a640 1 Processor -- start 2024-09-12T12:16:22.702 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:21.943+0000 7fb4be12a640 1 -- start start 2024-09-12T12:16:22.703 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:21.943+0000 7fb4be12a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4b807cd50 0x7fb4b819d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:22.703 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:21.943+0000 7fb4be12a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb4b810da00 con 0x7fb4b807cd50 2024-09-12T12:16:22.703 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:21.943+0000 7fb4b77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4b807cd50 0x7fb4b819d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:22.703 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:21.943+0000 7fb4b77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4b807cd50 0x7fb4b819d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58482/0 (socket says 172.21.15.33:58482) 2024-09-12T12:16:22.703 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:21.943+0000 7fb4b77fe640 1 -- 172.21.15.33:0/2971345173 learned_addr learned my addr 172.21.15.33:0/2971345173 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:22.703 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:21.944+0000 7fb4b77fe640 1 -- 172.21.15.33:0/2971345173 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4b819db00 con 0x7fb4b807cd50 2024-09-12T12:16:22.703 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:21.944+0000 7fb4b77fe640 1 --2- 172.21.15.33:0/2971345173 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4b807cd50 0x7fb4b819d5c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8009940 tx=0x7fb4a8032e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:22.703 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:21.944+0000 7fb4b57fa640 1 -- 172.21.15.33:0/2971345173 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4a8042070 con 0x7fb4b807cd50 2024-09-12T12:16:22.703 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:21.944+0000 7fb4b57fa640 1 -- 172.21.15.33:0/2971345173 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fb4a8030c80 con 0x7fb4b807cd50 2024-09-12T12:16:22.703 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:21.944+0000 7fb4be12a640 1 -- 172.21.15.33:0/2971345173 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4b819dd90 con 0x7fb4b807cd50 2024-09-12T12:16:22.703 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:21.944+0000 7fb4b57fa640 1 -- 172.21.15.33:0/2971345173 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4a8037040 con 0x7fb4b807cd50 2024-09-12T12:16:22.703 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:21.944+0000 7fb4be12a640 1 -- 172.21.15.33:0/2971345173 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4b81a0a80 con 0x7fb4b807cd50 2024-09-12T12:16:22.703 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:21.944+0000 7fb4b57fa640 1 -- 172.21.15.33:0/2971345173 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb4a8045070 con 0x7fb4b807cd50 2024-09-12T12:16:22.704 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:21.944+0000 7fb4b57fa640 1 -- 172.21.15.33:0/2971345173 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb4a80479f0 con 0x7fb4b807cd50 2024-09-12T12:16:22.704 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:21.945+0000 7fb4be12a640 1 -- 172.21.15.33:0/2971345173 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4b807b230 con 0x7fb4b807cd50 2024-09-12T12:16:22.704 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:21.947+0000 7fb4b57fa640 1 -- 172.21.15.33:0/2971345173 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fb4a803c5f0 con 0x7fb4b807cd50 2024-09-12T12:16:22.704 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:22.010+0000 7fb4be12a640 1 -- 172.21.15.33:0/2971345173 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fb4b81a0c50 con 0x7fb4b807cd50 2024-09-12T12:16:22.704 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:22.011+0000 7fb4b57fa640 1 -- 172.21.15.33:0/2971345173 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fb4a803c7d0 con 0x7fb4b807cd50 2024-09-12T12:16:22.704 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:22.012+0000 7fb4be12a640 1 -- 172.21.15.33:0/2971345173 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4b807cd50 msgr2=0x7fb4b819d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:22.704 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:22.012+0000 7fb4be12a640 1 --2- 172.21.15.33:0/2971345173 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4b807cd50 0x7fb4b819d5c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8009940 tx=0x7fb4a8032e10 comp rx=0 tx=0).stop 2024-09-12T12:16:22.704 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:22.012+0000 7fb4be12a640 1 -- 172.21.15.33:0/2971345173 shutdown_connections 2024-09-12T12:16:22.704 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:22.012+0000 7fb4be12a640 1 --2- 172.21.15.33:0/2971345173 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4b807cd50 0x7fb4b819d5c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:22.704 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:22.012+0000 7fb4be12a640 1 -- 172.21.15.33:0/2971345173 >> 172.21.15.33:0/2971345173 conn(0x7fb4b8102bc0 msgr2=0x7fb4b8103690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:22.704 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:22.012+0000 7fb4be12a640 1 -- 172.21.15.33:0/2971345173 shutdown_connections 2024-09-12T12:16:22.704 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:22.012+0000 7fb4be12a640 1 -- 172.21.15.33:0/2971345173 wait complete. 2024-09-12T12:16:22.704 INFO:teuthology.orchestra.run.smithi033.stdout:mgr not available, waiting (2/15)... 2024-09-12T12:16:23.981 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:23 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:23.484+0000 7fc8c0560040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T12:16:23.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:23 smithi033 ceph-mon[31246]: Activating manager daemon x 2024-09-12T12:16:23.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:23 smithi033 ceph-mon[31246]: mgrmap e2: x(active, starting, since 0.00289945s) 2024-09-12T12:16:23.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:23 smithi033 ceph-mon[31246]: from='mgr.14100 172.21.15.33:0/3131037827' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T12:16:23.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:23 smithi033 ceph-mon[31246]: from='mgr.14100 172.21.15.33:0/3131037827' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T12:16:23.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:23 smithi033 ceph-mon[31246]: from='mgr.14100 172.21.15.33:0/3131037827' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T12:16:23.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:23 smithi033 ceph-mon[31246]: from='mgr.14100 172.21.15.33:0/3131037827' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:16:23.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:23 smithi033 ceph-mon[31246]: from='mgr.14100 172.21.15.33:0/3131037827' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T12:16:23.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:23 smithi033 ceph-mon[31246]: Manager daemon x is now available 2024-09-12T12:16:23.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:23 smithi033 ceph-mon[31246]: from='mgr.14100 172.21.15.33:0/3131037827' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T12:16:23.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:23 smithi033 ceph-mon[31246]: from='mgr.14100 172.21.15.33:0/3131037827' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T12:16:23.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:23 smithi033 ceph-mon[31246]: from='mgr.14100 172.21.15.33:0/3131037827' entity='mgr.x' 2024-09-12T12:16:23.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:23 smithi033 ceph-mon[31246]: from='mgr.14100 172.21.15.33:0/3131037827' entity='mgr.x' 2024-09-12T12:16:23.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:23 smithi033 ceph-mon[31246]: from='mgr.14100 172.21.15.33:0/3131037827' entity='mgr.x' 2024-09-12T12:16:25.678 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:25 smithi033 ceph-mon[31246]: mgrmap e3: x(active, since 1.00752s) 2024-09-12T12:16:25.679 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:25 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/1481499540' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-12T12:16:25.952 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-09-12T12:16:25.952 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout { 2024-09-12T12:16:25.952 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "fsid": "a66dfafc-7100-11ef-bcea-c7b262605968", 2024-09-12T12:16:25.953 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "health": { 2024-09-12T12:16:25.953 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-12T12:16:25.953 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-12T12:16:25.953 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-12T12:16:25.953 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:16:25.953 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-12T12:16:25.953 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-12T12:16:25.953 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 0 2024-09-12T12:16:25.953 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-09-12T12:16:25.953 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-12T12:16:25.953 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "a" 2024-09-12T12:16:25.953 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-09-12T12:16:25.953 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-09-12T12:16:25.953 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-12T12:16:25.954 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T12:16:25.954 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-12T12:16:25.954 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-12T12:16:25.954 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:16:25.954 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-12T12:16:25.954 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T12:16:25.954 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-12T12:16:25.954 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-12T12:16:25.954 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-12T12:16:25.954 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-12T12:16:25.954 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-12T12:16:25.954 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-12T12:16:25.954 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:16:25.954 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-12T12:16:25.955 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-12T12:16:25.955 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-12T12:16:25.955 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-12T12:16:25.955 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-12T12:16:25.955 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-12T12:16:25.955 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-12T12:16:25.955 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-12T12:16:25.955 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-12T12:16:25.955 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:16:25.955 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-12T12:16:25.955 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T12:16:25.955 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "btime": "2024-09-12T12:16:11:904584+0000", 2024-09-12T12:16:25.955 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-12T12:16:25.955 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-12T12:16:25.956 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:16:25.956 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-12T12:16:25.956 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-12T12:16:25.956 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-12T12:16:25.956 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-12T12:16:25.956 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-12T12:16:25.956 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-12T12:16:25.956 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "restful" 2024-09-12T12:16:25.956 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-09-12T12:16:25.956 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T12:16:25.956 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:16:25.956 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-12T12:16:25.956 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T12:16:25.957 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "modified": "2024-09-12T12:16:11.905401+0000", 2024-09-12T12:16:25.957 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T12:16:25.957 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:16:25.957 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-12T12:16:25.957 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout } 2024-09-12T12:16:25.957 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.123+0000 7f4169195640 1 Processor -- start 2024-09-12T12:16:25.957 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.123+0000 7f4169195640 1 -- start start 2024-09-12T12:16:25.957 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.123+0000 7f4169195640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4164107e90 0x7f416410a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:25.957 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.123+0000 7f4169195640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4164075880 con 0x7f4164107e90 2024-09-12T12:16:25.957 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.124+0000 7f4162d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4164107e90 0x7f416410a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:25.957 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.124+0000 7f4162d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4164107e90 0x7f416410a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58540/0 (socket says 172.21.15.33:58540) 2024-09-12T12:16:25.957 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.124+0000 7f4162d9d640 1 -- 172.21.15.33:0/1303079555 learned_addr learned my addr 172.21.15.33:0/1303079555 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:25.957 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.124+0000 7f4162d9d640 1 -- 172.21.15.33:0/1303079555 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f416410a7c0 con 0x7f4164107e90 2024-09-12T12:16:25.958 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.125+0000 7f4162d9d640 1 --2- 172.21.15.33:0/1303079555 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4164107e90 0x7f416410a280 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4154009e80 tx=0x7f415402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2486143cab1d77c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:25.958 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.125+0000 7f4161d9b640 1 -- 172.21.15.33:0/1303079555 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4154036070 con 0x7f4164107e90 2024-09-12T12:16:25.958 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.125+0000 7f4161d9b640 1 -- 172.21.15.33:0/1303079555 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f4154031890 con 0x7f4164107e90 2024-09-12T12:16:25.958 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.125+0000 7f4161d9b640 1 -- 172.21.15.33:0/1303079555 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4154007980 con 0x7f4164107e90 2024-09-12T12:16:25.958 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.126+0000 7f4169195640 1 -- 172.21.15.33:0/1303079555 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4164107e90 msgr2=0x7f416410a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:25.958 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.126+0000 7f4169195640 1 --2- 172.21.15.33:0/1303079555 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4164107e90 0x7f416410a280 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4154009e80 tx=0x7f415402a7a0 comp rx=0 tx=0).stop 2024-09-12T12:16:25.958 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.126+0000 7f4169195640 1 -- 172.21.15.33:0/1303079555 shutdown_connections 2024-09-12T12:16:25.958 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.126+0000 7f4169195640 1 --2- 172.21.15.33:0/1303079555 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4164107e90 0x7f416410a280 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:25.958 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.126+0000 7f4169195640 1 -- 172.21.15.33:0/1303079555 >> 172.21.15.33:0/1303079555 conn(0x7f4164101a90 msgr2=0x7f4164103ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:25.958 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.126+0000 7f4169195640 1 -- 172.21.15.33:0/1303079555 shutdown_connections 2024-09-12T12:16:25.958 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.126+0000 7f4169195640 1 -- 172.21.15.33:0/1303079555 wait complete. 2024-09-12T12:16:25.958 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.126+0000 7f4169195640 1 Processor -- start 2024-09-12T12:16:25.958 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.127+0000 7f4169195640 1 -- start start 2024-09-12T12:16:25.958 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.127+0000 7f4169195640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4164107e90 0x7f416419b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:25.959 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.127+0000 7f4169195640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f416410b800 con 0x7f4164107e90 2024-09-12T12:16:25.959 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.127+0000 7f4162d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4164107e90 0x7f416419b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:25.959 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.127+0000 7f4162d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4164107e90 0x7f416419b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58544/0 (socket says 172.21.15.33:58544) 2024-09-12T12:16:25.959 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.127+0000 7f4162d9d640 1 -- 172.21.15.33:0/1481499540 learned_addr learned my addr 172.21.15.33:0/1481499540 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:25.959 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.127+0000 7f4162d9d640 1 -- 172.21.15.33:0/1481499540 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f416419b8a0 con 0x7f4164107e90 2024-09-12T12:16:25.959 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.128+0000 7f4162d9d640 1 --2- 172.21.15.33:0/1481499540 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4164107e90 0x7f416419b360 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4154031c70 tx=0x7f4154031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:25.959 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.128+0000 7f414bfff640 1 -- 172.21.15.33:0/1481499540 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4154041020 con 0x7f4164107e90 2024-09-12T12:16:25.959 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.128+0000 7f414bfff640 1 -- 172.21.15.33:0/1481499540 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f415403c900 con 0x7f4164107e90 2024-09-12T12:16:25.959 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.128+0000 7f4169195640 1 -- 172.21.15.33:0/1481499540 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f416419bb30 con 0x7f4164107e90 2024-09-12T12:16:25.959 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.128+0000 7f414bfff640 1 -- 172.21.15.33:0/1481499540 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4154036040 con 0x7f4164107e90 2024-09-12T12:16:25.959 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.128+0000 7f4169195640 1 -- 172.21.15.33:0/1481499540 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f416419e820 con 0x7f4164107e90 2024-09-12T12:16:25.959 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.129+0000 7f414bfff640 1 -- 172.21.15.33:0/1481499540 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 3) ==== 46170+0+0 (secure 0 0 0) 0x7f4154044020 con 0x7f4164107e90 2024-09-12T12:16:25.959 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.129+0000 7f4169195640 1 -- 172.21.15.33:0/1481499540 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41641082f0 con 0x7f4164107e90 2024-09-12T12:16:25.960 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.129+0000 7f414bfff640 1 --2- 172.21.15.33:0/1481499540 >> [v2:172.21.15.33:6800/1156183797,v1:172.21.15.33:6801/1156183797] conn(0x7f414c038e60 0x7f414c03b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:25.960 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.129+0000 7f414bfff640 1 -- 172.21.15.33:0/1481499540 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f415406ce20 con 0x7f4164107e90 2024-09-12T12:16:25.960 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.129+0000 7f416259c640 1 --2- 172.21.15.33:0/1481499540 >> [v2:172.21.15.33:6800/1156183797,v1:172.21.15.33:6801/1156183797] conn(0x7f414c038e60 0x7f414c03b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:25.960 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.130+0000 7f416259c640 1 --2- 172.21.15.33:0/1481499540 >> [v2:172.21.15.33:6800/1156183797,v1:172.21.15.33:6801/1156183797] conn(0x7f414c038e60 0x7f414c03b320 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f41580098c0 tx=0x7f4158006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:25.960 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.134+0000 7f414bfff640 1 -- 172.21.15.33:0/1481499540 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f415404b020 con 0x7f4164107e90 2024-09-12T12:16:25.960 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.377+0000 7f4169195640 1 -- 172.21.15.33:0/1481499540 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f416419ef60 con 0x7f4164107e90 2024-09-12T12:16:25.960 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.377+0000 7f414bfff640 1 -- 172.21.15.33:0/1481499540 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7f4154038dc0 con 0x7f4164107e90 2024-09-12T12:16:25.960 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.379+0000 7f4169195640 1 -- 172.21.15.33:0/1481499540 >> [v2:172.21.15.33:6800/1156183797,v1:172.21.15.33:6801/1156183797] conn(0x7f414c038e60 msgr2=0x7f414c03b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:25.960 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.380+0000 7f4169195640 1 --2- 172.21.15.33:0/1481499540 >> [v2:172.21.15.33:6800/1156183797,v1:172.21.15.33:6801/1156183797] conn(0x7f414c038e60 0x7f414c03b320 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f41580098c0 tx=0x7f4158006db0 comp rx=0 tx=0).stop 2024-09-12T12:16:25.960 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.380+0000 7f4169195640 1 -- 172.21.15.33:0/1481499540 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4164107e90 msgr2=0x7f416419b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:25.961 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.380+0000 7f4169195640 1 --2- 172.21.15.33:0/1481499540 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4164107e90 0x7f416419b360 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4154031c70 tx=0x7f4154031ca0 comp rx=0 tx=0).stop 2024-09-12T12:16:25.961 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.380+0000 7f4169195640 1 -- 172.21.15.33:0/1481499540 shutdown_connections 2024-09-12T12:16:25.961 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.380+0000 7f4169195640 1 --2- 172.21.15.33:0/1481499540 >> [v2:172.21.15.33:6800/1156183797,v1:172.21.15.33:6801/1156183797] conn(0x7f414c038e60 0x7f414c03b320 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:25.961 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.380+0000 7f4169195640 1 --2- 172.21.15.33:0/1481499540 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4164107e90 0x7f416419b360 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:25.961 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.380+0000 7f4169195640 1 -- 172.21.15.33:0/1481499540 >> 172.21.15.33:0/1481499540 conn(0x7f4164101a90 msgr2=0x7f41641025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:25.961 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.380+0000 7f4169195640 1 -- 172.21.15.33:0/1481499540 shutdown_connections 2024-09-12T12:16:25.961 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:25.380+0000 7f4169195640 1 -- 172.21.15.33:0/1481499540 wait complete. 2024-09-12T12:16:25.961 INFO:teuthology.orchestra.run.smithi033.stdout:mgr is available 2024-09-12T12:16:26.544 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:26 smithi033 ceph-mon[31246]: mgrmap e4: x(active, since 2s) 2024-09-12T12:16:27.126 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-09-12T12:16:27.126 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout [global] 2024-09-12T12:16:27.126 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout fsid = a66dfafc-7100-11ef-bcea-c7b262605968 2024-09-12T12:16:27.127 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.33:3300,v1:172.21.15.33:6789] 2024-09-12T12:16:27.127 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-12T12:16:27.127 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-12T12:16:27.127 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-12T12:16:27.127 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-12T12:16:27.127 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-09-12T12:16:27.128 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-12T12:16:27.128 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-12T12:16:27.128 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-09-12T12:16:27.128 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout [osd] 2024-09-12T12:16:27.128 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-12T12:16:27.128 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-12T12:16:27.128 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-12T12:16:27.129 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-12T12:16:27.129 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-12T12:16:27.129 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.355+0000 7f93ffb58640 1 Processor -- start 2024-09-12T12:16:27.129 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.356+0000 7f93ffb58640 1 -- start start 2024-09-12T12:16:27.129 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.356+0000 7f93ffb58640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93f807de40 0x7f93f807c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:27.129 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.356+0000 7f93ffb58640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f93f807c870 con 0x7f93f807de40 2024-09-12T12:16:27.129 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.356+0000 7f93fd8f4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93f807de40 0x7f93f807c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:27.130 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.356+0000 7f93fd8f4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93f807de40 0x7f93f807c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58548/0 (socket says 172.21.15.33:58548) 2024-09-12T12:16:27.130 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.356+0000 7f93fd8f4640 1 -- 172.21.15.33:0/2812068827 learned_addr learned my addr 172.21.15.33:0/2812068827 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:27.130 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.356+0000 7f93fd8f4640 1 -- 172.21.15.33:0/2812068827 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93f807c9f0 con 0x7f93f807de40 2024-09-12T12:16:27.130 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.357+0000 7f93fd8f4640 1 --2- 172.21.15.33:0/2812068827 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93f807de40 0x7f93f807c2a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f93f4009820 tx=0x7f93f402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b1ec40dd53895fd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:27.130 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.357+0000 7f93fc8f2640 1 -- 172.21.15.33:0/2812068827 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93f4037070 con 0x7f93f807de40 2024-09-12T12:16:27.130 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.357+0000 7f93fc8f2640 1 -- 172.21.15.33:0/2812068827 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f93f40328d0 con 0x7f93f807de40 2024-09-12T12:16:27.130 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.357+0000 7f93fc8f2640 1 -- 172.21.15.33:0/2812068827 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93f40307d0 con 0x7f93f807de40 2024-09-12T12:16:27.131 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.358+0000 7f93ffb58640 1 -- 172.21.15.33:0/2812068827 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93f807de40 msgr2=0x7f93f807c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:27.131 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.358+0000 7f93ffb58640 1 --2- 172.21.15.33:0/2812068827 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93f807de40 0x7f93f807c2a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f93f4009820 tx=0x7f93f402a270 comp rx=0 tx=0).stop 2024-09-12T12:16:27.131 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.358+0000 7f93ffb58640 1 -- 172.21.15.33:0/2812068827 shutdown_connections 2024-09-12T12:16:27.131 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.358+0000 7f93ffb58640 1 --2- 172.21.15.33:0/2812068827 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93f807de40 0x7f93f807c2a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:27.131 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.358+0000 7f93ffb58640 1 -- 172.21.15.33:0/2812068827 >> 172.21.15.33:0/2812068827 conn(0x7f93f8102bb0 msgr2=0x7f93f8104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:27.131 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.358+0000 7f93ffb58640 1 -- 172.21.15.33:0/2812068827 shutdown_connections 2024-09-12T12:16:27.132 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.358+0000 7f93ffb58640 1 -- 172.21.15.33:0/2812068827 wait complete. 2024-09-12T12:16:27.132 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.359+0000 7f93ffb58640 1 Processor -- start 2024-09-12T12:16:27.132 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.359+0000 7f93ffb58640 1 -- start start 2024-09-12T12:16:27.132 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.359+0000 7f93ffb58640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93f807de40 0x7f93f819d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:27.132 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.359+0000 7f93ffb58640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f93f810da30 con 0x7f93f807de40 2024-09-12T12:16:27.132 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.359+0000 7f93fd8f4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93f807de40 0x7f93f819d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:27.132 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.359+0000 7f93fd8f4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93f807de40 0x7f93f819d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58560/0 (socket says 172.21.15.33:58560) 2024-09-12T12:16:27.133 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.359+0000 7f93fd8f4640 1 -- 172.21.15.33:0/1558781769 learned_addr learned my addr 172.21.15.33:0/1558781769 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:27.133 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.359+0000 7f93fd8f4640 1 -- 172.21.15.33:0/1558781769 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93f819daa0 con 0x7f93f807de40 2024-09-12T12:16:27.133 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.359+0000 7f93fd8f4640 1 --2- 172.21.15.33:0/1558781769 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93f807de40 0x7f93f819d560 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f93f40097f0 tx=0x7f93f4030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:27.133 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.360+0000 7f93eaffd640 1 -- 172.21.15.33:0/1558781769 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93f4037040 con 0x7f93f807de40 2024-09-12T12:16:27.133 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.360+0000 7f93ffb58640 1 -- 172.21.15.33:0/1558781769 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93f819dd30 con 0x7f93f807de40 2024-09-12T12:16:27.133 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.360+0000 7f93eaffd640 1 -- 172.21.15.33:0/1558781769 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f93f4032bb0 con 0x7f93f807de40 2024-09-12T12:16:27.134 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.360+0000 7f93eaffd640 1 -- 172.21.15.33:0/1558781769 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93f403a390 con 0x7f93f807de40 2024-09-12T12:16:27.134 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.360+0000 7f93ffb58640 1 -- 172.21.15.33:0/1558781769 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93f81a0a20 con 0x7f93f807de40 2024-09-12T12:16:27.134 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.361+0000 7f93eaffd640 1 -- 172.21.15.33:0/1558781769 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f93f403a5d0 con 0x7f93f807de40 2024-09-12T12:16:27.134 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.361+0000 7f93ffb58640 1 -- 172.21.15.33:0/1558781769 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93f807c320 con 0x7f93f807de40 2024-09-12T12:16:27.134 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.361+0000 7f93eaffd640 1 --2- 172.21.15.33:0/1558781769 >> [v2:172.21.15.33:6800/1156183797,v1:172.21.15.33:6801/1156183797] conn(0x7f93e4038f20 0x7f93e403b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:27.135 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.361+0000 7f93eaffd640 1 -- 172.21.15.33:0/1558781769 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f93f406c270 con 0x7f93f807de40 2024-09-12T12:16:27.135 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.361+0000 7f93fd0f3640 1 --2- 172.21.15.33:0/1558781769 >> [v2:172.21.15.33:6800/1156183797,v1:172.21.15.33:6801/1156183797] conn(0x7f93e4038f20 0x7f93e403b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:27.135 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.362+0000 7f93fd0f3640 1 --2- 172.21.15.33:0/1558781769 >> [v2:172.21.15.33:6800/1156183797,v1:172.21.15.33:6801/1156183797] conn(0x7f93e4038f20 0x7f93e403b3e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f93ec0098c0 tx=0x7f93ec006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:27.135 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.366+0000 7f93eaffd640 1 -- 172.21.15.33:0/1558781769 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f93f4032dd0 con 0x7f93f807de40 2024-09-12T12:16:27.135 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.544+0000 7f93ffb58640 1 -- 172.21.15.33:0/1558781769 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f93f81a2220 con 0x7f93f807de40 2024-09-12T12:16:27.135 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.545+0000 7f93eaffd640 1 -- 172.21.15.33:0/1558781769 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+429 (secure 0 0 0) 0x7f93f402cb70 con 0x7f93f807de40 2024-09-12T12:16:27.136 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.547+0000 7f93ffb58640 1 -- 172.21.15.33:0/1558781769 >> [v2:172.21.15.33:6800/1156183797,v1:172.21.15.33:6801/1156183797] conn(0x7f93e4038f20 msgr2=0x7f93e403b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:27.136 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.547+0000 7f93ffb58640 1 --2- 172.21.15.33:0/1558781769 >> [v2:172.21.15.33:6800/1156183797,v1:172.21.15.33:6801/1156183797] conn(0x7f93e4038f20 0x7f93e403b3e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f93ec0098c0 tx=0x7f93ec006db0 comp rx=0 tx=0).stop 2024-09-12T12:16:27.136 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.547+0000 7f93ffb58640 1 -- 172.21.15.33:0/1558781769 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93f807de40 msgr2=0x7f93f819d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:27.136 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.547+0000 7f93ffb58640 1 --2- 172.21.15.33:0/1558781769 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93f807de40 0x7f93f819d560 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f93f40097f0 tx=0x7f93f4030d00 comp rx=0 tx=0).stop 2024-09-12T12:16:27.136 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.547+0000 7f93ffb58640 1 -- 172.21.15.33:0/1558781769 shutdown_connections 2024-09-12T12:16:27.136 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.547+0000 7f93ffb58640 1 --2- 172.21.15.33:0/1558781769 >> [v2:172.21.15.33:6800/1156183797,v1:172.21.15.33:6801/1156183797] conn(0x7f93e4038f20 0x7f93e403b3e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:27.137 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.547+0000 7f93ffb58640 1 --2- 172.21.15.33:0/1558781769 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93f807de40 0x7f93f819d560 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:27.137 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.547+0000 7f93ffb58640 1 -- 172.21.15.33:0/1558781769 >> 172.21.15.33:0/1558781769 conn(0x7f93f8102bb0 msgr2=0x7f93f8103730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:27.137 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.547+0000 7f93ffb58640 1 -- 172.21.15.33:0/1558781769 shutdown_connections 2024-09-12T12:16:27.137 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:26.547+0000 7f93ffb58640 1 -- 172.21.15.33:0/1558781769 wait complete. 2024-09-12T12:16:27.137 INFO:teuthology.orchestra.run.smithi033.stdout:Enabling cephadm module... 2024-09-12T12:16:27.751 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:27 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/1558781769' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-12T12:16:28.818 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:28 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/1985405360' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-12T12:16:28.821 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:28 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: ignoring --setuser ceph since I am not root 2024-09-12T12:16:28.822 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:28 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: ignoring --setgroup ceph since I am not root 2024-09-12T12:16:28.822 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:28 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:28.648+0000 7f84dd9f4040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T12:16:28.822 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:28 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:28.707+0000 7f84dd9f4040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T12:16:29.076 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:28 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:28.863+0000 7f84dd9f4040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T12:16:29.076 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:28 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:28.933+0000 7f84dd9f4040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T12:16:29.084 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:27.514+0000 7ff5c9843640 1 Processor -- start 2024-09-12T12:16:29.084 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:27.514+0000 7ff5c9843640 1 -- start start 2024-09-12T12:16:29.084 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:27.514+0000 7ff5c9843640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5c4106310 0x7ff5c4106710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:29.084 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:27.514+0000 7ff5c9843640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff5c4106ce0 con 0x7ff5c4106310 2024-09-12T12:16:29.084 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:27.514+0000 7ff5c2ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5c4106310 0x7ff5c4106710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:29.084 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:27.514+0000 7ff5c2ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5c4106310 0x7ff5c4106710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58572/0 (socket says 172.21.15.33:58572) 2024-09-12T12:16:29.084 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:27.514+0000 7ff5c2ffd640 1 -- 172.21.15.33:0/3555341787 learned_addr learned my addr 172.21.15.33:0/3555341787 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:29.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:27.515+0000 7ff5c2ffd640 1 -- 172.21.15.33:0/3555341787 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5c4107510 con 0x7ff5c4106310 2024-09-12T12:16:29.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:27.515+0000 7ff5c2ffd640 1 --2- 172.21.15.33:0/3555341787 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5c4106310 0x7ff5c4106710 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4009820 tx=0x7ff5b402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=630ed9063b5a7b96 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:29.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:27.516+0000 7ff5c1ffb640 1 -- 172.21.15.33:0/3555341787 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5b4037070 con 0x7ff5c4106310 2024-09-12T12:16:29.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:27.516+0000 7ff5c1ffb640 1 -- 172.21.15.33:0/3555341787 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7ff5b40328d0 con 0x7ff5c4106310 2024-09-12T12:16:29.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:27.516+0000 7ff5c1ffb640 1 -- 172.21.15.33:0/3555341787 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5b40307d0 con 0x7ff5c4106310 2024-09-12T12:16:29.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:27.516+0000 7ff5c9843640 1 -- 172.21.15.33:0/3555341787 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5c4106310 msgr2=0x7ff5c4106710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:29.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:27.516+0000 7ff5c9843640 1 --2- 172.21.15.33:0/3555341787 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5c4106310 0x7ff5c4106710 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4009820 tx=0x7ff5b402a270 comp rx=0 tx=0).stop 2024-09-12T12:16:29.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:27.516+0000 7ff5c9843640 1 -- 172.21.15.33:0/3555341787 shutdown_connections 2024-09-12T12:16:29.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:27.516+0000 7ff5c9843640 1 --2- 172.21.15.33:0/3555341787 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5c4106310 0x7ff5c4106710 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:29.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:27.516+0000 7ff5c9843640 1 -- 172.21.15.33:0/3555341787 >> 172.21.15.33:0/3555341787 conn(0x7ff5c4101ae0 msgr2=0x7ff5c4103f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:29.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:27.516+0000 7ff5c9843640 1 -- 172.21.15.33:0/3555341787 shutdown_connections 2024-09-12T12:16:29.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:27.516+0000 7ff5c9843640 1 -- 172.21.15.33:0/3555341787 wait complete. 2024-09-12T12:16:29.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:27.517+0000 7ff5c9843640 1 Processor -- start 2024-09-12T12:16:29.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:27.517+0000 7ff5c9843640 1 -- start start 2024-09-12T12:16:29.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:27.518+0000 7ff5c9843640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5c4106310 0x7ff5c419b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:29.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:27.518+0000 7ff5c9843640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff5c410a8c0 con 0x7ff5c4106310 2024-09-12T12:16:29.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:27.518+0000 7ff5c2ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5c4106310 0x7ff5c419b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:29.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:27.518+0000 7ff5c2ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5c4106310 0x7ff5c419b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58576/0 (socket says 172.21.15.33:58576) 2024-09-12T12:16:29.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:27.518+0000 7ff5c2ffd640 1 -- 172.21.15.33:0/1985405360 learned_addr learned my addr 172.21.15.33:0/1985405360 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:29.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:27.518+0000 7ff5c2ffd640 1 -- 172.21.15.33:0/1985405360 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5c419b8f0 con 0x7ff5c4106310 2024-09-12T12:16:29.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:27.518+0000 7ff5c2ffd640 1 --2- 172.21.15.33:0/1985405360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5c4106310 0x7ff5c419b3b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4009940 tx=0x7ff5b4032e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:29.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:27.518+0000 7ff5c8841640 1 -- 172.21.15.33:0/1985405360 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5b4042070 con 0x7ff5c4106310 2024-09-12T12:16:29.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:27.518+0000 7ff5c8841640 1 -- 172.21.15.33:0/1985405360 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7ff5b4030c80 con 0x7ff5c4106310 2024-09-12T12:16:29.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:27.518+0000 7ff5c8841640 1 -- 172.21.15.33:0/1985405360 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5b4037040 con 0x7ff5c4106310 2024-09-12T12:16:29.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:27.518+0000 7ff5c9843640 1 -- 172.21.15.33:0/1985405360 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5c419bb80 con 0x7ff5c4106310 2024-09-12T12:16:29.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:27.518+0000 7ff5c9843640 1 -- 172.21.15.33:0/1985405360 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5c419e870 con 0x7ff5c4106310 2024-09-12T12:16:29.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:27.519+0000 7ff5c8841640 1 -- 172.21.15.33:0/1985405360 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7ff5b4045070 con 0x7ff5c4106310 2024-09-12T12:16:29.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:27.520+0000 7ff5c9843640 1 -- 172.21.15.33:0/1985405360 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5c410aa40 con 0x7ff5c4106310 2024-09-12T12:16:29.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:27.520+0000 7ff5c8841640 1 --2- 172.21.15.33:0/1985405360 >> [v2:172.21.15.33:6800/1156183797,v1:172.21.15.33:6801/1156183797] conn(0x7ff5ac038f70 0x7ff5ac03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:29.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:27.520+0000 7ff5c8841640 1 -- 172.21.15.33:0/1985405360 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff5b406bde0 con 0x7ff5c4106310 2024-09-12T12:16:29.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:27.520+0000 7ff5c27fc640 1 --2- 172.21.15.33:0/1985405360 >> [v2:172.21.15.33:6800/1156183797,v1:172.21.15.33:6801/1156183797] conn(0x7ff5ac038f70 0x7ff5ac03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:29.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:27.520+0000 7ff5c27fc640 1 --2- 172.21.15.33:0/1985405360 >> [v2:172.21.15.33:6800/1156183797,v1:172.21.15.33:6801/1156183797] conn(0x7ff5ac038f70 0x7ff5ac03b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff5b80098c0 tx=0x7ff5b8006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:29.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:27.525+0000 7ff5c8841640 1 -- 172.21.15.33:0/1985405360 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff5b4045360 con 0x7ff5c4106310 2024-09-12T12:16:29.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:27.751+0000 7ff5c9843640 1 -- 172.21.15.33:0/1985405360 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7ff5c40008d0 con 0x7ff5c4106310 2024-09-12T12:16:29.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:28.497+0000 7ff5c8841640 1 -- 172.21.15.33:0/1985405360 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7ff5b406b800 con 0x7ff5c4106310 2024-09-12T12:16:29.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:28.498+0000 7ff5c8841640 1 -- 172.21.15.33:0/1985405360 <== mon.0 v2:172.21.15.33:3300/0 8 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7ff5b402ed70 con 0x7ff5c4106310 2024-09-12T12:16:29.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:28.500+0000 7ff5c9843640 1 -- 172.21.15.33:0/1985405360 >> [v2:172.21.15.33:6800/1156183797,v1:172.21.15.33:6801/1156183797] conn(0x7ff5ac038f70 msgr2=0x7ff5ac03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:29.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:28.500+0000 7ff5c9843640 1 --2- 172.21.15.33:0/1985405360 >> [v2:172.21.15.33:6800/1156183797,v1:172.21.15.33:6801/1156183797] conn(0x7ff5ac038f70 0x7ff5ac03b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff5b80098c0 tx=0x7ff5b8006db0 comp rx=0 tx=0).stop 2024-09-12T12:16:29.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:28.500+0000 7ff5c9843640 1 -- 172.21.15.33:0/1985405360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5c4106310 msgr2=0x7ff5c419b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:29.088 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:28.500+0000 7ff5c9843640 1 --2- 172.21.15.33:0/1985405360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5c4106310 0x7ff5c419b3b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4009940 tx=0x7ff5b4032e10 comp rx=0 tx=0).stop 2024-09-12T12:16:29.088 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:28.500+0000 7ff5c9843640 1 -- 172.21.15.33:0/1985405360 shutdown_connections 2024-09-12T12:16:29.088 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:28.500+0000 7ff5c9843640 1 --2- 172.21.15.33:0/1985405360 >> [v2:172.21.15.33:6800/1156183797,v1:172.21.15.33:6801/1156183797] conn(0x7ff5ac038f70 0x7ff5ac03b430 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:29.088 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:28.500+0000 7ff5c9843640 1 --2- 172.21.15.33:0/1985405360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5c4106310 0x7ff5c419b3b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:29.088 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:28.500+0000 7ff5c9843640 1 -- 172.21.15.33:0/1985405360 >> 172.21.15.33:0/1985405360 conn(0x7ff5c4101ae0 msgr2=0x7ff5c4102980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:29.088 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:28.501+0000 7ff5c9843640 1 -- 172.21.15.33:0/1985405360 shutdown_connections 2024-09-12T12:16:29.088 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:28.501+0000 7ff5c9843640 1 -- 172.21.15.33:0/1985405360 wait complete. 2024-09-12T12:16:29.347 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:29 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:29.088+0000 7f84dd9f4040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T12:16:29.347 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:29 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:29.238+0000 7f84dd9f4040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T12:16:29.637 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:29 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/1985405360' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-12T12:16:29.637 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:29 smithi033 ceph-mon[31246]: mgrmap e5: x(active, since 5s) 2024-09-12T12:16:29.638 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:29 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:29.572+0000 7f84dd9f4040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T12:16:29.638 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:29 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:29.637+0000 7f84dd9f4040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T12:16:29.980 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:29 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:29.834+0000 7f84dd9f4040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T12:16:30.477 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout { 2024-09-12T12:16:30.477 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-12T12:16:30.478 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-12T12:16:30.478 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-12T12:16:30.478 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-12T12:16:30.478 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout } 2024-09-12T12:16:30.478 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.527+0000 7f34d2a70640 1 Processor -- start 2024-09-12T12:16:30.478 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.527+0000 7f34d2a70640 1 -- start start 2024-09-12T12:16:30.478 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.527+0000 7f34d2a70640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34cc107ef0 0x7f34cc10a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:30.478 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.527+0000 7f34d2a70640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc075820 con 0x7f34cc107ef0 2024-09-12T12:16:30.478 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.527+0000 7f34d080c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34cc107ef0 0x7f34cc10a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:30.478 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.528+0000 7f34d080c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34cc107ef0 0x7f34cc10a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58616/0 (socket says 172.21.15.33:58616) 2024-09-12T12:16:30.478 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.528+0000 7f34d080c640 1 -- 172.21.15.33:0/3265346681 learned_addr learned my addr 172.21.15.33:0/3265346681 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:30.478 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.528+0000 7f34d080c640 1 -- 172.21.15.33:0/3265346681 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34cc10a820 con 0x7f34cc107ef0 2024-09-12T12:16:30.478 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.528+0000 7f34d080c640 1 --2- 172.21.15.33:0/3265346681 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34cc107ef0 0x7f34cc10a2e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f34c0009820 tx=0x7f34c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f9ca0708960f837 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:30.479 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.529+0000 7f34cb7fe640 1 -- 172.21.15.33:0/3265346681 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34c0037070 con 0x7f34cc107ef0 2024-09-12T12:16:30.479 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.529+0000 7f34cb7fe640 1 -- 172.21.15.33:0/3265346681 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f34c00328d0 con 0x7f34cc107ef0 2024-09-12T12:16:30.479 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.529+0000 7f34cb7fe640 1 -- 172.21.15.33:0/3265346681 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34c00307d0 con 0x7f34cc107ef0 2024-09-12T12:16:30.479 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.529+0000 7f34d2a70640 1 -- 172.21.15.33:0/3265346681 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34cc107ef0 msgr2=0x7f34cc10a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:30.479 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.529+0000 7f34d2a70640 1 --2- 172.21.15.33:0/3265346681 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34cc107ef0 0x7f34cc10a2e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f34c0009820 tx=0x7f34c002a270 comp rx=0 tx=0).stop 2024-09-12T12:16:30.479 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.529+0000 7f34d2a70640 1 -- 172.21.15.33:0/3265346681 shutdown_connections 2024-09-12T12:16:30.479 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.529+0000 7f34d2a70640 1 --2- 172.21.15.33:0/3265346681 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34cc107ef0 0x7f34cc10a2e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.479 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.529+0000 7f34d2a70640 1 -- 172.21.15.33:0/3265346681 >> 172.21.15.33:0/3265346681 conn(0x7f34cc101a90 msgr2=0x7f34cc103ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:30.479 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.530+0000 7f34d2a70640 1 -- 172.21.15.33:0/3265346681 shutdown_connections 2024-09-12T12:16:30.479 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.530+0000 7f34d2a70640 1 -- 172.21.15.33:0/3265346681 wait complete. 2024-09-12T12:16:30.480 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.530+0000 7f34d2a70640 1 Processor -- start 2024-09-12T12:16:30.480 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.530+0000 7f34d2a70640 1 -- start start 2024-09-12T12:16:30.480 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.530+0000 7f34d2a70640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34cc107ef0 0x7f34cc19b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:30.480 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.530+0000 7f34d2a70640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc10b800 con 0x7f34cc107ef0 2024-09-12T12:16:30.480 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.531+0000 7f34d080c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34cc107ef0 0x7f34cc19b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:30.480 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.531+0000 7f34d080c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34cc107ef0 0x7f34cc19b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58630/0 (socket says 172.21.15.33:58630) 2024-09-12T12:16:30.480 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.531+0000 7f34d080c640 1 -- 172.21.15.33:0/4097878813 learned_addr learned my addr 172.21.15.33:0/4097878813 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:30.480 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.531+0000 7f34d080c640 1 -- 172.21.15.33:0/4097878813 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34cc19b8a0 con 0x7f34cc107ef0 2024-09-12T12:16:30.480 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.531+0000 7f34d080c640 1 --2- 172.21.15.33:0/4097878813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34cc107ef0 0x7f34cc19b360 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f34c0032e10 tx=0x7f34c0032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:30.480 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.531+0000 7f34c9ffb640 1 -- 172.21.15.33:0/4097878813 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34c0042070 con 0x7f34cc107ef0 2024-09-12T12:16:30.481 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.531+0000 7f34c9ffb640 1 -- 172.21.15.33:0/4097878813 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f34c0030c80 con 0x7f34cc107ef0 2024-09-12T12:16:30.481 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.531+0000 7f34d2a70640 1 -- 172.21.15.33:0/4097878813 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34cc19bb30 con 0x7f34cc107ef0 2024-09-12T12:16:30.481 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.531+0000 7f34c9ffb640 1 -- 172.21.15.33:0/4097878813 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34c0037040 con 0x7f34cc107ef0 2024-09-12T12:16:30.481 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.531+0000 7f34d2a70640 1 -- 172.21.15.33:0/4097878813 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34cc19e820 con 0x7f34cc107ef0 2024-09-12T12:16:30.481 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.532+0000 7f34c9ffb640 1 -- 172.21.15.33:0/4097878813 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f34c0045070 con 0x7f34cc107ef0 2024-09-12T12:16:30.481 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.532+0000 7f34d2a70640 1 -- 172.21.15.33:0/4097878813 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34cc108350 con 0x7f34cc107ef0 2024-09-12T12:16:30.481 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.533+0000 7f34c9ffb640 1 --2- 172.21.15.33:0/4097878813 >> [v2:172.21.15.33:6800/1156183797,v1:172.21.15.33:6801/1156183797] conn(0x7f34bc038f70 0x7f34bc03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:30.481 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.533+0000 7f34c9ffb640 1 -- 172.21.15.33:0/4097878813 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f34c006bf60 con 0x7f34cc107ef0 2024-09-12T12:16:30.481 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.533+0000 7f34cbfff640 1 -- 172.21.15.33:0/4097878813 >> [v2:172.21.15.33:6800/1156183797,v1:172.21.15.33:6801/1156183797] conn(0x7f34bc038f70 msgr2=0x7f34bc03b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/1156183797 2024-09-12T12:16:30.481 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.533+0000 7f34cbfff640 1 --2- 172.21.15.33:0/4097878813 >> [v2:172.21.15.33:6800/1156183797,v1:172.21.15.33:6801/1156183797] conn(0x7f34bc038f70 0x7f34bc03b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T12:16:30.481 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.537+0000 7f34c9ffb640 1 -- 172.21.15.33:0/4097878813 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f34c0045360 con 0x7f34cc107ef0 2024-09-12T12:16:30.481 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.734+0000 7f34cbfff640 1 -- 172.21.15.33:0/4097878813 >> [v2:172.21.15.33:6800/1156183797,v1:172.21.15.33:6801/1156183797] conn(0x7f34bc038f70 msgr2=0x7f34bc03b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/1156183797 2024-09-12T12:16:30.482 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.734+0000 7f34cbfff640 1 --2- 172.21.15.33:0/4097878813 >> [v2:172.21.15.33:6800/1156183797,v1:172.21.15.33:6801/1156183797] conn(0x7f34bc038f70 0x7f34bc03b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T12:16:30.482 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.761+0000 7f34d2a70640 1 -- 172.21.15.33:0/4097878813 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f34cc19eea0 con 0x7f34cc107ef0 2024-09-12T12:16:30.482 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.761+0000 7f34c9ffb640 1 -- 172.21.15.33:0/4097878813 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f34c006b980 con 0x7f34cc107ef0 2024-09-12T12:16:30.482 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.763+0000 7f34d2a70640 1 -- 172.21.15.33:0/4097878813 >> [v2:172.21.15.33:6800/1156183797,v1:172.21.15.33:6801/1156183797] conn(0x7f34bc038f70 msgr2=0x7f34bc03b430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T12:16:30.482 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.763+0000 7f34d2a70640 1 --2- 172.21.15.33:0/4097878813 >> [v2:172.21.15.33:6800/1156183797,v1:172.21.15.33:6801/1156183797] conn(0x7f34bc038f70 0x7f34bc03b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.482 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.763+0000 7f34d2a70640 1 -- 172.21.15.33:0/4097878813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34cc107ef0 msgr2=0x7f34cc19b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:30.482 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.763+0000 7f34d2a70640 1 --2- 172.21.15.33:0/4097878813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34cc107ef0 0x7f34cc19b360 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f34c0032e10 tx=0x7f34c0032e40 comp rx=0 tx=0).stop 2024-09-12T12:16:30.482 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.763+0000 7f34d2a70640 1 -- 172.21.15.33:0/4097878813 shutdown_connections 2024-09-12T12:16:30.482 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.763+0000 7f34d2a70640 1 --2- 172.21.15.33:0/4097878813 >> [v2:172.21.15.33:6800/1156183797,v1:172.21.15.33:6801/1156183797] conn(0x7f34bc038f70 0x7f34bc03b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.482 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.763+0000 7f34d2a70640 1 --2- 172.21.15.33:0/4097878813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34cc107ef0 0x7f34cc19b360 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.482 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.763+0000 7f34d2a70640 1 -- 172.21.15.33:0/4097878813 >> 172.21.15.33:0/4097878813 conn(0x7f34cc101a90 msgr2=0x7f34cc1025d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:30.482 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.764+0000 7f34d2a70640 1 -- 172.21.15.33:0/4097878813 shutdown_connections 2024-09-12T12:16:30.482 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:29.764+0000 7f34d2a70640 1 -- 172.21.15.33:0/4097878813 wait complete. 2024-09-12T12:16:30.483 INFO:teuthology.orchestra.run.smithi033.stdout:Waiting for the mgr to restart... 2024-09-12T12:16:30.483 INFO:teuthology.orchestra.run.smithi033.stdout:Waiting for mgr epoch 5... 2024-09-12T12:16:30.730 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:30 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/4097878813' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-12T12:16:31.056 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:30 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:30.766+0000 7f84dd9f4040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T12:16:31.056 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:30 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:30.839+0000 7f84dd9f4040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T12:16:31.712 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:31 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:31.591+0000 7f84dd9f4040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T12:16:31.712 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:31 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:31.712+0000 7f84dd9f4040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T12:16:31.980 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:31 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:31.861+0000 7f84dd9f4040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T12:16:31.981 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:31 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:31.925+0000 7f84dd9f4040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T12:16:32.380 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:32 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:32.081+0000 7f84dd9f4040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T12:16:32.380 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:32 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:32.152+0000 7f84dd9f4040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T12:16:32.380 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:32 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:32.215+0000 7f84dd9f4040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T12:16:32.380 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:32 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:32.380+0000 7f84dd9f4040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T12:16:32.666 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:32 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:32.448+0000 7f84dd9f4040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T12:16:32.667 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:32 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:32.518+0000 7f84dd9f4040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T12:16:32.667 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:32 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:32.604+0000 7f84dd9f4040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T12:16:32.667 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:32 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:32.666+0000 7f84dd9f4040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T12:16:32.980 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:32 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:32.728+0000 7f84dd9f4040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T12:16:33.882 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:33 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:33.557+0000 7f84dd9f4040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T12:16:33.882 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:33 smithi033 ceph-mon[31246]: Active manager daemon x restarted 2024-09-12T12:16:33.882 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:33 smithi033 ceph-mon[31246]: Activating manager daemon x 2024-09-12T12:16:33.882 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:33 smithi033 ceph-mon[31246]: osdmap e2: 0 total, 0 up, 0 in 2024-09-12T12:16:33.882 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:33 smithi033 ceph-mon[31246]: mgrmap e6: x(active, starting, since 0.00371428s) 2024-09-12T12:16:33.882 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:33 smithi033 ceph-mon[31246]: from='mgr.14118 172.21.15.33:0/447348134' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:16:33.883 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:33 smithi033 ceph-mon[31246]: from='mgr.14118 172.21.15.33:0/447348134' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T12:16:33.883 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:33 smithi033 ceph-mon[31246]: from='mgr.14118 172.21.15.33:0/447348134' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T12:16:33.883 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:33 smithi033 ceph-mon[31246]: from='mgr.14118 172.21.15.33:0/447348134' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T12:16:33.883 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:33 smithi033 ceph-mon[31246]: from='mgr.14118 172.21.15.33:0/447348134' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T12:16:33.883 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:33 smithi033 ceph-mon[31246]: Manager daemon x is now available 2024-09-12T12:16:33.883 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:33 smithi033 ceph-mon[31246]: from='mgr.14118 172.21.15.33:0/447348134' entity='mgr.x' 2024-09-12T12:16:33.883 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:33 smithi033 ceph-mon[31246]: from='mgr.14118 172.21.15.33:0/447348134' entity='mgr.x' 2024-09-12T12:16:33.883 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:33 smithi033 ceph-mon[31246]: from='mgr.14118 172.21.15.33:0/447348134' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:16:33.883 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:33 smithi033 ceph-mon[31246]: from='mgr.14118 172.21.15.33:0/447348134' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:16:33.883 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:33 smithi033 ceph-mon[31246]: from='mgr.14118 172.21.15.33:0/447348134' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T12:16:33.883 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:33 smithi033 ceph-mon[31246]: from='mgr.14118 172.21.15.33:0/447348134' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T12:16:34.848 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:34 smithi033 ceph-mon[31246]: Found migration_current of "None". Setting to last migration. 2024-09-12T12:16:34.848 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:34 smithi033 ceph-mon[31246]: mgrmap e7: x(active, since 1.00974s) 2024-09-12T12:16:35.143 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout { 2024-09-12T12:16:35.150 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-12T12:16:35.150 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-12T12:16:35.150 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout } 2024-09-12T12:16:35.150 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:30.849+0000 7f288eaac640 1 Processor -- start 2024-09-12T12:16:35.150 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:30.849+0000 7f288eaac640 1 -- start start 2024-09-12T12:16:35.150 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:30.849+0000 7f288eaac640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2888107e80 0x7f288810a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:35.150 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:30.850+0000 7f288eaac640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2888075880 con 0x7f2888107e80 2024-09-12T12:16:35.150 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:30.850+0000 7f288c848640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2888107e80 0x7f288810a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:35.151 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:30.850+0000 7f288c848640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2888107e80 0x7f288810a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46134/0 (socket says 172.21.15.33:46134) 2024-09-12T12:16:35.151 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:30.850+0000 7f288c848640 1 -- 172.21.15.33:0/3133823877 learned_addr learned my addr 172.21.15.33:0/3133823877 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:35.151 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:30.850+0000 7f288c848640 1 -- 172.21.15.33:0/3133823877 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f288810a7b0 con 0x7f2888107e80 2024-09-12T12:16:35.151 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:30.851+0000 7f288c848640 1 --2- 172.21.15.33:0/3133823877 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2888107e80 0x7f288810a270 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f287c009820 tx=0x7f287c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e83d541803c6574b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:35.151 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:30.851+0000 7f28877fe640 1 -- 172.21.15.33:0/3133823877 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f287c037070 con 0x7f2888107e80 2024-09-12T12:16:35.151 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:30.851+0000 7f28877fe640 1 -- 172.21.15.33:0/3133823877 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f287c0328d0 con 0x7f2888107e80 2024-09-12T12:16:35.151 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:30.851+0000 7f28877fe640 1 -- 172.21.15.33:0/3133823877 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f287c0307d0 con 0x7f2888107e80 2024-09-12T12:16:35.151 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:30.852+0000 7f288eaac640 1 -- 172.21.15.33:0/3133823877 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2888107e80 msgr2=0x7f288810a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:35.151 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:30.852+0000 7f288eaac640 1 --2- 172.21.15.33:0/3133823877 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2888107e80 0x7f288810a270 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f287c009820 tx=0x7f287c02a270 comp rx=0 tx=0).stop 2024-09-12T12:16:35.151 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:30.852+0000 7f288eaac640 1 -- 172.21.15.33:0/3133823877 shutdown_connections 2024-09-12T12:16:35.151 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:30.852+0000 7f288eaac640 1 --2- 172.21.15.33:0/3133823877 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2888107e80 0x7f288810a270 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:35.151 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:30.852+0000 7f288eaac640 1 -- 172.21.15.33:0/3133823877 >> 172.21.15.33:0/3133823877 conn(0x7f2888101ac0 msgr2=0x7f2888103ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:35.152 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:30.852+0000 7f288eaac640 1 -- 172.21.15.33:0/3133823877 shutdown_connections 2024-09-12T12:16:35.152 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:30.852+0000 7f288eaac640 1 -- 172.21.15.33:0/3133823877 wait complete. 2024-09-12T12:16:35.152 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:30.853+0000 7f288eaac640 1 Processor -- start 2024-09-12T12:16:35.152 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:30.853+0000 7f288eaac640 1 -- start start 2024-09-12T12:16:35.152 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:30.853+0000 7f288eaac640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2888107e80 0x7f288819b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:35.152 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:30.853+0000 7f288eaac640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f288810b7f0 con 0x7f2888107e80 2024-09-12T12:16:35.152 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:30.853+0000 7f288c848640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2888107e80 0x7f288819b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:35.152 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:30.853+0000 7f288c848640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2888107e80 0x7f288819b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46150/0 (socket says 172.21.15.33:46150) 2024-09-12T12:16:35.152 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:30.853+0000 7f288c848640 1 -- 172.21.15.33:0/3756896471 learned_addr learned my addr 172.21.15.33:0/3756896471 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:35.152 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:30.854+0000 7f288c848640 1 -- 172.21.15.33:0/3756896471 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f288819b890 con 0x7f2888107e80 2024-09-12T12:16:35.152 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:30.854+0000 7f288c848640 1 --2- 172.21.15.33:0/3756896471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2888107e80 0x7f288819b350 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f287c0097f0 tx=0x7f287c030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:35.152 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:30.854+0000 7f2885ffb640 1 -- 172.21.15.33:0/3756896471 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f287c037040 con 0x7f2888107e80 2024-09-12T12:16:35.152 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:30.854+0000 7f2885ffb640 1 -- 172.21.15.33:0/3756896471 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f287c032bb0 con 0x7f2888107e80 2024-09-12T12:16:35.152 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:30.854+0000 7f288eaac640 1 -- 172.21.15.33:0/3756896471 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f288819bb20 con 0x7f2888107e80 2024-09-12T12:16:35.153 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:30.854+0000 7f2885ffb640 1 -- 172.21.15.33:0/3756896471 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f287c03a390 con 0x7f2888107e80 2024-09-12T12:16:35.153 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:30.854+0000 7f288eaac640 1 -- 172.21.15.33:0/3756896471 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f288819e810 con 0x7f2888107e80 2024-09-12T12:16:35.153 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:30.855+0000 7f2885ffb640 1 -- 172.21.15.33:0/3756896471 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f287c03a5d0 con 0x7f2888107e80 2024-09-12T12:16:35.153 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:30.855+0000 7f2885ffb640 1 --2- 172.21.15.33:0/3756896471 >> [v2:172.21.15.33:6800/1156183797,v1:172.21.15.33:6801/1156183797] conn(0x7f2878038f70 0x7f287803b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:35.153 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:30.855+0000 7f288eaac640 1 -- 172.21.15.33:0/3756896471 --> [v2:172.21.15.33:6800/1156183797,v1:172.21.15.33:6801/1156183797] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f28881082e0 con 0x7f2878038f70 2024-09-12T12:16:35.153 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:30.855+0000 7f2885ffb640 1 -- 172.21.15.33:0/3756896471 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f287c06c140 con 0x7f2888107e80 2024-09-12T12:16:35.153 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:30.855+0000 7f2887fff640 1 -- 172.21.15.33:0/3756896471 >> [v2:172.21.15.33:6800/1156183797,v1:172.21.15.33:6801/1156183797] conn(0x7f2878038f70 msgr2=0x7f287803b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/1156183797 2024-09-12T12:16:35.153 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:30.855+0000 7f2887fff640 1 --2- 172.21.15.33:0/3756896471 >> [v2:172.21.15.33:6800/1156183797,v1:172.21.15.33:6801/1156183797] conn(0x7f2878038f70 0x7f287803b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T12:16:35.153 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:31.056+0000 7f2887fff640 1 -- 172.21.15.33:0/3756896471 >> [v2:172.21.15.33:6800/1156183797,v1:172.21.15.33:6801/1156183797] conn(0x7f2878038f70 msgr2=0x7f287803b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/1156183797 2024-09-12T12:16:35.153 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:31.056+0000 7f2887fff640 1 --2- 172.21.15.33:0/3756896471 >> [v2:172.21.15.33:6800/1156183797,v1:172.21.15.33:6801/1156183797] conn(0x7f2878038f70 0x7f287803b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T12:16:35.153 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:31.457+0000 7f2887fff640 1 -- 172.21.15.33:0/3756896471 >> [v2:172.21.15.33:6800/1156183797,v1:172.21.15.33:6801/1156183797] conn(0x7f2878038f70 msgr2=0x7f287803b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/1156183797 2024-09-12T12:16:35.153 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:31.457+0000 7f2887fff640 1 --2- 172.21.15.33:0/3756896471 >> [v2:172.21.15.33:6800/1156183797,v1:172.21.15.33:6801/1156183797] conn(0x7f2878038f70 0x7f287803b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T12:16:35.153 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:32.258+0000 7f2887fff640 1 -- 172.21.15.33:0/3756896471 >> [v2:172.21.15.33:6800/1156183797,v1:172.21.15.33:6801/1156183797] conn(0x7f2878038f70 msgr2=0x7f287803b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/1156183797 2024-09-12T12:16:35.154 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:32.258+0000 7f2887fff640 1 --2- 172.21.15.33:0/3756896471 >> [v2:172.21.15.33:6800/1156183797,v1:172.21.15.33:6801/1156183797] conn(0x7f2878038f70 0x7f287803b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T12:16:35.154 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:33.561+0000 7f2885ffb640 1 -- 172.21.15.33:0/3756896471 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mgrmap(e 6) ==== 46054+0+0 (secure 0 0 0) 0x7f287c049cf0 con 0x7f2888107e80 2024-09-12T12:16:35.154 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:33.561+0000 7f2885ffb640 1 -- 172.21.15.33:0/3756896471 >> [v2:172.21.15.33:6800/1156183797,v1:172.21.15.33:6801/1156183797] conn(0x7f2878038f70 msgr2=0x7f287803b430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T12:16:35.154 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:33.561+0000 7f2885ffb640 1 --2- 172.21.15.33:0/3756896471 >> [v2:172.21.15.33:6800/1156183797,v1:172.21.15.33:6801/1156183797] conn(0x7f2878038f70 0x7f287803b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:35.154 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:34.566+0000 7f2885ffb640 1 -- 172.21.15.33:0/3756896471 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7f287c044400 con 0x7f2888107e80 2024-09-12T12:16:35.154 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:34.566+0000 7f2885ffb640 1 --2- 172.21.15.33:0/3756896471 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f287803c6b0 0x7f287803eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:35.154 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:34.566+0000 7f2885ffb640 1 -- 172.21.15.33:0/3756896471 --> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f287c048e50 con 0x7f287803c6b0 2024-09-12T12:16:35.154 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:34.567+0000 7f2887fff640 1 --2- 172.21.15.33:0/3756896471 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f287803c6b0 0x7f287803eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:35.154 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:34.567+0000 7f2887fff640 1 --2- 172.21.15.33:0/3756896471 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f287803c6b0 0x7f287803eaa0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f2874003980 tx=0x7f2874006e10 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:35.154 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:34.568+0000 7f2885ffb640 1 -- 172.21.15.33:0/3756896471 <== mgr.14118 v2:172.21.15.33:6800/1381479235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f287c048e50 con 0x7f287803c6b0 2024-09-12T12:16:35.154 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:34.581+0000 7f288eaac640 1 -- 172.21.15.33:0/3756896471 --> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f2888102d40 con 0x7f287803c6b0 2024-09-12T12:16:35.154 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:34.582+0000 7f2885ffb640 1 -- 172.21.15.33:0/3756896471 <== mgr.14118 v2:172.21.15.33:6800/1381479235 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f2888102d40 con 0x7f287803c6b0 2024-09-12T12:16:35.154 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:34.582+0000 7f288eaac640 1 -- 172.21.15.33:0/3756896471 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f287803c6b0 msgr2=0x7f287803eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:35.155 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:34.582+0000 7f288eaac640 1 --2- 172.21.15.33:0/3756896471 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f287803c6b0 0x7f287803eaa0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f2874003980 tx=0x7f2874006e10 comp rx=0 tx=0).stop 2024-09-12T12:16:35.155 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:34.582+0000 7f288eaac640 1 -- 172.21.15.33:0/3756896471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2888107e80 msgr2=0x7f288819b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:35.155 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:34.582+0000 7f288eaac640 1 --2- 172.21.15.33:0/3756896471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2888107e80 0x7f288819b350 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f287c0097f0 tx=0x7f287c030d00 comp rx=0 tx=0).stop 2024-09-12T12:16:35.155 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:34.582+0000 7f288eaac640 1 -- 172.21.15.33:0/3756896471 shutdown_connections 2024-09-12T12:16:35.155 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:34.582+0000 7f288eaac640 1 --2- 172.21.15.33:0/3756896471 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f287803c6b0 0x7f287803eaa0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:35.155 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:34.582+0000 7f288eaac640 1 --2- 172.21.15.33:0/3756896471 >> [v2:172.21.15.33:6800/1156183797,v1:172.21.15.33:6801/1156183797] conn(0x7f2878038f70 0x7f287803b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:35.155 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:34.582+0000 7f288eaac640 1 --2- 172.21.15.33:0/3756896471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2888107e80 0x7f288819b350 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:35.155 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:34.582+0000 7f288eaac640 1 -- 172.21.15.33:0/3756896471 >> 172.21.15.33:0/3756896471 conn(0x7f2888101ac0 msgr2=0x7f2888102630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:35.155 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:34.582+0000 7f288eaac640 1 -- 172.21.15.33:0/3756896471 shutdown_connections 2024-09-12T12:16:35.155 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:34.582+0000 7f288eaac640 1 -- 172.21.15.33:0/3756896471 wait complete. 2024-09-12T12:16:35.155 INFO:teuthology.orchestra.run.smithi033.stdout:mgr epoch 5 is available 2024-09-12T12:16:35.155 INFO:teuthology.orchestra.run.smithi033.stdout:Setting orchestrator backend to cephadm... 2024-09-12T12:16:36.296 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.584+0000 7f774dc15640 1 Processor -- start 2024-09-12T12:16:36.296 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.584+0000 7f774dc15640 1 -- start start 2024-09-12T12:16:36.296 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.584+0000 7f774dc15640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7748106320 0x7f7748106720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:36.296 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.584+0000 7f774dc15640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7748106cf0 con 0x7f7748106320 2024-09-12T12:16:36.296 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.584+0000 7f77477fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7748106320 0x7f7748106720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:36.296 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.584+0000 7f77477fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7748106320 0x7f7748106720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46242/0 (socket says 172.21.15.33:46242) 2024-09-12T12:16:36.296 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.584+0000 7f77477fe640 1 -- 172.21.15.33:0/960809993 learned_addr learned my addr 172.21.15.33:0/960809993 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:36.297 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.585+0000 7f77477fe640 1 -- 172.21.15.33:0/960809993 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7748107520 con 0x7f7748106320 2024-09-12T12:16:36.297 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.586+0000 7f77477fe640 1 --2- 172.21.15.33:0/960809993 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7748106320 0x7f7748106720 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7738009820 tx=0x7f773802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9799134b278ac2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:36.297 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.586+0000 7f77467fc640 1 -- 172.21.15.33:0/960809993 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7738037070 con 0x7f7748106320 2024-09-12T12:16:36.297 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.586+0000 7f77467fc640 1 -- 172.21.15.33:0/960809993 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f77380328d0 con 0x7f7748106320 2024-09-12T12:16:36.297 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.586+0000 7f77467fc640 1 -- 172.21.15.33:0/960809993 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77380307d0 con 0x7f7748106320 2024-09-12T12:16:36.297 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.586+0000 7f774dc15640 1 -- 172.21.15.33:0/960809993 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7748106320 msgr2=0x7f7748106720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:36.297 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.586+0000 7f774dc15640 1 --2- 172.21.15.33:0/960809993 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7748106320 0x7f7748106720 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7738009820 tx=0x7f773802a270 comp rx=0 tx=0).stop 2024-09-12T12:16:36.297 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.586+0000 7f774dc15640 1 -- 172.21.15.33:0/960809993 shutdown_connections 2024-09-12T12:16:36.297 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.586+0000 7f774dc15640 1 --2- 172.21.15.33:0/960809993 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7748106320 0x7f7748106720 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:36.298 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.586+0000 7f774dc15640 1 -- 172.21.15.33:0/960809993 >> 172.21.15.33:0/960809993 conn(0x7f7748101a90 msgr2=0x7f7748103ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:36.298 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.586+0000 7f774dc15640 1 -- 172.21.15.33:0/960809993 shutdown_connections 2024-09-12T12:16:36.298 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.586+0000 7f774dc15640 1 -- 172.21.15.33:0/960809993 wait complete. 2024-09-12T12:16:36.298 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.587+0000 7f774dc15640 1 Processor -- start 2024-09-12T12:16:36.298 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.587+0000 7f774dc15640 1 -- start start 2024-09-12T12:16:36.298 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.588+0000 7f774dc15640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7748106320 0x7f774819b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:36.298 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.588+0000 7f774dc15640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f774810a8d0 con 0x7f7748106320 2024-09-12T12:16:36.298 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.588+0000 7f77477fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7748106320 0x7f774819b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:36.298 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.588+0000 7f77477fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7748106320 0x7f774819b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46244/0 (socket says 172.21.15.33:46244) 2024-09-12T12:16:36.298 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.588+0000 7f77477fe640 1 -- 172.21.15.33:0/1756130471 learned_addr learned my addr 172.21.15.33:0/1756130471 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:36.298 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.588+0000 7f77477fe640 1 -- 172.21.15.33:0/1756130471 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f774819b910 con 0x7f7748106320 2024-09-12T12:16:36.298 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.588+0000 7f77477fe640 1 --2- 172.21.15.33:0/1756130471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7748106320 0x7f774819b3d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f77380097f0 tx=0x7f7738030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:36.298 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.588+0000 7f7744ff9640 1 -- 172.21.15.33:0/1756130471 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7738037040 con 0x7f7748106320 2024-09-12T12:16:36.299 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.588+0000 7f7744ff9640 1 -- 172.21.15.33:0/1756130471 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f7738032bb0 con 0x7f7748106320 2024-09-12T12:16:36.299 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.588+0000 7f774dc15640 1 -- 172.21.15.33:0/1756130471 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f774819bba0 con 0x7f7748106320 2024-09-12T12:16:36.299 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.588+0000 7f7744ff9640 1 -- 172.21.15.33:0/1756130471 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f773803a390 con 0x7f7748106320 2024-09-12T12:16:36.299 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.589+0000 7f774dc15640 1 -- 172.21.15.33:0/1756130471 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f774819e890 con 0x7f7748106320 2024-09-12T12:16:36.299 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.590+0000 7f7744ff9640 1 -- 172.21.15.33:0/1756130471 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7f773803b3f0 con 0x7f7748106320 2024-09-12T12:16:36.299 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.590+0000 7f774dc15640 1 -- 172.21.15.33:0/1756130471 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f774810aa50 con 0x7f7748106320 2024-09-12T12:16:36.299 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.590+0000 7f7744ff9640 1 --2- 172.21.15.33:0/1756130471 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f7730038eb0 0x7f773003b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:36.299 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.590+0000 7f7744ff9640 1 -- 172.21.15.33:0/1756130471 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f773806bfd0 con 0x7f7748106320 2024-09-12T12:16:36.299 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.590+0000 7f7746ffd640 1 --2- 172.21.15.33:0/1756130471 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f7730038eb0 0x7f773003b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:36.299 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.590+0000 7f7746ffd640 1 --2- 172.21.15.33:0/1756130471 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f7730038eb0 0x7f773003b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f773c0098c0 tx=0x7f773c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:36.299 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.595+0000 7f7744ff9640 1 -- 172.21.15.33:0/1756130471 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f773803a580 con 0x7f7748106320 2024-09-12T12:16:36.299 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.783+0000 7f774dc15640 1 -- 172.21.15.33:0/1756130471 --> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f77480008d0 con 0x7f7730038eb0 2024-09-12T12:16:36.299 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.789+0000 7f7744ff9640 1 -- 172.21.15.33:0/1756130471 <== mgr.14118 v2:172.21.15.33:6800/1381479235 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f77480008d0 con 0x7f7730038eb0 2024-09-12T12:16:36.300 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.791+0000 7f774dc15640 1 -- 172.21.15.33:0/1756130471 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f7730038eb0 msgr2=0x7f773003b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:36.300 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.791+0000 7f774dc15640 1 --2- 172.21.15.33:0/1756130471 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f7730038eb0 0x7f773003b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f773c0098c0 tx=0x7f773c006db0 comp rx=0 tx=0).stop 2024-09-12T12:16:36.300 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.791+0000 7f774dc15640 1 -- 172.21.15.33:0/1756130471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7748106320 msgr2=0x7f774819b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:36.300 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.791+0000 7f774dc15640 1 --2- 172.21.15.33:0/1756130471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7748106320 0x7f774819b3d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f77380097f0 tx=0x7f7738030d00 comp rx=0 tx=0).stop 2024-09-12T12:16:36.300 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.791+0000 7f774dc15640 1 -- 172.21.15.33:0/1756130471 shutdown_connections 2024-09-12T12:16:36.300 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.791+0000 7f774dc15640 1 --2- 172.21.15.33:0/1756130471 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f7730038eb0 0x7f773003b370 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:36.300 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.791+0000 7f774dc15640 1 --2- 172.21.15.33:0/1756130471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7748106320 0x7f774819b3d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:36.300 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.791+0000 7f774dc15640 1 -- 172.21.15.33:0/1756130471 >> 172.21.15.33:0/1756130471 conn(0x7f7748101a90 msgr2=0x7f7748102940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:36.300 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.791+0000 7f774dc15640 1 -- 172.21.15.33:0/1756130471 shutdown_connections 2024-09-12T12:16:36.301 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:35.791+0000 7f774dc15640 1 -- 172.21.15.33:0/1756130471 wait complete. 2024-09-12T12:16:36.414 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:36 smithi033 ceph-mon[31246]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-12T12:16:36.414 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:36 smithi033 ceph-mon[31246]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-12T12:16:36.415 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:36 smithi033 ceph-mon[31246]: from='mgr.14118 172.21.15.33:0/447348134' entity='mgr.x' 2024-09-12T12:16:36.415 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:36 smithi033 ceph-mon[31246]: from='mgr.14118 172.21.15.33:0/447348134' entity='mgr.x' 2024-09-12T12:16:36.415 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:36 smithi033 ceph-mon[31246]: from='mgr.14118 172.21.15.33:0/447348134' entity='mgr.x' 2024-09-12T12:16:36.415 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:36 smithi033 ceph-mon[31246]: from='mgr.14118 172.21.15.33:0/447348134' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:16:37.388 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:37 smithi033 ceph-mon[31246]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:16:37.388 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:37 smithi033 ceph-mon[31246]: mgrmap e8: x(active, since 2s) 2024-09-12T12:16:37.396 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-12T12:16:37.396 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.697+0000 7f1770419640 1 Processor -- start 2024-09-12T12:16:37.396 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.697+0000 7f1770419640 1 -- start start 2024-09-12T12:16:37.396 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.698+0000 7f1770419640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1768106310 0x7f1768106710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:37.396 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.698+0000 7f1770419640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1768106ce0 con 0x7f1768106310 2024-09-12T12:16:37.396 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.698+0000 7f176e1b5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1768106310 0x7f1768106710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:37.397 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.698+0000 7f176e1b5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1768106310 0x7f1768106710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46248/0 (socket says 172.21.15.33:46248) 2024-09-12T12:16:37.397 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.698+0000 7f176e1b5640 1 -- 172.21.15.33:0/253642170 learned_addr learned my addr 172.21.15.33:0/253642170 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:37.397 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.698+0000 7f176e1b5640 1 -- 172.21.15.33:0/253642170 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1768107510 con 0x7f1768106310 2024-09-12T12:16:37.397 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.699+0000 7f176e1b5640 1 --2- 172.21.15.33:0/253642170 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1768106310 0x7f1768106710 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1764009820 tx=0x7f176402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b885decbd7bcb67 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:37.397 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.699+0000 7f176d1b3640 1 -- 172.21.15.33:0/253642170 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1764037070 con 0x7f1768106310 2024-09-12T12:16:37.397 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.699+0000 7f176d1b3640 1 -- 172.21.15.33:0/253642170 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f17640328d0 con 0x7f1768106310 2024-09-12T12:16:37.397 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.699+0000 7f176d1b3640 1 -- 172.21.15.33:0/253642170 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17640307d0 con 0x7f1768106310 2024-09-12T12:16:37.397 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.700+0000 7f1770419640 1 -- 172.21.15.33:0/253642170 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1768106310 msgr2=0x7f1768106710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:37.397 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.700+0000 7f1770419640 1 --2- 172.21.15.33:0/253642170 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1768106310 0x7f1768106710 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1764009820 tx=0x7f176402a270 comp rx=0 tx=0).stop 2024-09-12T12:16:37.397 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.700+0000 7f1770419640 1 -- 172.21.15.33:0/253642170 shutdown_connections 2024-09-12T12:16:37.397 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.700+0000 7f1770419640 1 --2- 172.21.15.33:0/253642170 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1768106310 0x7f1768106710 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:37.398 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.700+0000 7f1770419640 1 -- 172.21.15.33:0/253642170 >> 172.21.15.33:0/253642170 conn(0x7f1768101ac0 msgr2=0x7f1768103ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:37.398 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.700+0000 7f1770419640 1 -- 172.21.15.33:0/253642170 shutdown_connections 2024-09-12T12:16:37.398 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.700+0000 7f1770419640 1 -- 172.21.15.33:0/253642170 wait complete. 2024-09-12T12:16:37.398 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.701+0000 7f1770419640 1 Processor -- start 2024-09-12T12:16:37.398 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.701+0000 7f1770419640 1 -- start start 2024-09-12T12:16:37.398 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.701+0000 7f1770419640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1768106310 0x7f1768191540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:37.398 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.701+0000 7f1770419640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f176810a8c0 con 0x7f1768106310 2024-09-12T12:16:37.398 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.701+0000 7f176e1b5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1768106310 0x7f1768191540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:37.398 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.701+0000 7f176e1b5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1768106310 0x7f1768191540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46252/0 (socket says 172.21.15.33:46252) 2024-09-12T12:16:37.398 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.701+0000 7f176e1b5640 1 -- 172.21.15.33:0/158670593 learned_addr learned my addr 172.21.15.33:0/158670593 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:37.398 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.701+0000 7f176e1b5640 1 -- 172.21.15.33:0/158670593 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1768191a80 con 0x7f1768106310 2024-09-12T12:16:37.398 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.701+0000 7f176e1b5640 1 --2- 172.21.15.33:0/158670593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1768106310 0x7f1768191540 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1764009940 tx=0x7f1764032e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:37.398 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.702+0000 7f175b7fe640 1 -- 172.21.15.33:0/158670593 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1764042070 con 0x7f1768106310 2024-09-12T12:16:37.399 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.702+0000 7f175b7fe640 1 -- 172.21.15.33:0/158670593 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f1764030c80 con 0x7f1768106310 2024-09-12T12:16:37.399 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.702+0000 7f1770419640 1 -- 172.21.15.33:0/158670593 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f176818fc70 con 0x7f1768106310 2024-09-12T12:16:37.399 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.702+0000 7f175b7fe640 1 -- 172.21.15.33:0/158670593 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1764037040 con 0x7f1768106310 2024-09-12T12:16:37.399 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.702+0000 7f1770419640 1 -- 172.21.15.33:0/158670593 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17681901b0 con 0x7f1768106310 2024-09-12T12:16:37.399 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.702+0000 7f175b7fe640 1 -- 172.21.15.33:0/158670593 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f1764045070 con 0x7f1768106310 2024-09-12T12:16:37.399 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.703+0000 7f175b7fe640 1 --2- 172.21.15.33:0/158670593 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f1754038f70 0x7f175403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:37.399 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.703+0000 7f1770419640 1 -- 172.21.15.33:0/158670593 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f176810aa40 con 0x7f1768106310 2024-09-12T12:16:37.399 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.703+0000 7f175b7fe640 1 -- 172.21.15.33:0/158670593 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f176406c060 con 0x7f1768106310 2024-09-12T12:16:37.399 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.703+0000 7f176d9b4640 1 --2- 172.21.15.33:0/158670593 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f1754038f70 0x7f175403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:37.399 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.703+0000 7f176d9b4640 1 --2- 172.21.15.33:0/158670593 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f1754038f70 0x7f175403b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f175c0098c0 tx=0x7f175c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:37.399 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.708+0000 7f175b7fe640 1 -- 172.21.15.33:0/158670593 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1764045360 con 0x7f1768106310 2024-09-12T12:16:37.399 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.885+0000 7f1770419640 1 -- 172.21.15.33:0/158670593 --> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f17680008d0 con 0x7f1754038f70 2024-09-12T12:16:37.400 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.886+0000 7f175b7fe640 1 -- 172.21.15.33:0/158670593 <== mgr.14118 v2:172.21.15.33:6800/1381479235 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f17680008d0 con 0x7f1754038f70 2024-09-12T12:16:37.400 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.888+0000 7f1770419640 1 -- 172.21.15.33:0/158670593 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f1754038f70 msgr2=0x7f175403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:37.400 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.888+0000 7f1770419640 1 --2- 172.21.15.33:0/158670593 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f1754038f70 0x7f175403b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f175c0098c0 tx=0x7f175c006db0 comp rx=0 tx=0).stop 2024-09-12T12:16:37.400 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.888+0000 7f1770419640 1 -- 172.21.15.33:0/158670593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1768106310 msgr2=0x7f1768191540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:37.400 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.888+0000 7f1770419640 1 --2- 172.21.15.33:0/158670593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1768106310 0x7f1768191540 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1764009940 tx=0x7f1764032e10 comp rx=0 tx=0).stop 2024-09-12T12:16:37.400 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.888+0000 7f1770419640 1 -- 172.21.15.33:0/158670593 shutdown_connections 2024-09-12T12:16:37.400 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.888+0000 7f1770419640 1 --2- 172.21.15.33:0/158670593 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f1754038f70 0x7f175403b430 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:37.400 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.888+0000 7f1770419640 1 --2- 172.21.15.33:0/158670593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1768106310 0x7f1768191540 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:37.400 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.888+0000 7f1770419640 1 -- 172.21.15.33:0/158670593 >> 172.21.15.33:0/158670593 conn(0x7f1768101ac0 msgr2=0x7f1768102950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:37.400 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.889+0000 7f1770419640 1 -- 172.21.15.33:0/158670593 shutdown_connections 2024-09-12T12:16:37.400 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:36.889+0000 7f1770419640 1 -- 172.21.15.33:0/158670593 wait complete. 2024-09-12T12:16:37.400 INFO:teuthology.orchestra.run.smithi033.stdout:Generating ssh key... 2024-09-12T12:16:37.691 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:37 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:37.601+0000 7f844a519640 -1 log_channel(cephadm) log [ERR] : [12/Sep/2024:12:16:37] ENGINE Error in HTTPServer.serve 2024-09-12T12:16:37.691 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:37 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: Traceback (most recent call last): 2024-09-12T12:16:37.691 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:37 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T12:16:37.691 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:37 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: self._connections.run(self.expiration_interval) 2024-09-12T12:16:37.691 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:37 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T12:16:37.691 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:37 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: self._run(expiration_interval) 2024-09-12T12:16:37.691 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:37 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T12:16:37.691 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:37 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T12:16:37.692 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:37 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T12:16:37.692 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:37 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T12:16:37.692 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:37 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T12:16:37.692 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:37 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: s = self.context.wrap_socket( 2024-09-12T12:16:37.692 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:37 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T12:16:37.692 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:37 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: return self.sslsocket_class._create( 2024-09-12T12:16:37.692 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:37 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T12:16:37.692 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:37 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: self.do_handshake() 2024-09-12T12:16:37.692 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:37 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T12:16:37.692 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:37 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: self._sslobj.do_handshake() 2024-09-12T12:16:37.692 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:37 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T12:16:37.692 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:37 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:38.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:38 smithi033 ceph-mon[31246]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:16:38.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:38 smithi033 ceph-mon[31246]: [12/Sep/2024:12:16:37] ENGINE Bus STARTING 2024-09-12T12:16:38.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:38 smithi033 ceph-mon[31246]: from='mgr.14118 172.21.15.33:0/447348134' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:16:38.535 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:38 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: Generating public/private rsa key pair. 2024-09-12T12:16:38.535 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:38 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: Your identification has been saved in /tmp/tmpdb6z6kj7/key 2024-09-12T12:16:38.536 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:38 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: Your public key has been saved in /tmp/tmpdb6z6kj7/key.pub 2024-09-12T12:16:38.536 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:38 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: The key fingerprint is: 2024-09-12T12:16:38.536 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:38 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: SHA256:ocT5GOn5ciRRoLGEhWGd2D3MaKxJWwz2ODYpqZC41ew ceph-a66dfafc-7100-11ef-bcea-c7b262605968 2024-09-12T12:16:38.536 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:38 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: The key's randomart image is: 2024-09-12T12:16:38.536 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:38 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: +---[RSA 3072]----+ 2024-09-12T12:16:38.536 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:38 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: | =%+*... | 2024-09-12T12:16:38.536 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:38 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: |.==BX==+ | 2024-09-12T12:16:38.536 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:38 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: |*.B** B.. | 2024-09-12T12:16:38.536 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:38 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: |o=++ o B . | 2024-09-12T12:16:38.536 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:38 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: |o E * S | 2024-09-12T12:16:38.536 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:38 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: | + | 2024-09-12T12:16:38.536 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:38 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: | . o | 2024-09-12T12:16:38.536 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:38 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: | o | 2024-09-12T12:16:38.536 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:38 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: | | 2024-09-12T12:16:38.537 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:38 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: +----[SHA256]-----+ 2024-09-12T12:16:38.838 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:37.770+0000 7f6d08bfc640 1 Processor -- start 2024-09-12T12:16:38.838 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:37.770+0000 7f6d08bfc640 1 -- start start 2024-09-12T12:16:38.838 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:37.770+0000 7f6d08bfc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d04105d10 0x7f6d04106110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:38.838 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:37.770+0000 7f6d08bfc640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0407bdb0 con 0x7f6d04105d10 2024-09-12T12:16:38.838 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:37.770+0000 7f6d0259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d04105d10 0x7f6d04106110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:38.838 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:37.770+0000 7f6d0259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d04105d10 0x7f6d04106110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46264/0 (socket says 172.21.15.33:46264) 2024-09-12T12:16:38.838 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:37.770+0000 7f6d0259c640 1 -- 172.21.15.33:0/3336169601 learned_addr learned my addr 172.21.15.33:0/3336169601 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:38.839 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:37.771+0000 7f6d0259c640 1 -- 172.21.15.33:0/3336169601 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d04106650 con 0x7f6d04105d10 2024-09-12T12:16:38.839 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:37.771+0000 7f6d0259c640 1 --2- 172.21.15.33:0/3336169601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d04105d10 0x7f6d04106110 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4009820 tx=0x7f6cf402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da3d68a3024f1877 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:38.839 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:37.772+0000 7f6d01d9b640 1 -- 172.21.15.33:0/3336169601 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cf4037070 con 0x7f6d04105d10 2024-09-12T12:16:38.839 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:37.772+0000 7f6d01d9b640 1 -- 172.21.15.33:0/3336169601 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f6cf40328d0 con 0x7f6d04105d10 2024-09-12T12:16:38.839 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:37.772+0000 7f6d01d9b640 1 -- 172.21.15.33:0/3336169601 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cf40307d0 con 0x7f6d04105d10 2024-09-12T12:16:38.839 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:37.772+0000 7f6d08bfc640 1 -- 172.21.15.33:0/3336169601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d04105d10 msgr2=0x7f6d04106110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:38.839 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:37.772+0000 7f6d08bfc640 1 --2- 172.21.15.33:0/3336169601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d04105d10 0x7f6d04106110 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4009820 tx=0x7f6cf402a270 comp rx=0 tx=0).stop 2024-09-12T12:16:38.839 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:37.772+0000 7f6d08bfc640 1 -- 172.21.15.33:0/3336169601 shutdown_connections 2024-09-12T12:16:38.840 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:37.772+0000 7f6d08bfc640 1 --2- 172.21.15.33:0/3336169601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d04105d10 0x7f6d04106110 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:38.840 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:37.772+0000 7f6d08bfc640 1 -- 172.21.15.33:0/3336169601 >> 172.21.15.33:0/3336169601 conn(0x7f6d04101ae0 msgr2=0x7f6d04103f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:38.840 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:37.772+0000 7f6d08bfc640 1 -- 172.21.15.33:0/3336169601 shutdown_connections 2024-09-12T12:16:38.840 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:37.772+0000 7f6d08bfc640 1 -- 172.21.15.33:0/3336169601 wait complete. 2024-09-12T12:16:38.840 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:37.773+0000 7f6d08bfc640 1 Processor -- start 2024-09-12T12:16:38.840 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:37.773+0000 7f6d08bfc640 1 -- start start 2024-09-12T12:16:38.840 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:37.773+0000 7f6d08bfc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d04105d10 0x7f6d0419d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:38.840 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:37.773+0000 7f6d08bfc640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6d041076f0 con 0x7f6d04105d10 2024-09-12T12:16:38.840 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:37.773+0000 7f6d0259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d04105d10 0x7f6d0419d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:38.840 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:37.773+0000 7f6d0259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d04105d10 0x7f6d0419d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46272/0 (socket says 172.21.15.33:46272) 2024-09-12T12:16:38.841 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:37.773+0000 7f6d0259c640 1 -- 172.21.15.33:0/2214524712 learned_addr learned my addr 172.21.15.33:0/2214524712 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:38.841 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:37.774+0000 7f6d0259c640 1 -- 172.21.15.33:0/2214524712 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d0419daa0 con 0x7f6d04105d10 2024-09-12T12:16:38.841 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:37.774+0000 7f6d0259c640 1 --2- 172.21.15.33:0/2214524712 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d04105d10 0x7f6d0419d560 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4032e10 tx=0x7f6cf4032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:38.841 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:37.774+0000 7f6cfb7fe640 1 -- 172.21.15.33:0/2214524712 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cf4042070 con 0x7f6d04105d10 2024-09-12T12:16:38.841 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:37.774+0000 7f6cfb7fe640 1 -- 172.21.15.33:0/2214524712 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f6cf4030c80 con 0x7f6d04105d10 2024-09-12T12:16:38.841 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:37.774+0000 7f6d08bfc640 1 -- 172.21.15.33:0/2214524712 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d0419dd30 con 0x7f6d04105d10 2024-09-12T12:16:38.841 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:37.774+0000 7f6cfb7fe640 1 -- 172.21.15.33:0/2214524712 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cf4037040 con 0x7f6d04105d10 2024-09-12T12:16:38.841 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:37.774+0000 7f6d08bfc640 1 -- 172.21.15.33:0/2214524712 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d041a0a20 con 0x7f6d04105d10 2024-09-12T12:16:38.841 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:37.775+0000 7f6cfb7fe640 1 -- 172.21.15.33:0/2214524712 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f6cf4045070 con 0x7f6d04105d10 2024-09-12T12:16:38.841 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:37.775+0000 7f6d08bfc640 1 -- 172.21.15.33:0/2214524712 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d04106110 con 0x7f6d04105d10 2024-09-12T12:16:38.841 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:37.775+0000 7f6cfb7fe640 1 --2- 172.21.15.33:0/2214524712 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f6cf0038fc0 0x7f6cf003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:38.841 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:37.775+0000 7f6cfb7fe640 1 -- 172.21.15.33:0/2214524712 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f6cf406be90 con 0x7f6d04105d10 2024-09-12T12:16:38.842 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:37.775+0000 7f6cfbfff640 1 --2- 172.21.15.33:0/2214524712 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f6cf0038fc0 0x7f6cf003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:38.842 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:37.776+0000 7f6cfbfff640 1 --2- 172.21.15.33:0/2214524712 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f6cf0038fc0 0x7f6cf003b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6cec0098c0 tx=0x7f6cec006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:38.842 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:37.780+0000 7f6cfb7fe640 1 -- 172.21.15.33:0/2214524712 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6cf4045360 con 0x7f6d04105d10 2024-09-12T12:16:38.842 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:37.955+0000 7f6d08bfc640 1 -- 172.21.15.33:0/2214524712 --> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f6d0402dab0 con 0x7f6cf0038fc0 2024-09-12T12:16:38.842 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:38.250+0000 7f6cfb7fe640 1 -- 172.21.15.33:0/2214524712 <== mgr.14118 v2:172.21.15.33:6800/1381479235 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6d0402dab0 con 0x7f6cf0038fc0 2024-09-12T12:16:38.842 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:38.252+0000 7f6d08bfc640 1 -- 172.21.15.33:0/2214524712 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f6cf0038fc0 msgr2=0x7f6cf003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:38.842 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:38.252+0000 7f6d08bfc640 1 --2- 172.21.15.33:0/2214524712 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f6cf0038fc0 0x7f6cf003b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6cec0098c0 tx=0x7f6cec006db0 comp rx=0 tx=0).stop 2024-09-12T12:16:38.842 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:38.252+0000 7f6d08bfc640 1 -- 172.21.15.33:0/2214524712 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d04105d10 msgr2=0x7f6d0419d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:38.842 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:38.252+0000 7f6d08bfc640 1 --2- 172.21.15.33:0/2214524712 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d04105d10 0x7f6d0419d560 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4032e10 tx=0x7f6cf4032e40 comp rx=0 tx=0).stop 2024-09-12T12:16:38.842 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:38.252+0000 7f6d08bfc640 1 -- 172.21.15.33:0/2214524712 shutdown_connections 2024-09-12T12:16:38.842 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:38.252+0000 7f6d08bfc640 1 --2- 172.21.15.33:0/2214524712 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f6cf0038fc0 0x7f6cf003b480 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:38.842 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:38.252+0000 7f6d08bfc640 1 --2- 172.21.15.33:0/2214524712 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d04105d10 0x7f6d0419d560 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:38.842 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:38.252+0000 7f6d08bfc640 1 -- 172.21.15.33:0/2214524712 >> 172.21.15.33:0/2214524712 conn(0x7f6d04101ae0 msgr2=0x7f6d04194220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:38.842 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:38.252+0000 7f6d08bfc640 1 -- 172.21.15.33:0/2214524712 shutdown_connections 2024-09-12T12:16:38.843 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:38.252+0000 7f6d08bfc640 1 -- 172.21.15.33:0/2214524712 wait complete. 2024-09-12T12:16:39.410 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:39 smithi033 ceph-mon[31246]: [12/Sep/2024:12:16:37] ENGINE Serving on https://172.21.15.33:7150 2024-09-12T12:16:39.411 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:39 smithi033 ceph-mon[31246]: [12/Sep/2024:12:16:37] ENGINE Error in HTTPServer.serve 2024-09-12T12:16:39.411 INFO:journalctl@ceph.mon.a.smithi033.stdout: Traceback (most recent call last): 2024-09-12T12:16:39.411 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T12:16:39.411 INFO:journalctl@ceph.mon.a.smithi033.stdout: self._connections.run(self.expiration_interval) 2024-09-12T12:16:39.411 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T12:16:39.411 INFO:journalctl@ceph.mon.a.smithi033.stdout: self._run(expiration_interval) 2024-09-12T12:16:39.411 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T12:16:39.411 INFO:journalctl@ceph.mon.a.smithi033.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T12:16:39.411 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T12:16:39.411 INFO:journalctl@ceph.mon.a.smithi033.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T12:16:39.411 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T12:16:39.412 INFO:journalctl@ceph.mon.a.smithi033.stdout: s = self.context.wrap_socket( 2024-09-12T12:16:39.412 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T12:16:39.412 INFO:journalctl@ceph.mon.a.smithi033.stdout: return self.sslsocket_class._create( 2024-09-12T12:16:39.412 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T12:16:39.412 INFO:journalctl@ceph.mon.a.smithi033.stdout: self.do_handshake() 2024-09-12T12:16:39.412 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T12:16:39.412 INFO:journalctl@ceph.mon.a.smithi033.stdout: self._sslobj.do_handshake() 2024-09-12T12:16:39.412 INFO:journalctl@ceph.mon.a.smithi033.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T12:16:39.412 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:39 smithi033 ceph-mon[31246]: [12/Sep/2024:12:16:37] ENGINE Serving on http://172.21.15.33:8765 2024-09-12T12:16:39.412 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:39 smithi033 ceph-mon[31246]: [12/Sep/2024:12:16:37] ENGINE Bus STARTED 2024-09-12T12:16:39.412 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:39 smithi033 ceph-mon[31246]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:16:39.412 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:39 smithi033 ceph-mon[31246]: Generating ssh key... 2024-09-12T12:16:39.413 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:39 smithi033 ceph-mon[31246]: from='mgr.14118 172.21.15.33:0/447348134' entity='mgr.x' 2024-09-12T12:16:39.413 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:39 smithi033 ceph-mon[31246]: from='mgr.14118 172.21.15.33:0/447348134' entity='mgr.x' 2024-09-12T12:16:39.976 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCdPtIXjLJXV1sVerEb7A39fTA/2DsZqiawjSr/eL0enTf9J5lH0mhPNaJ5Bh3ySYDcOWLOYBp+Pca8fdMuezIbelbIXLUyDxs/rnwFZ2I8znanwWHpuQ1OP/ZvFYi0YY4S4U677WPU1rRFgXM5v7N2jSLLK0ojXeXlJkbLKUMI/znTjevOgSXDtbfXq/kT+eTIgxJy6KDFOXHT1OknTT5NsFTYH5hCqebollWaaY7nfRosvy5qN8clcDSXJ9RV0JIWD7iiw/4L07keQgwzap9mCZONiKA+D9g19DuIteUvS30DDUt83jnso3liX/ZB0hrEsp4zjEvcKTOtIIM7Uq4I32SNyf0EBOjY2HSK8PTPGcf2+gsWBI1TTlIJNwFNy9/agb32GUfIOEN7q/OHslbKWM05vOv2I4SHYlcHvH2f7EeeGjAxpO8UjE7bS2y6JtDZ+OYKC3hHwZp//UC6ntO7eq9D9hKHkrf7hy1U+bJUmSVJ38w845iChz0ggdK/GXE= ceph-a66dfafc-7100-11ef-bcea-c7b262605968 2024-09-12T12:16:39.976 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.220+0000 7fb58c77b640 1 Processor -- start 2024-09-12T12:16:39.976 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.220+0000 7fb58c77b640 1 -- start start 2024-09-12T12:16:39.976 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.220+0000 7fb58c77b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb584107420 0x7fb584107820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:39.976 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.220+0000 7fb58c77b640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb584107df0 con 0x7fb584107420 2024-09-12T12:16:39.976 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.220+0000 7fb58a517640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb584107420 0x7fb584107820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:39.976 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.221+0000 7fb58a517640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb584107420 0x7fb584107820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46288/0 (socket says 172.21.15.33:46288) 2024-09-12T12:16:39.976 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.221+0000 7fb58a517640 1 -- 172.21.15.33:0/4058574957 learned_addr learned my addr 172.21.15.33:0/4058574957 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:39.976 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.221+0000 7fb58a517640 1 -- 172.21.15.33:0/4058574957 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb584108620 con 0x7fb584107420 2024-09-12T12:16:39.976 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.221+0000 7fb58a517640 1 --2- 172.21.15.33:0/4058574957 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb584107420 0x7fb584107820 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb57c009820 tx=0x7fb57c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=500d6d9082f3f5fb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:39.976 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.222+0000 7fb589515640 1 -- 172.21.15.33:0/4058574957 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb57c037070 con 0x7fb584107420 2024-09-12T12:16:39.977 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.222+0000 7fb589515640 1 -- 172.21.15.33:0/4058574957 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fb57c0328d0 con 0x7fb584107420 2024-09-12T12:16:39.977 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.222+0000 7fb589515640 1 -- 172.21.15.33:0/4058574957 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb57c0307d0 con 0x7fb584107420 2024-09-12T12:16:39.977 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.222+0000 7fb58c77b640 1 -- 172.21.15.33:0/4058574957 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb584107420 msgr2=0x7fb584107820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:39.977 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.222+0000 7fb58c77b640 1 --2- 172.21.15.33:0/4058574957 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb584107420 0x7fb584107820 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb57c009820 tx=0x7fb57c02a270 comp rx=0 tx=0).stop 2024-09-12T12:16:39.977 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.222+0000 7fb58c77b640 1 -- 172.21.15.33:0/4058574957 shutdown_connections 2024-09-12T12:16:39.977 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.222+0000 7fb58c77b640 1 --2- 172.21.15.33:0/4058574957 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb584107420 0x7fb584107820 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:39.977 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.222+0000 7fb58c77b640 1 -- 172.21.15.33:0/4058574957 >> 172.21.15.33:0/4058574957 conn(0x7fb584102bb0 msgr2=0x7fb584104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:39.977 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.222+0000 7fb58c77b640 1 -- 172.21.15.33:0/4058574957 shutdown_connections 2024-09-12T12:16:39.977 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.222+0000 7fb58c77b640 1 -- 172.21.15.33:0/4058574957 wait complete. 2024-09-12T12:16:39.977 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.223+0000 7fb58c77b640 1 Processor -- start 2024-09-12T12:16:39.977 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.223+0000 7fb58c77b640 1 -- start start 2024-09-12T12:16:39.977 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.223+0000 7fb58c77b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb584107420 0x7fb58419b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:39.978 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.223+0000 7fb58c77b640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb58410b9d0 con 0x7fb584107420 2024-09-12T12:16:39.978 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.223+0000 7fb58a517640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb584107420 0x7fb58419b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:39.978 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.223+0000 7fb58a517640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb584107420 0x7fb58419b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46304/0 (socket says 172.21.15.33:46304) 2024-09-12T12:16:39.978 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.223+0000 7fb58a517640 1 -- 172.21.15.33:0/3752600701 learned_addr learned my addr 172.21.15.33:0/3752600701 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:39.978 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.224+0000 7fb58a517640 1 -- 172.21.15.33:0/3752600701 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb58419b8d0 con 0x7fb584107420 2024-09-12T12:16:39.978 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.224+0000 7fb58a517640 1 --2- 172.21.15.33:0/3752600701 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb584107420 0x7fb58419b390 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb57c009940 tx=0x7fb57c032e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:39.978 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.224+0000 7fb5837fe640 1 -- 172.21.15.33:0/3752600701 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb57c042070 con 0x7fb584107420 2024-09-12T12:16:39.978 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.224+0000 7fb5837fe640 1 -- 172.21.15.33:0/3752600701 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fb57c030c80 con 0x7fb584107420 2024-09-12T12:16:39.978 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.224+0000 7fb58c77b640 1 -- 172.21.15.33:0/3752600701 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb58419bb60 con 0x7fb584107420 2024-09-12T12:16:39.978 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.224+0000 7fb5837fe640 1 -- 172.21.15.33:0/3752600701 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb57c037040 con 0x7fb584107420 2024-09-12T12:16:39.978 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.224+0000 7fb58c77b640 1 -- 172.21.15.33:0/3752600701 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb58419e850 con 0x7fb584107420 2024-09-12T12:16:39.978 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.225+0000 7fb5837fe640 1 -- 172.21.15.33:0/3752600701 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fb57c045070 con 0x7fb584107420 2024-09-12T12:16:39.978 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.225+0000 7fb5837fe640 1 --2- 172.21.15.33:0/3752600701 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7fb56c038fc0 0x7fb56c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:39.979 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.225+0000 7fb58c77b640 1 -- 172.21.15.33:0/3752600701 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb58410bb50 con 0x7fb584107420 2024-09-12T12:16:39.979 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.225+0000 7fb5837fe640 1 -- 172.21.15.33:0/3752600701 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb57c06c010 con 0x7fb584107420 2024-09-12T12:16:39.979 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.225+0000 7fb589d16640 1 --2- 172.21.15.33:0/3752600701 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7fb56c038fc0 0x7fb56c03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:39.979 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.226+0000 7fb589d16640 1 --2- 172.21.15.33:0/3752600701 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7fb56c038fc0 0x7fb56c03b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb5780098c0 tx=0x7fb578006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:39.979 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.230+0000 7fb5837fe640 1 -- 172.21.15.33:0/3752600701 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb57c03ac60 con 0x7fb584107420 2024-09-12T12:16:39.979 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.410+0000 7fb58c77b640 1 -- 172.21.15.33:0/3752600701 --> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7fb584103db0 con 0x7fb56c038fc0 2024-09-12T12:16:39.979 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.411+0000 7fb5837fe640 1 -- 172.21.15.33:0/3752600701 <== mgr.14118 v2:172.21.15.33:6800/1381479235 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7fb584103db0 con 0x7fb56c038fc0 2024-09-12T12:16:39.979 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.413+0000 7fb58c77b640 1 -- 172.21.15.33:0/3752600701 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7fb56c038fc0 msgr2=0x7fb56c03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:39.979 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.413+0000 7fb58c77b640 1 --2- 172.21.15.33:0/3752600701 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7fb56c038fc0 0x7fb56c03b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb5780098c0 tx=0x7fb578006db0 comp rx=0 tx=0).stop 2024-09-12T12:16:39.979 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.413+0000 7fb58c77b640 1 -- 172.21.15.33:0/3752600701 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb584107420 msgr2=0x7fb58419b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:39.979 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.413+0000 7fb58c77b640 1 --2- 172.21.15.33:0/3752600701 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb584107420 0x7fb58419b390 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb57c009940 tx=0x7fb57c032e10 comp rx=0 tx=0).stop 2024-09-12T12:16:39.979 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.413+0000 7fb58c77b640 1 -- 172.21.15.33:0/3752600701 shutdown_connections 2024-09-12T12:16:39.980 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.413+0000 7fb58c77b640 1 --2- 172.21.15.33:0/3752600701 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7fb56c038fc0 0x7fb56c03b480 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:39.980 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.413+0000 7fb58c77b640 1 --2- 172.21.15.33:0/3752600701 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb584107420 0x7fb58419b390 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:39.980 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.413+0000 7fb58c77b640 1 -- 172.21.15.33:0/3752600701 >> 172.21.15.33:0/3752600701 conn(0x7fb584102bb0 msgr2=0x7fb5841036a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:39.980 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.413+0000 7fb58c77b640 1 -- 172.21.15.33:0/3752600701 shutdown_connections 2024-09-12T12:16:39.980 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:39.413+0000 7fb58c77b640 1 -- 172.21.15.33:0/3752600701 wait complete. 2024-09-12T12:16:39.980 INFO:teuthology.orchestra.run.smithi033.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-12T12:16:39.980 INFO:teuthology.orchestra.run.smithi033.stdout:Adding key to root@localhost authorized_keys... 2024-09-12T12:16:39.982 INFO:teuthology.orchestra.run.smithi033.stdout:Adding host smithi033... 2024-09-12T12:16:40.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:40 smithi033 ceph-mon[31246]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:16:41.924 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:41 smithi033 ceph-mon[31246]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi033", "addr": "172.21.15.33", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:16:42.852 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:42 smithi033 ceph-mon[31246]: Deploying cephadm binary to smithi033 2024-09-12T12:16:45.077 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout Added host 'smithi033' with addr '172.21.15.33' 2024-09-12T12:16:45.077 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:40.405+0000 7f8cfb5bd640 1 Processor -- start 2024-09-12T12:16:45.077 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:40.405+0000 7f8cfb5bd640 1 -- start start 2024-09-12T12:16:45.077 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:40.406+0000 7f8cfb5bd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cf4107f40 0x7f8cf410a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:45.077 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:40.406+0000 7f8cfb5bd640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf407bd90 con 0x7f8cf4107f40 2024-09-12T12:16:45.078 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:40.406+0000 7f8cf9359640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cf4107f40 0x7f8cf410a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:45.078 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:40.406+0000 7f8cf9359640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cf4107f40 0x7f8cf410a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46316/0 (socket says 172.21.15.33:46316) 2024-09-12T12:16:45.078 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:40.406+0000 7f8cf9359640 1 -- 172.21.15.33:0/2815326906 learned_addr learned my addr 172.21.15.33:0/2815326906 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:45.078 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:40.406+0000 7f8cf9359640 1 -- 172.21.15.33:0/2815326906 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cf410a870 con 0x7f8cf4107f40 2024-09-12T12:16:45.078 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:40.407+0000 7f8cf9359640 1 --2- 172.21.15.33:0/2815326906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cf4107f40 0x7f8cf410a330 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0009820 tx=0x7f8cf002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffab8bfc303c84e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:45.078 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:40.407+0000 7f8cebfff640 1 -- 172.21.15.33:0/2815326906 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cf0037070 con 0x7f8cf4107f40 2024-09-12T12:16:45.078 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:40.407+0000 7f8cebfff640 1 -- 172.21.15.33:0/2815326906 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f8cf00328d0 con 0x7f8cf4107f40 2024-09-12T12:16:45.078 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:40.407+0000 7f8cebfff640 1 -- 172.21.15.33:0/2815326906 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cf00307d0 con 0x7f8cf4107f40 2024-09-12T12:16:45.078 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:40.408+0000 7f8cfb5bd640 1 -- 172.21.15.33:0/2815326906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cf4107f40 msgr2=0x7f8cf410a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:45.078 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:40.408+0000 7f8cfb5bd640 1 --2- 172.21.15.33:0/2815326906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cf4107f40 0x7f8cf410a330 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0009820 tx=0x7f8cf002a270 comp rx=0 tx=0).stop 2024-09-12T12:16:45.078 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:40.408+0000 7f8cfb5bd640 1 -- 172.21.15.33:0/2815326906 shutdown_connections 2024-09-12T12:16:45.078 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:40.408+0000 7f8cfb5bd640 1 --2- 172.21.15.33:0/2815326906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cf4107f40 0x7f8cf410a330 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:45.079 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:40.408+0000 7f8cfb5bd640 1 -- 172.21.15.33:0/2815326906 >> 172.21.15.33:0/2815326906 conn(0x7f8cf4101ae0 msgr2=0x7f8cf4103f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:45.079 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:40.408+0000 7f8cfb5bd640 1 -- 172.21.15.33:0/2815326906 shutdown_connections 2024-09-12T12:16:45.079 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:40.408+0000 7f8cfb5bd640 1 -- 172.21.15.33:0/2815326906 wait complete. 2024-09-12T12:16:45.079 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:40.408+0000 7f8cfb5bd640 1 Processor -- start 2024-09-12T12:16:45.079 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:40.408+0000 7f8cfb5bd640 1 -- start start 2024-09-12T12:16:45.079 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:40.409+0000 7f8cfb5bd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cf4107f40 0x7f8cf419b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:45.079 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:40.409+0000 7f8cfb5bd640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf410b7f0 con 0x7f8cf4107f40 2024-09-12T12:16:45.079 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:40.409+0000 7f8cf9359640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cf4107f40 0x7f8cf419b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:45.079 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:40.409+0000 7f8cf9359640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cf4107f40 0x7f8cf419b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46318/0 (socket says 172.21.15.33:46318) 2024-09-12T12:16:45.079 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:40.409+0000 7f8cf9359640 1 -- 172.21.15.33:0/1868428319 learned_addr learned my addr 172.21.15.33:0/1868428319 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:45.079 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:40.409+0000 7f8cf9359640 1 -- 172.21.15.33:0/1868428319 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cf419b890 con 0x7f8cf4107f40 2024-09-12T12:16:45.079 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:40.409+0000 7f8cf9359640 1 --2- 172.21.15.33:0/1868428319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cf4107f40 0x7f8cf419b350 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8cf00097f0 tx=0x7f8cf0030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:45.079 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:40.409+0000 7f8cea7fc640 1 -- 172.21.15.33:0/1868428319 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cf0037040 con 0x7f8cf4107f40 2024-09-12T12:16:45.080 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:40.409+0000 7f8cea7fc640 1 -- 172.21.15.33:0/1868428319 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f8cf0032bb0 con 0x7f8cf4107f40 2024-09-12T12:16:45.080 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:40.409+0000 7f8cfb5bd640 1 -- 172.21.15.33:0/1868428319 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cf419bb20 con 0x7f8cf4107f40 2024-09-12T12:16:45.080 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:40.409+0000 7f8cea7fc640 1 -- 172.21.15.33:0/1868428319 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cf003a390 con 0x7f8cf4107f40 2024-09-12T12:16:45.080 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:40.409+0000 7f8cfb5bd640 1 -- 172.21.15.33:0/1868428319 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cf419e810 con 0x7f8cf4107f40 2024-09-12T12:16:45.080 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:40.410+0000 7f8cea7fc640 1 -- 172.21.15.33:0/1868428319 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f8cf003a580 con 0x7f8cf4107f40 2024-09-12T12:16:45.080 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:40.410+0000 7f8cfb5bd640 1 -- 172.21.15.33:0/1868428319 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cf41083a0 con 0x7f8cf4107f40 2024-09-12T12:16:45.080 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:40.410+0000 7f8cea7fc640 1 --2- 172.21.15.33:0/1868428319 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f8ce0038fc0 0x7f8ce003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:45.080 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:40.410+0000 7f8cea7fc640 1 -- 172.21.15.33:0/1868428319 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f8cf006c1f0 con 0x7f8cf4107f40 2024-09-12T12:16:45.080 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:40.411+0000 7f8cf8b58640 1 --2- 172.21.15.33:0/1868428319 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f8ce0038fc0 0x7f8ce003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:45.080 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:40.411+0000 7f8cf8b58640 1 --2- 172.21.15.33:0/1868428319 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f8ce0038fc0 0x7f8ce003b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8ce40098c0 tx=0x7f8ce4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:45.080 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:40.415+0000 7f8cea7fc640 1 -- 172.21.15.33:0/1868428319 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8cf0032d60 con 0x7f8cf4107f40 2024-09-12T12:16:45.080 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:40.596+0000 7f8cfb5bd640 1 -- 172.21.15.33:0/1868428319 --> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi033", "addr": "172.21.15.33", "target": ["mon-mgr", ""]}) -- 0x7f8cf4102d70 con 0x7f8ce0038fc0 2024-09-12T12:16:45.080 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:44.490+0000 7f8cea7fc640 1 -- 172.21.15.33:0/1868428319 <== mgr.14118 v2:172.21.15.33:6800/1381479235 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f8cf4102d70 con 0x7f8ce0038fc0 2024-09-12T12:16:45.081 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:44.494+0000 7f8cfb5bd640 1 -- 172.21.15.33:0/1868428319 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f8ce0038fc0 msgr2=0x7f8ce003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:45.081 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:44.494+0000 7f8cfb5bd640 1 --2- 172.21.15.33:0/1868428319 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f8ce0038fc0 0x7f8ce003b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8ce40098c0 tx=0x7f8ce4006db0 comp rx=0 tx=0).stop 2024-09-12T12:16:45.081 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:44.494+0000 7f8cfb5bd640 1 -- 172.21.15.33:0/1868428319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cf4107f40 msgr2=0x7f8cf419b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:45.081 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:44.494+0000 7f8cfb5bd640 1 --2- 172.21.15.33:0/1868428319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cf4107f40 0x7f8cf419b350 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8cf00097f0 tx=0x7f8cf0030d00 comp rx=0 tx=0).stop 2024-09-12T12:16:45.081 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:44.494+0000 7f8cfb5bd640 1 -- 172.21.15.33:0/1868428319 shutdown_connections 2024-09-12T12:16:45.081 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:44.494+0000 7f8cfb5bd640 1 --2- 172.21.15.33:0/1868428319 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f8ce0038fc0 0x7f8ce003b480 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:45.081 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:44.494+0000 7f8cfb5bd640 1 --2- 172.21.15.33:0/1868428319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cf4107f40 0x7f8cf419b350 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:45.081 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:44.494+0000 7f8cfb5bd640 1 -- 172.21.15.33:0/1868428319 >> 172.21.15.33:0/1868428319 conn(0x7f8cf4101ae0 msgr2=0x7f8cf4102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:45.081 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:44.494+0000 7f8cfb5bd640 1 -- 172.21.15.33:0/1868428319 shutdown_connections 2024-09-12T12:16:45.081 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:44.494+0000 7f8cfb5bd640 1 -- 172.21.15.33:0/1868428319 wait complete. 2024-09-12T12:16:45.081 INFO:teuthology.orchestra.run.smithi033.stdout:Deploying unmanaged mon service... 2024-09-12T12:16:45.782 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:45 smithi033 ceph-mon[31246]: from='mgr.14118 172.21.15.33:0/447348134' entity='mgr.x' 2024-09-12T12:16:45.782 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:45 smithi033 ceph-mon[31246]: Added host smithi033 2024-09-12T12:16:45.783 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:45 smithi033 ceph-mon[31246]: from='mgr.14118 172.21.15.33:0/447348134' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:16:46.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:46 smithi033 ceph-mon[31246]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:16:46.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:46 smithi033 ceph-mon[31246]: Saving service mon spec with placement count:5 2024-09-12T12:16:46.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:46 smithi033 ceph-mon[31246]: from='mgr.14118 172.21.15.33:0/447348134' entity='mgr.x' 2024-09-12T12:16:47.176 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-12T12:16:47.176 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.506+0000 7f72bb3b0640 1 Processor -- start 2024-09-12T12:16:47.176 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.506+0000 7f72bb3b0640 1 -- start start 2024-09-12T12:16:47.176 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.506+0000 7f72bb3b0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72b4107420 0x7f72b4107820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:47.176 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.506+0000 7f72bb3b0640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f72b4107df0 con 0x7f72b4107420 2024-09-12T12:16:47.176 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.506+0000 7f72b914c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72b4107420 0x7f72b4107820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:47.177 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.506+0000 7f72b914c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72b4107420 0x7f72b4107820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56038/0 (socket says 172.21.15.33:56038) 2024-09-12T12:16:47.177 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.506+0000 7f72b914c640 1 -- 172.21.15.33:0/2881420254 learned_addr learned my addr 172.21.15.33:0/2881420254 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:47.177 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.507+0000 7f72b914c640 1 -- 172.21.15.33:0/2881420254 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b4108620 con 0x7f72b4107420 2024-09-12T12:16:47.177 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.507+0000 7f72b914c640 1 --2- 172.21.15.33:0/2881420254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72b4107420 0x7f72b4107820 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f72b0009820 tx=0x7f72b002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8ffcad23ebdd7d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:47.177 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.507+0000 7f72abfff640 1 -- 172.21.15.33:0/2881420254 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72b0037070 con 0x7f72b4107420 2024-09-12T12:16:47.177 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.507+0000 7f72abfff640 1 -- 172.21.15.33:0/2881420254 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f72b00328d0 con 0x7f72b4107420 2024-09-12T12:16:47.177 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.507+0000 7f72abfff640 1 -- 172.21.15.33:0/2881420254 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72b00307d0 con 0x7f72b4107420 2024-09-12T12:16:47.177 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.508+0000 7f72bb3b0640 1 -- 172.21.15.33:0/2881420254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72b4107420 msgr2=0x7f72b4107820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:47.177 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.508+0000 7f72bb3b0640 1 --2- 172.21.15.33:0/2881420254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72b4107420 0x7f72b4107820 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f72b0009820 tx=0x7f72b002a270 comp rx=0 tx=0).stop 2024-09-12T12:16:47.177 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.508+0000 7f72bb3b0640 1 -- 172.21.15.33:0/2881420254 shutdown_connections 2024-09-12T12:16:47.177 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.508+0000 7f72bb3b0640 1 --2- 172.21.15.33:0/2881420254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72b4107420 0x7f72b4107820 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:47.177 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.508+0000 7f72bb3b0640 1 -- 172.21.15.33:0/2881420254 >> 172.21.15.33:0/2881420254 conn(0x7f72b4102bb0 msgr2=0x7f72b4104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:47.177 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.508+0000 7f72bb3b0640 1 -- 172.21.15.33:0/2881420254 shutdown_connections 2024-09-12T12:16:47.178 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.508+0000 7f72bb3b0640 1 -- 172.21.15.33:0/2881420254 wait complete. 2024-09-12T12:16:47.178 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.509+0000 7f72bb3b0640 1 Processor -- start 2024-09-12T12:16:47.178 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.509+0000 7f72bb3b0640 1 -- start start 2024-09-12T12:16:47.178 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.509+0000 7f72bb3b0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72b4107420 0x7f72b419b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:47.178 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.509+0000 7f72bb3b0640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f72b410b9d0 con 0x7f72b4107420 2024-09-12T12:16:47.178 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.509+0000 7f72b914c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72b4107420 0x7f72b419b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:47.178 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.509+0000 7f72b914c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72b4107420 0x7f72b419b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56054/0 (socket says 172.21.15.33:56054) 2024-09-12T12:16:47.178 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.509+0000 7f72b914c640 1 -- 172.21.15.33:0/3340501824 learned_addr learned my addr 172.21.15.33:0/3340501824 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:47.178 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.509+0000 7f72b914c640 1 -- 172.21.15.33:0/3340501824 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b419b8d0 con 0x7f72b4107420 2024-09-12T12:16:47.178 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.509+0000 7f72b914c640 1 --2- 172.21.15.33:0/3340501824 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72b4107420 0x7f72b419b390 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f72b00097f0 tx=0x7f72b0030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:47.178 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.509+0000 7f72aa7fc640 1 -- 172.21.15.33:0/3340501824 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72b0037040 con 0x7f72b4107420 2024-09-12T12:16:47.178 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.509+0000 7f72aa7fc640 1 -- 172.21.15.33:0/3340501824 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f72b0032bb0 con 0x7f72b4107420 2024-09-12T12:16:47.178 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.509+0000 7f72aa7fc640 1 -- 172.21.15.33:0/3340501824 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72b003a390 con 0x7f72b4107420 2024-09-12T12:16:47.178 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.509+0000 7f72bb3b0640 1 -- 172.21.15.33:0/3340501824 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72b419bb60 con 0x7f72b4107420 2024-09-12T12:16:47.179 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.510+0000 7f72bb3b0640 1 -- 172.21.15.33:0/3340501824 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72b419e850 con 0x7f72b4107420 2024-09-12T12:16:47.179 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.510+0000 7f72aa7fc640 1 -- 172.21.15.33:0/3340501824 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f72b003b3f0 con 0x7f72b4107420 2024-09-12T12:16:47.179 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.510+0000 7f72bb3b0640 1 -- 172.21.15.33:0/3340501824 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72b410bb50 con 0x7f72b4107420 2024-09-12T12:16:47.179 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.511+0000 7f72aa7fc640 1 --2- 172.21.15.33:0/3340501824 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f72a0038f70 0x7f72a003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:47.179 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.511+0000 7f72aa7fc640 1 -- 172.21.15.33:0/3340501824 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f72b006c1e0 con 0x7f72b4107420 2024-09-12T12:16:47.179 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.511+0000 7f72b894b640 1 --2- 172.21.15.33:0/3340501824 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f72a0038f70 0x7f72a003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:47.179 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.511+0000 7f72b894b640 1 --2- 172.21.15.33:0/3340501824 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f72a0038f70 0x7f72a003b430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f72a40098c0 tx=0x7f72a4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:47.179 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.515+0000 7f72aa7fc640 1 -- 172.21.15.33:0/3340501824 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f72b0049c80 con 0x7f72b4107420 2024-09-12T12:16:47.179 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.707+0000 7f72bb3b0640 1 -- 172.21.15.33:0/3340501824 --> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f72b4103dd0 con 0x7f72a0038f70 2024-09-12T12:16:47.179 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.712+0000 7f72aa7fc640 1 -- 172.21.15.33:0/3340501824 <== mgr.14118 v2:172.21.15.33:6800/1381479235 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f72b4103dd0 con 0x7f72a0038f70 2024-09-12T12:16:47.179 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.714+0000 7f72bb3b0640 1 -- 172.21.15.33:0/3340501824 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f72a0038f70 msgr2=0x7f72a003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:47.179 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.714+0000 7f72bb3b0640 1 --2- 172.21.15.33:0/3340501824 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f72a0038f70 0x7f72a003b430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f72a40098c0 tx=0x7f72a4006db0 comp rx=0 tx=0).stop 2024-09-12T12:16:47.179 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.714+0000 7f72bb3b0640 1 -- 172.21.15.33:0/3340501824 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72b4107420 msgr2=0x7f72b419b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:47.179 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.714+0000 7f72bb3b0640 1 --2- 172.21.15.33:0/3340501824 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72b4107420 0x7f72b419b390 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f72b00097f0 tx=0x7f72b0030d00 comp rx=0 tx=0).stop 2024-09-12T12:16:47.180 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.714+0000 7f72bb3b0640 1 -- 172.21.15.33:0/3340501824 shutdown_connections 2024-09-12T12:16:47.180 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.714+0000 7f72bb3b0640 1 --2- 172.21.15.33:0/3340501824 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f72a0038f70 0x7f72a003b430 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:47.180 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.714+0000 7f72bb3b0640 1 --2- 172.21.15.33:0/3340501824 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72b4107420 0x7f72b419b390 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:47.180 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.714+0000 7f72bb3b0640 1 -- 172.21.15.33:0/3340501824 >> 172.21.15.33:0/3340501824 conn(0x7f72b4102bb0 msgr2=0x7f72b41036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:47.180 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.714+0000 7f72bb3b0640 1 -- 172.21.15.33:0/3340501824 shutdown_connections 2024-09-12T12:16:47.180 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:45.714+0000 7f72bb3b0640 1 -- 172.21.15.33:0/3340501824 wait complete. 2024-09-12T12:16:47.180 INFO:teuthology.orchestra.run.smithi033.stdout:Deploying unmanaged mgr service... 2024-09-12T12:16:48.083 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:47 smithi033 ceph-mon[31246]: from='mgr.14118 172.21.15.33:0/447348134' entity='mgr.x' 2024-09-12T12:16:48.083 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:47 smithi033 ceph-mon[31246]: from='mgr.14118 172.21.15.33:0/447348134' entity='mgr.x' 2024-09-12T12:16:48.618 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-12T12:16:48.618 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.601+0000 7fcbd7cbf640 1 Processor -- start 2024-09-12T12:16:48.618 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.601+0000 7fcbd7cbf640 1 -- start start 2024-09-12T12:16:48.618 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.601+0000 7fcbd7cbf640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcbd0107e90 0x7fcbd010a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:48.618 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.601+0000 7fcbd7cbf640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd0075880 con 0x7fcbd0107e90 2024-09-12T12:16:48.618 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.602+0000 7fcbd5a5b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcbd0107e90 0x7fcbd010a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:48.618 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.602+0000 7fcbd5a5b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcbd0107e90 0x7fcbd010a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56068/0 (socket says 172.21.15.33:56068) 2024-09-12T12:16:48.618 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.602+0000 7fcbd5a5b640 1 -- 172.21.15.33:0/3550469352 learned_addr learned my addr 172.21.15.33:0/3550469352 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:48.618 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.602+0000 7fcbd5a5b640 1 -- 172.21.15.33:0/3550469352 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbd010a7c0 con 0x7fcbd0107e90 2024-09-12T12:16:48.618 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.603+0000 7fcbd5a5b640 1 --2- 172.21.15.33:0/3550469352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcbd0107e90 0x7fcbd010a280 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc009820 tx=0x7fcbcc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=466190b3c540fd2d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:48.619 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.603+0000 7fcbd4a59640 1 -- 172.21.15.33:0/3550469352 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbcc037070 con 0x7fcbd0107e90 2024-09-12T12:16:48.619 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.603+0000 7fcbd4a59640 1 -- 172.21.15.33:0/3550469352 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcbcc0328f0 con 0x7fcbd0107e90 2024-09-12T12:16:48.619 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.603+0000 7fcbd4a59640 1 -- 172.21.15.33:0/3550469352 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbcc030740 con 0x7fcbd0107e90 2024-09-12T12:16:48.619 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.604+0000 7fcbd7cbf640 1 -- 172.21.15.33:0/3550469352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcbd0107e90 msgr2=0x7fcbd010a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:48.619 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.604+0000 7fcbd7cbf640 1 --2- 172.21.15.33:0/3550469352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcbd0107e90 0x7fcbd010a280 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc009820 tx=0x7fcbcc02a270 comp rx=0 tx=0).stop 2024-09-12T12:16:48.619 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.604+0000 7fcbd7cbf640 1 -- 172.21.15.33:0/3550469352 shutdown_connections 2024-09-12T12:16:48.619 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.604+0000 7fcbd7cbf640 1 --2- 172.21.15.33:0/3550469352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcbd0107e90 0x7fcbd010a280 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:48.619 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.604+0000 7fcbd7cbf640 1 -- 172.21.15.33:0/3550469352 >> 172.21.15.33:0/3550469352 conn(0x7fcbd0101a90 msgr2=0x7fcbd0103ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:48.619 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.604+0000 7fcbd7cbf640 1 -- 172.21.15.33:0/3550469352 shutdown_connections 2024-09-12T12:16:48.619 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.604+0000 7fcbd7cbf640 1 -- 172.21.15.33:0/3550469352 wait complete. 2024-09-12T12:16:48.619 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.604+0000 7fcbd7cbf640 1 Processor -- start 2024-09-12T12:16:48.619 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.604+0000 7fcbd7cbf640 1 -- start start 2024-09-12T12:16:48.619 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.605+0000 7fcbd7cbf640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcbd0107e90 0x7fcbd019d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:48.620 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.605+0000 7fcbd7cbf640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd010b840 con 0x7fcbd0107e90 2024-09-12T12:16:48.620 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.605+0000 7fcbd5a5b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcbd0107e90 0x7fcbd019d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:48.620 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.605+0000 7fcbd5a5b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcbd0107e90 0x7fcbd019d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56074/0 (socket says 172.21.15.33:56074) 2024-09-12T12:16:48.620 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.605+0000 7fcbd5a5b640 1 -- 172.21.15.33:0/2947020987 learned_addr learned my addr 172.21.15.33:0/2947020987 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:48.620 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.605+0000 7fcbd5a5b640 1 -- 172.21.15.33:0/2947020987 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbd019dae0 con 0x7fcbd0107e90 2024-09-12T12:16:48.620 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.605+0000 7fcbd5a5b640 1 --2- 172.21.15.33:0/2947020987 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcbd0107e90 0x7fcbd019d5a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc030cc0 tx=0x7fcbcc030cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:48.620 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.605+0000 7fcbc6ffd640 1 -- 172.21.15.33:0/2947020987 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbcc042070 con 0x7fcbd0107e90 2024-09-12T12:16:48.620 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.605+0000 7fcbc6ffd640 1 -- 172.21.15.33:0/2947020987 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcbcc030e60 con 0x7fcbd0107e90 2024-09-12T12:16:48.620 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.605+0000 7fcbc6ffd640 1 -- 172.21.15.33:0/2947020987 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbcc037040 con 0x7fcbd0107e90 2024-09-12T12:16:48.620 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.606+0000 7fcbd7cbf640 1 -- 172.21.15.33:0/2947020987 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbd019dd70 con 0x7fcbd0107e90 2024-09-12T12:16:48.620 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.606+0000 7fcbd7cbf640 1 -- 172.21.15.33:0/2947020987 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbd01a0a60 con 0x7fcbd0107e90 2024-09-12T12:16:48.620 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.607+0000 7fcbd7cbf640 1 -- 172.21.15.33:0/2947020987 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbd01082f0 con 0x7fcbd0107e90 2024-09-12T12:16:48.620 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.607+0000 7fcbc6ffd640 1 -- 172.21.15.33:0/2947020987 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fcbcc045070 con 0x7fcbd0107e90 2024-09-12T12:16:48.621 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.607+0000 7fcbc6ffd640 1 --2- 172.21.15.33:0/2947020987 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7fcbbc038f70 0x7fcbbc03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:48.621 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.607+0000 7fcbc6ffd640 1 -- 172.21.15.33:0/2947020987 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fcbcc06c060 con 0x7fcbd0107e90 2024-09-12T12:16:48.621 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.607+0000 7fcbd525a640 1 --2- 172.21.15.33:0/2947020987 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7fcbbc038f70 0x7fcbbc03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:48.621 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.608+0000 7fcbd525a640 1 --2- 172.21.15.33:0/2947020987 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7fcbbc038f70 0x7fcbbc03b430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcbc00098c0 tx=0x7fcbc0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:48.621 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.616+0000 7fcbc6ffd640 1 -- 172.21.15.33:0/2947020987 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcbcc045360 con 0x7fcbd0107e90 2024-09-12T12:16:48.621 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.834+0000 7fcbd7cbf640 1 -- 172.21.15.33:0/2947020987 --> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fcbd0102c90 con 0x7fcbbc038f70 2024-09-12T12:16:48.621 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.841+0000 7fcbc6ffd640 1 -- 172.21.15.33:0/2947020987 <== mgr.14118 v2:172.21.15.33:6800/1381479235 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fcbd0102c90 con 0x7fcbbc038f70 2024-09-12T12:16:48.621 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.843+0000 7fcbd7cbf640 1 -- 172.21.15.33:0/2947020987 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7fcbbc038f70 msgr2=0x7fcbbc03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:48.621 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.843+0000 7fcbd7cbf640 1 --2- 172.21.15.33:0/2947020987 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7fcbbc038f70 0x7fcbbc03b430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcbc00098c0 tx=0x7fcbc0006db0 comp rx=0 tx=0).stop 2024-09-12T12:16:48.621 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.843+0000 7fcbd7cbf640 1 -- 172.21.15.33:0/2947020987 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcbd0107e90 msgr2=0x7fcbd019d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:48.621 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.843+0000 7fcbd7cbf640 1 --2- 172.21.15.33:0/2947020987 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcbd0107e90 0x7fcbd019d5a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc030cc0 tx=0x7fcbcc030cf0 comp rx=0 tx=0).stop 2024-09-12T12:16:48.621 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.843+0000 7fcbd7cbf640 1 -- 172.21.15.33:0/2947020987 shutdown_connections 2024-09-12T12:16:48.621 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.843+0000 7fcbd7cbf640 1 --2- 172.21.15.33:0/2947020987 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7fcbbc038f70 0x7fcbbc03b430 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:48.622 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.843+0000 7fcbd7cbf640 1 --2- 172.21.15.33:0/2947020987 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcbd0107e90 0x7fcbd019d5a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:48.622 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.843+0000 7fcbd7cbf640 1 -- 172.21.15.33:0/2947020987 >> 172.21.15.33:0/2947020987 conn(0x7fcbd0101a90 msgr2=0x7fcbd0102580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:48.622 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.844+0000 7fcbd7cbf640 1 -- 172.21.15.33:0/2947020987 shutdown_connections 2024-09-12T12:16:48.622 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:47.844+0000 7fcbd7cbf640 1 -- 172.21.15.33:0/2947020987 wait complete. 2024-09-12T12:16:48.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:48 smithi033 ceph-mon[31246]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:16:48.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:48 smithi033 ceph-mon[31246]: Saving service mgr spec with placement count:2 2024-09-12T12:16:48.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:48 smithi033 ceph-mon[31246]: from='mgr.14118 172.21.15.33:0/447348134' entity='mgr.x' 2024-09-12T12:16:50.058 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.374+0000 7f6833d9c640 1 Processor -- start 2024-09-12T12:16:50.058 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.375+0000 7f6833d9c640 1 -- start start 2024-09-12T12:16:50.058 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.375+0000 7f6833d9c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f682c107ef0 0x7f682c10a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:50.058 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.375+0000 7f6833d9c640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f682c07bdd0 con 0x7f682c107ef0 2024-09-12T12:16:50.058 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.375+0000 7f6831b38640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f682c107ef0 0x7f682c10a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:50.058 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.375+0000 7f6831b38640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f682c107ef0 0x7f682c10a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56084/0 (socket says 172.21.15.33:56084) 2024-09-12T12:16:50.058 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.375+0000 7f6831b38640 1 -- 172.21.15.33:0/3354302054 learned_addr learned my addr 172.21.15.33:0/3354302054 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:50.058 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.375+0000 7f6831b38640 1 -- 172.21.15.33:0/3354302054 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f682c10a820 con 0x7f682c107ef0 2024-09-12T12:16:50.059 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.376+0000 7f6831b38640 1 --2- 172.21.15.33:0/3354302054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f682c107ef0 0x7f682c10a2e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6828009820 tx=0x7f682802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b0af8be2e772906 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:50.059 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.376+0000 7f6830b36640 1 -- 172.21.15.33:0/3354302054 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6828037070 con 0x7f682c107ef0 2024-09-12T12:16:50.059 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.376+0000 7f6830b36640 1 -- 172.21.15.33:0/3354302054 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f68280328f0 con 0x7f682c107ef0 2024-09-12T12:16:50.059 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.376+0000 7f6830b36640 1 -- 172.21.15.33:0/3354302054 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6828030740 con 0x7f682c107ef0 2024-09-12T12:16:50.059 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.377+0000 7f6833d9c640 1 -- 172.21.15.33:0/3354302054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f682c107ef0 msgr2=0x7f682c10a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:50.059 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.377+0000 7f6833d9c640 1 --2- 172.21.15.33:0/3354302054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f682c107ef0 0x7f682c10a2e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6828009820 tx=0x7f682802a270 comp rx=0 tx=0).stop 2024-09-12T12:16:50.059 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.377+0000 7f6833d9c640 1 -- 172.21.15.33:0/3354302054 shutdown_connections 2024-09-12T12:16:50.059 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.377+0000 7f6833d9c640 1 --2- 172.21.15.33:0/3354302054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f682c107ef0 0x7f682c10a2e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:50.059 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.377+0000 7f6833d9c640 1 -- 172.21.15.33:0/3354302054 >> 172.21.15.33:0/3354302054 conn(0x7f682c101a70 msgr2=0x7f682c103ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:50.059 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.377+0000 7f6833d9c640 1 -- 172.21.15.33:0/3354302054 shutdown_connections 2024-09-12T12:16:50.059 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.377+0000 7f6833d9c640 1 -- 172.21.15.33:0/3354302054 wait complete. 2024-09-12T12:16:50.059 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.378+0000 7f6833d9c640 1 Processor -- start 2024-09-12T12:16:50.059 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.378+0000 7f6833d9c640 1 -- start start 2024-09-12T12:16:50.059 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.378+0000 7f6833d9c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f682c107ef0 0x7f682c107770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:50.060 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.378+0000 7f6833d9c640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f682c10b7e0 con 0x7f682c107ef0 2024-09-12T12:16:50.060 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.378+0000 7f6831b38640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f682c107ef0 0x7f682c107770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:50.060 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.378+0000 7f6831b38640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f682c107ef0 0x7f682c107770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56096/0 (socket says 172.21.15.33:56096) 2024-09-12T12:16:50.060 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.378+0000 7f6831b38640 1 -- 172.21.15.33:0/4215283815 learned_addr learned my addr 172.21.15.33:0/4215283815 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:50.060 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.378+0000 7f6831b38640 1 -- 172.21.15.33:0/4215283815 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f682c107cb0 con 0x7f682c107ef0 2024-09-12T12:16:50.060 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.378+0000 7f6831b38640 1 --2- 172.21.15.33:0/4215283815 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f682c107ef0 0x7f682c107770 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f68280097f0 tx=0x7f6828030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:50.060 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.379+0000 7f681effd640 1 -- 172.21.15.33:0/4215283815 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6828042070 con 0x7f682c107ef0 2024-09-12T12:16:50.060 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.379+0000 7f681effd640 1 -- 172.21.15.33:0/4215283815 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6828030d80 con 0x7f682c107ef0 2024-09-12T12:16:50.060 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.379+0000 7f6833d9c640 1 -- 172.21.15.33:0/4215283815 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f682c105ea0 con 0x7f682c107ef0 2024-09-12T12:16:50.060 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.379+0000 7f681effd640 1 -- 172.21.15.33:0/4215283815 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6828037040 con 0x7f682c107ef0 2024-09-12T12:16:50.060 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.379+0000 7f6833d9c640 1 -- 172.21.15.33:0/4215283815 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f682c1063e0 con 0x7f682c107ef0 2024-09-12T12:16:50.060 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.380+0000 7f681effd640 1 -- 172.21.15.33:0/4215283815 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f6828045070 con 0x7f682c107ef0 2024-09-12T12:16:50.060 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.380+0000 7f681effd640 1 --2- 172.21.15.33:0/4215283815 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f6818038fc0 0x7f681803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:50.061 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.380+0000 7f6833d9c640 1 -- 172.21.15.33:0/4215283815 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f682c108350 con 0x7f682c107ef0 2024-09-12T12:16:50.061 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.380+0000 7f681effd640 1 -- 172.21.15.33:0/4215283815 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f682806c000 con 0x7f682c107ef0 2024-09-12T12:16:50.061 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.380+0000 7f6831337640 1 --2- 172.21.15.33:0/4215283815 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f6818038fc0 0x7f681803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:50.061 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.380+0000 7f6831337640 1 --2- 172.21.15.33:0/4215283815 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f6818038fc0 0x7f681803b480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f68200098c0 tx=0x7f6820006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:50.061 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.385+0000 7f681effd640 1 -- 172.21.15.33:0/4215283815 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6828045520 con 0x7f682c107ef0 2024-09-12T12:16:50.061 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.565+0000 7f6833d9c640 1 -- 172.21.15.33:0/4215283815 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f682c106b40 con 0x7f682c107ef0 2024-09-12T12:16:50.061 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.568+0000 7f681effd640 1 -- 172.21.15.33:0/4215283815 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f6828045780 con 0x7f682c107ef0 2024-09-12T12:16:50.061 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.570+0000 7f6833d9c640 1 -- 172.21.15.33:0/4215283815 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f6818038fc0 msgr2=0x7f681803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:50.061 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.570+0000 7f6833d9c640 1 --2- 172.21.15.33:0/4215283815 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f6818038fc0 0x7f681803b480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f68200098c0 tx=0x7f6820006db0 comp rx=0 tx=0).stop 2024-09-12T12:16:50.061 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.570+0000 7f6833d9c640 1 -- 172.21.15.33:0/4215283815 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f682c107ef0 msgr2=0x7f682c107770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:50.061 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.570+0000 7f6833d9c640 1 --2- 172.21.15.33:0/4215283815 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f682c107ef0 0x7f682c107770 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f68280097f0 tx=0x7f6828030c70 comp rx=0 tx=0).stop 2024-09-12T12:16:50.061 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.570+0000 7f6833d9c640 1 -- 172.21.15.33:0/4215283815 shutdown_connections 2024-09-12T12:16:50.062 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.570+0000 7f6833d9c640 1 --2- 172.21.15.33:0/4215283815 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f6818038fc0 0x7f681803b480 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:50.062 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.570+0000 7f6833d9c640 1 --2- 172.21.15.33:0/4215283815 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f682c107ef0 0x7f682c107770 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:50.062 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.570+0000 7f6833d9c640 1 -- 172.21.15.33:0/4215283815 >> 172.21.15.33:0/4215283815 conn(0x7f682c101a70 msgr2=0x7f682c102610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:50.062 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.570+0000 7f6833d9c640 1 -- 172.21.15.33:0/4215283815 shutdown_connections 2024-09-12T12:16:50.062 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:49.571+0000 7f6833d9c640 1 -- 172.21.15.33:0/4215283815 wait complete. 2024-09-12T12:16:50.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:49 smithi033 ceph-mon[31246]: from='mgr.14118 172.21.15.33:0/447348134' entity='mgr.x' 2024-09-12T12:16:50.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:49 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/4215283815' entity='client.admin' 2024-09-12T12:16:50.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:49 smithi033 ceph-mon[31246]: from='mgr.14118 172.21.15.33:0/447348134' entity='mgr.x' 2024-09-12T12:16:51.955 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:51 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/576384183' entity='client.admin' 2024-09-12T12:16:51.965 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.460+0000 7f97064e1640 1 Processor -- start 2024-09-12T12:16:51.965 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.460+0000 7f97064e1640 1 -- start start 2024-09-12T12:16:51.965 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.461+0000 7f97064e1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9700107ef0 0x7f970010a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:51.965 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.461+0000 7f97064e1640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9700075820 con 0x7f9700107ef0 2024-09-12T12:16:51.965 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.461+0000 7f96fffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9700107ef0 0x7f970010a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:51.965 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.461+0000 7f96fffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9700107ef0 0x7f970010a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55572/0 (socket says 172.21.15.33:55572) 2024-09-12T12:16:51.965 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.461+0000 7f96fffff640 1 -- 172.21.15.33:0/62138056 learned_addr learned my addr 172.21.15.33:0/62138056 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:51.965 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.461+0000 7f96fffff640 1 -- 172.21.15.33:0/62138056 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f970010a820 con 0x7f9700107ef0 2024-09-12T12:16:51.966 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.462+0000 7f96fffff640 1 --2- 172.21.15.33:0/62138056 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9700107ef0 0x7f970010a2e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f96f0009820 tx=0x7f96f002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49777fe262fd30ee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:51.966 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.462+0000 7f96feffd640 1 -- 172.21.15.33:0/62138056 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96f0037070 con 0x7f9700107ef0 2024-09-12T12:16:51.966 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.462+0000 7f96feffd640 1 -- 172.21.15.33:0/62138056 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f96f00328f0 con 0x7f9700107ef0 2024-09-12T12:16:51.966 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.462+0000 7f96feffd640 1 -- 172.21.15.33:0/62138056 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96f0030740 con 0x7f9700107ef0 2024-09-12T12:16:51.966 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.463+0000 7f97064e1640 1 -- 172.21.15.33:0/62138056 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9700107ef0 msgr2=0x7f970010a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:51.966 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.463+0000 7f97064e1640 1 --2- 172.21.15.33:0/62138056 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9700107ef0 0x7f970010a2e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f96f0009820 tx=0x7f96f002a270 comp rx=0 tx=0).stop 2024-09-12T12:16:51.966 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.463+0000 7f97064e1640 1 -- 172.21.15.33:0/62138056 shutdown_connections 2024-09-12T12:16:51.966 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.463+0000 7f97064e1640 1 --2- 172.21.15.33:0/62138056 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9700107ef0 0x7f970010a2e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:51.966 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.463+0000 7f97064e1640 1 -- 172.21.15.33:0/62138056 >> 172.21.15.33:0/62138056 conn(0x7f9700101a90 msgr2=0x7f9700103ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:51.966 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.463+0000 7f97064e1640 1 -- 172.21.15.33:0/62138056 shutdown_connections 2024-09-12T12:16:51.966 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.463+0000 7f97064e1640 1 -- 172.21.15.33:0/62138056 wait complete. 2024-09-12T12:16:51.966 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.464+0000 7f97064e1640 1 Processor -- start 2024-09-12T12:16:51.967 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.464+0000 7f97064e1640 1 -- start start 2024-09-12T12:16:51.967 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.464+0000 7f97064e1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9700107ef0 0x7f970019b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:51.967 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.464+0000 7f97064e1640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f970010b840 con 0x7f9700107ef0 2024-09-12T12:16:51.967 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.464+0000 7f96fffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9700107ef0 0x7f970019b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:51.967 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.464+0000 7f96fffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9700107ef0 0x7f970019b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55576/0 (socket says 172.21.15.33:55576) 2024-09-12T12:16:51.967 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.464+0000 7f96fffff640 1 -- 172.21.15.33:0/576384183 learned_addr learned my addr 172.21.15.33:0/576384183 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:51.967 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.465+0000 7f96fffff640 1 -- 172.21.15.33:0/576384183 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f970019b8c0 con 0x7f9700107ef0 2024-09-12T12:16:51.967 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.465+0000 7f96fffff640 1 --2- 172.21.15.33:0/576384183 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9700107ef0 0x7f970019b380 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f96f00097f0 tx=0x7f96f0030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:51.967 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.465+0000 7f96fd7fa640 1 -- 172.21.15.33:0/576384183 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96f0042070 con 0x7f9700107ef0 2024-09-12T12:16:51.967 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.465+0000 7f97064e1640 1 -- 172.21.15.33:0/576384183 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f970019bb50 con 0x7f9700107ef0 2024-09-12T12:16:51.967 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.465+0000 7f97064e1640 1 -- 172.21.15.33:0/576384183 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f970019e840 con 0x7f9700107ef0 2024-09-12T12:16:51.968 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.465+0000 7f96fd7fa640 1 -- 172.21.15.33:0/576384183 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f96f0030d80 con 0x7f9700107ef0 2024-09-12T12:16:51.968 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.465+0000 7f96fd7fa640 1 -- 172.21.15.33:0/576384183 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96f0037040 con 0x7f9700107ef0 2024-09-12T12:16:51.968 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.466+0000 7f96fd7fa640 1 -- 172.21.15.33:0/576384183 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f96f0045070 con 0x7f9700107ef0 2024-09-12T12:16:51.968 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.466+0000 7f96fd7fa640 1 --2- 172.21.15.33:0/576384183 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f96e8038fc0 0x7f96e803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:51.968 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.466+0000 7f96fd7fa640 1 -- 172.21.15.33:0/576384183 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f96f006cf10 con 0x7f9700107ef0 2024-09-12T12:16:51.968 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.466+0000 7f96ff7fe640 1 --2- 172.21.15.33:0/576384183 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f96e8038fc0 0x7f96e803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:51.968 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.467+0000 7f97064e1640 1 -- 172.21.15.33:0/576384183 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96ec0052c0 con 0x7f9700107ef0 2024-09-12T12:16:51.968 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.467+0000 7f96ff7fe640 1 --2- 172.21.15.33:0/576384183 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f96e8038fc0 0x7f96e803b480 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f96f40098c0 tx=0x7f96f4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:51.968 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.471+0000 7f96fd7fa640 1 -- 172.21.15.33:0/576384183 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f96f0045520 con 0x7f9700107ef0 2024-09-12T12:16:51.968 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.664+0000 7f97064e1640 1 -- 172.21.15.33:0/576384183 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f96ec0055b0 con 0x7f9700107ef0 2024-09-12T12:16:51.968 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.666+0000 7f96fd7fa640 1 -- 172.21.15.33:0/576384183 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f96f003add0 con 0x7f9700107ef0 2024-09-12T12:16:51.968 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.668+0000 7f97064e1640 1 -- 172.21.15.33:0/576384183 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f96e8038fc0 msgr2=0x7f96e803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:51.969 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.668+0000 7f97064e1640 1 --2- 172.21.15.33:0/576384183 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f96e8038fc0 0x7f96e803b480 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f96f40098c0 tx=0x7f96f4006db0 comp rx=0 tx=0).stop 2024-09-12T12:16:51.969 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.668+0000 7f97064e1640 1 -- 172.21.15.33:0/576384183 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9700107ef0 msgr2=0x7f970019b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:51.969 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.668+0000 7f97064e1640 1 --2- 172.21.15.33:0/576384183 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9700107ef0 0x7f970019b380 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f96f00097f0 tx=0x7f96f0030c70 comp rx=0 tx=0).stop 2024-09-12T12:16:51.969 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.669+0000 7f97064e1640 1 -- 172.21.15.33:0/576384183 shutdown_connections 2024-09-12T12:16:51.969 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.669+0000 7f97064e1640 1 --2- 172.21.15.33:0/576384183 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f96e8038fc0 0x7f96e803b480 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:51.969 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.669+0000 7f97064e1640 1 --2- 172.21.15.33:0/576384183 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9700107ef0 0x7f970019b380 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:51.969 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.669+0000 7f97064e1640 1 -- 172.21.15.33:0/576384183 >> 172.21.15.33:0/576384183 conn(0x7f9700101a90 msgr2=0x7f97001025d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:51.969 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.669+0000 7f97064e1640 1 -- 172.21.15.33:0/576384183 shutdown_connections 2024-09-12T12:16:51.969 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:50.669+0000 7f97064e1640 1 -- 172.21.15.33:0/576384183 wait complete. 2024-09-12T12:16:51.969 INFO:teuthology.orchestra.run.smithi033.stdout:Enabling the dashboard module... 2024-09-12T12:16:52.884 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:52 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/2698247511' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-12T12:16:52.884 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:52 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: ignoring --setuser ceph since I am not root 2024-09-12T12:16:52.884 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:52 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: ignoring --setgroup ceph since I am not root 2024-09-12T12:16:52.884 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:52 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:52.822+0000 7fda17452040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T12:16:52.884 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:52 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:52.882+0000 7fda17452040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T12:16:53.231 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:53 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:53.041+0000 7fda17452040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T12:16:53.231 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:53 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:53.111+0000 7fda17452040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T12:16:53.243 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.344+0000 7f96656fe640 1 Processor -- start 2024-09-12T12:16:53.243 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.344+0000 7f96656fe640 1 -- start start 2024-09-12T12:16:53.243 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.344+0000 7f96656fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9660107f40 0x7f966010a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:53.243 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.344+0000 7f96656fe640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f966007bd90 con 0x7f9660107f40 2024-09-12T12:16:53.243 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.345+0000 7f965effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9660107f40 0x7f966010a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:53.243 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.345+0000 7f965effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9660107f40 0x7f966010a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55578/0 (socket says 172.21.15.33:55578) 2024-09-12T12:16:53.243 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.345+0000 7f965effd640 1 -- 172.21.15.33:0/28957624 learned_addr learned my addr 172.21.15.33:0/28957624 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:53.243 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.345+0000 7f965effd640 1 -- 172.21.15.33:0/28957624 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f966010a870 con 0x7f9660107f40 2024-09-12T12:16:53.243 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.346+0000 7f965effd640 1 --2- 172.21.15.33:0/28957624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9660107f40 0x7f966010a330 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9650009820 tx=0x7f965002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0afc043c233c635 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:53.244 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.346+0000 7f965e7fc640 1 -- 172.21.15.33:0/28957624 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9650037070 con 0x7f9660107f40 2024-09-12T12:16:53.244 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.346+0000 7f965e7fc640 1 -- 172.21.15.33:0/28957624 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f96500328f0 con 0x7f9660107f40 2024-09-12T12:16:53.244 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.346+0000 7f965e7fc640 1 -- 172.21.15.33:0/28957624 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9650030740 con 0x7f9660107f40 2024-09-12T12:16:53.244 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.346+0000 7f96656fe640 1 -- 172.21.15.33:0/28957624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9660107f40 msgr2=0x7f966010a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:53.244 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.346+0000 7f96656fe640 1 --2- 172.21.15.33:0/28957624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9660107f40 0x7f966010a330 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9650009820 tx=0x7f965002a270 comp rx=0 tx=0).stop 2024-09-12T12:16:53.244 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.346+0000 7f96656fe640 1 -- 172.21.15.33:0/28957624 shutdown_connections 2024-09-12T12:16:53.244 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.346+0000 7f96656fe640 1 --2- 172.21.15.33:0/28957624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9660107f40 0x7f966010a330 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:53.244 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.346+0000 7f96656fe640 1 -- 172.21.15.33:0/28957624 >> 172.21.15.33:0/28957624 conn(0x7f9660101ae0 msgr2=0x7f9660103f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:53.244 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.347+0000 7f96656fe640 1 -- 172.21.15.33:0/28957624 shutdown_connections 2024-09-12T12:16:53.244 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.347+0000 7f96656fe640 1 -- 172.21.15.33:0/28957624 wait complete. 2024-09-12T12:16:53.244 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.347+0000 7f96656fe640 1 Processor -- start 2024-09-12T12:16:53.244 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.347+0000 7f96656fe640 1 -- start start 2024-09-12T12:16:53.245 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.347+0000 7f96656fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9660107f40 0x7f96601077c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:53.245 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.347+0000 7f96656fe640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f966010b830 con 0x7f9660107f40 2024-09-12T12:16:53.245 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.347+0000 7f965effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9660107f40 0x7f96601077c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:53.245 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.347+0000 7f965effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9660107f40 0x7f96601077c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55588/0 (socket says 172.21.15.33:55588) 2024-09-12T12:16:53.245 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.347+0000 7f965effd640 1 -- 172.21.15.33:0/2698247511 learned_addr learned my addr 172.21.15.33:0/2698247511 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:53.245 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.348+0000 7f965effd640 1 -- 172.21.15.33:0/2698247511 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9660107d00 con 0x7f9660107f40 2024-09-12T12:16:53.245 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.348+0000 7f965effd640 1 --2- 172.21.15.33:0/2698247511 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9660107f40 0x7f96601077c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9650030cc0 tx=0x7f9650030cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:53.245 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.348+0000 7f965cff9640 1 -- 172.21.15.33:0/2698247511 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9650042070 con 0x7f9660107f40 2024-09-12T12:16:53.245 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.348+0000 7f965cff9640 1 -- 172.21.15.33:0/2698247511 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9650030e60 con 0x7f9660107f40 2024-09-12T12:16:53.245 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.348+0000 7f96656fe640 1 -- 172.21.15.33:0/2698247511 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9660105ef0 con 0x7f9660107f40 2024-09-12T12:16:53.245 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.348+0000 7f965cff9640 1 -- 172.21.15.33:0/2698247511 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9650037040 con 0x7f9660107f40 2024-09-12T12:16:53.245 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.348+0000 7f96656fe640 1 -- 172.21.15.33:0/2698247511 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9660106430 con 0x7f9660107f40 2024-09-12T12:16:53.245 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.349+0000 7f965cff9640 1 -- 172.21.15.33:0/2698247511 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f9650045070 con 0x7f9660107f40 2024-09-12T12:16:53.246 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.349+0000 7f96656fe640 1 -- 172.21.15.33:0/2698247511 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96601083a0 con 0x7f9660107f40 2024-09-12T12:16:53.246 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.349+0000 7f965cff9640 1 --2- 172.21.15.33:0/2698247511 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f964c038fc0 0x7f964c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:53.246 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.349+0000 7f965cff9640 1 -- 172.21.15.33:0/2698247511 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f965006c0e0 con 0x7f9660107f40 2024-09-12T12:16:53.246 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.350+0000 7f9657fff640 1 --2- 172.21.15.33:0/2698247511 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f964c038fc0 0x7f964c03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:53.246 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.350+0000 7f9657fff640 1 --2- 172.21.15.33:0/2698247511 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f964c038fc0 0x7f964c03b480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f96480098c0 tx=0x7f9648006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:53.246 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.354+0000 7f965cff9640 1 -- 172.21.15.33:0/2698247511 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f965004b170 con 0x7f9660107f40 2024-09-12T12:16:53.246 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.577+0000 7f96656fe640 1 -- 172.21.15.33:0/2698247511 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f9660106bd0 con 0x7f9660107f40 2024-09-12T12:16:53.246 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.669+0000 7f965cff9640 1 -- 172.21.15.33:0/2698247511 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f965006ba30 con 0x7f9660107f40 2024-09-12T12:16:53.246 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.671+0000 7f965cff9640 1 -- 172.21.15.33:0/2698247511 <== mon.0 v2:172.21.15.33:3300/0 8 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f965003d950 con 0x7f9660107f40 2024-09-12T12:16:53.246 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.672+0000 7f96656fe640 1 -- 172.21.15.33:0/2698247511 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f964c038fc0 msgr2=0x7f964c03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:53.246 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.672+0000 7f96656fe640 1 --2- 172.21.15.33:0/2698247511 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f964c038fc0 0x7f964c03b480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f96480098c0 tx=0x7f9648006db0 comp rx=0 tx=0).stop 2024-09-12T12:16:53.246 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.672+0000 7f96656fe640 1 -- 172.21.15.33:0/2698247511 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9660107f40 msgr2=0x7f96601077c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:53.246 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.672+0000 7f96656fe640 1 --2- 172.21.15.33:0/2698247511 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9660107f40 0x7f96601077c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9650030cc0 tx=0x7f9650030cf0 comp rx=0 tx=0).stop 2024-09-12T12:16:53.247 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.672+0000 7f96656fe640 1 -- 172.21.15.33:0/2698247511 shutdown_connections 2024-09-12T12:16:53.247 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.672+0000 7f96656fe640 1 --2- 172.21.15.33:0/2698247511 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f964c038fc0 0x7f964c03b480 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:53.247 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.672+0000 7f96656fe640 1 --2- 172.21.15.33:0/2698247511 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9660107f40 0x7f96601077c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:53.247 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.672+0000 7f96656fe640 1 -- 172.21.15.33:0/2698247511 >> 172.21.15.33:0/2698247511 conn(0x7f9660101ae0 msgr2=0x7f9660102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:53.247 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.672+0000 7f96656fe640 1 -- 172.21.15.33:0/2698247511 shutdown_connections 2024-09-12T12:16:53.247 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:52.673+0000 7f96656fe640 1 -- 172.21.15.33:0/2698247511 wait complete. 2024-09-12T12:16:53.491 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:53 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:53.269+0000 7fda17452040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T12:16:53.491 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:53 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:53.419+0000 7fda17452040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T12:16:53.761 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:53 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/2698247511' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-12T12:16:53.761 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:53 smithi033 ceph-mon[31246]: mgrmap e9: x(active, since 19s) 2024-09-12T12:16:54.031 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:53 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:53.760+0000 7fda17452040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T12:16:54.031 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:53 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:53.824+0000 7fda17452040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T12:16:54.031 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:54 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:54.030+0000 7fda17452040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T12:16:54.476 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout { 2024-09-12T12:16:54.476 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-12T12:16:54.477 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-12T12:16:54.477 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-12T12:16:54.477 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-12T12:16:54.477 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout } 2024-09-12T12:16:54.477 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.668+0000 7f8b18c49640 1 Processor -- start 2024-09-12T12:16:54.477 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.668+0000 7f8b18c49640 1 -- start start 2024-09-12T12:16:54.477 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.669+0000 7f8b18c49640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b14107420 0x7f8b14107820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:54.477 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.669+0000 7f8b18c49640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8b14107df0 con 0x7f8b14107420 2024-09-12T12:16:54.477 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.669+0000 7f8b1259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b14107420 0x7f8b14107820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:54.477 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.669+0000 7f8b1259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b14107420 0x7f8b14107820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55614/0 (socket says 172.21.15.33:55614) 2024-09-12T12:16:54.477 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.669+0000 7f8b1259c640 1 -- 172.21.15.33:0/471874614 learned_addr learned my addr 172.21.15.33:0/471874614 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:54.477 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.669+0000 7f8b1259c640 1 -- 172.21.15.33:0/471874614 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b14108620 con 0x7f8b14107420 2024-09-12T12:16:54.478 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.670+0000 7f8b1259c640 1 --2- 172.21.15.33:0/471874614 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b14107420 0x7f8b14107820 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8b04009820 tx=0x7f8b0402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=440f184d65cdb9aa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:54.478 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.671+0000 7f8b1159a640 1 -- 172.21.15.33:0/471874614 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b04037070 con 0x7f8b14107420 2024-09-12T12:16:54.478 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.671+0000 7f8b1159a640 1 -- 172.21.15.33:0/471874614 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8b040328f0 con 0x7f8b14107420 2024-09-12T12:16:54.478 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.671+0000 7f8b1159a640 1 -- 172.21.15.33:0/471874614 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b04030740 con 0x7f8b14107420 2024-09-12T12:16:54.478 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.672+0000 7f8b18c49640 1 -- 172.21.15.33:0/471874614 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b14107420 msgr2=0x7f8b14107820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:54.478 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.672+0000 7f8b18c49640 1 --2- 172.21.15.33:0/471874614 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b14107420 0x7f8b14107820 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8b04009820 tx=0x7f8b0402a270 comp rx=0 tx=0).stop 2024-09-12T12:16:54.478 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.672+0000 7f8b18c49640 1 -- 172.21.15.33:0/471874614 shutdown_connections 2024-09-12T12:16:54.478 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.672+0000 7f8b18c49640 1 --2- 172.21.15.33:0/471874614 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b14107420 0x7f8b14107820 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.478 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.672+0000 7f8b18c49640 1 -- 172.21.15.33:0/471874614 >> 172.21.15.33:0/471874614 conn(0x7f8b14102bb0 msgr2=0x7f8b14104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:54.478 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.673+0000 7f8b18c49640 1 -- 172.21.15.33:0/471874614 shutdown_connections 2024-09-12T12:16:54.478 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.673+0000 7f8b18c49640 1 -- 172.21.15.33:0/471874614 wait complete. 2024-09-12T12:16:54.478 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.673+0000 7f8b18c49640 1 Processor -- start 2024-09-12T12:16:54.479 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.673+0000 7f8b18c49640 1 -- start start 2024-09-12T12:16:54.479 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.674+0000 7f8b18c49640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b14107420 0x7f8b1419b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:54.479 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.674+0000 7f8b18c49640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1410b9d0 con 0x7f8b14107420 2024-09-12T12:16:54.479 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.674+0000 7f8b1259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b14107420 0x7f8b1419b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:54.479 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.674+0000 7f8b1259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b14107420 0x7f8b1419b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55630/0 (socket says 172.21.15.33:55630) 2024-09-12T12:16:54.479 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.674+0000 7f8b1259c640 1 -- 172.21.15.33:0/362178341 learned_addr learned my addr 172.21.15.33:0/362178341 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:54.479 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.674+0000 7f8b1259c640 1 -- 172.21.15.33:0/362178341 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b1419b900 con 0x7f8b14107420 2024-09-12T12:16:54.479 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.674+0000 7f8b1259c640 1 --2- 172.21.15.33:0/362178341 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b14107420 0x7f8b1419b3c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8b04009940 tx=0x7f8b04030cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:54.479 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.674+0000 7f8b0b7fe640 1 -- 172.21.15.33:0/362178341 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b04042070 con 0x7f8b14107420 2024-09-12T12:16:54.479 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.674+0000 7f8b18c49640 1 -- 172.21.15.33:0/362178341 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b1419bb90 con 0x7f8b14107420 2024-09-12T12:16:54.479 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.674+0000 7f8b0b7fe640 1 -- 172.21.15.33:0/362178341 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8b04030e30 con 0x7f8b14107420 2024-09-12T12:16:54.479 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.674+0000 7f8b0b7fe640 1 -- 172.21.15.33:0/362178341 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b04037040 con 0x7f8b14107420 2024-09-12T12:16:54.480 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.674+0000 7f8b18c49640 1 -- 172.21.15.33:0/362178341 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b1419e880 con 0x7f8b14107420 2024-09-12T12:16:54.480 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.675+0000 7f8b0b7fe640 1 -- 172.21.15.33:0/362178341 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f8b04045070 con 0x7f8b14107420 2024-09-12T12:16:54.480 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.675+0000 7f8b18c49640 1 -- 172.21.15.33:0/362178341 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b1410bb50 con 0x7f8b14107420 2024-09-12T12:16:54.480 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.676+0000 7f8b0b7fe640 1 --2- 172.21.15.33:0/362178341 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f8b00038fc0 0x7f8b0003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:54.480 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.676+0000 7f8b0b7fe640 1 -- 172.21.15.33:0/362178341 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f8b0406cfa0 con 0x7f8b14107420 2024-09-12T12:16:54.480 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.676+0000 7f8b11d9b640 1 -- 172.21.15.33:0/362178341 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f8b00038fc0 msgr2=0x7f8b0003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/1381479235 2024-09-12T12:16:54.480 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.676+0000 7f8b11d9b640 1 --2- 172.21.15.33:0/362178341 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f8b00038fc0 0x7f8b0003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T12:16:54.480 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.680+0000 7f8b0b7fe640 1 -- 172.21.15.33:0/362178341 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8b0403add0 con 0x7f8b14107420 2024-09-12T12:16:54.480 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.877+0000 7f8b11d9b640 1 -- 172.21.15.33:0/362178341 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f8b00038fc0 msgr2=0x7f8b0003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/1381479235 2024-09-12T12:16:54.480 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.877+0000 7f8b11d9b640 1 --2- 172.21.15.33:0/362178341 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f8b00038fc0 0x7f8b0003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T12:16:54.480 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.904+0000 7f8b18c49640 1 -- 172.21.15.33:0/362178341 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f8b1419ea50 con 0x7f8b14107420 2024-09-12T12:16:54.480 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.904+0000 7f8b0b7fe640 1 -- 172.21.15.33:0/362178341 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f8b04045520 con 0x7f8b14107420 2024-09-12T12:16:54.480 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.906+0000 7f8b18c49640 1 -- 172.21.15.33:0/362178341 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f8b00038fc0 msgr2=0x7f8b0003b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T12:16:54.481 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.906+0000 7f8b18c49640 1 --2- 172.21.15.33:0/362178341 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f8b00038fc0 0x7f8b0003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.481 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.906+0000 7f8b18c49640 1 -- 172.21.15.33:0/362178341 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b14107420 msgr2=0x7f8b1419b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:54.481 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.906+0000 7f8b18c49640 1 --2- 172.21.15.33:0/362178341 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b14107420 0x7f8b1419b3c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8b04009940 tx=0x7f8b04030cc0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.481 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.906+0000 7f8b18c49640 1 -- 172.21.15.33:0/362178341 shutdown_connections 2024-09-12T12:16:54.481 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.906+0000 7f8b18c49640 1 --2- 172.21.15.33:0/362178341 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7f8b00038fc0 0x7f8b0003b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.481 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.906+0000 7f8b18c49640 1 --2- 172.21.15.33:0/362178341 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b14107420 0x7f8b1419b3c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.481 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.906+0000 7f8b18c49640 1 -- 172.21.15.33:0/362178341 >> 172.21.15.33:0/362178341 conn(0x7f8b14102bb0 msgr2=0x7f8b14103690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:54.481 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.906+0000 7f8b18c49640 1 -- 172.21.15.33:0/362178341 shutdown_connections 2024-09-12T12:16:54.481 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:53.906+0000 7f8b18c49640 1 -- 172.21.15.33:0/362178341 wait complete. 2024-09-12T12:16:54.481 INFO:teuthology.orchestra.run.smithi033.stdout:Waiting for the mgr to restart... 2024-09-12T12:16:54.482 INFO:teuthology.orchestra.run.smithi033.stdout:Waiting for mgr epoch 9... 2024-09-12T12:16:54.980 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:54 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/362178341' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-12T12:16:55.449 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:54 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:54.983+0000 7fda17452040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T12:16:55.449 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:55 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:55.054+0000 7fda17452040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T12:16:56.083 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:55 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:55.810+0000 7fda17452040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T12:16:56.084 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:55 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:55.932+0000 7fda17452040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T12:16:56.376 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:56 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:56.082+0000 7fda17452040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T12:16:56.377 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:56 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:56.147+0000 7fda17452040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T12:16:56.377 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:56 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:56.304+0000 7fda17452040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T12:16:56.377 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:56 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:56.375+0000 7fda17452040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T12:16:56.674 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:56 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:56.439+0000 7fda17452040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T12:16:56.675 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:56 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:56.605+0000 7fda17452040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T12:16:56.675 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:56 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:56.673+0000 7fda17452040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T12:16:56.956 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:56 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:56.743+0000 7fda17452040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T12:16:56.957 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:56 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:56.830+0000 7fda17452040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T12:16:56.957 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:56 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:56.893+0000 7fda17452040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T12:16:56.957 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:56 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:56.955+0000 7fda17452040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T12:16:58.057 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:57 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:57.789+0000 7fda17452040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T12:16:58.057 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:57 smithi033 ceph-mon[31246]: Active manager daemon x restarted 2024-09-12T12:16:58.057 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:57 smithi033 ceph-mon[31246]: Activating manager daemon x 2024-09-12T12:16:58.058 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:57 smithi033 ceph-mon[31246]: osdmap e3: 0 total, 0 up, 0 in 2024-09-12T12:16:58.058 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:57 smithi033 ceph-mon[31246]: mgrmap e10: x(active, starting, since 0.00355384s) 2024-09-12T12:16:58.058 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:57 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:16:58.058 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:57 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T12:16:58.058 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:57 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T12:16:58.058 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:57 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T12:16:58.058 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:57 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T12:16:58.058 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:57 smithi033 ceph-mon[31246]: Manager daemon x is now available 2024-09-12T12:16:58.058 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:57 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:16:58.058 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:57 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T12:16:58.058 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:57 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T12:16:59.452 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:59 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:59.371+0000 7fd982766640 -1 log_channel(cephadm) log [ERR] : [12/Sep/2024:12:16:59] ENGINE Error in HTTPServer.serve 2024-09-12T12:16:59.452 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:59 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: Traceback (most recent call last): 2024-09-12T12:16:59.452 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:59 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T12:16:59.452 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:59 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: self._connections.run(self.expiration_interval) 2024-09-12T12:16:59.453 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:59 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T12:16:59.453 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:59 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: self._run(expiration_interval) 2024-09-12T12:16:59.453 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:59 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T12:16:59.453 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:59 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T12:16:59.453 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:59 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T12:16:59.453 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:59 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T12:16:59.453 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:59 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T12:16:59.453 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:59 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: s = self.context.wrap_socket( 2024-09-12T12:16:59.453 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:59 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T12:16:59.453 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:59 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: return self.sslsocket_class._create( 2024-09-12T12:16:59.453 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:59 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T12:16:59.453 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:59 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: self.do_handshake() 2024-09-12T12:16:59.453 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:59 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T12:16:59.454 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:59 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: self._sslobj.do_handshake() 2024-09-12T12:16:59.454 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:59 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T12:16:59.454 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:16:59 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:16:59.729 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout { 2024-09-12T12:16:59.729 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-12T12:16:59.729 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-12T12:16:59.729 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout } 2024-09-12T12:16:59.729 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:54.841+0000 7ff4f2173640 1 Processor -- start 2024-09-12T12:16:59.729 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:54.841+0000 7ff4f2173640 1 -- start start 2024-09-12T12:16:59.729 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:54.841+0000 7ff4f2173640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4ec106310 0x7ff4ec106710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:59.729 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:54.841+0000 7ff4f2173640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ec106ce0 con 0x7ff4ec106310 2024-09-12T12:16:59.729 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:54.841+0000 7ff4eb7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4ec106310 0x7ff4ec106710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:59.730 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:54.841+0000 7ff4eb7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4ec106310 0x7ff4ec106710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55638/0 (socket says 172.21.15.33:55638) 2024-09-12T12:16:59.730 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:54.841+0000 7ff4eb7fe640 1 -- 172.21.15.33:0/493258695 learned_addr learned my addr 172.21.15.33:0/493258695 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:59.730 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:54.841+0000 7ff4eb7fe640 1 -- 172.21.15.33:0/493258695 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4ec107510 con 0x7ff4ec106310 2024-09-12T12:16:59.730 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:54.842+0000 7ff4eb7fe640 1 --2- 172.21.15.33:0/493258695 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4ec106310 0x7ff4ec106710 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc009820 tx=0x7ff4dc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d9be763f6c95 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:59.730 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:54.842+0000 7ff4ea7fc640 1 -- 172.21.15.33:0/493258695 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4dc037070 con 0x7ff4ec106310 2024-09-12T12:16:59.730 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:54.842+0000 7ff4ea7fc640 1 -- 172.21.15.33:0/493258695 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff4dc0328f0 con 0x7ff4ec106310 2024-09-12T12:16:59.730 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:54.842+0000 7ff4ea7fc640 1 -- 172.21.15.33:0/493258695 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4dc030740 con 0x7ff4ec106310 2024-09-12T12:16:59.730 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:54.843+0000 7ff4f2173640 1 -- 172.21.15.33:0/493258695 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4ec106310 msgr2=0x7ff4ec106710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:59.730 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:54.843+0000 7ff4f2173640 1 --2- 172.21.15.33:0/493258695 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4ec106310 0x7ff4ec106710 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc009820 tx=0x7ff4dc02a270 comp rx=0 tx=0).stop 2024-09-12T12:16:59.730 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:54.843+0000 7ff4f2173640 1 -- 172.21.15.33:0/493258695 shutdown_connections 2024-09-12T12:16:59.731 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:54.843+0000 7ff4f2173640 1 --2- 172.21.15.33:0/493258695 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4ec106310 0x7ff4ec106710 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:59.731 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:54.843+0000 7ff4f2173640 1 -- 172.21.15.33:0/493258695 >> 172.21.15.33:0/493258695 conn(0x7ff4ec101ac0 msgr2=0x7ff4ec103ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:59.731 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:54.843+0000 7ff4f2173640 1 -- 172.21.15.33:0/493258695 shutdown_connections 2024-09-12T12:16:59.731 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:54.843+0000 7ff4f2173640 1 -- 172.21.15.33:0/493258695 wait complete. 2024-09-12T12:16:59.731 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:54.844+0000 7ff4f2173640 1 Processor -- start 2024-09-12T12:16:59.731 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:54.844+0000 7ff4f2173640 1 -- start start 2024-09-12T12:16:59.731 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:54.844+0000 7ff4f2173640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4ec106310 0x7ff4ec19d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:59.731 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:54.844+0000 7ff4f2173640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ec10a8c0 con 0x7ff4ec106310 2024-09-12T12:16:59.731 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:54.844+0000 7ff4eb7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4ec106310 0x7ff4ec19d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:59.731 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:54.844+0000 7ff4eb7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4ec106310 0x7ff4ec19d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55646/0 (socket says 172.21.15.33:55646) 2024-09-12T12:16:59.731 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:54.844+0000 7ff4eb7fe640 1 -- 172.21.15.33:0/3494696126 learned_addr learned my addr 172.21.15.33:0/3494696126 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:16:59.731 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:54.844+0000 7ff4eb7fe640 1 -- 172.21.15.33:0/3494696126 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4ec19db20 con 0x7ff4ec106310 2024-09-12T12:16:59.731 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:54.845+0000 7ff4eb7fe640 1 --2- 172.21.15.33:0/3494696126 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4ec106310 0x7ff4ec19d5e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc0097f0 tx=0x7ff4dc030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:59.732 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:54.845+0000 7ff4e8ff9640 1 -- 172.21.15.33:0/3494696126 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4dc042070 con 0x7ff4ec106310 2024-09-12T12:16:59.732 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:54.845+0000 7ff4e8ff9640 1 -- 172.21.15.33:0/3494696126 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff4dc030d80 con 0x7ff4ec106310 2024-09-12T12:16:59.732 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:54.845+0000 7ff4f2173640 1 -- 172.21.15.33:0/3494696126 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4ec19ddb0 con 0x7ff4ec106310 2024-09-12T12:16:59.732 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:54.845+0000 7ff4e8ff9640 1 -- 172.21.15.33:0/3494696126 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4dc037040 con 0x7ff4ec106310 2024-09-12T12:16:59.732 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:54.845+0000 7ff4f2173640 1 -- 172.21.15.33:0/3494696126 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4ec1a0aa0 con 0x7ff4ec106310 2024-09-12T12:16:59.732 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:54.846+0000 7ff4e8ff9640 1 -- 172.21.15.33:0/3494696126 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7ff4dc045070 con 0x7ff4ec106310 2024-09-12T12:16:59.732 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:54.846+0000 7ff4e8ff9640 1 --2- 172.21.15.33:0/3494696126 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7ff4d4039020 0x7ff4d403b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:59.732 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:54.846+0000 7ff4e8ff9640 1 -- 172.21.15.33:0/3494696126 --> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff4d403bbf0 con 0x7ff4d4039020 2024-09-12T12:16:59.732 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:54.846+0000 7ff4e8ff9640 1 -- 172.21.15.33:0/3494696126 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff4dc06c240 con 0x7ff4ec106310 2024-09-12T12:16:59.732 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:54.846+0000 7ff4eaffd640 1 -- 172.21.15.33:0/3494696126 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7ff4d4039020 msgr2=0x7ff4d403b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/1381479235 2024-09-12T12:16:59.732 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:54.846+0000 7ff4eaffd640 1 --2- 172.21.15.33:0/3494696126 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7ff4d4039020 0x7ff4d403b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T12:16:59.732 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:55.047+0000 7ff4eaffd640 1 -- 172.21.15.33:0/3494696126 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7ff4d4039020 msgr2=0x7ff4d403b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/1381479235 2024-09-12T12:16:59.733 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:55.047+0000 7ff4eaffd640 1 --2- 172.21.15.33:0/3494696126 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7ff4d4039020 0x7ff4d403b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T12:16:59.733 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:55.448+0000 7ff4eaffd640 1 -- 172.21.15.33:0/3494696126 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7ff4d4039020 msgr2=0x7ff4d403b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/1381479235 2024-09-12T12:16:59.733 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:55.448+0000 7ff4eaffd640 1 --2- 172.21.15.33:0/3494696126 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7ff4d4039020 0x7ff4d403b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T12:16:59.733 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:56.249+0000 7ff4eaffd640 1 -- 172.21.15.33:0/3494696126 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7ff4d4039020 msgr2=0x7ff4d403b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/1381479235 2024-09-12T12:16:59.733 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:56.249+0000 7ff4eaffd640 1 --2- 172.21.15.33:0/3494696126 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7ff4d4039020 0x7ff4d403b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T12:16:59.733 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:57.793+0000 7ff4e8ff9640 1 -- 172.21.15.33:0/3494696126 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mgrmap(e 10) ==== 46067+0+0 (secure 0 0 0) 0x7ff4dc06acf0 con 0x7ff4ec106310 2024-09-12T12:16:59.733 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:57.793+0000 7ff4e8ff9640 1 -- 172.21.15.33:0/3494696126 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7ff4d4039020 msgr2=0x7ff4d403b4e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T12:16:59.733 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:57.793+0000 7ff4e8ff9640 1 --2- 172.21.15.33:0/3494696126 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7ff4d4039020 0x7ff4d403b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:59.733 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:58.794+0000 7ff4e8ff9640 1 -- 172.21.15.33:0/3494696126 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7ff4dc03c660 con 0x7ff4ec106310 2024-09-12T12:16:59.733 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:58.795+0000 7ff4e8ff9640 1 --2- 172.21.15.33:0/3494696126 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff4d403cae0 0x7ff4d403eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:59.733 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:58.795+0000 7ff4e8ff9640 1 -- 172.21.15.33:0/3494696126 --> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff4dc037e50 con 0x7ff4d403cae0 2024-09-12T12:16:59.733 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:58.795+0000 7ff4eaffd640 1 --2- 172.21.15.33:0/3494696126 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff4d403cae0 0x7ff4d403eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:59.733 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:58.796+0000 7ff4eaffd640 1 --2- 172.21.15.33:0/3494696126 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff4d403cae0 0x7ff4d403eed0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0003980 tx=0x7ff4e00092b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:59.734 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:58.796+0000 7ff4e8ff9640 1 -- 172.21.15.33:0/3494696126 <== mgr.14150 v2:172.21.15.33:6800/176202431 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7ff4dc037e50 con 0x7ff4d403cae0 2024-09-12T12:16:59.734 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:58.803+0000 7ff4f2173640 1 -- 172.21.15.33:0/3494696126 --> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7ff4ec10aa40 con 0x7ff4d403cae0 2024-09-12T12:16:59.734 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:58.804+0000 7ff4e8ff9640 1 -- 172.21.15.33:0/3494696126 <== mgr.14150 v2:172.21.15.33:6800/176202431 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7ff4ec10aa40 con 0x7ff4d403cae0 2024-09-12T12:16:59.734 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:58.804+0000 7ff4f2173640 1 -- 172.21.15.33:0/3494696126 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff4d403cae0 msgr2=0x7ff4d403eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:59.734 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:58.804+0000 7ff4f2173640 1 --2- 172.21.15.33:0/3494696126 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff4d403cae0 0x7ff4d403eed0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0003980 tx=0x7ff4e00092b0 comp rx=0 tx=0).stop 2024-09-12T12:16:59.734 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:58.804+0000 7ff4f2173640 1 -- 172.21.15.33:0/3494696126 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4ec106310 msgr2=0x7ff4ec19d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:59.734 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:58.804+0000 7ff4f2173640 1 --2- 172.21.15.33:0/3494696126 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4ec106310 0x7ff4ec19d5e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc0097f0 tx=0x7ff4dc030c70 comp rx=0 tx=0).stop 2024-09-12T12:16:59.734 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:58.804+0000 7ff4f2173640 1 -- 172.21.15.33:0/3494696126 shutdown_connections 2024-09-12T12:16:59.734 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:58.804+0000 7ff4f2173640 1 --2- 172.21.15.33:0/3494696126 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff4d403cae0 0x7ff4d403eed0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:59.734 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:58.804+0000 7ff4f2173640 1 --2- 172.21.15.33:0/3494696126 >> [v2:172.21.15.33:6800/1381479235,v1:172.21.15.33:6801/1381479235] conn(0x7ff4d4039020 0x7ff4d403b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:59.734 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:58.804+0000 7ff4f2173640 1 --2- 172.21.15.33:0/3494696126 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4ec106310 0x7ff4ec19d5e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:59.734 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:58.804+0000 7ff4f2173640 1 -- 172.21.15.33:0/3494696126 >> 172.21.15.33:0/3494696126 conn(0x7ff4ec101ac0 msgr2=0x7ff4ec102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:59.734 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:58.804+0000 7ff4f2173640 1 -- 172.21.15.33:0/3494696126 shutdown_connections 2024-09-12T12:16:59.734 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:16:58.804+0000 7ff4f2173640 1 -- 172.21.15.33:0/3494696126 wait complete. 2024-09-12T12:16:59.735 INFO:teuthology.orchestra.run.smithi033.stdout:mgr epoch 9 is available 2024-09-12T12:16:59.735 INFO:teuthology.orchestra.run.smithi033.stdout:Generating a dashboard self-signed certificate... 2024-09-12T12:16:59.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:59 smithi033 ceph-mon[31246]: mgrmap e11: x(active, since 1.00599s) 2024-09-12T12:16:59.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:59 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:16:59.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:59 smithi033 ceph-mon[31246]: [12/Sep/2024:12:16:59] ENGINE Bus STARTING 2024-09-12T12:16:59.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:59 smithi033 ceph-mon[31246]: [12/Sep/2024:12:16:59] ENGINE Serving on https://172.21.15.33:7150 2024-09-12T12:16:59.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:59 smithi033 ceph-mon[31246]: [12/Sep/2024:12:16:59] ENGINE Error in HTTPServer.serve 2024-09-12T12:16:59.981 INFO:journalctl@ceph.mon.a.smithi033.stdout: Traceback (most recent call last): 2024-09-12T12:16:59.981 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T12:16:59.981 INFO:journalctl@ceph.mon.a.smithi033.stdout: self._connections.run(self.expiration_interval) 2024-09-12T12:16:59.981 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T12:16:59.981 INFO:journalctl@ceph.mon.a.smithi033.stdout: self._run(expiration_interval) 2024-09-12T12:16:59.981 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T12:16:59.982 INFO:journalctl@ceph.mon.a.smithi033.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T12:16:59.982 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T12:16:59.982 INFO:journalctl@ceph.mon.a.smithi033.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T12:16:59.982 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T12:16:59.982 INFO:journalctl@ceph.mon.a.smithi033.stdout: s = self.context.wrap_socket( 2024-09-12T12:16:59.982 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T12:16:59.982 INFO:journalctl@ceph.mon.a.smithi033.stdout: return self.sslsocket_class._create( 2024-09-12T12:16:59.982 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T12:16:59.982 INFO:journalctl@ceph.mon.a.smithi033.stdout: self.do_handshake() 2024-09-12T12:16:59.982 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T12:16:59.982 INFO:journalctl@ceph.mon.a.smithi033.stdout: self._sslobj.do_handshake() 2024-09-12T12:16:59.982 INFO:journalctl@ceph.mon.a.smithi033.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T12:16:59.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:59 smithi033 ceph-mon[31246]: [12/Sep/2024:12:16:59] ENGINE Serving on http://172.21.15.33:8765 2024-09-12T12:16:59.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:16:59 smithi033 ceph-mon[31246]: [12/Sep/2024:12:16:59] ENGINE Bus STARTED 2024-09-12T12:17:00.916 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-12T12:17:00.916 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.111+0000 7f23e3c52640 1 Processor -- start 2024-09-12T12:17:00.916 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.112+0000 7f23e3c52640 1 -- start start 2024-09-12T12:17:00.916 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.112+0000 7f23e3c52640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23dc105060 0x7f23dc105440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:00.916 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.112+0000 7f23e3c52640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f23dc105a10 con 0x7f23dc105060 2024-09-12T12:17:00.916 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.112+0000 7f23e19ee640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23dc105060 0x7f23dc105440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:00.916 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.112+0000 7f23e19ee640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23dc105060 0x7f23dc105440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55728/0 (socket says 172.21.15.33:55728) 2024-09-12T12:17:00.916 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.112+0000 7f23e19ee640 1 -- 172.21.15.33:0/337909479 learned_addr learned my addr 172.21.15.33:0/337909479 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:17:00.916 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.113+0000 7f23e19ee640 1 -- 172.21.15.33:0/337909479 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23dc105b90 con 0x7f23dc105060 2024-09-12T12:17:00.917 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.113+0000 7f23e19ee640 1 --2- 172.21.15.33:0/337909479 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23dc105060 0x7f23dc105440 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f23d8009e80 tx=0x7f23d802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba833a6810d4e691 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:00.917 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.113+0000 7f23e09ec640 1 -- 172.21.15.33:0/337909479 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23d8036070 con 0x7f23dc105060 2024-09-12T12:17:00.917 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.114+0000 7f23e09ec640 1 -- 172.21.15.33:0/337909479 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f23d80318b0 con 0x7f23dc105060 2024-09-12T12:17:00.917 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.114+0000 7f23e09ec640 1 -- 172.21.15.33:0/337909479 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23d8007930 con 0x7f23dc105060 2024-09-12T12:17:00.917 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.114+0000 7f23e3c52640 1 -- 172.21.15.33:0/337909479 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23dc105060 msgr2=0x7f23dc105440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:00.917 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.114+0000 7f23e3c52640 1 --2- 172.21.15.33:0/337909479 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23dc105060 0x7f23dc105440 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f23d8009e80 tx=0x7f23d802a7a0 comp rx=0 tx=0).stop 2024-09-12T12:17:00.917 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.114+0000 7f23e3c52640 1 -- 172.21.15.33:0/337909479 shutdown_connections 2024-09-12T12:17:00.917 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.114+0000 7f23e3c52640 1 --2- 172.21.15.33:0/337909479 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23dc105060 0x7f23dc105440 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:00.917 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.114+0000 7f23e3c52640 1 -- 172.21.15.33:0/337909479 >> 172.21.15.33:0/337909479 conn(0x7f23dc100dc0 msgr2=0x7f23dc103220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:00.917 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.114+0000 7f23e3c52640 1 -- 172.21.15.33:0/337909479 shutdown_connections 2024-09-12T12:17:00.917 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.114+0000 7f23e3c52640 1 -- 172.21.15.33:0/337909479 wait complete. 2024-09-12T12:17:00.917 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.115+0000 7f23e3c52640 1 Processor -- start 2024-09-12T12:17:00.918 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.115+0000 7f23e3c52640 1 -- start start 2024-09-12T12:17:00.918 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.115+0000 7f23e3c52640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23dc105060 0x7f23dc19d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:00.918 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.115+0000 7f23e3c52640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f23dc10b800 con 0x7f23dc105060 2024-09-12T12:17:00.918 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.115+0000 7f23e19ee640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23dc105060 0x7f23dc19d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:00.918 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.115+0000 7f23e19ee640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23dc105060 0x7f23dc19d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55738/0 (socket says 172.21.15.33:55738) 2024-09-12T12:17:00.918 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.115+0000 7f23e19ee640 1 -- 172.21.15.33:0/351057941 learned_addr learned my addr 172.21.15.33:0/351057941 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:17:00.918 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.115+0000 7f23e19ee640 1 -- 172.21.15.33:0/351057941 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23dc19db10 con 0x7f23dc105060 2024-09-12T12:17:00.918 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.116+0000 7f23e19ee640 1 --2- 172.21.15.33:0/351057941 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23dc105060 0x7f23dc19d5d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f23d8007b60 tx=0x7f23d8031c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:00.918 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.116+0000 7f23ceffd640 1 -- 172.21.15.33:0/351057941 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23d8036050 con 0x7f23dc105060 2024-09-12T12:17:00.918 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.116+0000 7f23ceffd640 1 -- 172.21.15.33:0/351057941 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f23d8042070 con 0x7f23dc105060 2024-09-12T12:17:00.918 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.116+0000 7f23e3c52640 1 -- 172.21.15.33:0/351057941 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23dc19dda0 con 0x7f23dc105060 2024-09-12T12:17:00.918 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.116+0000 7f23ceffd640 1 -- 172.21.15.33:0/351057941 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23d803da30 con 0x7f23dc105060 2024-09-12T12:17:00.918 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.116+0000 7f23e3c52640 1 -- 172.21.15.33:0/351057941 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23dc1a0a90 con 0x7f23dc105060 2024-09-12T12:17:00.919 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.117+0000 7f23ceffd640 1 -- 172.21.15.33:0/351057941 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7f23d803dce0 con 0x7f23dc105060 2024-09-12T12:17:00.919 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.117+0000 7f23e3c52640 1 -- 172.21.15.33:0/351057941 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23dc1054c0 con 0x7f23dc105060 2024-09-12T12:17:00.919 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.117+0000 7f23ceffd640 1 --2- 172.21.15.33:0/351057941 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f23c8038f00 0x7f23c803b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:00.919 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.117+0000 7f23ceffd640 1 -- 172.21.15.33:0/351057941 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f23d806d640 con 0x7f23dc105060 2024-09-12T12:17:00.919 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.117+0000 7f23e11ed640 1 --2- 172.21.15.33:0/351057941 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f23c8038f00 0x7f23c803b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:00.919 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.118+0000 7f23e11ed640 1 --2- 172.21.15.33:0/351057941 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f23c8038f00 0x7f23c803b3c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f23d00098c0 tx=0x7f23d0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:00.919 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.122+0000 7f23ceffd640 1 -- 172.21.15.33:0/351057941 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f23d8039d00 con 0x7f23dc105060 2024-09-12T12:17:00.919 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.132+0000 7f23ceffd640 1 -- 172.21.15.33:0/351057941 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f23d803b610 con 0x7f23dc105060 2024-09-12T12:17:00.919 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.320+0000 7f23e3c52640 1 -- 172.21.15.33:0/351057941 --> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f23dc102010 con 0x7f23c8038f00 2024-09-12T12:17:00.919 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.402+0000 7f23ceffd640 1 -- 172.21.15.33:0/351057941 <== mgr.14150 v2:172.21.15.33:6800/176202431 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f23dc102010 con 0x7f23c8038f00 2024-09-12T12:17:00.919 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.405+0000 7f23e3c52640 1 -- 172.21.15.33:0/351057941 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f23c8038f00 msgr2=0x7f23c803b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:00.919 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.405+0000 7f23e3c52640 1 --2- 172.21.15.33:0/351057941 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f23c8038f00 0x7f23c803b3c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f23d00098c0 tx=0x7f23d0006db0 comp rx=0 tx=0).stop 2024-09-12T12:17:00.919 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.405+0000 7f23e3c52640 1 -- 172.21.15.33:0/351057941 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23dc105060 msgr2=0x7f23dc19d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:00.919 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.405+0000 7f23e3c52640 1 --2- 172.21.15.33:0/351057941 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23dc105060 0x7f23dc19d5d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f23d8007b60 tx=0x7f23d8031c90 comp rx=0 tx=0).stop 2024-09-12T12:17:00.920 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.405+0000 7f23e3c52640 1 -- 172.21.15.33:0/351057941 shutdown_connections 2024-09-12T12:17:00.920 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.405+0000 7f23e3c52640 1 --2- 172.21.15.33:0/351057941 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f23c8038f00 0x7f23c803b3c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:00.920 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.405+0000 7f23e3c52640 1 --2- 172.21.15.33:0/351057941 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23dc105060 0x7f23dc19d5d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:00.920 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.405+0000 7f23e3c52640 1 -- 172.21.15.33:0/351057941 >> 172.21.15.33:0/351057941 conn(0x7f23dc100dc0 msgr2=0x7f23dc101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:00.920 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.405+0000 7f23e3c52640 1 -- 172.21.15.33:0/351057941 shutdown_connections 2024-09-12T12:17:00.920 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:00.405+0000 7f23e3c52640 1 -- 172.21.15.33:0/351057941 wait complete. 2024-09-12T12:17:00.920 INFO:teuthology.orchestra.run.smithi033.stdout:Creating initial admin user... 2024-09-12T12:17:01.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:01 smithi033 ceph-mon[31246]: mgrmap e12: x(active, since 2s) 2024-09-12T12:17:01.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:01 smithi033 ceph-mon[31246]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:17:01.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:01 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:01.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:01 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:02.406 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$FYg7xlM4q2tVIrC4Eq05NOD/y4nTxK0kfoVtWz7p103bQwstdwf5y", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726143421, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-12T12:17:02.407 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.303+0000 7ff087416640 1 Processor -- start 2024-09-12T12:17:02.407 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.303+0000 7ff087416640 1 -- start start 2024-09-12T12:17:02.407 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.303+0000 7ff087416640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff080107420 0x7ff080107820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:02.407 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.303+0000 7ff087416640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff080107df0 con 0x7ff080107420 2024-09-12T12:17:02.407 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.304+0000 7ff0851b2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff080107420 0x7ff080107820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:02.407 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.304+0000 7ff0851b2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff080107420 0x7ff080107820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44928/0 (socket says 172.21.15.33:44928) 2024-09-12T12:17:02.407 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.304+0000 7ff0851b2640 1 -- 172.21.15.33:0/2578117403 learned_addr learned my addr 172.21.15.33:0/2578117403 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:17:02.407 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.304+0000 7ff0851b2640 1 -- 172.21.15.33:0/2578117403 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff080108620 con 0x7ff080107420 2024-09-12T12:17:02.407 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.304+0000 7ff0851b2640 1 --2- 172.21.15.33:0/2578117403 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff080107420 0x7ff080107820 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff07c009820 tx=0x7ff07c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e70dbdb65210b7bf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:02.407 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.305+0000 7ff077fff640 1 -- 172.21.15.33:0/2578117403 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff07c037070 con 0x7ff080107420 2024-09-12T12:17:02.407 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.305+0000 7ff077fff640 1 -- 172.21.15.33:0/2578117403 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff07c0328f0 con 0x7ff080107420 2024-09-12T12:17:02.408 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.305+0000 7ff077fff640 1 -- 172.21.15.33:0/2578117403 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff07c030740 con 0x7ff080107420 2024-09-12T12:17:02.408 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.305+0000 7ff087416640 1 -- 172.21.15.33:0/2578117403 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff080107420 msgr2=0x7ff080107820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:02.408 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.305+0000 7ff087416640 1 --2- 172.21.15.33:0/2578117403 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff080107420 0x7ff080107820 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff07c009820 tx=0x7ff07c02a270 comp rx=0 tx=0).stop 2024-09-12T12:17:02.408 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.305+0000 7ff087416640 1 -- 172.21.15.33:0/2578117403 shutdown_connections 2024-09-12T12:17:02.408 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.305+0000 7ff087416640 1 --2- 172.21.15.33:0/2578117403 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff080107420 0x7ff080107820 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:02.408 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.305+0000 7ff087416640 1 -- 172.21.15.33:0/2578117403 >> 172.21.15.33:0/2578117403 conn(0x7ff080102bb0 msgr2=0x7ff080104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:02.408 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.305+0000 7ff087416640 1 -- 172.21.15.33:0/2578117403 shutdown_connections 2024-09-12T12:17:02.408 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.305+0000 7ff087416640 1 -- 172.21.15.33:0/2578117403 wait complete. 2024-09-12T12:17:02.408 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.306+0000 7ff087416640 1 Processor -- start 2024-09-12T12:17:02.408 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.306+0000 7ff087416640 1 -- start start 2024-09-12T12:17:02.408 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.306+0000 7ff087416640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff080107420 0x7ff08019b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:02.408 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.306+0000 7ff087416640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff08010b9d0 con 0x7ff080107420 2024-09-12T12:17:02.408 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.306+0000 7ff0851b2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff080107420 0x7ff08019b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:02.409 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.306+0000 7ff0851b2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff080107420 0x7ff08019b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44938/0 (socket says 172.21.15.33:44938) 2024-09-12T12:17:02.409 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.306+0000 7ff0851b2640 1 -- 172.21.15.33:0/3519250632 learned_addr learned my addr 172.21.15.33:0/3519250632 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:17:02.409 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.306+0000 7ff0851b2640 1 -- 172.21.15.33:0/3519250632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff08019b900 con 0x7ff080107420 2024-09-12T12:17:02.409 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.307+0000 7ff0851b2640 1 --2- 172.21.15.33:0/3519250632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff080107420 0x7ff08019b3c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff07c009940 tx=0x7ff07c030cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:02.409 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.307+0000 7ff0767fc640 1 -- 172.21.15.33:0/3519250632 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff07c042070 con 0x7ff080107420 2024-09-12T12:17:02.409 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.307+0000 7ff0767fc640 1 -- 172.21.15.33:0/3519250632 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff07c030e30 con 0x7ff080107420 2024-09-12T12:17:02.409 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.307+0000 7ff087416640 1 -- 172.21.15.33:0/3519250632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff08019bb90 con 0x7ff080107420 2024-09-12T12:17:02.409 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.307+0000 7ff0767fc640 1 -- 172.21.15.33:0/3519250632 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff07c037040 con 0x7ff080107420 2024-09-12T12:17:02.409 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.307+0000 7ff087416640 1 -- 172.21.15.33:0/3519250632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff08019e880 con 0x7ff080107420 2024-09-12T12:17:02.409 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.308+0000 7ff0767fc640 1 -- 172.21.15.33:0/3519250632 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7ff07c045070 con 0x7ff080107420 2024-09-12T12:17:02.409 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.308+0000 7ff0767fc640 1 --2- 172.21.15.33:0/3519250632 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff06c038fc0 0x7ff06c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:02.409 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.308+0000 7ff0767fc640 1 -- 172.21.15.33:0/3519250632 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff07c06c1b0 con 0x7ff080107420 2024-09-12T12:17:02.410 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.308+0000 7ff0849b1640 1 --2- 172.21.15.33:0/3519250632 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff06c038fc0 0x7ff06c03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:02.410 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.308+0000 7ff087416640 1 -- 172.21.15.33:0/3519250632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff08010bb50 con 0x7ff080107420 2024-09-12T12:17:02.410 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.308+0000 7ff0849b1640 1 --2- 172.21.15.33:0/3519250632 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff06c038fc0 0x7ff06c03b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff0700098c0 tx=0x7ff070006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:02.410 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.313+0000 7ff0767fc640 1 -- 172.21.15.33:0/3519250632 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff07c045360 con 0x7ff080107420 2024-09-12T12:17:02.410 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.505+0000 7ff087416640 1 -- 172.21.15.33:0/3519250632 --> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7ff08019eb10 con 0x7ff06c038fc0 2024-09-12T12:17:02.410 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.755+0000 7ff0767fc640 1 -- 172.21.15.33:0/3519250632 <== mgr.14150 v2:172.21.15.33:6800/176202431 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7ff08019eb10 con 0x7ff06c038fc0 2024-09-12T12:17:02.410 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.757+0000 7ff087416640 1 -- 172.21.15.33:0/3519250632 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff06c038fc0 msgr2=0x7ff06c03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:02.410 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.757+0000 7ff087416640 1 --2- 172.21.15.33:0/3519250632 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff06c038fc0 0x7ff06c03b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff0700098c0 tx=0x7ff070006db0 comp rx=0 tx=0).stop 2024-09-12T12:17:02.410 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.757+0000 7ff087416640 1 -- 172.21.15.33:0/3519250632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff080107420 msgr2=0x7ff08019b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:02.410 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.757+0000 7ff087416640 1 --2- 172.21.15.33:0/3519250632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff080107420 0x7ff08019b3c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff07c009940 tx=0x7ff07c030cc0 comp rx=0 tx=0).stop 2024-09-12T12:17:02.410 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.757+0000 7ff087416640 1 -- 172.21.15.33:0/3519250632 shutdown_connections 2024-09-12T12:17:02.410 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.757+0000 7ff087416640 1 --2- 172.21.15.33:0/3519250632 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff06c038fc0 0x7ff06c03b480 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:02.411 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.757+0000 7ff087416640 1 --2- 172.21.15.33:0/3519250632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff080107420 0x7ff08019b3c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:02.411 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.757+0000 7ff087416640 1 -- 172.21.15.33:0/3519250632 >> 172.21.15.33:0/3519250632 conn(0x7ff080102bb0 msgr2=0x7ff080103720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:02.411 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.757+0000 7ff087416640 1 -- 172.21.15.33:0/3519250632 shutdown_connections 2024-09-12T12:17:02.411 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:01.757+0000 7ff087416640 1 -- 172.21.15.33:0/3519250632 wait complete. 2024-09-12T12:17:02.411 INFO:teuthology.orchestra.run.smithi033.stdout:Fetching dashboard port number... 2024-09-12T12:17:02.730 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:02 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:02.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:02 smithi033 ceph-mon[31246]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:17:02.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:02 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:03.640 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:03 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/3318285621' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-12T12:17:03.649 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 8443 2024-09-12T12:17:03.649 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:02.848+0000 7f2c4dc13640 1 Processor -- start 2024-09-12T12:17:03.649 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:02.848+0000 7f2c4dc13640 1 -- start start 2024-09-12T12:17:03.649 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:02.849+0000 7f2c4dc13640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c48106320 0x7f2c48106720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:03.649 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:02.849+0000 7f2c4dc13640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2c48106cf0 con 0x7f2c48106320 2024-09-12T12:17:03.649 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:02.849+0000 7f2c477fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c48106320 0x7f2c48106720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:03.649 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:02.849+0000 7f2c477fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c48106320 0x7f2c48106720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44950/0 (socket says 172.21.15.33:44950) 2024-09-12T12:17:03.649 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:02.849+0000 7f2c477fe640 1 -- 172.21.15.33:0/1972444741 learned_addr learned my addr 172.21.15.33:0/1972444741 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:17:03.649 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:02.849+0000 7f2c477fe640 1 -- 172.21.15.33:0/1972444741 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c48107520 con 0x7f2c48106320 2024-09-12T12:17:03.649 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:02.850+0000 7f2c477fe640 1 --2- 172.21.15.33:0/1972444741 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c48106320 0x7f2c48106720 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2c38009820 tx=0x7f2c3802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4526793d2d2a9029 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:03.650 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:02.850+0000 7f2c467fc640 1 -- 172.21.15.33:0/1972444741 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c38037070 con 0x7f2c48106320 2024-09-12T12:17:03.650 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:02.850+0000 7f2c467fc640 1 -- 172.21.15.33:0/1972444741 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2c380328f0 con 0x7f2c48106320 2024-09-12T12:17:03.650 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:02.850+0000 7f2c467fc640 1 -- 172.21.15.33:0/1972444741 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c38030740 con 0x7f2c48106320 2024-09-12T12:17:03.650 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:02.851+0000 7f2c4dc13640 1 -- 172.21.15.33:0/1972444741 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c48106320 msgr2=0x7f2c48106720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:03.650 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:02.851+0000 7f2c4dc13640 1 --2- 172.21.15.33:0/1972444741 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c48106320 0x7f2c48106720 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2c38009820 tx=0x7f2c3802a270 comp rx=0 tx=0).stop 2024-09-12T12:17:03.650 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:02.851+0000 7f2c4dc13640 1 -- 172.21.15.33:0/1972444741 shutdown_connections 2024-09-12T12:17:03.650 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:02.851+0000 7f2c4dc13640 1 --2- 172.21.15.33:0/1972444741 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c48106320 0x7f2c48106720 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:03.650 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:02.851+0000 7f2c4dc13640 1 -- 172.21.15.33:0/1972444741 >> 172.21.15.33:0/1972444741 conn(0x7f2c48101a90 msgr2=0x7f2c48103ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:03.650 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:02.851+0000 7f2c4dc13640 1 -- 172.21.15.33:0/1972444741 shutdown_connections 2024-09-12T12:17:03.650 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:02.851+0000 7f2c4dc13640 1 -- 172.21.15.33:0/1972444741 wait complete. 2024-09-12T12:17:03.650 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:02.851+0000 7f2c4dc13640 1 Processor -- start 2024-09-12T12:17:03.650 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:02.852+0000 7f2c4dc13640 1 -- start start 2024-09-12T12:17:03.650 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:02.852+0000 7f2c4dc13640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c48106320 0x7f2c4819b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:03.651 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:02.852+0000 7f2c4dc13640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4810a8d0 con 0x7f2c48106320 2024-09-12T12:17:03.651 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:02.852+0000 7f2c477fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c48106320 0x7f2c4819b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:03.651 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:02.852+0000 7f2c477fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c48106320 0x7f2c4819b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44956/0 (socket says 172.21.15.33:44956) 2024-09-12T12:17:03.651 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:02.852+0000 7f2c477fe640 1 -- 172.21.15.33:0/3318285621 learned_addr learned my addr 172.21.15.33:0/3318285621 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:17:03.651 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:02.852+0000 7f2c477fe640 1 -- 172.21.15.33:0/3318285621 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c4819b940 con 0x7f2c48106320 2024-09-12T12:17:03.651 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:02.852+0000 7f2c477fe640 1 --2- 172.21.15.33:0/3318285621 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c48106320 0x7f2c4819b400 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2c380097f0 tx=0x7f2c38030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:03.651 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:02.853+0000 7f2c44ff9640 1 -- 172.21.15.33:0/3318285621 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c38042070 con 0x7f2c48106320 2024-09-12T12:17:03.651 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:02.853+0000 7f2c44ff9640 1 -- 172.21.15.33:0/3318285621 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2c38030d80 con 0x7f2c48106320 2024-09-12T12:17:03.651 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:02.853+0000 7f2c4dc13640 1 -- 172.21.15.33:0/3318285621 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c4819bbd0 con 0x7f2c48106320 2024-09-12T12:17:03.651 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:02.853+0000 7f2c44ff9640 1 -- 172.21.15.33:0/3318285621 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c38037040 con 0x7f2c48106320 2024-09-12T12:17:03.651 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:02.853+0000 7f2c4dc13640 1 -- 172.21.15.33:0/3318285621 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c4819e8c0 con 0x7f2c48106320 2024-09-12T12:17:03.651 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:02.854+0000 7f2c44ff9640 1 -- 172.21.15.33:0/3318285621 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f2c38045070 con 0x7f2c48106320 2024-09-12T12:17:03.651 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:02.854+0000 7f2c4dc13640 1 -- 172.21.15.33:0/3318285621 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c4810aa50 con 0x7f2c48106320 2024-09-12T12:17:03.652 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:02.854+0000 7f2c44ff9640 1 --2- 172.21.15.33:0/3318285621 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2c30039020 0x7f2c3003b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:03.652 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:02.854+0000 7f2c44ff9640 1 -- 172.21.15.33:0/3318285621 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f2c3806c260 con 0x7f2c48106320 2024-09-12T12:17:03.652 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:02.854+0000 7f2c46ffd640 1 --2- 172.21.15.33:0/3318285621 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2c30039020 0x7f2c3003b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:03.652 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:02.855+0000 7f2c46ffd640 1 --2- 172.21.15.33:0/3318285621 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2c30039020 0x7f2c3003b4e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c0098c0 tx=0x7f2c3c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:03.652 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:02.859+0000 7f2c44ff9640 1 -- 172.21.15.33:0/3318285621 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2c3803ac60 con 0x7f2c48106320 2024-09-12T12:17:03.652 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:03.038+0000 7f2c4dc13640 1 -- 172.21.15.33:0/3318285621 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f2c4802d9b0 con 0x7f2c48106320 2024-09-12T12:17:03.652 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:03.039+0000 7f2c44ff9640 1 -- 172.21.15.33:0/3318285621 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f2c3803b330 con 0x7f2c48106320 2024-09-12T12:17:03.652 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:03.041+0000 7f2c4dc13640 1 -- 172.21.15.33:0/3318285621 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2c30039020 msgr2=0x7f2c3003b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:03.652 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:03.041+0000 7f2c4dc13640 1 --2- 172.21.15.33:0/3318285621 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2c30039020 0x7f2c3003b4e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c0098c0 tx=0x7f2c3c006db0 comp rx=0 tx=0).stop 2024-09-12T12:17:03.652 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:03.041+0000 7f2c4dc13640 1 -- 172.21.15.33:0/3318285621 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c48106320 msgr2=0x7f2c4819b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:03.652 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:03.041+0000 7f2c4dc13640 1 --2- 172.21.15.33:0/3318285621 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c48106320 0x7f2c4819b400 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2c380097f0 tx=0x7f2c38030c70 comp rx=0 tx=0).stop 2024-09-12T12:17:03.652 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:03.041+0000 7f2c4dc13640 1 -- 172.21.15.33:0/3318285621 shutdown_connections 2024-09-12T12:17:03.653 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:03.041+0000 7f2c4dc13640 1 --2- 172.21.15.33:0/3318285621 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2c30039020 0x7f2c3003b4e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:03.653 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:03.041+0000 7f2c4dc13640 1 --2- 172.21.15.33:0/3318285621 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c48106320 0x7f2c4819b400 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:03.653 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:03.041+0000 7f2c4dc13640 1 -- 172.21.15.33:0/3318285621 >> 172.21.15.33:0/3318285621 conn(0x7f2c48101a90 msgr2=0x7f2c48102960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:03.653 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:03.042+0000 7f2c4dc13640 1 -- 172.21.15.33:0/3318285621 shutdown_connections 2024-09-12T12:17:03.653 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:03.042+0000 7f2c4dc13640 1 -- 172.21.15.33:0/3318285621 wait complete. 2024-09-12T12:17:03.656 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T12:17:03.656 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout disabled 2024-09-12T12:17:03.663 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T12:17:03.663 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout inactive 2024-09-12T12:17:03.664 INFO:teuthology.orchestra.run.smithi033.stdout:firewalld.service is not enabled 2024-09-12T12:17:03.664 INFO:teuthology.orchestra.run.smithi033.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-12T12:17:03.665 INFO:teuthology.orchestra.run.smithi033.stdout:Ceph Dashboard is now available at: 2024-09-12T12:17:03.665 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:17:03.666 INFO:teuthology.orchestra.run.smithi033.stdout: URL: https://smithi033.front.sepia.ceph.com:8443/ 2024-09-12T12:17:03.666 INFO:teuthology.orchestra.run.smithi033.stdout: User: admin 2024-09-12T12:17:03.666 INFO:teuthology.orchestra.run.smithi033.stdout: Password: 796l3r7qfm 2024-09-12T12:17:03.666 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:17:03.666 INFO:teuthology.orchestra.run.smithi033.stdout:Saving cluster configuration to /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/config directory 2024-09-12T12:17:05.426 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.419+0000 7f8436d19640 1 Processor -- start 2024-09-12T12:17:05.426 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.419+0000 7f8436d19640 1 -- start start 2024-09-12T12:17:05.426 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.419+0000 7f8436d19640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8430107420 0x7f8430107820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:05.426 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.419+0000 7f8436d19640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8430107df0 con 0x7f8430107420 2024-09-12T12:17:05.426 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.419+0000 7f8434ab5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8430107420 0x7f8430107820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:05.426 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.419+0000 7f8434ab5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8430107420 0x7f8430107820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44968/0 (socket says 172.21.15.33:44968) 2024-09-12T12:17:05.426 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.419+0000 7f8434ab5640 1 -- 172.21.15.33:0/2322387958 learned_addr learned my addr 172.21.15.33:0/2322387958 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:17:05.426 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.419+0000 7f8434ab5640 1 -- 172.21.15.33:0/2322387958 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8430108620 con 0x7f8430107420 2024-09-12T12:17:05.426 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.420+0000 7f8434ab5640 1 --2- 172.21.15.33:0/2322387958 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8430107420 0x7f8430107820 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f842c009820 tx=0x7f842c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc1b7e021170d46e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:05.426 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.420+0000 7f84277fe640 1 -- 172.21.15.33:0/2322387958 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f842c037070 con 0x7f8430107420 2024-09-12T12:17:05.427 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.420+0000 7f84277fe640 1 -- 172.21.15.33:0/2322387958 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f842c0328f0 con 0x7f8430107420 2024-09-12T12:17:05.427 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.420+0000 7f84277fe640 1 -- 172.21.15.33:0/2322387958 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f842c030740 con 0x7f8430107420 2024-09-12T12:17:05.427 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.421+0000 7f8436d19640 1 -- 172.21.15.33:0/2322387958 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8430107420 msgr2=0x7f8430107820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:05.427 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.421+0000 7f8436d19640 1 --2- 172.21.15.33:0/2322387958 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8430107420 0x7f8430107820 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f842c009820 tx=0x7f842c02a270 comp rx=0 tx=0).stop 2024-09-12T12:17:05.427 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.421+0000 7f8436d19640 1 -- 172.21.15.33:0/2322387958 shutdown_connections 2024-09-12T12:17:05.427 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.421+0000 7f8436d19640 1 --2- 172.21.15.33:0/2322387958 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8430107420 0x7f8430107820 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.427 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.421+0000 7f8436d19640 1 -- 172.21.15.33:0/2322387958 >> 172.21.15.33:0/2322387958 conn(0x7f8430102bb0 msgr2=0x7f8430104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:05.427 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.421+0000 7f8436d19640 1 -- 172.21.15.33:0/2322387958 shutdown_connections 2024-09-12T12:17:05.427 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.421+0000 7f8436d19640 1 -- 172.21.15.33:0/2322387958 wait complete. 2024-09-12T12:17:05.427 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.422+0000 7f8436d19640 1 Processor -- start 2024-09-12T12:17:05.427 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.422+0000 7f8436d19640 1 -- start start 2024-09-12T12:17:05.427 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.422+0000 7f8436d19640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8430107420 0x7f843019b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:05.428 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.422+0000 7f8436d19640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f843010b9d0 con 0x7f8430107420 2024-09-12T12:17:05.428 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.422+0000 7f8434ab5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8430107420 0x7f843019b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:05.428 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.422+0000 7f8434ab5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8430107420 0x7f843019b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44982/0 (socket says 172.21.15.33:44982) 2024-09-12T12:17:05.428 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.422+0000 7f8434ab5640 1 -- 172.21.15.33:0/3721209838 learned_addr learned my addr 172.21.15.33:0/3721209838 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:17:05.428 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.422+0000 7f8434ab5640 1 -- 172.21.15.33:0/3721209838 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f843019b920 con 0x7f8430107420 2024-09-12T12:17:05.428 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.422+0000 7f8434ab5640 1 --2- 172.21.15.33:0/3721209838 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8430107420 0x7f843019b3e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f842c009940 tx=0x7f842c030cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:05.428 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.422+0000 7f8425ffb640 1 -- 172.21.15.33:0/3721209838 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f842c042070 con 0x7f8430107420 2024-09-12T12:17:05.428 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.422+0000 7f8425ffb640 1 -- 172.21.15.33:0/3721209838 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f842c030e30 con 0x7f8430107420 2024-09-12T12:17:05.428 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.422+0000 7f8436d19640 1 -- 172.21.15.33:0/3721209838 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f843019bbb0 con 0x7f8430107420 2024-09-12T12:17:05.428 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.422+0000 7f8425ffb640 1 -- 172.21.15.33:0/3721209838 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f842c037040 con 0x7f8430107420 2024-09-12T12:17:05.428 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.423+0000 7f8436d19640 1 -- 172.21.15.33:0/3721209838 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f843019e8a0 con 0x7f8430107420 2024-09-12T12:17:05.428 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.423+0000 7f8425ffb640 1 -- 172.21.15.33:0/3721209838 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f842c045070 con 0x7f8430107420 2024-09-12T12:17:05.428 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.424+0000 7f8436d19640 1 -- 172.21.15.33:0/3721209838 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f843010bb50 con 0x7f8430107420 2024-09-12T12:17:05.429 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.424+0000 7f8425ffb640 1 --2- 172.21.15.33:0/3721209838 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f8418038fc0 0x7f841803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:05.429 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.424+0000 7f8425ffb640 1 -- 172.21.15.33:0/3721209838 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f842c06c130 con 0x7f8430107420 2024-09-12T12:17:05.429 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.424+0000 7f8427fff640 1 --2- 172.21.15.33:0/3721209838 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f8418038fc0 0x7f841803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:05.429 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.424+0000 7f8427fff640 1 --2- 172.21.15.33:0/3721209838 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f8418038fc0 0x7f841803b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f84200098c0 tx=0x7f8420006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:05.429 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.428+0000 7f8425ffb640 1 -- 172.21.15.33:0/3721209838 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f842c04b170 con 0x7f8430107420 2024-09-12T12:17:05.429 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.449+0000 7f8425ffb640 1 -- 172.21.15.33:0/3721209838 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f842c03d950 con 0x7f8430107420 2024-09-12T12:17:05.429 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.695+0000 7f8436d19640 1 -- 172.21.15.33:0/3721209838 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f843019ea70 con 0x7f8430107420 2024-09-12T12:17:05.429 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.697+0000 7f8425ffb640 1 -- 172.21.15.33:0/3721209838 <== mon.0 v2:172.21.15.33:3300/0 8 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f842c02fd90 con 0x7f8430107420 2024-09-12T12:17:05.429 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-12T12:17:05.429 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.699+0000 7f8436d19640 1 -- 172.21.15.33:0/3721209838 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f8418038fc0 msgr2=0x7f841803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:05.429 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.699+0000 7f8436d19640 1 --2- 172.21.15.33:0/3721209838 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f8418038fc0 0x7f841803b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f84200098c0 tx=0x7f8420006db0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.429 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.699+0000 7f8436d19640 1 -- 172.21.15.33:0/3721209838 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8430107420 msgr2=0x7f843019b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:05.430 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.699+0000 7f8436d19640 1 --2- 172.21.15.33:0/3721209838 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8430107420 0x7f843019b3e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f842c009940 tx=0x7f842c030cc0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.430 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.699+0000 7f8436d19640 1 -- 172.21.15.33:0/3721209838 shutdown_connections 2024-09-12T12:17:05.430 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.699+0000 7f8436d19640 1 --2- 172.21.15.33:0/3721209838 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f8418038fc0 0x7f841803b480 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.430 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.699+0000 7f8436d19640 1 --2- 172.21.15.33:0/3721209838 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8430107420 0x7f843019b3e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.430 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.699+0000 7f8436d19640 1 -- 172.21.15.33:0/3721209838 >> 172.21.15.33:0/3721209838 conn(0x7f8430102bb0 msgr2=0x7f84301036e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:05.430 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.699+0000 7f8436d19640 1 -- 172.21.15.33:0/3721209838 shutdown_connections 2024-09-12T12:17:05.430 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-09-12T12:17:04.699+0000 7f8436d19640 1 -- 172.21.15.33:0/3721209838 wait complete. 2024-09-12T12:17:05.430 INFO:teuthology.orchestra.run.smithi033.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-12T12:17:05.430 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:17:05.430 INFO:teuthology.orchestra.run.smithi033.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-12T12:17:05.430 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:17:05.430 INFO:teuthology.orchestra.run.smithi033.stdout:Or, if you are only running a single cluster on this host: 2024-09-12T12:17:05.430 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:17:05.430 INFO:teuthology.orchestra.run.smithi033.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-12T12:17:05.431 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:17:05.431 INFO:teuthology.orchestra.run.smithi033.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-12T12:17:05.431 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:17:05.431 INFO:teuthology.orchestra.run.smithi033.stdout: ceph telemetry on 2024-09-12T12:17:05.431 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:17:05.431 INFO:teuthology.orchestra.run.smithi033.stdout:For more information see: 2024-09-12T12:17:05.431 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:17:05.431 INFO:teuthology.orchestra.run.smithi033.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-12T12:17:05.431 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:17:05.431 INFO:teuthology.orchestra.run.smithi033.stdout:Bootstrap complete. 2024-09-12T12:17:05.473 INFO:tasks.cephadm:Fetching config... 2024-09-12T12:17:05.473 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T12:17:05.473 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-12T12:17:05.492 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-12T12:17:05.492 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T12:17:05.492 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-12T12:17:05.549 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-12T12:17:05.549 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T12:17:05.549 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-12T12:17:05.616 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-12T12:17:05.617 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T12:17:05.617 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-12T12:17:05.674 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-12T12:17:05.675 DEBUG:teuthology.orchestra.run.smithi033:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCdPtIXjLJXV1sVerEb7A39fTA/2DsZqiawjSr/eL0enTf9J5lH0mhPNaJ5Bh3ySYDcOWLOYBp+Pca8fdMuezIbelbIXLUyDxs/rnwFZ2I8znanwWHpuQ1OP/ZvFYi0YY4S4U677WPU1rRFgXM5v7N2jSLLK0ojXeXlJkbLKUMI/znTjevOgSXDtbfXq/kT+eTIgxJy6KDFOXHT1OknTT5NsFTYH5hCqebollWaaY7nfRosvy5qN8clcDSXJ9RV0JIWD7iiw/4L07keQgwzap9mCZONiKA+D9g19DuIteUvS30DDUt83jnso3liX/ZB0hrEsp4zjEvcKTOtIIM7Uq4I32SNyf0EBOjY2HSK8PTPGcf2+gsWBI1TTlIJNwFNy9/agb32GUfIOEN7q/OHslbKWM05vOv2I4SHYlcHvH2f7EeeGjAxpO8UjE7bS2y6JtDZ+OYKC3hHwZp//UC6ntO7eq9D9hKHkrf7hy1U+bJUmSVJ38w845iChz0ggdK/GXE= ceph-a66dfafc-7100-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-12T12:17:05.730 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:05 smithi033 ceph-mon[31246]: mgrmap e13: x(active, since 6s) 2024-09-12T12:17:05.730 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:05 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/3721209838' entity='client.admin' 2024-09-12T12:17:05.751 INFO:teuthology.orchestra.run.smithi033.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCdPtIXjLJXV1sVerEb7A39fTA/2DsZqiawjSr/eL0enTf9J5lH0mhPNaJ5Bh3ySYDcOWLOYBp+Pca8fdMuezIbelbIXLUyDxs/rnwFZ2I8znanwWHpuQ1OP/ZvFYi0YY4S4U677WPU1rRFgXM5v7N2jSLLK0ojXeXlJkbLKUMI/znTjevOgSXDtbfXq/kT+eTIgxJy6KDFOXHT1OknTT5NsFTYH5hCqebollWaaY7nfRosvy5qN8clcDSXJ9RV0JIWD7iiw/4L07keQgwzap9mCZONiKA+D9g19DuIteUvS30DDUt83jnso3liX/ZB0hrEsp4zjEvcKTOtIIM7Uq4I32SNyf0EBOjY2HSK8PTPGcf2+gsWBI1TTlIJNwFNy9/agb32GUfIOEN7q/OHslbKWM05vOv2I4SHYlcHvH2f7EeeGjAxpO8UjE7bS2y6JtDZ+OYKC3hHwZp//UC6ntO7eq9D9hKHkrf7hy1U+bJUmSVJ38w845iChz0ggdK/GXE= ceph-a66dfafc-7100-11ef-bcea-c7b262605968 2024-09-12T12:17:05.763 DEBUG:teuthology.orchestra.run.smithi043:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCdPtIXjLJXV1sVerEb7A39fTA/2DsZqiawjSr/eL0enTf9J5lH0mhPNaJ5Bh3ySYDcOWLOYBp+Pca8fdMuezIbelbIXLUyDxs/rnwFZ2I8znanwWHpuQ1OP/ZvFYi0YY4S4U677WPU1rRFgXM5v7N2jSLLK0ojXeXlJkbLKUMI/znTjevOgSXDtbfXq/kT+eTIgxJy6KDFOXHT1OknTT5NsFTYH5hCqebollWaaY7nfRosvy5qN8clcDSXJ9RV0JIWD7iiw/4L07keQgwzap9mCZONiKA+D9g19DuIteUvS30DDUt83jnso3liX/ZB0hrEsp4zjEvcKTOtIIM7Uq4I32SNyf0EBOjY2HSK8PTPGcf2+gsWBI1TTlIJNwFNy9/agb32GUfIOEN7q/OHslbKWM05vOv2I4SHYlcHvH2f7EeeGjAxpO8UjE7bS2y6JtDZ+OYKC3hHwZp//UC6ntO7eq9D9hKHkrf7hy1U+bJUmSVJ38w845iChz0ggdK/GXE= ceph-a66dfafc-7100-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-12T12:17:05.818 INFO:teuthology.orchestra.run.smithi043.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCdPtIXjLJXV1sVerEb7A39fTA/2DsZqiawjSr/eL0enTf9J5lH0mhPNaJ5Bh3ySYDcOWLOYBp+Pca8fdMuezIbelbIXLUyDxs/rnwFZ2I8znanwWHpuQ1OP/ZvFYi0YY4S4U677WPU1rRFgXM5v7N2jSLLK0ojXeXlJkbLKUMI/znTjevOgSXDtbfXq/kT+eTIgxJy6KDFOXHT1OknTT5NsFTYH5hCqebollWaaY7nfRosvy5qN8clcDSXJ9RV0JIWD7iiw/4L07keQgwzap9mCZONiKA+D9g19DuIteUvS30DDUt83jnso3liX/ZB0hrEsp4zjEvcKTOtIIM7Uq4I32SNyf0EBOjY2HSK8PTPGcf2+gsWBI1TTlIJNwFNy9/agb32GUfIOEN7q/OHslbKWM05vOv2I4SHYlcHvH2f7EeeGjAxpO8UjE7bS2y6JtDZ+OYKC3hHwZp//UC6ntO7eq9D9hKHkrf7hy1U+bJUmSVJ38w845iChz0ggdK/GXE= ceph-a66dfafc-7100-11ef-bcea-c7b262605968 2024-09-12T12:17:05.831 DEBUG:teuthology.orchestra.run.smithi102:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCdPtIXjLJXV1sVerEb7A39fTA/2DsZqiawjSr/eL0enTf9J5lH0mhPNaJ5Bh3ySYDcOWLOYBp+Pca8fdMuezIbelbIXLUyDxs/rnwFZ2I8znanwWHpuQ1OP/ZvFYi0YY4S4U677WPU1rRFgXM5v7N2jSLLK0ojXeXlJkbLKUMI/znTjevOgSXDtbfXq/kT+eTIgxJy6KDFOXHT1OknTT5NsFTYH5hCqebollWaaY7nfRosvy5qN8clcDSXJ9RV0JIWD7iiw/4L07keQgwzap9mCZONiKA+D9g19DuIteUvS30DDUt83jnso3liX/ZB0hrEsp4zjEvcKTOtIIM7Uq4I32SNyf0EBOjY2HSK8PTPGcf2+gsWBI1TTlIJNwFNy9/agb32GUfIOEN7q/OHslbKWM05vOv2I4SHYlcHvH2f7EeeGjAxpO8UjE7bS2y6JtDZ+OYKC3hHwZp//UC6ntO7eq9D9hKHkrf7hy1U+bJUmSVJ38w845iChz0ggdK/GXE= ceph-a66dfafc-7100-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-12T12:17:06.090 INFO:teuthology.orchestra.run.smithi102.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCdPtIXjLJXV1sVerEb7A39fTA/2DsZqiawjSr/eL0enTf9J5lH0mhPNaJ5Bh3ySYDcOWLOYBp+Pca8fdMuezIbelbIXLUyDxs/rnwFZ2I8znanwWHpuQ1OP/ZvFYi0YY4S4U677WPU1rRFgXM5v7N2jSLLK0ojXeXlJkbLKUMI/znTjevOgSXDtbfXq/kT+eTIgxJy6KDFOXHT1OknTT5NsFTYH5hCqebollWaaY7nfRosvy5qN8clcDSXJ9RV0JIWD7iiw/4L07keQgwzap9mCZONiKA+D9g19DuIteUvS30DDUt83jnso3liX/ZB0hrEsp4zjEvcKTOtIIM7Uq4I32SNyf0EBOjY2HSK8PTPGcf2+gsWBI1TTlIJNwFNy9/agb32GUfIOEN7q/OHslbKWM05vOv2I4SHYlcHvH2f7EeeGjAxpO8UjE7bS2y6JtDZ+OYKC3hHwZp//UC6ntO7eq9D9hKHkrf7hy1U+bJUmSVJ38w845iChz0ggdK/GXE= ceph-a66dfafc-7100-11ef-bcea-c7b262605968 2024-09-12T12:17:06.103 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-12T12:17:06.375 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:17:06.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:06.952+0000 7facf2a41640 1 -- 172.21.15.33:0/2879244524 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facec101600 msgr2=0x7facec101a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:06.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:06.952+0000 7facf2a41640 1 --2- 172.21.15.33:0/2879244524 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facec101600 0x7facec101a00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7facdc009880 tx=0x7facdc02a5d0 comp rx=0 tx=0).stop 2024-09-12T12:17:06.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:06.953+0000 7facf2a41640 1 -- 172.21.15.33:0/2879244524 shutdown_connections 2024-09-12T12:17:06.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:06.953+0000 7facf2a41640 1 --2- 172.21.15.33:0/2879244524 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facec101600 0x7facec101a00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:06.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:06.953+0000 7facf2a41640 1 -- 172.21.15.33:0/2879244524 >> 172.21.15.33:0/2879244524 conn(0x7facec0fcdb0 msgr2=0x7facec0ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:06.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:06.953+0000 7facf2a41640 1 -- 172.21.15.33:0/2879244524 shutdown_connections 2024-09-12T12:17:06.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:06.953+0000 7facf2a41640 1 -- 172.21.15.33:0/2879244524 wait complete. 2024-09-12T12:17:06.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:06.953+0000 7facf2a41640 1 Processor -- start 2024-09-12T12:17:06.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:06.953+0000 7facf2a41640 1 -- start start 2024-09-12T12:17:06.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:06.954+0000 7facf2a41640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facec101600 0x7facec196cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:06.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:06.954+0000 7facf2a41640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7facec1075c0 con 0x7facec101600 2024-09-12T12:17:06.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:06.954+0000 7facebfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facec101600 0x7facec196cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:06.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:06.954+0000 7facebfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facec101600 0x7facec196cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45006/0 (socket says 172.21.15.33:45006) 2024-09-12T12:17:06.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:06.954+0000 7facebfff640 1 -- 172.21.15.33:0/3606165910 learned_addr learned my addr 172.21.15.33:0/3606165910 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:17:06.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:06.954+0000 7facebfff640 1 -- 172.21.15.33:0/3606165910 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facec197200 con 0x7facec101600 2024-09-12T12:17:06.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:06.954+0000 7facebfff640 1 --2- 172.21.15.33:0/3606165910 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facec101600 0x7facec196cc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7facdc009230 tx=0x7facdc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:06.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:06.954+0000 7face97fa640 1 -- 172.21.15.33:0/3606165910 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facdc03f070 con 0x7facec101600 2024-09-12T12:17:06.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:06.954+0000 7face97fa640 1 -- 172.21.15.33:0/3606165910 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7facdc003aa0 con 0x7facec101600 2024-09-12T12:17:06.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:06.954+0000 7face97fa640 1 -- 172.21.15.33:0/3606165910 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facdc035030 con 0x7facec101600 2024-09-12T12:17:06.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:06.954+0000 7facf2a41640 1 -- 172.21.15.33:0/3606165910 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facec197490 con 0x7facec101600 2024-09-12T12:17:06.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:06.955+0000 7facf2a41640 1 -- 172.21.15.33:0/3606165910 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facec19a180 con 0x7facec101600 2024-09-12T12:17:06.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:06.955+0000 7face97fa640 1 -- 172.21.15.33:0/3606165910 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7facdc042070 con 0x7facec101600 2024-09-12T12:17:06.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:06.956+0000 7face97fa640 1 --2- 172.21.15.33:0/3606165910 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7facd40390c0 0x7facd403b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:06.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:06.956+0000 7face97fa640 1 -- 172.21.15.33:0/3606165910 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7facdc06ce20 con 0x7facec101600 2024-09-12T12:17:06.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:06.956+0000 7faceb7fe640 1 --2- 172.21.15.33:0/3606165910 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7facd40390c0 0x7facd403b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:06.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:06.956+0000 7facf2a41640 1 -- 172.21.15.33:0/3606165910 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facec107d40 con 0x7facec101600 2024-09-12T12:17:06.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:06.956+0000 7faceb7fe640 1 --2- 172.21.15.33:0/3606165910 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7facd40390c0 0x7facd403b580 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7face00098c0 tx=0x7face0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:06.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:06.961+0000 7face97fa640 1 -- 172.21.15.33:0/3606165910 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7facdc036260 con 0x7facec101600 2024-09-12T12:17:07.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:07.139+0000 7facf2a41640 1 -- 172.21.15.33:0/3606165910 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7facec02d7c0 con 0x7facec101600 2024-09-12T12:17:07.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:07.142+0000 7face97fa640 1 -- 172.21.15.33:0/3606165910 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7facdc04ad50 con 0x7facec101600 2024-09-12T12:17:07.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:07.144+0000 7facf2a41640 1 -- 172.21.15.33:0/3606165910 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7facd40390c0 msgr2=0x7facd403b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:07.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:07.144+0000 7facf2a41640 1 --2- 172.21.15.33:0/3606165910 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7facd40390c0 0x7facd403b580 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7face00098c0 tx=0x7face0006db0 comp rx=0 tx=0).stop 2024-09-12T12:17:07.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:07.144+0000 7facf2a41640 1 -- 172.21.15.33:0/3606165910 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facec101600 msgr2=0x7facec196cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:07.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:07.144+0000 7facf2a41640 1 --2- 172.21.15.33:0/3606165910 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facec101600 0x7facec196cc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7facdc009230 tx=0x7facdc0048f0 comp rx=0 tx=0).stop 2024-09-12T12:17:07.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:07.144+0000 7facf2a41640 1 -- 172.21.15.33:0/3606165910 shutdown_connections 2024-09-12T12:17:07.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:07.144+0000 7facf2a41640 1 --2- 172.21.15.33:0/3606165910 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7facd40390c0 0x7facd403b580 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:07.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:07.144+0000 7facf2a41640 1 --2- 172.21.15.33:0/3606165910 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facec101600 0x7facec196cc0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:07.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:07.144+0000 7facf2a41640 1 -- 172.21.15.33:0/3606165910 >> 172.21.15.33:0/3606165910 conn(0x7facec0fcdb0 msgr2=0x7facec0fd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:07.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:07.144+0000 7facf2a41640 1 -- 172.21.15.33:0/3606165910 shutdown_connections 2024-09-12T12:17:07.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:07.144+0000 7facf2a41640 1 -- 172.21.15.33:0/3606165910 wait complete. 2024-09-12T12:17:07.852 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-12T12:17:07.853 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-12T12:17:08.346 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:17:08.468 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:08 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/3606165910' entity='client.admin' 2024-09-12T12:17:08.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:08.812+0000 7f06fc14d640 1 -- 172.21.15.33:0/4069729527 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06f41020d0 msgr2=0x7f06f41044c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:08.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:08.812+0000 7f06fc14d640 1 --2- 172.21.15.33:0/4069729527 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06f41020d0 0x7f06f41044c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f06f0009880 tx=0x7f06f002a5d0 comp rx=0 tx=0).stop 2024-09-12T12:17:08.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:08.812+0000 7f06fc14d640 1 -- 172.21.15.33:0/4069729527 shutdown_connections 2024-09-12T12:17:08.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:08.812+0000 7f06fc14d640 1 --2- 172.21.15.33:0/4069729527 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06f41020d0 0x7f06f41044c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:08.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:08.812+0000 7f06fc14d640 1 -- 172.21.15.33:0/4069729527 >> 172.21.15.33:0/4069729527 conn(0x7f06f40fbcd0 msgr2=0x7f06f40fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:08.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:08.812+0000 7f06fc14d640 1 -- 172.21.15.33:0/4069729527 shutdown_connections 2024-09-12T12:17:08.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:08.812+0000 7f06fc14d640 1 -- 172.21.15.33:0/4069729527 wait complete. 2024-09-12T12:17:08.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:08.813+0000 7f06fc14d640 1 Processor -- start 2024-09-12T12:17:08.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:08.813+0000 7f06fc14d640 1 -- start start 2024-09-12T12:17:08.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:08.813+0000 7f06fc14d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06f41020d0 0x7f06f4194a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:08.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:08.813+0000 7f06fc14d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f06f4105360 con 0x7f06f41020d0 2024-09-12T12:17:08.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:08.813+0000 7f06f9ee9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06f41020d0 0x7f06f4194a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:08.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:08.813+0000 7f06f9ee9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06f41020d0 0x7f06f4194a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45014/0 (socket says 172.21.15.33:45014) 2024-09-12T12:17:08.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:08.813+0000 7f06f9ee9640 1 -- 172.21.15.33:0/2542226872 learned_addr learned my addr 172.21.15.33:0/2542226872 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:17:08.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:08.814+0000 7f06f9ee9640 1 -- 172.21.15.33:0/2542226872 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06f4194f60 con 0x7f06f41020d0 2024-09-12T12:17:08.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:08.814+0000 7f06f9ee9640 1 --2- 172.21.15.33:0/2542226872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06f41020d0 0x7f06f4194a20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f06f0009230 tx=0x7f06f00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:08.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:08.814+0000 7f06eaffd640 1 -- 172.21.15.33:0/2542226872 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06f003f070 con 0x7f06f41020d0 2024-09-12T12:17:08.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:08.814+0000 7f06eaffd640 1 -- 172.21.15.33:0/2542226872 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f06f0003aa0 con 0x7f06f41020d0 2024-09-12T12:17:08.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:08.814+0000 7f06eaffd640 1 -- 172.21.15.33:0/2542226872 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06f0035030 con 0x7f06f41020d0 2024-09-12T12:17:08.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:08.814+0000 7f06fc14d640 1 -- 172.21.15.33:0/2542226872 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06f4195250 con 0x7f06f41020d0 2024-09-12T12:17:08.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:08.814+0000 7f06fc14d640 1 -- 172.21.15.33:0/2542226872 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06f4197ee0 con 0x7f06f41020d0 2024-09-12T12:17:08.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:08.815+0000 7f06eaffd640 1 -- 172.21.15.33:0/2542226872 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f06f0042070 con 0x7f06f41020d0 2024-09-12T12:17:08.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:08.815+0000 7f06eaffd640 1 --2- 172.21.15.33:0/2542226872 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f06e003d510 0x7f06e003f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:08.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:08.815+0000 7f06eaffd640 1 -- 172.21.15.33:0/2542226872 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f06f006ccc0 con 0x7f06f41020d0 2024-09-12T12:17:08.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:08.815+0000 7f06f96e8640 1 --2- 172.21.15.33:0/2542226872 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f06e003d510 0x7f06e003f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:08.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:08.815+0000 7f06fc14d640 1 -- 172.21.15.33:0/2542226872 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06f4105a90 con 0x7f06f41020d0 2024-09-12T12:17:08.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:08.816+0000 7f06f96e8640 1 --2- 172.21.15.33:0/2542226872 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f06e003d510 0x7f06e003f9d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f06e40098c0 tx=0x7f06e4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:08.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:08.820+0000 7f06eaffd640 1 -- 172.21.15.33:0/2542226872 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f06f004a260 con 0x7f06f41020d0 2024-09-12T12:17:09.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:09.010+0000 7f06fc14d640 1 -- 172.21.15.33:0/2542226872 --> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f06f4062630 con 0x7f06e003d510 2024-09-12T12:17:09.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:09.013+0000 7f06eaffd640 1 -- 172.21.15.33:0/2542226872 <== mgr.14150 v2:172.21.15.33:6800/176202431 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f06f4062630 con 0x7f06e003d510 2024-09-12T12:17:09.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:09.015+0000 7f06fc14d640 1 -- 172.21.15.33:0/2542226872 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f06e003d510 msgr2=0x7f06e003f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:09.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:09.015+0000 7f06fc14d640 1 --2- 172.21.15.33:0/2542226872 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f06e003d510 0x7f06e003f9d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f06e40098c0 tx=0x7f06e4006db0 comp rx=0 tx=0).stop 2024-09-12T12:17:09.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:09.015+0000 7f06fc14d640 1 -- 172.21.15.33:0/2542226872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06f41020d0 msgr2=0x7f06f4194a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:09.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:09.015+0000 7f06fc14d640 1 --2- 172.21.15.33:0/2542226872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06f41020d0 0x7f06f4194a20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f06f0009230 tx=0x7f06f00048f0 comp rx=0 tx=0).stop 2024-09-12T12:17:09.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:09.015+0000 7f06fc14d640 1 -- 172.21.15.33:0/2542226872 shutdown_connections 2024-09-12T12:17:09.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:09.015+0000 7f06fc14d640 1 --2- 172.21.15.33:0/2542226872 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f06e003d510 0x7f06e003f9d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:09.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:09.015+0000 7f06fc14d640 1 --2- 172.21.15.33:0/2542226872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06f41020d0 0x7f06f4194a20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:09.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:09.015+0000 7f06fc14d640 1 -- 172.21.15.33:0/2542226872 >> 172.21.15.33:0/2542226872 conn(0x7f06f40fbcd0 msgr2=0x7f06f40fc780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:09.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:09.015+0000 7f06fc14d640 1 -- 172.21.15.33:0/2542226872 shutdown_connections 2024-09-12T12:17:09.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:09.015+0000 7f06fc14d640 1 -- 172.21.15.33:0/2542226872 wait complete. 2024-09-12T12:17:10.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:10 smithi033 ceph-mon[31246]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:17:10.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:10 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:10.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:10 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:10.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:10 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:10.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:10 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi033", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:17:10.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:10 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:10.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:10 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:17:10.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:10 smithi033 ceph-mon[31246]: Updating smithi033:/etc/ceph/ceph.conf 2024-09-12T12:17:10.304 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi043 2024-09-12T12:17:10.304 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T12:17:10.304 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/etc/ceph/ceph.conf 2024-09-12T12:17:10.324 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T12:17:10.324 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T12:17:10.383 INFO:tasks.cephadm:Adding host smithi043 to orchestrator... 2024-09-12T12:17:10.383 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph orch host add smithi043 2024-09-12T12:17:10.641 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:17:11.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:11.101+0000 7ff22c8ef640 1 -- 172.21.15.33:0/1771510322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff228107660 msgr2=0x7ff228107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:11.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:11.101+0000 7ff22c8ef640 1 --2- 172.21.15.33:0/1771510322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff228107660 0x7ff228107a40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff218009880 tx=0x7ff21802a5d0 comp rx=0 tx=0).stop 2024-09-12T12:17:11.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:11.101+0000 7ff22c8ef640 1 -- 172.21.15.33:0/1771510322 shutdown_connections 2024-09-12T12:17:11.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:11.102+0000 7ff22c8ef640 1 --2- 172.21.15.33:0/1771510322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff228107660 0x7ff228107a40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:11.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:11.102+0000 7ff22c8ef640 1 -- 172.21.15.33:0/1771510322 >> 172.21.15.33:0/1771510322 conn(0x7ff2280fd290 msgr2=0x7ff2280ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:11.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:11.102+0000 7ff22c8ef640 1 -- 172.21.15.33:0/1771510322 shutdown_connections 2024-09-12T12:17:11.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:11.102+0000 7ff22c8ef640 1 -- 172.21.15.33:0/1771510322 wait complete. 2024-09-12T12:17:11.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:11.102+0000 7ff22c8ef640 1 Processor -- start 2024-09-12T12:17:11.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:11.102+0000 7ff22c8ef640 1 -- start start 2024-09-12T12:17:11.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:11.103+0000 7ff22c8ef640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff228107660 0x7ff2280744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:11.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:11.103+0000 7ff22c8ef640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff22810bb40 con 0x7ff228107660 2024-09-12T12:17:11.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:11.103+0000 7ff22659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff228107660 0x7ff2280744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:11.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:11.103+0000 7ff22659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff228107660 0x7ff2280744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51990/0 (socket says 172.21.15.33:51990) 2024-09-12T12:17:11.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:11.103+0000 7ff22659c640 1 -- 172.21.15.33:0/2250911938 learned_addr learned my addr 172.21.15.33:0/2250911938 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:17:11.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:11.103+0000 7ff22659c640 1 -- 172.21.15.33:0/2250911938 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2280763e0 con 0x7ff228107660 2024-09-12T12:17:11.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:11.103+0000 7ff22659c640 1 --2- 172.21.15.33:0/2250911938 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff228107660 0x7ff2280744f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff218009230 tx=0x7ff2180048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:11.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:11.103+0000 7ff2177fe640 1 -- 172.21.15.33:0/2250911938 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff21803f070 con 0x7ff228107660 2024-09-12T12:17:11.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:11.103+0000 7ff22c8ef640 1 -- 172.21.15.33:0/2250911938 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff228074a30 con 0x7ff228107660 2024-09-12T12:17:11.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:11.103+0000 7ff2177fe640 1 -- 172.21.15.33:0/2250911938 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff218004d10 con 0x7ff228107660 2024-09-12T12:17:11.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:11.103+0000 7ff2177fe640 1 -- 172.21.15.33:0/2250911938 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff218035030 con 0x7ff228107660 2024-09-12T12:17:11.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:11.103+0000 7ff22c8ef640 1 -- 172.21.15.33:0/2250911938 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff228074ef0 con 0x7ff228107660 2024-09-12T12:17:11.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:11.104+0000 7ff2177fe640 1 -- 172.21.15.33:0/2250911938 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7ff218042070 con 0x7ff228107660 2024-09-12T12:17:11.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:11.104+0000 7ff22c8ef640 1 -- 172.21.15.33:0/2250911938 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff228102cd0 con 0x7ff228107660 2024-09-12T12:17:11.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:11.104+0000 7ff2177fe640 1 --2- 172.21.15.33:0/2250911938 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff210039060 0x7ff21003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:11.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:11.105+0000 7ff2177fe640 1 -- 172.21.15.33:0/2250911938 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff21806cd30 con 0x7ff228107660 2024-09-12T12:17:11.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:11.105+0000 7ff225d9b640 1 --2- 172.21.15.33:0/2250911938 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff210039060 0x7ff21003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:11.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:11.105+0000 7ff225d9b640 1 --2- 172.21.15.33:0/2250911938 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff210039060 0x7ff21003b520 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff21c0098c0 tx=0x7ff21c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:11.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:11.109+0000 7ff2177fe640 1 -- 172.21.15.33:0/2250911938 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff218003b10 con 0x7ff228107660 2024-09-12T12:17:11.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:11.290+0000 7ff22c8ef640 1 -- 172.21.15.33:0/2250911938 --> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi043", "target": ["mon-mgr", ""]}) -- 0x7ff228075a90 con 0x7ff210039060 2024-09-12T12:17:11.730 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:11 smithi033 ceph-mon[31246]: Updating smithi033:/var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:17:11.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:11 smithi033 ceph-mon[31246]: Updating smithi033:/etc/ceph/ceph.client.admin.keyring 2024-09-12T12:17:11.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:11 smithi033 ceph-mon[31246]: Updating smithi033:/var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T12:17:11.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:11 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:11.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:11 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:11.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:11 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:11.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:11 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:17:11.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:11 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:11.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:11 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:17:11.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:11 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:12.730 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:12 smithi033 ceph-mon[31246]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi043", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:17:13.730 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:13 smithi033 ceph-mon[31246]: Deploying cephadm binary to smithi043 2024-09-12T12:17:15.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:15.153+0000 7ff2177fe640 1 -- 172.21.15.33:0/2250911938 <== mgr.14150 v2:172.21.15.33:6800/176202431 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7ff228075a90 con 0x7ff210039060 2024-09-12T12:17:15.153 INFO:teuthology.orchestra.run.smithi033.stdout:Added host 'smithi043' with addr '172.21.15.43' 2024-09-12T12:17:15.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:15.155+0000 7ff22c8ef640 1 -- 172.21.15.33:0/2250911938 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff210039060 msgr2=0x7ff21003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:15.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:15.155+0000 7ff22c8ef640 1 --2- 172.21.15.33:0/2250911938 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff210039060 0x7ff21003b520 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff21c0098c0 tx=0x7ff21c006db0 comp rx=0 tx=0).stop 2024-09-12T12:17:15.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:15.155+0000 7ff22c8ef640 1 -- 172.21.15.33:0/2250911938 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff228107660 msgr2=0x7ff2280744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:15.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:15.155+0000 7ff22c8ef640 1 --2- 172.21.15.33:0/2250911938 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff228107660 0x7ff2280744f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff218009230 tx=0x7ff2180048f0 comp rx=0 tx=0).stop 2024-09-12T12:17:15.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:15.155+0000 7ff22c8ef640 1 -- 172.21.15.33:0/2250911938 shutdown_connections 2024-09-12T12:17:15.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:15.155+0000 7ff22c8ef640 1 --2- 172.21.15.33:0/2250911938 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff210039060 0x7ff21003b520 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:15.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:15.155+0000 7ff22c8ef640 1 --2- 172.21.15.33:0/2250911938 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff228107660 0x7ff2280744f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:15.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:15.155+0000 7ff22c8ef640 1 -- 172.21.15.33:0/2250911938 >> 172.21.15.33:0/2250911938 conn(0x7ff2280fd290 msgr2=0x7ff2280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:15.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:15.155+0000 7ff22c8ef640 1 -- 172.21.15.33:0/2250911938 shutdown_connections 2024-09-12T12:17:15.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:15.156+0000 7ff22c8ef640 1 -- 172.21.15.33:0/2250911938 wait complete. 2024-09-12T12:17:15.735 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-12T12:17:15.987 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:17:16.424 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:16 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:16.424 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:16 smithi033 ceph-mon[31246]: Added host smithi043 2024-09-12T12:17:16.425 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:16 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:17:16.425 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:16 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:16.425 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:16 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:16.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:16.432+0000 7f3010874640 1 -- 172.21.15.33:0/2937242901 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f300c106560 msgr2=0x7f300c106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:16.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:16.432+0000 7f3010874640 1 --2- 172.21.15.33:0/2937242901 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f300c106560 0x7f300c106940 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc009880 tx=0x7f2ffc02a5d0 comp rx=0 tx=0).stop 2024-09-12T12:17:16.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:16.432+0000 7f3010874640 1 -- 172.21.15.33:0/2937242901 shutdown_connections 2024-09-12T12:17:16.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:16.432+0000 7f3010874640 1 --2- 172.21.15.33:0/2937242901 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f300c106560 0x7f300c106940 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:16.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:16.432+0000 7f3010874640 1 -- 172.21.15.33:0/2937242901 >> 172.21.15.33:0/2937242901 conn(0x7f300c0fc1b0 msgr2=0x7f300c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:16.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:16.432+0000 7f3010874640 1 -- 172.21.15.33:0/2937242901 shutdown_connections 2024-09-12T12:17:16.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:16.432+0000 7f3010874640 1 -- 172.21.15.33:0/2937242901 wait complete. 2024-09-12T12:17:16.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:16.433+0000 7f3010874640 1 Processor -- start 2024-09-12T12:17:16.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:16.433+0000 7f3010874640 1 -- start start 2024-09-12T12:17:16.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:16.434+0000 7f3010874640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f300c106560 0x7f300c197010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:16.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:16.434+0000 7f3010874640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f300c10aa40 con 0x7f300c106560 2024-09-12T12:17:16.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:16.434+0000 7f300a59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f300c106560 0x7f300c197010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:16.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:16.434+0000 7f300a59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f300c106560 0x7f300c197010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52008/0 (socket says 172.21.15.33:52008) 2024-09-12T12:17:16.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:16.434+0000 7f300a59c640 1 -- 172.21.15.33:0/2954881553 learned_addr learned my addr 172.21.15.33:0/2954881553 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:17:16.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:16.434+0000 7f300a59c640 1 -- 172.21.15.33:0/2954881553 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f300c197550 con 0x7f300c106560 2024-09-12T12:17:16.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:16.434+0000 7f300a59c640 1 --2- 172.21.15.33:0/2954881553 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f300c106560 0x7f300c197010 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc009230 tx=0x7f2ffc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:16.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:16.434+0000 7f2ffb7fe640 1 -- 172.21.15.33:0/2954881553 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ffc03f070 con 0x7f300c106560 2024-09-12T12:17:16.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:16.434+0000 7f2ffb7fe640 1 -- 172.21.15.33:0/2954881553 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2ffc004d10 con 0x7f300c106560 2024-09-12T12:17:16.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:16.434+0000 7f3010874640 1 -- 172.21.15.33:0/2954881553 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f300c1977e0 con 0x7f300c106560 2024-09-12T12:17:16.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:16.434+0000 7f2ffb7fe640 1 -- 172.21.15.33:0/2954881553 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ffc035030 con 0x7f300c106560 2024-09-12T12:17:16.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:16.434+0000 7f3010874640 1 -- 172.21.15.33:0/2954881553 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f300c19b8e0 con 0x7f300c106560 2024-09-12T12:17:16.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:16.435+0000 7f2ffb7fe640 1 -- 172.21.15.33:0/2954881553 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f2ffc042070 con 0x7f300c106560 2024-09-12T12:17:16.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:16.435+0000 7f3010874640 1 -- 172.21.15.33:0/2954881553 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f300c101bd0 con 0x7f300c106560 2024-09-12T12:17:16.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:16.436+0000 7f2ffb7fe640 1 --2- 172.21.15.33:0/2954881553 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2ff4039060 0x7f2ff403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:16.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:16.436+0000 7f2ffb7fe640 1 -- 172.21.15.33:0/2954881553 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f2ffc06cca0 con 0x7f300c106560 2024-09-12T12:17:16.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:16.436+0000 7f3009d9b640 1 --2- 172.21.15.33:0/2954881553 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2ff4039060 0x7f2ff403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:16.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:16.436+0000 7f3009d9b640 1 --2- 172.21.15.33:0/2954881553 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2ff4039060 0x7f2ff403b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f30000098c0 tx=0x7f3000006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:16.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:16.440+0000 7f2ffb7fe640 1 -- 172.21.15.33:0/2954881553 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2ffc039350 con 0x7f300c106560 2024-09-12T12:17:16.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:16.633+0000 7f3010874640 1 -- 172.21.15.33:0/2954881553 --> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f300c198370 con 0x7f2ff4039060 2024-09-12T12:17:16.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:16.634+0000 7f2ffb7fe640 1 -- 172.21.15.33:0/2954881553 <== mgr.14150 v2:172.21.15.33:6800/176202431 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+159 (secure 0 0 0) 0x7f300c198370 con 0x7f2ff4039060 2024-09-12T12:17:16.634 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:17:16.634 INFO:teuthology.orchestra.run.smithi033.stdout:[{"addr": "172.21.15.33", "hostname": "smithi033", "labels": [], "status": ""}, {"addr": "172.21.15.43", "hostname": "smithi043", "labels": [], "status": ""}] 2024-09-12T12:17:16.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:16.636+0000 7f3010874640 1 -- 172.21.15.33:0/2954881553 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2ff4039060 msgr2=0x7f2ff403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:16.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:16.637+0000 7f3010874640 1 --2- 172.21.15.33:0/2954881553 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2ff4039060 0x7f2ff403b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f30000098c0 tx=0x7f3000006db0 comp rx=0 tx=0).stop 2024-09-12T12:17:16.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:16.637+0000 7f3010874640 1 -- 172.21.15.33:0/2954881553 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f300c106560 msgr2=0x7f300c197010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:16.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:16.637+0000 7f3010874640 1 --2- 172.21.15.33:0/2954881553 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f300c106560 0x7f300c197010 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc009230 tx=0x7f2ffc0048f0 comp rx=0 tx=0).stop 2024-09-12T12:17:16.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:16.637+0000 7f3010874640 1 -- 172.21.15.33:0/2954881553 shutdown_connections 2024-09-12T12:17:16.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:16.637+0000 7f3010874640 1 --2- 172.21.15.33:0/2954881553 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2ff4039060 0x7f2ff403b520 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:16.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:16.637+0000 7f3010874640 1 --2- 172.21.15.33:0/2954881553 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f300c106560 0x7f300c197010 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:16.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:16.637+0000 7f3010874640 1 -- 172.21.15.33:0/2954881553 >> 172.21.15.33:0/2954881553 conn(0x7f300c0fc1b0 msgr2=0x7f300c0fdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:16.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:16.637+0000 7f3010874640 1 -- 172.21.15.33:0/2954881553 shutdown_connections 2024-09-12T12:17:16.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:16.637+0000 7f3010874640 1 -- 172.21.15.33:0/2954881553 wait complete. 2024-09-12T12:17:17.183 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi102 2024-09-12T12:17:17.184 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-12T12:17:17.184 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/etc/ceph/ceph.conf 2024-09-12T12:17:17.201 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-12T12:17:17.201 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T12:17:17.257 INFO:tasks.cephadm:Adding host smithi102 to orchestrator... 2024-09-12T12:17:17.257 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph orch host add smithi102 2024-09-12T12:17:17.508 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:17:17.831 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:17 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:17.831 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:17 smithi033 ceph-mon[31246]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:17:17.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:17.915+0000 7fd7071e2640 1 -- 172.21.15.33:0/1411423823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd700107660 msgr2=0x7fd700107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:17.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:17.915+0000 7fd7071e2640 1 --2- 172.21.15.33:0/1411423823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd700107660 0x7fd700107a40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4009880 tx=0x7fd6f402a5d0 comp rx=0 tx=0).stop 2024-09-12T12:17:17.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:17.915+0000 7fd7071e2640 1 -- 172.21.15.33:0/1411423823 shutdown_connections 2024-09-12T12:17:17.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:17.915+0000 7fd7071e2640 1 --2- 172.21.15.33:0/1411423823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd700107660 0x7fd700107a40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:17.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:17.915+0000 7fd7071e2640 1 -- 172.21.15.33:0/1411423823 >> 172.21.15.33:0/1411423823 conn(0x7fd7000fd290 msgr2=0x7fd7000ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:17.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:17.915+0000 7fd7071e2640 1 -- 172.21.15.33:0/1411423823 shutdown_connections 2024-09-12T12:17:17.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:17.915+0000 7fd7071e2640 1 -- 172.21.15.33:0/1411423823 wait complete. 2024-09-12T12:17:17.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:17.916+0000 7fd7071e2640 1 Processor -- start 2024-09-12T12:17:17.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:17.916+0000 7fd7071e2640 1 -- start start 2024-09-12T12:17:17.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:17.916+0000 7fd7071e2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd700107660 0x7fd700197020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:17.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:17.916+0000 7fd7071e2640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd70010bb40 con 0x7fd700107660 2024-09-12T12:17:17.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:17.916+0000 7fd704f7e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd700107660 0x7fd700197020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:17.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:17.916+0000 7fd704f7e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd700107660 0x7fd700197020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52026/0 (socket says 172.21.15.33:52026) 2024-09-12T12:17:17.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:17.916+0000 7fd704f7e640 1 -- 172.21.15.33:0/1588505429 learned_addr learned my addr 172.21.15.33:0/1588505429 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:17:17.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:17.916+0000 7fd704f7e640 1 -- 172.21.15.33:0/1588505429 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd700197560 con 0x7fd700107660 2024-09-12T12:17:17.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:17.916+0000 7fd704f7e640 1 --2- 172.21.15.33:0/1588505429 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd700107660 0x7fd700197020 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4009230 tx=0x7fd6f40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:17.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:17.917+0000 7fd6fdffb640 1 -- 172.21.15.33:0/1588505429 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6f403f070 con 0x7fd700107660 2024-09-12T12:17:17.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:17.917+0000 7fd6fdffb640 1 -- 172.21.15.33:0/1588505429 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd6f4003aa0 con 0x7fd700107660 2024-09-12T12:17:17.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:17.917+0000 7fd7071e2640 1 -- 172.21.15.33:0/1588505429 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7001977f0 con 0x7fd700107660 2024-09-12T12:17:17.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:17.917+0000 7fd6fdffb640 1 -- 172.21.15.33:0/1588505429 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6f4035030 con 0x7fd700107660 2024-09-12T12:17:17.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:17.917+0000 7fd7071e2640 1 -- 172.21.15.33:0/1588505429 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd70019b8f0 con 0x7fd700107660 2024-09-12T12:17:17.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:17.918+0000 7fd6fdffb640 1 -- 172.21.15.33:0/1588505429 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fd6f4042070 con 0x7fd700107660 2024-09-12T12:17:17.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:17.918+0000 7fd7071e2640 1 -- 172.21.15.33:0/1588505429 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd700102cd0 con 0x7fd700107660 2024-09-12T12:17:17.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:17.918+0000 7fd6fdffb640 1 --2- 172.21.15.33:0/1588505429 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd6f00390c0 0x7fd6f003b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:17.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:17.918+0000 7fd6fdffb640 1 -- 172.21.15.33:0/1588505429 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd6f406cc60 con 0x7fd700107660 2024-09-12T12:17:17.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:17.918+0000 7fd6fffff640 1 --2- 172.21.15.33:0/1588505429 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd6f00390c0 0x7fd6f003b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:17.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:17.918+0000 7fd6fffff640 1 --2- 172.21.15.33:0/1588505429 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd6f00390c0 0x7fd6f003b580 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec0098c0 tx=0x7fd6ec006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:17.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:17.923+0000 7fd6fdffb640 1 -- 172.21.15.33:0/1588505429 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd6f40433b0 con 0x7fd700107660 2024-09-12T12:17:18.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:18.100+0000 7fd7071e2640 1 -- 172.21.15.33:0/1588505429 --> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi102", "target": ["mon-mgr", ""]}) -- 0x7fd700107ac0 con 0x7fd6f00390c0 2024-09-12T12:17:19.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:18 smithi033 ceph-mon[31246]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:19.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:18 smithi033 ceph-mon[31246]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi102", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:17:20.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:20 smithi033 ceph-mon[31246]: Deploying cephadm binary to smithi102 2024-09-12T12:17:20.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:20 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:20.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:20 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:20.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:20 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:20.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:20 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:20.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:20 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi043", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:17:20.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:20 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:20.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:20 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:17:20.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:20 smithi033 ceph-mon[31246]: Updating smithi043:/etc/ceph/ceph.conf 2024-09-12T12:17:20.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:20 smithi033 ceph-mon[31246]: Updating smithi043:/var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:17:20.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:20 smithi033 ceph-mon[31246]: Updating smithi043:/etc/ceph/ceph.client.admin.keyring 2024-09-12T12:17:20.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:20 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:20.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:20 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:20.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:20 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:21.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:21 smithi033 ceph-mon[31246]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:21.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:21 smithi033 ceph-mon[31246]: Updating smithi043:/var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T12:17:21.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:21.916+0000 7fd6fdffb640 1 -- 172.21.15.33:0/1588505429 <== mgr.14150 v2:172.21.15.33:6800/176202431 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fd700107ac0 con 0x7fd6f00390c0 2024-09-12T12:17:21.917 INFO:teuthology.orchestra.run.smithi033.stdout:Added host 'smithi102' with addr '172.21.15.102' 2024-09-12T12:17:21.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:21.919+0000 7fd7071e2640 1 -- 172.21.15.33:0/1588505429 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd6f00390c0 msgr2=0x7fd6f003b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:21.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:21.919+0000 7fd7071e2640 1 --2- 172.21.15.33:0/1588505429 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd6f00390c0 0x7fd6f003b580 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec0098c0 tx=0x7fd6ec006db0 comp rx=0 tx=0).stop 2024-09-12T12:17:21.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:21.919+0000 7fd7071e2640 1 -- 172.21.15.33:0/1588505429 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd700107660 msgr2=0x7fd700197020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:21.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:21.919+0000 7fd7071e2640 1 --2- 172.21.15.33:0/1588505429 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd700107660 0x7fd700197020 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4009230 tx=0x7fd6f40048f0 comp rx=0 tx=0).stop 2024-09-12T12:17:21.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:21.919+0000 7fd7071e2640 1 -- 172.21.15.33:0/1588505429 shutdown_connections 2024-09-12T12:17:21.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:21.919+0000 7fd7071e2640 1 --2- 172.21.15.33:0/1588505429 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd6f00390c0 0x7fd6f003b580 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:21.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:21.919+0000 7fd7071e2640 1 --2- 172.21.15.33:0/1588505429 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd700107660 0x7fd700197020 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:21.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:21.919+0000 7fd7071e2640 1 -- 172.21.15.33:0/1588505429 >> 172.21.15.33:0/1588505429 conn(0x7fd7000fd290 msgr2=0x7fd7000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:21.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:21.919+0000 7fd7071e2640 1 -- 172.21.15.33:0/1588505429 shutdown_connections 2024-09-12T12:17:21.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:21.919+0000 7fd7071e2640 1 -- 172.21.15.33:0/1588505429 wait complete. 2024-09-12T12:17:22.454 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-12T12:17:22.703 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:17:23.128 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:22 smithi033 ceph-mon[31246]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:23.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:22 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:23.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:22 smithi033 ceph-mon[31246]: Added host smithi102 2024-09-12T12:17:23.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:22 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:17:23.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:22 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:23.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:22 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:23.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:23.135+0000 7f2b1346e640 1 -- 172.21.15.33:0/1399976836 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b0c107660 msgr2=0x7f2b0c107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:23.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:23.135+0000 7f2b1346e640 1 --2- 172.21.15.33:0/1399976836 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b0c107660 0x7f2b0c107a40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2b08009c20 tx=0x7f2b0802aa90 comp rx=0 tx=0).stop 2024-09-12T12:17:23.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:23.135+0000 7f2b1346e640 1 -- 172.21.15.33:0/1399976836 shutdown_connections 2024-09-12T12:17:23.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:23.135+0000 7f2b1346e640 1 --2- 172.21.15.33:0/1399976836 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b0c107660 0x7f2b0c107a40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:23.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:23.135+0000 7f2b1346e640 1 -- 172.21.15.33:0/1399976836 >> 172.21.15.33:0/1399976836 conn(0x7f2b0c0fd290 msgr2=0x7f2b0c0ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:23.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:23.135+0000 7f2b1346e640 1 -- 172.21.15.33:0/1399976836 shutdown_connections 2024-09-12T12:17:23.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:23.135+0000 7f2b1346e640 1 -- 172.21.15.33:0/1399976836 wait complete. 2024-09-12T12:17:23.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:23.136+0000 7f2b1346e640 1 Processor -- start 2024-09-12T12:17:23.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:23.136+0000 7f2b1346e640 1 -- start start 2024-09-12T12:17:23.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:23.136+0000 7f2b1346e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b0c107660 0x7f2b0c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:23.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:23.136+0000 7f2b1346e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0c10bb40 con 0x7f2b0c107660 2024-09-12T12:17:23.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:23.137+0000 7f2b1120a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b0c107660 0x7f2b0c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:23.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:23.137+0000 7f2b1120a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b0c107660 0x7f2b0c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55584/0 (socket says 172.21.15.33:55584) 2024-09-12T12:17:23.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:23.137+0000 7f2b1120a640 1 -- 172.21.15.33:0/3549551421 learned_addr learned my addr 172.21.15.33:0/3549551421 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:17:23.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:23.137+0000 7f2b1120a640 1 -- 172.21.15.33:0/3549551421 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b0c0763e0 con 0x7f2b0c107660 2024-09-12T12:17:23.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:23.137+0000 7f2b1120a640 1 --2- 172.21.15.33:0/3549551421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b0c107660 0x7f2b0c0744f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2b08009d40 tx=0x7f2b08030f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:23.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:23.137+0000 7f2b027fc640 1 -- 172.21.15.33:0/3549551421 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b08047070 con 0x7f2b0c107660 2024-09-12T12:17:23.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:23.137+0000 7f2b027fc640 1 -- 172.21.15.33:0/3549551421 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2b08003e20 con 0x7f2b0c107660 2024-09-12T12:17:23.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:23.137+0000 7f2b1346e640 1 -- 172.21.15.33:0/3549551421 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b0c074a30 con 0x7f2b0c107660 2024-09-12T12:17:23.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:23.137+0000 7f2b027fc640 1 -- 172.21.15.33:0/3549551421 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b08033050 con 0x7f2b0c107660 2024-09-12T12:17:23.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:23.137+0000 7f2b1346e640 1 -- 172.21.15.33:0/3549551421 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b0c074e90 con 0x7f2b0c107660 2024-09-12T12:17:23.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:23.138+0000 7f2b027fc640 1 -- 172.21.15.33:0/3549551421 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f2b0804a070 con 0x7f2b0c107660 2024-09-12T12:17:23.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:23.138+0000 7f2b1346e640 1 -- 172.21.15.33:0/3549551421 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b0c102cd0 con 0x7f2b0c107660 2024-09-12T12:17:23.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:23.138+0000 7f2b027fc640 1 --2- 172.21.15.33:0/3549551421 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2af8039060 0x7f2af803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:23.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:23.138+0000 7f2b027fc640 1 -- 172.21.15.33:0/3549551421 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f2b0803e030 con 0x7f2b0c107660 2024-09-12T12:17:23.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:23.138+0000 7f2b10a09640 1 --2- 172.21.15.33:0/3549551421 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2af8039060 0x7f2af803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:23.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:23.139+0000 7f2b10a09640 1 --2- 172.21.15.33:0/3549551421 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2af8039060 0x7f2af803b520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2afc0098c0 tx=0x7f2afc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:23.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:23.143+0000 7f2b027fc640 1 -- 172.21.15.33:0/3549551421 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2b080492c0 con 0x7f2b0c107660 2024-09-12T12:17:23.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:23.325+0000 7f2b1346e640 1 -- 172.21.15.33:0/3549551421 --> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2b0c075a20 con 0x7f2af8039060 2024-09-12T12:17:23.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:23.326+0000 7f2b027fc640 1 -- 172.21.15.33:0/3549551421 <== mgr.14150 v2:172.21.15.33:6800/176202431 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+239 (secure 0 0 0) 0x7f2b0c075a20 con 0x7f2af8039060 2024-09-12T12:17:23.326 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:17:23.326 INFO:teuthology.orchestra.run.smithi033.stdout:[{"addr": "172.21.15.33", "hostname": "smithi033", "labels": [], "status": ""}, {"addr": "172.21.15.43", "hostname": "smithi043", "labels": [], "status": ""}, {"addr": "172.21.15.102", "hostname": "smithi102", "labels": [], "status": ""}] 2024-09-12T12:17:23.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:23.329+0000 7f2b1346e640 1 -- 172.21.15.33:0/3549551421 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2af8039060 msgr2=0x7f2af803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:23.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:23.329+0000 7f2b1346e640 1 --2- 172.21.15.33:0/3549551421 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2af8039060 0x7f2af803b520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2afc0098c0 tx=0x7f2afc006db0 comp rx=0 tx=0).stop 2024-09-12T12:17:23.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:23.329+0000 7f2b1346e640 1 -- 172.21.15.33:0/3549551421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b0c107660 msgr2=0x7f2b0c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:23.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:23.329+0000 7f2b1346e640 1 --2- 172.21.15.33:0/3549551421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b0c107660 0x7f2b0c0744f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2b08009d40 tx=0x7f2b08030f50 comp rx=0 tx=0).stop 2024-09-12T12:17:23.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:23.329+0000 7f2b1346e640 1 -- 172.21.15.33:0/3549551421 shutdown_connections 2024-09-12T12:17:23.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:23.329+0000 7f2b1346e640 1 --2- 172.21.15.33:0/3549551421 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2af8039060 0x7f2af803b520 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:23.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:23.329+0000 7f2b1346e640 1 --2- 172.21.15.33:0/3549551421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b0c107660 0x7f2b0c0744f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:23.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:23.329+0000 7f2b1346e640 1 -- 172.21.15.33:0/3549551421 >> 172.21.15.33:0/3549551421 conn(0x7f2b0c0fd290 msgr2=0x7f2b0c0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:23.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:23.329+0000 7f2b1346e640 1 -- 172.21.15.33:0/3549551421 shutdown_connections 2024-09-12T12:17:23.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:23.329+0000 7f2b1346e640 1 -- 172.21.15.33:0/3549551421 wait complete. 2024-09-12T12:17:24.223 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-12T12:17:24.224 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-12T12:17:24.479 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:17:24.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:24 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:24.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:24 smithi033 ceph-mon[31246]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:17:24.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:24.894+0000 7f5313bb2640 1 -- 172.21.15.33:0/3910729324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f530c106560 msgr2=0x7f530c106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:24.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:24.894+0000 7f5313bb2640 1 --2- 172.21.15.33:0/3910729324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f530c106560 0x7f530c106940 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5308009880 tx=0x7f530802a5d0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:24.894+0000 7f5313bb2640 1 -- 172.21.15.33:0/3910729324 shutdown_connections 2024-09-12T12:17:24.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:24.894+0000 7f5313bb2640 1 --2- 172.21.15.33:0/3910729324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f530c106560 0x7f530c106940 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:24.894+0000 7f5313bb2640 1 -- 172.21.15.33:0/3910729324 >> 172.21.15.33:0/3910729324 conn(0x7f530c0fc1b0 msgr2=0x7f530c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:24.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:24.894+0000 7f5313bb2640 1 -- 172.21.15.33:0/3910729324 shutdown_connections 2024-09-12T12:17:24.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:24.894+0000 7f5313bb2640 1 -- 172.21.15.33:0/3910729324 wait complete. 2024-09-12T12:17:24.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:24.894+0000 7f5313bb2640 1 Processor -- start 2024-09-12T12:17:24.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:24.894+0000 7f5313bb2640 1 -- start start 2024-09-12T12:17:24.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:24.895+0000 7f5313bb2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f530c106560 0x7f530c0fc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:24.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:24.895+0000 7f5313bb2640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f530c10aa40 con 0x7f530c106560 2024-09-12T12:17:24.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:24.895+0000 7f531194e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f530c106560 0x7f530c0fc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:24.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:24.895+0000 7f531194e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f530c106560 0x7f530c0fc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55602/0 (socket says 172.21.15.33:55602) 2024-09-12T12:17:24.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:24.895+0000 7f531194e640 1 -- 172.21.15.33:0/3316798499 learned_addr learned my addr 172.21.15.33:0/3316798499 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:17:24.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:24.895+0000 7f531194e640 1 -- 172.21.15.33:0/3316798499 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f530c0fe550 con 0x7f530c106560 2024-09-12T12:17:24.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:24.895+0000 7f531194e640 1 --2- 172.21.15.33:0/3316798499 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f530c106560 0x7f530c0fc660 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5308009230 tx=0x7f53080048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:24.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:24.895+0000 7f5302ffd640 1 -- 172.21.15.33:0/3316798499 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f530803f070 con 0x7f530c106560 2024-09-12T12:17:24.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:24.895+0000 7f5302ffd640 1 -- 172.21.15.33:0/3316798499 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5308004d10 con 0x7f530c106560 2024-09-12T12:17:24.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:24.895+0000 7f5313bb2640 1 -- 172.21.15.33:0/3316798499 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f530c0fcba0 con 0x7f530c106560 2024-09-12T12:17:24.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:24.895+0000 7f5302ffd640 1 -- 172.21.15.33:0/3316798499 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5308035030 con 0x7f530c106560 2024-09-12T12:17:24.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:24.896+0000 7f5313bb2640 1 -- 172.21.15.33:0/3316798499 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f530c0fd060 con 0x7f530c106560 2024-09-12T12:17:24.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:24.897+0000 7f5302ffd640 1 -- 172.21.15.33:0/3316798499 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f5308042070 con 0x7f530c106560 2024-09-12T12:17:24.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:24.897+0000 7f5313bb2640 1 -- 172.21.15.33:0/3316798499 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f530c101bd0 con 0x7f530c106560 2024-09-12T12:17:24.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:24.897+0000 7f5302ffd640 1 --2- 172.21.15.33:0/3316798499 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f52f80390c0 0x7f52f803b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:24.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:24.897+0000 7f5302ffd640 1 -- 172.21.15.33:0/3316798499 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f530806cdb0 con 0x7f530c106560 2024-09-12T12:17:24.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:24.897+0000 7f531114d640 1 --2- 172.21.15.33:0/3316798499 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f52f80390c0 0x7f52f803b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:24.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:24.897+0000 7f531114d640 1 --2- 172.21.15.33:0/3316798499 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f52f80390c0 0x7f52f803b580 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f52fc0098c0 tx=0x7f52fc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:24.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:24.901+0000 7f5302ffd640 1 -- 172.21.15.33:0/3316798499 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5308031400 con 0x7f530c106560 2024-09-12T12:17:25.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:25.085+0000 7f5313bb2640 1 -- 172.21.15.33:0/3316798499 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f530c0fdb90 con 0x7f530c106560 2024-09-12T12:17:25.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:25.267+0000 7f5302ffd640 1 -- 172.21.15.33:0/3316798499 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f530803b9f0 con 0x7f530c106560 2024-09-12T12:17:25.267 INFO:teuthology.orchestra.run.smithi033.stderr:adjusted tunables profile to default 2024-09-12T12:17:25.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:25.269+0000 7f5313bb2640 1 -- 172.21.15.33:0/3316798499 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f52f80390c0 msgr2=0x7f52f803b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:25.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:25.269+0000 7f5313bb2640 1 --2- 172.21.15.33:0/3316798499 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f52f80390c0 0x7f52f803b580 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f52fc0098c0 tx=0x7f52fc006db0 comp rx=0 tx=0).stop 2024-09-12T12:17:25.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:25.269+0000 7f5313bb2640 1 -- 172.21.15.33:0/3316798499 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f530c106560 msgr2=0x7f530c0fc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:25.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:25.269+0000 7f5313bb2640 1 --2- 172.21.15.33:0/3316798499 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f530c106560 0x7f530c0fc660 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5308009230 tx=0x7f53080048f0 comp rx=0 tx=0).stop 2024-09-12T12:17:25.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:25.269+0000 7f5313bb2640 1 -- 172.21.15.33:0/3316798499 shutdown_connections 2024-09-12T12:17:25.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:25.269+0000 7f5313bb2640 1 --2- 172.21.15.33:0/3316798499 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f52f80390c0 0x7f52f803b580 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:25.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:25.269+0000 7f5313bb2640 1 --2- 172.21.15.33:0/3316798499 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f530c106560 0x7f530c0fc660 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:25.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:25.269+0000 7f5313bb2640 1 -- 172.21.15.33:0/3316798499 >> 172.21.15.33:0/3316798499 conn(0x7f530c0fc1b0 msgr2=0x7f530c069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:25.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:25.270+0000 7f5313bb2640 1 -- 172.21.15.33:0/3316798499 shutdown_connections 2024-09-12T12:17:25.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:25.270+0000 7f5313bb2640 1 -- 172.21.15.33:0/3316798499 wait complete. 2024-09-12T12:17:25.721 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:25 smithi033 ceph-mon[31246]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:25.721 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:25 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/3316798499' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-12T12:17:25.985 INFO:tasks.cephadm:Adding mon.a on smithi033 2024-09-12T12:17:25.986 INFO:tasks.cephadm:Adding mon.b on smithi043 2024-09-12T12:17:25.986 INFO:tasks.cephadm:Adding mon.c on smithi102 2024-09-12T12:17:25.986 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph orch apply mon '3;smithi033:172.21.15.33=a;smithi043:172.21.15.43=b;smithi102:172.21.15.102=c' 2024-09-12T12:17:26.225 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-12T12:17:26.270 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-12T12:17:26.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:26 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/3316798499' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-12T12:17:26.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:26 smithi033 ceph-mon[31246]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T12:17:26.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:26 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:26.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:26 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:26.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:26 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:26.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:26 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:26.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:26 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi102", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:17:26.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:26 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:26.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:26 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:17:26.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:26.752+0000 7fa0f0135640 1 -- 172.21.15.102:0/3928463858 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0e80ff900 msgr2=0x7fa0e80ffd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:26.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:26.752+0000 7fa0f0135640 1 --2- 172.21.15.102:0/3928463858 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0e80ff900 0x7fa0e80ffd00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4009880 tx=0x7fa0e402a5d0 comp rx=0 tx=0).stop 2024-09-12T12:17:26.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:26.752+0000 7fa0f0135640 1 -- 172.21.15.102:0/3928463858 shutdown_connections 2024-09-12T12:17:26.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:26.752+0000 7fa0f0135640 1 --2- 172.21.15.102:0/3928463858 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0e80ff900 0x7fa0e80ffd00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:26.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:26.752+0000 7fa0f0135640 1 -- 172.21.15.102:0/3928463858 >> 172.21.15.102:0/3928463858 conn(0x7fa0e80fb450 msgr2=0x7fa0e80fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:26.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:26.752+0000 7fa0f0135640 1 -- 172.21.15.102:0/3928463858 shutdown_connections 2024-09-12T12:17:26.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:26.752+0000 7fa0f0135640 1 -- 172.21.15.102:0/3928463858 wait complete. 2024-09-12T12:17:26.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:26.753+0000 7fa0f0135640 1 Processor -- start 2024-09-12T12:17:26.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:26.753+0000 7fa0f0135640 1 -- start start 2024-09-12T12:17:26.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:26.753+0000 7fa0f0135640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0e80ff900 0x7fa0e8196ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:26.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:26.753+0000 7fa0f0135640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e8107590 con 0x7fa0e80ff900 2024-09-12T12:17:26.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:26.753+0000 7fa0eded1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0e80ff900 0x7fa0e8196ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:26.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:26.753+0000 7fa0eded1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0e80ff900 0x7fa0e8196ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.102:34518/0 (socket says 172.21.15.102:34518) 2024-09-12T12:17:26.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:26.753+0000 7fa0eded1640 1 -- 172.21.15.102:0/1908720609 learned_addr learned my addr 172.21.15.102:0/1908720609 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-12T12:17:26.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:26.754+0000 7fa0eded1640 1 -- 172.21.15.102:0/1908720609 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0e8197220 con 0x7fa0e80ff900 2024-09-12T12:17:26.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:26.754+0000 7fa0eded1640 1 --2- 172.21.15.102:0/1908720609 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0e80ff900 0x7fa0e8196ce0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4009230 tx=0x7fa0e40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:26.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:26.754+0000 7fa0deffd640 1 -- 172.21.15.102:0/1908720609 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0e403f070 con 0x7fa0e80ff900 2024-09-12T12:17:26.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:26.754+0000 7fa0deffd640 1 -- 172.21.15.102:0/1908720609 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa0e4003aa0 con 0x7fa0e80ff900 2024-09-12T12:17:26.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:26.754+0000 7fa0f0135640 1 -- 172.21.15.102:0/1908720609 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0e81974b0 con 0x7fa0e80ff900 2024-09-12T12:17:26.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:26.754+0000 7fa0deffd640 1 -- 172.21.15.102:0/1908720609 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0e4035030 con 0x7fa0e80ff900 2024-09-12T12:17:26.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:26.754+0000 7fa0f0135640 1 -- 172.21.15.102:0/1908720609 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0e819a190 con 0x7fa0e80ff900 2024-09-12T12:17:26.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:26.755+0000 7fa0deffd640 1 -- 172.21.15.102:0/1908720609 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fa0e4042070 con 0x7fa0e80ff900 2024-09-12T12:17:26.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:26.755+0000 7fa0deffd640 1 --2- 172.21.15.102:0/1908720609 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fa0d4039060 0x7fa0d403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:26.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:26.755+0000 7fa0f0135640 1 -- 172.21.15.102:0/1908720609 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0e8107d10 con 0x7fa0e80ff900 2024-09-12T12:17:26.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:26.755+0000 7fa0deffd640 1 -- 172.21.15.102:0/1908720609 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa0e406cf10 con 0x7fa0e80ff900 2024-09-12T12:17:26.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:26.756+0000 7fa0ed6d0640 1 --2- 172.21.15.102:0/1908720609 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fa0d4039060 0x7fa0d403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:26.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:26.756+0000 7fa0ed6d0640 1 --2- 172.21.15.102:0/1908720609 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fa0d4039060 0x7fa0d403b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa0d80098c0 tx=0x7fa0d8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:26.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:26.760+0000 7fa0deffd640 1 -- 172.21.15.102:0/1908720609 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa0e402f300 con 0x7fa0e80ff900 2024-09-12T12:17:26.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:26.943+0000 7fa0f0135640 1 -- 172.21.15.102:0/1908720609 --> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi033:172.21.15.33=a;smithi043:172.21.15.43=b;smithi102:172.21.15.102=c", "target": ["mon-mgr", ""]}) -- 0x7fa0e802da00 con 0x7fa0d4039060 2024-09-12T12:17:26.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:26.949+0000 7fa0deffd640 1 -- 172.21.15.102:0/1908720609 <== mgr.14150 v2:172.21.15.33:6800/176202431 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fa0e802da00 con 0x7fa0d4039060 2024-09-12T12:17:26.949 INFO:teuthology.orchestra.run.smithi102.stdout:Scheduled mon update... 2024-09-12T12:17:26.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:26.951+0000 7fa0f0135640 1 -- 172.21.15.102:0/1908720609 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fa0d4039060 msgr2=0x7fa0d403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:26.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:26.951+0000 7fa0f0135640 1 --2- 172.21.15.102:0/1908720609 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fa0d4039060 0x7fa0d403b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa0d80098c0 tx=0x7fa0d8006db0 comp rx=0 tx=0).stop 2024-09-12T12:17:26.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:26.951+0000 7fa0f0135640 1 -- 172.21.15.102:0/1908720609 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0e80ff900 msgr2=0x7fa0e8196ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:26.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:26.951+0000 7fa0f0135640 1 --2- 172.21.15.102:0/1908720609 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0e80ff900 0x7fa0e8196ce0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4009230 tx=0x7fa0e40048f0 comp rx=0 tx=0).stop 2024-09-12T12:17:26.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:26.951+0000 7fa0f0135640 1 -- 172.21.15.102:0/1908720609 shutdown_connections 2024-09-12T12:17:26.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:26.951+0000 7fa0f0135640 1 --2- 172.21.15.102:0/1908720609 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fa0d4039060 0x7fa0d403b520 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:26.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:26.951+0000 7fa0f0135640 1 --2- 172.21.15.102:0/1908720609 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0e80ff900 0x7fa0e8196ce0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:26.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:26.951+0000 7fa0f0135640 1 -- 172.21.15.102:0/1908720609 >> 172.21.15.102:0/1908720609 conn(0x7fa0e80fb450 msgr2=0x7fa0e80fbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:26.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:26.951+0000 7fa0f0135640 1 -- 172.21.15.102:0/1908720609 shutdown_connections 2024-09-12T12:17:26.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:26.951+0000 7fa0f0135640 1 -- 172.21.15.102:0/1908720609 wait complete. 2024-09-12T12:17:27.547 DEBUG:teuthology.orchestra.run.smithi043:mon.b> sudo journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mon.b.service 2024-09-12T12:17:27.550 DEBUG:teuthology.orchestra.run.smithi102:mon.c> sudo journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mon.c.service 2024-09-12T12:17:27.552 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T12:17:27.552 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T12:17:27.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:27 smithi033 ceph-mon[31246]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:27.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:27 smithi033 ceph-mon[31246]: Updating smithi102:/etc/ceph/ceph.conf 2024-09-12T12:17:27.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:27 smithi033 ceph-mon[31246]: Updating smithi102:/var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:17:27.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:27 smithi033 ceph-mon[31246]: Updating smithi102:/etc/ceph/ceph.client.admin.keyring 2024-09-12T12:17:27.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:27 smithi033 ceph-mon[31246]: Updating smithi102:/var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T12:17:27.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:27 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:27.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:27 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:27.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:27 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:27.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:27 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:27.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:27 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:17:27.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:27 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:27.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:27 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:17:27.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:27 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:27.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:27 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T12:17:27.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:27 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:28.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:28 smithi033 ceph-mon[31246]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi033:172.21.15.33=a;smithi043:172.21.15.43=b;smithi102:172.21.15.102=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:17:28.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:28 smithi033 ceph-mon[31246]: Saving service mon spec with placement smithi033:172.21.15.33=a;smithi043:172.21.15.43=b;smithi102:172.21.15.102=c;count:3 2024-09-12T12:17:28.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:28 smithi033 ceph-mon[31246]: Deploying daemon mon.c on smithi102 2024-09-12T12:17:29.562 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:17:29.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:29 smithi033 ceph-mon[31246]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:30.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:30.098+0000 7f68d564f640 1 -- 172.21.15.102:0/3653273290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68d0106650 msgr2=0x7f68d0106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:30.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:30.098+0000 7f68d564f640 1 --2- 172.21.15.102:0/3653273290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68d0106650 0x7f68d0106a30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f68c0009880 tx=0x7f68c002a5d0 comp rx=0 tx=0).stop 2024-09-12T12:17:30.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:30.098+0000 7f68d564f640 1 -- 172.21.15.102:0/3653273290 shutdown_connections 2024-09-12T12:17:30.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:30.098+0000 7f68d564f640 1 --2- 172.21.15.102:0/3653273290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68d0106650 0x7f68d0106a30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:30.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:30.098+0000 7f68d564f640 1 -- 172.21.15.102:0/3653273290 >> 172.21.15.102:0/3653273290 conn(0x7f68d00fc280 msgr2=0x7f68d00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:30.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:30.098+0000 7f68d564f640 1 -- 172.21.15.102:0/3653273290 shutdown_connections 2024-09-12T12:17:30.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:30.098+0000 7f68d564f640 1 -- 172.21.15.102:0/3653273290 wait complete. 2024-09-12T12:17:30.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:30.099+0000 7f68d564f640 1 Processor -- start 2024-09-12T12:17:30.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:30.099+0000 7f68d564f640 1 -- start start 2024-09-12T12:17:30.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:30.099+0000 7f68d564f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68d0106650 0x7f68d00fc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:30.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:30.099+0000 7f68d564f640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f68d010ab30 con 0x7f68d0106650 2024-09-12T12:17:30.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:30.100+0000 7f68ceffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68d0106650 0x7f68d00fc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:30.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:30.100+0000 7f68ceffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68d0106650 0x7f68d00fc730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.102:34536/0 (socket says 172.21.15.102:34536) 2024-09-12T12:17:30.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:30.100+0000 7f68ceffd640 1 -- 172.21.15.102:0/60909329 learned_addr learned my addr 172.21.15.102:0/60909329 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-12T12:17:30.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:30.100+0000 7f68ceffd640 1 -- 172.21.15.102:0/60909329 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68d00fe620 con 0x7f68d0106650 2024-09-12T12:17:30.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:30.100+0000 7f68ceffd640 1 --2- 172.21.15.102:0/60909329 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68d0106650 0x7f68d00fc730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f68c0009230 tx=0x7f68c00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:30.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:30.100+0000 7f68b7fff640 1 -- 172.21.15.102:0/60909329 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68c003f070 con 0x7f68d0106650 2024-09-12T12:17:30.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:30.100+0000 7f68d564f640 1 -- 172.21.15.102:0/60909329 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68d00fcc70 con 0x7f68d0106650 2024-09-12T12:17:30.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:30.100+0000 7f68b7fff640 1 -- 172.21.15.102:0/60909329 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f68c0004d10 con 0x7f68d0106650 2024-09-12T12:17:30.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:30.100+0000 7f68b7fff640 1 -- 172.21.15.102:0/60909329 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68c0035030 con 0x7f68d0106650 2024-09-12T12:17:30.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:30.100+0000 7f68d564f640 1 -- 172.21.15.102:0/60909329 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68d00fd130 con 0x7f68d0106650 2024-09-12T12:17:30.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:30.101+0000 7f68b7fff640 1 -- 172.21.15.102:0/60909329 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f68c0042070 con 0x7f68d0106650 2024-09-12T12:17:30.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:30.102+0000 7f68d564f640 1 -- 172.21.15.102:0/60909329 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68d0101cc0 con 0x7f68d0106650 2024-09-12T12:17:30.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:30.102+0000 7f68b7fff640 1 --2- 172.21.15.102:0/60909329 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f68b8039060 0x7f68b803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:30.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:30.102+0000 7f68b7fff640 1 -- 172.21.15.102:0/60909329 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f68c006cd00 con 0x7f68d0106650 2024-09-12T12:17:30.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:30.102+0000 7f68ce7fc640 1 --2- 172.21.15.102:0/60909329 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f68b8039060 0x7f68b803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:30.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:30.102+0000 7f68ce7fc640 1 --2- 172.21.15.102:0/60909329 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f68b8039060 0x7f68b803b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f68c40098c0 tx=0x7f68c4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:30.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:30.107+0000 7f68b7fff640 1 -- 172.21.15.102:0/60909329 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f68c0039350 con 0x7f68d0106650 2024-09-12T12:17:30.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:30.363+0000 7f68d564f640 1 -- 172.21.15.102:0/60909329 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f68d00fdc60 con 0x7f68d0106650 2024-09-12T12:17:30.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:30.364+0000 7f68b7fff640 1 -- 172.21.15.102:0/60909329 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f68c002f300 con 0x7f68d0106650 2024-09-12T12:17:30.365 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T12:17:30.365 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":1,"fsid":"a66dfafc-7100-11ef-bcea-c7b262605968","modified":"2024-09-12T12:16:08.918919Z","created":"2024-09-12T12:16:08.918919Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-12T12:17:30.365 INFO:teuthology.orchestra.run.smithi102.stderr:dumped monmap epoch 1 2024-09-12T12:17:30.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:30.366+0000 7f68d564f640 1 -- 172.21.15.102:0/60909329 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f68b8039060 msgr2=0x7f68b803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:30.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:30.366+0000 7f68d564f640 1 --2- 172.21.15.102:0/60909329 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f68b8039060 0x7f68b803b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f68c40098c0 tx=0x7f68c4006db0 comp rx=0 tx=0).stop 2024-09-12T12:17:30.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:30.366+0000 7f68d564f640 1 -- 172.21.15.102:0/60909329 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68d0106650 msgr2=0x7f68d00fc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:30.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:30.366+0000 7f68d564f640 1 --2- 172.21.15.102:0/60909329 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68d0106650 0x7f68d00fc730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f68c0009230 tx=0x7f68c00048f0 comp rx=0 tx=0).stop 2024-09-12T12:17:30.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:30.366+0000 7f68d564f640 1 -- 172.21.15.102:0/60909329 shutdown_connections 2024-09-12T12:17:30.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:30.366+0000 7f68d564f640 1 --2- 172.21.15.102:0/60909329 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f68b8039060 0x7f68b803b520 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:30.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:30.366+0000 7f68d564f640 1 --2- 172.21.15.102:0/60909329 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68d0106650 0x7f68d00fc730 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:30.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:30.366+0000 7f68d564f640 1 -- 172.21.15.102:0/60909329 >> 172.21.15.102:0/60909329 conn(0x7f68d00fc280 msgr2=0x7f68d0069c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:30.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:30.366+0000 7f68d564f640 1 -- 172.21.15.102:0/60909329 shutdown_connections 2024-09-12T12:17:30.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:30.366+0000 7f68d564f640 1 -- 172.21.15.102:0/60909329 wait complete. 2024-09-12T12:17:31.526 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: mon.c@-1(???) e0 preinit fsid a66dfafc-7100-11ef-bcea-c7b262605968 2024-09-12T12:17:31.527 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: mon.c@-1(synchronizing).mds e1 new map 2024-09-12T12:17:31.527 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-12T12:17:31.527 INFO:journalctl@ceph.mon.c.smithi102.stdout: e1 2024-09-12T12:17:31.527 INFO:journalctl@ceph.mon.c.smithi102.stdout: btime 2024-09-12T12:16:11:904584+0000 2024-09-12T12:17:31.527 INFO:journalctl@ceph.mon.c.smithi102.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T12:17:31.527 INFO:journalctl@ceph.mon.c.smithi102.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T12:17:31.527 INFO:journalctl@ceph.mon.c.smithi102.stdout: legacy client fscid: -1 2024-09-12T12:17:31.527 INFO:journalctl@ceph.mon.c.smithi102.stdout: 2024-09-12T12:17:31.527 INFO:journalctl@ceph.mon.c.smithi102.stdout: No filesystems configured 2024-09-12T12:17:31.527 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-12T12:17:31.730 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:31 smithi033 ceph-mon[31246]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:31.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:31 smithi033 ceph-mon[31246]: from='client.? 172.21.15.102:0/60909329' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T12:17:31.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-12T12:17:31.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-12T12:17:31.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-12T12:17:31.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-12T12:17:31.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-12T12:17:31.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-12T12:17:31.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T12:17:31.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T12:17:31.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T12:17:31.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:31.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:17:31.898 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:31.898 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/3316798499' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-12T12:17:31.898 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/3316798499' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-12T12:17:31.898 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T12:17:31.898 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:31.898 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:31.898 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:31.898 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:31.898 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi102", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:17:31.898 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:31.898 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:17:31.898 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:31.898 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: Updating smithi102:/etc/ceph/ceph.conf 2024-09-12T12:17:31.899 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: Updating smithi102:/var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:17:31.899 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: Updating smithi102:/etc/ceph/ceph.client.admin.keyring 2024-09-12T12:17:31.899 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: Updating smithi102:/var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T12:17:31.899 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:31.899 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:31.899 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:31.899 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:31.899 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:17:31.899 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:31.899 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:17:31.899 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:31.899 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T12:17:31.899 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:31.900 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi033:172.21.15.33=a;smithi043:172.21.15.43=b;smithi102:172.21.15.102=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:17:31.900 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: Saving service mon spec with placement smithi033:172.21.15.33=a;smithi043:172.21.15.43=b;smithi102:172.21.15.102=c;count:3 2024-09-12T12:17:31.900 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: Deploying daemon mon.c on smithi102 2024-09-12T12:17:31.900 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:31.900 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:31.900 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: from='client.? 172.21.15.102:0/60909329' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T12:17:31.900 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 ceph-mon[34799]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-12T12:17:31.900 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 bash[34780]: 63281261a8199382a971b5e2b2284deeb14bbf2be0992b3ef9c5356ca62a9e2e 2024-09-12T12:17:31.900 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:31 smithi102 systemd[1]: Started Ceph mon.c for a66dfafc-7100-11ef-bcea-c7b262605968. 2024-09-12T12:17:32.034 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T12:17:32.035 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T12:17:32.283 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:17:36.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:36 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:17:36.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:36 smithi102 ceph-mon[34799]: mon.a calling monitor election 2024-09-12T12:17:36.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:36 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:17:36.898 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:36 smithi102 ceph-mon[34799]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:36.898 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:36 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:17:36.898 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:36 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:17:36.898 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:36 smithi102 ceph-mon[34799]: mon.c calling monitor election 2024-09-12T12:17:36.898 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:36 smithi102 ceph-mon[34799]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:36.898 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:36 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:17:36.898 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:36 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:17:36.898 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:36 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:17:36.898 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:36 smithi102 ceph-mon[34799]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T12:17:36.899 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:36 smithi102 ceph-mon[34799]: monmap epoch 2 2024-09-12T12:17:36.899 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:36 smithi102 ceph-mon[34799]: fsid a66dfafc-7100-11ef-bcea-c7b262605968 2024-09-12T12:17:36.899 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:36 smithi102 ceph-mon[34799]: last_changed 2024-09-12T12:17:31.536453+0000 2024-09-12T12:17:36.899 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:36 smithi102 ceph-mon[34799]: created 2024-09-12T12:16:08.918919+0000 2024-09-12T12:17:36.899 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:36 smithi102 ceph-mon[34799]: min_mon_release 19 (squid) 2024-09-12T12:17:36.899 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:36 smithi102 ceph-mon[34799]: election_strategy: 1 2024-09-12T12:17:36.899 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:36 smithi102 ceph-mon[34799]: 0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T12:17:36.899 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:36 smithi102 ceph-mon[34799]: 1: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.c 2024-09-12T12:17:36.899 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:36 smithi102 ceph-mon[34799]: fsmap 2024-09-12T12:17:36.899 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:36 smithi102 ceph-mon[34799]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T12:17:36.899 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:36 smithi102 ceph-mon[34799]: mgrmap e13: x(active, since 38s) 2024-09-12T12:17:36.899 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:36 smithi102 ceph-mon[34799]: overall HEALTH_OK 2024-09-12T12:17:36.900 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:36 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:36.900 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:36 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:36.900 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:36 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:36.900 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:36 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T12:17:36.900 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:36 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:36.985 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:36 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:17:36.985 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:36 smithi033 ceph-mon[31246]: mon.a calling monitor election 2024-09-12T12:17:36.985 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:36 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:17:36.986 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:36 smithi033 ceph-mon[31246]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:36.986 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:36 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:17:36.986 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:36 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:17:36.986 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:36 smithi033 ceph-mon[31246]: mon.c calling monitor election 2024-09-12T12:17:36.986 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:36 smithi033 ceph-mon[31246]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:36.987 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:36 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:17:36.987 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:36 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:17:36.987 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:36 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:17:36.987 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:36 smithi033 ceph-mon[31246]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T12:17:36.987 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:36 smithi033 ceph-mon[31246]: monmap epoch 2 2024-09-12T12:17:36.988 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:36 smithi033 ceph-mon[31246]: fsid a66dfafc-7100-11ef-bcea-c7b262605968 2024-09-12T12:17:36.988 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:36 smithi033 ceph-mon[31246]: last_changed 2024-09-12T12:17:31.536453+0000 2024-09-12T12:17:36.988 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:36 smithi033 ceph-mon[31246]: created 2024-09-12T12:16:08.918919+0000 2024-09-12T12:17:36.988 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:36 smithi033 ceph-mon[31246]: min_mon_release 19 (squid) 2024-09-12T12:17:36.988 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:36 smithi033 ceph-mon[31246]: election_strategy: 1 2024-09-12T12:17:36.989 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:36 smithi033 ceph-mon[31246]: 0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T12:17:36.989 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:36 smithi033 ceph-mon[31246]: 1: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.c 2024-09-12T12:17:36.989 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:36 smithi033 ceph-mon[31246]: fsmap 2024-09-12T12:17:36.989 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:36 smithi033 ceph-mon[31246]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T12:17:36.989 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:36 smithi033 ceph-mon[31246]: mgrmap e13: x(active, since 38s) 2024-09-12T12:17:36.989 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:36 smithi033 ceph-mon[31246]: overall HEALTH_OK 2024-09-12T12:17:36.989 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:36 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:36.990 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:36 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:36.990 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:36 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:36.990 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:36 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T12:17:36.990 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:36 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:37.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.121+0000 7f2d34514640 1 -- 172.21.15.102:0/2231872409 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d18003530 msgr2=0x7f2d180059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:37.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.121+0000 7f2d34514640 1 --2- 172.21.15.102:0/2231872409 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d18003530 0x7f2d180059c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c1016c0 tx=0x7f2d2802c490 comp rx=0 tx=0).stop 2024-09-12T12:17:37.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.121+0000 7f2d34514640 1 -- 172.21.15.102:0/2231872409 shutdown_connections 2024-09-12T12:17:37.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.121+0000 7f2d34514640 1 --2- 172.21.15.102:0/2231872409 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d18003530 0x7f2d180059c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:37.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.121+0000 7f2d34514640 1 -- 172.21.15.102:0/2231872409 >> 172.21.15.102:0/2231872409 conn(0x7f2d2c0fc280 msgr2=0x7f2d2c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:37.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.121+0000 7f2d34514640 1 -- 172.21.15.102:0/2231872409 shutdown_connections 2024-09-12T12:17:37.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.121+0000 7f2d34514640 1 -- 172.21.15.102:0/2231872409 wait complete. 2024-09-12T12:17:37.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.122+0000 7f2d34514640 1 Processor -- start 2024-09-12T12:17:37.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.122+0000 7f2d34514640 1 -- start start 2024-09-12T12:17:37.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.123+0000 7f2d34514640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d18003530 0x7f2d2c199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:37.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.123+0000 7f2d34514640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2d2c199940 0x7f2d2c19dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:37.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.123+0000 7f2d34514640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2d2c108540 con 0x7f2d18003530 2024-09-12T12:17:37.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.123+0000 7f2d34514640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2d2c1083c0 con 0x7f2d2c199940 2024-09-12T12:17:37.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.123+0000 7f2d31aaf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2d2c199940 0x7f2d2c19dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:37.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.123+0000 7f2d322b0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d18003530 0x7f2d2c199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:37.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.123+0000 7f2d31aaf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2d2c199940 0x7f2d2c19dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51192/0 (socket says 172.21.15.102:51192) 2024-09-12T12:17:37.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.123+0000 7f2d31aaf640 1 -- 172.21.15.102:0/2554301525 learned_addr learned my addr 172.21.15.102:0/2554301525 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-12T12:17:37.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.123+0000 7f2d31aaf640 1 -- 172.21.15.102:0/2554301525 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2d2c199940 msgr2=0x7f2d2c19dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-12T12:17:37.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.123+0000 7f2d31aaf640 1 -- 172.21.15.102:0/2554301525 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2d2c199940 msgr2=0x7f2d2c19dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T12:17:37.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.123+0000 7f2d31aaf640 1 --2- 172.21.15.102:0/2554301525 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2d2c199940 0x7f2d2c19dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T12:17:37.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.123+0000 7f2d31aaf640 1 --2- 172.21.15.102:0/2554301525 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2d2c199940 0x7f2d2c19dcd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T12:17:37.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.123+0000 7f2d322b0640 1 -- 172.21.15.102:0/2554301525 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2d2c199940 msgr2=0x7f2d2c19dcd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T12:17:37.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.123+0000 7f2d322b0640 1 --2- 172.21.15.102:0/2554301525 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2d2c199940 0x7f2d2c19dcd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:37.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.123+0000 7f2d322b0640 1 -- 172.21.15.102:0/2554301525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d2c199f60 con 0x7f2d18003530 2024-09-12T12:17:37.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.123+0000 7f2d322b0640 1 --2- 172.21.15.102:0/2554301525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d18003530 0x7f2d2c199400 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2d2802ca80 tx=0x7f2d280339a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:37.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.124+0000 7f2d237fe640 1 -- 172.21.15.102:0/2554301525 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f2d28005200 con 0x7f2d18003530 2024-09-12T12:17:37.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.124+0000 7f2d237fe640 1 -- 172.21.15.102:0/2554301525 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2d28032ca0 con 0x7f2d18003530 2024-09-12T12:17:37.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.124+0000 7f2d34514640 1 -- 172.21.15.102:0/2554301525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d2c19e210 con 0x7f2d18003530 2024-09-12T12:17:37.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.124+0000 7f2d237fe640 1 -- 172.21.15.102:0/2554301525 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f2d28004b90 con 0x7f2d18003530 2024-09-12T12:17:37.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.124+0000 7f2d34514640 1 -- 172.21.15.102:0/2554301525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d2c19e7a0 con 0x7f2d18003530 2024-09-12T12:17:37.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.125+0000 7f2d237fe640 1 -- 172.21.15.102:0/2554301525 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f2d28043020 con 0x7f2d18003530 2024-09-12T12:17:37.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.125+0000 7f2d237fe640 1 --2- 172.21.15.102:0/2554301525 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2d10038e50 0x7f2d1003b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:37.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.125+0000 7f2d237fe640 1 -- 172.21.15.102:0/2554301525 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2d28041020 con 0x7f2d18003530 2024-09-12T12:17:37.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.125+0000 7f2d34514640 1 -- 172.21.15.102:0/2554301525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d2c101cc0 con 0x7f2d18003530 2024-09-12T12:17:37.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.125+0000 7f2d31aaf640 1 --2- 172.21.15.102:0/2554301525 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2d10038e50 0x7f2d1003b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:37.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.126+0000 7f2d31aaf640 1 --2- 172.21.15.102:0/2554301525 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2d10038e50 0x7f2d1003b310 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c009100 tx=0x7f2d1c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:37.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.130+0000 7f2d237fe640 1 -- 172.21.15.102:0/2554301525 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2d2804a020 con 0x7f2d18003530 2024-09-12T12:17:37.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.358+0000 7f2d34514640 1 -- 172.21.15.102:0/2554301525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f2d2c19ea50 con 0x7f2d18003530 2024-09-12T12:17:37.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.359+0000 7f2d237fe640 1 -- 172.21.15.102:0/2554301525 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f2d2803ab60 con 0x7f2d18003530 2024-09-12T12:17:37.360 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T12:17:37.360 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":2,"fsid":"a66dfafc-7100-11ef-bcea-c7b262605968","modified":"2024-09-12T12:17:31.536453Z","created":"2024-09-12T12:16:08.918919Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:3300","nonce":0},{"type":"v1","addr":"172.21.15.102:6789","nonce":0}]},"addr":"172.21.15.102:6789/0","public_addr":"172.21.15.102:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-12T12:17:37.360 INFO:teuthology.orchestra.run.smithi102.stderr:dumped monmap epoch 2 2024-09-12T12:17:37.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.361+0000 7f2d34514640 1 -- 172.21.15.102:0/2554301525 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2d10038e50 msgr2=0x7f2d1003b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:37.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.361+0000 7f2d34514640 1 --2- 172.21.15.102:0/2554301525 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2d10038e50 0x7f2d1003b310 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c009100 tx=0x7f2d1c008040 comp rx=0 tx=0).stop 2024-09-12T12:17:37.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.361+0000 7f2d34514640 1 -- 172.21.15.102:0/2554301525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d18003530 msgr2=0x7f2d2c199400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:37.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.361+0000 7f2d34514640 1 --2- 172.21.15.102:0/2554301525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d18003530 0x7f2d2c199400 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2d2802ca80 tx=0x7f2d280339a0 comp rx=0 tx=0).stop 2024-09-12T12:17:37.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.361+0000 7f2d34514640 1 -- 172.21.15.102:0/2554301525 shutdown_connections 2024-09-12T12:17:37.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.361+0000 7f2d34514640 1 --2- 172.21.15.102:0/2554301525 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2d10038e50 0x7f2d1003b310 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:37.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.361+0000 7f2d34514640 1 --2- 172.21.15.102:0/2554301525 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2d2c199940 0x7f2d2c19dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:37.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.361+0000 7f2d34514640 1 --2- 172.21.15.102:0/2554301525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d18003530 0x7f2d2c199400 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:37.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.361+0000 7f2d34514640 1 -- 172.21.15.102:0/2554301525 >> 172.21.15.102:0/2554301525 conn(0x7f2d2c0fc280 msgr2=0x7f2d2c06a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:37.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.361+0000 7f2d34514640 1 -- 172.21.15.102:0/2554301525 shutdown_connections 2024-09-12T12:17:37.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:37.361+0000 7f2d34514640 1 -- 172.21.15.102:0/2554301525 wait complete. 2024-09-12T12:17:37.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:37 smithi102 ceph-mon[34799]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:37.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:37 smithi102 ceph-mon[34799]: Deploying daemon mon.b on smithi043 2024-09-12T12:17:37.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:37 smithi102 ceph-mon[34799]: from='client.? 172.21.15.102:0/2554301525' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T12:17:37.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:37 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:17:37.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:37 smithi033 ceph-mon[31246]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:37.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:37 smithi033 ceph-mon[31246]: Deploying daemon mon.b on smithi043 2024-09-12T12:17:37.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:37 smithi033 ceph-mon[31246]: from='client.? 172.21.15.102:0/2554301525' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T12:17:37.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:37 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:17:38.928 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T12:17:38.928 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T12:17:39.178 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:17:39.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.623+0000 7f194640e640 1 -- 172.21.15.102:0/3852881707 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1940106630 msgr2=0x7f1940106a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:39.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.623+0000 7f194640e640 1 --2- 172.21.15.102:0/3852881707 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1940106630 0x7f1940106a10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1930009880 tx=0x7f193002a5d0 comp rx=0 tx=0).stop 2024-09-12T12:17:39.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.623+0000 7f194640e640 1 -- 172.21.15.102:0/3852881707 shutdown_connections 2024-09-12T12:17:39.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.623+0000 7f194640e640 1 --2- 172.21.15.102:0/3852881707 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1940106630 0x7f1940106a10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:39.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.623+0000 7f194640e640 1 -- 172.21.15.102:0/3852881707 >> 172.21.15.102:0/3852881707 conn(0x7f19400fc220 msgr2=0x7f19400fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:39.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.623+0000 7f194640e640 1 -- 172.21.15.102:0/3852881707 shutdown_connections 2024-09-12T12:17:39.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.623+0000 7f194640e640 1 -- 172.21.15.102:0/3852881707 wait complete. 2024-09-12T12:17:39.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.623+0000 7f194640e640 1 Processor -- start 2024-09-12T12:17:39.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.623+0000 7f194640e640 1 -- start start 2024-09-12T12:17:39.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.624+0000 7f194640e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1940106630 0x7f19401021f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:39.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.624+0000 7f194640e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1940102730 0x7f1940102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:39.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.624+0000 7f194640e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f194010ab10 con 0x7f1940102730 2024-09-12T12:17:39.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.624+0000 7f194640e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f194010a990 con 0x7f1940106630 2024-09-12T12:17:39.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.624+0000 7f193ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1940106630 0x7f19401021f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:39.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.624+0000 7f193ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1940106630 0x7f19401021f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51208/0 (socket says 172.21.15.102:51208) 2024-09-12T12:17:39.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.624+0000 7f193ffff640 1 -- 172.21.15.102:0/612947805 learned_addr learned my addr 172.21.15.102:0/612947805 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-12T12:17:39.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.624+0000 7f193f7fe640 1 --2- 172.21.15.102:0/612947805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1940102730 0x7f1940102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:39.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.624+0000 7f193ffff640 1 -- 172.21.15.102:0/612947805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1940106630 msgr2=0x7f19401021f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-12T12:17:39.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.624+0000 7f193ffff640 1 -- 172.21.15.102:0/612947805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1940106630 msgr2=0x7f19401021f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T12:17:39.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.624+0000 7f193ffff640 1 --2- 172.21.15.102:0/612947805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1940106630 0x7f19401021f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T12:17:39.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.624+0000 7f193ffff640 1 --2- 172.21.15.102:0/612947805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1940106630 0x7f19401021f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T12:17:39.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.624+0000 7f193f7fe640 1 -- 172.21.15.102:0/612947805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1940106630 msgr2=0x7f19401021f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T12:17:39.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.624+0000 7f193f7fe640 1 --2- 172.21.15.102:0/612947805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1940106630 0x7f19401021f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:39.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.624+0000 7f193f7fe640 1 -- 172.21.15.102:0/612947805 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19401040e0 con 0x7f1940102730 2024-09-12T12:17:39.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.624+0000 7f193f7fe640 1 --2- 172.21.15.102:0/612947805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1940102730 0x7f1940102b90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f193400b400 tx=0x7f193400b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:39.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.625+0000 7f193d7fa640 1 -- 172.21.15.102:0/612947805 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f1934011630 con 0x7f1940102730 2024-09-12T12:17:39.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.625+0000 7f193d7fa640 1 -- 172.21.15.102:0/612947805 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1934011c80 con 0x7f1940102730 2024-09-12T12:17:39.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.625+0000 7f194640e640 1 -- 172.21.15.102:0/612947805 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19401a3480 con 0x7f1940102730 2024-09-12T12:17:39.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.625+0000 7f193d7fa640 1 -- 172.21.15.102:0/612947805 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f1934010d10 con 0x7f1940102730 2024-09-12T12:17:39.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.625+0000 7f194640e640 1 -- 172.21.15.102:0/612947805 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19401a3a10 con 0x7f1940102730 2024-09-12T12:17:39.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.625+0000 7f193d7fa640 1 -- 172.21.15.102:0/612947805 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f1934018020 con 0x7f1940102730 2024-09-12T12:17:39.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.625+0000 7f194640e640 1 -- 172.21.15.102:0/612947805 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1940101ca0 con 0x7f1940102730 2024-09-12T12:17:39.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.626+0000 7f193d7fa640 1 --2- 172.21.15.102:0/612947805 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f1928038e00 0x7f192803b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:39.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.626+0000 7f193d7fa640 1 -- 172.21.15.102:0/612947805 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f193404bbe0 con 0x7f1940102730 2024-09-12T12:17:39.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.626+0000 7f193ffff640 1 --2- 172.21.15.102:0/612947805 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f1928038e00 0x7f192803b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:39.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.626+0000 7f193ffff640 1 --2- 172.21.15.102:0/612947805 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f1928038e00 0x7f192803b2c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f193002abc0 tx=0x7f193002aad0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:39.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.631+0000 7f193d7fa640 1 -- 172.21.15.102:0/612947805 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f193401f020 con 0x7f1940102730 2024-09-12T12:17:39.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.860+0000 7f194640e640 1 -- 172.21.15.102:0/612947805 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f19401a3d50 con 0x7f1940102730 2024-09-12T12:17:39.861 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:39 smithi102 ceph-mon[34799]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:39.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.861+0000 7f193d7fa640 1 -- 172.21.15.102:0/612947805 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f1934018310 con 0x7f1940102730 2024-09-12T12:17:39.862 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T12:17:39.862 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":2,"fsid":"a66dfafc-7100-11ef-bcea-c7b262605968","modified":"2024-09-12T12:17:31.536453Z","created":"2024-09-12T12:16:08.918919Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:3300","nonce":0},{"type":"v1","addr":"172.21.15.102:6789","nonce":0}]},"addr":"172.21.15.102:6789/0","public_addr":"172.21.15.102:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-12T12:17:39.862 INFO:teuthology.orchestra.run.smithi102.stderr:dumped monmap epoch 2 2024-09-12T12:17:39.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.863+0000 7f194640e640 1 -- 172.21.15.102:0/612947805 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f1928038e00 msgr2=0x7f192803b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:39.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.863+0000 7f194640e640 1 --2- 172.21.15.102:0/612947805 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f1928038e00 0x7f192803b2c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f193002abc0 tx=0x7f193002aad0 comp rx=0 tx=0).stop 2024-09-12T12:17:39.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.863+0000 7f194640e640 1 -- 172.21.15.102:0/612947805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1940102730 msgr2=0x7f1940102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:39.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.863+0000 7f194640e640 1 --2- 172.21.15.102:0/612947805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1940102730 0x7f1940102b90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f193400b400 tx=0x7f193400b8c0 comp rx=0 tx=0).stop 2024-09-12T12:17:39.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.863+0000 7f194640e640 1 -- 172.21.15.102:0/612947805 shutdown_connections 2024-09-12T12:17:39.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.863+0000 7f194640e640 1 --2- 172.21.15.102:0/612947805 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f1928038e00 0x7f192803b2c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:39.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.863+0000 7f194640e640 1 --2- 172.21.15.102:0/612947805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1940102730 0x7f1940102b90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:39.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.863+0000 7f194640e640 1 --2- 172.21.15.102:0/612947805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1940106630 0x7f19401021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:39.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.863+0000 7f194640e640 1 -- 172.21.15.102:0/612947805 >> 172.21.15.102:0/612947805 conn(0x7f19400fc220 msgr2=0x7f1940104330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:39.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.863+0000 7f194640e640 1 -- 172.21.15.102:0/612947805 shutdown_connections 2024-09-12T12:17:39.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:39.863+0000 7f194640e640 1 -- 172.21.15.102:0/612947805 wait complete. 2024-09-12T12:17:39.980 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:39 smithi033 ceph-mon[31246]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:40.537 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-12T12:17:40.603 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-12T12:17:40.603 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-12T12:17:40.603 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-12T12:17:40.603 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-12T12:17:40.603 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-12T12:17:40.603 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-12T12:17:40.603 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T12:17:40.604 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T12:17:40.604 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T12:17:40.604 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:40.604 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:17:40.604 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:40.604 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/3316798499' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-12T12:17:40.604 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/3316798499' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-12T12:17:40.604 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T12:17:40.604 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:40.604 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:40.604 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:40.604 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:40.604 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi102", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:17:40.605 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:40.605 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:17:40.605 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:40.605 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: Updating smithi102:/etc/ceph/ceph.conf 2024-09-12T12:17:40.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: Updating smithi102:/var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:17:40.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: Updating smithi102:/etc/ceph/ceph.client.admin.keyring 2024-09-12T12:17:40.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: Updating smithi102:/var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T12:17:40.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:40.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:40.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:40.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:40.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:17:40.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:40.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:17:40.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:40.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T12:17:40.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:40.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi033:172.21.15.33=a;smithi043:172.21.15.43=b;smithi102:172.21.15.102=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:17:40.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: Saving service mon spec with placement smithi033:172.21.15.33=a;smithi043:172.21.15.43=b;smithi102:172.21.15.102=c;count:3 2024-09-12T12:17:40.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: Deploying daemon mon.c on smithi102 2024-09-12T12:17:40.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:40.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:40.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: from='client.? 172.21.15.102:0/60909329' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T12:17:40.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:17:40.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: mon.a calling monitor election 2024-09-12T12:17:40.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:17:40.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:40.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:17:40.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:17:40.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: mon.c calling monitor election 2024-09-12T12:17:40.868 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:40.868 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:17:40.868 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:17:40.868 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:17:40.868 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T12:17:40.868 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: monmap epoch 2 2024-09-12T12:17:40.868 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: fsid a66dfafc-7100-11ef-bcea-c7b262605968 2024-09-12T12:17:40.868 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: last_changed 2024-09-12T12:17:31.536453+0000 2024-09-12T12:17:40.868 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: created 2024-09-12T12:16:08.918919+0000 2024-09-12T12:17:40.868 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: min_mon_release 19 (squid) 2024-09-12T12:17:40.868 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: election_strategy: 1 2024-09-12T12:17:40.868 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: 0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T12:17:40.868 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: 1: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.c 2024-09-12T12:17:40.869 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: fsmap 2024-09-12T12:17:40.869 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T12:17:40.869 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: mgrmap e13: x(active, since 38s) 2024-09-12T12:17:40.869 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: overall HEALTH_OK 2024-09-12T12:17:40.869 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:40.869 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:40.869 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:40.869 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T12:17:40.869 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:40.869 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:40.869 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: Deploying daemon mon.b on smithi043 2024-09-12T12:17:40.870 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: from='client.? 172.21.15.102:0/2554301525' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T12:17:40.870 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:17:40.870 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:40.870 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 ceph-mon[34144]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-12T12:17:40.870 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 bash[34125]: 9967b2583464705ff10006c80928cb92c8f3b419db8ac6fa52c3af12e1d2d4d0 2024-09-12T12:17:40.870 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:40 smithi043 systemd[1]: Started Ceph mon.b for a66dfafc-7100-11ef-bcea-c7b262605968. 2024-09-12T12:17:41.532 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T12:17:41.532 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T12:17:41.780 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:17:45.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.744+0000 7f2ad7223640 1 -- 172.21.15.102:0/620126944 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ad0107660 msgr2=0x7f2ac0005580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:45.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.744+0000 7f2ad7223640 1 --2- 172.21.15.102:0/620126944 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ad0107660 0x7f2ac0005580 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4014d10 tx=0x7f2ac402c570 comp rx=0 tx=0).stop 2024-09-12T12:17:45.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.745+0000 7f2ad7223640 1 -- 172.21.15.102:0/620126944 shutdown_connections 2024-09-12T12:17:45.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.745+0000 7f2ad7223640 1 --2- 172.21.15.102:0/620126944 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ad0107660 0x7f2ac0005580 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:45.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.745+0000 7f2ad7223640 1 -- 172.21.15.102:0/620126944 >> 172.21.15.102:0/620126944 conn(0x7f2ad00fd320 msgr2=0x7f2ad00ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:45.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.745+0000 7f2ad7223640 1 -- 172.21.15.102:0/620126944 shutdown_connections 2024-09-12T12:17:45.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.745+0000 7f2ad7223640 1 -- 172.21.15.102:0/620126944 wait complete. 2024-09-12T12:17:45.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.745+0000 7f2ad7223640 1 Processor -- start 2024-09-12T12:17:45.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.745+0000 7f2ad7223640 1 -- start start 2024-09-12T12:17:45.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.746+0000 7f2ad7223640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ad0107660 0x7f2ad00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:45.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.746+0000 7f2ad7223640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ad0074a30 0x7f2ad0074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:45.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.746+0000 7f2ad7223640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ad01a3420 0x7f2ad01a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:45.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.746+0000 7f2ad7223640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad01095d0 con 0x7f2ad01a3420 2024-09-12T12:17:45.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.746+0000 7f2ad7223640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad0109450 con 0x7f2ad0107660 2024-09-12T12:17:45.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.746+0000 7f2ad7223640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad0109750 con 0x7f2ad0074a30 2024-09-12T12:17:45.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.746+0000 7f2acffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ad0074a30 0x7f2ad0074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:45.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.746+0000 7f2acffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ad0074a30 0x7f2ad0074e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51216/0 (socket says 172.21.15.102:51216) 2024-09-12T12:17:45.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.746+0000 7f2ad4fbf640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ad0107660 0x7f2ad00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:45.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.746+0000 7f2acffff640 1 -- 172.21.15.102:0/1646879675 learned_addr learned my addr 172.21.15.102:0/1646879675 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-12T12:17:45.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.746+0000 7f2ad57c0640 1 --2- 172.21.15.102:0/1646879675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ad01a3420 0x7f2ad01a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:45.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.746+0000 7f2acffff640 1 -- 172.21.15.102:0/1646879675 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ad0074a30 msgr2=0x7f2ad0074e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-12T12:17:45.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.746+0000 7f2acffff640 1 -- 172.21.15.102:0/1646879675 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ad0074a30 msgr2=0x7f2ad0074e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T12:17:45.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.746+0000 7f2acffff640 1 --2- 172.21.15.102:0/1646879675 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ad0074a30 0x7f2ad0074e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T12:17:45.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.746+0000 7f2ad4fbf640 1 -- 172.21.15.102:0/1646879675 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ad0107660 msgr2=0x7f2ad00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-12T12:17:45.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.746+0000 7f2acffff640 1 --2- 172.21.15.102:0/1646879675 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ad0074a30 0x7f2ad0074e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T12:17:45.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.746+0000 7f2ad4fbf640 1 -- 172.21.15.102:0/1646879675 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ad0107660 msgr2=0x7f2ad00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T12:17:45.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.746+0000 7f2ad4fbf640 1 --2- 172.21.15.102:0/1646879675 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ad0107660 0x7f2ad00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T12:17:45.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.746+0000 7f2ad4fbf640 1 --2- 172.21.15.102:0/1646879675 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ad0107660 0x7f2ad00744f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T12:17:45.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.746+0000 7f2ad57c0640 1 -- 172.21.15.102:0/1646879675 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ad0074a30 msgr2=0x7f2ad0074e90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T12:17:45.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.746+0000 7f2ad57c0640 1 --2- 172.21.15.102:0/1646879675 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ad0074a30 0x7f2ad0074e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:45.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.746+0000 7f2ad57c0640 1 -- 172.21.15.102:0/1646879675 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ad0107660 msgr2=0x7f2ad00744f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T12:17:45.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.746+0000 7f2ad57c0640 1 --2- 172.21.15.102:0/1646879675 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ad0107660 0x7f2ad00744f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:45.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.746+0000 7f2ad57c0640 1 -- 172.21.15.102:0/1646879675 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ad01a5ee0 con 0x7f2ad01a3420 2024-09-12T12:17:45.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.747+0000 7f2ad57c0640 1 --2- 172.21.15.102:0/1646879675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ad01a3420 0x7f2ad01a5810 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2ac800bd50 tx=0x7f2ac800be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:45.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.747+0000 7f2acdffb640 1 -- 172.21.15.102:0/1646879675 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac8019070 con 0x7f2ad01a3420 2024-09-12T12:17:45.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.747+0000 7f2acdffb640 1 -- 172.21.15.102:0/1646879675 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2ac80148f0 con 0x7f2ad01a3420 2024-09-12T12:17:45.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.747+0000 7f2ad7223640 1 -- 172.21.15.102:0/1646879675 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ad01a61d0 con 0x7f2ad01a3420 2024-09-12T12:17:45.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.747+0000 7f2acdffb640 1 -- 172.21.15.102:0/1646879675 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac8012910 con 0x7f2ad01a3420 2024-09-12T12:17:45.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.747+0000 7f2ad7223640 1 -- 172.21.15.102:0/1646879675 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ad01a6710 con 0x7f2ad01a3420 2024-09-12T12:17:45.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.748+0000 7f2acdffb640 1 -- 172.21.15.102:0/1646879675 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f2ac801c070 con 0x7f2ad01a3420 2024-09-12T12:17:45.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.748+0000 7f2acdffb640 1 --2- 172.21.15.102:0/1646879675 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2ab40394f0 0x7f2ab403b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:45.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.748+0000 7f2acdffb640 1 -- 172.21.15.102:0/1646879675 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2ac804bc90 con 0x7f2ad01a3420 2024-09-12T12:17:45.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.748+0000 7f2ad7223640 1 -- 172.21.15.102:0/1646879675 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ad010a680 con 0x7f2ad01a3420 2024-09-12T12:17:45.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.748+0000 7f2ad4fbf640 1 --2- 172.21.15.102:0/1646879675 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2ab40394f0 0x7f2ab403b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:45.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.749+0000 7f2ad4fbf640 1 --2- 172.21.15.102:0/1646879675 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2ab40394f0 0x7f2ab403b9b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4000c00 tx=0x7f2ac4005dc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:45.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.753+0000 7f2acdffb640 1 -- 172.21.15.102:0/1646879675 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2ac8013c30 con 0x7f2ad01a3420 2024-09-12T12:17:45.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:45 smithi102 ceph-mon[34799]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:45.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:45 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:17:45.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:45 smithi102 ceph-mon[34799]: mon.c calling monitor election 2024-09-12T12:17:45.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:45 smithi102 ceph-mon[34799]: mon.a calling monitor election 2024-09-12T12:17:45.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:45 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:17:45.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:45 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:17:45.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:45 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:17:45.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:45 smithi102 ceph-mon[34799]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:45.898 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:45 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:17:45.898 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:45 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:17:45.898 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:45 smithi102 ceph-mon[34799]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:45.898 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:45 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:17:45.898 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:45 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:17:45.898 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:45 smithi102 ceph-mon[34799]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T12:17:45.898 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:45 smithi102 ceph-mon[34799]: monmap epoch 3 2024-09-12T12:17:45.898 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:45 smithi102 ceph-mon[34799]: fsid a66dfafc-7100-11ef-bcea-c7b262605968 2024-09-12T12:17:45.898 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:45 smithi102 ceph-mon[34799]: last_changed 2024-09-12T12:17:40.542473+0000 2024-09-12T12:17:45.898 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:45 smithi102 ceph-mon[34799]: created 2024-09-12T12:16:08.918919+0000 2024-09-12T12:17:45.898 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:45 smithi102 ceph-mon[34799]: min_mon_release 19 (squid) 2024-09-12T12:17:45.898 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:45 smithi102 ceph-mon[34799]: election_strategy: 1 2024-09-12T12:17:45.898 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:45 smithi102 ceph-mon[34799]: 0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T12:17:45.898 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:45 smithi102 ceph-mon[34799]: 1: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.c 2024-09-12T12:17:45.899 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:45 smithi102 ceph-mon[34799]: 2: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.b 2024-09-12T12:17:45.899 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:45 smithi102 ceph-mon[34799]: fsmap 2024-09-12T12:17:45.899 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:45 smithi102 ceph-mon[34799]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T12:17:45.899 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:45 smithi102 ceph-mon[34799]: mgrmap e13: x(active, since 47s) 2024-09-12T12:17:45.899 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:45 smithi102 ceph-mon[34799]: overall HEALTH_OK 2024-09-12T12:17:45.899 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:45 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:45.899 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:45 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:45.899 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:45 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:45.899 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:45 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:45.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:45 smithi033 ceph-mon[31246]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:45.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:45 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:17:45.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:45 smithi033 ceph-mon[31246]: mon.c calling monitor election 2024-09-12T12:17:45.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:45 smithi033 ceph-mon[31246]: mon.a calling monitor election 2024-09-12T12:17:45.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:45 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:17:45.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:45 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:17:45.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:45 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:17:45.983 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:45 smithi033 ceph-mon[31246]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:45.983 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:45 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:17:45.983 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:45 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:17:45.983 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:45 smithi033 ceph-mon[31246]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:45.983 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:45 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:17:45.983 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:45 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:17:45.984 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:45 smithi033 ceph-mon[31246]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T12:17:45.984 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:45 smithi033 ceph-mon[31246]: monmap epoch 3 2024-09-12T12:17:45.984 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:45 smithi033 ceph-mon[31246]: fsid a66dfafc-7100-11ef-bcea-c7b262605968 2024-09-12T12:17:45.984 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:45 smithi033 ceph-mon[31246]: last_changed 2024-09-12T12:17:40.542473+0000 2024-09-12T12:17:45.984 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:45 smithi033 ceph-mon[31246]: created 2024-09-12T12:16:08.918919+0000 2024-09-12T12:17:45.984 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:45 smithi033 ceph-mon[31246]: min_mon_release 19 (squid) 2024-09-12T12:17:45.984 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:45 smithi033 ceph-mon[31246]: election_strategy: 1 2024-09-12T12:17:45.984 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:45 smithi033 ceph-mon[31246]: 0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T12:17:45.985 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:45 smithi033 ceph-mon[31246]: 1: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.c 2024-09-12T12:17:45.985 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:45 smithi033 ceph-mon[31246]: 2: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.b 2024-09-12T12:17:45.985 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:45 smithi033 ceph-mon[31246]: fsmap 2024-09-12T12:17:45.985 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:45 smithi033 ceph-mon[31246]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T12:17:45.985 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:45 smithi033 ceph-mon[31246]: mgrmap e13: x(active, since 47s) 2024-09-12T12:17:45.985 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:45 smithi033 ceph-mon[31246]: overall HEALTH_OK 2024-09-12T12:17:45.985 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:45 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:45.985 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:45 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:45.986 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:45 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:45.986 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:45 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:45.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.997+0000 7f2ad7223640 1 -- 172.21.15.102:0/1646879675 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f2ad0190cb0 con 0x7f2ad01a3420 2024-09-12T12:17:45.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:45.998+0000 7f2acdffb640 1 -- 172.21.15.102:0/1646879675 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1279 (secure 0 0 0) 0x7f2ac803b2e0 con 0x7f2ad01a3420 2024-09-12T12:17:45.999 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T12:17:45.999 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":3,"fsid":"a66dfafc-7100-11ef-bcea-c7b262605968","modified":"2024-09-12T12:17:40.542473Z","created":"2024-09-12T12:16:08.918919Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:3300","nonce":0},{"type":"v1","addr":"172.21.15.102:6789","nonce":0}]},"addr":"172.21.15.102:6789/0","public_addr":"172.21.15.102:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:3300","nonce":0},{"type":"v1","addr":"172.21.15.43:6789","nonce":0}]},"addr":"172.21.15.43:6789/0","public_addr":"172.21.15.43:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-12T12:17:46.000 INFO:teuthology.orchestra.run.smithi102.stderr:dumped monmap epoch 3 2024-09-12T12:17:46.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:46.000+0000 7f2ad7223640 1 -- 172.21.15.102:0/1646879675 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2ab40394f0 msgr2=0x7f2ab403b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:46.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:46.000+0000 7f2ad7223640 1 --2- 172.21.15.102:0/1646879675 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2ab40394f0 0x7f2ab403b9b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4000c00 tx=0x7f2ac4005dc0 comp rx=0 tx=0).stop 2024-09-12T12:17:46.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:46.000+0000 7f2ad7223640 1 -- 172.21.15.102:0/1646879675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ad01a3420 msgr2=0x7f2ad01a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:46.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:46.000+0000 7f2ad7223640 1 --2- 172.21.15.102:0/1646879675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ad01a3420 0x7f2ad01a5810 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2ac800bd50 tx=0x7f2ac800be40 comp rx=0 tx=0).stop 2024-09-12T12:17:46.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:46.000+0000 7f2ad7223640 1 -- 172.21.15.102:0/1646879675 shutdown_connections 2024-09-12T12:17:46.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:46.000+0000 7f2ad7223640 1 --2- 172.21.15.102:0/1646879675 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2ab40394f0 0x7f2ab403b9b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:46.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:46.000+0000 7f2ad7223640 1 --2- 172.21.15.102:0/1646879675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ad01a3420 0x7f2ad01a5810 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:46.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:46.000+0000 7f2ad7223640 1 --2- 172.21.15.102:0/1646879675 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ad0074a30 0x7f2ad0074e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:46.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:46.000+0000 7f2ad7223640 1 --2- 172.21.15.102:0/1646879675 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ad0107660 0x7f2ad00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:46.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:46.000+0000 7f2ad7223640 1 -- 172.21.15.102:0/1646879675 >> 172.21.15.102:0/1646879675 conn(0x7f2ad00fd320 msgr2=0x7f2ad01069a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:46.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:46.000+0000 7f2ad7223640 1 -- 172.21.15.102:0/1646879675 shutdown_connections 2024-09-12T12:17:46.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:46.000+0000 7f2ad7223640 1 -- 172.21.15.102:0/1646879675 wait complete. 2024-09-12T12:17:46.638 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-12T12:17:46.638 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-12T12:17:46.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:46 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:17:46.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:46 smithi102 ceph-mon[34799]: from='client.? 172.21.15.102:0/1646879675' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T12:17:46.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:46 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:17:46.904 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:17:46.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:46 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:17:46.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:46 smithi033 ceph-mon[31246]: from='client.? 172.21.15.102:0/1646879675' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T12:17:46.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:46 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:17:47.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.288+0000 7f437853c640 1 -- 172.21.15.33:0/3383550127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4370106540 msgr2=0x7f4370106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:47.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.288+0000 7f437853c640 1 --2- 172.21.15.33:0/3383550127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4370106540 0x7f4370106920 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f436c009810 tx=0x7f436c02a540 comp rx=0 tx=0).stop 2024-09-12T12:17:47.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.288+0000 7f437853c640 1 -- 172.21.15.33:0/3383550127 shutdown_connections 2024-09-12T12:17:47.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.288+0000 7f437853c640 1 --2- 172.21.15.33:0/3383550127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4370106540 0x7f4370106920 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:47.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.288+0000 7f437853c640 1 -- 172.21.15.33:0/3383550127 >> 172.21.15.33:0/3383550127 conn(0x7f4370077310 msgr2=0x7f43700fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:47.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.288+0000 7f437853c640 1 -- 172.21.15.33:0/3383550127 shutdown_connections 2024-09-12T12:17:47.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.288+0000 7f437853c640 1 -- 172.21.15.33:0/3383550127 wait complete. 2024-09-12T12:17:47.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.289+0000 7f437853c640 1 Processor -- start 2024-09-12T12:17:47.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.289+0000 7f437853c640 1 -- start start 2024-09-12T12:17:47.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.289+0000 7f437853c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4370106540 0x7f43701961d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:47.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.289+0000 7f437853c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4370196710 0x7f437019aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:47.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.289+0000 7f437853c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f437019afe0 0x7f437019b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:47.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.289+0000 7f437853c640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f437010a9d0 con 0x7f437019afe0 2024-09-12T12:17:47.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.289+0000 7f437853c640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f437010a850 con 0x7f4370106540 2024-09-12T12:17:47.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.289+0000 7f437853c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f437010ab50 con 0x7f4370196710 2024-09-12T12:17:47.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.289+0000 7f4376ad9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f437019afe0 0x7f437019b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:47.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.289+0000 7f4376ad9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f437019afe0 0x7f437019b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38652/0 (socket says 172.21.15.33:38652) 2024-09-12T12:17:47.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.289+0000 7f4376ad9640 1 -- 172.21.15.33:0/732825926 learned_addr learned my addr 172.21.15.33:0/732825926 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:17:47.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.290+0000 7f4375ad7640 1 --2- 172.21.15.33:0/732825926 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4370196710 0x7f437019aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:47.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.290+0000 7f43762d8640 1 --2- 172.21.15.33:0/732825926 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4370106540 0x7f43701961d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:47.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.290+0000 7f43762d8640 1 -- 172.21.15.33:0/732825926 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4370106540 msgr2=0x7f43701961d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-12T12:17:47.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.290+0000 7f43762d8640 1 -- 172.21.15.33:0/732825926 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4370106540 msgr2=0x7f43701961d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T12:17:47.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.290+0000 7f43762d8640 1 --2- 172.21.15.33:0/732825926 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4370106540 0x7f43701961d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T12:17:47.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.290+0000 7f4376ad9640 1 -- 172.21.15.33:0/732825926 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4370196710 msgr2=0x7f437019aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:47.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.290+0000 7f4376ad9640 1 --2- 172.21.15.33:0/732825926 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4370196710 0x7f437019aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:47.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.290+0000 7f4376ad9640 1 -- 172.21.15.33:0/732825926 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4370106540 msgr2=0x7f43701961d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:47.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.290+0000 7f43762d8640 1 --2- 172.21.15.33:0/732825926 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4370106540 0x7f43701961d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T12:17:47.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.290+0000 7f4376ad9640 1 --2- 172.21.15.33:0/732825926 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4370106540 0x7f43701961d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:47.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.290+0000 7f4376ad9640 1 -- 172.21.15.33:0/732825926 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43701a2d50 con 0x7f437019afe0 2024-09-12T12:17:47.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.290+0000 7f4376ad9640 1 --2- 172.21.15.33:0/732825926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f437019afe0 0x7f437019b490 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f436800ba50 tx=0x7f436800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:47.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.290+0000 7f43637fe640 1 -- 172.21.15.33:0/732825926 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4368019070 con 0x7f437019afe0 2024-09-12T12:17:47.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.290+0000 7f437853c640 1 -- 172.21.15.33:0/732825926 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4370069710 con 0x7f437019afe0 2024-09-12T12:17:47.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.290+0000 7f437853c640 1 -- 172.21.15.33:0/732825926 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4370069cd0 con 0x7f437019afe0 2024-09-12T12:17:47.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.290+0000 7f43637fe640 1 -- 172.21.15.33:0/732825926 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f436800cbe0 con 0x7f437019afe0 2024-09-12T12:17:47.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.290+0000 7f43637fe640 1 -- 172.21.15.33:0/732825926 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4368023060 con 0x7f437019afe0 2024-09-12T12:17:47.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.291+0000 7f43637fe640 1 -- 172.21.15.33:0/732825926 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f436801c070 con 0x7f437019afe0 2024-09-12T12:17:47.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.291+0000 7f43637fe640 1 --2- 172.21.15.33:0/732825926 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f435c0394f0 0x7f435c03b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:47.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.291+0000 7f43637fe640 1 -- 172.21.15.33:0/732825926 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f436804baa0 con 0x7f437019afe0 2024-09-12T12:17:47.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.291+0000 7f437853c640 1 -- 172.21.15.33:0/732825926 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4354005290 con 0x7f437019afe0 2024-09-12T12:17:47.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.292+0000 7f43762d8640 1 --2- 172.21.15.33:0/732825926 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f435c0394f0 0x7f435c03b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:47.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.292+0000 7f43762d8640 1 --2- 172.21.15.33:0/732825926 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f435c0394f0 0x7f435c03b9b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f436c0092c0 tx=0x7f436c009250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:47.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.297+0000 7f43637fe640 1 -- 172.21.15.33:0/732825926 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f436801db10 con 0x7f437019afe0 2024-09-12T12:17:47.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.474+0000 7f437853c640 1 -- 172.21.15.33:0/732825926 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f4354005580 con 0x7f437019afe0 2024-09-12T12:17:47.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.474+0000 7f43637fe640 1 -- 172.21.15.33:0/732825926 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+273 (secure 0 0 0) 0x7f436801bae0 con 0x7f437019afe0 2024-09-12T12:17:47.475 INFO:teuthology.orchestra.run.smithi033.stdout:# minimal ceph.conf for a66dfafc-7100-11ef-bcea-c7b262605968 2024-09-12T12:17:47.475 INFO:teuthology.orchestra.run.smithi033.stdout:[global] 2024-09-12T12:17:47.476 INFO:teuthology.orchestra.run.smithi033.stdout: fsid = a66dfafc-7100-11ef-bcea-c7b262605968 2024-09-12T12:17:47.476 INFO:teuthology.orchestra.run.smithi033.stdout: mon_host = [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T12:17:47.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.476+0000 7f437853c640 1 -- 172.21.15.33:0/732825926 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f435c0394f0 msgr2=0x7f435c03b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:47.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.476+0000 7f437853c640 1 --2- 172.21.15.33:0/732825926 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f435c0394f0 0x7f435c03b9b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f436c0092c0 tx=0x7f436c009250 comp rx=0 tx=0).stop 2024-09-12T12:17:47.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.476+0000 7f437853c640 1 -- 172.21.15.33:0/732825926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f437019afe0 msgr2=0x7f437019b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:47.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.476+0000 7f437853c640 1 --2- 172.21.15.33:0/732825926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f437019afe0 0x7f437019b490 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f436800ba50 tx=0x7f436800bf10 comp rx=0 tx=0).stop 2024-09-12T12:17:47.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.476+0000 7f437853c640 1 -- 172.21.15.33:0/732825926 shutdown_connections 2024-09-12T12:17:47.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.476+0000 7f437853c640 1 --2- 172.21.15.33:0/732825926 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f435c0394f0 0x7f435c03b9b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:47.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.476+0000 7f437853c640 1 --2- 172.21.15.33:0/732825926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f437019afe0 0x7f437019b490 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:47.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.476+0000 7f437853c640 1 --2- 172.21.15.33:0/732825926 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4370196710 0x7f437019aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:47.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.476+0000 7f437853c640 1 --2- 172.21.15.33:0/732825926 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4370106540 0x7f43701961d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:47.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.476+0000 7f437853c640 1 -- 172.21.15.33:0/732825926 >> 172.21.15.33:0/732825926 conn(0x7f4370077310 msgr2=0x7f43700fd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:47.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.476+0000 7f437853c640 1 -- 172.21.15.33:0/732825926 shutdown_connections 2024-09-12T12:17:47.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:47.477+0000 7f437853c640 1 -- 172.21.15.33:0/732825926 wait complete. 2024-09-12T12:17:47.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:47 smithi043 ceph-mon[34144]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:47.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:47 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:17:47.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:47 smithi043 ceph-mon[34144]: mon.c calling monitor election 2024-09-12T12:17:47.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:47 smithi043 ceph-mon[34144]: mon.a calling monitor election 2024-09-12T12:17:47.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:47 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:17:47.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:47 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:17:47.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:47 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:17:47.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:47 smithi043 ceph-mon[34144]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:47.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:47 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:17:47.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:47 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:17:47.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:47 smithi043 ceph-mon[34144]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:47.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:47 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:17:47.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:47 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:17:47.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:47 smithi043 ceph-mon[34144]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T12:17:47.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:47 smithi043 ceph-mon[34144]: monmap epoch 3 2024-09-12T12:17:47.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:47 smithi043 ceph-mon[34144]: fsid a66dfafc-7100-11ef-bcea-c7b262605968 2024-09-12T12:17:47.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:47 smithi043 ceph-mon[34144]: last_changed 2024-09-12T12:17:40.542473+0000 2024-09-12T12:17:47.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:47 smithi043 ceph-mon[34144]: created 2024-09-12T12:16:08.918919+0000 2024-09-12T12:17:47.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:47 smithi043 ceph-mon[34144]: min_mon_release 19 (squid) 2024-09-12T12:17:47.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:47 smithi043 ceph-mon[34144]: election_strategy: 1 2024-09-12T12:17:47.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:47 smithi043 ceph-mon[34144]: 0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T12:17:47.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:47 smithi043 ceph-mon[34144]: 1: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.c 2024-09-12T12:17:47.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:47 smithi043 ceph-mon[34144]: 2: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.b 2024-09-12T12:17:47.868 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:47 smithi043 ceph-mon[34144]: fsmap 2024-09-12T12:17:47.868 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:47 smithi043 ceph-mon[34144]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T12:17:47.868 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:47 smithi043 ceph-mon[34144]: mgrmap e13: x(active, since 47s) 2024-09-12T12:17:47.868 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:47 smithi043 ceph-mon[34144]: overall HEALTH_OK 2024-09-12T12:17:47.868 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:47 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:47.868 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:47 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:47.868 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:47 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:47.868 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:47 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:47.868 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:47 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:17:47.868 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:47 smithi043 ceph-mon[34144]: from='client.? 172.21.15.102:0/1646879675' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T12:17:47.868 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:47 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:17:48.181 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-12T12:17:48.181 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T12:17:48.181 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/ceph/ceph.conf 2024-09-12T12:17:48.210 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T12:17:48.210 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T12:17:48.278 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T12:17:48.278 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/ceph/ceph.conf 2024-09-12T12:17:48.307 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T12:17:48.307 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T12:17:48.373 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-12T12:17:48.373 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/ceph/ceph.conf 2024-09-12T12:17:48.400 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-12T12:17:48.400 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T12:17:48.465 INFO:tasks.cephadm:Adding mgr.x on smithi033 2024-09-12T12:17:48.466 INFO:tasks.cephadm:Adding mgr.y on smithi043 2024-09-12T12:17:48.466 INFO:tasks.cephadm:Adding mgr.z on smithi102 2024-09-12T12:17:48.466 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph orch apply mgr '3;smithi033=x;smithi043=y;smithi102=z' 2024-09-12T12:17:48.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:48 smithi043 ceph-mon[34144]: mon.b calling monitor election 2024-09-12T12:17:48.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:48 smithi043 ceph-mon[34144]: Updating smithi033:/etc/ceph/ceph.conf 2024-09-12T12:17:48.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:48 smithi043 ceph-mon[34144]: Updating smithi043:/etc/ceph/ceph.conf 2024-09-12T12:17:48.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:48 smithi043 ceph-mon[34144]: Updating smithi102:/etc/ceph/ceph.conf 2024-09-12T12:17:48.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:48 smithi043 ceph-mon[34144]: mon.b calling monitor election 2024-09-12T12:17:48.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:48 smithi043 ceph-mon[34144]: mon.c calling monitor election 2024-09-12T12:17:48.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:48 smithi043 ceph-mon[34144]: mon.a calling monitor election 2024-09-12T12:17:48.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:48 smithi043 ceph-mon[34144]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-12T12:17:48.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:48 smithi043 ceph-mon[34144]: monmap epoch 3 2024-09-12T12:17:48.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:48 smithi043 ceph-mon[34144]: fsid a66dfafc-7100-11ef-bcea-c7b262605968 2024-09-12T12:17:48.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:48 smithi043 ceph-mon[34144]: last_changed 2024-09-12T12:17:40.542473+0000 2024-09-12T12:17:48.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:48 smithi043 ceph-mon[34144]: created 2024-09-12T12:16:08.918919+0000 2024-09-12T12:17:48.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:48 smithi043 ceph-mon[34144]: min_mon_release 19 (squid) 2024-09-12T12:17:48.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:48 smithi043 ceph-mon[34144]: election_strategy: 1 2024-09-12T12:17:48.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:48 smithi043 ceph-mon[34144]: 0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T12:17:48.617 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:48 smithi043 ceph-mon[34144]: 1: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.c 2024-09-12T12:17:48.617 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:48 smithi043 ceph-mon[34144]: 2: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.b 2024-09-12T12:17:48.617 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:48 smithi043 ceph-mon[34144]: fsmap 2024-09-12T12:17:48.617 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:48 smithi043 ceph-mon[34144]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T12:17:48.617 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:48 smithi043 ceph-mon[34144]: mgrmap e13: x(active, since 49s) 2024-09-12T12:17:48.617 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:48 smithi043 ceph-mon[34144]: overall HEALTH_OK 2024-09-12T12:17:48.617 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:48 smithi043 ceph-mon[34144]: Updating smithi102:/var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:17:48.617 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:48 smithi043 ceph-mon[34144]: Updating smithi033:/var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:17:48.617 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:48 smithi043 ceph-mon[34144]: Updating smithi043:/var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:17:48.617 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:48 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:48.617 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:48 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:48.617 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:48 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:48.617 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:48 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:48.618 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:48 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:48.618 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:48 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:48.618 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:48 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:48.618 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:48 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:48.618 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:48 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:48.618 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:48 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:48.618 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:48 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:48.618 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:48 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:48.618 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:48 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T12:17:48.618 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:48 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T12:17:48.618 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:48 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:48.620 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:48 smithi033 ceph-mon[31246]: mon.b calling monitor election 2024-09-12T12:17:48.620 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:48 smithi033 ceph-mon[31246]: Updating smithi033:/etc/ceph/ceph.conf 2024-09-12T12:17:48.621 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:48 smithi033 ceph-mon[31246]: Updating smithi043:/etc/ceph/ceph.conf 2024-09-12T12:17:48.621 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:48 smithi033 ceph-mon[31246]: Updating smithi102:/etc/ceph/ceph.conf 2024-09-12T12:17:48.621 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:48 smithi033 ceph-mon[31246]: mon.b calling monitor election 2024-09-12T12:17:48.621 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:48 smithi033 ceph-mon[31246]: mon.c calling monitor election 2024-09-12T12:17:48.621 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:48 smithi033 ceph-mon[31246]: mon.a calling monitor election 2024-09-12T12:17:48.621 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:48 smithi033 ceph-mon[31246]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-12T12:17:48.621 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:48 smithi033 ceph-mon[31246]: monmap epoch 3 2024-09-12T12:17:48.621 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:48 smithi033 ceph-mon[31246]: fsid a66dfafc-7100-11ef-bcea-c7b262605968 2024-09-12T12:17:48.621 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:48 smithi033 ceph-mon[31246]: last_changed 2024-09-12T12:17:40.542473+0000 2024-09-12T12:17:48.621 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:48 smithi033 ceph-mon[31246]: created 2024-09-12T12:16:08.918919+0000 2024-09-12T12:17:48.621 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:48 smithi033 ceph-mon[31246]: min_mon_release 19 (squid) 2024-09-12T12:17:48.621 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:48 smithi033 ceph-mon[31246]: election_strategy: 1 2024-09-12T12:17:48.621 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:48 smithi033 ceph-mon[31246]: 0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T12:17:48.622 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:48 smithi033 ceph-mon[31246]: 1: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.c 2024-09-12T12:17:48.622 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:48 smithi033 ceph-mon[31246]: 2: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.b 2024-09-12T12:17:48.622 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:48 smithi033 ceph-mon[31246]: fsmap 2024-09-12T12:17:48.622 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:48 smithi033 ceph-mon[31246]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T12:17:48.622 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:48 smithi033 ceph-mon[31246]: mgrmap e13: x(active, since 49s) 2024-09-12T12:17:48.622 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:48 smithi033 ceph-mon[31246]: overall HEALTH_OK 2024-09-12T12:17:48.622 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:48 smithi033 ceph-mon[31246]: Updating smithi102:/var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:17:48.622 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:48 smithi033 ceph-mon[31246]: Updating smithi033:/var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:17:48.622 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:48 smithi033 ceph-mon[31246]: Updating smithi043:/var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:17:48.622 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:48 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:48.622 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:48 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:48.622 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:48 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:48.622 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:48 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:48.623 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:48 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:48.623 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:48 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:48.623 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:48 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:48.623 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:48 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:48.623 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:48 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:48.623 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:48 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:48.623 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:48 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:48.623 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:48 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:48.623 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:48 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T12:17:48.623 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:48 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T12:17:48.623 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:48 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:48.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:48 smithi102 ceph-mon[34799]: mon.b calling monitor election 2024-09-12T12:17:48.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:48 smithi102 ceph-mon[34799]: Updating smithi033:/etc/ceph/ceph.conf 2024-09-12T12:17:48.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:48 smithi102 ceph-mon[34799]: Updating smithi043:/etc/ceph/ceph.conf 2024-09-12T12:17:48.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:48 smithi102 ceph-mon[34799]: Updating smithi102:/etc/ceph/ceph.conf 2024-09-12T12:17:48.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:48 smithi102 ceph-mon[34799]: mon.b calling monitor election 2024-09-12T12:17:48.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:48 smithi102 ceph-mon[34799]: mon.c calling monitor election 2024-09-12T12:17:48.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:48 smithi102 ceph-mon[34799]: mon.a calling monitor election 2024-09-12T12:17:48.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:48 smithi102 ceph-mon[34799]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-12T12:17:48.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:48 smithi102 ceph-mon[34799]: monmap epoch 3 2024-09-12T12:17:48.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:48 smithi102 ceph-mon[34799]: fsid a66dfafc-7100-11ef-bcea-c7b262605968 2024-09-12T12:17:48.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:48 smithi102 ceph-mon[34799]: last_changed 2024-09-12T12:17:40.542473+0000 2024-09-12T12:17:48.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:48 smithi102 ceph-mon[34799]: created 2024-09-12T12:16:08.918919+0000 2024-09-12T12:17:48.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:48 smithi102 ceph-mon[34799]: min_mon_release 19 (squid) 2024-09-12T12:17:48.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:48 smithi102 ceph-mon[34799]: election_strategy: 1 2024-09-12T12:17:48.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:48 smithi102 ceph-mon[34799]: 0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T12:17:48.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:48 smithi102 ceph-mon[34799]: 1: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.c 2024-09-12T12:17:48.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:48 smithi102 ceph-mon[34799]: 2: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.b 2024-09-12T12:17:48.648 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:48 smithi102 ceph-mon[34799]: fsmap 2024-09-12T12:17:48.648 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:48 smithi102 ceph-mon[34799]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T12:17:48.648 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:48 smithi102 ceph-mon[34799]: mgrmap e13: x(active, since 49s) 2024-09-12T12:17:48.648 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:48 smithi102 ceph-mon[34799]: overall HEALTH_OK 2024-09-12T12:17:48.648 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:48 smithi102 ceph-mon[34799]: Updating smithi102:/var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:17:48.648 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:48 smithi102 ceph-mon[34799]: Updating smithi033:/var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:17:48.648 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:48 smithi102 ceph-mon[34799]: Updating smithi043:/var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:17:48.648 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:48 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:48.648 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:48 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:48.648 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:48 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:48.648 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:48 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:48.648 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:48 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:48.648 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:48 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:48.649 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:48 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:48.649 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:48 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:48.649 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:48 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:48.649 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:48 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:48.649 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:48 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:48.649 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:48 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:48.649 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:48 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T12:17:48.649 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:48 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T12:17:48.649 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:48 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:48.740 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:17:49.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.141+0000 7ff2cf207640 1 -- 172.21.15.102:0/2841126773 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2c81005f0 msgr2=0x7ff2c81009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:49.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.141+0000 7ff2cf207640 1 --2- 172.21.15.102:0/2841126773 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2c81005f0 0x7ff2c81009f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc009880 tx=0x7ff2bc02a5d0 comp rx=0 tx=0).stop 2024-09-12T12:17:49.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.141+0000 7ff2cf207640 1 -- 172.21.15.102:0/2841126773 shutdown_connections 2024-09-12T12:17:49.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.141+0000 7ff2cf207640 1 --2- 172.21.15.102:0/2841126773 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2c81005f0 0x7ff2c81009f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:49.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.141+0000 7ff2cf207640 1 -- 172.21.15.102:0/2841126773 >> 172.21.15.102:0/2841126773 conn(0x7ff2c80fbda0 msgr2=0x7ff2c80fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:49.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.141+0000 7ff2cf207640 1 -- 172.21.15.102:0/2841126773 shutdown_connections 2024-09-12T12:17:49.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.141+0000 7ff2cf207640 1 -- 172.21.15.102:0/2841126773 wait complete. 2024-09-12T12:17:49.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.141+0000 7ff2cf207640 1 Processor -- start 2024-09-12T12:17:49.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.142+0000 7ff2cf207640 1 -- start start 2024-09-12T12:17:49.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.142+0000 7ff2cf207640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff2c81005f0 0x7ff2c806af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:49.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.142+0000 7ff2cf207640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2c8199c90 0x7ff2c819c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:49.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.142+0000 7ff2cf207640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2c819c5c0 0x7ff2c819ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:49.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.142+0000 7ff2cf207640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c81065b0 con 0x7ff2c819c5c0 2024-09-12T12:17:49.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.142+0000 7ff2cf207640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c8106430 con 0x7ff2c8199c90 2024-09-12T12:17:49.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.142+0000 7ff2cf207640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c8106730 con 0x7ff2c81005f0 2024-09-12T12:17:49.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.142+0000 7ff2ccfa3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff2c81005f0 0x7ff2c806af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:49.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.142+0000 7ff2ccfa3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff2c81005f0 0x7ff2c806af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:53302/0 (socket says 172.21.15.102:53302) 2024-09-12T12:17:49.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.142+0000 7ff2ccfa3640 1 -- 172.21.15.102:0/329739272 learned_addr learned my addr 172.21.15.102:0/329739272 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-12T12:17:49.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.142+0000 7ff2c7fff640 1 --2- 172.21.15.102:0/329739272 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2c8199c90 0x7ff2c819c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:49.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.142+0000 7ff2cd7a4640 1 --2- 172.21.15.102:0/329739272 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2c819c5c0 0x7ff2c819ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:49.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.142+0000 7ff2ccfa3640 1 -- 172.21.15.102:0/329739272 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2c8199c90 msgr2=0x7ff2c819c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:49.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.142+0000 7ff2ccfa3640 1 --2- 172.21.15.102:0/329739272 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2c8199c90 0x7ff2c819c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:49.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.142+0000 7ff2ccfa3640 1 -- 172.21.15.102:0/329739272 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2c819c5c0 msgr2=0x7ff2c819ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:49.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.142+0000 7ff2ccfa3640 1 --2- 172.21.15.102:0/329739272 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2c819c5c0 0x7ff2c819ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:49.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.142+0000 7ff2ccfa3640 1 -- 172.21.15.102:0/329739272 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2c819f390 con 0x7ff2c81005f0 2024-09-12T12:17:49.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.142+0000 7ff2cd7a4640 1 --2- 172.21.15.102:0/329739272 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2c819c5c0 0x7ff2c819ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:17:49.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.142+0000 7ff2ccfa3640 1 --2- 172.21.15.102:0/329739272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff2c81005f0 0x7ff2c806af90 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc02ab40 tx=0x7ff2bc003cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:49.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.143+0000 7ff2c5ffb640 1 -- 172.21.15.102:0/329739272 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc03f070 con 0x7ff2c81005f0 2024-09-12T12:17:49.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.143+0000 7ff2c5ffb640 1 -- 172.21.15.102:0/329739272 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff2bc031e40 con 0x7ff2c81005f0 2024-09-12T12:17:49.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.143+0000 7ff2cf207640 1 -- 172.21.15.102:0/329739272 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2c819f5c0 con 0x7ff2c81005f0 2024-09-12T12:17:49.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.143+0000 7ff2c5ffb640 1 -- 172.21.15.102:0/329739272 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc035030 con 0x7ff2c81005f0 2024-09-12T12:17:49.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.143+0000 7ff2cf207640 1 -- 172.21.15.102:0/329739272 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2c819fb70 con 0x7ff2c81005f0 2024-09-12T12:17:49.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.143+0000 7ff2c5ffb640 1 -- 172.21.15.102:0/329739272 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7ff2bc042070 con 0x7ff2c81005f0 2024-09-12T12:17:49.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.144+0000 7ff2c5ffb640 1 --2- 172.21.15.102:0/329739272 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff2b80394f0 0x7ff2b803b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:49.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.144+0000 7ff2c5ffb640 1 -- 172.21.15.102:0/329739272 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff2bc06cd20 con 0x7ff2c81005f0 2024-09-12T12:17:49.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.144+0000 7ff2c7fff640 1 --2- 172.21.15.102:0/329739272 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff2b80394f0 0x7ff2b803b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:49.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.144+0000 7ff2cf207640 1 -- 172.21.15.102:0/329739272 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2c818f370 con 0x7ff2c81005f0 2024-09-12T12:17:49.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.144+0000 7ff2c7fff640 1 --2- 172.21.15.102:0/329739272 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff2b80394f0 0x7ff2b803b9b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff2c806b510 tx=0x7ff2b4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:49.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.149+0000 7ff2c5ffb640 1 -- 172.21.15.102:0/329739272 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff2bc04c350 con 0x7ff2c81005f0 2024-09-12T12:17:49.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.324+0000 7ff2cf207640 1 -- 172.21.15.102:0/329739272 --> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi033=x;smithi043=y;smithi102=z", "target": ["mon-mgr", ""]}) -- 0x7ff2c8062630 con 0x7ff2b80394f0 2024-09-12T12:17:49.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.331+0000 7ff2c5ffb640 1 -- 172.21.15.102:0/329739272 <== mgr.14150 v2:172.21.15.33:6800/176202431 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7ff2c8062630 con 0x7ff2b80394f0 2024-09-12T12:17:49.332 INFO:teuthology.orchestra.run.smithi102.stdout:Scheduled mgr update... 2024-09-12T12:17:49.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.333+0000 7ff2cf207640 1 -- 172.21.15.102:0/329739272 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff2b80394f0 msgr2=0x7ff2b803b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:49.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.333+0000 7ff2cf207640 1 --2- 172.21.15.102:0/329739272 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff2b80394f0 0x7ff2b803b9b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff2c806b510 tx=0x7ff2b4008040 comp rx=0 tx=0).stop 2024-09-12T12:17:49.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.333+0000 7ff2cf207640 1 -- 172.21.15.102:0/329739272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff2c81005f0 msgr2=0x7ff2c806af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:49.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.333+0000 7ff2cf207640 1 --2- 172.21.15.102:0/329739272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff2c81005f0 0x7ff2c806af90 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc02ab40 tx=0x7ff2bc003cd0 comp rx=0 tx=0).stop 2024-09-12T12:17:49.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.333+0000 7ff2cf207640 1 -- 172.21.15.102:0/329739272 shutdown_connections 2024-09-12T12:17:49.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.333+0000 7ff2cf207640 1 --2- 172.21.15.102:0/329739272 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff2b80394f0 0x7ff2b803b9b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:49.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.333+0000 7ff2cf207640 1 --2- 172.21.15.102:0/329739272 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2c819c5c0 0x7ff2c819ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:49.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.333+0000 7ff2cf207640 1 --2- 172.21.15.102:0/329739272 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2c8199c90 0x7ff2c819c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:49.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.333+0000 7ff2cf207640 1 --2- 172.21.15.102:0/329739272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff2c81005f0 0x7ff2c806af90 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:49.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.333+0000 7ff2cf207640 1 -- 172.21.15.102:0/329739272 >> 172.21.15.102:0/329739272 conn(0x7ff2c80fbda0 msgr2=0x7ff2c80fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:49.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.334+0000 7ff2cf207640 1 -- 172.21.15.102:0/329739272 shutdown_connections 2024-09-12T12:17:49.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:17:49.334+0000 7ff2cf207640 1 -- 172.21.15.102:0/329739272 wait complete. 2024-09-12T12:17:49.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:49 smithi102 ceph-mon[34799]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:49.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:49 smithi102 ceph-mon[34799]: Reconfiguring mon.a (unknown last config time)... 2024-09-12T12:17:49.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:49 smithi102 ceph-mon[34799]: Reconfiguring daemon mon.a on smithi033 2024-09-12T12:17:49.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:49 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:17:49.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:49 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:49.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:49 smithi033 ceph-mon[31246]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:49.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:49 smithi033 ceph-mon[31246]: Reconfiguring mon.a (unknown last config time)... 2024-09-12T12:17:49.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:49 smithi033 ceph-mon[31246]: Reconfiguring daemon mon.a on smithi033 2024-09-12T12:17:49.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:49 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:17:49.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:49 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:49.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:49 smithi043 ceph-mon[34144]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:49.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:49 smithi043 ceph-mon[34144]: Reconfiguring mon.a (unknown last config time)... 2024-09-12T12:17:49.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:49 smithi043 ceph-mon[34144]: Reconfiguring daemon mon.a on smithi033 2024-09-12T12:17:49.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:49 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:17:49.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:49 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:49.832 DEBUG:teuthology.orchestra.run.smithi043:mgr.y> sudo journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mgr.y.service 2024-09-12T12:17:49.835 DEBUG:teuthology.orchestra.run.smithi102:mgr.z> sudo journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mgr.z.service 2024-09-12T12:17:49.838 INFO:tasks.cephadm:Deploying OSDs... 2024-09-12T12:17:49.838 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T12:17:49.838 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T12:17:49.843 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:17:49 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:17:49.541+0000 7fd9b615b640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T12:17:49.855 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T12:17:49.855 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_1 2024-09-12T12:17:49.911 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T12:17:49.911 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T12:17:49.911 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-12T12:17:49.911 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:17:49.911 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T12:17:49.911 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-09-12 12:17:08.704611278 +0000 2024-09-12T12:17:49.911 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-09-12 12:12:39.988921325 +0000 2024-09-12T12:17:49.912 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-09-12 12:12:39.988921325 +0000 2024-09-12T12:17:49.912 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: 2024-09-12 12:12:39.988921325 +0000 2024-09-12T12:17:49.912 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T12:17:49.976 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2024-09-12T12:17:49.976 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2024-09-12T12:17:49.976 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000211463 s, 2.4 MB/s 2024-09-12T12:17:49.977 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T12:17:50.034 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_2 2024-09-12T12:17:50.091 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T12:17:50.091 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T12:17:50.091 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-12T12:17:50.091 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:17:50.091 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T12:17:50.091 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-09-12 12:17:08.741610683 +0000 2024-09-12T12:17:50.091 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-09-12 12:12:40.322915979 +0000 2024-09-12T12:17:50.091 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-09-12 12:12:40.322915979 +0000 2024-09-12T12:17:50.091 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: 2024-09-12 12:12:40.322915979 +0000 2024-09-12T12:17:50.092 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T12:17:50.155 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2024-09-12T12:17:50.155 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2024-09-12T12:17:50.155 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000212776 s, 2.4 MB/s 2024-09-12T12:17:50.156 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T12:17:50.213 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_3 2024-09-12T12:17:50.269 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T12:17:50.269 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T12:17:50.269 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-12T12:17:50.269 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:17:50.269 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T12:17:50.270 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-09-12 12:17:08.776610121 +0000 2024-09-12T12:17:50.270 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-09-12 12:12:40.657910616 +0000 2024-09-12T12:17:50.270 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-09-12 12:12:40.657910616 +0000 2024-09-12T12:17:50.270 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: 2024-09-12 12:12:40.657910616 +0000 2024-09-12T12:17:50.270 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T12:17:50.334 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2024-09-12T12:17:50.335 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2024-09-12T12:17:50.335 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.00022614 s, 2.3 MB/s 2024-09-12T12:17:50.336 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T12:17:50.393 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_4 2024-09-12T12:17:50.450 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T12:17:50.450 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T12:17:50.450 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-12T12:17:50.451 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:17:50.451 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T12:17:50.451 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-09-12 12:17:08.812609542 +0000 2024-09-12T12:17:50.451 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-09-12 12:12:40.985905365 +0000 2024-09-12T12:17:50.451 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-09-12 12:12:40.985905365 +0000 2024-09-12T12:17:50.452 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: 2024-09-12 12:12:40.985905365 +0000 2024-09-12T12:17:50.452 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T12:17:50.515 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2024-09-12T12:17:50.515 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2024-09-12T12:17:50.515 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000278929 s, 1.8 MB/s 2024-09-12T12:17:50.517 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T12:17:50.573 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T12:17:50.573 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T12:17:50.594 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T12:17:50.594 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_1 2024-09-12T12:17:50.656 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T12:17:50.656 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T12:17:50.656 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-12T12:17:50.657 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:17:50.657 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T12:17:50.657 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-09-12 12:17:39.990629390 +0000 2024-09-12T12:17:50.657 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-09-12 12:12:54.111042214 +0000 2024-09-12T12:17:50.657 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-09-12 12:12:54.111042214 +0000 2024-09-12T12:17:50.657 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2024-09-12 12:12:54.111042214 +0000 2024-09-12T12:17:50.657 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T12:17:50.674 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:50 smithi033 ceph-mon[31246]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi033=x;smithi043=y;smithi102=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:17:50.674 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:50 smithi033 ceph-mon[31246]: Saving service mgr spec with placement smithi033=x;smithi043=y;smithi102=z;count:3 2024-09-12T12:17:50.674 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:50 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:50.675 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:50 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:50.675 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:50 smithi033 ceph-mon[31246]: Reconfiguring mgr.x (unknown last config time)... 2024-09-12T12:17:50.675 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:50 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T12:17:50.675 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:50 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T12:17:50.675 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:50 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:50.675 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:50 smithi033 ceph-mon[31246]: Reconfiguring daemon mgr.x on smithi033 2024-09-12T12:17:50.725 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-09-12T12:17:50.726 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-09-12T12:17:50.726 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000126993 s, 4.0 MB/s 2024-09-12T12:17:50.727 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T12:17:50.786 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_2 2024-09-12T12:17:50.842 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T12:17:50.843 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T12:17:50.843 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-12T12:17:50.843 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:17:50.843 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T12:17:50.843 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-09-12 12:17:39.990629390 +0000 2024-09-12T12:17:50.843 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-09-12 12:12:54.443038420 +0000 2024-09-12T12:17:50.843 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-09-12 12:12:54.443038420 +0000 2024-09-12T12:17:50.843 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2024-09-12 12:12:54.443038420 +0000 2024-09-12T12:17:50.843 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T12:17:50.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:50 smithi043 ceph-mon[34144]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi033=x;smithi043=y;smithi102=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:17:50.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:50 smithi043 ceph-mon[34144]: Saving service mgr spec with placement smithi033=x;smithi043=y;smithi102=z;count:3 2024-09-12T12:17:50.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:50 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:50.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:50 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:50.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:50 smithi043 ceph-mon[34144]: Reconfiguring mgr.x (unknown last config time)... 2024-09-12T12:17:50.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:50 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T12:17:50.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:50 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T12:17:50.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:50 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:50.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:50 smithi043 ceph-mon[34144]: Reconfiguring daemon mgr.x on smithi033 2024-09-12T12:17:50.890 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-09-12T12:17:50.890 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-09-12T12:17:50.890 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000114655 s, 4.5 MB/s 2024-09-12T12:17:50.892 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T12:17:50.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:50 smithi102 ceph-mon[34799]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi033=x;smithi043=y;smithi102=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:17:50.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:50 smithi102 ceph-mon[34799]: Saving service mgr spec with placement smithi033=x;smithi043=y;smithi102=z;count:3 2024-09-12T12:17:50.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:50 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:50.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:50 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:50.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:50 smithi102 ceph-mon[34799]: Reconfiguring mgr.x (unknown last config time)... 2024-09-12T12:17:50.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:50 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T12:17:50.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:50 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T12:17:50.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:50 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:50.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:50 smithi102 ceph-mon[34799]: Reconfiguring daemon mgr.x on smithi033 2024-09-12T12:17:50.948 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_3 2024-09-12T12:17:51.007 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T12:17:51.007 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T12:17:51.007 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-12T12:17:51.007 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:17:51.007 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T12:17:51.007 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-09-12 12:17:39.991629378 +0000 2024-09-12T12:17:51.007 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-09-12 12:12:54.770034683 +0000 2024-09-12T12:17:51.007 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-09-12 12:12:54.770034683 +0000 2024-09-12T12:17:51.007 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2024-09-12 12:12:54.770034683 +0000 2024-09-12T12:17:51.008 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T12:17:51.073 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-09-12T12:17:51.073 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-09-12T12:17:51.073 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000130334 s, 3.9 MB/s 2024-09-12T12:17:51.074 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T12:17:51.131 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_4 2024-09-12T12:17:51.187 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T12:17:51.187 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T12:17:51.188 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-12T12:17:51.188 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:17:51.188 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T12:17:51.188 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-09-12 12:17:39.991629378 +0000 2024-09-12T12:17:51.188 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-09-12 12:12:55.088031049 +0000 2024-09-12T12:17:51.188 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-09-12 12:12:55.088031049 +0000 2024-09-12T12:17:51.188 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2024-09-12 12:12:55.088031049 +0000 2024-09-12T12:17:51.188 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T12:17:51.252 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-09-12T12:17:51.252 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-09-12T12:17:51.252 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000103442 s, 4.9 MB/s 2024-09-12T12:17:51.254 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T12:17:51.312 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-12T12:17:51.312 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T12:17:51.331 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T12:17:51.331 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_1 2024-09-12T12:17:51.389 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T12:17:51.389 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T12:17:51.390 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-12T12:17:51.390 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:17:51.390 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T12:17:51.390 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-12 12:17:30.537911801 +0000 2024-09-12T12:17:51.390 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-12 12:12:37.188246009 +0000 2024-09-12T12:17:51.390 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-12 12:12:37.188246009 +0000 2024-09-12T12:17:51.390 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-09-12 12:12:37.188246009 +0000 2024-09-12T12:17:51.390 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T12:17:51.456 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-12T12:17:51.456 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-12T12:17:51.456 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000207805 s, 2.5 MB/s 2024-09-12T12:17:51.458 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T12:17:51.516 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_2 2024-09-12T12:17:51.572 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T12:17:51.572 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T12:17:51.572 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-12T12:17:51.572 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:17:51.572 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T12:17:51.572 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-12 12:17:30.538911781 +0000 2024-09-12T12:17:51.572 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-12 12:12:37.515239309 +0000 2024-09-12T12:17:51.572 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-12 12:12:37.515239309 +0000 2024-09-12T12:17:51.573 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-09-12 12:12:37.515239309 +0000 2024-09-12T12:17:51.573 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T12:17:51.637 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-12T12:17:51.637 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-12T12:17:51.637 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000187444 s, 2.7 MB/s 2024-09-12T12:17:51.639 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T12:17:51.695 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_3 2024-09-12T12:17:51.751 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T12:17:51.751 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T12:17:51.751 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-12T12:17:51.751 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:17:51.751 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T12:17:51.752 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-12 12:17:30.538911781 +0000 2024-09-12T12:17:51.752 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-12 12:12:37.829232876 +0000 2024-09-12T12:17:51.752 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-12 12:12:37.829232876 +0000 2024-09-12T12:17:51.752 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-09-12 12:12:37.829232876 +0000 2024-09-12T12:17:51.752 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T12:17:51.815 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-12T12:17:51.815 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-12T12:17:51.816 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.00020856 s, 2.5 MB/s 2024-09-12T12:17:51.817 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T12:17:51.874 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_4 2024-09-12T12:17:51.930 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T12:17:51.930 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T12:17:51.930 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-12T12:17:51.930 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:17:51.930 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T12:17:51.930 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-12 12:17:30.538911781 +0000 2024-09-12T12:17:51.930 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-12 12:12:38.148226340 +0000 2024-09-12T12:17:51.931 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-12 12:12:38.148226340 +0000 2024-09-12T12:17:51.931 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-09-12 12:12:38.148226340 +0000 2024-09-12T12:17:51.931 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T12:17:51.992 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:51 smithi102 ceph-mon[34799]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:51.992 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:51 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:51.992 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:51 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:51.992 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:51 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T12:17:51.992 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:51 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T12:17:51.992 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:51 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:51.994 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-12T12:17:51.994 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-12T12:17:51.994 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000189654 s, 2.7 MB/s 2024-09-12T12:17:51.995 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T12:17:52.051 INFO:tasks.cephadm:Deploying osd.0 on smithi033 with /dev/vg_nvme/lv_4... 2024-09-12T12:17:52.052 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-12T12:17:52.079 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:51 smithi033 ceph-mon[31246]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:52.079 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:51 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:52.079 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:51 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:52.079 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:51 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T12:17:52.080 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:51 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T12:17:52.080 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:51 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:52.095 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:51 smithi043 ceph-mon[34144]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:52.095 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:51 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:52.096 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:51 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:52.096 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:51 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T12:17:52.096 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:51 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T12:17:52.096 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:51 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:52.315 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:17:52.799 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:52 smithi102 ceph-mon[34799]: Reconfiguring mon.b (monmap changed)... 2024-09-12T12:17:52.799 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:52 smithi102 ceph-mon[34799]: Reconfiguring daemon mon.b on smithi043 2024-09-12T12:17:52.799 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:52 smithi102 ceph-mon[34799]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:52.799 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:52 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:52.799 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:52 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:52.800 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:52 smithi102 ceph-mon[34799]: Reconfiguring mon.c (monmap changed)... 2024-09-12T12:17:52.800 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:52 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T12:17:52.800 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:52 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T12:17:52.800 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:52 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:52.800 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:52 smithi102 ceph-mon[34799]: Reconfiguring daemon mon.c on smithi102 2024-09-12T12:17:53.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:52 smithi043 ceph-mon[34144]: Reconfiguring mon.b (monmap changed)... 2024-09-12T12:17:53.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:52 smithi043 ceph-mon[34144]: Reconfiguring daemon mon.b on smithi043 2024-09-12T12:17:53.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:52 smithi043 ceph-mon[34144]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:53.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:52 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:53.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:52 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:53.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:52 smithi043 ceph-mon[34144]: Reconfiguring mon.c (monmap changed)... 2024-09-12T12:17:53.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:52 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T12:17:53.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:52 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T12:17:53.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:52 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:53.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:52 smithi043 ceph-mon[34144]: Reconfiguring daemon mon.c on smithi102 2024-09-12T12:17:53.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:52 smithi033 ceph-mon[31246]: Reconfiguring mon.b (monmap changed)... 2024-09-12T12:17:53.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:52 smithi033 ceph-mon[31246]: Reconfiguring daemon mon.b on smithi043 2024-09-12T12:17:53.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:52 smithi033 ceph-mon[31246]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:53.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:52 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:53.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:52 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:53.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:52 smithi033 ceph-mon[31246]: Reconfiguring mon.c (monmap changed)... 2024-09-12T12:17:53.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:52 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T12:17:53.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:52 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T12:17:53.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:52 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:53.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:52 smithi033 ceph-mon[31246]: Reconfiguring daemon mon.c on smithi102 2024-09-12T12:17:54.641 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:17:54.667 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi033:vg_nvme/lv_4 2024-09-12T12:17:54.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:54 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:54.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:54 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:54.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:54 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:17:54.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:54 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:54.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:54 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:17:54.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:54 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:54.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:54 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T12:17:54.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:54 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T12:17:54.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:54 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T12:17:54.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:54 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:54.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:54 smithi033 ceph-mon[31246]: Deploying daemon mgr.z on smithi102 2024-09-12T12:17:54.841 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:54 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:54.841 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:54 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:54.841 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:54 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:17:54.841 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:54 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:54.841 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:54 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:17:54.841 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:54 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:54.841 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:54 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T12:17:54.841 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:54 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T12:17:54.841 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:54 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T12:17:54.841 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:54 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:54.841 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:54 smithi102 ceph-mon[34799]: Deploying daemon mgr.z on smithi102 2024-09-12T12:17:54.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:54 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:54.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:54 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:54.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:54 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:17:54.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:54 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:54.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:54 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:17:54.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:54 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:54.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:54 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T12:17:54.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:54 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T12:17:54.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:54 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T12:17:54.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:54 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:54.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:54 smithi043 ceph-mon[34144]: Deploying daemon mgr.z on smithi102 2024-09-12T12:17:54.961 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:17:55.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:55.375+0000 7efd56344640 1 -- 172.21.15.33:0/3415735793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd50102e00 msgr2=0x7efd50103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:55.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:55.375+0000 7efd56344640 1 --2- 172.21.15.33:0/3415735793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd50102e00 0x7efd50103280 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7efd44009900 tx=0x7efd4402a410 comp rx=0 tx=0).stop 2024-09-12T12:17:55.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:55.375+0000 7efd56344640 1 -- 172.21.15.33:0/3415735793 shutdown_connections 2024-09-12T12:17:55.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:55.375+0000 7efd56344640 1 --2- 172.21.15.33:0/3415735793 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd501037c0 0x7efd5010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:55.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:55.375+0000 7efd56344640 1 --2- 172.21.15.33:0/3415735793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd50102e00 0x7efd50103280 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:55.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:55.375+0000 7efd56344640 1 --2- 172.21.15.33:0/3415735793 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd50101c00 0x7efd50102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:55.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:55.375+0000 7efd56344640 1 -- 172.21.15.33:0/3415735793 >> 172.21.15.33:0/3415735793 conn(0x7efd500fd390 msgr2=0x7efd500ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:55.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:55.375+0000 7efd56344640 1 -- 172.21.15.33:0/3415735793 shutdown_connections 2024-09-12T12:17:55.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:55.375+0000 7efd56344640 1 -- 172.21.15.33:0/3415735793 wait complete. 2024-09-12T12:17:55.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:55.376+0000 7efd56344640 1 Processor -- start 2024-09-12T12:17:55.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:55.376+0000 7efd56344640 1 -- start start 2024-09-12T12:17:55.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:55.376+0000 7efd56344640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd50101c00 0x7efd50197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:55.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:55.376+0000 7efd56344640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd50102e00 0x7efd50198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:55.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:55.376+0000 7efd56344640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd501037c0 0x7efd5019f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:55.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:55.376+0000 7efd56344640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7efd5010d7e0 con 0x7efd50102e00 2024-09-12T12:17:55.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:55.376+0000 7efd56344640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7efd5010d660 con 0x7efd501037c0 2024-09-12T12:17:55.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:55.376+0000 7efd56344640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7efd5010d960 con 0x7efd50101c00 2024-09-12T12:17:55.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:55.376+0000 7efd4f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd50102e00 0x7efd50198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:55.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:55.376+0000 7efd4f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd50102e00 0x7efd50198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58960/0 (socket says 172.21.15.33:58960) 2024-09-12T12:17:55.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:55.376+0000 7efd4f7fe640 1 -- 172.21.15.33:0/4062312531 learned_addr learned my addr 172.21.15.33:0/4062312531 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:17:55.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:55.376+0000 7efd4ffff640 1 --2- 172.21.15.33:0/4062312531 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd50101c00 0x7efd50197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:55.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:55.377+0000 7efd548e1640 1 --2- 172.21.15.33:0/4062312531 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd501037c0 0x7efd5019f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:55.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:55.377+0000 7efd4ffff640 1 -- 172.21.15.33:0/4062312531 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd501037c0 msgr2=0x7efd5019f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:55.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:55.377+0000 7efd4ffff640 1 --2- 172.21.15.33:0/4062312531 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd501037c0 0x7efd5019f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:55.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:55.377+0000 7efd4ffff640 1 -- 172.21.15.33:0/4062312531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd50102e00 msgr2=0x7efd50198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:55.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:55.377+0000 7efd4ffff640 1 --2- 172.21.15.33:0/4062312531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd50102e00 0x7efd50198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:55.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:55.377+0000 7efd4ffff640 1 -- 172.21.15.33:0/4062312531 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd5019faf0 con 0x7efd50101c00 2024-09-12T12:17:55.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:55.377+0000 7efd4f7fe640 1 --2- 172.21.15.33:0/4062312531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd50102e00 0x7efd50198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:17:55.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:55.377+0000 7efd4ffff640 1 --2- 172.21.15.33:0/4062312531 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd50101c00 0x7efd50197ec0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7efd4000e9c0 tx=0x7efd4000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:55.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:55.377+0000 7efd4d7fa640 1 -- 172.21.15.33:0/4062312531 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd4000ccc0 con 0x7efd50101c00 2024-09-12T12:17:55.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:55.377+0000 7efd56344640 1 -- 172.21.15.33:0/4062312531 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd5019fde0 con 0x7efd50101c00 2024-09-12T12:17:55.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:55.377+0000 7efd4d7fa640 1 -- 172.21.15.33:0/4062312531 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efd400035f0 con 0x7efd50101c00 2024-09-12T12:17:55.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:55.377+0000 7efd4d7fa640 1 -- 172.21.15.33:0/4062312531 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd4000ce60 con 0x7efd50101c00 2024-09-12T12:17:55.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:55.377+0000 7efd56344640 1 -- 172.21.15.33:0/4062312531 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd501a02c0 con 0x7efd50101c00 2024-09-12T12:17:55.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:55.378+0000 7efd4d7fa640 1 -- 172.21.15.33:0/4062312531 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7efd40010690 con 0x7efd50101c00 2024-09-12T12:17:55.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:55.378+0000 7efd4d7fa640 1 --2- 172.21.15.33:0/4062312531 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7efd380392c0 0x7efd3803b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:55.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:55.378+0000 7efd56344640 1 -- 172.21.15.33:0/4062312531 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd50108fd0 con 0x7efd50101c00 2024-09-12T12:17:55.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:55.378+0000 7efd4d7fa640 1 -- 172.21.15.33:0/4062312531 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7efd4004c890 con 0x7efd50101c00 2024-09-12T12:17:55.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:55.378+0000 7efd4f7fe640 1 --2- 172.21.15.33:0/4062312531 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7efd380392c0 0x7efd3803b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:55.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:55.379+0000 7efd4f7fe640 1 --2- 172.21.15.33:0/4062312531 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7efd380392c0 0x7efd3803b780 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efd501993e0 tx=0x7efd44005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:55.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:55.383+0000 7efd4d7fa640 1 -- 172.21.15.33:0/4062312531 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efd40020a30 con 0x7efd50101c00 2024-09-12T12:17:55.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:17:55.570+0000 7efd56344640 1 -- 172.21.15.33:0/4062312531 --> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7efd50062630 con 0x7efd380392c0 2024-09-12T12:17:55.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:55 smithi033 ceph-mon[31246]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:55.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:55 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:17:55.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:55 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:17:55.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:55 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:55.774 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:55 smithi102 ceph-mon[34799]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:55.774 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:55 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:17:55.774 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:55 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:17:55.774 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:55 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:55.774 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 12 12:17:55 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-z[36609]: 2024-09-12T12:17:55.712+0000 7f96b6fff040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T12:17:55.774 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 12 12:17:55 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-z[36609]: 2024-09-12T12:17:55.774+0000 7f96b6fff040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T12:17:55.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:55 smithi043 ceph-mon[34144]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:55.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:55 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:17:55.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:55 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:17:55.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:55 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:56.133 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 12 12:17:55 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-z[36609]: 2024-09-12T12:17:55.922+0000 7f96b6fff040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T12:17:56.133 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 12 12:17:55 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-z[36609]: 2024-09-12T12:17:55.987+0000 7f96b6fff040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T12:17:56.133 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 12 12:17:56 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-z[36609]: 2024-09-12T12:17:56.133+0000 7f96b6fff040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T12:17:56.396 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 12 12:17:56 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-z[36609]: 2024-09-12T12:17:56.270+0000 7f96b6fff040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T12:17:56.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:56 smithi043 ceph-mon[34144]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:17:56.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:56 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:56.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:56 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:56.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:56 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:56.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:56 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T12:17:56.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:56 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T12:17:56.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:56 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T12:17:56.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:56 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:56.896 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 12 12:17:56 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-z[36609]: 2024-09-12T12:17:56.579+0000 7f96b6fff040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T12:17:56.896 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 12 12:17:56 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-z[36609]: 2024-09-12T12:17:56.640+0000 7f96b6fff040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T12:17:56.896 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 12 12:17:56 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-z[36609]: 2024-09-12T12:17:56.823+0000 7f96b6fff040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T12:17:56.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:56 smithi102 ceph-mon[34799]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:17:56.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:56 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:56.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:56 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:56.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:56 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:56.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:56 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T12:17:56.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:56 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T12:17:56.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:56 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T12:17:56.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:56 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:56.969 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:56 smithi033 ceph-mon[31246]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:17:56.969 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:56 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:56.969 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:56 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:56.969 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:56 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:56.969 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:56 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T12:17:56.969 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:56 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T12:17:56.969 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:56 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T12:17:56.969 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:56 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:57.787 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:57 smithi043 ceph-mon[34144]: Deploying daemon mgr.y on smithi043 2024-09-12T12:17:57.787 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:57 smithi043 ceph-mon[34144]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:57.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:57 smithi102 ceph-mon[34799]: Deploying daemon mgr.y on smithi043 2024-09-12T12:17:57.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:57 smithi102 ceph-mon[34799]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:57.896 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 12 12:17:57 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-z[36609]: 2024-09-12T12:17:57.699+0000 7f96b6fff040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T12:17:57.897 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 12 12:17:57 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-z[36609]: 2024-09-12T12:17:57.767+0000 7f96b6fff040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T12:17:57.980 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:57 smithi033 ceph-mon[31246]: Deploying daemon mgr.y on smithi043 2024-09-12T12:17:57.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:57 smithi033 ceph-mon[31246]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:58.072 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Sep 12 12:17:58 smithi043 ceph-mgr[35517]: -- 172.21.15.43:0/4106915682 <== mon.2 v2:172.21.15.43:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5633de3610e0 con 0x5633de33f000 2024-09-12T12:17:58.352 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Sep 12 12:17:58 smithi043 bash[35498]: a16592404a0db430975cb8e5f9c280f402cdf46b04f3e6f8be147c3debf15b5f 2024-09-12T12:17:58.352 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Sep 12 12:17:58 smithi043 systemd[1]: Started Ceph mgr.y for a66dfafc-7100-11ef-bcea-c7b262605968. 2024-09-12T12:17:58.352 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Sep 12 12:17:58 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-y[35513]: 2024-09-12T12:17:58.131+0000 7f7905aa7040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T12:17:58.352 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Sep 12 12:17:58 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-y[35513]: 2024-09-12T12:17:58.192+0000 7f7905aa7040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T12:17:58.352 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Sep 12 12:17:58 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-y[35513]: 2024-09-12T12:17:58.351+0000 7f7905aa7040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T12:17:58.615 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Sep 12 12:17:58 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-y[35513]: 2024-09-12T12:17:58.422+0000 7f7905aa7040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T12:17:58.615 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Sep 12 12:17:58 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-y[35513]: 2024-09-12T12:17:58.589+0000 7f7905aa7040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T12:17:58.782 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 12 12:17:58 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-z[36609]: 2024-09-12T12:17:58.496+0000 7f96b6fff040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T12:17:58.782 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 12 12:17:58 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-z[36609]: 2024-09-12T12:17:58.637+0000 7f96b6fff040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T12:17:58.782 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 12 12:17:58 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-z[36609]: 2024-09-12T12:17:58.782+0000 7f96b6fff040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T12:17:58.783 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:58 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/2659357550' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "74b68729-c97c-4da6-a659-75d6c147ad05"}]: dispatch 2024-09-12T12:17:58.783 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:58 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/2659357550' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "74b68729-c97c-4da6-a659-75d6c147ad05"}]': finished 2024-09-12T12:17:58.783 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:58 smithi102 ceph-mon[34799]: osdmap e5: 1 total, 0 up, 1 in 2024-09-12T12:17:58.783 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:58 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:17:58.783 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:58 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:58.783 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:58 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:58.783 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:58 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:58.783 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:58 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:58.783 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:58 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:17:58.783 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:58 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/3488895412' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:17:58.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:58 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/2659357550' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "74b68729-c97c-4da6-a659-75d6c147ad05"}]: dispatch 2024-09-12T12:17:58.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:58 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/2659357550' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "74b68729-c97c-4da6-a659-75d6c147ad05"}]': finished 2024-09-12T12:17:58.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:58 smithi033 ceph-mon[31246]: osdmap e5: 1 total, 0 up, 1 in 2024-09-12T12:17:58.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:58 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:17:58.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:58 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:58.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:58 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:58.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:58 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:58.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:58 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:58.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:58 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:17:58.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:58 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/3488895412' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:17:58.986 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Sep 12 12:17:58 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-y[35513]: 2024-09-12T12:17:58.745+0000 7f7905aa7040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T12:17:58.987 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:58 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/2659357550' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "74b68729-c97c-4da6-a659-75d6c147ad05"}]: dispatch 2024-09-12T12:17:58.987 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:58 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/2659357550' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "74b68729-c97c-4da6-a659-75d6c147ad05"}]': finished 2024-09-12T12:17:58.987 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:58 smithi043 ceph-mon[34144]: osdmap e5: 1 total, 0 up, 1 in 2024-09-12T12:17:58.987 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:58 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:17:58.987 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:58 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:58.987 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:58 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:58.987 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:58 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:58.987 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:58 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:58.988 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:58 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:17:58.988 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:58 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/3488895412' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:17:59.057 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 12 12:17:58 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-z[36609]: 2024-09-12T12:17:58.846+0000 7f96b6fff040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T12:17:59.057 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 12 12:17:59 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-z[36609]: 2024-09-12T12:17:59.010+0000 7f96b6fff040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T12:17:59.348 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Sep 12 12:17:59 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-y[35513]: 2024-09-12T12:17:59.085+0000 7f7905aa7040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T12:17:59.348 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Sep 12 12:17:59 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-y[35513]: 2024-09-12T12:17:59.148+0000 7f7905aa7040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T12:17:59.348 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Sep 12 12:17:59 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-y[35513]: 2024-09-12T12:17:59.347+0000 7f7905aa7040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T12:17:59.370 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 12 12:17:59 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-z[36609]: 2024-09-12T12:17:59.080+0000 7f96b6fff040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T12:17:59.370 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 12 12:17:59 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-z[36609]: 2024-09-12T12:17:59.140+0000 7f96b6fff040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T12:17:59.370 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 12 12:17:59 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-z[36609]: 2024-09-12T12:17:59.301+0000 7f96b6fff040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T12:17:59.370 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 12 12:17:59 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-z[36609]: 2024-09-12T12:17:59.370+0000 7f96b6fff040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T12:17:59.644 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 12 12:17:59 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-z[36609]: 2024-09-12T12:17:59.437+0000 7f96b6fff040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T12:17:59.644 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 12 12:17:59 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-z[36609]: 2024-09-12T12:17:59.522+0000 7f96b6fff040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T12:17:59.644 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 12 12:17:59 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-z[36609]: 2024-09-12T12:17:59.583+0000 7f96b6fff040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T12:17:59.644 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 12 12:17:59 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-z[36609]: 2024-09-12T12:17:59.644+0000 7f96b6fff040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T12:17:59.645 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:59 smithi102 ceph-mon[34799]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:59.645 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:59 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:59.645 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:59 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:59.645 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:59 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:59.645 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:59 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:59.645 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:59 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:59.645 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:59 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:17:59.645 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:59 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:59.645 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:59 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:17:59.645 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:59 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:59.645 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:59 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:17:59.645 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:17:59 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:59.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:59 smithi033 ceph-mon[31246]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:17:59.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:59 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:59.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:59 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:59.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:59 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:59.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:59 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:59.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:59 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:59.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:59 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:17:59.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:59 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:17:59.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:59 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:17:59.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:59 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:59.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:59 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:17:59.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:17:59 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:00.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:59 smithi043 ceph-mon[34144]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:18:00.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:59 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:00.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:59 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:00.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:59 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:00.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:59 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:00.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:59 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:00.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:59 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:18:00.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:59 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:00.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:59 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:18:00.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:59 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:00.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:59 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:18:00.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:17:59 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:00.615 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Sep 12 12:18:00 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-y[35513]: 2024-09-12T12:18:00.279+0000 7f7905aa7040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T12:18:00.615 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Sep 12 12:18:00 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-y[35513]: 2024-09-12T12:18:00.349+0000 7f7905aa7040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T12:18:00.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:18:00.626+0000 7efd4d7fa640 1 -- 172.21.15.33:0/4062312531 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mgrmap(e 14) ==== 92060+0+0 (secure 0 0 0) 0x7efd4001dd20 con 0x7efd50101c00 2024-09-12T12:18:00.896 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 12 12:18:00 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-z[36609]: 2024-09-12T12:18:00.426+0000 7f96b6fff040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T12:18:00.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:00 smithi102 ceph-mon[34799]: Standby manager daemon z started 2024-09-12T12:18:00.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:00 smithi102 ceph-mon[34799]: from='mgr.? 172.21.15.102:0/1530622250' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T12:18:00.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:00 smithi102 ceph-mon[34799]: from='mgr.? 172.21.15.102:0/1530622250' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T12:18:00.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:00 smithi102 ceph-mon[34799]: from='mgr.? 172.21.15.102:0/1530622250' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T12:18:00.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:00 smithi102 ceph-mon[34799]: from='mgr.? 172.21.15.102:0/1530622250' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T12:18:00.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:00 smithi033 ceph-mon[31246]: Standby manager daemon z started 2024-09-12T12:18:00.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:00 smithi033 ceph-mon[31246]: from='mgr.? 172.21.15.102:0/1530622250' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T12:18:00.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:00 smithi033 ceph-mon[31246]: from='mgr.? 172.21.15.102:0/1530622250' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T12:18:00.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:00 smithi033 ceph-mon[31246]: from='mgr.? 172.21.15.102:0/1530622250' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T12:18:00.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:00 smithi033 ceph-mon[31246]: from='mgr.? 172.21.15.102:0/1530622250' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T12:18:01.106 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:00 smithi043 ceph-mon[34144]: Standby manager daemon z started 2024-09-12T12:18:01.106 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:00 smithi043 ceph-mon[34144]: from='mgr.? 172.21.15.102:0/1530622250' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T12:18:01.106 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:00 smithi043 ceph-mon[34144]: from='mgr.? 172.21.15.102:0/1530622250' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T12:18:01.106 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:00 smithi043 ceph-mon[34144]: from='mgr.? 172.21.15.102:0/1530622250' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T12:18:01.106 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:00 smithi043 ceph-mon[34144]: from='mgr.? 172.21.15.102:0/1530622250' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T12:18:01.365 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Sep 12 12:18:01 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-y[35513]: 2024-09-12T12:18:01.105+0000 7f7905aa7040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T12:18:01.365 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Sep 12 12:18:01 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-y[35513]: 2024-09-12T12:18:01.226+0000 7f7905aa7040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T12:18:01.626 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:01 smithi043 ceph-mon[34144]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:18:01.626 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:01 smithi043 ceph-mon[34144]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-12T12:18:01.626 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:01 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T12:18:01.626 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Sep 12 12:18:01 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-y[35513]: 2024-09-12T12:18:01.375+0000 7f7905aa7040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T12:18:01.626 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Sep 12 12:18:01 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-y[35513]: 2024-09-12T12:18:01.438+0000 7f7905aa7040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T12:18:01.626 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Sep 12 12:18:01 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-y[35513]: 2024-09-12T12:18:01.595+0000 7f7905aa7040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T12:18:01.895 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Sep 12 12:18:01 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-y[35513]: 2024-09-12T12:18:01.666+0000 7f7905aa7040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T12:18:01.895 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Sep 12 12:18:01 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-y[35513]: 2024-09-12T12:18:01.729+0000 7f7905aa7040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T12:18:01.895 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Sep 12 12:18:01 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-y[35513]: 2024-09-12T12:18:01.894+0000 7f7905aa7040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T12:18:01.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:01 smithi102 ceph-mon[34799]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:18:01.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:01 smithi102 ceph-mon[34799]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-12T12:18:01.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:01 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T12:18:01.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:01 smithi033 ceph-mon[31246]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:18:01.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:01 smithi033 ceph-mon[31246]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-12T12:18:01.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:01 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T12:18:02.180 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Sep 12 12:18:01 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-y[35513]: 2024-09-12T12:18:01.962+0000 7f7905aa7040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T12:18:02.181 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Sep 12 12:18:02 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-y[35513]: 2024-09-12T12:18:02.031+0000 7f7905aa7040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T12:18:02.181 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Sep 12 12:18:02 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-y[35513]: 2024-09-12T12:18:02.118+0000 7f7905aa7040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T12:18:02.181 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Sep 12 12:18:02 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-y[35513]: 2024-09-12T12:18:02.180+0000 7f7905aa7040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T12:18:02.615 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Sep 12 12:18:02 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-y[35513]: 2024-09-12T12:18:02.241+0000 7f7905aa7040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T12:18:03.365 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Sep 12 12:18:03 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-y[35513]: 2024-09-12T12:18:03.070+0000 7f7905aa7040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T12:18:03.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:18:03.848+0000 7efd4d7fa640 1 -- 172.21.15.33:0/4062312531 <== mon.1 v2:172.21.15.102:3300/0 8 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7efd40017cd0 con 0x7efd50101c00 2024-09-12T12:18:03.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:03 smithi102 ceph-mon[34799]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:18:03.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:03 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:03.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:03 smithi102 ceph-mon[34799]: Standby manager daemon y started 2024-09-12T12:18:03.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:03 smithi102 ceph-mon[34799]: from='mgr.? 172.21.15.43:0/3846926605' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T12:18:03.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:03 smithi102 ceph-mon[34799]: from='mgr.? 172.21.15.43:0/3846926605' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T12:18:03.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:03 smithi102 ceph-mon[34799]: from='mgr.? 172.21.15.43:0/3846926605' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T12:18:03.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:03 smithi102 ceph-mon[34799]: from='mgr.? 172.21.15.43:0/3846926605' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T12:18:03.963 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:03 smithi033 ceph-mon[31246]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:18:03.963 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:03 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:03.964 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:03 smithi033 ceph-mon[31246]: Standby manager daemon y started 2024-09-12T12:18:03.964 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:03 smithi033 ceph-mon[31246]: from='mgr.? 172.21.15.43:0/3846926605' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T12:18:03.964 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:03 smithi033 ceph-mon[31246]: from='mgr.? 172.21.15.43:0/3846926605' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T12:18:03.964 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:03 smithi033 ceph-mon[31246]: from='mgr.? 172.21.15.43:0/3846926605' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T12:18:03.964 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:03 smithi033 ceph-mon[31246]: from='mgr.? 172.21.15.43:0/3846926605' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T12:18:04.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:03 smithi043 ceph-mon[34144]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:18:04.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:03 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:04.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:03 smithi043 ceph-mon[34144]: Standby manager daemon y started 2024-09-12T12:18:04.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:03 smithi043 ceph-mon[34144]: from='mgr.? 172.21.15.43:0/3846926605' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T12:18:04.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:03 smithi043 ceph-mon[34144]: from='mgr.? 172.21.15.43:0/3846926605' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T12:18:04.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:03 smithi043 ceph-mon[34144]: from='mgr.? 172.21.15.43:0/3846926605' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T12:18:04.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:03 smithi043 ceph-mon[34144]: from='mgr.? 172.21.15.43:0/3846926605' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T12:18:05.111 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:04 smithi033 ceph-mon[31246]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:18:05.112 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:04 smithi033 ceph-mon[31246]: mgrmap e15: x(active, since 66s), standbys: z, y 2024-09-12T12:18:05.112 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:04 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T12:18:05.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:04 smithi043 ceph-mon[34144]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:18:05.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:04 smithi043 ceph-mon[34144]: mgrmap e15: x(active, since 66s), standbys: z, y 2024-09-12T12:18:05.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:04 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T12:18:05.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:04 smithi102 ceph-mon[34799]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:18:05.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:04 smithi102 ceph-mon[34799]: mgrmap e15: x(active, since 66s), standbys: z, y 2024-09-12T12:18:05.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:04 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T12:18:07.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:06 smithi043 ceph-mon[34144]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:18:07.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:06 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T12:18:07.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:06 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:07.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:06 smithi043 ceph-mon[34144]: Deploying daemon osd.0 on smithi033 2024-09-12T12:18:07.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:06 smithi102 ceph-mon[34799]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:18:07.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:06 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T12:18:07.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:06 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:07.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:06 smithi102 ceph-mon[34799]: Deploying daemon osd.0 on smithi033 2024-09-12T12:18:07.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:06 smithi033 ceph-mon[31246]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:18:07.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:06 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T12:18:07.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:06 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:07.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:06 smithi033 ceph-mon[31246]: Deploying daemon osd.0 on smithi033 2024-09-12T12:18:09.109 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:08 smithi033 ceph-mon[31246]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:18:09.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:08 smithi043 ceph-mon[34144]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:18:09.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:08 smithi102 ceph-mon[34799]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:18:11.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:10 smithi043 ceph-mon[34144]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:18:11.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:10 smithi102 ceph-mon[34799]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:18:11.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:10 smithi033 ceph-mon[31246]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:18:13.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:12 smithi043 ceph-mon[34144]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:18:13.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:12 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:18:13.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:12 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:13.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:12 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:13.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:12 smithi102 ceph-mon[34799]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:18:13.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:12 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:18:13.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:12 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:13.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:12 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:13.171 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:12 smithi033 ceph-mon[31246]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:18:13.171 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:12 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:18:13.171 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:12 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:13.171 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:12 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:15.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:15 smithi043 ceph-mon[34144]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:18:15.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:15 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:15.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:15 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:15.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:15 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:15.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:15 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:18:15.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:15 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:15.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:15 smithi102 ceph-mon[34799]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:18:15.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:15 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:15.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:15 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:15.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:15 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:15.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:15 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:18:15.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:15 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:15.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:15 smithi033 ceph-mon[31246]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:18:15.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:15 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:15.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:15 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:15.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:15 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:15.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:15 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:18:15.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:15 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:16.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:18:16.669+0000 7efd4d7fa640 1 -- 172.21.15.33:0/4062312531 <== mgr.14150 v2:172.21.15.33:6800/176202431 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7efd50062630 con 0x7efd380392c0 2024-09-12T12:18:16.669 INFO:teuthology.orchestra.run.smithi033.stdout:Created osd(s) 0 on host 'smithi033' 2024-09-12T12:18:16.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:18:16.673+0000 7efd56344640 1 -- 172.21.15.33:0/4062312531 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7efd380392c0 msgr2=0x7efd3803b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:16.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:18:16.673+0000 7efd56344640 1 --2- 172.21.15.33:0/4062312531 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7efd380392c0 0x7efd3803b780 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efd501993e0 tx=0x7efd44005a20 comp rx=0 tx=0).stop 2024-09-12T12:18:16.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:18:16.673+0000 7efd56344640 1 -- 172.21.15.33:0/4062312531 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd50101c00 msgr2=0x7efd50197ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:16.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:18:16.673+0000 7efd56344640 1 --2- 172.21.15.33:0/4062312531 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd50101c00 0x7efd50197ec0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7efd4000e9c0 tx=0x7efd4000ee80 comp rx=0 tx=0).stop 2024-09-12T12:18:16.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:18:16.673+0000 7efd56344640 1 -- 172.21.15.33:0/4062312531 shutdown_connections 2024-09-12T12:18:16.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:18:16.673+0000 7efd56344640 1 --2- 172.21.15.33:0/4062312531 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7efd380392c0 0x7efd3803b780 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:16.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:18:16.673+0000 7efd56344640 1 --2- 172.21.15.33:0/4062312531 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd501037c0 0x7efd5019f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:16.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:18:16.673+0000 7efd56344640 1 --2- 172.21.15.33:0/4062312531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd50102e00 0x7efd50198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:16.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:18:16.673+0000 7efd56344640 1 --2- 172.21.15.33:0/4062312531 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd50101c00 0x7efd50197ec0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:16.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:18:16.673+0000 7efd56344640 1 -- 172.21.15.33:0/4062312531 >> 172.21.15.33:0/4062312531 conn(0x7efd500fd390 msgr2=0x7efd501061a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:16.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:18:16.673+0000 7efd56344640 1 -- 172.21.15.33:0/4062312531 shutdown_connections 2024-09-12T12:18:16.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:18:16.673+0000 7efd56344640 1 -- 172.21.15.33:0/4062312531 wait complete. 2024-09-12T12:18:17.280 DEBUG:teuthology.orchestra.run.smithi033:osd.0> sudo journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@osd.0.service 2024-09-12T12:18:17.323 INFO:tasks.cephadm:Deploying osd.1 on smithi043 with /dev/vg_nvme/lv_4... 2024-09-12T12:18:17.323 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-12T12:18:17.573 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T12:18:17.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:17 smithi043 ceph-mon[34144]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:18:17.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:17 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:18:17.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:17 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:17.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:17 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:17.848 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:17 smithi033 ceph-mon[31246]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:18:17.848 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:17 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:18:17.848 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:17 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:17.848 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:17 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:17.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:17 smithi102 ceph-mon[34799]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:18:17.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:17 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:18:17.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:17 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:17.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:17 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:18.577 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:18 smithi033 ceph-mon[31246]: from='osd.0 [v2:172.21.15.33:6802/963294466,v1:172.21.15.33:6803/963294466]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T12:18:18.577 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 12 12:18:18 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-0[45435]: 2024-09-12T12:18:18.303+0000 7f9bc98b7640 -1 osd.0 0 log_to_monitors true 2024-09-12T12:18:18.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:18 smithi043 ceph-mon[34144]: from='osd.0 [v2:172.21.15.33:6802/963294466,v1:172.21.15.33:6803/963294466]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T12:18:18.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:18 smithi102 ceph-mon[34799]: from='osd.0 [v2:172.21.15.33:6802/963294466,v1:172.21.15.33:6803/963294466]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T12:18:19.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:19 smithi033 ceph-mon[31246]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:18:19.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:19 smithi033 ceph-mon[31246]: from='osd.0 [v2:172.21.15.33:6802/963294466,v1:172.21.15.33:6803/963294466]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T12:18:19.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:19 smithi033 ceph-mon[31246]: osdmap e6: 1 total, 0 up, 1 in 2024-09-12T12:18:19.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:19 smithi033 ceph-mon[31246]: from='osd.0 [v2:172.21.15.33:6802/963294466,v1:172.21.15.33:6803/963294466]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-09-12T12:18:19.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:19 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:18:19.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:19 smithi043 ceph-mon[34144]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:18:19.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:19 smithi043 ceph-mon[34144]: from='osd.0 [v2:172.21.15.33:6802/963294466,v1:172.21.15.33:6803/963294466]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T12:18:19.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:19 smithi043 ceph-mon[34144]: osdmap e6: 1 total, 0 up, 1 in 2024-09-12T12:18:19.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:19 smithi043 ceph-mon[34144]: from='osd.0 [v2:172.21.15.33:6802/963294466,v1:172.21.15.33:6803/963294466]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-09-12T12:18:19.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:19 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:18:19.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:19 smithi102 ceph-mon[34799]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:18:19.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:19 smithi102 ceph-mon[34799]: from='osd.0 [v2:172.21.15.33:6802/963294466,v1:172.21.15.33:6803/963294466]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T12:18:19.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:19 smithi102 ceph-mon[34799]: osdmap e6: 1 total, 0 up, 1 in 2024-09-12T12:18:19.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:19 smithi102 ceph-mon[34799]: from='osd.0 [v2:172.21.15.33:6802/963294466,v1:172.21.15.33:6803/963294466]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-09-12T12:18:19.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:19 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:18:19.990 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T12:18:20.018 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi043:vg_nvme/lv_4 2024-09-12T12:18:20.101 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 12 12:18:20 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-0[45435]: 2024-09-12T12:18:20.032+0000 7f9bc583a640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T12:18:20.101 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 12 12:18:20 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-0[45435]: 2024-09-12T12:18:20.035+0000 7f9bbd65a640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T12:18:20.281 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T12:18:20.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:20 smithi033 ceph-mon[31246]: from='osd.0 [v2:172.21.15.33:6802/963294466,v1:172.21.15.33:6803/963294466]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-09-12T12:18:20.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:20 smithi033 ceph-mon[31246]: osdmap e7: 1 total, 0 up, 1 in 2024-09-12T12:18:20.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:20 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:18:20.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:20 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:18:20.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:20 smithi033 ceph-mon[31246]: from='osd.0 [v2:172.21.15.33:6802/963294466,v1:172.21.15.33:6803/963294466]' entity='osd.0' 2024-09-12T12:18:20.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:20 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:20.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:20 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:20.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:20 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:18:20.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:20 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:20.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:20 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:20.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:20 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:18:20.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:20 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:20.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:20.771+0000 7f5802056640 1 -- 172.21.15.43:0/2052891035 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57fc102e00 msgr2=0x7f57fc103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:20.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:20.771+0000 7f5802056640 1 --2- 172.21.15.43:0/2052891035 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57fc102e00 0x7f57fc103280 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f57ec009900 tx=0x7f57ec02a410 comp rx=0 tx=0).stop 2024-09-12T12:18:20.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:20.771+0000 7f5802056640 1 -- 172.21.15.43:0/2052891035 shutdown_connections 2024-09-12T12:18:20.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:20.771+0000 7f5802056640 1 --2- 172.21.15.43:0/2052891035 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57fc1037c0 0x7f57fc10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:20.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:20.771+0000 7f5802056640 1 --2- 172.21.15.43:0/2052891035 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57fc102e00 0x7f57fc103280 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:20.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:20.771+0000 7f5802056640 1 --2- 172.21.15.43:0/2052891035 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57fc101c00 0x7f57fc102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:20.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:20.771+0000 7f5802056640 1 -- 172.21.15.43:0/2052891035 >> 172.21.15.43:0/2052891035 conn(0x7f57fc0fd390 msgr2=0x7f57fc0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:20.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:20.771+0000 7f5802056640 1 -- 172.21.15.43:0/2052891035 shutdown_connections 2024-09-12T12:18:20.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:20.771+0000 7f5802056640 1 -- 172.21.15.43:0/2052891035 wait complete. 2024-09-12T12:18:20.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:20.771+0000 7f5802056640 1 Processor -- start 2024-09-12T12:18:20.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:20.772+0000 7f5802056640 1 -- start start 2024-09-12T12:18:20.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:20.772+0000 7f5802056640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57fc101c00 0x7f57fc075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:20.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:20.772+0000 7f5802056640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57fc102e00 0x7f57fc0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:20.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:20.772+0000 7f5802056640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57fc1037c0 0x7f57fc074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:20.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:20.772+0000 7f5802056640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f57fc10d780 con 0x7f57fc102e00 2024-09-12T12:18:20.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:20.772+0000 7f5802056640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f57fc10d600 con 0x7f57fc101c00 2024-09-12T12:18:20.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:20.772+0000 7f5802056640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f57fc10d900 con 0x7f57fc1037c0 2024-09-12T12:18:20.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:20.772+0000 7f57fb7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57fc101c00 0x7f57fc075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:20.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:20.772+0000 7f57fb7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57fc101c00 0x7f57fc075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60980/0 (socket says 172.21.15.43:60980) 2024-09-12T12:18:20.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:20.772+0000 7f57fb7fe640 1 -- 172.21.15.43:0/760200040 learned_addr learned my addr 172.21.15.43:0/760200040 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-12T12:18:20.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:20.772+0000 7f57fbfff640 1 --2- 172.21.15.43:0/760200040 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57fc1037c0 0x7f57fc074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:20.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:20.772+0000 7f57faffd640 1 --2- 172.21.15.43:0/760200040 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57fc102e00 0x7f57fc0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:20.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:20.772+0000 7f57fb7fe640 1 -- 172.21.15.43:0/760200040 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57fc1037c0 msgr2=0x7f57fc074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:20.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:20.772+0000 7f57fb7fe640 1 --2- 172.21.15.43:0/760200040 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57fc1037c0 0x7f57fc074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:20.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:20.772+0000 7f57fb7fe640 1 -- 172.21.15.43:0/760200040 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57fc102e00 msgr2=0x7f57fc0745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:20.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:20.772+0000 7f57fb7fe640 1 --2- 172.21.15.43:0/760200040 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57fc102e00 0x7f57fc0745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:20.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:20.772+0000 7f57fb7fe640 1 -- 172.21.15.43:0/760200040 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57fc0753e0 con 0x7f57fc101c00 2024-09-12T12:18:20.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:20.772+0000 7f57fb7fe640 1 --2- 172.21.15.43:0/760200040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57fc101c00 0x7f57fc075f90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f57e400e9c0 tx=0x7f57e400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:20.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:20.773+0000 7f57f8ff9640 1 -- 172.21.15.43:0/760200040 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e400cd80 con 0x7f57fc101c00 2024-09-12T12:18:20.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:20.773+0000 7f57f8ff9640 1 -- 172.21.15.43:0/760200040 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f57e40035f0 con 0x7f57fc101c00 2024-09-12T12:18:20.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:20.773+0000 7f5802056640 1 -- 172.21.15.43:0/760200040 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57fc1a1f90 con 0x7f57fc101c00 2024-09-12T12:18:20.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:20.773+0000 7f57f8ff9640 1 -- 172.21.15.43:0/760200040 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e4010690 con 0x7f57fc101c00 2024-09-12T12:18:20.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:20.773+0000 7f5802056640 1 -- 172.21.15.43:0/760200040 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57fc1a2330 con 0x7f57fc101c00 2024-09-12T12:18:20.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:20.774+0000 7f5802056640 1 -- 172.21.15.43:0/760200040 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57fc1090a0 con 0x7f57fc101c00 2024-09-12T12:18:20.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:20.775+0000 7f57f8ff9640 1 -- 172.21.15.43:0/760200040 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f57e40037a0 con 0x7f57fc101c00 2024-09-12T12:18:20.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:20.776+0000 7f57f8ff9640 1 --2- 172.21.15.43:0/760200040 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f57e80a2af0 0x7f57e80a4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:20.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:20.776+0000 7f57f8ff9640 1 -- 172.21.15.43:0/760200040 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f57e40cda60 con 0x7f57fc101c00 2024-09-12T12:18:20.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:20.776+0000 7f57faffd640 1 --2- 172.21.15.43:0/760200040 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f57e80a2af0 0x7f57e80a4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:20.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:20.777+0000 7f57faffd640 1 --2- 172.21.15.43:0/760200040 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f57e80a2af0 0x7f57e80a4fb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f57ec000c00 tx=0x7f57ec0314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:20.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:20.780+0000 7f57f8ff9640 1 -- 172.21.15.43:0/760200040 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f57e409c550 con 0x7f57fc101c00 2024-09-12T12:18:20.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:20 smithi043 ceph-mon[34144]: from='osd.0 [v2:172.21.15.33:6802/963294466,v1:172.21.15.33:6803/963294466]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-09-12T12:18:20.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:20 smithi043 ceph-mon[34144]: osdmap e7: 1 total, 0 up, 1 in 2024-09-12T12:18:20.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:20 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:18:20.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:20 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:18:20.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:20 smithi043 ceph-mon[34144]: from='osd.0 [v2:172.21.15.33:6802/963294466,v1:172.21.15.33:6803/963294466]' entity='osd.0' 2024-09-12T12:18:20.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:20 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:20.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:20 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:20.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:20 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:18:20.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:20 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:20.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:20 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:20.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:20 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:18:20.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:20 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:20.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:20 smithi102 ceph-mon[34799]: from='osd.0 [v2:172.21.15.33:6802/963294466,v1:172.21.15.33:6803/963294466]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-09-12T12:18:20.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:20 smithi102 ceph-mon[34799]: osdmap e7: 1 total, 0 up, 1 in 2024-09-12T12:18:20.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:20 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:18:20.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:20 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:18:20.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:20 smithi102 ceph-mon[34799]: from='osd.0 [v2:172.21.15.33:6802/963294466,v1:172.21.15.33:6803/963294466]' entity='osd.0' 2024-09-12T12:18:20.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:20 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:20.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:20 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:20.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:20 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:18:20.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:20 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:20.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:20 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:20.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:20 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:18:20.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:20 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:20.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:20.965+0000 7f5802056640 1 -- 172.21.15.43:0/760200040 --> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f57fc062630 con 0x7f57e80a2af0 2024-09-12T12:18:21.583 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:21 smithi043 ceph-mon[34144]: purged_snaps scrub starts 2024-09-12T12:18:21.583 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:21 smithi043 ceph-mon[34144]: purged_snaps scrub ok 2024-09-12T12:18:21.583 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:21 smithi043 ceph-mon[34144]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:18:21.583 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:21 smithi043 ceph-mon[34144]: Detected new or changed devices on smithi033 2024-09-12T12:18:21.583 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:21 smithi043 ceph-mon[34144]: Adjusting osd_memory_target on smithi033 to 17092M 2024-09-12T12:18:21.583 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:21 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:18:21.583 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:21 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:18:21.583 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:21 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:18:21.584 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:21 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:21.584 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:21 smithi043 ceph-mon[34144]: osd.0 [v2:172.21.15.33:6802/963294466,v1:172.21.15.33:6803/963294466] boot 2024-09-12T12:18:21.584 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:21 smithi043 ceph-mon[34144]: osdmap e8: 1 total, 1 up, 1 in 2024-09-12T12:18:21.584 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:21 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:18:21.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:21 smithi102 ceph-mon[34799]: purged_snaps scrub starts 2024-09-12T12:18:21.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:21 smithi102 ceph-mon[34799]: purged_snaps scrub ok 2024-09-12T12:18:21.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:21 smithi102 ceph-mon[34799]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:18:21.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:21 smithi102 ceph-mon[34799]: Detected new or changed devices on smithi033 2024-09-12T12:18:21.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:21 smithi102 ceph-mon[34799]: Adjusting osd_memory_target on smithi033 to 17092M 2024-09-12T12:18:21.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:21 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:18:21.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:21 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:18:21.898 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:21 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:18:21.898 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:21 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:21.898 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:21 smithi102 ceph-mon[34799]: osd.0 [v2:172.21.15.33:6802/963294466,v1:172.21.15.33:6803/963294466] boot 2024-09-12T12:18:21.898 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:21 smithi102 ceph-mon[34799]: osdmap e8: 1 total, 1 up, 1 in 2024-09-12T12:18:21.898 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:21 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:18:21.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:21 smithi033 ceph-mon[31246]: purged_snaps scrub starts 2024-09-12T12:18:21.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:21 smithi033 ceph-mon[31246]: purged_snaps scrub ok 2024-09-12T12:18:21.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:21 smithi033 ceph-mon[31246]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:18:21.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:21 smithi033 ceph-mon[31246]: Detected new or changed devices on smithi033 2024-09-12T12:18:21.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:21 smithi033 ceph-mon[31246]: Adjusting osd_memory_target on smithi033 to 17092M 2024-09-12T12:18:21.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:21 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:18:21.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:21 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:18:21.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:21 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:18:21.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:21 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:21.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:21 smithi033 ceph-mon[31246]: osd.0 [v2:172.21.15.33:6802/963294466,v1:172.21.15.33:6803/963294466] boot 2024-09-12T12:18:21.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:21 smithi033 ceph-mon[31246]: osdmap e8: 1 total, 1 up, 1 in 2024-09-12T12:18:21.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:21 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:18:22.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:22 smithi043 ceph-mon[34144]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:18:22.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:22 smithi043 ceph-mon[34144]: osdmap e9: 1 total, 1 up, 1 in 2024-09-12T12:18:22.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:22 smithi102 ceph-mon[34799]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:18:22.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:22 smithi102 ceph-mon[34799]: osdmap e9: 1 total, 1 up, 1 in 2024-09-12T12:18:22.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:22 smithi033 ceph-mon[31246]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:18:22.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:22 smithi033 ceph-mon[31246]: osdmap e9: 1 total, 1 up, 1 in 2024-09-12T12:18:23.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:23 smithi043 ceph-mon[34144]: pgmap v40: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:18:23.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:23 smithi043 ceph-mon[34144]: from='client.? 172.21.15.43:0/1459767657' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2461a388-e110-420b-9404-eb54cd39119e"}]: dispatch 2024-09-12T12:18:23.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:23 smithi043 ceph-mon[34144]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2461a388-e110-420b-9404-eb54cd39119e"}]: dispatch 2024-09-12T12:18:23.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:23 smithi043 ceph-mon[34144]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2461a388-e110-420b-9404-eb54cd39119e"}]': finished 2024-09-12T12:18:23.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:23 smithi043 ceph-mon[34144]: osdmap e10: 2 total, 1 up, 2 in 2024-09-12T12:18:23.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:23 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:18:23.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:23 smithi102 ceph-mon[34799]: pgmap v40: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:18:23.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:23 smithi102 ceph-mon[34799]: from='client.? 172.21.15.43:0/1459767657' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2461a388-e110-420b-9404-eb54cd39119e"}]: dispatch 2024-09-12T12:18:23.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:23 smithi102 ceph-mon[34799]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2461a388-e110-420b-9404-eb54cd39119e"}]: dispatch 2024-09-12T12:18:23.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:23 smithi102 ceph-mon[34799]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2461a388-e110-420b-9404-eb54cd39119e"}]': finished 2024-09-12T12:18:23.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:23 smithi102 ceph-mon[34799]: osdmap e10: 2 total, 1 up, 2 in 2024-09-12T12:18:23.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:23 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:18:23.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:23 smithi033 ceph-mon[31246]: pgmap v40: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:18:23.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:23 smithi033 ceph-mon[31246]: from='client.? 172.21.15.43:0/1459767657' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2461a388-e110-420b-9404-eb54cd39119e"}]: dispatch 2024-09-12T12:18:23.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:23 smithi033 ceph-mon[31246]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2461a388-e110-420b-9404-eb54cd39119e"}]: dispatch 2024-09-12T12:18:23.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:23 smithi033 ceph-mon[31246]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2461a388-e110-420b-9404-eb54cd39119e"}]': finished 2024-09-12T12:18:23.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:23 smithi033 ceph-mon[31246]: osdmap e10: 2 total, 1 up, 2 in 2024-09-12T12:18:23.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:23 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:18:24.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:24 smithi043 ceph-mon[34144]: from='client.? 172.21.15.43:0/1877572639' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:18:24.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:24 smithi102 ceph-mon[34799]: from='client.? 172.21.15.43:0/1877572639' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:18:24.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:24 smithi033 ceph-mon[31246]: from='client.? 172.21.15.43:0/1877572639' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:18:25.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:25 smithi043 ceph-mon[34144]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:18:25.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:25 smithi102 ceph-mon[34799]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:18:25.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:25 smithi033 ceph-mon[31246]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:18:27.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:27 smithi043 ceph-mon[34144]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:18:27.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:27 smithi102 ceph-mon[34799]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:18:27.980 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:27 smithi033 ceph-mon[31246]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:18:29.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:29 smithi043 ceph-mon[34144]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:18:29.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:29 smithi102 ceph-mon[34799]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:18:29.934 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:29 smithi033 ceph-mon[31246]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:18:31.717 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:31 smithi043 ceph-mon[34144]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:18:31.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:31 smithi102 ceph-mon[34799]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:18:31.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:31 smithi033 ceph-mon[31246]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:18:32.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:32 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T12:18:32.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:32 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:32.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:32 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T12:18:32.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:32 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:32.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:32 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T12:18:32.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:32 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:33.648 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:33 smithi043 ceph-mon[34144]: Deploying daemon osd.1 on smithi043 2024-09-12T12:18:33.648 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:33 smithi043 ceph-mon[34144]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:18:33.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:33 smithi102 ceph-mon[34799]: Deploying daemon osd.1 on smithi043 2024-09-12T12:18:33.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:33 smithi102 ceph-mon[34799]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:18:33.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:33 smithi033 ceph-mon[31246]: Deploying daemon osd.1 on smithi043 2024-09-12T12:18:33.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:33 smithi033 ceph-mon[31246]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:18:35.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:35 smithi043 ceph-mon[34144]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:18:35.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:35 smithi102 ceph-mon[34799]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:18:35.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:35 smithi033 ceph-mon[31246]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:18:37.801 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:37 smithi043 ceph-mon[34144]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:18:37.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:37 smithi102 ceph-mon[34799]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:18:37.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:37 smithi033 ceph-mon[31246]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:18:38.793 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:38 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:18:38.794 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:38 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:38.794 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:38 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:38.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:38 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:18:38.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:38 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:38.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:38 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:38.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:38 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:18:38.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:38 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:38.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:38 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:39.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:39 smithi043 ceph-mon[34144]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:18:39.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:39 smithi102 ceph-mon[34799]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:18:39.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:39 smithi033 ceph-mon[31246]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:18:40.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:40 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:40.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:40 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:40.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:40 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:40.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:40 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:18:40.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:40 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:41.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:40 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:41.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:40 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:41.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:40 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:41.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:40 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:18:41.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:40 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:41.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:40 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:41.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:40 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:41.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:40 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:41.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:40 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:18:41.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:40 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:41.856 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:41 smithi043 ceph-mon[34144]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:18:41.980 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:41 smithi033 ceph-mon[31246]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:18:42.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:41 smithi102 ceph-mon[34799]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:18:42.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:42.182+0000 7f57f8ff9640 1 -- 172.21.15.43:0/760200040 <== mgr.14150 v2:172.21.15.33:6800/176202431 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f57fc062630 con 0x7f57e80a2af0 2024-09-12T12:18:42.183 INFO:teuthology.orchestra.run.smithi043.stdout:Created osd(s) 1 on host 'smithi043' 2024-09-12T12:18:42.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:42.185+0000 7f5802056640 1 -- 172.21.15.43:0/760200040 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f57e80a2af0 msgr2=0x7f57e80a4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:42.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:42.185+0000 7f5802056640 1 --2- 172.21.15.43:0/760200040 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f57e80a2af0 0x7f57e80a4fb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f57ec000c00 tx=0x7f57ec0314a0 comp rx=0 tx=0).stop 2024-09-12T12:18:42.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:42.185+0000 7f5802056640 1 -- 172.21.15.43:0/760200040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57fc101c00 msgr2=0x7f57fc075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:42.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:42.185+0000 7f5802056640 1 --2- 172.21.15.43:0/760200040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57fc101c00 0x7f57fc075f90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f57e400e9c0 tx=0x7f57e400ee80 comp rx=0 tx=0).stop 2024-09-12T12:18:42.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:42.185+0000 7f5802056640 1 -- 172.21.15.43:0/760200040 shutdown_connections 2024-09-12T12:18:42.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:42.185+0000 7f5802056640 1 --2- 172.21.15.43:0/760200040 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f57e80a2af0 0x7f57e80a4fb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:42.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:42.185+0000 7f5802056640 1 --2- 172.21.15.43:0/760200040 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57fc1037c0 0x7f57fc074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:42.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:42.185+0000 7f5802056640 1 --2- 172.21.15.43:0/760200040 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57fc102e00 0x7f57fc0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:42.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:42.185+0000 7f5802056640 1 --2- 172.21.15.43:0/760200040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57fc101c00 0x7f57fc075f90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:42.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:42.185+0000 7f5802056640 1 -- 172.21.15.43:0/760200040 >> 172.21.15.43:0/760200040 conn(0x7f57fc0fd390 msgr2=0x7f57fc106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:42.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:42.185+0000 7f5802056640 1 -- 172.21.15.43:0/760200040 shutdown_connections 2024-09-12T12:18:42.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:18:42.185+0000 7f5802056640 1 -- 172.21.15.43:0/760200040 wait complete. 2024-09-12T12:18:42.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:42 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:18:42.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:42 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:42.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:42 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:42.763 DEBUG:teuthology.orchestra.run.smithi043:osd.1> sudo journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@osd.1.service 2024-09-12T12:18:42.765 INFO:tasks.cephadm:Deploying osd.2 on smithi102 with /dev/vg_nvme/lv_4... 2024-09-12T12:18:42.765 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-12T12:18:42.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:42 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:18:42.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:42 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:42.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:42 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:43.029 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:18:43.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:42 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:18:43.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:42 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:43.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:42 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:43.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:43 smithi043 ceph-mon[34144]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:18:43.980 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:43 smithi033 ceph-mon[31246]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:18:44.061 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:43 smithi102 ceph-mon[34799]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:18:44.194 INFO:journalctl@ceph.osd.1.smithi043.stdout:Sep 12 12:18:43 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-1[38612]: 2024-09-12T12:18:43.879+0000 7f1831fd5640 -1 osd.1 0 log_to_monitors true 2024-09-12T12:18:44.966 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:44 smithi043 ceph-mon[34144]: from='osd.1 [v2:172.21.15.43:6800/2306025171,v1:172.21.15.43:6801/2306025171]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T12:18:44.966 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:44 smithi043 ceph-mon[34144]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T12:18:44.980 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:44 smithi033 ceph-mon[31246]: from='osd.1 [v2:172.21.15.43:6800/2306025171,v1:172.21.15.43:6801/2306025171]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T12:18:44.980 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:44 smithi033 ceph-mon[31246]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T12:18:45.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:44 smithi102 ceph-mon[34799]: from='osd.1 [v2:172.21.15.43:6800/2306025171,v1:172.21.15.43:6801/2306025171]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T12:18:45.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:44 smithi102 ceph-mon[34799]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T12:18:45.422 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T12:18:45.450 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi102:vg_nvme/lv_4 2024-09-12T12:18:45.694 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:18:45.947 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:45 smithi102 ceph-mon[34799]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:18:45.947 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:45 smithi102 ceph-mon[34799]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T12:18:45.947 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:45 smithi102 ceph-mon[34799]: osdmap e11: 2 total, 1 up, 2 in 2024-09-12T12:18:45.947 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:45 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:18:45.947 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:45 smithi102 ceph-mon[34799]: from='osd.1 [v2:172.21.15.43:6800/2306025171,v1:172.21.15.43:6801/2306025171]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-09-12T12:18:45.948 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:45 smithi102 ceph-mon[34799]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-09-12T12:18:45.948 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:45 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:45.948 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:45 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:45.948 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:45 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:18:45.948 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:45 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:45.948 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:45 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:45.948 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:45 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:18:45.948 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:45 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:46.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:45 smithi043 ceph-mon[34144]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:18:46.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:45 smithi043 ceph-mon[34144]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T12:18:46.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:45 smithi043 ceph-mon[34144]: osdmap e11: 2 total, 1 up, 2 in 2024-09-12T12:18:46.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:45 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:18:46.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:45 smithi043 ceph-mon[34144]: from='osd.1 [v2:172.21.15.43:6800/2306025171,v1:172.21.15.43:6801/2306025171]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-09-12T12:18:46.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:45 smithi043 ceph-mon[34144]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-09-12T12:18:46.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:45 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:46.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:45 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:46.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:45 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:18:46.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:45 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:46.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:45 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:46.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:45 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:18:46.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:45 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:46.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:18:46.176+0000 7fadded32640 1 -- 172.21.15.102:0/4000640647 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fadd81099b0 msgr2=0x7fadd8109db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:46.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:18:46.176+0000 7fadded32640 1 --2- 172.21.15.102:0/4000640647 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fadd81099b0 0x7fadd8109db0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fadcc009900 tx=0x7fadcc02a410 comp rx=0 tx=0).stop 2024-09-12T12:18:46.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:18:46.176+0000 7fadded32640 1 -- 172.21.15.102:0/4000640647 shutdown_connections 2024-09-12T12:18:46.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:18:46.176+0000 7fadded32640 1 --2- 172.21.15.102:0/4000640647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fadd80738d0 0x7fadd8112540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:46.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:18:46.176+0000 7fadded32640 1 --2- 172.21.15.102:0/4000640647 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fadd8072db0 0x7fadd8073230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:46.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:18:46.176+0000 7fadded32640 1 --2- 172.21.15.102:0/4000640647 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fadd81099b0 0x7fadd8109db0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:46.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:18:46.176+0000 7fadded32640 1 -- 172.21.15.102:0/4000640647 >> 172.21.15.102:0/4000640647 conn(0x7fadd806edf0 msgr2=0x7fadd8071230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:46.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:18:46.176+0000 7fadded32640 1 -- 172.21.15.102:0/4000640647 shutdown_connections 2024-09-12T12:18:46.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:18:46.176+0000 7fadded32640 1 -- 172.21.15.102:0/4000640647 wait complete. 2024-09-12T12:18:46.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:18:46.177+0000 7fadded32640 1 Processor -- start 2024-09-12T12:18:46.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:18:46.177+0000 7fadded32640 1 -- start start 2024-09-12T12:18:46.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:18:46.177+0000 7fadded32640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fadd8072db0 0x7fadd81a06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:46.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:18:46.177+0000 7fadded32640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fadd80738d0 0x7fadd81a0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:46.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:18:46.177+0000 7fadded32640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fadd81099b0 0x7fadd81a7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:46.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:18:46.177+0000 7fadded32640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fadd8115ff0 con 0x7fadd8072db0 2024-09-12T12:18:46.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:18:46.177+0000 7fadded32640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fadd8115e70 con 0x7fadd80738d0 2024-09-12T12:18:46.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:18:46.177+0000 7fadded32640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fadd8116170 con 0x7fadd81099b0 2024-09-12T12:18:46.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:18:46.177+0000 7faddd2cf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fadd81099b0 0x7fadd81a7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:46.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:18:46.177+0000 7faddd2cf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fadd81099b0 0x7fadd81a7c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:41452/0 (socket says 172.21.15.102:41452) 2024-09-12T12:18:46.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:18:46.177+0000 7faddd2cf640 1 -- 172.21.15.102:0/3569139310 learned_addr learned my addr 172.21.15.102:0/3569139310 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-12T12:18:46.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:18:46.177+0000 7faddcace640 1 --2- 172.21.15.102:0/3569139310 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fadd8072db0 0x7fadd81a06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:46.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:18:46.177+0000 7fadd7fff640 1 --2- 172.21.15.102:0/3569139310 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fadd80738d0 0x7fadd81a0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:46.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:18:46.177+0000 7faddd2cf640 1 -- 172.21.15.102:0/3569139310 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fadd80738d0 msgr2=0x7fadd81a0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:46.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:18:46.177+0000 7faddd2cf640 1 --2- 172.21.15.102:0/3569139310 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fadd80738d0 0x7fadd81a0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:46.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:18:46.177+0000 7faddd2cf640 1 -- 172.21.15.102:0/3569139310 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fadd8072db0 msgr2=0x7fadd81a06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:46.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:18:46.177+0000 7faddd2cf640 1 --2- 172.21.15.102:0/3569139310 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fadd8072db0 0x7fadd81a06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:46.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:18:46.177+0000 7faddd2cf640 1 -- 172.21.15.102:0/3569139310 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadd81a82f0 con 0x7fadd81099b0 2024-09-12T12:18:46.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:18:46.177+0000 7fadd7fff640 1 --2- 172.21.15.102:0/3569139310 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fadd80738d0 0x7fadd81a0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:18:46.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:18:46.178+0000 7faddd2cf640 1 --2- 172.21.15.102:0/3569139310 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fadd81099b0 0x7fadd81a7c80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fadd000cab0 tx=0x7fadd000cf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:46.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:18:46.178+0000 7fadd5ffb640 1 -- 172.21.15.102:0/3569139310 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd000ae20 con 0x7fadd81099b0 2024-09-12T12:18:46.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:18:46.178+0000 7fadded32640 1 -- 172.21.15.102:0/3569139310 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadd81a85e0 con 0x7fadd81099b0 2024-09-12T12:18:46.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:18:46.178+0000 7fadd5ffb640 1 -- 172.21.15.102:0/3569139310 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fadd000f900 con 0x7fadd81099b0 2024-09-12T12:18:46.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:18:46.178+0000 7fadd5ffb640 1 -- 172.21.15.102:0/3569139310 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd00189f0 con 0x7fadd81099b0 2024-09-12T12:18:46.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:18:46.178+0000 7fadded32640 1 -- 172.21.15.102:0/3569139310 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadd81a8b20 con 0x7fadd81099b0 2024-09-12T12:18:46.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:18:46.179+0000 7fadded32640 1 -- 172.21.15.102:0/3569139310 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadd81115e0 con 0x7fadd81099b0 2024-09-12T12:18:46.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:18:46.181+0000 7fadd5ffb640 1 -- 172.21.15.102:0/3569139310 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7fadd000fab0 con 0x7fadd81099b0 2024-09-12T12:18:46.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:18:46.181+0000 7fadd5ffb640 1 --2- 172.21.15.102:0/3569139310 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fadc80a2b20 0x7fadc80a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:46.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:18:46.181+0000 7fadd5ffb640 1 -- 172.21.15.102:0/3569139310 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7fadd00cdde0 con 0x7fadd81099b0 2024-09-12T12:18:46.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:18:46.182+0000 7faddcace640 1 --2- 172.21.15.102:0/3569139310 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fadc80a2b20 0x7fadc80a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:46.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:18:46.182+0000 7faddcace640 1 --2- 172.21.15.102:0/3569139310 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fadc80a2b20 0x7fadc80a4fe0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fadcc005ab0 tx=0x7fadcc005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:46.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:18:46.186+0000 7fadd5ffb640 1 -- 172.21.15.102:0/3569139310 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fadd0014030 con 0x7fadd81099b0 2024-09-12T12:18:46.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:45 smithi033 ceph-mon[31246]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:18:46.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:45 smithi033 ceph-mon[31246]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T12:18:46.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:45 smithi033 ceph-mon[31246]: osdmap e11: 2 total, 1 up, 2 in 2024-09-12T12:18:46.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:45 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:18:46.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:45 smithi033 ceph-mon[31246]: from='osd.1 [v2:172.21.15.43:6800/2306025171,v1:172.21.15.43:6801/2306025171]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-09-12T12:18:46.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:45 smithi033 ceph-mon[31246]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-09-12T12:18:46.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:45 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:46.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:45 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:46.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:45 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:18:46.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:45 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:46.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:45 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:46.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:45 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:18:46.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:45 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:18:46.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:18:46.365+0000 7fadded32640 1 -- 172.21.15.102:0/3569139310 --> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fadd8062630 con 0x7fadc80a2b20 2024-09-12T12:18:46.615 INFO:journalctl@ceph.osd.1.smithi043.stdout:Sep 12 12:18:46 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-1[38612]: 2024-09-12T12:18:46.138+0000 7f182df58640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T12:18:46.615 INFO:journalctl@ceph.osd.1.smithi043.stdout:Sep 12 12:18:46 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-1[38612]: 2024-09-12T12:18:46.141+0000 7f1825d78640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T12:18:46.975 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:46 smithi102 ceph-mon[34799]: Detected new or changed devices on smithi043 2024-09-12T12:18:46.975 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:46 smithi102 ceph-mon[34799]: Adjusting osd_memory_target on smithi043 to 17092M 2024-09-12T12:18:46.975 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:46 smithi102 ceph-mon[34799]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-09-12T12:18:46.975 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:46 smithi102 ceph-mon[34799]: osdmap e12: 2 total, 1 up, 2 in 2024-09-12T12:18:46.975 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:46 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:18:46.975 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:46 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:18:46.975 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:46 smithi102 ceph-mon[34799]: from='osd.1 ' entity='osd.1' 2024-09-12T12:18:46.975 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:46 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:18:46.975 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:46 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:18:46.976 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:46 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:47.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:46 smithi043 ceph-mon[34144]: Detected new or changed devices on smithi043 2024-09-12T12:18:47.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:46 smithi043 ceph-mon[34144]: Adjusting osd_memory_target on smithi043 to 17092M 2024-09-12T12:18:47.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:46 smithi043 ceph-mon[34144]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-09-12T12:18:47.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:46 smithi043 ceph-mon[34144]: osdmap e12: 2 total, 1 up, 2 in 2024-09-12T12:18:47.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:46 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:18:47.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:46 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:18:47.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:46 smithi043 ceph-mon[34144]: from='osd.1 ' entity='osd.1' 2024-09-12T12:18:47.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:46 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:18:47.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:46 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:18:47.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:46 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:47.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:46 smithi033 ceph-mon[31246]: Detected new or changed devices on smithi043 2024-09-12T12:18:47.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:46 smithi033 ceph-mon[31246]: Adjusting osd_memory_target on smithi043 to 17092M 2024-09-12T12:18:47.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:46 smithi033 ceph-mon[31246]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-09-12T12:18:47.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:46 smithi033 ceph-mon[31246]: osdmap e12: 2 total, 1 up, 2 in 2024-09-12T12:18:47.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:46 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:18:47.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:46 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:18:47.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:46 smithi033 ceph-mon[31246]: from='osd.1 ' entity='osd.1' 2024-09-12T12:18:47.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:46 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:18:47.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:46 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:18:47.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:46 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:47.862 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:47 smithi102 ceph-mon[34799]: purged_snaps scrub starts 2024-09-12T12:18:47.862 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:47 smithi102 ceph-mon[34799]: purged_snaps scrub ok 2024-09-12T12:18:47.862 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:47 smithi102 ceph-mon[34799]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:18:47.862 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:47 smithi102 ceph-mon[34799]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:18:47.862 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:47 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:18:47.862 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:47 smithi102 ceph-mon[34799]: osd.1 [v2:172.21.15.43:6800/2306025171,v1:172.21.15.43:6801/2306025171] boot 2024-09-12T12:18:47.863 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:47 smithi102 ceph-mon[34799]: osdmap e13: 2 total, 2 up, 2 in 2024-09-12T12:18:47.863 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:47 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:18:47.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:47 smithi043 ceph-mon[34144]: purged_snaps scrub starts 2024-09-12T12:18:47.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:47 smithi043 ceph-mon[34144]: purged_snaps scrub ok 2024-09-12T12:18:47.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:47 smithi043 ceph-mon[34144]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:18:47.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:47 smithi043 ceph-mon[34144]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:18:47.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:47 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:18:47.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:47 smithi043 ceph-mon[34144]: osd.1 [v2:172.21.15.43:6800/2306025171,v1:172.21.15.43:6801/2306025171] boot 2024-09-12T12:18:47.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:47 smithi043 ceph-mon[34144]: osdmap e13: 2 total, 2 up, 2 in 2024-09-12T12:18:47.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:47 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:18:48.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:47 smithi033 ceph-mon[31246]: purged_snaps scrub starts 2024-09-12T12:18:48.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:47 smithi033 ceph-mon[31246]: purged_snaps scrub ok 2024-09-12T12:18:48.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:47 smithi033 ceph-mon[31246]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:18:48.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:47 smithi033 ceph-mon[31246]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:18:48.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:47 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:18:48.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:47 smithi033 ceph-mon[31246]: osd.1 [v2:172.21.15.43:6800/2306025171,v1:172.21.15.43:6801/2306025171] boot 2024-09-12T12:18:48.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:47 smithi033 ceph-mon[31246]: osdmap e13: 2 total, 2 up, 2 in 2024-09-12T12:18:48.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:47 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:18:48.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:48 smithi033 ceph-mon[31246]: from='client.? 172.21.15.102:0/2806033687' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4ba9dd02-977d-45fb-b366-ade15b52232b"}]: dispatch 2024-09-12T12:18:48.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:48 smithi033 ceph-mon[31246]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4ba9dd02-977d-45fb-b366-ade15b52232b"}]: dispatch 2024-09-12T12:18:48.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:48 smithi033 ceph-mon[31246]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4ba9dd02-977d-45fb-b366-ade15b52232b"}]': finished 2024-09-12T12:18:48.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:48 smithi033 ceph-mon[31246]: osdmap e14: 3 total, 2 up, 3 in 2024-09-12T12:18:48.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:48 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:18:49.077 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:48 smithi102 ceph-mon[34799]: from='client.? 172.21.15.102:0/2806033687' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4ba9dd02-977d-45fb-b366-ade15b52232b"}]: dispatch 2024-09-12T12:18:49.077 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:48 smithi102 ceph-mon[34799]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4ba9dd02-977d-45fb-b366-ade15b52232b"}]: dispatch 2024-09-12T12:18:49.077 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:48 smithi102 ceph-mon[34799]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4ba9dd02-977d-45fb-b366-ade15b52232b"}]': finished 2024-09-12T12:18:49.077 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:48 smithi102 ceph-mon[34799]: osdmap e14: 3 total, 2 up, 3 in 2024-09-12T12:18:49.077 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:48 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:18:49.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:48 smithi043 ceph-mon[34144]: from='client.? 172.21.15.102:0/2806033687' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4ba9dd02-977d-45fb-b366-ade15b52232b"}]: dispatch 2024-09-12T12:18:49.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:48 smithi043 ceph-mon[34144]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4ba9dd02-977d-45fb-b366-ade15b52232b"}]: dispatch 2024-09-12T12:18:49.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:48 smithi043 ceph-mon[34144]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4ba9dd02-977d-45fb-b366-ade15b52232b"}]': finished 2024-09-12T12:18:49.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:48 smithi043 ceph-mon[34144]: osdmap e14: 3 total, 2 up, 3 in 2024-09-12T12:18:49.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:48 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:18:50.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:49 smithi043 ceph-mon[34144]: pgmap v58: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:18:50.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:49 smithi043 ceph-mon[34144]: from='client.? 172.21.15.102:0/1823153661' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:18:50.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:49 smithi102 ceph-mon[34799]: pgmap v58: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:18:50.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:49 smithi102 ceph-mon[34799]: from='client.? 172.21.15.102:0/1823153661' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:18:50.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:49 smithi033 ceph-mon[31246]: pgmap v58: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:18:50.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:49 smithi033 ceph-mon[31246]: from='client.? 172.21.15.102:0/1823153661' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:18:51.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:50 smithi043 ceph-mon[34144]: pgmap v60: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:18:51.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:50 smithi102 ceph-mon[34799]: pgmap v60: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:18:51.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:50 smithi033 ceph-mon[31246]: pgmap v60: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:18:53.123 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:52 smithi102 ceph-mon[34799]: pgmap v61: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:18:53.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:52 smithi033 ceph-mon[31246]: pgmap v61: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:18:53.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:52 smithi043 ceph-mon[34144]: pgmap v61: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:18:55.142 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:54 smithi102 ceph-mon[34799]: pgmap v62: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:18:55.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:54 smithi033 ceph-mon[31246]: pgmap v62: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:18:55.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:54 smithi043 ceph-mon[34144]: pgmap v62: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:18:57.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:56 smithi102 ceph-mon[34799]: pgmap v63: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:18:57.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:56 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T12:18:57.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:56 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:57.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:56 smithi102 ceph-mon[34799]: Deploying daemon osd.2 on smithi102 2024-09-12T12:18:57.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:56 smithi033 ceph-mon[31246]: pgmap v63: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:18:57.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:56 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T12:18:57.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:56 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:57.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:56 smithi033 ceph-mon[31246]: Deploying daemon osd.2 on smithi102 2024-09-12T12:18:57.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:56 smithi043 ceph-mon[34144]: pgmap v63: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:18:57.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:56 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T12:18:57.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:56 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:57.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:56 smithi043 ceph-mon[34144]: Deploying daemon osd.2 on smithi102 2024-09-12T12:18:59.136 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:18:58 smithi102 ceph-mon[34799]: pgmap v64: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:18:59.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:18:58 smithi033 ceph-mon[31246]: pgmap v64: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:18:59.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:18:58 smithi043 ceph-mon[34144]: pgmap v64: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:19:01.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:00 smithi102 ceph-mon[34799]: pgmap v65: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:19:01.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:00 smithi033 ceph-mon[31246]: pgmap v65: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:19:01.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:00 smithi043 ceph-mon[34144]: pgmap v65: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:19:03.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:02 smithi102 ceph-mon[34799]: pgmap v66: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:19:03.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:02 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:19:03.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:02 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:03.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:02 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:03.233 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:02 smithi033 ceph-mon[31246]: pgmap v66: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:19:03.233 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:02 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:19:03.233 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:02 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:03.233 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:02 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:03.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:02 smithi043 ceph-mon[34144]: pgmap v66: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:19:03.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:02 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:19:03.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:02 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:03.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:02 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:05.027 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:04 smithi102 ceph-mon[34799]: pgmap v67: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:19:05.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:04 smithi033 ceph-mon[31246]: pgmap v67: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:19:05.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:04 smithi043 ceph-mon[34144]: pgmap v67: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:19:06.513 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:06 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:06.513 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:06 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:06.513 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:06 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:06.513 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:06 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:19:06.513 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:06 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:06.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:19:06.512+0000 7fadd5ffb640 1 -- 172.21.15.102:0/3569139310 <== mgr.14150 v2:172.21.15.33:6800/176202431 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fadd8062630 con 0x7fadc80a2b20 2024-09-12T12:19:06.514 INFO:teuthology.orchestra.run.smithi102.stdout:Created osd(s) 2 on host 'smithi102' 2024-09-12T12:19:06.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:19:06.514+0000 7fadded32640 1 -- 172.21.15.102:0/3569139310 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fadc80a2b20 msgr2=0x7fadc80a4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:06.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:19:06.514+0000 7fadded32640 1 --2- 172.21.15.102:0/3569139310 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fadc80a2b20 0x7fadc80a4fe0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fadcc005ab0 tx=0x7fadcc005a20 comp rx=0 tx=0).stop 2024-09-12T12:19:06.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:19:06.514+0000 7fadded32640 1 -- 172.21.15.102:0/3569139310 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fadd81099b0 msgr2=0x7fadd81a7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:06.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:19:06.514+0000 7fadded32640 1 --2- 172.21.15.102:0/3569139310 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fadd81099b0 0x7fadd81a7c80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fadd000cab0 tx=0x7fadd000cf70 comp rx=0 tx=0).stop 2024-09-12T12:19:06.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:19:06.514+0000 7fadded32640 1 -- 172.21.15.102:0/3569139310 shutdown_connections 2024-09-12T12:19:06.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:19:06.514+0000 7fadded32640 1 --2- 172.21.15.102:0/3569139310 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fadc80a2b20 0x7fadc80a4fe0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:06.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:19:06.514+0000 7fadded32640 1 --2- 172.21.15.102:0/3569139310 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fadd81099b0 0x7fadd81a7c80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:06.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:19:06.514+0000 7fadded32640 1 --2- 172.21.15.102:0/3569139310 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fadd80738d0 0x7fadd81a0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:06.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:19:06.514+0000 7fadded32640 1 --2- 172.21.15.102:0/3569139310 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fadd8072db0 0x7fadd81a06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:06.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:19:06.514+0000 7fadded32640 1 -- 172.21.15.102:0/3569139310 >> 172.21.15.102:0/3569139310 conn(0x7fadd806edf0 msgr2=0x7fadd810e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:06.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:19:06.514+0000 7fadded32640 1 -- 172.21.15.102:0/3569139310 shutdown_connections 2024-09-12T12:19:06.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:19:06.514+0000 7fadded32640 1 -- 172.21.15.102:0/3569139310 wait complete. 2024-09-12T12:19:06.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:06 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:06.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:06 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:06.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:06 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:06.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:06 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:19:06.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:06 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:06.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:06 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:06.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:06 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:06.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:06 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:06.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:06 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:19:06.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:06 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:07.092 DEBUG:teuthology.orchestra.run.smithi102:osd.2> sudo journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@osd.2.service 2024-09-12T12:19:07.095 INFO:tasks.cephadm:Deploying osd.3 on smithi033 with /dev/vg_nvme/lv_3... 2024-09-12T12:19:07.095 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-12T12:19:07.363 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:19:07.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:07 smithi102 ceph-mon[34799]: pgmap v68: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:19:07.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:07 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:19:07.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:07 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:07.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:07 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:07.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:07 smithi033 ceph-mon[31246]: pgmap v68: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:19:07.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:07 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:19:07.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:07 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:07.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:07 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:07.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:07 smithi043 ceph-mon[34144]: pgmap v68: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:19:07.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:07 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:19:07.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:07 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:07.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:07 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:08.190 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 12 12:19:07 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-2[39763]: 2024-09-12T12:19:07.895+0000 7fa9ac2cb640 -1 osd.2 0 log_to_monitors true 2024-09-12T12:19:08.721 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:08 smithi102 ceph-mon[34799]: from='osd.2 [v2:172.21.15.102:6800/4257223217,v1:172.21.15.102:6801/4257223217]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T12:19:08.721 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:08 smithi102 ceph-mon[34799]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T12:19:08.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:08 smithi033 ceph-mon[31246]: from='osd.2 [v2:172.21.15.102:6800/4257223217,v1:172.21.15.102:6801/4257223217]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T12:19:08.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:08 smithi033 ceph-mon[31246]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T12:19:08.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:08 smithi043 ceph-mon[34144]: from='osd.2 [v2:172.21.15.102:6800/4257223217,v1:172.21.15.102:6801/4257223217]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T12:19:08.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:08 smithi043 ceph-mon[34144]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T12:19:09.677 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:09 smithi033 ceph-mon[31246]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:19:09.678 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:09 smithi033 ceph-mon[31246]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T12:19:09.678 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:09 smithi033 ceph-mon[31246]: osdmap e15: 3 total, 2 up, 3 in 2024-09-12T12:19:09.678 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:09 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:19:09.678 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:09 smithi033 ceph-mon[31246]: from='osd.2 [v2:172.21.15.102:6800/4257223217,v1:172.21.15.102:6801/4257223217]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-12T12:19:09.678 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:09 smithi033 ceph-mon[31246]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-12T12:19:09.746 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:09 smithi102 ceph-mon[34799]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:19:09.746 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:09 smithi102 ceph-mon[34799]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T12:19:09.746 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:09 smithi102 ceph-mon[34799]: osdmap e15: 3 total, 2 up, 3 in 2024-09-12T12:19:09.747 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:09 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:19:09.747 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:09 smithi102 ceph-mon[34799]: from='osd.2 [v2:172.21.15.102:6800/4257223217,v1:172.21.15.102:6801/4257223217]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-12T12:19:09.747 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:09 smithi102 ceph-mon[34799]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-12T12:19:09.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:09 smithi043 ceph-mon[34144]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:19:09.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:09 smithi043 ceph-mon[34144]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T12:19:09.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:09 smithi043 ceph-mon[34144]: osdmap e15: 3 total, 2 up, 3 in 2024-09-12T12:19:09.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:09 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:19:09.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:09 smithi043 ceph-mon[34144]: from='osd.2 [v2:172.21.15.102:6800/4257223217,v1:172.21.15.102:6801/4257223217]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-12T12:19:09.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:09 smithi043 ceph-mon[34144]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-12T12:19:10.019 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:19:10.045 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi033:vg_nvme/lv_3 2024-09-12T12:19:10.146 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 12 12:19:09 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-2[39763]: 2024-09-12T12:19:09.875+0000 7fa9a824e640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T12:19:10.146 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 12 12:19:09 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-2[39763]: 2024-09-12T12:19:09.879+0000 7fa9a006e640 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T12:19:10.299 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:19:10.635 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:10 smithi033 ceph-mon[31246]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-12T12:19:10.635 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:10 smithi033 ceph-mon[31246]: osdmap e16: 3 total, 2 up, 3 in 2024-09-12T12:19:10.635 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:10 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:19:10.635 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:10 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:19:10.635 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:10 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:10.635 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:10 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:10.635 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:10 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:19:10.635 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:10 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:10.636 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:10 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:10.636 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:10 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:19:10.636 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:10 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:10.636 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:10 smithi033 ceph-mon[31246]: from='osd.2 ' entity='osd.2' 2024-09-12T12:19:10.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:10.826+0000 7f0b5975f640 1 -- 172.21.15.33:0/1894857167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b54107960 msgr2=0x7f0b54109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:10.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:10.826+0000 7f0b5975f640 1 --2- 172.21.15.33:0/1894857167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b54107960 0x7f0b54109d50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c009ca0 tx=0x7f0b4c02a8c0 comp rx=0 tx=0).stop 2024-09-12T12:19:10.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:10.826+0000 7f0b5975f640 1 -- 172.21.15.33:0/1894857167 shutdown_connections 2024-09-12T12:19:10.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:10.826+0000 7f0b5975f640 1 --2- 172.21.15.33:0/1894857167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b54107960 0x7f0b54109d50 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:10.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:10.826+0000 7f0b5975f640 1 --2- 172.21.15.33:0/1894857167 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b54105030 0x7f0b54107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:10.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:10.826+0000 7f0b5975f640 1 --2- 172.21.15.33:0/1894857167 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b54102700 0x7f0b54104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:10.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:10.826+0000 7f0b5975f640 1 -- 172.21.15.33:0/1894857167 >> 172.21.15.33:0/1894857167 conn(0x7f0b540fc280 msgr2=0x7f0b540fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:10.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:10.826+0000 7f0b5975f640 1 -- 172.21.15.33:0/1894857167 shutdown_connections 2024-09-12T12:19:10.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:10.826+0000 7f0b5975f640 1 -- 172.21.15.33:0/1894857167 wait complete. 2024-09-12T12:19:10.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:10.826+0000 7f0b5975f640 1 Processor -- start 2024-09-12T12:19:10.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:10.826+0000 7f0b5975f640 1 -- start start 2024-09-12T12:19:10.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:10.827+0000 7f0b5975f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b54102700 0x7f0b54102060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:10.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:10.827+0000 7f0b5975f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b54105030 0x7f0b541006b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:10.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:10.827+0000 7f0b5975f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b54107960 0x7f0b54100bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:10.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:10.827+0000 7f0b5975f640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5410d780 con 0x7f0b54107960 2024-09-12T12:19:10.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:10.827+0000 7f0b5975f640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5410d600 con 0x7f0b54105030 2024-09-12T12:19:10.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:10.827+0000 7f0b5975f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5410d900 con 0x7f0b54102700 2024-09-12T12:19:10.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:10.827+0000 7f0b537fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b54107960 0x7f0b54100bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:10.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:10.827+0000 7f0b537fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b54107960 0x7f0b54100bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44134/0 (socket says 172.21.15.33:44134) 2024-09-12T12:19:10.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:10.827+0000 7f0b537fe640 1 -- 172.21.15.33:0/1922783048 learned_addr learned my addr 172.21.15.33:0/1922783048 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:19:10.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:10.827+0000 7f0b52ffd640 1 --2- 172.21.15.33:0/1922783048 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b54102700 0x7f0b54102060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:10.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:10.827+0000 7f0b527fc640 1 --2- 172.21.15.33:0/1922783048 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b54105030 0x7f0b541006b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:10.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:10.827+0000 7f0b537fe640 1 -- 172.21.15.33:0/1922783048 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b54102700 msgr2=0x7f0b54102060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:10.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:10.827+0000 7f0b537fe640 1 --2- 172.21.15.33:0/1922783048 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b54102700 0x7f0b54102060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:10.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:10.827+0000 7f0b537fe640 1 -- 172.21.15.33:0/1922783048 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b54105030 msgr2=0x7f0b541006b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:10.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:10.827+0000 7f0b537fe640 1 --2- 172.21.15.33:0/1922783048 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b54105030 0x7f0b541006b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:10.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:10.827+0000 7f0b537fe640 1 -- 172.21.15.33:0/1922783048 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b541014b0 con 0x7f0b54107960 2024-09-12T12:19:10.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:10.827+0000 7f0b537fe640 1 --2- 172.21.15.33:0/1922783048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b54107960 0x7f0b54100bf0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c009dc0 tx=0x7f0b4c003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:10.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:10.827+0000 7f0b4bfff640 1 -- 172.21.15.33:0/1922783048 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c004040 con 0x7f0b54107960 2024-09-12T12:19:10.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:10.827+0000 7f0b4bfff640 1 -- 172.21.15.33:0/1922783048 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0b4c004690 con 0x7f0b54107960 2024-09-12T12:19:10.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:10.827+0000 7f0b5975f640 1 -- 172.21.15.33:0/1922783048 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b541a1ee0 con 0x7f0b54107960 2024-09-12T12:19:10.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:10.827+0000 7f0b4bfff640 1 -- 172.21.15.33:0/1922783048 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c02f4c0 con 0x7f0b54107960 2024-09-12T12:19:10.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:10.828+0000 7f0b5975f640 1 -- 172.21.15.33:0/1922783048 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b541a23e0 con 0x7f0b54107960 2024-09-12T12:19:10.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:10.829+0000 7f0b5975f640 1 -- 172.21.15.33:0/1922783048 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b540fdd70 con 0x7f0b54107960 2024-09-12T12:19:10.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:10.830+0000 7f0b4bfff640 1 -- 172.21.15.33:0/1922783048 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f0b4c0305c0 con 0x7f0b54107960 2024-09-12T12:19:10.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:10.830+0000 7f0b4bfff640 1 --2- 172.21.15.33:0/1922783048 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0b380a2b70 0x7f0b380a5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:10.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:10.830+0000 7f0b52ffd640 1 --2- 172.21.15.33:0/1922783048 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0b380a2b70 0x7f0b380a5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:10.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:10.830+0000 7f0b4bfff640 1 -- 172.21.15.33:0/1922783048 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2571+0+0 (secure 0 0 0) 0x7f0b4c0ef020 con 0x7f0b54107960 2024-09-12T12:19:10.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:10.831+0000 7f0b52ffd640 1 --2- 172.21.15.33:0/1922783048 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0b380a2b70 0x7f0b380a5030 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0b4400abe0 tx=0x7f0b4400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:10.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:10.835+0000 7f0b4bfff640 1 -- 172.21.15.33:0/1922783048 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0b4c04d3a0 con 0x7f0b54107960 2024-09-12T12:19:10.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:10 smithi043 ceph-mon[34144]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-12T12:19:10.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:10 smithi043 ceph-mon[34144]: osdmap e16: 3 total, 2 up, 3 in 2024-09-12T12:19:10.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:10 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:19:10.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:10 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:19:10.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:10 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:10.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:10 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:10.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:10 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:19:10.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:10 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:10.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:10 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:10.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:10 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:19:10.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:10 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:10.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:10 smithi043 ceph-mon[34144]: from='osd.2 ' entity='osd.2' 2024-09-12T12:19:10.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:10 smithi102 ceph-mon[34799]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-12T12:19:10.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:10 smithi102 ceph-mon[34799]: osdmap e16: 3 total, 2 up, 3 in 2024-09-12T12:19:10.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:10 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:19:10.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:10 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:19:10.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:10 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:10.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:10 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:10.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:10 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:19:10.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:10 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:10.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:10 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:10.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:10 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:19:10.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:10 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:10.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:10 smithi102 ceph-mon[34799]: from='osd.2 ' entity='osd.2' 2024-09-12T12:19:11.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:11.020+0000 7f0b5975f640 1 -- 172.21.15.33:0/1922783048 --> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f0b54062630 con 0x7f0b380a2b70 2024-09-12T12:19:11.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:11 smithi033 ceph-mon[31246]: purged_snaps scrub starts 2024-09-12T12:19:11.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:11 smithi033 ceph-mon[31246]: purged_snaps scrub ok 2024-09-12T12:19:11.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:11 smithi033 ceph-mon[31246]: pgmap v72: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:19:11.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:11 smithi033 ceph-mon[31246]: Detected new or changed devices on smithi102 2024-09-12T12:19:11.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:11 smithi033 ceph-mon[31246]: Adjusting osd_memory_target on smithi102 to 17088M 2024-09-12T12:19:11.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:11 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:19:11.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:11 smithi033 ceph-mon[31246]: osd.2 [v2:172.21.15.102:6800/4257223217,v1:172.21.15.102:6801/4257223217] boot 2024-09-12T12:19:11.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:11 smithi033 ceph-mon[31246]: osdmap e17: 3 total, 3 up, 3 in 2024-09-12T12:19:11.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:11 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:19:11.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:11 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:19:11.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:11 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:19:11.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:11 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:11.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:11 smithi043 ceph-mon[34144]: purged_snaps scrub starts 2024-09-12T12:19:11.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:11 smithi043 ceph-mon[34144]: purged_snaps scrub ok 2024-09-12T12:19:11.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:11 smithi043 ceph-mon[34144]: pgmap v72: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:19:11.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:11 smithi043 ceph-mon[34144]: Detected new or changed devices on smithi102 2024-09-12T12:19:11.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:11 smithi043 ceph-mon[34144]: Adjusting osd_memory_target on smithi102 to 17088M 2024-09-12T12:19:11.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:11 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:19:11.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:11 smithi043 ceph-mon[34144]: osd.2 [v2:172.21.15.102:6800/4257223217,v1:172.21.15.102:6801/4257223217] boot 2024-09-12T12:19:11.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:11 smithi043 ceph-mon[34144]: osdmap e17: 3 total, 3 up, 3 in 2024-09-12T12:19:11.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:11 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:19:11.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:11 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:19:11.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:11 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:19:11.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:11 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:11.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:11 smithi102 ceph-mon[34799]: purged_snaps scrub starts 2024-09-12T12:19:11.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:11 smithi102 ceph-mon[34799]: purged_snaps scrub ok 2024-09-12T12:19:11.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:11 smithi102 ceph-mon[34799]: pgmap v72: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:19:11.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:11 smithi102 ceph-mon[34799]: Detected new or changed devices on smithi102 2024-09-12T12:19:11.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:11 smithi102 ceph-mon[34799]: Adjusting osd_memory_target on smithi102 to 17088M 2024-09-12T12:19:11.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:11 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:19:11.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:11 smithi102 ceph-mon[34799]: osd.2 [v2:172.21.15.102:6800/4257223217,v1:172.21.15.102:6801/4257223217] boot 2024-09-12T12:19:11.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:11 smithi102 ceph-mon[34799]: osdmap e17: 3 total, 3 up, 3 in 2024-09-12T12:19:11.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:11 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:19:11.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:11 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:19:11.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:11 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:19:11.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:11 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:12.546 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:12 smithi033 ceph-mon[31246]: from='client.14289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:19:12.547 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:12 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-12T12:19:12.547 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:12 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-12T12:19:12.547 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:12 smithi033 ceph-mon[31246]: osdmap e18: 3 total, 3 up, 3 in 2024-09-12T12:19:12.547 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:12 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T12:19:12.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:12 smithi043 ceph-mon[34144]: from='client.14289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:19:12.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:12 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-12T12:19:12.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:12 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-12T12:19:12.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:12 smithi043 ceph-mon[34144]: osdmap e18: 3 total, 3 up, 3 in 2024-09-12T12:19:12.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:12 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T12:19:12.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:12 smithi102 ceph-mon[34799]: from='client.14289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:19:12.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:12 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-12T12:19:12.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:12 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-12T12:19:12.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:12 smithi102 ceph-mon[34799]: osdmap e18: 3 total, 3 up, 3 in 2024-09-12T12:19:12.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:12 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T12:19:13.791 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:13 smithi033 ceph-mon[31246]: pgmap v74: 0 pgs: ; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:19:13.791 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:13 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-12T12:19:13.791 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:13 smithi033 ceph-mon[31246]: osdmap e19: 3 total, 3 up, 3 in 2024-09-12T12:19:13.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:13 smithi043 ceph-mon[34144]: pgmap v74: 0 pgs: ; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:19:13.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:13 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-12T12:19:13.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:13 smithi043 ceph-mon[34144]: osdmap e19: 3 total, 3 up, 3 in 2024-09-12T12:19:13.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:13 smithi102 ceph-mon[34799]: pgmap v74: 0 pgs: ; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:19:13.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:13 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-12T12:19:13.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:13 smithi102 ceph-mon[34799]: osdmap e19: 3 total, 3 up, 3 in 2024-09-12T12:19:14.129 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 12 12:19:13 smithi033 sudo[50306]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T12:19:14.129 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 12 12:19:13 smithi033 sudo[50306]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T12:19:14.129 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 12 12:19:13 smithi033 sudo[50306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T12:19:14.129 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 12 12:19:13 smithi033 sudo[50306]: pam_unix(sudo:session): session closed for user root 2024-09-12T12:19:14.480 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 12 12:19:14 smithi033 sudo[50350]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T12:19:14.481 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 12 12:19:14 smithi033 sudo[50350]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T12:19:14.481 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 12 12:19:14 smithi033 sudo[50350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T12:19:14.481 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 12 12:19:14 smithi033 sudo[50350]: pam_unix(sudo:session): session closed for user root 2024-09-12T12:19:14.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:14.569+0000 7f0b4bfff640 1 -- 172.21.15.33:0/1922783048 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f0b4c0b9640 con 0x7f0b54107960 2024-09-12T12:19:14.793 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:14 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/4150753607' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "345aa854-9ea2-4103-a186-9794af34c237"}]: dispatch 2024-09-12T12:19:14.793 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:14 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/4150753607' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "345aa854-9ea2-4103-a186-9794af34c237"}]': finished 2024-09-12T12:19:14.793 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:14 smithi043 ceph-mon[34144]: osdmap e20: 4 total, 3 up, 4 in 2024-09-12T12:19:14.793 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:14 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:19:14.793 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:14 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/2017130846' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:19:14.793 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:14 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:14.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:14 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/4150753607' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "345aa854-9ea2-4103-a186-9794af34c237"}]: dispatch 2024-09-12T12:19:14.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:14 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/4150753607' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "345aa854-9ea2-4103-a186-9794af34c237"}]': finished 2024-09-12T12:19:14.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:14 smithi102 ceph-mon[34799]: osdmap e20: 4 total, 3 up, 4 in 2024-09-12T12:19:14.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:14 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:19:14.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:14 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/2017130846' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:19:14.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:14 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:14.980 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:14 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/4150753607' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "345aa854-9ea2-4103-a186-9794af34c237"}]: dispatch 2024-09-12T12:19:14.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:14 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/4150753607' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "345aa854-9ea2-4103-a186-9794af34c237"}]': finished 2024-09-12T12:19:14.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:14 smithi033 ceph-mon[31246]: osdmap e20: 4 total, 3 up, 4 in 2024-09-12T12:19:14.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:14 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:19:14.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:14 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/2017130846' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:19:14.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:14 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:15.115 INFO:journalctl@ceph.osd.1.smithi043.stdout:Sep 12 12:19:14 smithi043 sudo[42290]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T12:19:15.115 INFO:journalctl@ceph.osd.1.smithi043.stdout:Sep 12 12:19:14 smithi043 sudo[42290]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T12:19:15.115 INFO:journalctl@ceph.osd.1.smithi043.stdout:Sep 12 12:19:14 smithi043 sudo[42290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T12:19:15.115 INFO:journalctl@ceph.osd.1.smithi043.stdout:Sep 12 12:19:14 smithi043 sudo[42290]: pam_unix(sudo:session): session closed for user root 2024-09-12T12:19:15.565 INFO:journalctl@ceph.osd.1.smithi043.stdout:Sep 12 12:19:15 smithi043 sudo[42293]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T12:19:15.565 INFO:journalctl@ceph.osd.1.smithi043.stdout:Sep 12 12:19:15 smithi043 sudo[42293]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T12:19:15.565 INFO:journalctl@ceph.osd.1.smithi043.stdout:Sep 12 12:19:15 smithi043 sudo[42293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T12:19:15.565 INFO:journalctl@ceph.osd.1.smithi043.stdout:Sep 12 12:19:15 smithi043 sudo[42293]: pam_unix(sudo:session): session closed for user root 2024-09-12T12:19:15.771 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 12 12:19:15 smithi102 sudo[43370]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T12:19:15.771 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 12 12:19:15 smithi102 sudo[43370]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T12:19:15.771 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 12 12:19:15 smithi102 sudo[43370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T12:19:15.772 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 12 12:19:15 smithi102 sudo[43370]: pam_unix(sudo:session): session closed for user root 2024-09-12T12:19:15.772 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:15 smithi102 ceph-mon[34799]: pgmap v78: 1 pgs: 1 creating+peering; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:19:15.772 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:15 smithi102 ceph-mon[34799]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-12T12:19:15.772 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:15 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:15.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:15 smithi043 ceph-mon[34144]: pgmap v78: 1 pgs: 1 creating+peering; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:19:15.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:15 smithi043 ceph-mon[34144]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-12T12:19:15.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:15 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:15.980 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:15 smithi033 ceph-mon[31246]: pgmap v78: 1 pgs: 1 creating+peering; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:19:15.980 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:15 smithi033 ceph-mon[31246]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-12T12:19:15.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:15 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:16.146 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 12 12:19:15 smithi102 sudo[43373]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T12:19:16.146 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 12 12:19:15 smithi102 sudo[43373]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T12:19:16.146 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 12 12:19:15 smithi102 sudo[43373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T12:19:16.146 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 12 12:19:15 smithi102 sudo[43373]: pam_unix(sudo:session): session closed for user root 2024-09-12T12:19:16.691 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:16 smithi033 sudo[50749]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T12:19:16.692 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:16 smithi033 sudo[50749]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T12:19:16.692 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:16 smithi033 sudo[50749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T12:19:16.692 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:16 smithi033 sudo[50749]: pam_unix(sudo:session): session closed for user root 2024-09-12T12:19:16.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:16 smithi033 sudo[50937]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T12:19:16.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:16 smithi033 sudo[50937]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T12:19:16.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:16 smithi033 sudo[50937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T12:19:16.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:16 smithi033 sudo[50937]: pam_unix(sudo:session): session closed for user root 2024-09-12T12:19:17.191 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:16 smithi102 sudo[43376]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T12:19:17.191 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:16 smithi102 sudo[43376]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T12:19:17.192 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:16 smithi102 sudo[43376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T12:19:17.192 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:16 smithi102 sudo[43376]: pam_unix(sudo:session): session closed for user root 2024-09-12T12:19:17.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:17 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:17.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:17 smithi033 ceph-mon[31246]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T12:19:17.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:17 smithi033 ceph-mon[31246]: pgmap v79: 1 pgs: 1 creating+peering; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:19:17.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:17 smithi033 ceph-mon[31246]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T12:19:17.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:17 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:19:17.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:17 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:19:17.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:17 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:19:17.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:17 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:19:17.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:17 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:19:17.482 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:17 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:19:17.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:17 smithi102 sudo[43379]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T12:19:17.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:17 smithi102 sudo[43379]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T12:19:17.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:17 smithi102 sudo[43379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T12:19:17.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:17 smithi102 sudo[43379]: pam_unix(sudo:session): session closed for user root 2024-09-12T12:19:17.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:17 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:17.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:17 smithi102 ceph-mon[34799]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T12:19:17.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:17 smithi102 ceph-mon[34799]: pgmap v79: 1 pgs: 1 creating+peering; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:19:17.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:17 smithi102 ceph-mon[34799]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T12:19:17.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:17 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:19:17.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:17 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:19:17.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:17 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:19:17.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:17 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:19:17.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:17 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:19:17.648 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:17 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:19:18.093 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:17 smithi043 sudo[42296]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T12:19:18.094 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:17 smithi043 sudo[42296]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T12:19:18.094 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:17 smithi043 sudo[42296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T12:19:18.094 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:17 smithi043 sudo[42296]: pam_unix(sudo:session): session closed for user root 2024-09-12T12:19:18.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:18 smithi043 sudo[42299]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T12:19:18.366 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:18 smithi043 sudo[42299]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T12:19:18.366 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:18 smithi043 sudo[42299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T12:19:18.366 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:18 smithi043 sudo[42299]: pam_unix(sudo:session): session closed for user root 2024-09-12T12:19:18.366 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:18 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:18.366 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:18 smithi043 ceph-mon[34144]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T12:19:18.366 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:18 smithi043 ceph-mon[34144]: pgmap v79: 1 pgs: 1 creating+peering; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:19:18.366 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:18 smithi043 ceph-mon[34144]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T12:19:18.366 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:18 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:19:18.366 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:18 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:19:18.366 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:18 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:19:18.366 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:18 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:19:18.366 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:18 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:19:18.366 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:18 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:19:18.367 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:18 smithi043 ceph-mon[34144]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T12:19:18.367 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:18 smithi043 ceph-mon[34144]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T12:19:18.367 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:18 smithi043 ceph-mon[34144]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T12:19:18.367 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:18 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:19:18.367 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:18 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:19:18.367 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:18 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:19:18.367 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:18 smithi043 ceph-mon[34144]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T12:19:18.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:18 smithi033 ceph-mon[31246]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T12:19:18.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:18 smithi033 ceph-mon[31246]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T12:19:18.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:18 smithi033 ceph-mon[31246]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T12:19:18.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:18 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:19:18.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:18 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:19:18.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:18 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:19:18.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:18 smithi033 ceph-mon[31246]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T12:19:18.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:18 smithi102 ceph-mon[34799]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T12:19:18.864 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:18 smithi102 ceph-mon[34799]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T12:19:18.865 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:18 smithi102 ceph-mon[34799]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T12:19:18.865 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:18 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:19:18.865 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:18 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:19:18.865 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:18 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:19:18.865 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:18 smithi102 ceph-mon[34799]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T12:19:19.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:19 smithi033 ceph-mon[31246]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:19:19.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:19 smithi043 ceph-mon[34144]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:19:19.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:19 smithi102 ceph-mon[34799]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:19:21.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:21 smithi033 ceph-mon[31246]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:19:21.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:21 smithi043 ceph-mon[34144]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:19:21.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:21 smithi102 ceph-mon[34799]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:19:22.472 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:22 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T12:19:22.472 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:22 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:22.472 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:22 smithi033 ceph-mon[31246]: Deploying daemon osd.3 on smithi033 2024-09-12T12:19:22.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:22 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T12:19:22.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:22 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:22.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:22 smithi043 ceph-mon[34144]: Deploying daemon osd.3 on smithi033 2024-09-12T12:19:22.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:22 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T12:19:22.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:22 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:22.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:22 smithi102 ceph-mon[34799]: Deploying daemon osd.3 on smithi033 2024-09-12T12:19:23.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:23 smithi033 ceph-mon[31246]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:19:23.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:23 smithi043 ceph-mon[34144]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:19:23.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:23 smithi102 ceph-mon[34799]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:19:25.346 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:25 smithi033 ceph-mon[31246]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-12T12:19:25.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:25 smithi043 ceph-mon[34144]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-12T12:19:25.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:25 smithi102 ceph-mon[34799]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-12T12:19:27.450 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:27 smithi033 ceph-mon[31246]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-12T12:19:27.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:27 smithi043 ceph-mon[34144]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-12T12:19:27.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:27 smithi102 ceph-mon[34799]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-12T12:19:28.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:28 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:19:28.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:28 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:28.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:28 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:28.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:28 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:19:28.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:28 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:28.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:28 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:28.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:28 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:19:28.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:28 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:28.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:28 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:29.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:29 smithi033 ceph-mon[31246]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-12T12:19:29.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:29 smithi043 ceph-mon[34144]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-12T12:19:29.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:29 smithi102 ceph-mon[34799]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-12T12:19:31.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:31 smithi033 ceph-mon[31246]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-12T12:19:31.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:31 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:31.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:31 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:31.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:31 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:31.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:31 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:19:31.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:31 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:32.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:31 smithi043 ceph-mon[34144]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-12T12:19:32.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:31 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:32.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:31 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:32.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:31 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:32.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:31 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:19:32.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:31 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:32.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:32.119+0000 7f0b4bfff640 1 -- 172.21.15.33:0/1922783048 <== mgr.14150 v2:172.21.15.33:6800/176202431 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0b54062630 con 0x7f0b380a2b70 2024-09-12T12:19:32.119 INFO:teuthology.orchestra.run.smithi033.stdout:Created osd(s) 3 on host 'smithi033' 2024-09-12T12:19:32.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:32.121+0000 7f0b5975f640 1 -- 172.21.15.33:0/1922783048 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0b380a2b70 msgr2=0x7f0b380a5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:32.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:32.121+0000 7f0b5975f640 1 --2- 172.21.15.33:0/1922783048 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0b380a2b70 0x7f0b380a5030 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0b4400abe0 tx=0x7f0b4400a2d0 comp rx=0 tx=0).stop 2024-09-12T12:19:32.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:32.121+0000 7f0b5975f640 1 -- 172.21.15.33:0/1922783048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b54107960 msgr2=0x7f0b54100bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:32.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:32.121+0000 7f0b5975f640 1 --2- 172.21.15.33:0/1922783048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b54107960 0x7f0b54100bf0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c009dc0 tx=0x7f0b4c003ba0 comp rx=0 tx=0).stop 2024-09-12T12:19:32.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:32.121+0000 7f0b5975f640 1 -- 172.21.15.33:0/1922783048 shutdown_connections 2024-09-12T12:19:32.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:32.121+0000 7f0b5975f640 1 --2- 172.21.15.33:0/1922783048 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0b380a2b70 0x7f0b380a5030 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:32.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:32.121+0000 7f0b5975f640 1 --2- 172.21.15.33:0/1922783048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b54107960 0x7f0b54100bf0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:32.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:32.121+0000 7f0b5975f640 1 --2- 172.21.15.33:0/1922783048 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b54105030 0x7f0b541006b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:32.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:32.121+0000 7f0b5975f640 1 --2- 172.21.15.33:0/1922783048 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b54102700 0x7f0b54102060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:32.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:32.121+0000 7f0b5975f640 1 -- 172.21.15.33:0/1922783048 >> 172.21.15.33:0/1922783048 conn(0x7f0b540fc280 msgr2=0x7f0b54102fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:32.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:32.121+0000 7f0b5975f640 1 -- 172.21.15.33:0/1922783048 shutdown_connections 2024-09-12T12:19:32.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:19:32.122+0000 7f0b5975f640 1 -- 172.21.15.33:0/1922783048 wait complete. 2024-09-12T12:19:32.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:31 smithi102 ceph-mon[34799]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-12T12:19:32.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:31 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:32.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:31 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:32.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:31 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:32.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:31 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:19:32.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:31 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:32.798 DEBUG:teuthology.orchestra.run.smithi033:osd.3> sudo journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@osd.3.service 2024-09-12T12:19:32.800 INFO:tasks.cephadm:Deploying osd.4 on smithi043 with /dev/vg_nvme/lv_3... 2024-09-12T12:19:32.800 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-12T12:19:32.976 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:32 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:19:32.977 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:32 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:32.977 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:32 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:33.066 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T12:19:33.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:32 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:19:33.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:32 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:33.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:32 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:33.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:32 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:19:33.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:32 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:33.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:32 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:33.721 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 12 12:19:33 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-3[52341]: 2024-09-12T12:19:33.417+0000 7f7f76c91640 -1 osd.3 0 log_to_monitors true 2024-09-12T12:19:33.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:33 smithi043 ceph-mon[34144]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-12T12:19:33.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:33 smithi043 ceph-mon[34144]: from='osd.3 [v2:172.21.15.33:6810/2483872739,v1:172.21.15.33:6811/2483872739]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T12:19:33.979 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:33 smithi033 ceph-mon[31246]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-12T12:19:33.979 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:33 smithi033 ceph-mon[31246]: from='osd.3 [v2:172.21.15.33:6810/2483872739,v1:172.21.15.33:6811/2483872739]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T12:19:34.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:33 smithi102 ceph-mon[34799]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-12T12:19:34.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:33 smithi102 ceph-mon[34799]: from='osd.3 [v2:172.21.15.33:6810/2483872739,v1:172.21.15.33:6811/2483872739]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T12:19:34.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:34 smithi033 ceph-mon[31246]: from='osd.3 [v2:172.21.15.33:6810/2483872739,v1:172.21.15.33:6811/2483872739]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T12:19:34.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:34 smithi033 ceph-mon[31246]: osdmap e21: 4 total, 3 up, 4 in 2024-09-12T12:19:34.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:34 smithi033 ceph-mon[31246]: from='osd.3 [v2:172.21.15.33:6810/2483872739,v1:172.21.15.33:6811/2483872739]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-09-12T12:19:34.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:34 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:19:34.982 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 12 12:19:34 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-3[52341]: 2024-09-12T12:19:34.734+0000 7f7f72c14640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T12:19:34.982 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 12 12:19:34 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-3[52341]: 2024-09-12T12:19:34.738+0000 7f7f6ea3c640 -1 osd.3 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T12:19:35.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:34 smithi043 ceph-mon[34144]: from='osd.3 [v2:172.21.15.33:6810/2483872739,v1:172.21.15.33:6811/2483872739]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T12:19:35.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:34 smithi043 ceph-mon[34144]: osdmap e21: 4 total, 3 up, 4 in 2024-09-12T12:19:35.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:34 smithi043 ceph-mon[34144]: from='osd.3 [v2:172.21.15.33:6810/2483872739,v1:172.21.15.33:6811/2483872739]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-09-12T12:19:35.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:34 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:19:35.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:34 smithi102 ceph-mon[34799]: from='osd.3 [v2:172.21.15.33:6810/2483872739,v1:172.21.15.33:6811/2483872739]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T12:19:35.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:34 smithi102 ceph-mon[34799]: osdmap e21: 4 total, 3 up, 4 in 2024-09-12T12:19:35.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:34 smithi102 ceph-mon[34799]: from='osd.3 [v2:172.21.15.33:6810/2483872739,v1:172.21.15.33:6811/2483872739]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-09-12T12:19:35.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:34 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:19:35.413 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T12:19:35.439 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi043:vg_nvme/lv_3 2024-09-12T12:19:35.695 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T12:19:35.978 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:35 smithi043 ceph-mon[34144]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:19:35.978 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:35 smithi043 ceph-mon[34144]: from='osd.3 [v2:172.21.15.33:6810/2483872739,v1:172.21.15.33:6811/2483872739]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-09-12T12:19:35.978 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:35 smithi043 ceph-mon[34144]: osdmap e22: 4 total, 3 up, 4 in 2024-09-12T12:19:35.978 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:35 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:19:35.978 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:35 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:19:35.980 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:35 smithi033 ceph-mon[31246]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:19:35.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:35 smithi033 ceph-mon[31246]: from='osd.3 [v2:172.21.15.33:6810/2483872739,v1:172.21.15.33:6811/2483872739]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-09-12T12:19:35.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:35 smithi033 ceph-mon[31246]: osdmap e22: 4 total, 3 up, 4 in 2024-09-12T12:19:35.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:35 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:19:35.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:35 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:19:36.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:35 smithi102 ceph-mon[34799]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:19:36.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:35 smithi102 ceph-mon[34799]: from='osd.3 [v2:172.21.15.33:6810/2483872739,v1:172.21.15.33:6811/2483872739]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-09-12T12:19:36.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:35 smithi102 ceph-mon[34799]: osdmap e22: 4 total, 3 up, 4 in 2024-09-12T12:19:36.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:35 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:19:36.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:35 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:19:36.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:36.151+0000 7f35f7002640 1 -- 172.21.15.43:0/2300901699 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f35f0100ad0 msgr2=0x7f35f0100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:36.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:36.151+0000 7f35f7002640 1 --2- 172.21.15.43:0/2300901699 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f35f0100ad0 0x7f35f0100ed0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f35e0009900 tx=0x7f35e002a410 comp rx=0 tx=0).stop 2024-09-12T12:19:36.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:36.151+0000 7f35f7002640 1 -- 172.21.15.43:0/2300901699 shutdown_connections 2024-09-12T12:19:36.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:36.151+0000 7f35f7002640 1 --2- 172.21.15.43:0/2300901699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35f0102690 0x7f35f0108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:36.151+0000 7f35f7002640 1 --2- 172.21.15.43:0/2300901699 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35f0101cd0 0x7f35f0102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:36.151+0000 7f35f7002640 1 --2- 172.21.15.43:0/2300901699 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f35f0100ad0 0x7f35f0100ed0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:36.151+0000 7f35f7002640 1 -- 172.21.15.43:0/2300901699 >> 172.21.15.43:0/2300901699 conn(0x7f35f00fc280 msgr2=0x7f35f00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:36.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:36.151+0000 7f35f7002640 1 -- 172.21.15.43:0/2300901699 shutdown_connections 2024-09-12T12:19:36.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:36.151+0000 7f35f7002640 1 -- 172.21.15.43:0/2300901699 wait complete. 2024-09-12T12:19:36.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:36.152+0000 7f35f7002640 1 Processor -- start 2024-09-12T12:19:36.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:36.152+0000 7f35f7002640 1 -- start start 2024-09-12T12:19:36.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:36.152+0000 7f35f7002640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f35f0100ad0 0x7f35f006aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:36.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:36.152+0000 7f35f7002640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35f0101cd0 0x7f35f019efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:36.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:36.152+0000 7f35f7002640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35f0102690 0x7f35f01a1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:36.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:36.152+0000 7f35f7002640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f35f010c660 con 0x7f35f0102690 2024-09-12T12:19:36.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:36.152+0000 7f35f7002640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f35f010c4e0 con 0x7f35f0100ad0 2024-09-12T12:19:36.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:36.152+0000 7f35f7002640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f35f010c7e0 con 0x7f35f0101cd0 2024-09-12T12:19:36.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:36.152+0000 7f35f4d9e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f35f0100ad0 0x7f35f006aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:36.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:36.153+0000 7f35f4d9e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f35f0100ad0 0x7f35f006aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47462/0 (socket says 172.21.15.43:47462) 2024-09-12T12:19:36.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:36.153+0000 7f35f4d9e640 1 -- 172.21.15.43:0/1874231206 learned_addr learned my addr 172.21.15.43:0/1874231206 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-12T12:19:36.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:36.153+0000 7f35f559f640 1 --2- 172.21.15.43:0/1874231206 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35f0102690 0x7f35f01a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:36.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:36.153+0000 7f35effff640 1 --2- 172.21.15.43:0/1874231206 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35f0101cd0 0x7f35f019efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:36.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:36.153+0000 7f35f4d9e640 1 -- 172.21.15.43:0/1874231206 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35f0101cd0 msgr2=0x7f35f019efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:36.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:36.153+0000 7f35f4d9e640 1 --2- 172.21.15.43:0/1874231206 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35f0101cd0 0x7f35f019efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:36.153+0000 7f35f4d9e640 1 -- 172.21.15.43:0/1874231206 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35f0102690 msgr2=0x7f35f01a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:36.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:36.153+0000 7f35f4d9e640 1 --2- 172.21.15.43:0/1874231206 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35f0102690 0x7f35f01a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:36.153+0000 7f35f4d9e640 1 -- 172.21.15.43:0/1874231206 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35f01a1d10 con 0x7f35f0100ad0 2024-09-12T12:19:36.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:36.153+0000 7f35f4d9e640 1 --2- 172.21.15.43:0/1874231206 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f35f0100ad0 0x7f35f006aad0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f35e00314e0 tx=0x7f35e0031a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:36.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:36.153+0000 7f35edffb640 1 -- 172.21.15.43:0/1874231206 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e003f030 con 0x7f35f0100ad0 2024-09-12T12:19:36.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:36.153+0000 7f35edffb640 1 -- 172.21.15.43:0/1874231206 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f35e00044b0 con 0x7f35f0100ad0 2024-09-12T12:19:36.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:36.153+0000 7f35f7002640 1 -- 172.21.15.43:0/1874231206 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35f01a1f40 con 0x7f35f0100ad0 2024-09-12T12:19:36.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:36.153+0000 7f35edffb640 1 -- 172.21.15.43:0/1874231206 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e0035070 con 0x7f35f0100ad0 2024-09-12T12:19:36.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:36.154+0000 7f35f7002640 1 -- 172.21.15.43:0/1874231206 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35f01a2410 con 0x7f35f0100ad0 2024-09-12T12:19:36.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:36.155+0000 7f35f7002640 1 -- 172.21.15.43:0/1874231206 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35f0107f90 con 0x7f35f0100ad0 2024-09-12T12:19:36.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:36.156+0000 7f35edffb640 1 -- 172.21.15.43:0/1874231206 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f35e0042030 con 0x7f35f0100ad0 2024-09-12T12:19:36.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:36.157+0000 7f35edffb640 1 --2- 172.21.15.43:0/1874231206 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f35d80a2bb0 0x7f35d80a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:36.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:36.157+0000 7f35edffb640 1 -- 172.21.15.43:0/1874231206 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 3702+0+0 (secure 0 0 0) 0x7f35e00ee900 con 0x7f35f0100ad0 2024-09-12T12:19:36.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:36.157+0000 7f35effff640 1 --2- 172.21.15.43:0/1874231206 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f35d80a2bb0 0x7f35d80a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:36.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:36.157+0000 7f35effff640 1 --2- 172.21.15.43:0/1874231206 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f35d80a2bb0 0x7f35d80a5070 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f35f006b050 tx=0x7f35e4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:36.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:36.160+0000 7f35edffb640 1 -- 172.21.15.43:0/1874231206 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f35e00bcae0 con 0x7f35f0100ad0 2024-09-12T12:19:36.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:36.346+0000 7f35f7002640 1 -- 172.21.15.43:0/1874231206 --> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f35f0062630 con 0x7f35d80a2bb0 2024-09-12T12:19:37.017 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:36 smithi043 ceph-mon[34144]: purged_snaps scrub starts 2024-09-12T12:19:37.018 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:36 smithi043 ceph-mon[34144]: purged_snaps scrub ok 2024-09-12T12:19:37.018 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:36 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:19:37.018 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:36 smithi043 ceph-mon[34144]: osd.3 [v2:172.21.15.33:6810/2483872739,v1:172.21.15.33:6811/2483872739] boot 2024-09-12T12:19:37.018 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:36 smithi043 ceph-mon[34144]: osdmap e23: 4 total, 4 up, 4 in 2024-09-12T12:19:37.018 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:36 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:19:37.018 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:36 smithi043 ceph-mon[34144]: Detected new or changed devices on smithi033 2024-09-12T12:19:37.018 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:36 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:37.018 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:36 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:37.018 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:36 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:19:37.018 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:36 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:19:37.018 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:36 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:37.018 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:36 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:37.019 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:36 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:19:37.019 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:36 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:37.019 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:36 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:19:37.019 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:36 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:19:37.019 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:36 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:37.019 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:36 smithi043 ceph-mon[34144]: osdmap e24: 4 total, 4 up, 4 in 2024-09-12T12:19:37.048 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:36 smithi102 ceph-mon[34799]: purged_snaps scrub starts 2024-09-12T12:19:37.048 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:36 smithi102 ceph-mon[34799]: purged_snaps scrub ok 2024-09-12T12:19:37.048 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:36 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:19:37.048 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:36 smithi102 ceph-mon[34799]: osd.3 [v2:172.21.15.33:6810/2483872739,v1:172.21.15.33:6811/2483872739] boot 2024-09-12T12:19:37.048 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:36 smithi102 ceph-mon[34799]: osdmap e23: 4 total, 4 up, 4 in 2024-09-12T12:19:37.048 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:36 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:19:37.048 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:36 smithi102 ceph-mon[34799]: Detected new or changed devices on smithi033 2024-09-12T12:19:37.048 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:36 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:37.048 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:36 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:37.048 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:36 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:19:37.048 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:36 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:19:37.048 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:36 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:37.048 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:36 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:37.049 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:36 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:19:37.049 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:36 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:37.049 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:36 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:19:37.049 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:36 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:19:37.049 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:36 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:37.049 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:36 smithi102 ceph-mon[34799]: osdmap e24: 4 total, 4 up, 4 in 2024-09-12T12:19:37.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:36 smithi033 ceph-mon[31246]: purged_snaps scrub starts 2024-09-12T12:19:37.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:36 smithi033 ceph-mon[31246]: purged_snaps scrub ok 2024-09-12T12:19:37.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:36 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:19:37.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:36 smithi033 ceph-mon[31246]: osd.3 [v2:172.21.15.33:6810/2483872739,v1:172.21.15.33:6811/2483872739] boot 2024-09-12T12:19:37.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:36 smithi033 ceph-mon[31246]: osdmap e23: 4 total, 4 up, 4 in 2024-09-12T12:19:37.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:36 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:19:37.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:36 smithi033 ceph-mon[31246]: Detected new or changed devices on smithi033 2024-09-12T12:19:37.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:36 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:37.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:36 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:37.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:36 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:19:37.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:36 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:19:37.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:36 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:37.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:36 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:37.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:36 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:19:37.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:36 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:37.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:36 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:19:37.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:36 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:19:37.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:36 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:37.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:36 smithi033 ceph-mon[31246]: osdmap e24: 4 total, 4 up, 4 in 2024-09-12T12:19:38.031 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:37 smithi043 ceph-mon[34144]: Adjusting osd_memory_target on smithi033 to 8546M 2024-09-12T12:19:38.031 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:37 smithi043 ceph-mon[34144]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:19:38.031 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:37 smithi043 ceph-mon[34144]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:19:38.031 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:37 smithi043 ceph-mon[34144]: osdmap e25: 4 total, 4 up, 4 in 2024-09-12T12:19:38.132 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:37 smithi033 ceph-mon[31246]: Adjusting osd_memory_target on smithi033 to 8546M 2024-09-12T12:19:38.132 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:37 smithi033 ceph-mon[31246]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:19:38.132 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:37 smithi033 ceph-mon[31246]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:19:38.132 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:37 smithi033 ceph-mon[31246]: osdmap e25: 4 total, 4 up, 4 in 2024-09-12T12:19:38.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:37 smithi102 ceph-mon[34799]: Adjusting osd_memory_target on smithi033 to 8546M 2024-09-12T12:19:38.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:37 smithi102 ceph-mon[34799]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:19:38.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:37 smithi102 ceph-mon[34799]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:19:38.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:37 smithi102 ceph-mon[34799]: osdmap e25: 4 total, 4 up, 4 in 2024-09-12T12:19:39.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:39 smithi033 ceph-mon[31246]: pgmap v95: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T12:19:39.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:39 smithi033 ceph-mon[31246]: osdmap e26: 4 total, 4 up, 4 in 2024-09-12T12:19:39.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:39 smithi033 ceph-mon[31246]: from='client.? 172.21.15.43:0/3072641006' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32acd6da-01d6-4a8e-9d05-3d394363d6f0"}]: dispatch 2024-09-12T12:19:39.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:39 smithi033 ceph-mon[31246]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32acd6da-01d6-4a8e-9d05-3d394363d6f0"}]: dispatch 2024-09-12T12:19:39.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:39 smithi033 ceph-mon[31246]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "32acd6da-01d6-4a8e-9d05-3d394363d6f0"}]': finished 2024-09-12T12:19:39.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:39 smithi033 ceph-mon[31246]: osdmap e27: 5 total, 4 up, 5 in 2024-09-12T12:19:39.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:39 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:19:39.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:39 smithi033 ceph-mon[31246]: from='client.? 172.21.15.43:0/346223349' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:19:40.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:39 smithi043 ceph-mon[34144]: pgmap v95: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T12:19:40.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:39 smithi043 ceph-mon[34144]: osdmap e26: 4 total, 4 up, 4 in 2024-09-12T12:19:40.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:39 smithi043 ceph-mon[34144]: from='client.? 172.21.15.43:0/3072641006' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32acd6da-01d6-4a8e-9d05-3d394363d6f0"}]: dispatch 2024-09-12T12:19:40.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:39 smithi043 ceph-mon[34144]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32acd6da-01d6-4a8e-9d05-3d394363d6f0"}]: dispatch 2024-09-12T12:19:40.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:39 smithi043 ceph-mon[34144]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "32acd6da-01d6-4a8e-9d05-3d394363d6f0"}]': finished 2024-09-12T12:19:40.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:39 smithi043 ceph-mon[34144]: osdmap e27: 5 total, 4 up, 5 in 2024-09-12T12:19:40.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:39 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:19:40.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:39 smithi043 ceph-mon[34144]: from='client.? 172.21.15.43:0/346223349' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:19:40.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:39 smithi102 ceph-mon[34799]: pgmap v95: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T12:19:40.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:39 smithi102 ceph-mon[34799]: osdmap e26: 4 total, 4 up, 4 in 2024-09-12T12:19:40.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:39 smithi102 ceph-mon[34799]: from='client.? 172.21.15.43:0/3072641006' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32acd6da-01d6-4a8e-9d05-3d394363d6f0"}]: dispatch 2024-09-12T12:19:40.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:39 smithi102 ceph-mon[34799]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32acd6da-01d6-4a8e-9d05-3d394363d6f0"}]: dispatch 2024-09-12T12:19:40.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:39 smithi102 ceph-mon[34799]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "32acd6da-01d6-4a8e-9d05-3d394363d6f0"}]': finished 2024-09-12T12:19:40.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:39 smithi102 ceph-mon[34799]: osdmap e27: 5 total, 4 up, 5 in 2024-09-12T12:19:40.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:39 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:19:40.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:39 smithi102 ceph-mon[34799]: from='client.? 172.21.15.43:0/346223349' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:19:41.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:41 smithi033 ceph-mon[31246]: pgmap v98: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T12:19:42.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:41 smithi043 ceph-mon[34144]: pgmap v98: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T12:19:42.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:41 smithi102 ceph-mon[34799]: pgmap v98: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T12:19:43.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:43 smithi033 ceph-mon[31246]: pgmap v99: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-09-12T12:19:44.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:43 smithi043 ceph-mon[34144]: pgmap v99: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-09-12T12:19:44.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:43 smithi102 ceph-mon[34799]: pgmap v99: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-09-12T12:19:45.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:45 smithi043 ceph-mon[34144]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-09-12T12:19:45.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:45 smithi033 ceph-mon[31246]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-09-12T12:19:46.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:45 smithi102 ceph-mon[34799]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-09-12T12:19:47.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:47 smithi043 ceph-mon[34144]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:19:47.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:47 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T12:19:47.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:47 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:47.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:47 smithi033 ceph-mon[31246]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:19:47.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:47 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T12:19:47.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:47 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:48.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:47 smithi102 ceph-mon[34799]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:19:48.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:47 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T12:19:48.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:47 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:48.843 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:48 smithi043 ceph-mon[34144]: Deploying daemon osd.4 on smithi043 2024-09-12T12:19:48.980 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:48 smithi033 ceph-mon[31246]: Deploying daemon osd.4 on smithi043 2024-09-12T12:19:49.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:48 smithi102 ceph-mon[34799]: Deploying daemon osd.4 on smithi043 2024-09-12T12:19:49.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:49 smithi033 ceph-mon[31246]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:19:50.014 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:49 smithi043 ceph-mon[34144]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:19:50.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:49 smithi102 ceph-mon[34799]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:19:51.934 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:51 smithi043 ceph-mon[34144]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:19:51.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:51 smithi033 ceph-mon[31246]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:19:52.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:51 smithi102 ceph-mon[34799]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:19:53.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:53 smithi043 ceph-mon[34144]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:19:53.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:53 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:19:53.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:53 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:53.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:53 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:54.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:53 smithi102 ceph-mon[34799]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:19:54.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:53 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:19:54.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:53 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:54.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:53 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:54.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:53 smithi033 ceph-mon[31246]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:19:54.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:53 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:19:54.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:53 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:54.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:53 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:55.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:55 smithi043 ceph-mon[34144]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:19:56.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:55 smithi102 ceph-mon[34799]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:19:56.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:55 smithi033 ceph-mon[31246]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:19:56.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:56.457+0000 7f35edffb640 1 -- 172.21.15.43:0/1874231206 <== mgr.14150 v2:172.21.15.33:6800/176202431 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f35f0062630 con 0x7f35d80a2bb0 2024-09-12T12:19:56.458 INFO:teuthology.orchestra.run.smithi043.stdout:Created osd(s) 4 on host 'smithi043' 2024-09-12T12:19:56.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:56.459+0000 7f35f7002640 1 -- 172.21.15.43:0/1874231206 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f35d80a2bb0 msgr2=0x7f35d80a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:56.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:56.459+0000 7f35f7002640 1 --2- 172.21.15.43:0/1874231206 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f35d80a2bb0 0x7f35d80a5070 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f35f006b050 tx=0x7f35e4008040 comp rx=0 tx=0).stop 2024-09-12T12:19:56.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:56.459+0000 7f35f7002640 1 -- 172.21.15.43:0/1874231206 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f35f0100ad0 msgr2=0x7f35f006aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:56.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:56.459+0000 7f35f7002640 1 --2- 172.21.15.43:0/1874231206 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f35f0100ad0 0x7f35f006aad0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f35e00314e0 tx=0x7f35e0031a30 comp rx=0 tx=0).stop 2024-09-12T12:19:56.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:56.459+0000 7f35f7002640 1 -- 172.21.15.43:0/1874231206 shutdown_connections 2024-09-12T12:19:56.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:56.459+0000 7f35f7002640 1 --2- 172.21.15.43:0/1874231206 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f35d80a2bb0 0x7f35d80a5070 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:56.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:56.459+0000 7f35f7002640 1 --2- 172.21.15.43:0/1874231206 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35f0102690 0x7f35f01a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:56.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:56.459+0000 7f35f7002640 1 --2- 172.21.15.43:0/1874231206 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35f0101cd0 0x7f35f019efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:56.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:56.459+0000 7f35f7002640 1 --2- 172.21.15.43:0/1874231206 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f35f0100ad0 0x7f35f006aad0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:56.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:56.459+0000 7f35f7002640 1 -- 172.21.15.43:0/1874231206 >> 172.21.15.43:0/1874231206 conn(0x7f35f00fc280 msgr2=0x7f35f0105160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:56.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:56.459+0000 7f35f7002640 1 -- 172.21.15.43:0/1874231206 shutdown_connections 2024-09-12T12:19:56.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:19:56.460+0000 7f35f7002640 1 -- 172.21.15.43:0/1874231206 wait complete. 2024-09-12T12:19:57.153 DEBUG:teuthology.orchestra.run.smithi043:osd.4> sudo journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@osd.4.service 2024-09-12T12:19:57.156 INFO:tasks.cephadm:Deploying osd.5 on smithi102 with /dev/vg_nvme/lv_3... 2024-09-12T12:19:57.156 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-12T12:19:57.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:57 smithi102 ceph-mon[34799]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:19:57.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:57 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:57.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:57 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:57.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:57 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:57.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:57 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:19:57.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:57 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:57.397 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:57 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:19:57.397 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:57 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:57.397 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:57 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:57.402 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:19:57.450 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:57 smithi043 ceph-mon[34144]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:19:57.450 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:57 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:57.450 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:57 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:57.450 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:57 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:57.450 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:57 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:19:57.450 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:57 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:57.451 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:57 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:19:57.451 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:57 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:57.451 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:57 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:57.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:57 smithi033 ceph-mon[31246]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:19:57.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:57 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:57.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:57 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:57.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:57 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:57.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:57 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:19:57.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:57 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:57.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:57 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:19:57.482 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:57 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:57.482 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:57 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:19:59.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:59 smithi043 ceph-mon[34144]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:19:59.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:59 smithi043 ceph-mon[34144]: from='osd.4 [v2:172.21.15.43:6808/136043101,v1:172.21.15.43:6809/136043101]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T12:19:59.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:19:59 smithi043 ceph-mon[34144]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T12:19:59.365 INFO:journalctl@ceph.osd.4.smithi043.stdout:Sep 12 12:19:58 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-4[45041]: 2024-09-12T12:19:58.961+0000 7ff8033c7640 -1 osd.4 0 log_to_monitors true 2024-09-12T12:19:59.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:59 smithi102 ceph-mon[34799]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:19:59.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:59 smithi102 ceph-mon[34799]: from='osd.4 [v2:172.21.15.43:6808/136043101,v1:172.21.15.43:6809/136043101]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T12:19:59.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:19:59 smithi102 ceph-mon[34799]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T12:19:59.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:59 smithi033 ceph-mon[31246]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:19:59.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:59 smithi033 ceph-mon[31246]: from='osd.4 [v2:172.21.15.43:6808/136043101,v1:172.21.15.43:6809/136043101]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T12:19:59.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:19:59 smithi033 ceph-mon[31246]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T12:19:59.983 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T12:20:00.011 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi102:vg_nvme/lv_3 2024-09-12T12:20:00.259 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:20:00.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:00 smithi043 ceph-mon[34144]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T12:20:00.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:00 smithi043 ceph-mon[34144]: from='osd.4 [v2:172.21.15.43:6808/136043101,v1:172.21.15.43:6809/136043101]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-09-12T12:20:00.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:00 smithi043 ceph-mon[34144]: osdmap e28: 5 total, 4 up, 5 in 2024-09-12T12:20:00.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:00 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:20:00.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:00 smithi043 ceph-mon[34144]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-09-12T12:20:00.366 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:00 smithi043 ceph-mon[34144]: overall HEALTH_OK 2024-09-12T12:20:00.366 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:00 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:00.366 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:00 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:00.366 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:00 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:20:00.366 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:00 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:20:00.366 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:00 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:00.366 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:00 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:00.366 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:00 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:20:00.366 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:00 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:00.366 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:00 smithi043 ceph-mon[34144]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-09-12T12:20:00.380 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:00 smithi102 ceph-mon[34799]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T12:20:00.380 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:00 smithi102 ceph-mon[34799]: from='osd.4 [v2:172.21.15.43:6808/136043101,v1:172.21.15.43:6809/136043101]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-09-12T12:20:00.380 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:00 smithi102 ceph-mon[34799]: osdmap e28: 5 total, 4 up, 5 in 2024-09-12T12:20:00.380 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:00 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:20:00.380 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:00 smithi102 ceph-mon[34799]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-09-12T12:20:00.380 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:00 smithi102 ceph-mon[34799]: overall HEALTH_OK 2024-09-12T12:20:00.380 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:00 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:00.381 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:00 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:00.381 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:00 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:20:00.381 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:00 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:20:00.381 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:00 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:00.381 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:00 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:00.381 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:00 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:20:00.381 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:00 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:00.381 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:00 smithi102 ceph-mon[34799]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-09-12T12:20:00.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:00 smithi033 ceph-mon[31246]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T12:20:00.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:00 smithi033 ceph-mon[31246]: from='osd.4 [v2:172.21.15.43:6808/136043101,v1:172.21.15.43:6809/136043101]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-09-12T12:20:00.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:00 smithi033 ceph-mon[31246]: osdmap e28: 5 total, 4 up, 5 in 2024-09-12T12:20:00.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:00 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:20:00.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:00 smithi033 ceph-mon[31246]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-09-12T12:20:00.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:00 smithi033 ceph-mon[31246]: overall HEALTH_OK 2024-09-12T12:20:00.482 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:00 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:00.482 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:00 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:00.482 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:00 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:20:00.482 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:00 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:20:00.482 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:00 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:00.482 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:00 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:00.482 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:00 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:20:00.482 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:00 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:00.482 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:00 smithi033 ceph-mon[31246]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-09-12T12:20:00.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:00.725+0000 7fb1ba260640 1 -- 172.21.15.102:0/2384137511 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1b4105940 msgr2=0x7fb1b410c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:00.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:00.725+0000 7fb1ba260640 1 --2- 172.21.15.102:0/2384137511 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1b4105940 0x7fb1b410c260 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac009ca0 tx=0x7fb1ac02a8c0 comp rx=0 tx=0).stop 2024-09-12T12:20:00.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:00.725+0000 7fb1ba260640 1 -- 172.21.15.102:0/2384137511 shutdown_connections 2024-09-12T12:20:00.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:00.725+0000 7fb1ba260640 1 --2- 172.21.15.102:0/2384137511 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1b4105940 0x7fb1b410c260 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:00.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:00.725+0000 7fb1ba260640 1 --2- 172.21.15.102:0/2384137511 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1b4104f80 0x7fb1b4105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:00.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:00.725+0000 7fb1ba260640 1 --2- 172.21.15.102:0/2384137511 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1b4103e20 0x7fb1b4104220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:00.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:00.725+0000 7fb1ba260640 1 -- 172.21.15.102:0/2384137511 >> 172.21.15.102:0/2384137511 conn(0x7fb1b40ff5b0 msgr2=0x7fb1b41019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:00.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:00.725+0000 7fb1ba260640 1 -- 172.21.15.102:0/2384137511 shutdown_connections 2024-09-12T12:20:00.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:00.725+0000 7fb1ba260640 1 -- 172.21.15.102:0/2384137511 wait complete. 2024-09-12T12:20:00.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:00.725+0000 7fb1ba260640 1 Processor -- start 2024-09-12T12:20:00.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:00.725+0000 7fb1ba260640 1 -- start start 2024-09-12T12:20:00.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:00.726+0000 7fb1ba260640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1b4103e20 0x7fb1b4199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:00.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:00.726+0000 7fb1ba260640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1b4104f80 0x7fb1b419a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:00.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:00.726+0000 7fb1ba260640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1b4105940 0x7fb1b41a15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:00.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:00.726+0000 7fb1ba260640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b410f980 con 0x7fb1b4103e20 2024-09-12T12:20:00.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:00.726+0000 7fb1ba260640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b410f800 con 0x7fb1b4104f80 2024-09-12T12:20:00.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:00.726+0000 7fb1ba260640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b410fb00 con 0x7fb1b4105940 2024-09-12T12:20:00.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:00.726+0000 7fb1b3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1b4105940 0x7fb1b41a15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:00.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:00.726+0000 7fb1b3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1b4105940 0x7fb1b41a15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33390/0 (socket says 172.21.15.102:33390) 2024-09-12T12:20:00.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:00.726+0000 7fb1b3fff640 1 -- 172.21.15.102:0/3913444802 learned_addr learned my addr 172.21.15.102:0/3913444802 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-12T12:20:00.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:00.726+0000 7fb1b37fe640 1 --2- 172.21.15.102:0/3913444802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1b4103e20 0x7fb1b4199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:00.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:00.726+0000 7fb1b2ffd640 1 --2- 172.21.15.102:0/3913444802 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1b4104f80 0x7fb1b419a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:00.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:00.726+0000 7fb1b3fff640 1 -- 172.21.15.102:0/3913444802 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1b4104f80 msgr2=0x7fb1b419a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:00.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:00.726+0000 7fb1b3fff640 1 --2- 172.21.15.102:0/3913444802 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1b4104f80 0x7fb1b419a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:00.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:00.726+0000 7fb1b3fff640 1 -- 172.21.15.102:0/3913444802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1b4103e20 msgr2=0x7fb1b4199fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:00.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:00.726+0000 7fb1b3fff640 1 --2- 172.21.15.102:0/3913444802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1b4103e20 0x7fb1b4199fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:00.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:00.726+0000 7fb1b3fff640 1 -- 172.21.15.102:0/3913444802 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1b41a1c10 con 0x7fb1b4105940 2024-09-12T12:20:00.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:00.726+0000 7fb1b37fe640 1 --2- 172.21.15.102:0/3913444802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1b4103e20 0x7fb1b4199fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:20:00.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:00.726+0000 7fb1b2ffd640 1 --2- 172.21.15.102:0/3913444802 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1b4104f80 0x7fb1b419a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:20:00.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:00.726+0000 7fb1b3fff640 1 --2- 172.21.15.102:0/3913444802 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1b4105940 0x7fb1b41a15a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac009dc0 tx=0x7fb1ac003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:00.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:00.726+0000 7fb1b0ff9640 1 -- 172.21.15.102:0/3913444802 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac032ec0 con 0x7fb1b4105940 2024-09-12T12:20:00.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:00.726+0000 7fb1b0ff9640 1 -- 172.21.15.102:0/3913444802 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb1ac0044f0 con 0x7fb1b4105940 2024-09-12T12:20:00.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:00.726+0000 7fb1ba260640 1 -- 172.21.15.102:0/3913444802 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1b41a1ea0 con 0x7fb1b4105940 2024-09-12T12:20:00.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:00.726+0000 7fb1b0ff9640 1 -- 172.21.15.102:0/3913444802 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac030d40 con 0x7fb1b4105940 2024-09-12T12:20:00.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:00.726+0000 7fb1ba260640 1 -- 172.21.15.102:0/3913444802 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1b41a2350 con 0x7fb1b4105940 2024-09-12T12:20:00.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:00.727+0000 7fb1ba260640 1 -- 172.21.15.102:0/3913444802 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1b410b2d0 con 0x7fb1b4105940 2024-09-12T12:20:00.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:00.728+0000 7fb1b0ff9640 1 -- 172.21.15.102:0/3913444802 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb1ac004040 con 0x7fb1b4105940 2024-09-12T12:20:00.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:00.729+0000 7fb1b0ff9640 1 --2- 172.21.15.102:0/3913444802 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb1a00a2d50 0x7fb1a00a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:00.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:00.729+0000 7fb1b0ff9640 1 -- 172.21.15.102:0/3913444802 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 3821+0+0 (secure 0 0 0) 0x7fb1ac0ef520 con 0x7fb1b4105940 2024-09-12T12:20:00.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:00.730+0000 7fb1b37fe640 1 --2- 172.21.15.102:0/3913444802 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb1a00a2d50 0x7fb1a00a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:00.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:00.730+0000 7fb1b37fe640 1 --2- 172.21.15.102:0/3913444802 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb1a00a2d50 0x7fb1a00a5210 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb1a40058c0 tx=0x7fb1a4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:00.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:00.733+0000 7fb1b0ff9640 1 -- 172.21.15.102:0/3913444802 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb1ac0bd610 con 0x7fb1b4105940 2024-09-12T12:20:00.865 INFO:journalctl@ceph.osd.4.smithi043.stdout:Sep 12 12:20:00 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-4[45041]: 2024-09-12T12:20:00.556+0000 7ff7ff34a640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T12:20:00.865 INFO:journalctl@ceph.osd.4.smithi043.stdout:Sep 12 12:20:00 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-4[45041]: 2024-09-12T12:20:00.561+0000 7ff7f716a640 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T12:20:00.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:00.909+0000 7fb1ba260640 1 -- 172.21.15.102:0/3913444802 --> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fb1b4062630 con 0x7fb1a00a2d50 2024-09-12T12:20:01.315 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:01 smithi102 ceph-mon[34799]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:20:01.315 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:01 smithi102 ceph-mon[34799]: Detected new or changed devices on smithi043 2024-09-12T12:20:01.315 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:01 smithi102 ceph-mon[34799]: Adjusting osd_memory_target on smithi043 to 8546M 2024-09-12T12:20:01.315 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:01 smithi102 ceph-mon[34799]: osdmap e29: 5 total, 4 up, 5 in 2024-09-12T12:20:01.315 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:01 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:20:01.315 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:01 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:20:01.315 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:01 smithi102 ceph-mon[34799]: from='osd.4 ' entity='osd.4' 2024-09-12T12:20:01.315 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:01 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:20:01.315 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:01 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:20:01.315 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:01 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:01.315 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:01 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:20:01.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:01 smithi033 ceph-mon[31246]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:20:01.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:01 smithi033 ceph-mon[31246]: Detected new or changed devices on smithi043 2024-09-12T12:20:01.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:01 smithi033 ceph-mon[31246]: Adjusting osd_memory_target on smithi043 to 8546M 2024-09-12T12:20:01.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:01 smithi033 ceph-mon[31246]: osdmap e29: 5 total, 4 up, 5 in 2024-09-12T12:20:01.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:01 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:20:01.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:01 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:20:01.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:01 smithi033 ceph-mon[31246]: from='osd.4 ' entity='osd.4' 2024-09-12T12:20:01.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:01 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:20:01.482 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:01 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:20:01.482 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:01 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:01.482 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:01 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:20:01.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:01 smithi043 ceph-mon[34144]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:20:01.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:01 smithi043 ceph-mon[34144]: Detected new or changed devices on smithi043 2024-09-12T12:20:01.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:01 smithi043 ceph-mon[34144]: Adjusting osd_memory_target on smithi043 to 8546M 2024-09-12T12:20:01.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:01 smithi043 ceph-mon[34144]: osdmap e29: 5 total, 4 up, 5 in 2024-09-12T12:20:01.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:01 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:20:01.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:01 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:20:01.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:01 smithi043 ceph-mon[34144]: from='osd.4 ' entity='osd.4' 2024-09-12T12:20:01.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:01 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:20:01.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:01 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:20:01.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:01 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:01.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:01 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:20:02.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:02 smithi102 ceph-mon[34799]: purged_snaps scrub starts 2024-09-12T12:20:02.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:02 smithi102 ceph-mon[34799]: purged_snaps scrub ok 2024-09-12T12:20:02.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:02 smithi102 ceph-mon[34799]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:20:02.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:02 smithi102 ceph-mon[34799]: osd.4 [v2:172.21.15.43:6808/136043101,v1:172.21.15.43:6809/136043101] boot 2024-09-12T12:20:02.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:02 smithi102 ceph-mon[34799]: osdmap e30: 5 total, 5 up, 5 in 2024-09-12T12:20:02.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:02 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:20:02.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:02 smithi043 ceph-mon[34144]: purged_snaps scrub starts 2024-09-12T12:20:02.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:02 smithi043 ceph-mon[34144]: purged_snaps scrub ok 2024-09-12T12:20:02.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:02 smithi043 ceph-mon[34144]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:20:02.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:02 smithi043 ceph-mon[34144]: osd.4 [v2:172.21.15.43:6808/136043101,v1:172.21.15.43:6809/136043101] boot 2024-09-12T12:20:02.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:02 smithi043 ceph-mon[34144]: osdmap e30: 5 total, 5 up, 5 in 2024-09-12T12:20:02.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:02 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:20:02.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:02 smithi033 ceph-mon[31246]: purged_snaps scrub starts 2024-09-12T12:20:02.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:02 smithi033 ceph-mon[31246]: purged_snaps scrub ok 2024-09-12T12:20:02.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:02 smithi033 ceph-mon[31246]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:20:02.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:02 smithi033 ceph-mon[31246]: osd.4 [v2:172.21.15.43:6808/136043101,v1:172.21.15.43:6809/136043101] boot 2024-09-12T12:20:02.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:02 smithi033 ceph-mon[31246]: osdmap e30: 5 total, 5 up, 5 in 2024-09-12T12:20:02.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:02 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:20:03.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:03 smithi043 ceph-mon[34144]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:20:03.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:03 smithi043 ceph-mon[34144]: osdmap e31: 5 total, 5 up, 5 in 2024-09-12T12:20:03.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:03 smithi043 ceph-mon[34144]: from='client.? 172.21.15.102:0/23573577' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dced0037-2da2-48c2-a391-f871d6ceebb4"}]: dispatch 2024-09-12T12:20:03.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:03 smithi043 ceph-mon[34144]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dced0037-2da2-48c2-a391-f871d6ceebb4"}]: dispatch 2024-09-12T12:20:03.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:03 smithi043 ceph-mon[34144]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dced0037-2da2-48c2-a391-f871d6ceebb4"}]': finished 2024-09-12T12:20:03.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:03 smithi043 ceph-mon[34144]: osdmap e32: 6 total, 5 up, 6 in 2024-09-12T12:20:03.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:03 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:20:03.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:03 smithi102 ceph-mon[34799]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:20:03.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:03 smithi102 ceph-mon[34799]: osdmap e31: 5 total, 5 up, 5 in 2024-09-12T12:20:03.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:03 smithi102 ceph-mon[34799]: from='client.? 172.21.15.102:0/23573577' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dced0037-2da2-48c2-a391-f871d6ceebb4"}]: dispatch 2024-09-12T12:20:03.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:03 smithi102 ceph-mon[34799]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dced0037-2da2-48c2-a391-f871d6ceebb4"}]: dispatch 2024-09-12T12:20:03.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:03 smithi102 ceph-mon[34799]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dced0037-2da2-48c2-a391-f871d6ceebb4"}]': finished 2024-09-12T12:20:03.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:03 smithi102 ceph-mon[34799]: osdmap e32: 6 total, 5 up, 6 in 2024-09-12T12:20:03.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:03 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:20:03.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:03 smithi033 ceph-mon[31246]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:20:03.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:03 smithi033 ceph-mon[31246]: osdmap e31: 5 total, 5 up, 5 in 2024-09-12T12:20:03.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:03 smithi033 ceph-mon[31246]: from='client.? 172.21.15.102:0/23573577' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dced0037-2da2-48c2-a391-f871d6ceebb4"}]: dispatch 2024-09-12T12:20:03.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:03 smithi033 ceph-mon[31246]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dced0037-2da2-48c2-a391-f871d6ceebb4"}]: dispatch 2024-09-12T12:20:03.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:03 smithi033 ceph-mon[31246]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dced0037-2da2-48c2-a391-f871d6ceebb4"}]': finished 2024-09-12T12:20:03.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:03 smithi033 ceph-mon[31246]: osdmap e32: 6 total, 5 up, 6 in 2024-09-12T12:20:03.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:03 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:20:04.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:04 smithi043 ceph-mon[34144]: from='client.? 172.21.15.102:0/3883487692' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:20:04.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:04 smithi102 ceph-mon[34799]: from='client.? 172.21.15.102:0/3883487692' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:20:04.980 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:04 smithi033 ceph-mon[31246]: from='client.? 172.21.15.102:0/3883487692' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:20:05.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:05 smithi043 ceph-mon[34144]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:20:05.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:05 smithi102 ceph-mon[34799]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:20:05.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:05 smithi033 ceph-mon[31246]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:20:07.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:07 smithi043 ceph-mon[34144]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:20:07.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:07 smithi102 ceph-mon[34799]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:20:07.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:07 smithi033 ceph-mon[31246]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:20:09.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:09 smithi043 ceph-mon[34144]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:20:09.867 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:09 smithi102 ceph-mon[34799]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:20:09.980 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:09 smithi033 ceph-mon[31246]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:20:11.856 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:11 smithi102 ceph-mon[34799]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:20:11.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:11 smithi043 ceph-mon[34144]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:20:11.980 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:11 smithi033 ceph-mon[31246]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:20:12.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:12 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T12:20:12.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:12 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:12.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:12 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T12:20:12.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:12 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:12.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:12 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T12:20:12.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:12 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:13.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:13 smithi043 ceph-mon[34144]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:20:13.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:13 smithi043 ceph-mon[34144]: Deploying daemon osd.5 on smithi102 2024-09-12T12:20:13.891 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:13 smithi102 ceph-mon[34799]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:20:13.891 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:13 smithi102 ceph-mon[34799]: Deploying daemon osd.5 on smithi102 2024-09-12T12:20:13.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:13 smithi033 ceph-mon[31246]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:20:13.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:13 smithi033 ceph-mon[31246]: Deploying daemon osd.5 on smithi102 2024-09-12T12:20:15.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:15 smithi043 ceph-mon[34144]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:20:15.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:15 smithi102 ceph-mon[34799]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:20:15.980 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:15 smithi033 ceph-mon[31246]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:20:17.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:17 smithi043 ceph-mon[34144]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:20:17.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:17 smithi102 ceph-mon[34799]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:20:17.980 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:17 smithi033 ceph-mon[31246]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:20:18.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:18 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:20:18.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:18 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:18.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:18 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:18.877 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:18 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:20:18.878 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:18 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:18.878 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:18 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:18.980 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:18 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:20:18.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:18 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:18.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:18 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:19.876 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:19 smithi102 ceph-mon[34799]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:20:19.980 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:19 smithi033 ceph-mon[31246]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:20:20.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:19 smithi043 ceph-mon[34144]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:20:21.784 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:21 smithi102 ceph-mon[34799]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:20:21.784 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:21 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:21.784 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:21 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:21.784 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:21 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:21.784 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:21 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:20:21.785 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:21 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:21.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:21.823+0000 7fb1b0ff9640 1 -- 172.21.15.102:0/3913444802 <== mgr.14150 v2:172.21.15.33:6800/176202431 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb1b4062630 con 0x7fb1a00a2d50 2024-09-12T12:20:21.824 INFO:teuthology.orchestra.run.smithi102.stdout:Created osd(s) 5 on host 'smithi102' 2024-09-12T12:20:21.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:21.825+0000 7fb1ba260640 1 -- 172.21.15.102:0/3913444802 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb1a00a2d50 msgr2=0x7fb1a00a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:21.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:21.825+0000 7fb1ba260640 1 --2- 172.21.15.102:0/3913444802 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb1a00a2d50 0x7fb1a00a5210 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb1a40058c0 tx=0x7fb1a4005850 comp rx=0 tx=0).stop 2024-09-12T12:20:21.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:21.825+0000 7fb1ba260640 1 -- 172.21.15.102:0/3913444802 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1b4105940 msgr2=0x7fb1b41a15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:21.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:21.825+0000 7fb1ba260640 1 --2- 172.21.15.102:0/3913444802 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1b4105940 0x7fb1b41a15a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac009dc0 tx=0x7fb1ac003ba0 comp rx=0 tx=0).stop 2024-09-12T12:20:21.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:21.825+0000 7fb1ba260640 1 -- 172.21.15.102:0/3913444802 shutdown_connections 2024-09-12T12:20:21.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:21.825+0000 7fb1ba260640 1 --2- 172.21.15.102:0/3913444802 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb1a00a2d50 0x7fb1a00a5210 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:21.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:21.825+0000 7fb1ba260640 1 --2- 172.21.15.102:0/3913444802 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1b4105940 0x7fb1b41a15a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:21.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:21.825+0000 7fb1ba260640 1 --2- 172.21.15.102:0/3913444802 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1b4104f80 0x7fb1b419a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:21.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:21.825+0000 7fb1ba260640 1 --2- 172.21.15.102:0/3913444802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1b4103e20 0x7fb1b4199fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:21.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:21.825+0000 7fb1ba260640 1 -- 172.21.15.102:0/3913444802 >> 172.21.15.102:0/3913444802 conn(0x7fb1b40ff5b0 msgr2=0x7fb1b41084a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:21.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:21.826+0000 7fb1ba260640 1 -- 172.21.15.102:0/3913444802 shutdown_connections 2024-09-12T12:20:21.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:20:21.826+0000 7fb1ba260640 1 -- 172.21.15.102:0/3913444802 wait complete. 2024-09-12T12:20:21.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:21 smithi033 ceph-mon[31246]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:20:21.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:21 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:21.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:21 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:21.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:21 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:21.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:21 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:20:21.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:21 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:22.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:21 smithi043 ceph-mon[34144]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:20:22.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:21 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:22.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:21 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:22.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:21 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:22.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:21 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:20:22.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:21 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:22.457 DEBUG:teuthology.orchestra.run.smithi102:osd.5> sudo journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@osd.5.service 2024-09-12T12:20:22.459 INFO:tasks.cephadm:Deploying osd.6 on smithi033 with /dev/vg_nvme/lv_2... 2024-09-12T12:20:22.459 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-12T12:20:22.731 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:20:22.791 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:22 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:20:22.791 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:22 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:22.791 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:22 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:22.838 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:22 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:20:22.838 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:22 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:22.839 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:22 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:23.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:22 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:20:23.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:22 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:23.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:22 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:23.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:23 smithi102 ceph-mon[34799]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:20:23.937 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:23 smithi033 ceph-mon[31246]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:20:24.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:23 smithi043 ceph-mon[34144]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:20:24.616 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:20:24 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-5[46206]: 2024-09-12T12:20:24.314+0000 7f33e4c08640 -1 osd.5 0 log_to_monitors true 2024-09-12T12:20:24.851 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:24 smithi033 ceph-mon[31246]: from='osd.5 [v2:172.21.15.102:6808/2605625792,v1:172.21.15.102:6809/2605625792]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T12:20:24.852 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:24 smithi033 ceph-mon[31246]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T12:20:24.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:24 smithi102 ceph-mon[34799]: from='osd.5 [v2:172.21.15.102:6808/2605625792,v1:172.21.15.102:6809/2605625792]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T12:20:24.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:24 smithi102 ceph-mon[34799]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T12:20:25.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:24 smithi043 ceph-mon[34144]: from='osd.5 [v2:172.21.15.102:6808/2605625792,v1:172.21.15.102:6809/2605625792]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T12:20:25.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:24 smithi043 ceph-mon[34144]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T12:20:25.157 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:20:25.184 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi033:vg_nvme/lv_2 2024-09-12T12:20:25.447 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:20:25.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:25 smithi033 ceph-mon[31246]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:20:25.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:25 smithi033 ceph-mon[31246]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T12:20:25.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:25 smithi033 ceph-mon[31246]: osdmap e33: 6 total, 5 up, 6 in 2024-09-12T12:20:25.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:25 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:20:25.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:25 smithi033 ceph-mon[31246]: from='osd.5 [v2:172.21.15.102:6808/2605625792,v1:172.21.15.102:6809/2605625792]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-12T12:20:25.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:25 smithi033 ceph-mon[31246]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-12T12:20:25.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:25 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:25.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:25 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:25.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:25 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:20:25.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:25 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:20:25.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:25 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:25.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:25 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:25.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:25 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:20:25.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:25 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:25.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:25 smithi102 ceph-mon[34799]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:20:25.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:25 smithi102 ceph-mon[34799]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T12:20:25.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:25 smithi102 ceph-mon[34799]: osdmap e33: 6 total, 5 up, 6 in 2024-09-12T12:20:25.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:25 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:20:25.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:25 smithi102 ceph-mon[34799]: from='osd.5 [v2:172.21.15.102:6808/2605625792,v1:172.21.15.102:6809/2605625792]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-12T12:20:25.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:25 smithi102 ceph-mon[34799]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-12T12:20:25.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:25 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:25.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:25 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:25.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:25 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:20:25.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:25 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:20:25.898 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:25 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:25.898 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:25 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:25.898 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:25 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:20:25.898 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:25 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:25.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:25.919+0000 7f72cc8ed640 1 -- 172.21.15.33:0/1423386545 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72c8100ad0 msgr2=0x7f72c8100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:25.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:25.919+0000 7f72cc8ed640 1 --2- 172.21.15.33:0/1423386545 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72c8100ad0 0x7f72c8100ed0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f72b8009900 tx=0x7f72b802a410 comp rx=0 tx=0).stop 2024-09-12T12:20:25.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:25.920+0000 7f72cc8ed640 1 -- 172.21.15.33:0/1423386545 shutdown_connections 2024-09-12T12:20:25.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:25.920+0000 7f72cc8ed640 1 --2- 172.21.15.33:0/1423386545 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72c8102690 0x7f72c8108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:25.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:25.920+0000 7f72cc8ed640 1 --2- 172.21.15.33:0/1423386545 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72c8101cd0 0x7f72c8102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:25.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:25.920+0000 7f72cc8ed640 1 --2- 172.21.15.33:0/1423386545 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72c8100ad0 0x7f72c8100ed0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:25.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:25.920+0000 7f72cc8ed640 1 -- 172.21.15.33:0/1423386545 >> 172.21.15.33:0/1423386545 conn(0x7f72c80fc280 msgr2=0x7f72c80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:25.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:25.920+0000 7f72cc8ed640 1 -- 172.21.15.33:0/1423386545 shutdown_connections 2024-09-12T12:20:25.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:25.920+0000 7f72cc8ed640 1 -- 172.21.15.33:0/1423386545 wait complete. 2024-09-12T12:20:25.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:25.921+0000 7f72cc8ed640 1 Processor -- start 2024-09-12T12:20:25.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:25.921+0000 7f72cc8ed640 1 -- start start 2024-09-12T12:20:25.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:25.921+0000 7f72cc8ed640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72c8100ad0 0x7f72c806aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:25.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:25.921+0000 7f72cc8ed640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72c8101cd0 0x7f72c819cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:25.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:25.921+0000 7f72cc8ed640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72c8102690 0x7f72c819f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:25.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:25.921+0000 7f72cc8ed640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f72c810c5e0 con 0x7f72c8102690 2024-09-12T12:20:25.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:25.921+0000 7f72cc8ed640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f72c810c460 con 0x7f72c8100ad0 2024-09-12T12:20:25.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:25.921+0000 7f72cc8ed640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f72c810c760 con 0x7f72c8101cd0 2024-09-12T12:20:25.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:25.921+0000 7f72c6d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72c8102690 0x7f72c819f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:25.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:25.921+0000 7f72bffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72c8101cd0 0x7f72c819cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:25.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:25.921+0000 7f72c659c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72c8100ad0 0x7f72c806aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:25.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:25.921+0000 7f72c6d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72c8102690 0x7f72c819f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52552/0 (socket says 172.21.15.33:52552) 2024-09-12T12:20:25.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:25.921+0000 7f72c6d9d640 1 -- 172.21.15.33:0/2453182816 learned_addr learned my addr 172.21.15.33:0/2453182816 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:20:25.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:25.921+0000 7f72bffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72c8101cd0 0x7f72c819cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:54670/0 (socket says 172.21.15.33:54670) 2024-09-12T12:20:25.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:25.921+0000 7f72c6d9d640 1 -- 172.21.15.33:0/2453182816 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72c8101cd0 msgr2=0x7f72c819cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:25.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:25.921+0000 7f72c6d9d640 1 --2- 172.21.15.33:0/2453182816 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72c8101cd0 0x7f72c819cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:25.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:25.921+0000 7f72c6d9d640 1 -- 172.21.15.33:0/2453182816 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72c8100ad0 msgr2=0x7f72c806aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:25.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:25.921+0000 7f72c6d9d640 1 --2- 172.21.15.33:0/2453182816 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72c8100ad0 0x7f72c806aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:25.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:25.921+0000 7f72c6d9d640 1 -- 172.21.15.33:0/2453182816 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72c819fae0 con 0x7f72c8102690 2024-09-12T12:20:25.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:25.922+0000 7f72c6d9d640 1 --2- 172.21.15.33:0/2453182816 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72c8102690 0x7f72c819f1d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f72c0009fd0 tx=0x7f72c000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:25.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:25.922+0000 7f72bf7fe640 1 -- 172.21.15.33:0/2453182816 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c0017070 con 0x7f72c8102690 2024-09-12T12:20:25.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:25.922+0000 7f72bf7fe640 1 -- 172.21.15.33:0/2453182816 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f72c0003e20 con 0x7f72c8102690 2024-09-12T12:20:25.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:25.922+0000 7f72cc8ed640 1 -- 172.21.15.33:0/2453182816 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72c819fd70 con 0x7f72c8102690 2024-09-12T12:20:25.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:25.922+0000 7f72bf7fe640 1 -- 172.21.15.33:0/2453182816 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c0010460 con 0x7f72c8102690 2024-09-12T12:20:25.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:25.922+0000 7f72cc8ed640 1 -- 172.21.15.33:0/2453182816 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72c81a0260 con 0x7f72c8102690 2024-09-12T12:20:25.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:25.923+0000 7f72cc8ed640 1 -- 172.21.15.33:0/2453182816 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72c8100ed0 con 0x7f72c8102690 2024-09-12T12:20:25.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:25.924+0000 7f72bf7fe640 1 -- 172.21.15.33:0/2453182816 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f72c0003970 con 0x7f72c8102690 2024-09-12T12:20:25.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:25.925+0000 7f72bf7fe640 1 --2- 172.21.15.33:0/2453182816 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f72b40a2b80 0x7f72b40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:25.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:25.925+0000 7f72c659c640 1 --2- 172.21.15.33:0/2453182816 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f72b40a2b80 0x7f72b40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:25.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:25.925+0000 7f72bf7fe640 1 -- 172.21.15.33:0/2453182816 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4253+0+0 (secure 0 0 0) 0x7f72c00cdeb0 con 0x7f72c8102690 2024-09-12T12:20:25.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:25.926+0000 7f72c659c640 1 --2- 172.21.15.33:0/2453182816 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f72b40a2b80 0x7f72b40a5040 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f72b8004770 tx=0x7f72b8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:25.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:25.930+0000 7f72bf7fe640 1 -- 172.21.15.33:0/2453182816 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f72c009b700 con 0x7f72c8102690 2024-09-12T12:20:26.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:26.115+0000 7f72cc8ed640 1 -- 172.21.15.33:0/2453182816 --> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f72c8062630 con 0x7f72b40a2b80 2024-09-12T12:20:26.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:25 smithi043 ceph-mon[34144]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:20:26.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:25 smithi043 ceph-mon[34144]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T12:20:26.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:25 smithi043 ceph-mon[34144]: osdmap e33: 6 total, 5 up, 6 in 2024-09-12T12:20:26.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:25 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:20:26.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:25 smithi043 ceph-mon[34144]: from='osd.5 [v2:172.21.15.102:6808/2605625792,v1:172.21.15.102:6809/2605625792]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-12T12:20:26.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:25 smithi043 ceph-mon[34144]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-12T12:20:26.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:25 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:26.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:25 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:26.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:25 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:20:26.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:25 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:20:26.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:25 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:26.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:25 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:26.117 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:25 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:20:26.117 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:25 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:26.396 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:20:26 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-5[46206]: 2024-09-12T12:20:26.015+0000 7f33e0b8b640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T12:20:26.397 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:20:26 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-5[46206]: 2024-09-12T12:20:26.020+0000 7f33d89ab640 -1 osd.5 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T12:20:26.785 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:26 smithi033 ceph-mon[31246]: Detected new or changed devices on smithi102 2024-09-12T12:20:26.785 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:26 smithi033 ceph-mon[31246]: Adjusting osd_memory_target on smithi102 to 8544M 2024-09-12T12:20:26.785 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:26 smithi033 ceph-mon[31246]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-12T12:20:26.786 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:26 smithi033 ceph-mon[31246]: osdmap e34: 6 total, 5 up, 6 in 2024-09-12T12:20:26.786 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:26 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:20:26.786 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:26 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:20:26.786 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:26 smithi033 ceph-mon[31246]: from='osd.5 ' entity='osd.5' 2024-09-12T12:20:26.786 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:26 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:20:26.786 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:26 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:20:26.786 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:26 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:26.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:26 smithi102 ceph-mon[34799]: Detected new or changed devices on smithi102 2024-09-12T12:20:26.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:26 smithi102 ceph-mon[34799]: Adjusting osd_memory_target on smithi102 to 8544M 2024-09-12T12:20:26.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:26 smithi102 ceph-mon[34799]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-12T12:20:26.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:26 smithi102 ceph-mon[34799]: osdmap e34: 6 total, 5 up, 6 in 2024-09-12T12:20:26.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:26 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:20:26.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:26 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:20:26.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:26 smithi102 ceph-mon[34799]: from='osd.5 ' entity='osd.5' 2024-09-12T12:20:26.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:26 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:20:26.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:26 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:20:26.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:26 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:27.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:26 smithi043 ceph-mon[34144]: Detected new or changed devices on smithi102 2024-09-12T12:20:27.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:26 smithi043 ceph-mon[34144]: Adjusting osd_memory_target on smithi102 to 8544M 2024-09-12T12:20:27.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:26 smithi043 ceph-mon[34144]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-12T12:20:27.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:26 smithi043 ceph-mon[34144]: osdmap e34: 6 total, 5 up, 6 in 2024-09-12T12:20:27.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:26 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:20:27.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:26 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:20:27.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:26 smithi043 ceph-mon[34144]: from='osd.5 ' entity='osd.5' 2024-09-12T12:20:27.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:26 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:20:27.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:26 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:20:27.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:26 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:27.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:27 smithi102 ceph-mon[34799]: purged_snaps scrub starts 2024-09-12T12:20:27.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:27 smithi102 ceph-mon[34799]: purged_snaps scrub ok 2024-09-12T12:20:27.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:27 smithi102 ceph-mon[34799]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:20:27.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:27 smithi102 ceph-mon[34799]: from='client.14373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:20:27.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:27 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:20:27.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:27 smithi102 ceph-mon[34799]: osd.5 [v2:172.21.15.102:6808/2605625792,v1:172.21.15.102:6809/2605625792] boot 2024-09-12T12:20:27.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:27 smithi102 ceph-mon[34799]: osdmap e35: 6 total, 6 up, 6 in 2024-09-12T12:20:27.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:27 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:20:27.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:27 smithi102 ceph-mon[34799]: osdmap e36: 6 total, 6 up, 6 in 2024-09-12T12:20:27.900 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:27 smithi033 ceph-mon[31246]: purged_snaps scrub starts 2024-09-12T12:20:27.901 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:27 smithi033 ceph-mon[31246]: purged_snaps scrub ok 2024-09-12T12:20:27.901 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:27 smithi033 ceph-mon[31246]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:20:27.901 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:27 smithi033 ceph-mon[31246]: from='client.14373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:20:27.901 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:27 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:20:27.901 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:27 smithi033 ceph-mon[31246]: osd.5 [v2:172.21.15.102:6808/2605625792,v1:172.21.15.102:6809/2605625792] boot 2024-09-12T12:20:27.901 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:27 smithi033 ceph-mon[31246]: osdmap e35: 6 total, 6 up, 6 in 2024-09-12T12:20:27.901 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:27 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:20:27.901 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:27 smithi033 ceph-mon[31246]: osdmap e36: 6 total, 6 up, 6 in 2024-09-12T12:20:28.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:27 smithi043 ceph-mon[34144]: purged_snaps scrub starts 2024-09-12T12:20:28.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:27 smithi043 ceph-mon[34144]: purged_snaps scrub ok 2024-09-12T12:20:28.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:27 smithi043 ceph-mon[34144]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:20:28.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:27 smithi043 ceph-mon[34144]: from='client.14373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:20:28.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:27 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:20:28.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:27 smithi043 ceph-mon[34144]: osd.5 [v2:172.21.15.102:6808/2605625792,v1:172.21.15.102:6809/2605625792] boot 2024-09-12T12:20:28.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:27 smithi043 ceph-mon[34144]: osdmap e35: 6 total, 6 up, 6 in 2024-09-12T12:20:28.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:27 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:20:28.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:27 smithi043 ceph-mon[34144]: osdmap e36: 6 total, 6 up, 6 in 2024-09-12T12:20:28.980 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:28 smithi033 ceph-mon[31246]: osdmap e37: 6 total, 6 up, 6 in 2024-09-12T12:20:28.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:28 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/1894808530' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "46e5532e-026a-4bb2-8847-2a3216e5d7a0"}]: dispatch 2024-09-12T12:20:28.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:28 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/1894808530' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "46e5532e-026a-4bb2-8847-2a3216e5d7a0"}]': finished 2024-09-12T12:20:28.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:28 smithi033 ceph-mon[31246]: osdmap e38: 7 total, 6 up, 7 in 2024-09-12T12:20:28.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:28 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:20:29.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:28 smithi043 ceph-mon[34144]: osdmap e37: 6 total, 6 up, 6 in 2024-09-12T12:20:29.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:28 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/1894808530' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "46e5532e-026a-4bb2-8847-2a3216e5d7a0"}]: dispatch 2024-09-12T12:20:29.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:28 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/1894808530' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "46e5532e-026a-4bb2-8847-2a3216e5d7a0"}]': finished 2024-09-12T12:20:29.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:28 smithi043 ceph-mon[34144]: osdmap e38: 7 total, 6 up, 7 in 2024-09-12T12:20:29.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:28 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:20:29.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:28 smithi102 ceph-mon[34799]: osdmap e37: 6 total, 6 up, 6 in 2024-09-12T12:20:29.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:28 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/1894808530' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "46e5532e-026a-4bb2-8847-2a3216e5d7a0"}]: dispatch 2024-09-12T12:20:29.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:28 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/1894808530' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "46e5532e-026a-4bb2-8847-2a3216e5d7a0"}]': finished 2024-09-12T12:20:29.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:28 smithi102 ceph-mon[34799]: osdmap e38: 7 total, 6 up, 7 in 2024-09-12T12:20:29.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:28 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:20:29.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:29 smithi033 ceph-mon[31246]: pgmap v132: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 180 KiB/s, 0 objects/s recovering 2024-09-12T12:20:29.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:29 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/22010058' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:20:29.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:29 smithi033 ceph-mon[31246]: osdmap e39: 7 total, 6 up, 7 in 2024-09-12T12:20:29.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:29 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:20:30.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:29 smithi043 ceph-mon[34144]: pgmap v132: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 180 KiB/s, 0 objects/s recovering 2024-09-12T12:20:30.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:29 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/22010058' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:20:30.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:29 smithi043 ceph-mon[34144]: osdmap e39: 7 total, 6 up, 7 in 2024-09-12T12:20:30.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:29 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:20:30.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:29 smithi102 ceph-mon[34799]: pgmap v132: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 180 KiB/s, 0 objects/s recovering 2024-09-12T12:20:30.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:29 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/22010058' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:20:30.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:29 smithi102 ceph-mon[34799]: osdmap e39: 7 total, 6 up, 7 in 2024-09-12T12:20:30.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:29 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:20:31.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:31 smithi033 ceph-mon[31246]: pgmap v135: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 181 KiB/s, 0 objects/s recovering 2024-09-12T12:20:32.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:31 smithi043 ceph-mon[34144]: pgmap v135: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 181 KiB/s, 0 objects/s recovering 2024-09-12T12:20:32.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:31 smithi102 ceph-mon[34799]: pgmap v135: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 181 KiB/s, 0 objects/s recovering 2024-09-12T12:20:33.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:33 smithi033 ceph-mon[31246]: pgmap v136: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-09-12T12:20:34.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:33 smithi043 ceph-mon[34144]: pgmap v136: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-09-12T12:20:34.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:33 smithi102 ceph-mon[34799]: pgmap v136: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-09-12T12:20:35.940 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:35 smithi033 ceph-mon[31246]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-09-12T12:20:36.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:35 smithi043 ceph-mon[34144]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-09-12T12:20:36.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:35 smithi102 ceph-mon[34799]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-09-12T12:20:37.984 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:37 smithi033 ceph-mon[31246]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:20:37.985 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:37 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-12T12:20:37.985 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:37 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:38.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:37 smithi043 ceph-mon[34144]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:20:38.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:37 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-12T12:20:38.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:37 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:38.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:37 smithi102 ceph-mon[34799]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:20:38.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:37 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-12T12:20:38.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:37 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:38.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:38 smithi033 ceph-mon[31246]: Deploying daemon osd.6 on smithi033 2024-09-12T12:20:39.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:38 smithi043 ceph-mon[34144]: Deploying daemon osd.6 on smithi033 2024-09-12T12:20:39.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:38 smithi102 ceph-mon[34799]: Deploying daemon osd.6 on smithi033 2024-09-12T12:20:40.024 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:39 smithi033 ceph-mon[31246]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:20:40.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:39 smithi043 ceph-mon[34144]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:20:40.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:39 smithi102 ceph-mon[34799]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:20:41.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:41 smithi033 ceph-mon[31246]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:20:42.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:41 smithi043 ceph-mon[34144]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:20:42.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:41 smithi102 ceph-mon[34799]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:20:43.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:43 smithi033 ceph-mon[31246]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:20:43.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:43 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:20:43.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:43 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:43.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:43 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:44.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:43 smithi043 ceph-mon[34144]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:20:44.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:43 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:20:44.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:43 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:44.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:43 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:44.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:43 smithi102 ceph-mon[34799]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:20:44.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:43 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:20:44.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:43 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:44.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:43 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:45.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:45 smithi033 ceph-mon[31246]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:20:46.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:45 smithi043 ceph-mon[34144]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:20:46.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:45 smithi102 ceph-mon[34799]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:20:46.845 INFO:teuthology.orchestra.run.smithi033.stdout:Created osd(s) 6 on host 'smithi033' 2024-09-12T12:20:46.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:46.844+0000 7f72bf7fe640 1 -- 172.21.15.33:0/2453182816 <== mgr.14150 v2:172.21.15.33:6800/176202431 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f72c8062630 con 0x7f72b40a2b80 2024-09-12T12:20:46.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:46.846+0000 7f72cc8ed640 1 -- 172.21.15.33:0/2453182816 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f72b40a2b80 msgr2=0x7f72b40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:46.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:46.846+0000 7f72cc8ed640 1 --2- 172.21.15.33:0/2453182816 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f72b40a2b80 0x7f72b40a5040 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f72b8004770 tx=0x7f72b8000bc0 comp rx=0 tx=0).stop 2024-09-12T12:20:46.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:46.846+0000 7f72cc8ed640 1 -- 172.21.15.33:0/2453182816 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72c8102690 msgr2=0x7f72c819f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:46.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:46.846+0000 7f72cc8ed640 1 --2- 172.21.15.33:0/2453182816 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72c8102690 0x7f72c819f1d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f72c0009fd0 tx=0x7f72c000b260 comp rx=0 tx=0).stop 2024-09-12T12:20:46.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:46.846+0000 7f72cc8ed640 1 -- 172.21.15.33:0/2453182816 shutdown_connections 2024-09-12T12:20:46.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:46.846+0000 7f72cc8ed640 1 --2- 172.21.15.33:0/2453182816 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f72b40a2b80 0x7f72b40a5040 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:46.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:46.846+0000 7f72cc8ed640 1 --2- 172.21.15.33:0/2453182816 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72c8102690 0x7f72c819f1d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:46.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:46.846+0000 7f72cc8ed640 1 --2- 172.21.15.33:0/2453182816 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72c8101cd0 0x7f72c819cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:46.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:46.846+0000 7f72cc8ed640 1 --2- 172.21.15.33:0/2453182816 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72c8100ad0 0x7f72c806aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:46.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:46.846+0000 7f72cc8ed640 1 -- 172.21.15.33:0/2453182816 >> 172.21.15.33:0/2453182816 conn(0x7f72c80fc280 msgr2=0x7f72c8105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:46.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:46.846+0000 7f72cc8ed640 1 -- 172.21.15.33:0/2453182816 shutdown_connections 2024-09-12T12:20:46.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:20:46.846+0000 7f72cc8ed640 1 -- 172.21.15.33:0/2453182816 wait complete. 2024-09-12T12:20:47.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:46 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:47.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:46 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:47.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:46 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:47.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:46 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:20:47.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:46 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:47.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:46 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:47.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:46 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:47.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:46 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:47.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:46 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:20:47.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:46 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:47.158 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:46 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:47.158 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:46 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:47.158 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:46 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:47.159 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:46 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:20:47.159 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:46 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:47.461 DEBUG:teuthology.orchestra.run.smithi033:osd.6> sudo journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@osd.6.service 2024-09-12T12:20:47.464 INFO:tasks.cephadm:Deploying osd.7 on smithi043 with /dev/vg_nvme/lv_2... 2024-09-12T12:20:47.464 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-12T12:20:47.729 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T12:20:48.091 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:47 smithi043 ceph-mon[34144]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:20:48.091 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:47 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:20:48.091 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:47 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:48.091 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:47 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:48.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:47 smithi102 ceph-mon[34799]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:20:48.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:47 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:20:48.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:47 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:48.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:47 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:48.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:47 smithi033 ceph-mon[31246]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:20:48.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:47 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:20:48.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:47 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:48.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:47 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:48.666 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:20:48 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:20:48.465+0000 7fe50a6a7640 -1 osd.6 0 log_to_monitors true 2024-09-12T12:20:48.969 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:48 smithi033 ceph-mon[31246]: from='osd.6 [v2:172.21.15.33:6818/805864618,v1:172.21.15.33:6819/805864618]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T12:20:49.015 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:48 smithi043 ceph-mon[34144]: from='osd.6 [v2:172.21.15.33:6818/805864618,v1:172.21.15.33:6819/805864618]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T12:20:49.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:48 smithi102 ceph-mon[34799]: from='osd.6 [v2:172.21.15.33:6818/805864618,v1:172.21.15.33:6819/805864618]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T12:20:49.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:49 smithi033 ceph-mon[31246]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:20:49.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:49 smithi033 ceph-mon[31246]: from='osd.6 [v2:172.21.15.33:6818/805864618,v1:172.21.15.33:6819/805864618]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-12T12:20:49.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:49 smithi033 ceph-mon[31246]: osdmap e40: 7 total, 6 up, 7 in 2024-09-12T12:20:49.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:49 smithi033 ceph-mon[31246]: from='osd.6 [v2:172.21.15.33:6818/805864618,v1:172.21.15.33:6819/805864618]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-09-12T12:20:49.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:49 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:20:50.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:49 smithi043 ceph-mon[34144]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:20:50.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:49 smithi043 ceph-mon[34144]: from='osd.6 [v2:172.21.15.33:6818/805864618,v1:172.21.15.33:6819/805864618]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-12T12:20:50.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:49 smithi043 ceph-mon[34144]: osdmap e40: 7 total, 6 up, 7 in 2024-09-12T12:20:50.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:49 smithi043 ceph-mon[34144]: from='osd.6 [v2:172.21.15.33:6818/805864618,v1:172.21.15.33:6819/805864618]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-09-12T12:20:50.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:49 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:20:50.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:49 smithi102 ceph-mon[34799]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:20:50.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:49 smithi102 ceph-mon[34799]: from='osd.6 [v2:172.21.15.33:6818/805864618,v1:172.21.15.33:6819/805864618]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-12T12:20:50.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:49 smithi102 ceph-mon[34799]: osdmap e40: 7 total, 6 up, 7 in 2024-09-12T12:20:50.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:49 smithi102 ceph-mon[34799]: from='osd.6 [v2:172.21.15.33:6818/805864618,v1:172.21.15.33:6819/805864618]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-09-12T12:20:50.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:49 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:20:50.298 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T12:20:50.325 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi043:vg_nvme/lv_2 2024-09-12T12:20:50.393 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:20:50 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:20:50.202+0000 7fe50662a640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T12:20:50.393 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:20:50 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:20:50.210+0000 7fe4fe44a640 -1 osd.6 41 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T12:20:50.584 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T12:20:50.863 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:50 smithi043 ceph-mon[34144]: from='osd.6 [v2:172.21.15.33:6818/805864618,v1:172.21.15.33:6819/805864618]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-09-12T12:20:50.863 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:50 smithi043 ceph-mon[34144]: osdmap e41: 7 total, 6 up, 7 in 2024-09-12T12:20:50.863 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:50 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:20:50.863 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:50 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:20:50.863 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:50 smithi043 ceph-mon[34144]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:20:50.863 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:50 smithi043 ceph-mon[34144]: from='osd.6 [v2:172.21.15.33:6818/805864618,v1:172.21.15.33:6819/805864618]' entity='osd.6' 2024-09-12T12:20:50.864 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:50 smithi043 ceph-mon[34144]: Detected new or changed devices on smithi033 2024-09-12T12:20:50.864 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:50 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:50.864 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:50 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:50.864 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:50 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:20:50.864 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:50 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:20:50.864 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:50 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:20:50.864 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:50 smithi043 ceph-mon[34144]: Adjusting osd_memory_target on smithi033 to 5697M 2024-09-12T12:20:50.864 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:50 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:50.864 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:50 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:50.864 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:50 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:20:50.864 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:50 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:51.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:20:51.061+0000 7fa7fb5fc640 1 -- 172.21.15.43:0/769823773 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa7f4101760 msgr2=0x7fa7f4101c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:51.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:20:51.061+0000 7fa7fb5fc640 1 --2- 172.21.15.43:0/769823773 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa7f4101760 0x7fa7f4101c10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009ca0 tx=0x7fa7ec02a8c0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:20:51.061+0000 7fa7fb5fc640 1 -- 172.21.15.43:0/769823773 shutdown_connections 2024-09-12T12:20:51.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:20:51.061+0000 7fa7fb5fc640 1 --2- 172.21.15.43:0/769823773 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa7f4101760 0x7fa7f4101c10 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:20:51.061+0000 7fa7fb5fc640 1 --2- 172.21.15.43:0/769823773 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7f4100dc0 0x7fa7f4101220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:20:51.061+0000 7fa7fb5fc640 1 --2- 172.21.15.43:0/769823773 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7f4100480 0x7fa7f4100880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:20:51.061+0000 7fa7fb5fc640 1 -- 172.21.15.43:0/769823773 >> 172.21.15.43:0/769823773 conn(0x7fa7f40fc270 msgr2=0x7fa7f40fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:51.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:20:51.061+0000 7fa7fb5fc640 1 -- 172.21.15.43:0/769823773 shutdown_connections 2024-09-12T12:20:51.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:20:51.061+0000 7fa7fb5fc640 1 -- 172.21.15.43:0/769823773 wait complete. 2024-09-12T12:20:51.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:20:51.062+0000 7fa7fb5fc640 1 Processor -- start 2024-09-12T12:20:51.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:20:51.062+0000 7fa7fb5fc640 1 -- start start 2024-09-12T12:20:51.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:20:51.062+0000 7fa7fb5fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7f4100480 0x7fa7f419a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:51.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:20:51.062+0000 7fa7fb5fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7f4100dc0 0x7fa7f419a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:51.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:20:51.062+0000 7fa7fb5fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa7f4101760 0x7fa7f41a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:51.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:20:51.062+0000 7fa7fb5fc640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f410f920 con 0x7fa7f4100480 2024-09-12T12:20:51.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:20:51.062+0000 7fa7fb5fc640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f410f7a0 con 0x7fa7f4101760 2024-09-12T12:20:51.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:20:51.062+0000 7fa7fb5fc640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f410faa0 con 0x7fa7f4100dc0 2024-09-12T12:20:51.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:20:51.062+0000 7fa7f9b99640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa7f4101760 0x7fa7f41a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:51.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:20:51.062+0000 7fa7f9b99640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa7f4101760 0x7fa7f41a15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37334/0 (socket says 172.21.15.43:37334) 2024-09-12T12:20:51.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:20:51.062+0000 7fa7f9b99640 1 -- 172.21.15.43:0/1020071704 learned_addr learned my addr 172.21.15.43:0/1020071704 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-12T12:20:51.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:20:51.062+0000 7fa7f9398640 1 --2- 172.21.15.43:0/1020071704 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7f4100480 0x7fa7f419a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:51.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:20:51.062+0000 7fa7f8b97640 1 --2- 172.21.15.43:0/1020071704 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7f4100dc0 0x7fa7f419a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:51.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:20:51.062+0000 7fa7f9b99640 1 -- 172.21.15.43:0/1020071704 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7f4100dc0 msgr2=0x7fa7f419a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:51.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:20:51.062+0000 7fa7f9b99640 1 --2- 172.21.15.43:0/1020071704 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7f4100dc0 0x7fa7f419a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:20:51.062+0000 7fa7f9b99640 1 -- 172.21.15.43:0/1020071704 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7f4100480 msgr2=0x7fa7f419a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:51.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:20:51.062+0000 7fa7f9b99640 1 --2- 172.21.15.43:0/1020071704 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7f4100480 0x7fa7f419a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:20:51.062+0000 7fa7f9b99640 1 -- 172.21.15.43:0/1020071704 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7f41a1c60 con 0x7fa7f4101760 2024-09-12T12:20:51.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:20:51.062+0000 7fa7f9b99640 1 --2- 172.21.15.43:0/1020071704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa7f4101760 0x7fa7f41a15f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009dc0 tx=0x7fa7ec003ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:51.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:20:51.063+0000 7fa7ea7fc640 1 -- 172.21.15.43:0/1020071704 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec0317c0 con 0x7fa7f4101760 2024-09-12T12:20:51.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:20:51.063+0000 7fa7fb5fc640 1 -- 172.21.15.43:0/1020071704 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7f41a1ef0 con 0x7fa7f4101760 2024-09-12T12:20:51.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:20:51.063+0000 7fa7ea7fc640 1 -- 172.21.15.43:0/1020071704 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa7ec0044f0 con 0x7fa7f4101760 2024-09-12T12:20:51.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:20:51.063+0000 7fa7ea7fc640 1 -- 172.21.15.43:0/1020071704 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec030cd0 con 0x7fa7f4101760 2024-09-12T12:20:51.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:20:51.063+0000 7fa7fb5fc640 1 -- 172.21.15.43:0/1020071704 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7f41a23f0 con 0x7fa7f4101760 2024-09-12T12:20:51.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:20:51.064+0000 7fa7fb5fc640 1 -- 172.21.15.43:0/1020071704 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7f410b460 con 0x7fa7f4101760 2024-09-12T12:20:51.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:20:51.065+0000 7fa7ea7fc640 1 -- 172.21.15.43:0/1020071704 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fa7ec0046a0 con 0x7fa7f4101760 2024-09-12T12:20:51.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:20:51.066+0000 7fa7ea7fc640 1 --2- 172.21.15.43:0/1020071704 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fa7e00a2c30 0x7fa7e00a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:51.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:20:51.066+0000 7fa7ea7fc640 1 -- 172.21.15.43:0/1020071704 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4685+0+0 (secure 0 0 0) 0x7fa7ec0ef800 con 0x7fa7f4101760 2024-09-12T12:20:51.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:20:51.066+0000 7fa7f9398640 1 --2- 172.21.15.43:0/1020071704 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fa7e00a2c30 0x7fa7e00a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:51.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:20:51.067+0000 7fa7f9398640 1 --2- 172.21.15.43:0/1020071704 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fa7e00a2c30 0x7fa7e00a50f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0005fd0 tx=0x7fa7f000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:51.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:20:51.070+0000 7fa7ea7fc640 1 -- 172.21.15.43:0/1020071704 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa7ec0bd4f0 con 0x7fa7f4101760 2024-09-12T12:20:51.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:50 smithi102 ceph-mon[34799]: from='osd.6 [v2:172.21.15.33:6818/805864618,v1:172.21.15.33:6819/805864618]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-09-12T12:20:51.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:50 smithi102 ceph-mon[34799]: osdmap e41: 7 total, 6 up, 7 in 2024-09-12T12:20:51.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:50 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:20:51.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:50 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:20:51.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:50 smithi102 ceph-mon[34799]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:20:51.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:50 smithi102 ceph-mon[34799]: from='osd.6 [v2:172.21.15.33:6818/805864618,v1:172.21.15.33:6819/805864618]' entity='osd.6' 2024-09-12T12:20:51.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:50 smithi102 ceph-mon[34799]: Detected new or changed devices on smithi033 2024-09-12T12:20:51.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:50 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:51.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:50 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:51.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:50 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:20:51.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:50 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:20:51.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:50 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:20:51.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:50 smithi102 ceph-mon[34799]: Adjusting osd_memory_target on smithi033 to 5697M 2024-09-12T12:20:51.148 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:50 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:51.148 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:50 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:51.148 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:50 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:20:51.148 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:50 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:51.191 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:50 smithi033 ceph-mon[31246]: from='osd.6 [v2:172.21.15.33:6818/805864618,v1:172.21.15.33:6819/805864618]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-09-12T12:20:51.191 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:50 smithi033 ceph-mon[31246]: osdmap e41: 7 total, 6 up, 7 in 2024-09-12T12:20:51.191 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:50 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:20:51.191 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:50 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:20:51.191 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:50 smithi033 ceph-mon[31246]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:20:51.192 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:50 smithi033 ceph-mon[31246]: from='osd.6 [v2:172.21.15.33:6818/805864618,v1:172.21.15.33:6819/805864618]' entity='osd.6' 2024-09-12T12:20:51.192 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:50 smithi033 ceph-mon[31246]: Detected new or changed devices on smithi033 2024-09-12T12:20:51.192 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:50 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:51.192 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:50 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:51.192 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:50 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:20:51.192 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:50 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:20:51.192 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:50 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:20:51.192 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:50 smithi033 ceph-mon[31246]: Adjusting osd_memory_target on smithi033 to 5697M 2024-09-12T12:20:51.192 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:50 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:51.192 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:50 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:51.192 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:50 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:20:51.192 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:50 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:20:51.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:20:51.257+0000 7fa7fb5fc640 1 -- 172.21.15.43:0/1020071704 --> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fa7f4062630 con 0x7fa7e00a2c30 2024-09-12T12:20:51.969 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:51 smithi043 ceph-mon[34144]: purged_snaps scrub starts 2024-09-12T12:20:51.969 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:51 smithi043 ceph-mon[34144]: purged_snaps scrub ok 2024-09-12T12:20:51.969 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:51 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:20:51.969 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:51 smithi043 ceph-mon[34144]: osd.6 [v2:172.21.15.33:6818/805864618,v1:172.21.15.33:6819/805864618] boot 2024-09-12T12:20:51.969 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:51 smithi043 ceph-mon[34144]: osdmap e42: 7 total, 7 up, 7 in 2024-09-12T12:20:51.969 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:51 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:20:51.969 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:51 smithi043 ceph-mon[34144]: from='client.24266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:20:51.970 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:51 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:20:51.970 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:51 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:20:51.970 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:51 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:52.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:51 smithi102 ceph-mon[34799]: purged_snaps scrub starts 2024-09-12T12:20:52.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:51 smithi102 ceph-mon[34799]: purged_snaps scrub ok 2024-09-12T12:20:52.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:51 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:20:52.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:51 smithi102 ceph-mon[34799]: osd.6 [v2:172.21.15.33:6818/805864618,v1:172.21.15.33:6819/805864618] boot 2024-09-12T12:20:52.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:51 smithi102 ceph-mon[34799]: osdmap e42: 7 total, 7 up, 7 in 2024-09-12T12:20:52.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:51 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:20:52.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:51 smithi102 ceph-mon[34799]: from='client.24266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:20:52.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:51 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:20:52.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:51 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:20:52.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:51 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:52.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:51 smithi033 ceph-mon[31246]: purged_snaps scrub starts 2024-09-12T12:20:52.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:51 smithi033 ceph-mon[31246]: purged_snaps scrub ok 2024-09-12T12:20:52.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:51 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:20:52.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:51 smithi033 ceph-mon[31246]: osd.6 [v2:172.21.15.33:6818/805864618,v1:172.21.15.33:6819/805864618] boot 2024-09-12T12:20:52.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:51 smithi033 ceph-mon[31246]: osdmap e42: 7 total, 7 up, 7 in 2024-09-12T12:20:52.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:51 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:20:52.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:51 smithi033 ceph-mon[31246]: from='client.24266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:20:52.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:51 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:20:52.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:51 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:20:52.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:51 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:53.362 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:53 smithi043 ceph-mon[34144]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:20:53.362 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:53 smithi043 ceph-mon[34144]: osdmap e43: 7 total, 7 up, 7 in 2024-09-12T12:20:53.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:53 smithi033 ceph-mon[31246]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:20:53.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:53 smithi033 ceph-mon[31246]: osdmap e43: 7 total, 7 up, 7 in 2024-09-12T12:20:53.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:53 smithi102 ceph-mon[34799]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:20:53.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:53 smithi102 ceph-mon[34799]: osdmap e43: 7 total, 7 up, 7 in 2024-09-12T12:20:54.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:54 smithi033 ceph-mon[31246]: from='client.? 172.21.15.43:0/3993039002' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c8474ab4-68cd-4475-9429-b54981247ee2"}]: dispatch 2024-09-12T12:20:54.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:54 smithi033 ceph-mon[31246]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c8474ab4-68cd-4475-9429-b54981247ee2"}]: dispatch 2024-09-12T12:20:54.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:54 smithi033 ceph-mon[31246]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c8474ab4-68cd-4475-9429-b54981247ee2"}]': finished 2024-09-12T12:20:54.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:54 smithi033 ceph-mon[31246]: osdmap e44: 8 total, 7 up, 8 in 2024-09-12T12:20:54.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:54 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:20:54.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:54 smithi043 ceph-mon[34144]: from='client.? 172.21.15.43:0/3993039002' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c8474ab4-68cd-4475-9429-b54981247ee2"}]: dispatch 2024-09-12T12:20:54.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:54 smithi043 ceph-mon[34144]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c8474ab4-68cd-4475-9429-b54981247ee2"}]: dispatch 2024-09-12T12:20:54.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:54 smithi043 ceph-mon[34144]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c8474ab4-68cd-4475-9429-b54981247ee2"}]': finished 2024-09-12T12:20:54.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:54 smithi043 ceph-mon[34144]: osdmap e44: 8 total, 7 up, 8 in 2024-09-12T12:20:54.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:54 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:20:54.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:54 smithi102 ceph-mon[34799]: from='client.? 172.21.15.43:0/3993039002' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c8474ab4-68cd-4475-9429-b54981247ee2"}]: dispatch 2024-09-12T12:20:54.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:54 smithi102 ceph-mon[34799]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c8474ab4-68cd-4475-9429-b54981247ee2"}]: dispatch 2024-09-12T12:20:54.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:54 smithi102 ceph-mon[34799]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c8474ab4-68cd-4475-9429-b54981247ee2"}]': finished 2024-09-12T12:20:54.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:54 smithi102 ceph-mon[34799]: osdmap e44: 8 total, 7 up, 8 in 2024-09-12T12:20:54.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:54 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:20:55.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:55 smithi033 ceph-mon[31246]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:20:55.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:55 smithi033 ceph-mon[31246]: from='client.? 172.21.15.43:0/2435712984' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:20:55.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:55 smithi043 ceph-mon[34144]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:20:55.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:55 smithi043 ceph-mon[34144]: from='client.? 172.21.15.43:0/2435712984' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:20:55.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:55 smithi102 ceph-mon[34799]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:20:55.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:55 smithi102 ceph-mon[34799]: from='client.? 172.21.15.43:0/2435712984' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:20:57.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:57 smithi033 ceph-mon[31246]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:20:57.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:57 smithi043 ceph-mon[34144]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:20:57.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:57 smithi102 ceph-mon[34799]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:20:59.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:20:59 smithi033 ceph-mon[31246]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:20:59.491 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:20:59 smithi043 ceph-mon[34144]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:20:59.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:20:59 smithi102 ceph-mon[34799]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:21:01.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:01 smithi033 ceph-mon[31246]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:21:01.551 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:01 smithi043 ceph-mon[34144]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:21:01.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:01 smithi102 ceph-mon[34799]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:21:03.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:03 smithi043 ceph-mon[34144]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:21:03.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:03 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-12T12:21:03.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:03 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:03.366 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:03 smithi043 ceph-mon[34144]: Deploying daemon osd.7 on smithi043 2024-09-12T12:21:03.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:03 smithi033 ceph-mon[31246]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:21:03.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:03 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-12T12:21:03.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:03 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:03.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:03 smithi033 ceph-mon[31246]: Deploying daemon osd.7 on smithi043 2024-09-12T12:21:03.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:03 smithi102 ceph-mon[34799]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:21:03.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:03 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-12T12:21:03.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:03 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:03.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:03 smithi102 ceph-mon[34799]: Deploying daemon osd.7 on smithi043 2024-09-12T12:21:05.354 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:05 smithi043 ceph-mon[34144]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:21:05.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:05 smithi102 ceph-mon[34799]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:21:05.730 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:05 smithi033 ceph-mon[31246]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:21:07.402 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:07 smithi043 ceph-mon[34144]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:21:07.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:07 smithi102 ceph-mon[34799]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:21:07.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:07 smithi033 ceph-mon[31246]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:21:09.533 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:09 smithi033 ceph-mon[31246]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:21:09.533 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:09 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:21:09.533 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:09 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:09.533 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:09 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:09.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:09 smithi043 ceph-mon[34144]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:21:09.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:09 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:21:09.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:09 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:09.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:09 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:09.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:09 smithi102 ceph-mon[34799]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:21:09.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:09 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:21:09.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:09 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:09.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:09 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:11.568 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:11 smithi043 ceph-mon[34144]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:21:11.569 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:11 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:11.569 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:11 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:11.569 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:11 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:11.569 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:11 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:21:11.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:11 smithi102 ceph-mon[34799]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:21:11.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:11 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:11.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:11 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:11.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:11 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:11.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:11 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:21:11.730 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:11 smithi033 ceph-mon[31246]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:21:11.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:11 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:11.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:11 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:11.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:11 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:11.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:11 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:21:12.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:21:12.257+0000 7fa7ea7fc640 1 -- 172.21.15.43:0/1020071704 <== mgr.14150 v2:172.21.15.33:6800/176202431 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa7f4062630 con 0x7fa7e00a2c30 2024-09-12T12:21:12.259 INFO:teuthology.orchestra.run.smithi043.stdout:Created osd(s) 7 on host 'smithi043' 2024-09-12T12:21:12.260 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:21:12.259+0000 7fa7fb5fc640 1 -- 172.21.15.43:0/1020071704 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fa7e00a2c30 msgr2=0x7fa7e00a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:12.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:21:12.259+0000 7fa7fb5fc640 1 --2- 172.21.15.43:0/1020071704 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fa7e00a2c30 0x7fa7e00a50f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0005fd0 tx=0x7fa7f000b390 comp rx=0 tx=0).stop 2024-09-12T12:21:12.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:21:12.259+0000 7fa7fb5fc640 1 -- 172.21.15.43:0/1020071704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa7f4101760 msgr2=0x7fa7f41a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:12.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:21:12.259+0000 7fa7fb5fc640 1 --2- 172.21.15.43:0/1020071704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa7f4101760 0x7fa7f41a15f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009dc0 tx=0x7fa7ec003ba0 comp rx=0 tx=0).stop 2024-09-12T12:21:12.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:21:12.260+0000 7fa7fb5fc640 1 -- 172.21.15.43:0/1020071704 shutdown_connections 2024-09-12T12:21:12.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:21:12.260+0000 7fa7fb5fc640 1 --2- 172.21.15.43:0/1020071704 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fa7e00a2c30 0x7fa7e00a50f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:12.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:21:12.260+0000 7fa7fb5fc640 1 --2- 172.21.15.43:0/1020071704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa7f4101760 0x7fa7f41a15f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:12.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:21:12.260+0000 7fa7fb5fc640 1 --2- 172.21.15.43:0/1020071704 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7f4100dc0 0x7fa7f419a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:12.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:21:12.260+0000 7fa7fb5fc640 1 --2- 172.21.15.43:0/1020071704 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7f4100480 0x7fa7f419a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:12.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:21:12.260+0000 7fa7fb5fc640 1 -- 172.21.15.43:0/1020071704 >> 172.21.15.43:0/1020071704 conn(0x7fa7f40fc270 msgr2=0x7fa7f40fda20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:12.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:21:12.260+0000 7fa7fb5fc640 1 -- 172.21.15.43:0/1020071704 shutdown_connections 2024-09-12T12:21:12.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:21:12.260+0000 7fa7fb5fc640 1 -- 172.21.15.43:0/1020071704 wait complete. 2024-09-12T12:21:12.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:12 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:12.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:12 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:21:12.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:12 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:12.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:12 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:21:12.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:12 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:12.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:12 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:21:12.904 DEBUG:teuthology.orchestra.run.smithi043:osd.7> sudo journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@osd.7.service 2024-09-12T12:21:12.906 INFO:tasks.cephadm:Deploying osd.8 on smithi102 with /dev/vg_nvme/lv_2... 2024-09-12T12:21:12.906 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-12T12:21:13.156 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:21:13.513 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:13 smithi102 ceph-mon[34799]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:21:13.513 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:13 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:13.513 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:13 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:13.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:13 smithi043 ceph-mon[34144]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:21:13.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:13 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:13.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:13 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:13.730 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:13 smithi033 ceph-mon[31246]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:21:13.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:13 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:13.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:13 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:14.243 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:21:13 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:21:13.948+0000 7f6cdf334640 -1 osd.7 0 log_to_monitors true 2024-09-12T12:21:14.593 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:14 smithi102 ceph-mon[34799]: from='osd.7 [v2:172.21.15.43:6816/392537201,v1:172.21.15.43:6817/392537201]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T12:21:14.593 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:14 smithi102 ceph-mon[34799]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T12:21:14.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:14 smithi043 ceph-mon[34144]: from='osd.7 [v2:172.21.15.43:6816/392537201,v1:172.21.15.43:6817/392537201]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T12:21:14.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:14 smithi043 ceph-mon[34144]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T12:21:14.730 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:14 smithi033 ceph-mon[31246]: from='osd.7 [v2:172.21.15.43:6816/392537201,v1:172.21.15.43:6817/392537201]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T12:21:14.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:14 smithi033 ceph-mon[31246]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T12:21:15.600 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:15 smithi102 ceph-mon[34799]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:21:15.600 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:15 smithi102 ceph-mon[34799]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-12T12:21:15.600 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:15 smithi102 ceph-mon[34799]: osdmap e45: 8 total, 7 up, 8 in 2024-09-12T12:21:15.600 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:15 smithi102 ceph-mon[34799]: from='osd.7 [v2:172.21.15.43:6816/392537201,v1:172.21.15.43:6817/392537201]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-09-12T12:21:15.601 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:15 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:21:15.601 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:15 smithi102 ceph-mon[34799]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-09-12T12:21:15.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:15 smithi043 ceph-mon[34144]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:21:15.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:15 smithi043 ceph-mon[34144]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-12T12:21:15.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:15 smithi043 ceph-mon[34144]: osdmap e45: 8 total, 7 up, 8 in 2024-09-12T12:21:15.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:15 smithi043 ceph-mon[34144]: from='osd.7 [v2:172.21.15.43:6816/392537201,v1:172.21.15.43:6817/392537201]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-09-12T12:21:15.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:15 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:21:15.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:15 smithi043 ceph-mon[34144]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-09-12T12:21:15.730 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:15 smithi033 ceph-mon[31246]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:21:15.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:15 smithi033 ceph-mon[31246]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-12T12:21:15.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:15 smithi033 ceph-mon[31246]: osdmap e45: 8 total, 7 up, 8 in 2024-09-12T12:21:15.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:15 smithi033 ceph-mon[31246]: from='osd.7 [v2:172.21.15.43:6816/392537201,v1:172.21.15.43:6817/392537201]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-09-12T12:21:15.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:15 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:21:15.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:15 smithi033 ceph-mon[31246]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-09-12T12:21:15.764 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T12:21:15.790 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi102:vg_nvme/lv_2 2024-09-12T12:21:16.038 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:21:16.115 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:21:15 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:21:15.738+0000 7f6cdb2b7640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T12:21:16.115 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:21:15 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:21:15.747+0000 7f6cd30d7640 -1 osd.7 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T12:21:16.439 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:16 smithi102 ceph-mon[34799]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-09-12T12:21:16.439 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:16 smithi102 ceph-mon[34799]: osdmap e46: 8 total, 7 up, 8 in 2024-09-12T12:21:16.439 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:16 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:21:16.439 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:16 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:21:16.440 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:16 smithi102 ceph-mon[34799]: Detected new or changed devices on smithi043 2024-09-12T12:21:16.440 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:16 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:16.440 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:16 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:16.440 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:16 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:16.440 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:16 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:16.440 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:16 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:16.440 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:16 smithi102 ceph-mon[34799]: Adjusting osd_memory_target on smithi043 to 5697M 2024-09-12T12:21:16.440 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:16 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:16.440 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:16 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:16.440 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:16 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:21:16.440 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:16 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:16.440 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:16 smithi102 ceph-mon[34799]: from='osd.7 ' entity='osd.7' 2024-09-12T12:21:16.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:16.523+0000 7f93119e1640 1 -- 172.21.15.102:0/3530863374 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f930c102690 msgr2=0x7f930c108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:16.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:16.523+0000 7f93119e1640 1 --2- 172.21.15.102:0/3530863374 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f930c102690 0x7f930c108f20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9304009ca0 tx=0x7f930402a8c0 comp rx=0 tx=0).stop 2024-09-12T12:21:16.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:16.523+0000 7f93119e1640 1 -- 172.21.15.102:0/3530863374 shutdown_connections 2024-09-12T12:21:16.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:16.523+0000 7f93119e1640 1 --2- 172.21.15.102:0/3530863374 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f930c102690 0x7f930c108f20 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:16.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:16.523+0000 7f93119e1640 1 --2- 172.21.15.102:0/3530863374 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f930c101cd0 0x7f930c102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:16.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:16.523+0000 7f93119e1640 1 --2- 172.21.15.102:0/3530863374 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f930c100ad0 0x7f930c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:16.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:16.523+0000 7f93119e1640 1 -- 172.21.15.102:0/3530863374 >> 172.21.15.102:0/3530863374 conn(0x7f930c0fc280 msgr2=0x7f930c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:16.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:16.523+0000 7f93119e1640 1 -- 172.21.15.102:0/3530863374 shutdown_connections 2024-09-12T12:21:16.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:16.523+0000 7f93119e1640 1 -- 172.21.15.102:0/3530863374 wait complete. 2024-09-12T12:21:16.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:16.523+0000 7f93119e1640 1 Processor -- start 2024-09-12T12:21:16.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:16.523+0000 7f93119e1640 1 -- start start 2024-09-12T12:21:16.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:16.524+0000 7f93119e1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f930c100ad0 0x7f930c197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:16.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:16.524+0000 7f93119e1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f930c101cd0 0x7f930c198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:16.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:16.524+0000 7f93119e1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f930c102690 0x7f930c19f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:16.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:16.524+0000 7f93119e1640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f930c10d810 con 0x7f930c100ad0 2024-09-12T12:21:16.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:16.524+0000 7f93119e1640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f930c10d690 con 0x7f930c101cd0 2024-09-12T12:21:16.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:16.524+0000 7f93119e1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f930c10d990 con 0x7f930c102690 2024-09-12T12:21:16.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:16.524+0000 7f930b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f930c102690 0x7f930c19f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:16.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:16.524+0000 7f930b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f930c102690 0x7f930c19f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:53070/0 (socket says 172.21.15.102:53070) 2024-09-12T12:21:16.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:16.524+0000 7f930b7fe640 1 -- 172.21.15.102:0/2728696324 learned_addr learned my addr 172.21.15.102:0/2728696324 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-12T12:21:16.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:16.524+0000 7f930affd640 1 --2- 172.21.15.102:0/2728696324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f930c100ad0 0x7f930c197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:16.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:16.524+0000 7f93027fc640 1 --2- 172.21.15.102:0/2728696324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f930c101cd0 0x7f930c198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:16.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:16.524+0000 7f930b7fe640 1 -- 172.21.15.102:0/2728696324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f930c101cd0 msgr2=0x7f930c198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:16.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:16.524+0000 7f930b7fe640 1 --2- 172.21.15.102:0/2728696324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f930c101cd0 0x7f930c198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:16.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:16.524+0000 7f930b7fe640 1 -- 172.21.15.102:0/2728696324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f930c100ad0 msgr2=0x7f930c197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:16.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:16.524+0000 7f930b7fe640 1 --2- 172.21.15.102:0/2728696324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f930c100ad0 0x7f930c197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:16.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:16.524+0000 7f930b7fe640 1 -- 172.21.15.102:0/2728696324 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f930c19faf0 con 0x7f930c102690 2024-09-12T12:21:16.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:16.524+0000 7f93027fc640 1 --2- 172.21.15.102:0/2728696324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f930c101cd0 0x7f930c198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:21:16.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:16.524+0000 7f930b7fe640 1 --2- 172.21.15.102:0/2728696324 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f930c102690 0x7f930c19f480 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9304009dc0 tx=0x7f9304003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:16.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:16.525+0000 7f93109df640 1 -- 172.21.15.102:0/2728696324 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9304004040 con 0x7f930c102690 2024-09-12T12:21:16.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:16.525+0000 7f93109df640 1 -- 172.21.15.102:0/2728696324 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9304004690 con 0x7f930c102690 2024-09-12T12:21:16.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:16.525+0000 7f93119e1640 1 -- 172.21.15.102:0/2728696324 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f930c19fd80 con 0x7f930c102690 2024-09-12T12:21:16.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:16.525+0000 7f93109df640 1 -- 172.21.15.102:0/2728696324 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f930402f4c0 con 0x7f930c102690 2024-09-12T12:21:16.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:16.525+0000 7f93119e1640 1 -- 172.21.15.102:0/2728696324 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f930c1a0310 con 0x7f930c102690 2024-09-12T12:21:16.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:16.526+0000 7f93119e1640 1 -- 172.21.15.102:0/2728696324 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f930c107fc0 con 0x7f930c102690 2024-09-12T12:21:16.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:16.527+0000 7f93109df640 1 -- 172.21.15.102:0/2728696324 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f93040305c0 con 0x7f930c102690 2024-09-12T12:21:16.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:16.528+0000 7f93109df640 1 --2- 172.21.15.102:0/2728696324 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f92f80a2c30 0x7f92f80a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:16.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:16.528+0000 7f93109df640 1 -- 172.21.15.102:0/2728696324 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5430+0+0 (secure 0 0 0) 0x7f93040efdc0 con 0x7f930c102690 2024-09-12T12:21:16.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:16.528+0000 7f930affd640 1 --2- 172.21.15.102:0/2728696324 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f92f80a2c30 0x7f92f80a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:16.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:16.529+0000 7f930affd640 1 --2- 172.21.15.102:0/2728696324 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f92f80a2c30 0x7f92f80a50f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f930c101b30 tx=0x7f92fc009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:16.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:16.531+0000 7f93109df640 1 -- 172.21.15.102:0/2728696324 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f93040bd860 con 0x7f930c102690 2024-09-12T12:21:16.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:16 smithi043 ceph-mon[34144]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-09-12T12:21:16.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:16 smithi043 ceph-mon[34144]: osdmap e46: 8 total, 7 up, 8 in 2024-09-12T12:21:16.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:16 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:21:16.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:16 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:21:16.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:16 smithi043 ceph-mon[34144]: Detected new or changed devices on smithi043 2024-09-12T12:21:16.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:16 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:16.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:16 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:16.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:16 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:16.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:16 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:16.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:16 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:16.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:16 smithi043 ceph-mon[34144]: Adjusting osd_memory_target on smithi043 to 5697M 2024-09-12T12:21:16.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:16 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:16.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:16 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:16.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:16 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:21:16.617 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:16 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:16.617 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:16 smithi043 ceph-mon[34144]: from='osd.7 ' entity='osd.7' 2024-09-12T12:21:16.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:16.704+0000 7f93119e1640 1 -- 172.21.15.102:0/2728696324 --> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f930c062630 con 0x7f92f80a2c30 2024-09-12T12:21:16.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:16 smithi033 ceph-mon[31246]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-09-12T12:21:16.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:16 smithi033 ceph-mon[31246]: osdmap e46: 8 total, 7 up, 8 in 2024-09-12T12:21:16.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:16 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:21:16.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:16 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:21:16.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:16 smithi033 ceph-mon[31246]: Detected new or changed devices on smithi043 2024-09-12T12:21:16.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:16 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:16.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:16 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:16.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:16 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:16.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:16 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:16.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:16 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:16.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:16 smithi033 ceph-mon[31246]: Adjusting osd_memory_target on smithi043 to 5697M 2024-09-12T12:21:16.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:16 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:16.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:16 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:16.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:16 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:21:16.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:16 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:16.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:16 smithi033 ceph-mon[31246]: from='osd.7 ' entity='osd.7' 2024-09-12T12:21:17.368 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:17 smithi102 ceph-mon[34799]: purged_snaps scrub starts 2024-09-12T12:21:17.368 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:17 smithi102 ceph-mon[34799]: purged_snaps scrub ok 2024-09-12T12:21:17.368 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:17 smithi102 ceph-mon[34799]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:21:17.368 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:17 smithi102 ceph-mon[34799]: osd.7 [v2:172.21.15.43:6816/392537201,v1:172.21.15.43:6817/392537201] boot 2024-09-12T12:21:17.368 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:17 smithi102 ceph-mon[34799]: osdmap e47: 8 total, 8 up, 8 in 2024-09-12T12:21:17.368 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:17 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:21:17.368 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:17 smithi102 ceph-mon[34799]: from='client.24316 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:21:17.368 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:17 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:21:17.368 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:17 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:21:17.368 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:17 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:17.369 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:17 smithi102 ceph-mon[34799]: osdmap e48: 8 total, 8 up, 8 in 2024-09-12T12:21:17.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:17 smithi043 ceph-mon[34144]: purged_snaps scrub starts 2024-09-12T12:21:17.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:17 smithi043 ceph-mon[34144]: purged_snaps scrub ok 2024-09-12T12:21:17.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:17 smithi043 ceph-mon[34144]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:21:17.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:17 smithi043 ceph-mon[34144]: osd.7 [v2:172.21.15.43:6816/392537201,v1:172.21.15.43:6817/392537201] boot 2024-09-12T12:21:17.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:17 smithi043 ceph-mon[34144]: osdmap e47: 8 total, 8 up, 8 in 2024-09-12T12:21:17.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:17 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:21:17.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:17 smithi043 ceph-mon[34144]: from='client.24316 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:21:17.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:17 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:21:17.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:17 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:21:17.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:17 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:17.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:17 smithi043 ceph-mon[34144]: osdmap e48: 8 total, 8 up, 8 in 2024-09-12T12:21:17.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:17 smithi033 ceph-mon[31246]: purged_snaps scrub starts 2024-09-12T12:21:17.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:17 smithi033 ceph-mon[31246]: purged_snaps scrub ok 2024-09-12T12:21:17.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:17 smithi033 ceph-mon[31246]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:21:17.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:17 smithi033 ceph-mon[31246]: osd.7 [v2:172.21.15.43:6816/392537201,v1:172.21.15.43:6817/392537201] boot 2024-09-12T12:21:17.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:17 smithi033 ceph-mon[31246]: osdmap e47: 8 total, 8 up, 8 in 2024-09-12T12:21:17.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:17 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:21:17.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:17 smithi033 ceph-mon[31246]: from='client.24316 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:21:17.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:17 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:21:17.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:17 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:21:17.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:17 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:17.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:17 smithi033 ceph-mon[31246]: osdmap e48: 8 total, 8 up, 8 in 2024-09-12T12:21:18.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:18 smithi043 ceph-mon[34144]: osdmap e49: 8 total, 8 up, 8 in 2024-09-12T12:21:19.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:18 smithi102 ceph-mon[34799]: osdmap e49: 8 total, 8 up, 8 in 2024-09-12T12:21:19.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:18 smithi033 ceph-mon[31246]: osdmap e49: 8 total, 8 up, 8 in 2024-09-12T12:21:19.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:19 smithi102 ceph-mon[34799]: pgmap v169: 1 pgs: 1 remapped+peering; 577 KiB data, 255 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:21:19.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:19 smithi102 ceph-mon[34799]: osdmap e50: 8 total, 8 up, 8 in 2024-09-12T12:21:19.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:19 smithi102 ceph-mon[34799]: from='client.? 172.21.15.102:0/2404945941' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e7c2ef28-8c84-44d0-ba6d-7556ec1d02dd"}]: dispatch 2024-09-12T12:21:19.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:19 smithi102 ceph-mon[34799]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e7c2ef28-8c84-44d0-ba6d-7556ec1d02dd"}]: dispatch 2024-09-12T12:21:19.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:19 smithi102 ceph-mon[34799]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e7c2ef28-8c84-44d0-ba6d-7556ec1d02dd"}]': finished 2024-09-12T12:21:19.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:19 smithi102 ceph-mon[34799]: osdmap e51: 9 total, 8 up, 9 in 2024-09-12T12:21:19.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:19 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:21:19.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:19 smithi102 ceph-mon[34799]: from='client.? 172.21.15.102:0/816365302' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:21:20.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:19 smithi043 ceph-mon[34144]: pgmap v169: 1 pgs: 1 remapped+peering; 577 KiB data, 255 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:21:20.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:19 smithi043 ceph-mon[34144]: osdmap e50: 8 total, 8 up, 8 in 2024-09-12T12:21:20.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:19 smithi043 ceph-mon[34144]: from='client.? 172.21.15.102:0/2404945941' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e7c2ef28-8c84-44d0-ba6d-7556ec1d02dd"}]: dispatch 2024-09-12T12:21:20.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:19 smithi043 ceph-mon[34144]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e7c2ef28-8c84-44d0-ba6d-7556ec1d02dd"}]: dispatch 2024-09-12T12:21:20.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:19 smithi043 ceph-mon[34144]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e7c2ef28-8c84-44d0-ba6d-7556ec1d02dd"}]': finished 2024-09-12T12:21:20.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:19 smithi043 ceph-mon[34144]: osdmap e51: 9 total, 8 up, 9 in 2024-09-12T12:21:20.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:19 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:21:20.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:19 smithi043 ceph-mon[34144]: from='client.? 172.21.15.102:0/816365302' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:21:20.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:19 smithi033 ceph-mon[31246]: pgmap v169: 1 pgs: 1 remapped+peering; 577 KiB data, 255 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:21:20.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:19 smithi033 ceph-mon[31246]: osdmap e50: 8 total, 8 up, 8 in 2024-09-12T12:21:20.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:19 smithi033 ceph-mon[31246]: from='client.? 172.21.15.102:0/2404945941' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e7c2ef28-8c84-44d0-ba6d-7556ec1d02dd"}]: dispatch 2024-09-12T12:21:20.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:19 smithi033 ceph-mon[31246]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e7c2ef28-8c84-44d0-ba6d-7556ec1d02dd"}]: dispatch 2024-09-12T12:21:20.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:19 smithi033 ceph-mon[31246]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e7c2ef28-8c84-44d0-ba6d-7556ec1d02dd"}]': finished 2024-09-12T12:21:20.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:19 smithi033 ceph-mon[31246]: osdmap e51: 9 total, 8 up, 9 in 2024-09-12T12:21:20.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:19 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:21:20.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:19 smithi033 ceph-mon[31246]: from='client.? 172.21.15.102:0/816365302' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:21:22.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:21 smithi043 ceph-mon[34144]: pgmap v172: 1 pgs: 1 remapped+peering; 577 KiB data, 255 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:21:22.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:21 smithi102 ceph-mon[34799]: pgmap v172: 1 pgs: 1 remapped+peering; 577 KiB data, 255 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:21:22.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:21 smithi033 ceph-mon[31246]: pgmap v172: 1 pgs: 1 remapped+peering; 577 KiB data, 255 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:21:23.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:23 smithi102 ceph-mon[34799]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:21:24.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:23 smithi043 ceph-mon[34144]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:21:24.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:23 smithi033 ceph-mon[31246]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:21:26.071 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:25 smithi102 ceph-mon[34799]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:21:26.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:25 smithi043 ceph-mon[34144]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:21:26.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:25 smithi033 ceph-mon[31246]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:21:28.083 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:27 smithi102 ceph-mon[34799]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:21:28.083 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:27 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-12T12:21:28.084 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:27 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:28.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:27 smithi043 ceph-mon[34144]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:21:28.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:27 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-12T12:21:28.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:27 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:28.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:27 smithi033 ceph-mon[31246]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:21:28.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:27 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-12T12:21:28.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:27 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:29.020 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:28 smithi102 ceph-mon[34799]: Deploying daemon osd.8 on smithi102 2024-09-12T12:21:29.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:28 smithi043 ceph-mon[34144]: Deploying daemon osd.8 on smithi102 2024-09-12T12:21:29.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:28 smithi033 ceph-mon[31246]: Deploying daemon osd.8 on smithi102 2024-09-12T12:21:30.019 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:29 smithi102 ceph-mon[34799]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:21:30.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:29 smithi043 ceph-mon[34144]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:21:30.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:29 smithi033 ceph-mon[31246]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:21:32.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:31 smithi043 ceph-mon[34144]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:21:32.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:31 smithi102 ceph-mon[34799]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:21:32.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:31 smithi033 ceph-mon[31246]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:21:34.070 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:33 smithi102 ceph-mon[34799]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:21:34.070 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:33 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:21:34.070 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:33 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:34.070 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:33 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:34.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:33 smithi043 ceph-mon[34144]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:21:34.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:33 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:21:34.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:33 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:34.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:33 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:34.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:33 smithi033 ceph-mon[31246]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:21:34.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:33 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:21:34.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:33 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:34.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:33 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:36.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:35 smithi043 ceph-mon[34144]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:21:36.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:35 smithi102 ceph-mon[34799]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:21:36.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:35 smithi033 ceph-mon[31246]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:21:37.477 INFO:teuthology.orchestra.run.smithi102.stdout:Created osd(s) 8 on host 'smithi102' 2024-09-12T12:21:37.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:37.476+0000 7f93109df640 1 -- 172.21.15.102:0/2728696324 <== mgr.14150 v2:172.21.15.33:6800/176202431 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f930c062630 con 0x7f92f80a2c30 2024-09-12T12:21:37.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:37.478+0000 7f93119e1640 1 -- 172.21.15.102:0/2728696324 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f92f80a2c30 msgr2=0x7f92f80a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:37.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:37.478+0000 7f93119e1640 1 --2- 172.21.15.102:0/2728696324 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f92f80a2c30 0x7f92f80a50f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f930c101b30 tx=0x7f92fc009110 comp rx=0 tx=0).stop 2024-09-12T12:21:37.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:37.478+0000 7f93119e1640 1 -- 172.21.15.102:0/2728696324 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f930c102690 msgr2=0x7f930c19f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:37.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:37.478+0000 7f93119e1640 1 --2- 172.21.15.102:0/2728696324 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f930c102690 0x7f930c19f480 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9304009dc0 tx=0x7f9304003ba0 comp rx=0 tx=0).stop 2024-09-12T12:21:37.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:37.478+0000 7f93119e1640 1 -- 172.21.15.102:0/2728696324 shutdown_connections 2024-09-12T12:21:37.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:37.478+0000 7f93119e1640 1 --2- 172.21.15.102:0/2728696324 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f92f80a2c30 0x7f92f80a50f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:37.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:37.478+0000 7f93119e1640 1 --2- 172.21.15.102:0/2728696324 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f930c102690 0x7f930c19f480 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:37.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:37.478+0000 7f93119e1640 1 --2- 172.21.15.102:0/2728696324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f930c101cd0 0x7f930c198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:37.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:37.479+0000 7f93119e1640 1 --2- 172.21.15.102:0/2728696324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f930c100ad0 0x7f930c197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:37.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:37.479+0000 7f93119e1640 1 -- 172.21.15.102:0/2728696324 >> 172.21.15.102:0/2728696324 conn(0x7f930c0fc280 msgr2=0x7f930c105190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:37.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:37.479+0000 7f93119e1640 1 -- 172.21.15.102:0/2728696324 shutdown_connections 2024-09-12T12:21:37.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:21:37.479+0000 7f93119e1640 1 -- 172.21.15.102:0/2728696324 wait complete. 2024-09-12T12:21:37.782 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:37 smithi102 ceph-mon[34799]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:21:37.782 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:37 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:37.782 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:37 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:37.783 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:37 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:37.783 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:37 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:21:37.783 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:37 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:37.783 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:37 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:21:37.783 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:37 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:37.783 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:37 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:37.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:37 smithi043 ceph-mon[34144]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:21:37.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:37 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:37.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:37 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:37.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:37 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:37.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:37 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:21:37.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:37 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:37.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:37 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:21:37.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:37 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:37.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:37 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:37.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:37 smithi033 ceph-mon[31246]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:21:37.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:37 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:37.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:37 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:37.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:37 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:37.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:37 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:21:37.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:37 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:37.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:37 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:21:37.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:37 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:37.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:37 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:38.118 DEBUG:teuthology.orchestra.run.smithi102:osd.8> sudo journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@osd.8.service 2024-09-12T12:21:38.120 INFO:tasks.cephadm:Deploying osd.9 on smithi033 with /dev/vg_nvme/lv_1... 2024-09-12T12:21:38.121 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-12T12:21:38.392 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:21:39.557 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:21:39 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:21:39.310+0000 7f221aca3640 -1 osd.8 0 log_to_monitors true 2024-09-12T12:21:39.838 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:39 smithi033 ceph-mon[31246]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:21:39.838 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:39 smithi033 ceph-mon[31246]: from='osd.8 [v2:172.21.15.102:6816/1768219597,v1:172.21.15.102:6817/1768219597]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T12:21:39.838 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:39 smithi033 ceph-mon[31246]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T12:21:39.844 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:39 smithi102 ceph-mon[34799]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:21:39.844 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:39 smithi102 ceph-mon[34799]: from='osd.8 [v2:172.21.15.102:6816/1768219597,v1:172.21.15.102:6817/1768219597]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T12:21:39.844 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:39 smithi102 ceph-mon[34799]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T12:21:39.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:39 smithi043 ceph-mon[34144]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:21:39.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:39 smithi043 ceph-mon[34144]: from='osd.8 [v2:172.21.15.102:6816/1768219597,v1:172.21.15.102:6817/1768219597]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T12:21:39.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:39 smithi043 ceph-mon[34144]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T12:21:40.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:40 smithi033 ceph-mon[31246]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-12T12:21:40.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:40 smithi033 ceph-mon[31246]: from='osd.8 [v2:172.21.15.102:6816/1768219597,v1:172.21.15.102:6817/1768219597]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-12T12:21:40.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:40 smithi033 ceph-mon[31246]: osdmap e52: 9 total, 8 up, 9 in 2024-09-12T12:21:40.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:40 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:21:40.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:40 smithi033 ceph-mon[31246]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-12T12:21:40.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:40 smithi033 ceph-mon[31246]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-12T12:21:40.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:40 smithi033 ceph-mon[31246]: osdmap e53: 9 total, 8 up, 9 in 2024-09-12T12:21:40.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:40 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:21:40.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:40 smithi043 ceph-mon[34144]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-12T12:21:40.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:40 smithi043 ceph-mon[34144]: from='osd.8 [v2:172.21.15.102:6816/1768219597,v1:172.21.15.102:6817/1768219597]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-12T12:21:40.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:40 smithi043 ceph-mon[34144]: osdmap e52: 9 total, 8 up, 9 in 2024-09-12T12:21:40.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:40 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:21:40.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:40 smithi043 ceph-mon[34144]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-12T12:21:40.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:40 smithi043 ceph-mon[34144]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-12T12:21:40.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:40 smithi043 ceph-mon[34144]: osdmap e53: 9 total, 8 up, 9 in 2024-09-12T12:21:40.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:40 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:21:40.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:40 smithi102 ceph-mon[34799]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-12T12:21:40.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:40 smithi102 ceph-mon[34799]: from='osd.8 [v2:172.21.15.102:6816/1768219597,v1:172.21.15.102:6817/1768219597]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-12T12:21:40.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:40 smithi102 ceph-mon[34799]: osdmap e52: 9 total, 8 up, 9 in 2024-09-12T12:21:40.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:40 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:21:40.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:40 smithi102 ceph-mon[34799]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-12T12:21:40.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:40 smithi102 ceph-mon[34799]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-12T12:21:40.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:40 smithi102 ceph-mon[34799]: osdmap e53: 9 total, 8 up, 9 in 2024-09-12T12:21:40.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:40 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:21:40.897 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:21:40 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:21:40.559+0000 7f2216c26640 -1 osd.8 0 waiting for initial osdmap 2024-09-12T12:21:40.898 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:21:40 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:21:40.572+0000 7f2212a4e640 -1 osd.8 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T12:21:41.071 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:21:41.099 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi033:vg_nvme/lv_1 2024-09-12T12:21:41.359 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:21:41.723 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:41 smithi033 ceph-mon[31246]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:21:41.723 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:41 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:21:41.723 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:41 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:41.723 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:41 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:41.723 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:41 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:41.723 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:41 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:41.723 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:41 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:41.723 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:41 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:41.723 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:41 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:41.723 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:41 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:21:41.723 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:41 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:41.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:21:41.809+0000 7fbd8c060640 1 -- 172.21.15.33:0/996487042 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbd84074c50 msgr2=0x7fbd840750b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:41.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:21:41.809+0000 7fbd8c060640 1 --2- 172.21.15.33:0/996487042 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbd84074c50 0x7fbd840750b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbd80009900 tx=0x7fbd8002a410 comp rx=0 tx=0).stop 2024-09-12T12:21:41.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:21:41.809+0000 7fbd8c060640 1 -- 172.21.15.33:0/996487042 shutdown_connections 2024-09-12T12:21:41.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:21:41.809+0000 7fbd8c060640 1 --2- 172.21.15.33:0/996487042 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd8410e1f0 0x7fbd841105e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:41.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:21:41.809+0000 7fbd8c060640 1 --2- 172.21.15.33:0/996487042 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbd84074c50 0x7fbd840750b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:41.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:21:41.809+0000 7fbd8c060640 1 --2- 172.21.15.33:0/996487042 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd84076220 0x7fbd84074680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:41.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:21:41.809+0000 7fbd8c060640 1 -- 172.21.15.33:0/996487042 >> 172.21.15.33:0/996487042 conn(0x7fbd840fd3c0 msgr2=0x7fbd840ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:41.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:21:41.809+0000 7fbd8c060640 1 -- 172.21.15.33:0/996487042 shutdown_connections 2024-09-12T12:21:41.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:21:41.809+0000 7fbd8c060640 1 -- 172.21.15.33:0/996487042 wait complete. 2024-09-12T12:21:41.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:21:41.810+0000 7fbd8c060640 1 Processor -- start 2024-09-12T12:21:41.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:21:41.810+0000 7fbd8c060640 1 -- start start 2024-09-12T12:21:41.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:21:41.810+0000 7fbd8c060640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd84074c50 0x7fbd8419e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:41.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:21:41.810+0000 7fbd8c060640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbd84076220 0x7fbd8419e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:41.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:21:41.810+0000 7fbd8c060640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd8410e1f0 0x7fbd841a59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:41.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:21:41.810+0000 7fbd8c060640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fbd84113d60 con 0x7fbd84076220 2024-09-12T12:21:41.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:21:41.810+0000 7fbd8c060640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbd84113be0 con 0x7fbd8410e1f0 2024-09-12T12:21:41.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:21:41.810+0000 7fbd8c060640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbd84113ee0 con 0x7fbd84074c50 2024-09-12T12:21:41.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:21:41.810+0000 7fbd895fb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbd84076220 0x7fbd8419e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:41.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:21:41.810+0000 7fbd895fb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbd84076220 0x7fbd8419e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40866/0 (socket says 172.21.15.33:40866) 2024-09-12T12:21:41.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:21:41.810+0000 7fbd895fb640 1 -- 172.21.15.33:0/309985736 learned_addr learned my addr 172.21.15.33:0/309985736 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:21:41.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:21:41.810+0000 7fbd89dfc640 1 --2- 172.21.15.33:0/309985736 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd84074c50 0x7fbd8419e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:41.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:21:41.810+0000 7fbd8a5fd640 1 --2- 172.21.15.33:0/309985736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd8410e1f0 0x7fbd841a59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:41.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:21:41.811+0000 7fbd895fb640 1 -- 172.21.15.33:0/309985736 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd84074c50 msgr2=0x7fbd8419e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:41.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:21:41.811+0000 7fbd895fb640 1 --2- 172.21.15.33:0/309985736 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd84074c50 0x7fbd8419e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:41.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:21:41.811+0000 7fbd895fb640 1 -- 172.21.15.33:0/309985736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd8410e1f0 msgr2=0x7fbd841a59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:41.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:21:41.811+0000 7fbd895fb640 1 --2- 172.21.15.33:0/309985736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd8410e1f0 0x7fbd841a59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:41.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:21:41.811+0000 7fbd895fb640 1 -- 172.21.15.33:0/309985736 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd841a6050 con 0x7fbd84076220 2024-09-12T12:21:41.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:21:41.811+0000 7fbd895fb640 1 --2- 172.21.15.33:0/309985736 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbd84076220 0x7fbd8419e960 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbd80004770 tx=0x7fbd800042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:41.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:21:41.811+0000 7fbd76ffd640 1 -- 172.21.15.33:0/309985736 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd8003f030 con 0x7fbd84076220 2024-09-12T12:21:41.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:21:41.811+0000 7fbd76ffd640 1 -- 172.21.15.33:0/309985736 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbd80003cb0 con 0x7fbd84076220 2024-09-12T12:21:41.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:21:41.811+0000 7fbd8c060640 1 -- 172.21.15.33:0/309985736 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd841a62e0 con 0x7fbd84076220 2024-09-12T12:21:41.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:21:41.811+0000 7fbd76ffd640 1 -- 172.21.15.33:0/309985736 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd80035070 con 0x7fbd84076220 2024-09-12T12:21:41.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:21:41.811+0000 7fbd8c060640 1 -- 172.21.15.33:0/309985736 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd841a67c0 con 0x7fbd84076220 2024-09-12T12:21:41.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:21:41.812+0000 7fbd8c060640 1 -- 172.21.15.33:0/309985736 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd841043c0 con 0x7fbd84076220 2024-09-12T12:21:41.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:21:41.813+0000 7fbd76ffd640 1 -- 172.21.15.33:0/309985736 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fbd80042030 con 0x7fbd84076220 2024-09-12T12:21:41.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:21:41.814+0000 7fbd76ffd640 1 --2- 172.21.15.33:0/309985736 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fbd700a2bb0 0x7fbd700a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:41.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:21:41.814+0000 7fbd89dfc640 1 --2- 172.21.15.33:0/309985736 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fbd700a2bb0 0x7fbd700a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:41.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:21:41.814+0000 7fbd76ffd640 1 -- 172.21.15.33:0/309985736 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5858+0+0 (secure 0 0 0) 0x7fbd800ef360 con 0x7fbd84076220 2024-09-12T12:21:41.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:21:41.815+0000 7fbd89dfc640 1 --2- 172.21.15.33:0/309985736 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fbd700a2bb0 0x7fbd700a5070 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbd78005d00 tx=0x7fbd7800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:41.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:21:41.818+0000 7fbd76ffd640 1 -- 172.21.15.33:0/309985736 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbd800bc560 con 0x7fbd84076220 2024-09-12T12:21:41.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:41 smithi043 ceph-mon[34144]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:21:41.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:41 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:21:41.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:41 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:41.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:41 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:41.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:41 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:41.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:41 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:41.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:41 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:41.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:41 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:41.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:41 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:41.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:41 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:21:41.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:41 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:41.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:41 smithi102 ceph-mon[34799]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:21:41.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:41 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:21:41.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:41 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:41.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:41 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:41.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:41 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:41.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:41 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:41.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:41 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:21:41.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:41 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:41.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:41 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:41.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:41 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:21:41.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:41 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:21:42.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:21:42.004+0000 7fbd8c060640 1 -- 172.21.15.33:0/309985736 --> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fbd84062630 con 0x7fbd700a2bb0 2024-09-12T12:21:42.684 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:42 smithi033 ceph-mon[31246]: purged_snaps scrub starts 2024-09-12T12:21:42.684 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:42 smithi033 ceph-mon[31246]: purged_snaps scrub ok 2024-09-12T12:21:42.684 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:42 smithi033 ceph-mon[31246]: Detected new or changed devices on smithi102 2024-09-12T12:21:42.684 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:42 smithi033 ceph-mon[31246]: Adjusting osd_memory_target on smithi102 to 5696M 2024-09-12T12:21:42.684 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:42 smithi033 ceph-mon[31246]: osd.8 [v2:172.21.15.102:6816/1768219597,v1:172.21.15.102:6817/1768219597] boot 2024-09-12T12:21:42.684 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:42 smithi033 ceph-mon[31246]: osdmap e54: 9 total, 9 up, 9 in 2024-09-12T12:21:42.684 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:42 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:21:42.684 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:42 smithi033 ceph-mon[31246]: osdmap e55: 9 total, 9 up, 9 in 2024-09-12T12:21:42.685 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:42 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:21:42.685 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:42 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:21:42.685 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:42 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:42.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:42 smithi043 ceph-mon[34144]: purged_snaps scrub starts 2024-09-12T12:21:42.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:42 smithi043 ceph-mon[34144]: purged_snaps scrub ok 2024-09-12T12:21:42.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:42 smithi043 ceph-mon[34144]: Detected new or changed devices on smithi102 2024-09-12T12:21:42.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:42 smithi043 ceph-mon[34144]: Adjusting osd_memory_target on smithi102 to 5696M 2024-09-12T12:21:42.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:42 smithi043 ceph-mon[34144]: osd.8 [v2:172.21.15.102:6816/1768219597,v1:172.21.15.102:6817/1768219597] boot 2024-09-12T12:21:42.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:42 smithi043 ceph-mon[34144]: osdmap e54: 9 total, 9 up, 9 in 2024-09-12T12:21:42.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:42 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:21:42.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:42 smithi043 ceph-mon[34144]: osdmap e55: 9 total, 9 up, 9 in 2024-09-12T12:21:42.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:42 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:21:42.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:42 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:21:42.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:42 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:42.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:42 smithi102 ceph-mon[34799]: purged_snaps scrub starts 2024-09-12T12:21:42.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:42 smithi102 ceph-mon[34799]: purged_snaps scrub ok 2024-09-12T12:21:42.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:42 smithi102 ceph-mon[34799]: Detected new or changed devices on smithi102 2024-09-12T12:21:42.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:42 smithi102 ceph-mon[34799]: Adjusting osd_memory_target on smithi102 to 5696M 2024-09-12T12:21:42.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:42 smithi102 ceph-mon[34799]: osd.8 [v2:172.21.15.102:6816/1768219597,v1:172.21.15.102:6817/1768219597] boot 2024-09-12T12:21:42.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:42 smithi102 ceph-mon[34799]: osdmap e54: 9 total, 9 up, 9 in 2024-09-12T12:21:42.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:42 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:21:42.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:42 smithi102 ceph-mon[34799]: osdmap e55: 9 total, 9 up, 9 in 2024-09-12T12:21:42.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:42 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:21:42.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:42 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:21:42.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:42 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:44.121 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:43 smithi043 ceph-mon[34144]: pgmap v187: 1 pgs: 1 peering; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:21:44.121 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:43 smithi043 ceph-mon[34144]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:21:44.121 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:43 smithi043 ceph-mon[34144]: osdmap e56: 9 total, 9 up, 9 in 2024-09-12T12:21:44.124 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:43 smithi033 ceph-mon[31246]: pgmap v187: 1 pgs: 1 peering; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:21:44.124 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:43 smithi033 ceph-mon[31246]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:21:44.124 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:43 smithi033 ceph-mon[31246]: osdmap e56: 9 total, 9 up, 9 in 2024-09-12T12:21:44.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:43 smithi102 ceph-mon[34799]: pgmap v187: 1 pgs: 1 peering; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:21:44.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:43 smithi102 ceph-mon[34799]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:21:44.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:43 smithi102 ceph-mon[34799]: osdmap e56: 9 total, 9 up, 9 in 2024-09-12T12:21:44.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:44 smithi033 ceph-mon[31246]: osdmap e57: 9 total, 9 up, 9 in 2024-09-12T12:21:44.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:44 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/2889808467' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f2500273-8b21-4984-bc41-cec5cc0c883b"}]: dispatch 2024-09-12T12:21:44.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:44 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/2889808467' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f2500273-8b21-4984-bc41-cec5cc0c883b"}]': finished 2024-09-12T12:21:44.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:44 smithi033 ceph-mon[31246]: osdmap e58: 10 total, 9 up, 10 in 2024-09-12T12:21:44.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:44 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:21:45.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:44 smithi043 ceph-mon[34144]: osdmap e57: 9 total, 9 up, 9 in 2024-09-12T12:21:45.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:44 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/2889808467' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f2500273-8b21-4984-bc41-cec5cc0c883b"}]: dispatch 2024-09-12T12:21:45.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:44 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/2889808467' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f2500273-8b21-4984-bc41-cec5cc0c883b"}]': finished 2024-09-12T12:21:45.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:44 smithi043 ceph-mon[34144]: osdmap e58: 10 total, 9 up, 10 in 2024-09-12T12:21:45.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:44 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:21:45.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:44 smithi102 ceph-mon[34799]: osdmap e57: 9 total, 9 up, 9 in 2024-09-12T12:21:45.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:44 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/2889808467' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f2500273-8b21-4984-bc41-cec5cc0c883b"}]: dispatch 2024-09-12T12:21:45.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:44 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/2889808467' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f2500273-8b21-4984-bc41-cec5cc0c883b"}]': finished 2024-09-12T12:21:45.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:44 smithi102 ceph-mon[34799]: osdmap e58: 10 total, 9 up, 10 in 2024-09-12T12:21:45.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:44 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:21:46.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:45 smithi043 ceph-mon[34144]: pgmap v190: 1 pgs: 1 peering; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:21:46.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:45 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/2449822254' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:21:46.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:45 smithi102 ceph-mon[34799]: pgmap v190: 1 pgs: 1 peering; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:21:46.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:45 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/2449822254' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:21:46.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:45 smithi033 ceph-mon[31246]: pgmap v190: 1 pgs: 1 peering; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:21:46.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:45 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/2449822254' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:21:48.117 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:47 smithi043 ceph-mon[34144]: pgmap v192: 1 pgs: 1 peering; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:21:48.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:47 smithi102 ceph-mon[34799]: pgmap v192: 1 pgs: 1 peering; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:21:48.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:47 smithi033 ceph-mon[31246]: pgmap v192: 1 pgs: 1 peering; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:21:50.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:49 smithi043 ceph-mon[34144]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T12:21:50.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:49 smithi102 ceph-mon[34799]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T12:21:50.158 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:49 smithi033 ceph-mon[31246]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T12:21:51.933 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:51 smithi033 ceph-mon[31246]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-12T12:21:52.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:51 smithi043 ceph-mon[34144]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-12T12:21:52.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:51 smithi102 ceph-mon[34799]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-12T12:21:53.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:53 smithi033 ceph-mon[31246]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-12T12:21:53.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:53 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-12T12:21:53.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:53 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:54.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:53 smithi043 ceph-mon[34144]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-12T12:21:54.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:53 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-12T12:21:54.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:53 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:54.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:53 smithi102 ceph-mon[34799]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-12T12:21:54.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:53 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-12T12:21:54.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:53 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:55.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:54 smithi043 ceph-mon[34144]: Deploying daemon osd.9 on smithi033 2024-09-12T12:21:55.127 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:54 smithi033 ceph-mon[31246]: Deploying daemon osd.9 on smithi033 2024-09-12T12:21:55.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:54 smithi102 ceph-mon[34799]: Deploying daemon osd.9 on smithi033 2024-09-12T12:21:56.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:55 smithi043 ceph-mon[34144]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T12:21:56.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:55 smithi102 ceph-mon[34799]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T12:21:56.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:55 smithi033 ceph-mon[31246]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T12:21:58.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:57 smithi043 ceph-mon[34144]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-12T12:21:58.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:57 smithi102 ceph-mon[34799]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-12T12:21:58.210 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:57 smithi033 ceph-mon[31246]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-12T12:21:58.823 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:58 smithi033 ceph-mon[31246]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T12:21:59.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:58 smithi043 ceph-mon[34144]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T12:21:59.149 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:58 smithi102 ceph-mon[34799]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T12:22:00.053 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:59 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:22:00.053 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:59 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:00.053 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:21:59 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:00.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:59 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:22:00.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:59 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:00.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:21:59 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:00.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:59 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:22:00.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:59 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:00.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:21:59 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:01.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:00 smithi043 ceph-mon[34144]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:22:01.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:00 smithi102 ceph-mon[34799]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:22:01.178 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:00 smithi033 ceph-mon[31246]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:22:02.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:02.899+0000 7fbd76ffd640 1 -- 172.21.15.33:0/309985736 <== mgr.14150 v2:172.21.15.33:6800/176202431 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbd84062630 con 0x7fbd700a2bb0 2024-09-12T12:22:02.901 INFO:teuthology.orchestra.run.smithi033.stdout:Created osd(s) 9 on host 'smithi033' 2024-09-12T12:22:02.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:02.902+0000 7fbd8c060640 1 -- 172.21.15.33:0/309985736 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fbd700a2bb0 msgr2=0x7fbd700a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:02.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:02.902+0000 7fbd8c060640 1 --2- 172.21.15.33:0/309985736 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fbd700a2bb0 0x7fbd700a5070 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbd78005d00 tx=0x7fbd7800b410 comp rx=0 tx=0).stop 2024-09-12T12:22:02.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:02.902+0000 7fbd8c060640 1 -- 172.21.15.33:0/309985736 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbd84076220 msgr2=0x7fbd8419e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:02.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:02.902+0000 7fbd8c060640 1 --2- 172.21.15.33:0/309985736 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbd84076220 0x7fbd8419e960 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbd80004770 tx=0x7fbd800042f0 comp rx=0 tx=0).stop 2024-09-12T12:22:02.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:02.902+0000 7fbd8c060640 1 -- 172.21.15.33:0/309985736 shutdown_connections 2024-09-12T12:22:02.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:02.902+0000 7fbd8c060640 1 --2- 172.21.15.33:0/309985736 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fbd700a2bb0 0x7fbd700a5070 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:02.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:02.902+0000 7fbd8c060640 1 --2- 172.21.15.33:0/309985736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd8410e1f0 0x7fbd841a59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:02.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:02.902+0000 7fbd8c060640 1 --2- 172.21.15.33:0/309985736 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbd84076220 0x7fbd8419e960 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:02.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:02.902+0000 7fbd8c060640 1 --2- 172.21.15.33:0/309985736 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd84074c50 0x7fbd8419e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:02.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:02.902+0000 7fbd8c060640 1 -- 172.21.15.33:0/309985736 >> 172.21.15.33:0/309985736 conn(0x7fbd840fd3c0 msgr2=0x7fbd84101590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:02.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:02.902+0000 7fbd8c060640 1 -- 172.21.15.33:0/309985736 shutdown_connections 2024-09-12T12:22:02.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:02.902+0000 7fbd8c060640 1 -- 172.21.15.33:0/309985736 wait complete. 2024-09-12T12:22:03.222 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:02 smithi033 ceph-mon[31246]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:22:03.222 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:02 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:03.222 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:02 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:03.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:02 smithi043 ceph-mon[34144]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:22:03.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:02 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:03.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:02 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:03.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:02 smithi102 ceph-mon[34799]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:22:03.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:02 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:03.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:02 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:03.625 DEBUG:teuthology.orchestra.run.smithi033:osd.9> sudo journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@osd.9.service 2024-09-12T12:22:03.628 INFO:tasks.cephadm:Deploying osd.10 on smithi043 with /dev/vg_nvme/lv_1... 2024-09-12T12:22:03.628 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-12T12:22:03.893 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T12:22:04.909 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:04 smithi033 ceph-mon[31246]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:22:04.910 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:04 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:04.910 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:04 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:05.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:04 smithi102 ceph-mon[34799]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:22:05.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:04 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:05.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:04 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:05.267 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:04 smithi043 ceph-mon[34144]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:22:05.267 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:04 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:05.267 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:04 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:05.791 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:22:05 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:22:05.496+0000 7f118e60c640 -1 osd.9 0 log_to_monitors true 2024-09-12T12:22:06.087 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:05 smithi033 ceph-mon[31246]: from='osd.9 [v2:172.21.15.33:6826/973136168,v1:172.21.15.33:6827/973136168]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T12:22:06.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:05 smithi043 ceph-mon[34144]: from='osd.9 [v2:172.21.15.33:6826/973136168,v1:172.21.15.33:6827/973136168]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T12:22:06.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:05 smithi102 ceph-mon[34799]: from='osd.9 [v2:172.21.15.33:6826/973136168,v1:172.21.15.33:6827/973136168]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T12:22:06.591 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T12:22:06.622 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi043:vg_nvme/lv_1 2024-09-12T12:22:06.896 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T12:22:07.140 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:06 smithi043 ceph-mon[34144]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:22:07.141 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:06 smithi043 ceph-mon[34144]: from='osd.9 [v2:172.21.15.33:6826/973136168,v1:172.21.15.33:6827/973136168]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-12T12:22:07.141 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:06 smithi043 ceph-mon[34144]: osdmap e59: 10 total, 9 up, 10 in 2024-09-12T12:22:07.141 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:06 smithi043 ceph-mon[34144]: from='osd.9 [v2:172.21.15.33:6826/973136168,v1:172.21.15.33:6827/973136168]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-09-12T12:22:07.141 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:06 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:22:07.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:06 smithi102 ceph-mon[34799]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:22:07.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:06 smithi102 ceph-mon[34799]: from='osd.9 [v2:172.21.15.33:6826/973136168,v1:172.21.15.33:6827/973136168]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-12T12:22:07.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:06 smithi102 ceph-mon[34799]: osdmap e59: 10 total, 9 up, 10 in 2024-09-12T12:22:07.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:06 smithi102 ceph-mon[34799]: from='osd.9 [v2:172.21.15.33:6826/973136168,v1:172.21.15.33:6827/973136168]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-09-12T12:22:07.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:06 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:22:07.190 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:22:06 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:22:06.888+0000 7f118a58f640 -1 osd.9 0 waiting for initial osdmap 2024-09-12T12:22:07.190 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:22:06 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:22:06.901+0000 7f11863b7640 -1 osd.9 60 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T12:22:07.191 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:06 smithi033 ceph-mon[31246]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:22:07.191 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:06 smithi033 ceph-mon[31246]: from='osd.9 [v2:172.21.15.33:6826/973136168,v1:172.21.15.33:6827/973136168]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-12T12:22:07.191 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:06 smithi033 ceph-mon[31246]: osdmap e59: 10 total, 9 up, 10 in 2024-09-12T12:22:07.191 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:06 smithi033 ceph-mon[31246]: from='osd.9 [v2:172.21.15.33:6826/973136168,v1:172.21.15.33:6827/973136168]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-09-12T12:22:07.191 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:06 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:22:07.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:07.336+0000 7f962c11e640 1 -- 172.21.15.43:0/1806196095 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9624104ff0 msgr2=0x7f96241073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:07.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:07.336+0000 7f962c11e640 1 --2- 172.21.15.43:0/1806196095 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9624104ff0 0x7f96241073e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9614009900 tx=0x7f961402a410 comp rx=0 tx=0).stop 2024-09-12T12:22:07.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:07.336+0000 7f962c11e640 1 -- 172.21.15.43:0/1806196095 shutdown_connections 2024-09-12T12:22:07.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:07.336+0000 7f962c11e640 1 --2- 172.21.15.43:0/1806196095 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9624107920 0x7f9624109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:07.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:07.336+0000 7f962c11e640 1 --2- 172.21.15.43:0/1806196095 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9624104ff0 0x7f96241073e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:07.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:07.336+0000 7f962c11e640 1 --2- 172.21.15.43:0/1806196095 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f96241026c0 0x7f9624104ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:07.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:07.336+0000 7f962c11e640 1 -- 172.21.15.43:0/1806196095 >> 172.21.15.43:0/1806196095 conn(0x7f96240fc280 msgr2=0x7f96240fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:07.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:07.336+0000 7f962c11e640 1 -- 172.21.15.43:0/1806196095 shutdown_connections 2024-09-12T12:22:07.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:07.336+0000 7f962c11e640 1 -- 172.21.15.43:0/1806196095 wait complete. 2024-09-12T12:22:07.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:07.337+0000 7f962c11e640 1 Processor -- start 2024-09-12T12:22:07.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:07.337+0000 7f962c11e640 1 -- start start 2024-09-12T12:22:07.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:07.337+0000 7f962c11e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96241026c0 0x7f9624102020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:07.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:07.337+0000 7f962c11e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9624104ff0 0x7f9624100670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:07.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:07.337+0000 7f962c11e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9624107920 0x7f9624100bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:07.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:07.337+0000 7f962c11e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f962410d6e0 con 0x7f96241026c0 2024-09-12T12:22:07.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:07.337+0000 7f962c11e640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f962410d560 con 0x7f9624104ff0 2024-09-12T12:22:07.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:07.337+0000 7f962c11e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f962410d860 con 0x7f9624107920 2024-09-12T12:22:07.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:07.337+0000 7f96296b9640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9624104ff0 0x7f9624100670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:07.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:07.337+0000 7f96296b9640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9624104ff0 0x7f9624100670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57650/0 (socket says 172.21.15.43:57650) 2024-09-12T12:22:07.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:07.337+0000 7f96296b9640 1 -- 172.21.15.43:0/2095527457 learned_addr learned my addr 172.21.15.43:0/2095527457 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-12T12:22:07.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:07.337+0000 7f962a6bb640 1 --2- 172.21.15.43:0/2095527457 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9624107920 0x7f9624100bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:07.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:07.337+0000 7f9629eba640 1 --2- 172.21.15.43:0/2095527457 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96241026c0 0x7f9624102020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:07.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:07.338+0000 7f96296b9640 1 -- 172.21.15.43:0/2095527457 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9624107920 msgr2=0x7f9624100bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:07.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:07.338+0000 7f96296b9640 1 --2- 172.21.15.43:0/2095527457 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9624107920 0x7f9624100bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:07.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:07.338+0000 7f96296b9640 1 -- 172.21.15.43:0/2095527457 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96241026c0 msgr2=0x7f9624102020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:07.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:07.338+0000 7f96296b9640 1 --2- 172.21.15.43:0/2095527457 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96241026c0 0x7f9624102020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:07.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:07.338+0000 7f96296b9640 1 -- 172.21.15.43:0/2095527457 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9624101470 con 0x7f9624104ff0 2024-09-12T12:22:07.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:07.338+0000 7f9629eba640 1 --2- 172.21.15.43:0/2095527457 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96241026c0 0x7f9624102020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:22:07.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:07.338+0000 7f96296b9640 1 --2- 172.21.15.43:0/2095527457 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9624104ff0 0x7f9624100670 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9614009230 tx=0x7f9614004340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:07.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:07.338+0000 7f961affd640 1 -- 172.21.15.43:0/2095527457 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f961403f030 con 0x7f9624104ff0 2024-09-12T12:22:07.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:07.338+0000 7f962c11e640 1 -- 172.21.15.43:0/2095527457 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96241a1e90 con 0x7f9624104ff0 2024-09-12T12:22:07.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:07.338+0000 7f961affd640 1 -- 172.21.15.43:0/2095527457 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9614003cb0 con 0x7f9624104ff0 2024-09-12T12:22:07.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:07.338+0000 7f961affd640 1 -- 172.21.15.43:0/2095527457 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9614035070 con 0x7f9624104ff0 2024-09-12T12:22:07.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:07.338+0000 7f962c11e640 1 -- 172.21.15.43:0/2095527457 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96241a2280 con 0x7f9624104ff0 2024-09-12T12:22:07.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:07.339+0000 7f962c11e640 1 -- 172.21.15.43:0/2095527457 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96240fdd70 con 0x7f9624104ff0 2024-09-12T12:22:07.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:07.340+0000 7f961affd640 1 -- 172.21.15.43:0/2095527457 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f9614042030 con 0x7f9624104ff0 2024-09-12T12:22:07.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:07.341+0000 7f961affd640 1 --2- 172.21.15.43:0/2095527457 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f96100a2b80 0x7f96100a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:07.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:07.341+0000 7f961affd640 1 -- 172.21.15.43:0/2095527457 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5981+0+0 (secure 0 0 0) 0x7f96140eedb0 con 0x7f9624104ff0 2024-09-12T12:22:07.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:07.341+0000 7f9629eba640 1 --2- 172.21.15.43:0/2095527457 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f96100a2b80 0x7f96100a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:07.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:07.342+0000 7f9629eba640 1 --2- 172.21.15.43:0/2095527457 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f96100a2b80 0x7f96100a5040 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f962000abe0 tx=0x7f962000a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:07.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:07.345+0000 7f961affd640 1 -- 172.21.15.43:0/2095527457 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f96140bc630 con 0x7f9624104ff0 2024-09-12T12:22:07.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:07.534+0000 7f962c11e640 1 -- 172.21.15.43:0/2095527457 --> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f9624062630 con 0x7f96100a2b80 2024-09-12T12:22:08.043 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:07 smithi102 ceph-mon[34799]: from='osd.9 [v2:172.21.15.33:6826/973136168,v1:172.21.15.33:6827/973136168]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-09-12T12:22:08.043 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:07 smithi102 ceph-mon[34799]: osdmap e60: 10 total, 9 up, 10 in 2024-09-12T12:22:08.043 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:07 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:22:08.043 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:07 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:22:08.043 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:07 smithi102 ceph-mon[34799]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:22:08.043 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:07 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:22:08.043 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:07 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:22:08.043 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:07 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:08.043 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:07 smithi102 ceph-mon[34799]: Detected new or changed devices on smithi033 2024-09-12T12:22:08.043 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:07 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:08.044 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:07 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:08.044 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:07 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:22:08.044 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:07 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:22:08.044 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:07 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:22:08.044 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:07 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:22:08.044 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:07 smithi102 ceph-mon[34799]: Adjusting osd_memory_target on smithi033 to 4273M 2024-09-12T12:22:08.044 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:07 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:08.044 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:07 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:08.044 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:07 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:22:08.044 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:07 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:08.044 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:07 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:22:08.044 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:07 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:08.044 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:07 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:22:08.045 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:07 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:08.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:07 smithi033 ceph-mon[31246]: from='osd.9 [v2:172.21.15.33:6826/973136168,v1:172.21.15.33:6827/973136168]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-09-12T12:22:08.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:07 smithi033 ceph-mon[31246]: osdmap e60: 10 total, 9 up, 10 in 2024-09-12T12:22:08.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:07 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:22:08.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:07 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:22:08.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:07 smithi033 ceph-mon[31246]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:22:08.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:07 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:22:08.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:07 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:22:08.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:07 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:08.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:07 smithi033 ceph-mon[31246]: Detected new or changed devices on smithi033 2024-09-12T12:22:08.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:07 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:08.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:07 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:08.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:07 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:22:08.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:07 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:22:08.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:07 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:22:08.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:07 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:22:08.233 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:07 smithi033 ceph-mon[31246]: Adjusting osd_memory_target on smithi033 to 4273M 2024-09-12T12:22:08.233 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:07 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:08.233 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:07 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:08.233 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:07 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:22:08.233 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:07 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:08.233 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:07 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:22:08.233 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:07 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:08.233 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:07 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:22:08.233 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:07 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:08.236 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:07 smithi043 ceph-mon[34144]: from='osd.9 [v2:172.21.15.33:6826/973136168,v1:172.21.15.33:6827/973136168]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-09-12T12:22:08.236 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:07 smithi043 ceph-mon[34144]: osdmap e60: 10 total, 9 up, 10 in 2024-09-12T12:22:08.237 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:07 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:22:08.237 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:07 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:22:08.237 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:07 smithi043 ceph-mon[34144]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:22:08.237 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:07 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:22:08.237 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:07 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:22:08.237 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:07 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:08.237 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:07 smithi043 ceph-mon[34144]: Detected new or changed devices on smithi033 2024-09-12T12:22:08.237 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:07 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:08.237 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:07 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:08.237 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:07 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:22:08.237 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:07 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:22:08.238 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:07 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:22:08.238 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:07 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:22:08.238 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:07 smithi043 ceph-mon[34144]: Adjusting osd_memory_target on smithi033 to 4273M 2024-09-12T12:22:08.238 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:07 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:08.238 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:07 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:08.238 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:07 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:22:08.238 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:07 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:08.238 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:07 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:22:08.238 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:07 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:08.238 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:07 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:22:08.238 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:07 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:09.084 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:08 smithi043 ceph-mon[34144]: purged_snaps scrub starts 2024-09-12T12:22:09.085 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:08 smithi043 ceph-mon[34144]: purged_snaps scrub ok 2024-09-12T12:22:09.085 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:08 smithi043 ceph-mon[34144]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:22:09.085 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:08 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:22:09.085 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:08 smithi043 ceph-mon[34144]: osd.9 [v2:172.21.15.33:6826/973136168,v1:172.21.15.33:6827/973136168] boot 2024-09-12T12:22:09.085 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:08 smithi043 ceph-mon[34144]: osdmap e61: 10 total, 10 up, 10 in 2024-09-12T12:22:09.085 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:08 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:22:09.154 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:08 smithi033 ceph-mon[31246]: purged_snaps scrub starts 2024-09-12T12:22:09.154 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:08 smithi033 ceph-mon[31246]: purged_snaps scrub ok 2024-09-12T12:22:09.155 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:08 smithi033 ceph-mon[31246]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:22:09.155 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:08 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:22:09.155 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:08 smithi033 ceph-mon[31246]: osd.9 [v2:172.21.15.33:6826/973136168,v1:172.21.15.33:6827/973136168] boot 2024-09-12T12:22:09.155 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:08 smithi033 ceph-mon[31246]: osdmap e61: 10 total, 10 up, 10 in 2024-09-12T12:22:09.155 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:08 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:22:09.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:08 smithi102 ceph-mon[34799]: purged_snaps scrub starts 2024-09-12T12:22:09.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:08 smithi102 ceph-mon[34799]: purged_snaps scrub ok 2024-09-12T12:22:09.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:08 smithi102 ceph-mon[34799]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:22:09.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:08 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:22:09.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:08 smithi102 ceph-mon[34799]: osd.9 [v2:172.21.15.33:6826/973136168,v1:172.21.15.33:6827/973136168] boot 2024-09-12T12:22:09.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:08 smithi102 ceph-mon[34799]: osdmap e61: 10 total, 10 up, 10 in 2024-09-12T12:22:09.397 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:08 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:22:10.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:09 smithi043 ceph-mon[34144]: osdmap e62: 10 total, 10 up, 10 in 2024-09-12T12:22:10.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:09 smithi033 ceph-mon[31246]: osdmap e62: 10 total, 10 up, 10 in 2024-09-12T12:22:10.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:09 smithi102 ceph-mon[34799]: osdmap e62: 10 total, 10 up, 10 in 2024-09-12T12:22:11.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:10 smithi043 ceph-mon[34144]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:22:11.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:10 smithi043 ceph-mon[34144]: from='client.? 172.21.15.43:0/3697913573' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "954343c5-5d5b-4c30-acde-82aa695f7b04"}]: dispatch 2024-09-12T12:22:11.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:10 smithi043 ceph-mon[34144]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "954343c5-5d5b-4c30-acde-82aa695f7b04"}]: dispatch 2024-09-12T12:22:11.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:10 smithi043 ceph-mon[34144]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "954343c5-5d5b-4c30-acde-82aa695f7b04"}]': finished 2024-09-12T12:22:11.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:10 smithi043 ceph-mon[34144]: osdmap e63: 11 total, 10 up, 11 in 2024-09-12T12:22:11.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:10 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:22:11.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:10 smithi043 ceph-mon[34144]: from='client.? 172.21.15.43:0/1175920642' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:22:11.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:10 smithi033 ceph-mon[31246]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:22:11.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:10 smithi033 ceph-mon[31246]: from='client.? 172.21.15.43:0/3697913573' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "954343c5-5d5b-4c30-acde-82aa695f7b04"}]: dispatch 2024-09-12T12:22:11.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:10 smithi033 ceph-mon[31246]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "954343c5-5d5b-4c30-acde-82aa695f7b04"}]: dispatch 2024-09-12T12:22:11.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:10 smithi033 ceph-mon[31246]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "954343c5-5d5b-4c30-acde-82aa695f7b04"}]': finished 2024-09-12T12:22:11.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:10 smithi033 ceph-mon[31246]: osdmap e63: 11 total, 10 up, 11 in 2024-09-12T12:22:11.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:10 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:22:11.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:10 smithi033 ceph-mon[31246]: from='client.? 172.21.15.43:0/1175920642' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:22:11.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:10 smithi102 ceph-mon[34799]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:22:11.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:10 smithi102 ceph-mon[34799]: from='client.? 172.21.15.43:0/3697913573' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "954343c5-5d5b-4c30-acde-82aa695f7b04"}]: dispatch 2024-09-12T12:22:11.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:10 smithi102 ceph-mon[34799]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "954343c5-5d5b-4c30-acde-82aa695f7b04"}]: dispatch 2024-09-12T12:22:11.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:10 smithi102 ceph-mon[34799]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "954343c5-5d5b-4c30-acde-82aa695f7b04"}]': finished 2024-09-12T12:22:11.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:10 smithi102 ceph-mon[34799]: osdmap e63: 11 total, 10 up, 11 in 2024-09-12T12:22:11.397 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:10 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:22:11.397 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:10 smithi102 ceph-mon[34799]: from='client.? 172.21.15.43:0/1175920642' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:22:13.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:12 smithi033 ceph-mon[31246]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:22:13.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:12 smithi043 ceph-mon[34144]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:22:13.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:12 smithi102 ceph-mon[34799]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:22:15.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:14 smithi033 ceph-mon[31246]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:22:15.288 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:14 smithi043 ceph-mon[34144]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:22:15.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:14 smithi102 ceph-mon[34799]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:22:17.052 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:16 smithi043 ceph-mon[34144]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:22:17.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:16 smithi033 ceph-mon[31246]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:22:17.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:16 smithi102 ceph-mon[34799]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:22:19.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:18 smithi043 ceph-mon[34144]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:22:19.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:18 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-12T12:22:19.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:18 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:19.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:18 smithi033 ceph-mon[31246]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:22:19.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:18 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-12T12:22:19.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:18 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:19.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:18 smithi102 ceph-mon[34799]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:22:19.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:18 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-12T12:22:19.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:18 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:20.060 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:19 smithi043 ceph-mon[34144]: Deploying daemon osd.10 on smithi043 2024-09-12T12:22:20.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:19 smithi033 ceph-mon[31246]: Deploying daemon osd.10 on smithi043 2024-09-12T12:22:20.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:19 smithi102 ceph-mon[34799]: Deploying daemon osd.10 on smithi043 2024-09-12T12:22:21.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:20 smithi033 ceph-mon[31246]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:22:21.235 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:20 smithi043 ceph-mon[34144]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:22:21.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:20 smithi102 ceph-mon[34799]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:22:23.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:22 smithi033 ceph-mon[31246]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:22:23.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:22 smithi043 ceph-mon[34144]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:22:23.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:22 smithi102 ceph-mon[34799]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:22:25.208 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:24 smithi043 ceph-mon[34144]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:22:25.208 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:24 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:22:25.208 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:24 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:25.208 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:24 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:25.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:24 smithi033 ceph-mon[31246]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:22:25.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:24 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:22:25.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:24 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:25.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:24 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:25.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:24 smithi102 ceph-mon[34799]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:22:25.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:24 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:22:25.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:24 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:25.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:24 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:27.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:26 smithi043 ceph-mon[34144]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:22:27.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:26 smithi033 ceph-mon[31246]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:22:27.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:26 smithi102 ceph-mon[34799]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:22:28.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:28.211+0000 7f961affd640 1 -- 172.21.15.43:0/2095527457 <== mgr.14150 v2:172.21.15.33:6800/176202431 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f9624062630 con 0x7f96100a2b80 2024-09-12T12:22:28.212 INFO:teuthology.orchestra.run.smithi043.stdout:Created osd(s) 10 on host 'smithi043' 2024-09-12T12:22:28.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:28.213+0000 7f962c11e640 1 -- 172.21.15.43:0/2095527457 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f96100a2b80 msgr2=0x7f96100a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:28.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:28.213+0000 7f962c11e640 1 --2- 172.21.15.43:0/2095527457 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f96100a2b80 0x7f96100a5040 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f962000abe0 tx=0x7f962000a5c0 comp rx=0 tx=0).stop 2024-09-12T12:22:28.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:28.213+0000 7f962c11e640 1 -- 172.21.15.43:0/2095527457 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9624104ff0 msgr2=0x7f9624100670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:28.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:28.213+0000 7f962c11e640 1 --2- 172.21.15.43:0/2095527457 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9624104ff0 0x7f9624100670 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9614009230 tx=0x7f9614004340 comp rx=0 tx=0).stop 2024-09-12T12:22:28.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:28.214+0000 7f962c11e640 1 -- 172.21.15.43:0/2095527457 shutdown_connections 2024-09-12T12:22:28.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:28.214+0000 7f962c11e640 1 --2- 172.21.15.43:0/2095527457 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f96100a2b80 0x7f96100a5040 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:28.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:28.214+0000 7f962c11e640 1 --2- 172.21.15.43:0/2095527457 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9624107920 0x7f9624100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:28.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:28.214+0000 7f962c11e640 1 --2- 172.21.15.43:0/2095527457 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9624104ff0 0x7f9624100670 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:28.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:28.214+0000 7f962c11e640 1 --2- 172.21.15.43:0/2095527457 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96241026c0 0x7f9624102020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:28.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:28.214+0000 7f962c11e640 1 -- 172.21.15.43:0/2095527457 >> 172.21.15.43:0/2095527457 conn(0x7f96240fc280 msgr2=0x7f9624102f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:28.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:28.214+0000 7f962c11e640 1 -- 172.21.15.43:0/2095527457 shutdown_connections 2024-09-12T12:22:28.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T12:22:28.214+0000 7f962c11e640 1 -- 172.21.15.43:0/2095527457 wait complete. 2024-09-12T12:22:28.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:28 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:28.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:28 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:28.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:28 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:28.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:28 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:22:28.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:28 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:28.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:28 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:22:28.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:28 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:28.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:28 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:28.817 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:28 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:28.817 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:28 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:28.817 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:28 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:28.817 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:28 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:22:28.817 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:28 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:28.817 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:28 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:22:28.817 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:28 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:28.817 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:28 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:28.845 DEBUG:teuthology.orchestra.run.smithi043:osd.10> sudo journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@osd.10.service 2024-09-12T12:22:28.848 INFO:tasks.cephadm:Deploying osd.11 on smithi102 with /dev/vg_nvme/lv_1... 2024-09-12T12:22:28.848 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-12T12:22:28.875 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:28 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:28.875 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:28 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:28.875 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:28 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:28.875 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:28 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:22:28.875 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:28 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:28.876 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:28 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:22:28.876 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:28 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:28.876 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:28 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:29.100 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:22:29.758 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:29 smithi043 ceph-mon[34144]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:22:29.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:29 smithi102 ceph-mon[34799]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:22:29.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:29 smithi033 ceph-mon[31246]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:22:31.094 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:22:30 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:22:30.777+0000 7f1a6788e640 -1 osd.10 0 log_to_monitors true 2024-09-12T12:22:31.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:31 smithi102 ceph-mon[34799]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:22:31.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:31 smithi102 ceph-mon[34799]: from='osd.10 [v2:172.21.15.43:6824/248515585,v1:172.21.15.43:6825/248515585]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T12:22:31.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:31 smithi102 ceph-mon[34799]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T12:22:31.704 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T12:22:31.717 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:31 smithi043 ceph-mon[34144]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:22:31.717 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:31 smithi043 ceph-mon[34144]: from='osd.10 [v2:172.21.15.43:6824/248515585,v1:172.21.15.43:6825/248515585]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T12:22:31.717 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:31 smithi043 ceph-mon[34144]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T12:22:31.731 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi102:vg_nvme/lv_1 2024-09-12T12:22:31.980 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:31 smithi033 ceph-mon[31246]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:22:31.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:31 smithi033 ceph-mon[31246]: from='osd.10 [v2:172.21.15.43:6824/248515585,v1:172.21.15.43:6825/248515585]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T12:22:31.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:31 smithi033 ceph-mon[31246]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T12:22:32.040 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:22:32.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:32.546+0000 7f9ffd051640 1 -- 172.21.15.102:0/636105905 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ff81037c0 msgr2=0x7f9ff810a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:32.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:32.546+0000 7f9ffd051640 1 --2- 172.21.15.102:0/636105905 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ff81037c0 0x7f9ff810a050 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0009ca0 tx=0x7f9ff002a8c0 comp rx=0 tx=0).stop 2024-09-12T12:22:32.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:32.546+0000 7f9ffd051640 1 -- 172.21.15.102:0/636105905 shutdown_connections 2024-09-12T12:22:32.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:32.546+0000 7f9ffd051640 1 --2- 172.21.15.102:0/636105905 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ff81037c0 0x7f9ff810a050 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:32.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:32.546+0000 7f9ffd051640 1 --2- 172.21.15.102:0/636105905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ff8102e00 0x7f9ff8103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:32.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:32.546+0000 7f9ffd051640 1 --2- 172.21.15.102:0/636105905 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ff8101c00 0x7f9ff8102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:32.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:32.546+0000 7f9ffd051640 1 -- 172.21.15.102:0/636105905 >> 172.21.15.102:0/636105905 conn(0x7f9ff80fd390 msgr2=0x7f9ff80ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:32.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:32.546+0000 7f9ffd051640 1 -- 172.21.15.102:0/636105905 shutdown_connections 2024-09-12T12:22:32.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:32.546+0000 7f9ffd051640 1 -- 172.21.15.102:0/636105905 wait complete. 2024-09-12T12:22:32.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:32.547+0000 7f9ffd051640 1 Processor -- start 2024-09-12T12:22:32.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:32.547+0000 7f9ffd051640 1 -- start start 2024-09-12T12:22:32.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:32.547+0000 7f9ffd051640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ff8101c00 0x7f9ff8075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:32.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:32.547+0000 7f9ffd051640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ff8102e00 0x7f9ff80745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:32.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:32.547+0000 7f9ffd051640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ff81037c0 0x7f9ff8074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:32.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:32.547+0000 7f9ffd051640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff810d7b0 con 0x7f9ff81037c0 2024-09-12T12:22:32.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:32.547+0000 7f9ffd051640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff810d630 con 0x7f9ff8102e00 2024-09-12T12:22:32.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:32.547+0000 7f9ffd051640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff810d930 con 0x7f9ff8101c00 2024-09-12T12:22:32.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:32.547+0000 7f9ff6d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ff8101c00 0x7f9ff8075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:32.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:32.547+0000 7f9ff6d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ff8101c00 0x7f9ff8075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47652/0 (socket says 172.21.15.102:47652) 2024-09-12T12:22:32.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:32.547+0000 7f9ff6d9d640 1 -- 172.21.15.102:0/1821019209 learned_addr learned my addr 172.21.15.102:0/1821019209 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-12T12:22:32.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:32.547+0000 7f9ff759e640 1 --2- 172.21.15.102:0/1821019209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ff81037c0 0x7f9ff8074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:32.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:32.547+0000 7f9ff659c640 1 --2- 172.21.15.102:0/1821019209 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ff8102e00 0x7f9ff80745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:32.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:32.547+0000 7f9ff6d9d640 1 -- 172.21.15.102:0/1821019209 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ff8102e00 msgr2=0x7f9ff80745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:32.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:32.547+0000 7f9ff6d9d640 1 --2- 172.21.15.102:0/1821019209 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ff8102e00 0x7f9ff80745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:32.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:32.547+0000 7f9ff6d9d640 1 -- 172.21.15.102:0/1821019209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ff81037c0 msgr2=0x7f9ff8074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:32.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:32.547+0000 7f9ff6d9d640 1 --2- 172.21.15.102:0/1821019209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ff81037c0 0x7f9ff8074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:32.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:32.547+0000 7f9ff6d9d640 1 -- 172.21.15.102:0/1821019209 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ff80753e0 con 0x7f9ff8101c00 2024-09-12T12:22:32.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:32.547+0000 7f9ff759e640 1 --2- 172.21.15.102:0/1821019209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ff81037c0 0x7f9ff8074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:22:32.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:32.547+0000 7f9ff659c640 1 --2- 172.21.15.102:0/1821019209 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ff8102e00 0x7f9ff80745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:22:32.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:32.548+0000 7f9ff6d9d640 1 --2- 172.21.15.102:0/1821019209 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ff8101c00 0x7f9ff8075f90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9fe800d950 tx=0x7f9fe800de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:32.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:32.548+0000 7f9fdffff640 1 -- 172.21.15.102:0/1821019209 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe8017070 con 0x7f9ff8101c00 2024-09-12T12:22:32.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:32.548+0000 7f9fdffff640 1 -- 172.21.15.102:0/1821019209 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9fe8009c30 con 0x7f9ff8101c00 2024-09-12T12:22:32.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:32.548+0000 7f9ffd051640 1 -- 172.21.15.102:0/1821019209 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ff81a1fd0 con 0x7f9ff8101c00 2024-09-12T12:22:32.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:32.548+0000 7f9fdffff640 1 -- 172.21.15.102:0/1821019209 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe800f620 con 0x7f9ff8101c00 2024-09-12T12:22:32.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:32.548+0000 7f9ffd051640 1 -- 172.21.15.102:0/1821019209 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ff81a2370 con 0x7f9ff8101c00 2024-09-12T12:22:32.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:32.549+0000 7f9ffd051640 1 -- 172.21.15.102:0/1821019209 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ff8109070 con 0x7f9ff8101c00 2024-09-12T12:22:32.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:32.550+0000 7f9fdffff640 1 -- 172.21.15.102:0/1821019209 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f9fe801a070 con 0x7f9ff8101c00 2024-09-12T12:22:32.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:32.550+0000 7f9fdffff640 1 --2- 172.21.15.102:0/1821019209 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f9fe00a2b80 0x7f9fe00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:32.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:32.551+0000 7f9fdffff640 1 -- 172.21.15.102:0/1821019209 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6414+0+0 (secure 0 0 0) 0x7f9fe80ce3c0 con 0x7f9ff8101c00 2024-09-12T12:22:32.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:32.551+0000 7f9ff659c640 1 --2- 172.21.15.102:0/1821019209 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f9fe00a2b80 0x7f9fe00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:32.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:32.551+0000 7f9ff659c640 1 --2- 172.21.15.102:0/1821019209 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f9fe00a2b80 0x7f9fe00a5040 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8075d10 tx=0x7f9fec008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:32.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:32.554+0000 7f9fdffff640 1 -- 172.21.15.102:0/1821019209 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9fe8009de0 con 0x7f9ff8101c00 2024-09-12T12:22:32.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:32.728+0000 7f9ffd051640 1 -- 172.21.15.102:0/1821019209 --> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f9ff8062630 con 0x7f9fe00a2b80 2024-09-12T12:22:32.729 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:32 smithi102 ceph-mon[34799]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-12T12:22:32.730 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:32 smithi102 ceph-mon[34799]: from='osd.10 [v2:172.21.15.43:6824/248515585,v1:172.21.15.43:6825/248515585]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-09-12T12:22:32.730 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:32 smithi102 ceph-mon[34799]: osdmap e64: 11 total, 10 up, 11 in 2024-09-12T12:22:32.730 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:32 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:22:32.730 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:32 smithi102 ceph-mon[34799]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-09-12T12:22:32.730 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:32 smithi102 ceph-mon[34799]: Detected new or changed devices on smithi043 2024-09-12T12:22:32.730 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:32 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:32.730 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:32 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:32.730 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:32 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:22:32.730 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:32 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:22:32.730 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:32 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:22:32.730 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:32 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:22:32.730 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:32 smithi102 ceph-mon[34799]: Adjusting osd_memory_target on smithi043 to 4273M 2024-09-12T12:22:32.730 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:32 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:32.731 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:32 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:32.731 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:32 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:22:32.731 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:32 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:32.865 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:22:32 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:22:32.512+0000 7f1a63811640 -1 osd.10 0 waiting for initial osdmap 2024-09-12T12:22:32.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:22:32 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:22:32.525+0000 7f1a5f639640 -1 osd.10 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T12:22:32.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:32 smithi043 ceph-mon[34144]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-12T12:22:32.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:32 smithi043 ceph-mon[34144]: from='osd.10 [v2:172.21.15.43:6824/248515585,v1:172.21.15.43:6825/248515585]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-09-12T12:22:32.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:32 smithi043 ceph-mon[34144]: osdmap e64: 11 total, 10 up, 11 in 2024-09-12T12:22:32.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:32 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:22:32.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:32 smithi043 ceph-mon[34144]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-09-12T12:22:32.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:32 smithi043 ceph-mon[34144]: Detected new or changed devices on smithi043 2024-09-12T12:22:32.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:32 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:32.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:32 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:32.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:32 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:22:32.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:32 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:22:32.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:32 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:22:32.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:32 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:22:32.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:32 smithi043 ceph-mon[34144]: Adjusting osd_memory_target on smithi043 to 4273M 2024-09-12T12:22:32.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:32 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:32.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:32 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:32.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:32 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:22:32.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:32 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:32.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:32 smithi033 ceph-mon[31246]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-12T12:22:32.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:32 smithi033 ceph-mon[31246]: from='osd.10 [v2:172.21.15.43:6824/248515585,v1:172.21.15.43:6825/248515585]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-09-12T12:22:32.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:32 smithi033 ceph-mon[31246]: osdmap e64: 11 total, 10 up, 11 in 2024-09-12T12:22:32.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:32 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:22:32.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:32 smithi033 ceph-mon[31246]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-09-12T12:22:32.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:32 smithi033 ceph-mon[31246]: Detected new or changed devices on smithi043 2024-09-12T12:22:32.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:32 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:32.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:32 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:32.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:32 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:22:32.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:32 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:22:32.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:32 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:22:32.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:32 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:22:32.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:32 smithi033 ceph-mon[31246]: Adjusting osd_memory_target on smithi043 to 4273M 2024-09-12T12:22:32.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:32 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:32.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:32 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:32.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:32 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:22:32.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:32 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:33.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:33 smithi043 ceph-mon[34144]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:22:33.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:33 smithi043 ceph-mon[34144]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-09-12T12:22:33.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:33 smithi043 ceph-mon[34144]: osdmap e65: 11 total, 10 up, 11 in 2024-09-12T12:22:33.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:33 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:22:33.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:33 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:22:33.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:33 smithi043 ceph-mon[34144]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:22:33.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:33 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:22:33.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:33 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:22:33.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:33 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:33.895 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:33 smithi102 ceph-mon[34799]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:22:33.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:33 smithi102 ceph-mon[34799]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-09-12T12:22:33.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:33 smithi102 ceph-mon[34799]: osdmap e65: 11 total, 10 up, 11 in 2024-09-12T12:22:33.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:33 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:22:33.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:33 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:22:33.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:33 smithi102 ceph-mon[34799]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:22:33.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:33 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:22:33.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:33 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:22:33.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:33 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:33.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:33 smithi033 ceph-mon[31246]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:22:33.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:33 smithi033 ceph-mon[31246]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-09-12T12:22:33.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:33 smithi033 ceph-mon[31246]: osdmap e65: 11 total, 10 up, 11 in 2024-09-12T12:22:33.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:33 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:22:33.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:33 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:22:33.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:33 smithi033 ceph-mon[31246]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:22:33.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:33 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:22:33.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:33 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:22:33.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:33 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:34.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:34 smithi043 ceph-mon[34144]: purged_snaps scrub starts 2024-09-12T12:22:34.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:34 smithi043 ceph-mon[34144]: purged_snaps scrub ok 2024-09-12T12:22:34.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:34 smithi043 ceph-mon[34144]: osd.10 [v2:172.21.15.43:6824/248515585,v1:172.21.15.43:6825/248515585] boot 2024-09-12T12:22:34.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:34 smithi043 ceph-mon[34144]: osdmap e66: 11 total, 11 up, 11 in 2024-09-12T12:22:34.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:34 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:22:34.866 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:34 smithi102 ceph-mon[34799]: purged_snaps scrub starts 2024-09-12T12:22:34.866 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:34 smithi102 ceph-mon[34799]: purged_snaps scrub ok 2024-09-12T12:22:34.866 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:34 smithi102 ceph-mon[34799]: osd.10 [v2:172.21.15.43:6824/248515585,v1:172.21.15.43:6825/248515585] boot 2024-09-12T12:22:34.866 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:34 smithi102 ceph-mon[34799]: osdmap e66: 11 total, 11 up, 11 in 2024-09-12T12:22:34.866 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:34 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:22:34.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:34 smithi033 ceph-mon[31246]: purged_snaps scrub starts 2024-09-12T12:22:34.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:34 smithi033 ceph-mon[31246]: purged_snaps scrub ok 2024-09-12T12:22:34.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:34 smithi033 ceph-mon[31246]: osd.10 [v2:172.21.15.43:6824/248515585,v1:172.21.15.43:6825/248515585] boot 2024-09-12T12:22:34.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:34 smithi033 ceph-mon[31246]: osdmap e66: 11 total, 11 up, 11 in 2024-09-12T12:22:34.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:34 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:22:35.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:35 smithi102 ceph-mon[34799]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:22:35.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:35 smithi102 ceph-mon[34799]: osdmap e67: 11 total, 11 up, 11 in 2024-09-12T12:22:35.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:35 smithi102 ceph-mon[34799]: from='client.? 172.21.15.102:0/883335179' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "22b4147b-02ad-4514-be17-5bb395099eef"}]: dispatch 2024-09-12T12:22:35.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:35 smithi102 ceph-mon[34799]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "22b4147b-02ad-4514-be17-5bb395099eef"}]: dispatch 2024-09-12T12:22:35.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:35 smithi102 ceph-mon[34799]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "22b4147b-02ad-4514-be17-5bb395099eef"}]': finished 2024-09-12T12:22:35.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:35 smithi102 ceph-mon[34799]: osdmap e68: 12 total, 11 up, 12 in 2024-09-12T12:22:35.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:35 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:22:35.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:35 smithi043 ceph-mon[34144]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:22:35.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:35 smithi043 ceph-mon[34144]: osdmap e67: 11 total, 11 up, 11 in 2024-09-12T12:22:35.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:35 smithi043 ceph-mon[34144]: from='client.? 172.21.15.102:0/883335179' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "22b4147b-02ad-4514-be17-5bb395099eef"}]: dispatch 2024-09-12T12:22:35.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:35 smithi043 ceph-mon[34144]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "22b4147b-02ad-4514-be17-5bb395099eef"}]: dispatch 2024-09-12T12:22:35.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:35 smithi043 ceph-mon[34144]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "22b4147b-02ad-4514-be17-5bb395099eef"}]': finished 2024-09-12T12:22:35.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:35 smithi043 ceph-mon[34144]: osdmap e68: 12 total, 11 up, 12 in 2024-09-12T12:22:35.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:35 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:22:35.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:35 smithi033 ceph-mon[31246]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:22:35.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:35 smithi033 ceph-mon[31246]: osdmap e67: 11 total, 11 up, 11 in 2024-09-12T12:22:35.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:35 smithi033 ceph-mon[31246]: from='client.? 172.21.15.102:0/883335179' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "22b4147b-02ad-4514-be17-5bb395099eef"}]: dispatch 2024-09-12T12:22:35.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:35 smithi033 ceph-mon[31246]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "22b4147b-02ad-4514-be17-5bb395099eef"}]: dispatch 2024-09-12T12:22:35.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:35 smithi033 ceph-mon[31246]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "22b4147b-02ad-4514-be17-5bb395099eef"}]': finished 2024-09-12T12:22:35.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:35 smithi033 ceph-mon[31246]: osdmap e68: 12 total, 11 up, 12 in 2024-09-12T12:22:35.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:35 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:22:36.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:36 smithi043 ceph-mon[34144]: from='client.? 172.21.15.102:0/4041621096' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:22:36.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:36 smithi102 ceph-mon[34799]: from='client.? 172.21.15.102:0/4041621096' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:22:36.980 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:36 smithi033 ceph-mon[31246]: from='client.? 172.21.15.102:0/4041621096' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:22:37.797 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:37 smithi102 ceph-mon[34799]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:22:37.798 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:37 smithi102 ceph-mon[34799]: osdmap e69: 12 total, 11 up, 12 in 2024-09-12T12:22:37.798 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:37 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:22:37.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:37 smithi043 ceph-mon[34144]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:22:37.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:37 smithi043 ceph-mon[34144]: osdmap e69: 12 total, 11 up, 12 in 2024-09-12T12:22:37.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:37 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:22:37.980 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:37 smithi033 ceph-mon[31246]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:22:37.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:37 smithi033 ceph-mon[31246]: osdmap e69: 12 total, 11 up, 12 in 2024-09-12T12:22:37.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:37 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:22:38.807 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:38 smithi102 ceph-mon[34799]: osdmap e70: 12 total, 11 up, 12 in 2024-09-12T12:22:38.807 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:38 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:22:38.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:38 smithi043 ceph-mon[34144]: osdmap e70: 12 total, 11 up, 12 in 2024-09-12T12:22:38.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:38 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:22:38.980 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:38 smithi033 ceph-mon[31246]: osdmap e70: 12 total, 11 up, 12 in 2024-09-12T12:22:38.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:38 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:22:39.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:39 smithi043 ceph-mon[34144]: pgmap v230: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T12:22:39.882 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:39 smithi033 ceph-mon[31246]: pgmap v230: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T12:22:39.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:39 smithi102 ceph-mon[34799]: pgmap v230: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T12:22:41.844 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:41 smithi102 ceph-mon[34799]: pgmap v231: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-09-12T12:22:41.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:41 smithi043 ceph-mon[34144]: pgmap v231: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-09-12T12:22:41.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:41 smithi033 ceph-mon[31246]: pgmap v231: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-09-12T12:22:43.868 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:43 smithi043 ceph-mon[34144]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-09-12T12:22:43.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:43 smithi102 ceph-mon[34799]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-09-12T12:22:43.980 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:43 smithi033 ceph-mon[31246]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-09-12T12:22:44.839 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:44 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-12T12:22:44.839 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:44 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:44.839 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:44 smithi102 ceph-mon[34799]: Deploying daemon osd.11 on smithi102 2024-09-12T12:22:44.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:44 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-12T12:22:44.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:44 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:44.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:44 smithi043 ceph-mon[34144]: Deploying daemon osd.11 on smithi102 2024-09-12T12:22:44.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:44 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-12T12:22:44.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:44 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:44.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:44 smithi033 ceph-mon[31246]: Deploying daemon osd.11 on smithi102 2024-09-12T12:22:45.767 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:45 smithi102 ceph-mon[34799]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T12:22:45.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:45 smithi043 ceph-mon[34144]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T12:22:45.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:45 smithi033 ceph-mon[31246]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T12:22:47.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:47 smithi043 ceph-mon[34144]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:22:47.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:47 smithi102 ceph-mon[34799]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:22:47.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:47 smithi033 ceph-mon[31246]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:22:49.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:49 smithi102 ceph-mon[34799]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:22:49.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:49 smithi043 ceph-mon[34144]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:22:49.980 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:49 smithi033 ceph-mon[31246]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:22:50.786 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:50 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:22:50.786 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:50 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:50.786 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:50 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:50.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:50 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:22:50.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:50 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:50.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:50 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:50.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:50 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:22:50.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:50 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:50.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:50 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:51.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:51 smithi102 ceph-mon[34799]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:22:51.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:51 smithi033 ceph-mon[31246]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:22:52.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:51 smithi043 ceph-mon[34144]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:22:53.373 INFO:teuthology.orchestra.run.smithi102.stdout:Created osd(s) 11 on host 'smithi102' 2024-09-12T12:22:53.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:53.373+0000 7f9fdffff640 1 -- 172.21.15.102:0/1821019209 <== mgr.14150 v2:172.21.15.33:6800/176202431 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f9ff8062630 con 0x7f9fe00a2b80 2024-09-12T12:22:53.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:53.376+0000 7f9ffd051640 1 -- 172.21.15.102:0/1821019209 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f9fe00a2b80 msgr2=0x7f9fe00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:53.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:53.376+0000 7f9ffd051640 1 --2- 172.21.15.102:0/1821019209 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f9fe00a2b80 0x7f9fe00a5040 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8075d10 tx=0x7f9fec008040 comp rx=0 tx=0).stop 2024-09-12T12:22:53.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:53.376+0000 7f9ffd051640 1 -- 172.21.15.102:0/1821019209 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ff8101c00 msgr2=0x7f9ff8075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:53.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:53.376+0000 7f9ffd051640 1 --2- 172.21.15.102:0/1821019209 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ff8101c00 0x7f9ff8075f90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9fe800d950 tx=0x7f9fe800de10 comp rx=0 tx=0).stop 2024-09-12T12:22:53.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:53.376+0000 7f9ffd051640 1 -- 172.21.15.102:0/1821019209 shutdown_connections 2024-09-12T12:22:53.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:53.376+0000 7f9ffd051640 1 --2- 172.21.15.102:0/1821019209 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f9fe00a2b80 0x7f9fe00a5040 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:53.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:53.376+0000 7f9ffd051640 1 --2- 172.21.15.102:0/1821019209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ff81037c0 0x7f9ff8074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:53.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:53.376+0000 7f9ffd051640 1 --2- 172.21.15.102:0/1821019209 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ff8102e00 0x7f9ff80745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:53.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:53.376+0000 7f9ffd051640 1 --2- 172.21.15.102:0/1821019209 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ff8101c00 0x7f9ff8075f90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:53.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:53.376+0000 7f9ffd051640 1 -- 172.21.15.102:0/1821019209 >> 172.21.15.102:0/1821019209 conn(0x7f9ff80fd390 msgr2=0x7f9ff8106240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:53.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:53.376+0000 7f9ffd051640 1 -- 172.21.15.102:0/1821019209 shutdown_connections 2024-09-12T12:22:53.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:22:53.376+0000 7f9ffd051640 1 -- 172.21.15.102:0/1821019209 wait complete. 2024-09-12T12:22:53.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:53 smithi102 ceph-mon[34799]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:22:53.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:53 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:53.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:53 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:53.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:53 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:53.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:53 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:22:53.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:53 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:53.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:53 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:22:53.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:53 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:53.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:53 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:53.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:53 smithi033 ceph-mon[31246]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:22:53.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:53 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:53.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:53 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:53.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:53 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:53.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:53 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:22:53.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:53 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:53.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:53 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:22:53.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:53 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:53.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:53 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:53.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:53 smithi043 ceph-mon[34144]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:22:53.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:53 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:53.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:53 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:53.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:53 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:53.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:53 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:22:53.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:53 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:53.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:53 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:22:53.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:53 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:53.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:53 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:54.015 DEBUG:teuthology.orchestra.run.smithi102:osd.11> sudo journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@osd.11.service 2024-09-12T12:22:54.017 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-12T12:22:54.018 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-12T12:22:54.289 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:22:54.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.771+0000 7fe5e76f1640 1 -- 172.21.15.33:0/4209472017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5e01037c0 msgr2=0x7fe5e010a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:54.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.771+0000 7fe5e76f1640 1 --2- 172.21.15.33:0/4209472017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5e01037c0 0x7fe5e010a050 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe5d8009ca0 tx=0x7fe5d802a8c0 comp rx=0 tx=0).stop 2024-09-12T12:22:54.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.771+0000 7fe5e76f1640 1 -- 172.21.15.33:0/4209472017 shutdown_connections 2024-09-12T12:22:54.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.771+0000 7fe5e76f1640 1 --2- 172.21.15.33:0/4209472017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5e01037c0 0x7fe5e010a050 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:54.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.771+0000 7fe5e76f1640 1 --2- 172.21.15.33:0/4209472017 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5e0102e00 0x7fe5e0103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:54.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.771+0000 7fe5e76f1640 1 --2- 172.21.15.33:0/4209472017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5e0101c00 0x7fe5e0102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:54.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.771+0000 7fe5e76f1640 1 -- 172.21.15.33:0/4209472017 >> 172.21.15.33:0/4209472017 conn(0x7fe5e00fd390 msgr2=0x7fe5e00ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:54.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.771+0000 7fe5e76f1640 1 -- 172.21.15.33:0/4209472017 shutdown_connections 2024-09-12T12:22:54.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.771+0000 7fe5e76f1640 1 -- 172.21.15.33:0/4209472017 wait complete. 2024-09-12T12:22:54.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.772+0000 7fe5e76f1640 1 Processor -- start 2024-09-12T12:22:54.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.772+0000 7fe5e76f1640 1 -- start start 2024-09-12T12:22:54.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.772+0000 7fe5e76f1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5e0101c00 0x7fe5e0197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:54.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.772+0000 7fe5e76f1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5e0102e00 0x7fe5e0198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:54.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.772+0000 7fe5e76f1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5e01037c0 0x7fe5e019f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:54.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.772+0000 7fe5e76f1640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e010d790 con 0x7fe5e0102e00 2024-09-12T12:22:54.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.772+0000 7fe5e76f1640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e010d610 con 0x7fe5e01037c0 2024-09-12T12:22:54.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.772+0000 7fe5e76f1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e010d910 con 0x7fe5e0101c00 2024-09-12T12:22:54.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.772+0000 7fe5e4c8c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5e0102e00 0x7fe5e0198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:54.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.772+0000 7fe5e4c8c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5e0102e00 0x7fe5e0198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50888/0 (socket says 172.21.15.33:50888) 2024-09-12T12:22:54.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.772+0000 7fe5e4c8c640 1 -- 172.21.15.33:0/2930462295 learned_addr learned my addr 172.21.15.33:0/2930462295 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:22:54.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.772+0000 7fe5e5c8e640 1 --2- 172.21.15.33:0/2930462295 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5e01037c0 0x7fe5e019f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:54.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.772+0000 7fe5e548d640 1 --2- 172.21.15.33:0/2930462295 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5e0101c00 0x7fe5e0197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:54.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.772+0000 7fe5e4c8c640 1 -- 172.21.15.33:0/2930462295 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5e0101c00 msgr2=0x7fe5e0197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:54.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.772+0000 7fe5e4c8c640 1 --2- 172.21.15.33:0/2930462295 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5e0101c00 0x7fe5e0197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:54.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.772+0000 7fe5e4c8c640 1 -- 172.21.15.33:0/2930462295 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5e01037c0 msgr2=0x7fe5e019f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:54.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.772+0000 7fe5e4c8c640 1 --2- 172.21.15.33:0/2930462295 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5e01037c0 0x7fe5e019f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:54.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.772+0000 7fe5e4c8c640 1 -- 172.21.15.33:0/2930462295 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5e019fa70 con 0x7fe5e0102e00 2024-09-12T12:22:54.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.773+0000 7fe5e4c8c640 1 --2- 172.21.15.33:0/2930462295 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5e0102e00 0x7fe5e0198380 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe5d000b4a0 tx=0x7fe5d000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:54.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.773+0000 7fe5d67fc640 1 -- 172.21.15.33:0/2930462295 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d0014070 con 0x7fe5e0102e00 2024-09-12T12:22:54.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.773+0000 7fe5d67fc640 1 -- 172.21.15.33:0/2930462295 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe5d0010ac0 con 0x7fe5e0102e00 2024-09-12T12:22:54.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.773+0000 7fe5d67fc640 1 -- 172.21.15.33:0/2930462295 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d0017c30 con 0x7fe5e0102e00 2024-09-12T12:22:54.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.773+0000 7fe5e76f1640 1 -- 172.21.15.33:0/2930462295 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5e019fd60 con 0x7fe5e0102e00 2024-09-12T12:22:54.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.773+0000 7fe5e76f1640 1 -- 172.21.15.33:0/2930462295 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5e01a01f0 con 0x7fe5e0102e00 2024-09-12T12:22:54.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.774+0000 7fe5e76f1640 1 -- 172.21.15.33:0/2930462295 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5e0109050 con 0x7fe5e0102e00 2024-09-12T12:22:54.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.775+0000 7fe5d67fc640 1 -- 172.21.15.33:0/2930462295 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fe5d0017070 con 0x7fe5e0102e00 2024-09-12T12:22:54.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.776+0000 7fe5d67fc640 1 --2- 172.21.15.33:0/2930462295 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe5cc0a2c30 0x7fe5cc0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:54.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.776+0000 7fe5e548d640 1 --2- 172.21.15.33:0/2930462295 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe5cc0a2c30 0x7fe5cc0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:54.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.776+0000 7fe5d67fc640 1 -- 172.21.15.33:0/2930462295 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6809+0+0 (secure 0 0 0) 0x7fe5d00cdd00 con 0x7fe5e0102e00 2024-09-12T12:22:54.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.776+0000 7fe5e548d640 1 --2- 172.21.15.33:0/2930462295 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe5cc0a2c30 0x7fe5cc0a50f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc005db0 tx=0x7fe5dc005d40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:54.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.780+0000 7fe5d67fc640 1 -- 172.21.15.33:0/2930462295 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe5d009b240 con 0x7fe5e0102e00 2024-09-12T12:22:54.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.956+0000 7fe5e76f1640 1 -- 172.21.15.33:0/2930462295 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fe5e002da50 con 0x7fe5e0102e00 2024-09-12T12:22:54.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.956+0000 7fe5d67fc640 1 -- 172.21.15.33:0/2930462295 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v70) ==== 74+0+133 (secure 0 0 0) 0x7fe5d009ab40 con 0x7fe5e0102e00 2024-09-12T12:22:54.956 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:22:54.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.958+0000 7fe5e76f1640 1 -- 172.21.15.33:0/2930462295 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe5cc0a2c30 msgr2=0x7fe5cc0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:54.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.958+0000 7fe5e76f1640 1 --2- 172.21.15.33:0/2930462295 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe5cc0a2c30 0x7fe5cc0a50f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc005db0 tx=0x7fe5dc005d40 comp rx=0 tx=0).stop 2024-09-12T12:22:54.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.958+0000 7fe5e76f1640 1 -- 172.21.15.33:0/2930462295 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5e0102e00 msgr2=0x7fe5e0198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:54.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.958+0000 7fe5e76f1640 1 --2- 172.21.15.33:0/2930462295 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5e0102e00 0x7fe5e0198380 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe5d000b4a0 tx=0x7fe5d000b960 comp rx=0 tx=0).stop 2024-09-12T12:22:54.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.958+0000 7fe5e76f1640 1 -- 172.21.15.33:0/2930462295 shutdown_connections 2024-09-12T12:22:54.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.958+0000 7fe5e76f1640 1 --2- 172.21.15.33:0/2930462295 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe5cc0a2c30 0x7fe5cc0a50f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:54.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.958+0000 7fe5e76f1640 1 --2- 172.21.15.33:0/2930462295 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5e01037c0 0x7fe5e019f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:54.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.958+0000 7fe5e76f1640 1 --2- 172.21.15.33:0/2930462295 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5e0102e00 0x7fe5e0198380 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:54.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.958+0000 7fe5e76f1640 1 --2- 172.21.15.33:0/2930462295 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5e0101c00 0x7fe5e0197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:54.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.958+0000 7fe5e76f1640 1 -- 172.21.15.33:0/2930462295 >> 172.21.15.33:0/2930462295 conn(0x7fe5e00fd390 msgr2=0x7fe5e0106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:54.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.958+0000 7fe5e76f1640 1 -- 172.21.15.33:0/2930462295 shutdown_connections 2024-09-12T12:22:54.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:54.958+0000 7fe5e76f1640 1 -- 172.21.15.33:0/2930462295 wait complete. 2024-09-12T12:22:55.474 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:55 smithi102 ceph-mon[34799]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:22:55.474 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:55 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/2930462295' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T12:22:55.474 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:55 smithi102 ceph-mon[34799]: from='osd.11 [v2:172.21.15.102:6824/2463068013,v1:172.21.15.102:6825/2463068013]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T12:22:55.474 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:55 smithi102 ceph-mon[34799]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T12:22:55.475 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:22:55 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:22:55.218+0000 7fb70b34e640 -1 osd.11 0 log_to_monitors true 2024-09-12T12:22:55.693 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:55 smithi033 ceph-mon[31246]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:22:55.693 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:55 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/2930462295' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T12:22:55.693 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:55 smithi033 ceph-mon[31246]: from='osd.11 [v2:172.21.15.102:6824/2463068013,v1:172.21.15.102:6825/2463068013]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T12:22:55.693 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:55 smithi033 ceph-mon[31246]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T12:22:55.720 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":70,"num_osds":12,"num_up_osds":11,"osd_up_since":1726143753,"num_in_osds":12,"osd_in_since":1726143755,"num_remapped_pgs":0} 2024-09-12T12:22:55.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:55 smithi043 ceph-mon[34144]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:22:55.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:55 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/2930462295' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T12:22:55.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:55 smithi043 ceph-mon[34144]: from='osd.11 [v2:172.21.15.102:6824/2463068013,v1:172.21.15.102:6825/2463068013]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T12:22:55.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:55 smithi043 ceph-mon[34144]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T12:22:56.639 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:22:56 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:22:56.479+0000 7fb7072d1640 -1 osd.11 0 waiting for initial osdmap 2024-09-12T12:22:56.639 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:22:56 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:22:56.489+0000 7fb7030f9640 -1 osd.11 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T12:22:56.639 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:56 smithi102 ceph-mon[34799]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-12T12:22:56.640 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:56 smithi102 ceph-mon[34799]: osdmap e71: 12 total, 11 up, 12 in 2024-09-12T12:22:56.640 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:56 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:22:56.640 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:56 smithi102 ceph-mon[34799]: from='osd.11 [v2:172.21.15.102:6824/2463068013,v1:172.21.15.102:6825/2463068013]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-12T12:22:56.640 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:56 smithi102 ceph-mon[34799]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-12T12:22:56.721 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-12T12:22:56.730 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:56 smithi033 ceph-mon[31246]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-12T12:22:56.730 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:56 smithi033 ceph-mon[31246]: osdmap e71: 12 total, 11 up, 12 in 2024-09-12T12:22:56.730 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:56 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:22:56.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:56 smithi033 ceph-mon[31246]: from='osd.11 [v2:172.21.15.102:6824/2463068013,v1:172.21.15.102:6825/2463068013]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-12T12:22:56.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:56 smithi033 ceph-mon[31246]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-12T12:22:56.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:56 smithi043 ceph-mon[34144]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-12T12:22:56.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:56 smithi043 ceph-mon[34144]: osdmap e71: 12 total, 11 up, 12 in 2024-09-12T12:22:56.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:56 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:22:56.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:56 smithi043 ceph-mon[34144]: from='osd.11 [v2:172.21.15.102:6824/2463068013,v1:172.21.15.102:6825/2463068013]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-12T12:22:56.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:56 smithi043 ceph-mon[34144]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-12T12:22:56.991 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:22:57.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.556+0000 7f4de1285640 1 -- 172.21.15.33:0/1794366401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ddc1026a0 msgr2=0x7f4ddc104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:57.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.556+0000 7f4de1285640 1 --2- 172.21.15.33:0/1794366401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ddc1026a0 0x7f4ddc104a90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc009900 tx=0x7f4dcc02a410 comp rx=0 tx=0).stop 2024-09-12T12:22:57.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.556+0000 7f4de1285640 1 -- 172.21.15.33:0/1794366401 shutdown_connections 2024-09-12T12:22:57.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.556+0000 7f4de1285640 1 --2- 172.21.15.33:0/1794366401 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ddc107900 0x7f4ddc109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:57.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.556+0000 7f4de1285640 1 --2- 172.21.15.33:0/1794366401 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ddc104fd0 0x7f4ddc1073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:57.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.556+0000 7f4de1285640 1 --2- 172.21.15.33:0/1794366401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ddc1026a0 0x7f4ddc104a90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:57.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.556+0000 7f4de1285640 1 -- 172.21.15.33:0/1794366401 >> 172.21.15.33:0/1794366401 conn(0x7f4ddc0fc2a0 msgr2=0x7f4ddc0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:57.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.556+0000 7f4de1285640 1 -- 172.21.15.33:0/1794366401 shutdown_connections 2024-09-12T12:22:57.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.556+0000 7f4de1285640 1 -- 172.21.15.33:0/1794366401 wait complete. 2024-09-12T12:22:57.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.557+0000 7f4de1285640 1 Processor -- start 2024-09-12T12:22:57.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.557+0000 7f4de1285640 1 -- start start 2024-09-12T12:22:57.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.557+0000 7f4de1285640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ddc1026a0 0x7f4ddc197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:57.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.558+0000 7f4de1285640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ddc104fd0 0x7f4ddc198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:57.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.558+0000 7f4de1285640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ddc107900 0x7f4ddc19f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:57.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.558+0000 7f4de1285640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4ddc10d7d0 con 0x7f4ddc1026a0 2024-09-12T12:22:57.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.558+0000 7f4de1285640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4ddc10d650 con 0x7f4ddc107900 2024-09-12T12:22:57.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.558+0000 7f4de1285640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4ddc10d950 con 0x7f4ddc104fd0 2024-09-12T12:22:57.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.558+0000 7f4ddaffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ddc1026a0 0x7f4ddc197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:57.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.558+0000 7f4ddaffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ddc1026a0 0x7f4ddc197dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50900/0 (socket says 172.21.15.33:50900) 2024-09-12T12:22:57.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.558+0000 7f4ddaffd640 1 -- 172.21.15.33:0/759997473 learned_addr learned my addr 172.21.15.33:0/759997473 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:22:57.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.558+0000 7f4dda7fc640 1 --2- 172.21.15.33:0/759997473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ddc104fd0 0x7f4ddc198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:57.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.558+0000 7f4ddb7fe640 1 --2- 172.21.15.33:0/759997473 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ddc107900 0x7f4ddc19f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:57.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.558+0000 7f4ddaffd640 1 -- 172.21.15.33:0/759997473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ddc104fd0 msgr2=0x7f4ddc198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:57.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.558+0000 7f4ddaffd640 1 --2- 172.21.15.33:0/759997473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ddc104fd0 0x7f4ddc198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:57.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.558+0000 7f4ddaffd640 1 -- 172.21.15.33:0/759997473 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ddc107900 msgr2=0x7f4ddc19f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:57.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.558+0000 7f4ddaffd640 1 --2- 172.21.15.33:0/759997473 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ddc107900 0x7f4ddc19f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:57.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.558+0000 7f4ddaffd640 1 -- 172.21.15.33:0/759997473 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ddc19fa00 con 0x7f4ddc1026a0 2024-09-12T12:22:57.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.558+0000 7f4dda7fc640 1 --2- 172.21.15.33:0/759997473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ddc104fd0 0x7f4ddc198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:22:57.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.558+0000 7f4ddb7fe640 1 --2- 172.21.15.33:0/759997473 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ddc107900 0x7f4ddc19f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:22:57.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.558+0000 7f4ddaffd640 1 --2- 172.21.15.33:0/759997473 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ddc1026a0 0x7f4ddc197dd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc0314e0 tx=0x7f4dcc003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:57.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.558+0000 7f4dc3fff640 1 -- 172.21.15.33:0/759997473 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc03f070 con 0x7f4ddc1026a0 2024-09-12T12:22:57.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.558+0000 7f4de1285640 1 -- 172.21.15.33:0/759997473 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ddc19fc90 con 0x7f4ddc1026a0 2024-09-12T12:22:57.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.558+0000 7f4dc3fff640 1 -- 172.21.15.33:0/759997473 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4dcc031e40 con 0x7f4ddc1026a0 2024-09-12T12:22:57.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.558+0000 7f4dc3fff640 1 -- 172.21.15.33:0/759997473 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc035030 con 0x7f4ddc1026a0 2024-09-12T12:22:57.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.558+0000 7f4de1285640 1 -- 172.21.15.33:0/759997473 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ddc1a0170 con 0x7f4ddc1026a0 2024-09-12T12:22:57.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.559+0000 7f4de1285640 1 -- 172.21.15.33:0/759997473 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ddc0fdd90 con 0x7f4ddc1026a0 2024-09-12T12:22:57.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.561+0000 7f4dc3fff640 1 -- 172.21.15.33:0/759997473 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f4dcc042070 con 0x7f4ddc1026a0 2024-09-12T12:22:57.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.561+0000 7f4dc3fff640 1 --2- 172.21.15.33:0/759997473 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f4dc40a2bb0 0x7f4dc40a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:57.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.561+0000 7f4dda7fc640 1 --2- 172.21.15.33:0/759997473 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f4dc40a2bb0 0x7f4dc40a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:57.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.561+0000 7f4dc3fff640 1 -- 172.21.15.33:0/759997473 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f4dcc0efac0 con 0x7f4ddc1026a0 2024-09-12T12:22:57.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.562+0000 7f4dda7fc640 1 --2- 172.21.15.33:0/759997473 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f4dc40a2bb0 0x7f4dc40a5070 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc1992f0 tx=0x7f4dd0005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:57.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.565+0000 7f4dc3fff640 1 -- 172.21.15.33:0/759997473 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4dcc0bcec0 con 0x7f4ddc1026a0 2024-09-12T12:22:57.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:57 smithi033 ceph-mon[31246]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:22:57.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:57 smithi033 ceph-mon[31246]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-12T12:22:57.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:57 smithi033 ceph-mon[31246]: osdmap e72: 12 total, 11 up, 12 in 2024-09-12T12:22:57.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:57 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:22:57.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:57 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:22:57.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:57 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:57.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:57 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:57.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:57 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:22:57.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:57 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:22:57.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:57 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:22:57.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:57 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:22:57.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:57 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:57.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:57 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:57.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:57 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:22:57.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:57 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:57.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.742+0000 7f4de1285640 1 -- 172.21.15.33:0/759997473 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f4ddc02da50 con 0x7f4ddc1026a0 2024-09-12T12:22:57.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.743+0000 7f4dc3fff640 1 -- 172.21.15.33:0/759997473 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v73) ==== 74+0+133 (secure 0 0 0) 0x7f4dcc0bc7c0 con 0x7f4ddc1026a0 2024-09-12T12:22:57.743 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:22:57.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.745+0000 7f4de1285640 1 -- 172.21.15.33:0/759997473 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f4dc40a2bb0 msgr2=0x7f4dc40a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:57.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.745+0000 7f4de1285640 1 --2- 172.21.15.33:0/759997473 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f4dc40a2bb0 0x7f4dc40a5070 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc1992f0 tx=0x7f4dd0005d90 comp rx=0 tx=0).stop 2024-09-12T12:22:57.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.745+0000 7f4de1285640 1 -- 172.21.15.33:0/759997473 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ddc1026a0 msgr2=0x7f4ddc197dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:57.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.745+0000 7f4de1285640 1 --2- 172.21.15.33:0/759997473 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ddc1026a0 0x7f4ddc197dd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc0314e0 tx=0x7f4dcc003c80 comp rx=0 tx=0).stop 2024-09-12T12:22:57.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.745+0000 7f4de1285640 1 -- 172.21.15.33:0/759997473 shutdown_connections 2024-09-12T12:22:57.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.745+0000 7f4de1285640 1 --2- 172.21.15.33:0/759997473 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f4dc40a2bb0 0x7f4dc40a5070 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:57.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.745+0000 7f4de1285640 1 --2- 172.21.15.33:0/759997473 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ddc107900 0x7f4ddc19f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:57.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.745+0000 7f4de1285640 1 --2- 172.21.15.33:0/759997473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ddc104fd0 0x7f4ddc198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:57.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.745+0000 7f4de1285640 1 --2- 172.21.15.33:0/759997473 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ddc1026a0 0x7f4ddc197dd0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:57.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.745+0000 7f4de1285640 1 -- 172.21.15.33:0/759997473 >> 172.21.15.33:0/759997473 conn(0x7f4ddc0fc2a0 msgr2=0x7f4ddc103020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:57.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.745+0000 7f4de1285640 1 -- 172.21.15.33:0/759997473 shutdown_connections 2024-09-12T12:22:57.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:57.745+0000 7f4de1285640 1 -- 172.21.15.33:0/759997473 wait complete. 2024-09-12T12:22:57.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:57 smithi043 ceph-mon[34144]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:22:57.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:57 smithi043 ceph-mon[34144]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-12T12:22:57.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:57 smithi043 ceph-mon[34144]: osdmap e72: 12 total, 11 up, 12 in 2024-09-12T12:22:57.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:57 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:22:57.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:57 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:22:57.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:57 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:57.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:57 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:57.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:57 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:22:57.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:57 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:22:57.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:57 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:22:57.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:57 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:22:57.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:57 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:57.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:57 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:57.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:57 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:22:57.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:57 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:57.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:57 smithi102 ceph-mon[34799]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:22:57.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:57 smithi102 ceph-mon[34799]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-12T12:22:57.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:57 smithi102 ceph-mon[34799]: osdmap e72: 12 total, 11 up, 12 in 2024-09-12T12:22:57.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:57 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:22:57.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:57 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:22:57.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:57 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:57.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:57 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:57.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:57 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:22:57.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:57 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:22:57.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:57 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:22:57.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:57 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:22:57.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:57 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:57.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:57 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:57.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:57 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:22:57.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:57 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:22:58.573 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":73,"num_osds":12,"num_up_osds":12,"osd_up_since":1726143777,"num_in_osds":12,"osd_in_since":1726143755,"num_remapped_pgs":0} 2024-09-12T12:22:58.574 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T12:22:58.865 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:22:58.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:58 smithi043 ceph-mon[34144]: purged_snaps scrub starts 2024-09-12T12:22:58.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:58 smithi043 ceph-mon[34144]: purged_snaps scrub ok 2024-09-12T12:22:58.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:58 smithi043 ceph-mon[34144]: Detected new or changed devices on smithi102 2024-09-12T12:22:58.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:58 smithi043 ceph-mon[34144]: Adjusting osd_memory_target on smithi102 to 4272M 2024-09-12T12:22:58.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:58 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:22:58.868 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:58 smithi043 ceph-mon[34144]: osd.11 [v2:172.21.15.102:6824/2463068013,v1:172.21.15.102:6825/2463068013] boot 2024-09-12T12:22:58.868 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:58 smithi043 ceph-mon[34144]: osdmap e73: 12 total, 12 up, 12 in 2024-09-12T12:22:58.868 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:58 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:22:58.868 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:58 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/759997473' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T12:22:58.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:58 smithi102 ceph-mon[34799]: purged_snaps scrub starts 2024-09-12T12:22:58.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:58 smithi102 ceph-mon[34799]: purged_snaps scrub ok 2024-09-12T12:22:58.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:58 smithi102 ceph-mon[34799]: Detected new or changed devices on smithi102 2024-09-12T12:22:58.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:58 smithi102 ceph-mon[34799]: Adjusting osd_memory_target on smithi102 to 4272M 2024-09-12T12:22:58.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:58 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:22:58.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:58 smithi102 ceph-mon[34799]: osd.11 [v2:172.21.15.102:6824/2463068013,v1:172.21.15.102:6825/2463068013] boot 2024-09-12T12:22:58.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:58 smithi102 ceph-mon[34799]: osdmap e73: 12 total, 12 up, 12 in 2024-09-12T12:22:58.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:58 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:22:58.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:58 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/759997473' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T12:22:58.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:58 smithi033 ceph-mon[31246]: purged_snaps scrub starts 2024-09-12T12:22:58.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:58 smithi033 ceph-mon[31246]: purged_snaps scrub ok 2024-09-12T12:22:58.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:58 smithi033 ceph-mon[31246]: Detected new or changed devices on smithi102 2024-09-12T12:22:58.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:58 smithi033 ceph-mon[31246]: Adjusting osd_memory_target on smithi102 to 4272M 2024-09-12T12:22:58.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:58 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:22:58.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:58 smithi033 ceph-mon[31246]: osd.11 [v2:172.21.15.102:6824/2463068013,v1:172.21.15.102:6825/2463068013] boot 2024-09-12T12:22:58.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:58 smithi033 ceph-mon[31246]: osdmap e73: 12 total, 12 up, 12 in 2024-09-12T12:22:58.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:58 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:22:58.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:58 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/759997473' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T12:22:59.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.329+0000 7f42969b2640 1 -- 172.21.15.33:0/518386041 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4290106f10 msgr2=0x7f429010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:59.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.329+0000 7f42969b2640 1 --2- 172.21.15.33:0/518386041 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4290106f10 0x7f429010ea90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4288009ca0 tx=0x7f428802a8c0 comp rx=0 tx=0).stop 2024-09-12T12:22:59.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.329+0000 7f42969b2640 1 -- 172.21.15.33:0/518386041 shutdown_connections 2024-09-12T12:22:59.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.329+0000 7f42969b2640 1 --2- 172.21.15.33:0/518386041 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4290106f10 0x7f429010ea90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:59.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.329+0000 7f42969b2640 1 --2- 172.21.15.33:0/518386041 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4290102790 0x7f42901067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:59.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.329+0000 7f42969b2640 1 --2- 172.21.15.33:0/518386041 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4290101de0 0x7f42901021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:59.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.329+0000 7f42969b2640 1 -- 172.21.15.33:0/518386041 >> 172.21.15.33:0/518386041 conn(0x7f42900fd8c0 msgr2=0x7f42900ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:59.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.329+0000 7f42969b2640 1 -- 172.21.15.33:0/518386041 shutdown_connections 2024-09-12T12:22:59.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.329+0000 7f42969b2640 1 -- 172.21.15.33:0/518386041 wait complete. 2024-09-12T12:22:59.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.330+0000 7f42969b2640 1 Processor -- start 2024-09-12T12:22:59.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.330+0000 7f42969b2640 1 -- start start 2024-09-12T12:22:59.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.330+0000 7f42969b2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4290101de0 0x7f4290198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:59.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.330+0000 7f42969b2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4290102790 0x7f4290198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:59.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.330+0000 7f42969b2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4290106f10 0x7f429019cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:59.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.330+0000 7f42969b2640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4290111e20 con 0x7f4290101de0 2024-09-12T12:22:59.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.330+0000 7f42969b2640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4290111ca0 con 0x7f4290102790 2024-09-12T12:22:59.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.330+0000 7f42969b2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4290111fa0 con 0x7f4290106f10 2024-09-12T12:22:59.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.331+0000 7f428ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4290101de0 0x7f4290198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:59.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.331+0000 7f428ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4290101de0 0x7f4290198320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50906/0 (socket says 172.21.15.33:50906) 2024-09-12T12:22:59.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.331+0000 7f428ffff640 1 -- 172.21.15.33:0/4193473342 learned_addr learned my addr 172.21.15.33:0/4193473342 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:22:59.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.331+0000 7f428f7fe640 1 --2- 172.21.15.33:0/4193473342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4290102790 0x7f4290198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:59.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.331+0000 7f4294f4f640 1 --2- 172.21.15.33:0/4193473342 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4290106f10 0x7f429019cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:59.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.331+0000 7f428ffff640 1 -- 172.21.15.33:0/4193473342 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4290106f10 msgr2=0x7f429019cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:59.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.331+0000 7f428ffff640 1 --2- 172.21.15.33:0/4193473342 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4290106f10 0x7f429019cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:59.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.331+0000 7f428ffff640 1 -- 172.21.15.33:0/4193473342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4290102790 msgr2=0x7f4290198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:59.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.331+0000 7f428ffff640 1 --2- 172.21.15.33:0/4193473342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4290102790 0x7f4290198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:59.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.331+0000 7f428ffff640 1 -- 172.21.15.33:0/4193473342 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f429019d2d0 con 0x7f4290101de0 2024-09-12T12:22:59.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.331+0000 7f428ffff640 1 --2- 172.21.15.33:0/4193473342 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4290101de0 0x7f4290198320 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f428000d770 tx=0x7f428000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:59.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.331+0000 7f428d7fa640 1 -- 172.21.15.33:0/4193473342 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4280017070 con 0x7f4290101de0 2024-09-12T12:22:59.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.331+0000 7f428d7fa640 1 -- 172.21.15.33:0/4193473342 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f42800054d0 con 0x7f4290101de0 2024-09-12T12:22:59.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.331+0000 7f42969b2640 1 -- 172.21.15.33:0/4193473342 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f429019d5c0 con 0x7f4290101de0 2024-09-12T12:22:59.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.331+0000 7f428d7fa640 1 -- 172.21.15.33:0/4193473342 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4280004cf0 con 0x7f4290101de0 2024-09-12T12:22:59.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.331+0000 7f42969b2640 1 -- 172.21.15.33:0/4193473342 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42901a4ea0 con 0x7f4290101de0 2024-09-12T12:22:59.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.332+0000 7f42969b2640 1 -- 172.21.15.33:0/4193473342 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42901021c0 con 0x7f4290101de0 2024-09-12T12:22:59.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.333+0000 7f428d7fa640 1 -- 172.21.15.33:0/4193473342 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f4280004e90 con 0x7f4290101de0 2024-09-12T12:22:59.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.334+0000 7f428d7fa640 1 --2- 172.21.15.33:0/4193473342 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f42780a2b80 0x7f42780a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:59.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.334+0000 7f428f7fe640 1 --2- 172.21.15.33:0/4193473342 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f42780a2b80 0x7f42780a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:59.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.334+0000 7f428d7fa640 1 -- 172.21.15.33:0/4193473342 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f42800ce6c0 con 0x7f4290101de0 2024-09-12T12:22:59.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.335+0000 7f428f7fe640 1 --2- 172.21.15.33:0/4193473342 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f42780a2b80 0x7f42780a5040 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4284005d90 tx=0x7f4284005d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:59.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.339+0000 7f428d7fa640 1 -- 172.21.15.33:0/4193473342 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f428009bac0 con 0x7f4290101de0 2024-09-12T12:22:59.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.515+0000 7f42969b2640 1 -- 172.21.15.33:0/4193473342 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f429010a150 con 0x7f4290101de0 2024-09-12T12:22:59.515 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:59 smithi033 ceph-mon[31246]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:22:59.515 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:22:59 smithi033 ceph-mon[31246]: osdmap e74: 12 total, 12 up, 12 in 2024-09-12T12:22:59.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.516+0000 7f428d7fa640 1 -- 172.21.15.33:0/4193473342 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+18397 (secure 0 0 0) 0x7f428009b3c0 con 0x7f4290101de0 2024-09-12T12:22:59.517 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:22:59.517 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":74,"fsid":"a66dfafc-7100-11ef-bcea-c7b262605968","created":"2024-09-12T12:16:11.904815+0000","modified":"2024-09-12T12:22:58.487808+0000","last_up_change":"2024-09-12T12:22:57.476185+0000","last_in_change":"2024-09-12T12:22:35.192556+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:19:12.296305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"74b68729-c97c-4da6-a659-75d6c147ad05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6803","nonce":963294466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6805","nonce":963294466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6809","nonce":963294466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6807","nonce":963294466}]},"public_addr":"172.21.15.33:6803/963294466","cluster_addr":"172.21.15.33:6805/963294466","heartbeat_back_addr":"172.21.15.33:6809/963294466","heartbeat_front_addr":"172.21.15.33:6807/963294466","state":["exists","up"]},{"osd":1,"uuid":"2461a388-e110-420b-9404-eb54cd39119e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6801","nonce":2306025171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6803","nonce":2306025171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6807","nonce":2306025171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6805","nonce":2306025171}]},"public_addr":"172.21.15.43:6801/2306025171","cluster_addr":"172.21.15.43:6803/2306025171","heartbeat_back_addr":"172.21.15.43:6807/2306025171","heartbeat_front_addr":"172.21.15.43:6805/2306025171","state":["exists","up"]},{"osd":2,"uuid":"4ba9dd02-977d-45fb-b366-ade15b52232b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6801","nonce":4257223217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6803","nonce":4257223217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6807","nonce":4257223217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6805","nonce":4257223217}]},"public_addr":"172.21.15.102:6801/4257223217","cluster_addr":"172.21.15.102:6803/4257223217","heartbeat_back_addr":"172.21.15.102:6807/4257223217","heartbeat_front_addr":"172.21.15.102:6805/4257223217","state":["exists","up"]},{"osd":3,"uuid":"345aa854-9ea2-4103-a186-9794af34c237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6811","nonce":2483872739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6813","nonce":2483872739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6817","nonce":2483872739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6815","nonce":2483872739}]},"public_addr":"172.21.15.33:6811/2483872739","cluster_addr":"172.21.15.33:6813/2483872739","heartbeat_back_addr":"172.21.15.33:6817/2483872739","heartbeat_front_addr":"172.21.15.33:6815/2483872739","state":["exists","up"]},{"osd":4,"uuid":"32acd6da-01d6-4a8e-9d05-3d394363d6f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6809","nonce":136043101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6811","nonce":136043101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6815","nonce":136043101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6813","nonce":136043101}]},"public_addr":"172.21.15.43:6809/136043101","cluster_addr":"172.21.15.43:6811/136043101","heartbeat_back_addr":"172.21.15.43:6815/136043101","heartbeat_front_addr":"172.21.15.43:6813/136043101","state":["exists","up"]},{"osd":5,"uuid":"dced0037-2da2-48c2-a391-f871d6ceebb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6809","nonce":2605625792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6811","nonce":2605625792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6815","nonce":2605625792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6813","nonce":2605625792}]},"public_addr":"172.21.15.102:6809/2605625792","cluster_addr":"172.21.15.102:6811/2605625792","heartbeat_back_addr":"172.21.15.102:6815/2605625792","heartbeat_front_addr":"172.21.15.102:6813/2605625792","state":["exists","up"]},{"osd":6,"uuid":"46e5532e-026a-4bb2-8847-2a3216e5d7a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6819","nonce":805864618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6821","nonce":805864618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6825","nonce":805864618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6823","nonce":805864618}]},"public_addr":"172.21.15.33:6819/805864618","cluster_addr":"172.21.15.33:6821/805864618","heartbeat_back_addr":"172.21.15.33:6825/805864618","heartbeat_front_addr":"172.21.15.33:6823/805864618","state":["exists","up"]},{"osd":7,"uuid":"c8474ab4-68cd-4475-9429-b54981247ee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6817","nonce":392537201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6819","nonce":392537201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6823","nonce":392537201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6821","nonce":392537201}]},"public_addr":"172.21.15.43:6817/392537201","cluster_addr":"172.21.15.43:6819/392537201","heartbeat_back_addr":"172.21.15.43:6823/392537201","heartbeat_front_addr":"172.21.15.43:6821/392537201","state":["exists","up"]},{"osd":8,"uuid":"e7c2ef28-8c84-44d0-ba6d-7556ec1d02dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6817","nonce":1768219597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6819","nonce":1768219597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6823","nonce":1768219597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6821","nonce":1768219597}]},"public_addr":"172.21.15.102:6817/1768219597","cluster_addr":"172.21.15.102:6819/1768219597","heartbeat_back_addr":"172.21.15.102:6823/1768219597","heartbeat_front_addr":"172.21.15.102:6821/1768219597","state":["exists","up"]},{"osd":9,"uuid":"f2500273-8b21-4984-bc41-cec5cc0c883b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6827","nonce":973136168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6829","nonce":973136168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6833","nonce":973136168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6831","nonce":973136168}]},"public_addr":"172.21.15.33:6827/973136168","cluster_addr":"172.21.15.33:6829/973136168","heartbeat_back_addr":"172.21.15.33:6833/973136168","heartbeat_front_addr":"172.21.15.33:6831/973136168","state":["exists","up"]},{"osd":10,"uuid":"954343c5-5d5b-4c30-acde-82aa695f7b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6825","nonce":248515585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6827","nonce":248515585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6831","nonce":248515585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6829","nonce":248515585}]},"public_addr":"172.21.15.43:6825/248515585","cluster_addr":"172.21.15.43:6827/248515585","heartbeat_back_addr":"172.21.15.43:6831/248515585","heartbeat_front_addr":"172.21.15.43:6829/248515585","state":["exists","up"]},{"osd":11,"uuid":"22b4147b-02ad-4514-be17-5bb395099eef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6825","nonce":2463068013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6827","nonce":2463068013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6831","nonce":2463068013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6829","nonce":2463068013}]},"public_addr":"172.21.15.102:6825/2463068013","cluster_addr":"172.21.15.102:6827/2463068013","heartbeat_back_addr":"172.21.15.102:6831/2463068013","heartbeat_front_addr":"172.21.15.102:6829/2463068013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:19.274804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:44.900294+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:08.885404+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:34.382089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:59.978538+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:25.275179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:49.429847+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:14.974792+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:40.268629+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:22:06.458679+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:22:31.813019+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:22:56.264078+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/3187741548":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6800/1381479235":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6801/1156183797":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/2222991013":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6801/1381479235":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6800/1156183797":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/3450458842":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/202580320":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/2441151017":"2024-09-13T12:16:57.792813+0000","172.21.15.33:0/1001176884":"2024-09-13T12:16:33.559150+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:22:59.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.519+0000 7f42969b2640 1 -- 172.21.15.33:0/4193473342 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f42780a2b80 msgr2=0x7f42780a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:59.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.519+0000 7f42969b2640 1 --2- 172.21.15.33:0/4193473342 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f42780a2b80 0x7f42780a5040 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4284005d90 tx=0x7f4284005d20 comp rx=0 tx=0).stop 2024-09-12T12:22:59.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.519+0000 7f42969b2640 1 -- 172.21.15.33:0/4193473342 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4290101de0 msgr2=0x7f4290198320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:59.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.519+0000 7f42969b2640 1 --2- 172.21.15.33:0/4193473342 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4290101de0 0x7f4290198320 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f428000d770 tx=0x7f428000dc30 comp rx=0 tx=0).stop 2024-09-12T12:22:59.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.519+0000 7f42969b2640 1 -- 172.21.15.33:0/4193473342 shutdown_connections 2024-09-12T12:22:59.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.519+0000 7f42969b2640 1 --2- 172.21.15.33:0/4193473342 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f42780a2b80 0x7f42780a5040 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:59.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.519+0000 7f42969b2640 1 --2- 172.21.15.33:0/4193473342 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4290106f10 0x7f429019cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:59.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.519+0000 7f42969b2640 1 --2- 172.21.15.33:0/4193473342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4290102790 0x7f4290198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:59.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.519+0000 7f42969b2640 1 --2- 172.21.15.33:0/4193473342 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4290101de0 0x7f4290198320 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:59.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.519+0000 7f42969b2640 1 -- 172.21.15.33:0/4193473342 >> 172.21.15.33:0/4193473342 conn(0x7f42900fd8c0 msgr2=0x7f42900fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:59.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.519+0000 7f42969b2640 1 -- 172.21.15.33:0/4193473342 shutdown_connections 2024-09-12T12:22:59.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:22:59.519+0000 7f42969b2640 1 -- 172.21.15.33:0/4193473342 wait complete. 2024-09-12T12:22:59.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:59 smithi043 ceph-mon[34144]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:22:59.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:22:59 smithi043 ceph-mon[34144]: osdmap e74: 12 total, 12 up, 12 in 2024-09-12T12:22:59.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:59 smithi102 ceph-mon[34799]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:22:59.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:22:59 smithi102 ceph-mon[34799]: osdmap e74: 12 total, 12 up, 12 in 2024-09-12T12:23:00.217 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T12:19:12.296305+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T12:23:00.217 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-12T12:23:00.472 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:23:00.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:00 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/4193473342' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:23:00.866 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:00 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/4193473342' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:23:00.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:00 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/4193473342' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:23:00.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:00.951+0000 7fcb86c77640 1 -- 172.21.15.33:0/3850210765 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb801036c0 msgr2=0x7fcb8010bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:00.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:00.951+0000 7fcb86c77640 1 --2- 172.21.15.33:0/3850210765 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb801036c0 0x7fcb8010bbb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcb68009900 tx=0x7fcb6802a480 comp rx=0 tx=0).stop 2024-09-12T12:23:00.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:00.951+0000 7fcb86c77640 1 -- 172.21.15.33:0/3850210765 shutdown_connections 2024-09-12T12:23:00.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:00.951+0000 7fcb86c77640 1 --2- 172.21.15.33:0/3850210765 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb8010c180 0x7fcb8010e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:00.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:00.951+0000 7fcb86c77640 1 --2- 172.21.15.33:0/3850210765 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb801036c0 0x7fcb8010bbb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:00.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:00.951+0000 7fcb86c77640 1 --2- 172.21.15.33:0/3850210765 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb80102da0 0x7fcb80103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:00.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:00.951+0000 7fcb86c77640 1 -- 172.21.15.33:0/3850210765 >> 172.21.15.33:0/3850210765 conn(0x7fcb800fc7a0 msgr2=0x7fcb800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:00.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:00.951+0000 7fcb86c77640 1 -- 172.21.15.33:0/3850210765 shutdown_connections 2024-09-12T12:23:00.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:00.951+0000 7fcb86c77640 1 -- 172.21.15.33:0/3850210765 wait complete. 2024-09-12T12:23:00.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:00.952+0000 7fcb86c77640 1 Processor -- start 2024-09-12T12:23:00.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:00.952+0000 7fcb86c77640 1 -- start start 2024-09-12T12:23:00.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:00.952+0000 7fcb86c77640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb80102da0 0x7fcb80100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:00.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:00.952+0000 7fcb86c77640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb801036c0 0x7fcb80100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:00.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:00.952+0000 7fcb86c77640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb8010c180 0x7fcb80101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:00.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:00.952+0000 7fcb86c77640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcb80111e10 con 0x7fcb801036c0 2024-09-12T12:23:00.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:00.952+0000 7fcb86c77640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcb80111c90 con 0x7fcb8010c180 2024-09-12T12:23:00.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:00.952+0000 7fcb86c77640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fcb80111f90 con 0x7fcb80102da0 2024-09-12T12:23:00.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:00.952+0000 7fcb7ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb801036c0 0x7fcb80100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:00.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:00.952+0000 7fcb7ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb801036c0 0x7fcb80100f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50554/0 (socket says 172.21.15.33:50554) 2024-09-12T12:23:00.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:00.952+0000 7fcb7ffff640 1 -- 172.21.15.33:0/2877186555 learned_addr learned my addr 172.21.15.33:0/2877186555 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:23:00.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:00.952+0000 7fcb84a13640 1 --2- 172.21.15.33:0/2877186555 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb80102da0 0x7fcb80100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:00.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:00.952+0000 7fcb85214640 1 --2- 172.21.15.33:0/2877186555 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb8010c180 0x7fcb80101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:00.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:00.952+0000 7fcb7ffff640 1 -- 172.21.15.33:0/2877186555 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb80102da0 msgr2=0x7fcb80100a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:00.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:00.952+0000 7fcb7ffff640 1 --2- 172.21.15.33:0/2877186555 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb80102da0 0x7fcb80100a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:00.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:00.952+0000 7fcb7ffff640 1 -- 172.21.15.33:0/2877186555 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb8010c180 msgr2=0x7fcb80101480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:00.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:00.952+0000 7fcb7ffff640 1 --2- 172.21.15.33:0/2877186555 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb8010c180 0x7fcb80101480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:00.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:00.952+0000 7fcb7ffff640 1 -- 172.21.15.33:0/2877186555 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb801a67f0 con 0x7fcb801036c0 2024-09-12T12:23:00.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:00.952+0000 7fcb85214640 1 --2- 172.21.15.33:0/2877186555 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb8010c180 0x7fcb80101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:23:00.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:00.952+0000 7fcb7ffff640 1 --2- 172.21.15.33:0/2877186555 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb801036c0 0x7fcb80100f40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcb68005940 tx=0x7fcb68004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:00.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:00.953+0000 7fcb7dffb640 1 -- 172.21.15.33:0/2877186555 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb6803f030 con 0x7fcb801036c0 2024-09-12T12:23:00.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:00.953+0000 7fcb7dffb640 1 -- 172.21.15.33:0/2877186555 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcb68003aa0 con 0x7fcb801036c0 2024-09-12T12:23:00.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:00.953+0000 7fcb86c77640 1 -- 172.21.15.33:0/2877186555 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb801a6a80 con 0x7fcb801036c0 2024-09-12T12:23:00.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:00.953+0000 7fcb7dffb640 1 -- 172.21.15.33:0/2877186555 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb68035070 con 0x7fcb801036c0 2024-09-12T12:23:00.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:00.953+0000 7fcb86c77640 1 -- 172.21.15.33:0/2877186555 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb801a6fb0 con 0x7fcb801036c0 2024-09-12T12:23:00.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:00.954+0000 7fcb86c77640 1 -- 172.21.15.33:0/2877186555 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb80103180 con 0x7fcb801036c0 2024-09-12T12:23:00.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:00.955+0000 7fcb7dffb640 1 -- 172.21.15.33:0/2877186555 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fcb68042030 con 0x7fcb801036c0 2024-09-12T12:23:00.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:00.956+0000 7fcb7dffb640 1 --2- 172.21.15.33:0/2877186555 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fcb6c0a2c00 0x7fcb6c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:00.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:00.956+0000 7fcb84a13640 1 --2- 172.21.15.33:0/2877186555 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fcb6c0a2c00 0x7fcb6c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:00.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:00.956+0000 7fcb7dffb640 1 -- 172.21.15.33:0/2877186555 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fcb680ef390 con 0x7fcb801036c0 2024-09-12T12:23:00.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:00.956+0000 7fcb84a13640 1 --2- 172.21.15.33:0/2877186555 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fcb6c0a2c00 0x7fcb6c0a50c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcb7000bbe0 tx=0x7fcb7000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:00.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:00.960+0000 7fcb7dffb640 1 -- 172.21.15.33:0/2877186555 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcb680bc6f0 con 0x7fcb801036c0 2024-09-12T12:23:01.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:01.137+0000 7fcb86c77640 1 -- 172.21.15.33:0/2877186555 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcb801071c0 con 0x7fcb801036c0 2024-09-12T12:23:01.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:01.137+0000 7fcb7dffb640 1 -- 172.21.15.33:0/2877186555 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) ==== 93+0+10 (secure 0 0 0) 0x7fcb680bbff0 con 0x7fcb801036c0 2024-09-12T12:23:01.138 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-12T12:23:01.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:01.139+0000 7fcb86c77640 1 -- 172.21.15.33:0/2877186555 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fcb6c0a2c00 msgr2=0x7fcb6c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:01.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:01.139+0000 7fcb86c77640 1 --2- 172.21.15.33:0/2877186555 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fcb6c0a2c00 0x7fcb6c0a50c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcb7000bbe0 tx=0x7fcb7000b390 comp rx=0 tx=0).stop 2024-09-12T12:23:01.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:01.139+0000 7fcb86c77640 1 -- 172.21.15.33:0/2877186555 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb801036c0 msgr2=0x7fcb80100f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:01.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:01.139+0000 7fcb86c77640 1 --2- 172.21.15.33:0/2877186555 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb801036c0 0x7fcb80100f40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcb68005940 tx=0x7fcb68004270 comp rx=0 tx=0).stop 2024-09-12T12:23:01.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:01.140+0000 7fcb86c77640 1 -- 172.21.15.33:0/2877186555 shutdown_connections 2024-09-12T12:23:01.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:01.140+0000 7fcb86c77640 1 --2- 172.21.15.33:0/2877186555 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fcb6c0a2c00 0x7fcb6c0a50c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:01.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:01.140+0000 7fcb86c77640 1 --2- 172.21.15.33:0/2877186555 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb8010c180 0x7fcb80101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:01.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:01.140+0000 7fcb86c77640 1 --2- 172.21.15.33:0/2877186555 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb801036c0 0x7fcb80100f40 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:01.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:01.140+0000 7fcb86c77640 1 --2- 172.21.15.33:0/2877186555 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb80102da0 0x7fcb80100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:01.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:01.140+0000 7fcb86c77640 1 -- 172.21.15.33:0/2877186555 >> 172.21.15.33:0/2877186555 conn(0x7fcb800fc7a0 msgr2=0x7fcb800fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:01.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:01.140+0000 7fcb86c77640 1 -- 172.21.15.33:0/2877186555 shutdown_connections 2024-09-12T12:23:01.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:01.140+0000 7fcb86c77640 1 -- 172.21.15.33:0/2877186555 wait complete. 2024-09-12T12:23:01.773 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:01 smithi033 ceph-mon[31246]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:01.773 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:01 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/2877186555' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T12:23:01.803 INFO:tasks.cephadm:Adding mds.a on smithi033 2024-09-12T12:23:01.803 INFO:tasks.cephadm:Adding mds.d on smithi033 2024-09-12T12:23:01.803 INFO:tasks.cephadm:Adding mds.g on smithi033 2024-09-12T12:23:01.803 INFO:tasks.cephadm:Adding mds.j on smithi033 2024-09-12T12:23:01.803 INFO:tasks.cephadm:Adding mds.b on smithi043 2024-09-12T12:23:01.803 INFO:tasks.cephadm:Adding mds.e on smithi043 2024-09-12T12:23:01.803 INFO:tasks.cephadm:Adding mds.h on smithi043 2024-09-12T12:23:01.804 INFO:tasks.cephadm:Adding mds.k on smithi043 2024-09-12T12:23:01.804 INFO:tasks.cephadm:Adding mds.c on smithi102 2024-09-12T12:23:01.804 INFO:tasks.cephadm:Adding mds.f on smithi102 2024-09-12T12:23:01.804 INFO:tasks.cephadm:Adding mds.i on smithi102 2024-09-12T12:23:01.804 INFO:tasks.cephadm:Adding mds.l on smithi102 2024-09-12T12:23:01.804 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph orch apply mds all '12;smithi033=a;smithi033=d;smithi033=g;smithi033=j;smithi043=b;smithi043=e;smithi043=h;smithi043=k;smithi102=c;smithi102=f;smithi102=i;smithi102=l' 2024-09-12T12:23:01.832 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:01 smithi102 ceph-mon[34799]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:01.833 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:01 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/2877186555' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T12:23:01.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:01 smithi043 ceph-mon[34144]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:01.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:01 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/2877186555' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T12:23:02.062 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:23:02.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.530+0000 7f60ef4a4640 1 -- 172.21.15.102:0/3933410932 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60e8102e00 msgr2=0x7f60e8103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:02.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.530+0000 7f60ef4a4640 1 --2- 172.21.15.102:0/3933410932 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60e8102e00 0x7f60e8103280 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f60d8009900 tx=0x7f60d802a410 comp rx=0 tx=0).stop 2024-09-12T12:23:02.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.530+0000 7f60ef4a4640 1 -- 172.21.15.102:0/3933410932 shutdown_connections 2024-09-12T12:23:02.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.530+0000 7f60ef4a4640 1 --2- 172.21.15.102:0/3933410932 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60e81037c0 0x7f60e810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:02.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.530+0000 7f60ef4a4640 1 --2- 172.21.15.102:0/3933410932 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60e8102e00 0x7f60e8103280 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:02.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.530+0000 7f60ef4a4640 1 --2- 172.21.15.102:0/3933410932 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60e8101c00 0x7f60e8102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:02.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.530+0000 7f60ef4a4640 1 -- 172.21.15.102:0/3933410932 >> 172.21.15.102:0/3933410932 conn(0x7f60e80fd3b0 msgr2=0x7f60e80ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:02.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.530+0000 7f60ef4a4640 1 -- 172.21.15.102:0/3933410932 shutdown_connections 2024-09-12T12:23:02.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.530+0000 7f60ef4a4640 1 -- 172.21.15.102:0/3933410932 wait complete. 2024-09-12T12:23:02.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.531+0000 7f60ef4a4640 1 Processor -- start 2024-09-12T12:23:02.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.531+0000 7f60ef4a4640 1 -- start start 2024-09-12T12:23:02.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.531+0000 7f60ef4a4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60e8101c00 0x7f60e8197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:02.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.531+0000 7f60ef4a4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60e8102e00 0x7f60e81984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:02.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.531+0000 7f60ef4a4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60e81037c0 0x7f60e819f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:02.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.531+0000 7f60ef4a4640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f60e810d830 con 0x7f60e81037c0 2024-09-12T12:23:02.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.531+0000 7f60ef4a4640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f60e810d6b0 con 0x7f60e8101c00 2024-09-12T12:23:02.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.531+0000 7f60ef4a4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f60e810d9b0 con 0x7f60e8102e00 2024-09-12T12:23:02.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.531+0000 7f60eca3f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60e8102e00 0x7f60e81984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:02.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.531+0000 7f60eca3f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60e8102e00 0x7f60e81984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56902/0 (socket says 172.21.15.102:56902) 2024-09-12T12:23:02.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.531+0000 7f60eca3f640 1 -- 172.21.15.102:0/141076789 learned_addr learned my addr 172.21.15.102:0/141076789 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-12T12:23:02.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.531+0000 7f60eda41640 1 --2- 172.21.15.102:0/141076789 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60e81037c0 0x7f60e819f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:02.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.531+0000 7f60ed240640 1 --2- 172.21.15.102:0/141076789 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60e8101c00 0x7f60e8197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:02.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.531+0000 7f60eca3f640 1 -- 172.21.15.102:0/141076789 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60e8101c00 msgr2=0x7f60e8197fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:02.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.531+0000 7f60eca3f640 1 --2- 172.21.15.102:0/141076789 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60e8101c00 0x7f60e8197fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:02.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.531+0000 7f60eca3f640 1 -- 172.21.15.102:0/141076789 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60e81037c0 msgr2=0x7f60e819f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:02.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.531+0000 7f60eca3f640 1 --2- 172.21.15.102:0/141076789 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60e81037c0 0x7f60e819f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:02.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.531+0000 7f60eca3f640 1 -- 172.21.15.102:0/141076789 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60e819fbd0 con 0x7f60e8102e00 2024-09-12T12:23:02.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.531+0000 7f60ed240640 1 --2- 172.21.15.102:0/141076789 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60e8101c00 0x7f60e8197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:23:02.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.531+0000 7f60eca3f640 1 --2- 172.21.15.102:0/141076789 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60e8102e00 0x7f60e81984e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f60d8005940 tx=0x7f60d8004430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:02.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.532+0000 7f60de7fc640 1 -- 172.21.15.102:0/141076789 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d803f030 con 0x7f60e8102e00 2024-09-12T12:23:02.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.532+0000 7f60de7fc640 1 -- 172.21.15.102:0/141076789 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f60d8003cb0 con 0x7f60e8102e00 2024-09-12T12:23:02.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.532+0000 7f60ef4a4640 1 -- 172.21.15.102:0/141076789 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60e819fe60 con 0x7f60e8102e00 2024-09-12T12:23:02.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.532+0000 7f60de7fc640 1 -- 172.21.15.102:0/141076789 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d8035070 con 0x7f60e8102e00 2024-09-12T12:23:02.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.532+0000 7f60ef4a4640 1 -- 172.21.15.102:0/141076789 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60e81a0330 con 0x7f60e8102e00 2024-09-12T12:23:02.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.533+0000 7f60ef4a4640 1 -- 172.21.15.102:0/141076789 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60e81090a0 con 0x7f60e8102e00 2024-09-12T12:23:02.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.534+0000 7f60de7fc640 1 -- 172.21.15.102:0/141076789 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f60d8042030 con 0x7f60e8102e00 2024-09-12T12:23:02.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.535+0000 7f60de7fc640 1 --2- 172.21.15.102:0/141076789 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f60d40a2bb0 0x7f60d40a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:02.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.535+0000 7f60de7fc640 1 -- 172.21.15.102:0/141076789 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f60d80ef280 con 0x7f60e8102e00 2024-09-12T12:23:02.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.535+0000 7f60ed240640 1 --2- 172.21.15.102:0/141076789 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f60d40a2bb0 0x7f60d40a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:02.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.535+0000 7f60ed240640 1 --2- 172.21.15.102:0/141076789 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f60d40a2bb0 0x7f60d40a5070 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f60e4006fd0 tx=0x7f60e4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:02.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.539+0000 7f60de7fc640 1 -- 172.21.15.102:0/141076789 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f60d80bc680 con 0x7f60e8102e00 2024-09-12T12:23:02.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.719+0000 7f60ef4a4640 1 -- 172.21.15.102:0/141076789 --> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi033=a;smithi033=d;smithi033=g;smithi033=j;smithi043=b;smithi043=e;smithi043=h;smithi043=k;smithi102=c;smithi102=f;smithi102=i;smithi102=l", "target": ["mon-mgr", ""]}) -- 0x7f60e80627f0 con 0x7f60d40a2bb0 2024-09-12T12:23:02.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.726+0000 7f60de7fc640 1 -- 172.21.15.102:0/141076789 <== mgr.14150 v2:172.21.15.33:6800/176202431 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f60e80627f0 con 0x7f60d40a2bb0 2024-09-12T12:23:02.726 INFO:teuthology.orchestra.run.smithi102.stdout:Scheduled mds.all update... 2024-09-12T12:23:02.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.729+0000 7f60ef4a4640 1 -- 172.21.15.102:0/141076789 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f60d40a2bb0 msgr2=0x7f60d40a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:02.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.729+0000 7f60ef4a4640 1 --2- 172.21.15.102:0/141076789 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f60d40a2bb0 0x7f60d40a5070 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f60e4006fd0 tx=0x7f60e4008040 comp rx=0 tx=0).stop 2024-09-12T12:23:02.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.729+0000 7f60ef4a4640 1 -- 172.21.15.102:0/141076789 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60e8102e00 msgr2=0x7f60e81984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:02.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.729+0000 7f60ef4a4640 1 --2- 172.21.15.102:0/141076789 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60e8102e00 0x7f60e81984e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f60d8005940 tx=0x7f60d8004430 comp rx=0 tx=0).stop 2024-09-12T12:23:02.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.729+0000 7f60ef4a4640 1 -- 172.21.15.102:0/141076789 shutdown_connections 2024-09-12T12:23:02.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.729+0000 7f60ef4a4640 1 --2- 172.21.15.102:0/141076789 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f60d40a2bb0 0x7f60d40a5070 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:02.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.729+0000 7f60ef4a4640 1 --2- 172.21.15.102:0/141076789 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60e81037c0 0x7f60e819f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:02.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.729+0000 7f60ef4a4640 1 --2- 172.21.15.102:0/141076789 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60e8102e00 0x7f60e81984e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:02.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.729+0000 7f60ef4a4640 1 --2- 172.21.15.102:0/141076789 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60e8101c00 0x7f60e8197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:02.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.729+0000 7f60ef4a4640 1 -- 172.21.15.102:0/141076789 >> 172.21.15.102:0/141076789 conn(0x7f60e80fd3b0 msgr2=0x7f60e8106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:02.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.729+0000 7f60ef4a4640 1 -- 172.21.15.102:0/141076789 shutdown_connections 2024-09-12T12:23:02.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T12:23:02.729+0000 7f60ef4a4640 1 -- 172.21.15.102:0/141076789 wait complete. 2024-09-12T12:23:03.433 DEBUG:teuthology.orchestra.run.smithi033:mds.a> sudo journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mds.a.service 2024-09-12T12:23:03.436 DEBUG:teuthology.orchestra.run.smithi033:mds.d> sudo journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mds.d.service 2024-09-12T12:23:03.480 DEBUG:teuthology.orchestra.run.smithi033:mds.g> sudo journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mds.g.service 2024-09-12T12:23:03.523 DEBUG:teuthology.orchestra.run.smithi033:mds.j> sudo journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mds.j.service 2024-09-12T12:23:03.566 DEBUG:teuthology.orchestra.run.smithi043:mds.b> sudo journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mds.b.service 2024-09-12T12:23:03.570 DEBUG:teuthology.orchestra.run.smithi043:mds.e> sudo journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mds.e.service 2024-09-12T12:23:03.613 DEBUG:teuthology.orchestra.run.smithi043:mds.h> sudo journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mds.h.service 2024-09-12T12:23:03.657 DEBUG:teuthology.orchestra.run.smithi043:mds.k> sudo journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mds.k.service 2024-09-12T12:23:03.700 DEBUG:teuthology.orchestra.run.smithi102:mds.c> sudo journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mds.c.service 2024-09-12T12:23:03.702 DEBUG:teuthology.orchestra.run.smithi102:mds.f> sudo journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mds.f.service 2024-09-12T12:23:03.746 DEBUG:teuthology.orchestra.run.smithi102:mds.i> sudo journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mds.i.service 2024-09-12T12:23:03.793 DEBUG:teuthology.orchestra.run.smithi102:mds.l> sudo journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mds.l.service 2024-09-12T12:23:03.845 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-12T12:23:03.845 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:23:03.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:03 smithi043 ceph-mon[34144]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:03.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:03 smithi043 ceph-mon[34144]: from='client.24430 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi033=a;smithi033=d;smithi033=g;smithi033=j;smithi043=b;smithi043=e;smithi043=h;smithi043=k;smithi102=c;smithi102=f;smithi102=i;smithi102=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:23:03.868 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:03 smithi043 ceph-mon[34144]: Saving service mds.all spec with placement smithi033=a;smithi033=d;smithi033=g;smithi033=j;smithi043=b;smithi043=e;smithi043=h;smithi043=k;smithi102=c;smithi102=f;smithi102=i;smithi102=l;count:12 2024-09-12T12:23:03.868 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:03 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:03.868 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:03 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:23:03.868 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:03 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:03.868 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:03 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:23:03.868 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:03 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:03.868 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:03 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:23:03.868 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:03 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:23:03.868 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:03 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:03.963 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:03 smithi102 ceph-mon[34799]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:03.963 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:03 smithi102 ceph-mon[34799]: from='client.24430 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi033=a;smithi033=d;smithi033=g;smithi033=j;smithi043=b;smithi043=e;smithi043=h;smithi043=k;smithi102=c;smithi102=f;smithi102=i;smithi102=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:23:03.963 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:03 smithi102 ceph-mon[34799]: Saving service mds.all spec with placement smithi033=a;smithi033=d;smithi033=g;smithi033=j;smithi043=b;smithi043=e;smithi043=h;smithi043=k;smithi102=c;smithi102=f;smithi102=i;smithi102=l;count:12 2024-09-12T12:23:03.963 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:03 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:03.963 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:03 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:23:03.963 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:03 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:03.963 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:03 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:23:03.963 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:03 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:03.964 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:03 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:23:03.964 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:03 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:23:03.964 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:03 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:03.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:03 smithi033 ceph-mon[31246]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:03.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:03 smithi033 ceph-mon[31246]: from='client.24430 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi033=a;smithi033=d;smithi033=g;smithi033=j;smithi043=b;smithi043=e;smithi043=h;smithi043=k;smithi102=c;smithi102=f;smithi102=i;smithi102=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:23:03.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:03 smithi033 ceph-mon[31246]: Saving service mds.all spec with placement smithi033=a;smithi033=d;smithi033=g;smithi033=j;smithi043=b;smithi043=e;smithi043=h;smithi043=k;smithi102=c;smithi102=f;smithi102=i;smithi102=l;count:12 2024-09-12T12:23:03.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:03 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:03.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:03 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:23:03.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:03 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:03.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:03 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:23:03.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:03 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:03.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:03 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:23:03.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:03 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:23:03.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:03 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:04.115 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:23:04.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.599+0000 7f8f01ef1640 1 -- 172.21.15.33:0/2034865315 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8efc100a70 msgr2=0x7f8efc100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:04.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.599+0000 7f8f01ef1640 1 --2- 172.21.15.33:0/2034865315 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8efc100a70 0x7f8efc100ed0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0009930 tx=0x7f8ef002a420 comp rx=0 tx=0).stop 2024-09-12T12:23:04.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.599+0000 7f8f01ef1640 1 -- 172.21.15.33:0/2034865315 shutdown_connections 2024-09-12T12:23:04.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.599+0000 7f8f01ef1640 1 --2- 172.21.15.33:0/2034865315 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8efc101410 0x7f8efc10d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:04.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.599+0000 7f8f01ef1640 1 --2- 172.21.15.33:0/2034865315 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8efc100a70 0x7f8efc100ed0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:04.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.599+0000 7f8f01ef1640 1 --2- 172.21.15.33:0/2034865315 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8efc106a70 0x7f8efc106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:04.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.599+0000 7f8f01ef1640 1 -- 172.21.15.33:0/2034865315 >> 172.21.15.33:0/2034865315 conn(0x7f8efc0fc790 msgr2=0x7f8efc0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:04.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.599+0000 7f8f01ef1640 1 -- 172.21.15.33:0/2034865315 shutdown_connections 2024-09-12T12:23:04.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.599+0000 7f8f01ef1640 1 -- 172.21.15.33:0/2034865315 wait complete. 2024-09-12T12:23:04.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.599+0000 7f8f01ef1640 1 Processor -- start 2024-09-12T12:23:04.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.600+0000 7f8f01ef1640 1 -- start start 2024-09-12T12:23:04.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.600+0000 7f8f01ef1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8efc100a70 0x7f8efc197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:04.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.600+0000 7f8f01ef1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8efc101410 0x7f8efc197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:04.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.600+0000 7f8f01ef1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8efc106a70 0x7f8efc19bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:04.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.600+0000 7f8f01ef1640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8efc110d20 con 0x7f8efc100a70 2024-09-12T12:23:04.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.600+0000 7f8f01ef1640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8efc110ba0 con 0x7f8efc101410 2024-09-12T12:23:04.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.600+0000 7f8f01ef1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8efc110ea0 con 0x7f8efc106a70 2024-09-12T12:23:04.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.600+0000 7f8efb7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8efc100a70 0x7f8efc197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:04.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.600+0000 7f8efb7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8efc100a70 0x7f8efc197300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50576/0 (socket says 172.21.15.33:50576) 2024-09-12T12:23:04.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.600+0000 7f8efb7fe640 1 -- 172.21.15.33:0/3500383208 learned_addr learned my addr 172.21.15.33:0/3500383208 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:23:04.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.600+0000 7f8efaffd640 1 --2- 172.21.15.33:0/3500383208 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8efc101410 0x7f8efc197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:04.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.600+0000 7f8efbfff640 1 --2- 172.21.15.33:0/3500383208 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8efc106a70 0x7f8efc19bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:04.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.600+0000 7f8efb7fe640 1 -- 172.21.15.33:0/3500383208 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8efc106a70 msgr2=0x7f8efc19bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:04.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.600+0000 7f8efb7fe640 1 --2- 172.21.15.33:0/3500383208 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8efc106a70 0x7f8efc19bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:04.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.600+0000 7f8efb7fe640 1 -- 172.21.15.33:0/3500383208 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8efc101410 msgr2=0x7f8efc197840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:04.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.600+0000 7f8efb7fe640 1 --2- 172.21.15.33:0/3500383208 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8efc101410 0x7f8efc197840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:04.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.600+0000 7f8efb7fe640 1 -- 172.21.15.33:0/3500383208 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8efc19c2b0 con 0x7f8efc100a70 2024-09-12T12:23:04.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.600+0000 7f8efb7fe640 1 --2- 172.21.15.33:0/3500383208 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8efc100a70 0x7f8efc197300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8eec00d770 tx=0x7f8eec00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:04.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.601+0000 7f8ef8ff9640 1 -- 172.21.15.33:0/3500383208 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eec017070 con 0x7f8efc100a70 2024-09-12T12:23:04.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.601+0000 7f8ef8ff9640 1 -- 172.21.15.33:0/3500383208 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8eec0054d0 con 0x7f8efc100a70 2024-09-12T12:23:04.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.601+0000 7f8f01ef1640 1 -- 172.21.15.33:0/3500383208 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8efc19c5a0 con 0x7f8efc100a70 2024-09-12T12:23:04.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.601+0000 7f8ef8ff9640 1 -- 172.21.15.33:0/3500383208 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eec004cf0 con 0x7f8efc100a70 2024-09-12T12:23:04.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.601+0000 7f8f01ef1640 1 -- 172.21.15.33:0/3500383208 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8efc1a3e80 con 0x7f8efc100a70 2024-09-12T12:23:04.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.602+0000 7f8f01ef1640 1 -- 172.21.15.33:0/3500383208 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8efc1021b0 con 0x7f8efc100a70 2024-09-12T12:23:04.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.603+0000 7f8ef8ff9640 1 -- 172.21.15.33:0/3500383208 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f8eec004e90 con 0x7f8efc100a70 2024-09-12T12:23:04.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.603+0000 7f8ef8ff9640 1 --2- 172.21.15.33:0/3500383208 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f8ee40a2b80 0x7f8ee40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:04.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.604+0000 7f8efaffd640 1 --2- 172.21.15.33:0/3500383208 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f8ee40a2b80 0x7f8ee40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:04.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.604+0000 7f8ef8ff9640 1 -- 172.21.15.33:0/3500383208 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f8eec0ce570 con 0x7f8efc100a70 2024-09-12T12:23:04.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.604+0000 7f8efaffd640 1 --2- 172.21.15.33:0/3500383208 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f8ee40a2b80 0x7f8ee40a5040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0009900 tx=0x7f8ef0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:04.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.608+0000 7f8ef8ff9640 1 -- 172.21.15.33:0/3500383208 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8eec09b970 con 0x7f8efc100a70 2024-09-12T12:23:04.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.821+0000 7f8f01ef1640 1 -- 172.21.15.33:0/3500383208 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8efc109000 con 0x7f8efc100a70 2024-09-12T12:23:04.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:04 smithi033 ceph-mon[31246]: Deploying daemon mds.l on smithi102 2024-09-12T12:23:04.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.821+0000 7f8ef8ff9640 1 -- 172.21.15.33:0/3500383208 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f8eec09b270 con 0x7f8efc100a70 2024-09-12T12:23:04.823 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:23:04.823 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":1,"btime":"2024-09-12T12:16:11:904584+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-12T12:23:04.823 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 1 2024-09-12T12:23:04.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.824+0000 7f8f01ef1640 1 -- 172.21.15.33:0/3500383208 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f8ee40a2b80 msgr2=0x7f8ee40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:04.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.824+0000 7f8f01ef1640 1 --2- 172.21.15.33:0/3500383208 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f8ee40a2b80 0x7f8ee40a5040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0009900 tx=0x7f8ef0000bc0 comp rx=0 tx=0).stop 2024-09-12T12:23:04.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.824+0000 7f8f01ef1640 1 -- 172.21.15.33:0/3500383208 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8efc100a70 msgr2=0x7f8efc197300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:04.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.824+0000 7f8f01ef1640 1 --2- 172.21.15.33:0/3500383208 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8efc100a70 0x7f8efc197300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8eec00d770 tx=0x7f8eec00dc30 comp rx=0 tx=0).stop 2024-09-12T12:23:04.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.824+0000 7f8f01ef1640 1 -- 172.21.15.33:0/3500383208 shutdown_connections 2024-09-12T12:23:04.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.824+0000 7f8f01ef1640 1 --2- 172.21.15.33:0/3500383208 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f8ee40a2b80 0x7f8ee40a5040 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:04.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.824+0000 7f8f01ef1640 1 --2- 172.21.15.33:0/3500383208 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8efc106a70 0x7f8efc19bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:04.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.824+0000 7f8f01ef1640 1 --2- 172.21.15.33:0/3500383208 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8efc101410 0x7f8efc197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:04.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.824+0000 7f8f01ef1640 1 --2- 172.21.15.33:0/3500383208 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8efc100a70 0x7f8efc197300 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:04.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.824+0000 7f8f01ef1640 1 -- 172.21.15.33:0/3500383208 >> 172.21.15.33:0/3500383208 conn(0x7f8efc0fc790 msgr2=0x7f8efc0fd140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:04.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.824+0000 7f8f01ef1640 1 -- 172.21.15.33:0/3500383208 shutdown_connections 2024-09-12T12:23:04.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:04.824+0000 7f8f01ef1640 1 -- 172.21.15.33:0/3500383208 wait complete. 2024-09-12T12:23:04.959 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:04 smithi102 ceph-mon[34799]: Deploying daemon mds.l on smithi102 2024-09-12T12:23:05.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:04 smithi043 ceph-mon[34144]: Deploying daemon mds.l on smithi102 2024-09-12T12:23:05.353 INFO:journalctl@ceph.mds.l.smithi102.stdout:Sep 12 12:23:05 smithi102 systemd[1]: Starting Ceph mds.l for a66dfafc-7100-11ef-bcea-c7b262605968... 2024-09-12T12:23:05.631 INFO:journalctl@ceph.mds.l.smithi102.stdout:Sep 12 12:23:05 smithi102 podman[63930]: 2024-09-12 12:23:05.256232246 +0000 UTC m=+0.015616242 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:23:05.631 INFO:journalctl@ceph.mds.l.smithi102.stdout:Sep 12 12:23:05 smithi102 podman[63930]: 2024-09-12 12:23:05.378947899 +0000 UTC m=+0.138331894 container create 2f116b64dca27020c945d3d148f8a3b26dcb353b6dd44c1a0ba160e9634e1d77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux ) 2024-09-12T12:23:05.631 INFO:journalctl@ceph.mds.l.smithi102.stdout:Sep 12 12:23:05 smithi102 podman[63930]: 2024-09-12 12:23:05.631840962 +0000 UTC m=+0.391224959 container init 2f116b64dca27020c945d3d148f8a3b26dcb353b6dd44c1a0ba160e9634e1d77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3) 2024-09-12T12:23:05.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:05 smithi102 ceph-mon[34799]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:05.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:05 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/3500383208' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:23:05.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:05 smithi102 ceph-mon[34799]: mds.? [v2:172.21.15.102:6832/3051713000,v1:172.21.15.102:6833/3051713000] up:boot 2024-09-12T12:23:05.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:05 smithi102 ceph-mon[34799]: fsmap 1 up:standby 2024-09-12T12:23:05.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:05 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T12:23:05.897 INFO:journalctl@ceph.mds.l.smithi102.stdout:Sep 12 12:23:05 smithi102 podman[63930]: 2024-09-12 12:23:05.634723716 +0000 UTC m=+0.394107723 container start 2f116b64dca27020c945d3d148f8a3b26dcb353b6dd44c1a0ba160e9634e1d77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-l, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-12T12:23:05.897 INFO:journalctl@ceph.mds.l.smithi102.stdout:Sep 12 12:23:05 smithi102 ceph-mds[63950]: -- 172.21.15.102:0/3895379856 <== mon.1 v2:172.21.15.102:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5612ff417860 con 0x5612ff3f4800 2024-09-12T12:23:05.897 INFO:journalctl@ceph.mds.l.smithi102.stdout:Sep 12 12:23:05 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-l[63946]: starting mds.l at 2024-09-12T12:23:05.898 INFO:journalctl@ceph.mds.l.smithi102.stdout:Sep 12 12:23:05 smithi102 bash[63930]: 2f116b64dca27020c945d3d148f8a3b26dcb353b6dd44c1a0ba160e9634e1d77 2024-09-12T12:23:05.898 INFO:journalctl@ceph.mds.l.smithi102.stdout:Sep 12 12:23:05 smithi102 systemd[1]: Started Ceph mds.l for a66dfafc-7100-11ef-bcea-c7b262605968. 2024-09-12T12:23:05.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:05 smithi033 ceph-mon[31246]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:05.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:05 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/3500383208' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:23:05.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:05 smithi033 ceph-mon[31246]: mds.? [v2:172.21.15.102:6832/3051713000,v1:172.21.15.102:6833/3051713000] up:boot 2024-09-12T12:23:05.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:05 smithi033 ceph-mon[31246]: fsmap 1 up:standby 2024-09-12T12:23:05.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:05 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T12:23:06.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:05 smithi043 ceph-mon[34144]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:06.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:05 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/3500383208' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:23:06.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:05 smithi043 ceph-mon[34144]: mds.? [v2:172.21.15.102:6832/3051713000,v1:172.21.15.102:6833/3051713000] up:boot 2024-09-12T12:23:06.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:05 smithi043 ceph-mon[34144]: fsmap 1 up:standby 2024-09-12T12:23:06.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:05 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T12:23:06.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:06 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:06.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:06 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:06.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:06 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:06.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:06 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:23:06.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:06 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:23:06.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:06 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:07.148 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:06 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:07.148 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:06 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:07.148 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:06 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:07.148 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:06 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:23:07.148 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:06 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:23:07.148 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:06 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:07.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:06 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:07.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:06 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:07.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:06 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:07.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:06 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:23:07.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:06 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:23:07.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:06 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:07.656 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:23:07.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:07 smithi043 ceph-mon[34144]: Deploying daemon mds.k on smithi043 2024-09-12T12:23:07.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:07 smithi043 ceph-mon[34144]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:07.866 INFO:journalctl@ceph.mds.k.smithi043.stdout:Sep 12 12:23:07 smithi043 systemd[1]: Starting Ceph mds.k for a66dfafc-7100-11ef-bcea-c7b262605968... 2024-09-12T12:23:07.924 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:23:07.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:07 smithi033 ceph-mon[31246]: Deploying daemon mds.k on smithi043 2024-09-12T12:23:07.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:07 smithi033 ceph-mon[31246]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:08.048 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:07 smithi102 ceph-mon[34799]: Deploying daemon mds.k on smithi043 2024-09-12T12:23:08.048 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:07 smithi102 ceph-mon[34799]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:08.273 INFO:journalctl@ceph.mds.k.smithi043.stdout:Sep 12 12:23:08 smithi043 podman[63599]: 2024-09-12 12:23:07.917664084 +0000 UTC m=+0.016476582 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:23:08.273 INFO:journalctl@ceph.mds.k.smithi043.stdout:Sep 12 12:23:08 smithi043 podman[63599]: 2024-09-12 12:23:08.019607924 +0000 UTC m=+0.118420455 container create 10eabded262488cece1bcd1460fc9d96b75f749f1bdfce1f02a6047b2f8ddbc6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-k, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-12T12:23:08.273 INFO:journalctl@ceph.mds.k.smithi043.stdout:Sep 12 12:23:08 smithi043 podman[63599]: 2024-09-12 12:23:08.247560318 +0000 UTC m=+0.346372806 container init 10eabded262488cece1bcd1460fc9d96b75f749f1bdfce1f02a6047b2f8ddbc6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-k, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-12T12:23:08.274 INFO:journalctl@ceph.mds.k.smithi043.stdout:Sep 12 12:23:08 smithi043 podman[63599]: 2024-09-12 12:23:08.250332724 +0000 UTC m=+0.349145210 container start 10eabded262488cece1bcd1460fc9d96b75f749f1bdfce1f02a6047b2f8ddbc6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-k, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True) 2024-09-12T12:23:08.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.561+0000 7fbb37a47640 1 -- 172.21.15.33:0/2947558768 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb30102ef0 msgr2=0x7fbb3010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:08.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.561+0000 7fbb37a47640 1 --2- 172.21.15.33:0/2947558768 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb30102ef0 0x7fbb3010da40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbb28009ca0 tx=0x7fbb2802a950 comp rx=0 tx=0).stop 2024-09-12T12:23:08.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.561+0000 7fbb37a47640 1 -- 172.21.15.33:0/2947558768 shutdown_connections 2024-09-12T12:23:08.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.561+0000 7fbb37a47640 1 --2- 172.21.15.33:0/2947558768 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb30102ef0 0x7fbb3010da40 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:08.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.561+0000 7fbb37a47640 1 --2- 172.21.15.33:0/2947558768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb30102570 0x7fbb301029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:08.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.561+0000 7fbb37a47640 1 --2- 172.21.15.33:0/2947558768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb30100e20 0x7fbb30101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:08.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.561+0000 7fbb37a47640 1 -- 172.21.15.33:0/2947558768 >> 172.21.15.33:0/2947558768 conn(0x7fbb300fc7d0 msgr2=0x7fbb300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:08.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.561+0000 7fbb37a47640 1 -- 172.21.15.33:0/2947558768 shutdown_connections 2024-09-12T12:23:08.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.561+0000 7fbb37a47640 1 -- 172.21.15.33:0/2947558768 wait complete. 2024-09-12T12:23:08.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.562+0000 7fbb37a47640 1 Processor -- start 2024-09-12T12:23:08.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.562+0000 7fbb37a47640 1 -- start start 2024-09-12T12:23:08.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.562+0000 7fbb37a47640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb30100e20 0x7fbb3019a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:08.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.562+0000 7fbb37a47640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb30102570 0x7fbb3019aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:08.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.562+0000 7fbb37a47640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb30102ef0 0x7fbb3019ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:08.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.562+0000 7fbb37a47640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fbb30110e30 con 0x7fbb30102570 2024-09-12T12:23:08.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.562+0000 7fbb37a47640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbb30110cb0 con 0x7fbb30100e20 2024-09-12T12:23:08.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.562+0000 7fbb37a47640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbb30110fb0 con 0x7fbb30102ef0 2024-09-12T12:23:08.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.562+0000 7fbb34fe2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb30102570 0x7fbb3019aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:08.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.563+0000 7fbb34fe2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb30102570 0x7fbb3019aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50598/0 (socket says 172.21.15.33:50598) 2024-09-12T12:23:08.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.563+0000 7fbb34fe2640 1 -- 172.21.15.33:0/679934625 learned_addr learned my addr 172.21.15.33:0/679934625 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:23:08.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.563+0000 7fbb357e3640 1 --2- 172.21.15.33:0/679934625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb30100e20 0x7fbb3019a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:08.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.563+0000 7fbb35fe4640 1 --2- 172.21.15.33:0/679934625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb30102ef0 0x7fbb3019ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:08.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.563+0000 7fbb34fe2640 1 -- 172.21.15.33:0/679934625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb30102ef0 msgr2=0x7fbb3019ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:08.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.563+0000 7fbb34fe2640 1 --2- 172.21.15.33:0/679934625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb30102ef0 0x7fbb3019ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:08.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.563+0000 7fbb34fe2640 1 -- 172.21.15.33:0/679934625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb30100e20 msgr2=0x7fbb3019a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:08.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.563+0000 7fbb34fe2640 1 --2- 172.21.15.33:0/679934625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb30100e20 0x7fbb3019a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:08.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.563+0000 7fbb34fe2640 1 -- 172.21.15.33:0/679934625 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb3019f4f0 con 0x7fbb30102570 2024-09-12T12:23:08.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.563+0000 7fbb357e3640 1 --2- 172.21.15.33:0/679934625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb30100e20 0x7fbb3019a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:23:08.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.563+0000 7fbb34fe2640 1 --2- 172.21.15.33:0/679934625 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb30102570 0x7fbb3019aa80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbb2000d950 tx=0x7fbb2000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:08.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.563+0000 7fbb267fc640 1 -- 172.21.15.33:0/679934625 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb20017030 con 0x7fbb30102570 2024-09-12T12:23:08.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.563+0000 7fbb37a47640 1 -- 172.21.15.33:0/679934625 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb3019f7e0 con 0x7fbb30102570 2024-09-12T12:23:08.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.563+0000 7fbb267fc640 1 -- 172.21.15.33:0/679934625 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbb20004020 con 0x7fbb30102570 2024-09-12T12:23:08.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.563+0000 7fbb267fc640 1 -- 172.21.15.33:0/679934625 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb200047a0 con 0x7fbb30102570 2024-09-12T12:23:08.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.563+0000 7fbb37a47640 1 -- 172.21.15.33:0/679934625 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb301a70c0 con 0x7fbb30102570 2024-09-12T12:23:08.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.564+0000 7fbb37a47640 1 -- 172.21.15.33:0/679934625 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb30101200 con 0x7fbb30102570 2024-09-12T12:23:08.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.565+0000 7fbb267fc640 1 -- 172.21.15.33:0/679934625 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fbb200041d0 con 0x7fbb30102570 2024-09-12T12:23:08.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.566+0000 7fbb267fc640 1 --2- 172.21.15.33:0/679934625 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fbb1c0a2b80 0x7fbb1c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:08.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.566+0000 7fbb357e3640 1 --2- 172.21.15.33:0/679934625 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fbb1c0a2b80 0x7fbb1c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:08.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.566+0000 7fbb267fc640 1 -- 172.21.15.33:0/679934625 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fbb200ce540 con 0x7fbb30102570 2024-09-12T12:23:08.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.567+0000 7fbb357e3640 1 --2- 172.21.15.33:0/679934625 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fbb1c0a2b80 0x7fbb1c0a5040 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c00bfd0 tx=0x7fbb2c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:08.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.571+0000 7fbb267fc640 1 -- 172.21.15.33:0/679934625 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbb2009b940 con 0x7fbb30102570 2024-09-12T12:23:08.615 INFO:journalctl@ceph.mds.k.smithi043.stdout:Sep 12 12:23:08 smithi043 ceph-mds[63619]: -- 172.21.15.43:0/18453217 <== mon.2 v2:172.21.15.43:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561e367b7860 con 0x561e36794800 2024-09-12T12:23:08.615 INFO:journalctl@ceph.mds.k.smithi043.stdout:Sep 12 12:23:08 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-k[63615]: starting mds.k at 2024-09-12T12:23:08.615 INFO:journalctl@ceph.mds.k.smithi043.stdout:Sep 12 12:23:08 smithi043 bash[63599]: 10eabded262488cece1bcd1460fc9d96b75f749f1bdfce1f02a6047b2f8ddbc6 2024-09-12T12:23:08.616 INFO:journalctl@ceph.mds.k.smithi043.stdout:Sep 12 12:23:08 smithi043 systemd[1]: Started Ceph mds.k for a66dfafc-7100-11ef-bcea-c7b262605968. 2024-09-12T12:23:08.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.787+0000 7fbb37a47640 1 -- 172.21.15.33:0/679934625 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbb301a72c0 con 0x7fbb30102570 2024-09-12T12:23:08.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.787+0000 7fbb267fc640 1 -- 172.21.15.33:0/679934625 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7fbb2009b240 con 0x7fbb30102570 2024-09-12T12:23:08.789 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:23:08.789 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":2,"btime":"2024-09-12T12:23:05:663306+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/3051713000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3051713000},{"type":"v1","addr":"172.21.15.102:6833","nonce":3051713000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T12:23:08.789 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 2 2024-09-12T12:23:08.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.790+0000 7fbb37a47640 1 -- 172.21.15.33:0/679934625 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fbb1c0a2b80 msgr2=0x7fbb1c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:08.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.790+0000 7fbb37a47640 1 --2- 172.21.15.33:0/679934625 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fbb1c0a2b80 0x7fbb1c0a5040 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c00bfd0 tx=0x7fbb2c00b390 comp rx=0 tx=0).stop 2024-09-12T12:23:08.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.790+0000 7fbb37a47640 1 -- 172.21.15.33:0/679934625 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb30102570 msgr2=0x7fbb3019aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:08.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.790+0000 7fbb37a47640 1 --2- 172.21.15.33:0/679934625 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb30102570 0x7fbb3019aa80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbb2000d950 tx=0x7fbb2000de10 comp rx=0 tx=0).stop 2024-09-12T12:23:08.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.790+0000 7fbb37a47640 1 -- 172.21.15.33:0/679934625 shutdown_connections 2024-09-12T12:23:08.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.790+0000 7fbb37a47640 1 --2- 172.21.15.33:0/679934625 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fbb1c0a2b80 0x7fbb1c0a5040 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:08.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.790+0000 7fbb37a47640 1 --2- 172.21.15.33:0/679934625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb30102ef0 0x7fbb3019ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:08.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.790+0000 7fbb37a47640 1 --2- 172.21.15.33:0/679934625 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb30102570 0x7fbb3019aa80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:08.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.790+0000 7fbb37a47640 1 --2- 172.21.15.33:0/679934625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb30100e20 0x7fbb3019a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:08.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.790+0000 7fbb37a47640 1 -- 172.21.15.33:0/679934625 >> 172.21.15.33:0/679934625 conn(0x7fbb300fc7d0 msgr2=0x7fbb3006a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:08.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.790+0000 7fbb37a47640 1 -- 172.21.15.33:0/679934625 shutdown_connections 2024-09-12T12:23:08.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:08.790+0000 7fbb37a47640 1 -- 172.21.15.33:0/679934625 wait complete. 2024-09-12T12:23:09.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:09 smithi102 ceph-mon[34799]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:09.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:09 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:09.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:09 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:09.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:09 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:09.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:09 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:23:09.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:09 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:23:09.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:09 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:09.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:09 smithi102 ceph-mon[34799]: Deploying daemon mds.j on smithi033 2024-09-12T12:23:09.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:09 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/679934625' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:23:09.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:09 smithi102 ceph-mon[34799]: mds.? [v2:172.21.15.43:6832/3051073141,v1:172.21.15.43:6833/3051073141] up:boot 2024-09-12T12:23:09.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:09 smithi102 ceph-mon[34799]: fsmap 2 up:standby 2024-09-12T12:23:09.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:09 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T12:23:09.677 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:09 smithi043 ceph-mon[34144]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:09.677 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:09 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:09.677 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:09 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:09.677 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:09 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:09.677 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:09 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:23:09.677 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:09 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:23:09.677 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:09 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:09.677 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:09 smithi043 ceph-mon[34144]: Deploying daemon mds.j on smithi033 2024-09-12T12:23:09.677 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:09 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/679934625' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:23:09.678 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:09 smithi043 ceph-mon[34144]: mds.? [v2:172.21.15.43:6832/3051073141,v1:172.21.15.43:6833/3051073141] up:boot 2024-09-12T12:23:09.678 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:09 smithi043 ceph-mon[34144]: fsmap 2 up:standby 2024-09-12T12:23:09.678 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:09 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T12:23:09.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:09 smithi033 ceph-mon[31246]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:09.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:09 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:09.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:09 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:09.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:09 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:09.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:09 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:23:09.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:09 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:23:09.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:09 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:09.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:09 smithi033 ceph-mon[31246]: Deploying daemon mds.j on smithi033 2024-09-12T12:23:09.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:09 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/679934625' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:23:09.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:09 smithi033 ceph-mon[31246]: mds.? [v2:172.21.15.43:6832/3051073141,v1:172.21.15.43:6833/3051073141] up:boot 2024-09-12T12:23:09.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:09 smithi033 ceph-mon[31246]: fsmap 2 up:standby 2024-09-12T12:23:09.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:09 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T12:23:11.039 INFO:journalctl@ceph.mds.j.smithi033.stdout:Sep 12 12:23:11 smithi033 podman[71067]: 2024-09-12 12:23:10.919942994 +0000 UTC m=+0.017540269 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:23:11.040 INFO:journalctl@ceph.mds.j.smithi033.stdout:Sep 12 12:23:11 smithi033 podman[71067]: 2024-09-12 12:23:11.040187459 +0000 UTC m=+0.137784733 container create d5fe62fc2d5727917ae935f49a70653ff57f3255a5a1054b395c5bcd709037ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-j, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-12T12:23:11.303 INFO:journalctl@ceph.mds.j.smithi033.stdout:Sep 12 12:23:11 smithi033 podman[71067]: 2024-09-12 12:23:11.27633846 +0000 UTC m=+0.373935735 container init d5fe62fc2d5727917ae935f49a70653ff57f3255a5a1054b395c5bcd709037ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-12T12:23:11.303 INFO:journalctl@ceph.mds.j.smithi033.stdout:Sep 12 12:23:11 smithi033 podman[71067]: 2024-09-12 12:23:11.279300437 +0000 UTC m=+0.376897712 container start d5fe62fc2d5727917ae935f49a70653ff57f3255a5a1054b395c5bcd709037ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-j, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-12T12:23:11.730 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:11 smithi033 ceph-mon[31246]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:11.731 INFO:journalctl@ceph.mds.j.smithi033.stdout:Sep 12 12:23:11 smithi033 ceph-mds[71087]: -- 172.21.15.33:0/3114937514 <== mon.0 v2:172.21.15.33:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5582cb245860 con 0x5582cb222800 2024-09-12T12:23:11.731 INFO:journalctl@ceph.mds.j.smithi033.stdout:Sep 12 12:23:11 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-j[71083]: starting mds.j at 2024-09-12T12:23:11.731 INFO:journalctl@ceph.mds.j.smithi033.stdout:Sep 12 12:23:11 smithi033 bash[71067]: d5fe62fc2d5727917ae935f49a70653ff57f3255a5a1054b395c5bcd709037ba 2024-09-12T12:23:11.731 INFO:journalctl@ceph.mds.j.smithi033.stdout:Sep 12 12:23:11 smithi033 systemd[1]: Started Ceph mds.j for a66dfafc-7100-11ef-bcea-c7b262605968. 2024-09-12T12:23:11.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:11 smithi043 ceph-mon[34144]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:11.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:11 smithi102 ceph-mon[34799]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:12.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:12 smithi033 ceph-mon[31246]: mds.? [v2:172.21.15.33:6834/3327066342,v1:172.21.15.33:6835/3327066342] up:boot 2024-09-12T12:23:12.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:12 smithi033 ceph-mon[31246]: fsmap 3 up:standby 2024-09-12T12:23:12.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:12 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T12:23:12.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:12 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:12.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:12 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:12.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:12 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:12.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:12 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:23:12.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:12 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:23:12.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:12 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:12.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:12 smithi033 ceph-mon[31246]: Deploying daemon mds.d on smithi033 2024-09-12T12:23:12.811 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:23:12.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:12 smithi043 ceph-mon[34144]: mds.? [v2:172.21.15.33:6834/3327066342,v1:172.21.15.33:6835/3327066342] up:boot 2024-09-12T12:23:12.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:12 smithi043 ceph-mon[34144]: fsmap 3 up:standby 2024-09-12T12:23:12.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:12 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T12:23:12.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:12 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:12.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:12 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:12.869 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:12 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:12.869 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:12 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:23:12.869 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:12 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:23:12.869 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:12 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:12.869 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:12 smithi043 ceph-mon[34144]: Deploying daemon mds.d on smithi033 2024-09-12T12:23:12.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:12 smithi102 ceph-mon[34799]: mds.? [v2:172.21.15.33:6834/3327066342,v1:172.21.15.33:6835/3327066342] up:boot 2024-09-12T12:23:12.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:12 smithi102 ceph-mon[34799]: fsmap 3 up:standby 2024-09-12T12:23:12.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:12 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T12:23:12.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:12 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:12.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:12 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:12.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:12 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:12.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:12 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:23:12.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:12 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:23:12.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:12 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:12.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:12 smithi102 ceph-mon[34799]: Deploying daemon mds.d on smithi033 2024-09-12T12:23:13.082 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:23:13.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:13 smithi033 ceph-mon[31246]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:13.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.685+0000 7f5133ebe640 1 -- 172.21.15.33:0/748832897 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f512c106f10 msgr2=0x7f512c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:13.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.685+0000 7f5133ebe640 1 --2- 172.21.15.33:0/748832897 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f512c106f10 0x7f512c10ea90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5124009ca0 tx=0x7f512402a8c0 comp rx=0 tx=0).stop 2024-09-12T12:23:13.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.685+0000 7f5133ebe640 1 -- 172.21.15.33:0/748832897 shutdown_connections 2024-09-12T12:23:13.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.685+0000 7f5133ebe640 1 --2- 172.21.15.33:0/748832897 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f512c106f10 0x7f512c10ea90 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:13.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.685+0000 7f5133ebe640 1 --2- 172.21.15.33:0/748832897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f512c102790 0x7f512c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:13.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.685+0000 7f5133ebe640 1 --2- 172.21.15.33:0/748832897 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f512c101de0 0x7f512c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:13.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.685+0000 7f5133ebe640 1 -- 172.21.15.33:0/748832897 >> 172.21.15.33:0/748832897 conn(0x7f512c0fd8c0 msgr2=0x7f512c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:13.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.685+0000 7f5133ebe640 1 -- 172.21.15.33:0/748832897 shutdown_connections 2024-09-12T12:23:13.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.685+0000 7f5133ebe640 1 -- 172.21.15.33:0/748832897 wait complete. 2024-09-12T12:23:13.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.685+0000 7f5133ebe640 1 Processor -- start 2024-09-12T12:23:13.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.685+0000 7f5133ebe640 1 -- start start 2024-09-12T12:23:13.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.686+0000 7f5133ebe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f512c101de0 0x7f512c1983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:13.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.686+0000 7f5133ebe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f512c102790 0x7f512c1988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:13.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.686+0000 7f5133ebe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f512c106f10 0x7f512c19cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:13.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.686+0000 7f5133ebe640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f512c111e90 con 0x7f512c102790 2024-09-12T12:23:13.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.686+0000 7f5133ebe640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f512c111d10 con 0x7f512c101de0 2024-09-12T12:23:13.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.686+0000 7f5133ebe640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f512c112010 con 0x7f512c106f10 2024-09-12T12:23:13.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.686+0000 7f5131459640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f512c102790 0x7f512c1988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:13.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.686+0000 7f5131459640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f512c102790 0x7f512c1988f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60196/0 (socket says 172.21.15.33:60196) 2024-09-12T12:23:13.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.686+0000 7f5131459640 1 -- 172.21.15.33:0/158581570 learned_addr learned my addr 172.21.15.33:0/158581570 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:23:13.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.686+0000 7f5131c5a640 1 --2- 172.21.15.33:0/158581570 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f512c101de0 0x7f512c1983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:13.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.686+0000 7f513245b640 1 --2- 172.21.15.33:0/158581570 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f512c106f10 0x7f512c19cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:13.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.686+0000 7f5131459640 1 -- 172.21.15.33:0/158581570 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f512c106f10 msgr2=0x7f512c19cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:13.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.686+0000 7f5131459640 1 --2- 172.21.15.33:0/158581570 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f512c106f10 0x7f512c19cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:13.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.686+0000 7f5131459640 1 -- 172.21.15.33:0/158581570 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f512c101de0 msgr2=0x7f512c1983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:13.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.686+0000 7f5131459640 1 --2- 172.21.15.33:0/158581570 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f512c101de0 0x7f512c1983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:13.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.686+0000 7f5131459640 1 -- 172.21.15.33:0/158581570 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f512c19d360 con 0x7f512c102790 2024-09-12T12:23:13.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.686+0000 7f5131c5a640 1 --2- 172.21.15.33:0/158581570 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f512c101de0 0x7f512c1983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:23:13.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.686+0000 7f5131459640 1 --2- 172.21.15.33:0/158581570 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f512c102790 0x7f512c1988f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f511c00c920 tx=0x7f511c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:13.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.687+0000 7f5122ffd640 1 -- 172.21.15.33:0/158581570 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f511c007c70 con 0x7f512c102790 2024-09-12T12:23:13.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.687+0000 7f5133ebe640 1 -- 172.21.15.33:0/158581570 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f512c19d650 con 0x7f512c102790 2024-09-12T12:23:13.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.687+0000 7f5122ffd640 1 -- 172.21.15.33:0/158581570 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f511c007e10 con 0x7f512c102790 2024-09-12T12:23:13.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.687+0000 7f5122ffd640 1 -- 172.21.15.33:0/158581570 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f511c018820 con 0x7f512c102790 2024-09-12T12:23:13.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.687+0000 7f5133ebe640 1 -- 172.21.15.33:0/158581570 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f512c1a4f30 con 0x7f512c102790 2024-09-12T12:23:13.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.688+0000 7f5133ebe640 1 -- 172.21.15.33:0/158581570 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f512c1021c0 con 0x7f512c102790 2024-09-12T12:23:13.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.690+0000 7f5122ffd640 1 -- 172.21.15.33:0/158581570 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f511c0189c0 con 0x7f512c102790 2024-09-12T12:23:13.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.690+0000 7f5122ffd640 1 --2- 172.21.15.33:0/158581570 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f51180a2b80 0x7f51180a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:13.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.691+0000 7f5131c5a640 1 --2- 172.21.15.33:0/158581570 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f51180a2b80 0x7f51180a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:13.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.691+0000 7f5122ffd640 1 -- 172.21.15.33:0/158581570 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f511c0cf050 con 0x7f512c102790 2024-09-12T12:23:13.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.691+0000 7f5131c5a640 1 --2- 172.21.15.33:0/158581570 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f51180a2b80 0x7f51180a5040 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5128009930 tx=0x7f5128008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:13.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.694+0000 7f5122ffd640 1 -- 172.21.15.33:0/158581570 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f511c014030 con 0x7f512c102790 2024-09-12T12:23:13.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:13 smithi043 ceph-mon[34144]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:13.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:13 smithi102 ceph-mon[34799]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:13.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.920+0000 7f5133ebe640 1 -- 172.21.15.33:0/158581570 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f512c10a120 con 0x7f512c102790 2024-09-12T12:23:13.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.920+0000 7f5122ffd640 1 -- 172.21.15.33:0/158581570 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3088 (secure 0 0 0) 0x7f511c09c4e0 con 0x7f512c102790 2024-09-12T12:23:13.921 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:23:13.922 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":4,"btime":"2024-09-12T12:23:11:391844+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3327066342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3327066342},{"type":"v1","addr":"172.21.15.33:6835","nonce":3327066342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/3051073141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3051073141},{"type":"v1","addr":"172.21.15.43:6833","nonce":3051073141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/3051713000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3051713000},{"type":"v1","addr":"172.21.15.102:6833","nonce":3051713000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T12:23:13.922 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 4 2024-09-12T12:23:13.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.922+0000 7f5133ebe640 1 -- 172.21.15.33:0/158581570 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f51180a2b80 msgr2=0x7f51180a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:13.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.922+0000 7f5133ebe640 1 --2- 172.21.15.33:0/158581570 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f51180a2b80 0x7f51180a5040 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5128009930 tx=0x7f5128008040 comp rx=0 tx=0).stop 2024-09-12T12:23:13.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.922+0000 7f5133ebe640 1 -- 172.21.15.33:0/158581570 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f512c102790 msgr2=0x7f512c1988f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:13.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.922+0000 7f5133ebe640 1 --2- 172.21.15.33:0/158581570 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f512c102790 0x7f512c1988f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f511c00c920 tx=0x7f511c00cde0 comp rx=0 tx=0).stop 2024-09-12T12:23:13.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.922+0000 7f5133ebe640 1 -- 172.21.15.33:0/158581570 shutdown_connections 2024-09-12T12:23:13.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.922+0000 7f5133ebe640 1 --2- 172.21.15.33:0/158581570 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f51180a2b80 0x7f51180a5040 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:13.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.922+0000 7f5133ebe640 1 --2- 172.21.15.33:0/158581570 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f512c106f10 0x7f512c19cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:13.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.922+0000 7f5133ebe640 1 --2- 172.21.15.33:0/158581570 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f512c102790 0x7f512c1988f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:13.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.922+0000 7f5133ebe640 1 --2- 172.21.15.33:0/158581570 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f512c101de0 0x7f512c1983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:13.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.922+0000 7f5133ebe640 1 -- 172.21.15.33:0/158581570 >> 172.21.15.33:0/158581570 conn(0x7f512c0fd8c0 msgr2=0x7f512c0febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:13.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.923+0000 7f5133ebe640 1 -- 172.21.15.33:0/158581570 shutdown_connections 2024-09-12T12:23:13.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:13.923+0000 7f5133ebe640 1 -- 172.21.15.33:0/158581570 wait complete. 2024-09-12T12:23:14.625 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:14 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/158581570' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:23:14.625 INFO:journalctl@ceph.mds.d.smithi033.stdout:Sep 12 12:23:14 smithi033 systemd[1]: Started Ceph mds.d for a66dfafc-7100-11ef-bcea-c7b262605968. 2024-09-12T12:23:14.781 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:14 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/158581570' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:23:14.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:14 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/158581570' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:23:15.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:15 smithi033 ceph-mon[31246]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:15.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:15 smithi033 ceph-mon[31246]: mds.? [v2:172.21.15.33:6836/19516401,v1:172.21.15.33:6837/19516401] up:boot 2024-09-12T12:23:15.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:15 smithi033 ceph-mon[31246]: fsmap 4 up:standby 2024-09-12T12:23:15.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:15 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T12:23:15.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:15 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:15.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:15 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:15.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:15 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:15.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:15 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:23:15.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:15 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:23:15.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:15 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:15.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:15 smithi033 ceph-mon[31246]: Deploying daemon mds.e on smithi043 2024-09-12T12:23:15.787 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:15 smithi043 ceph-mon[34144]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:15.788 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:15 smithi043 ceph-mon[34144]: mds.? [v2:172.21.15.33:6836/19516401,v1:172.21.15.33:6837/19516401] up:boot 2024-09-12T12:23:15.788 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:15 smithi043 ceph-mon[34144]: fsmap 4 up:standby 2024-09-12T12:23:15.788 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:15 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T12:23:15.788 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:15 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:15.788 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:15 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:15.788 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:15 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:15.788 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:15 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:23:15.788 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:15 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:23:15.788 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:15 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:15.789 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:15 smithi043 ceph-mon[34144]: Deploying daemon mds.e on smithi043 2024-09-12T12:23:15.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:15 smithi102 ceph-mon[34799]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:15.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:15 smithi102 ceph-mon[34799]: mds.? [v2:172.21.15.33:6836/19516401,v1:172.21.15.33:6837/19516401] up:boot 2024-09-12T12:23:15.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:15 smithi102 ceph-mon[34799]: fsmap 4 up:standby 2024-09-12T12:23:15.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:15 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T12:23:15.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:15 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:15.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:15 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:15.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:15 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:15.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:15 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:23:15.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:15 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:23:15.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:15 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:15.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:15 smithi102 ceph-mon[34799]: Deploying daemon mds.e on smithi043 2024-09-12T12:23:17.065 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:23:17.116 INFO:journalctl@ceph.mds.e.smithi043.stdout:Sep 12 12:23:17 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-e[63934]: starting mds.e at 2024-09-12T12:23:17.343 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:23:17.430 INFO:journalctl@ceph.mds.e.smithi043.stdout:Sep 12 12:23:17 smithi043 bash[63919]: 4e4042335ac0b843a2ed94ca99fcc674b93cb967c47733f7046259ea1f2860cb 2024-09-12T12:23:17.431 INFO:journalctl@ceph.mds.e.smithi043.stdout:Sep 12 12:23:17 smithi043 systemd[1]: Started Ceph mds.e for a66dfafc-7100-11ef-bcea-c7b262605968. 2024-09-12T12:23:17.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:17 smithi033 ceph-mon[31246]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:17.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:17 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:17.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:17 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:17.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:17 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:17.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:17 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:23:17.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:17 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:23:17.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:17 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:17.732 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:17 smithi102 ceph-mon[34799]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:17.732 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:17 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:17.732 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:17 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:17.732 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:17 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:17.732 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:17 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:23:17.732 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:17 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:23:17.732 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:17 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:17.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:17.823+0000 7f53886ad640 1 -- 172.21.15.33:0/695410099 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f538010e4f0 msgr2=0x7f5380110900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:17.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:17.823+0000 7f53886ad640 1 --2- 172.21.15.33:0/695410099 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f538010e4f0 0x7f5380110900 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5378009ca0 tx=0x7f537802a8c0 comp rx=0 tx=0).stop 2024-09-12T12:23:17.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:17.823+0000 7f53886ad640 1 -- 172.21.15.33:0/695410099 shutdown_connections 2024-09-12T12:23:17.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:17.823+0000 7f53886ad640 1 --2- 172.21.15.33:0/695410099 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f538010e4f0 0x7f5380110900 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:17.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:17.823+0000 7f53886ad640 1 --2- 172.21.15.33:0/695410099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5380101380 0x7f538010dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:17.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:17.823+0000 7f53886ad640 1 --2- 172.21.15.33:0/695410099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53801009d0 0x7f5380100db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:17.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:17.823+0000 7f53886ad640 1 -- 172.21.15.33:0/695410099 >> 172.21.15.33:0/695410099 conn(0x7f53800fc7d0 msgr2=0x7f53800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:17.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:17.823+0000 7f53886ad640 1 -- 172.21.15.33:0/695410099 shutdown_connections 2024-09-12T12:23:17.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:17.823+0000 7f53886ad640 1 -- 172.21.15.33:0/695410099 wait complete. 2024-09-12T12:23:17.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:17.824+0000 7f53886ad640 1 Processor -- start 2024-09-12T12:23:17.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:17.824+0000 7f53886ad640 1 -- start start 2024-09-12T12:23:17.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:17.824+0000 7f53886ad640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53801009d0 0x7f538019a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:17.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:17.824+0000 7f53886ad640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5380101380 0x7f538019aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:17.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:17.824+0000 7f53886ad640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f538010e4f0 0x7f538019ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:17.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:17.824+0000 7f53886ad640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5380114100 con 0x7f53801009d0 2024-09-12T12:23:17.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:17.824+0000 7f53886ad640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5380113f80 con 0x7f538010e4f0 2024-09-12T12:23:17.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:17.824+0000 7f53886ad640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5380114280 con 0x7f5380101380 2024-09-12T12:23:17.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:17.824+0000 7f5386449640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53801009d0 0x7f538019a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:17.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:17.824+0000 7f5386449640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53801009d0 0x7f538019a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60226/0 (socket says 172.21.15.33:60226) 2024-09-12T12:23:17.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:17.824+0000 7f5386449640 1 -- 172.21.15.33:0/765624598 learned_addr learned my addr 172.21.15.33:0/765624598 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:23:17.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:17.824+0000 7f5386c4a640 1 --2- 172.21.15.33:0/765624598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f538010e4f0 0x7f538019ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:17.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:17.824+0000 7f5385c48640 1 --2- 172.21.15.33:0/765624598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5380101380 0x7f538019aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:17.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:17.824+0000 7f5386449640 1 -- 172.21.15.33:0/765624598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5380101380 msgr2=0x7f538019aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:17.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:17.824+0000 7f5386449640 1 --2- 172.21.15.33:0/765624598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5380101380 0x7f538019aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:17.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:17.824+0000 7f5386449640 1 -- 172.21.15.33:0/765624598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f538010e4f0 msgr2=0x7f538019ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:17.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:17.824+0000 7f5386449640 1 --2- 172.21.15.33:0/765624598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f538010e4f0 0x7f538019ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:17.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:17.824+0000 7f5386449640 1 -- 172.21.15.33:0/765624598 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f538019f540 con 0x7f53801009d0 2024-09-12T12:23:17.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:17.824+0000 7f5386c4a640 1 --2- 172.21.15.33:0/765624598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f538010e4f0 0x7f538019ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:23:17.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:17.824+0000 7f5385c48640 1 --2- 172.21.15.33:0/765624598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5380101380 0x7f538019aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:23:17.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:17.824+0000 7f5386449640 1 --2- 172.21.15.33:0/765624598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53801009d0 0x7f538019a590 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f537c00c920 tx=0x7f537c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:17.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:17.825+0000 7f53777fe640 1 -- 172.21.15.33:0/765624598 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f537c007c70 con 0x7f53801009d0 2024-09-12T12:23:17.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:17.825+0000 7f53777fe640 1 -- 172.21.15.33:0/765624598 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f537c007e10 con 0x7f53801009d0 2024-09-12T12:23:17.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:17.825+0000 7f53886ad640 1 -- 172.21.15.33:0/765624598 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f538019f830 con 0x7f53801009d0 2024-09-12T12:23:17.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:17.825+0000 7f53777fe640 1 -- 172.21.15.33:0/765624598 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f537c018820 con 0x7f53801009d0 2024-09-12T12:23:17.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:17.825+0000 7f53886ad640 1 -- 172.21.15.33:0/765624598 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53801a7110 con 0x7f53801009d0 2024-09-12T12:23:17.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:17.826+0000 7f53886ad640 1 -- 172.21.15.33:0/765624598 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5380100db0 con 0x7f53801009d0 2024-09-12T12:23:17.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:17.827+0000 7f53777fe640 1 -- 172.21.15.33:0/765624598 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f537c0189c0 con 0x7f53801009d0 2024-09-12T12:23:17.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:17.828+0000 7f53777fe640 1 --2- 172.21.15.33:0/765624598 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f536c0a2b80 0x7f536c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:17.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:17.828+0000 7f5385c48640 1 --2- 172.21.15.33:0/765624598 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f536c0a2b80 0x7f536c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:17.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:17.828+0000 7f53777fe640 1 -- 172.21.15.33:0/765624598 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f537c0cf050 con 0x7f53801009d0 2024-09-12T12:23:17.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:17.828+0000 7f5385c48640 1 --2- 172.21.15.33:0/765624598 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f536c0a2b80 0x7f536c0a5040 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5370005fd0 tx=0x7f53700094d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:17.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:17.831+0000 7f53777fe640 1 -- 172.21.15.33:0/765624598 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f537c014030 con 0x7f53801009d0 2024-09-12T12:23:17.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:17 smithi043 ceph-mon[34144]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:17.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:17 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:17.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:17 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:17.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:17 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:17.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:17 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:23:17.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:17 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:23:17.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:17 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:18.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:18.041+0000 7f53886ad640 1 -- 172.21.15.33:0/765624598 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f538019b8f0 con 0x7f53801009d0 2024-09-12T12:23:18.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:18.041+0000 7f53777fe640 1 -- 172.21.15.33:0/765624598 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4732 (secure 0 0 0) 0x7f537c09c4e0 con 0x7f53801009d0 2024-09-12T12:23:18.042 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:23:18.042 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":6,"btime":"2024-09-12T12:23:17:430096+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3327066342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3327066342},{"type":"v1","addr":"172.21.15.33:6835","nonce":3327066342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/19516401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":19516401},{"type":"v1","addr":"172.21.15.33:6837","nonce":19516401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/3051073141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3051073141},{"type":"v1","addr":"172.21.15.43:6833","nonce":3051073141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3282762800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3282762800},{"type":"v1","addr":"172.21.15.43:6835","nonce":3282762800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/3051713000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3051713000},{"type":"v1","addr":"172.21.15.102:6833","nonce":3051713000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T12:23:18.043 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 6 2024-09-12T12:23:18.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:18.044+0000 7f53886ad640 1 -- 172.21.15.33:0/765624598 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f536c0a2b80 msgr2=0x7f536c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:18.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:18.044+0000 7f53886ad640 1 --2- 172.21.15.33:0/765624598 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f536c0a2b80 0x7f536c0a5040 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5370005fd0 tx=0x7f53700094d0 comp rx=0 tx=0).stop 2024-09-12T12:23:18.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:18.044+0000 7f53886ad640 1 -- 172.21.15.33:0/765624598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53801009d0 msgr2=0x7f538019a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:18.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:18.044+0000 7f53886ad640 1 --2- 172.21.15.33:0/765624598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53801009d0 0x7f538019a590 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f537c00c920 tx=0x7f537c00cde0 comp rx=0 tx=0).stop 2024-09-12T12:23:18.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:18.044+0000 7f53886ad640 1 -- 172.21.15.33:0/765624598 shutdown_connections 2024-09-12T12:23:18.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:18.044+0000 7f53886ad640 1 --2- 172.21.15.33:0/765624598 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f536c0a2b80 0x7f536c0a5040 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:18.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:18.044+0000 7f53886ad640 1 --2- 172.21.15.33:0/765624598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f538010e4f0 0x7f538019ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:18.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:18.044+0000 7f53886ad640 1 --2- 172.21.15.33:0/765624598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5380101380 0x7f538019aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:18.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:18.044+0000 7f53886ad640 1 --2- 172.21.15.33:0/765624598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53801009d0 0x7f538019a590 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:18.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:18.044+0000 7f53886ad640 1 -- 172.21.15.33:0/765624598 >> 172.21.15.33:0/765624598 conn(0x7f53800fc7d0 msgr2=0x7f53800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:18.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:18.044+0000 7f53886ad640 1 -- 172.21.15.33:0/765624598 shutdown_connections 2024-09-12T12:23:18.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:18.044+0000 7f53886ad640 1 -- 172.21.15.33:0/765624598 wait complete. 2024-09-12T12:23:18.707 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:18 smithi102 ceph-mon[34799]: Deploying daemon mds.f on smithi102 2024-09-12T12:23:18.707 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:18 smithi102 ceph-mon[34799]: mds.? [v2:172.21.15.43:6834/3282762800,v1:172.21.15.43:6835/3282762800] up:boot 2024-09-12T12:23:18.707 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:18 smithi102 ceph-mon[34799]: fsmap 5 up:standby 2024-09-12T12:23:18.707 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:18 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T12:23:18.707 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:18 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/765624598' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:23:18.730 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:18 smithi033 ceph-mon[31246]: Deploying daemon mds.f on smithi102 2024-09-12T12:23:18.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:18 smithi033 ceph-mon[31246]: mds.? [v2:172.21.15.43:6834/3282762800,v1:172.21.15.43:6835/3282762800] up:boot 2024-09-12T12:23:18.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:18 smithi033 ceph-mon[31246]: fsmap 5 up:standby 2024-09-12T12:23:18.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:18 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T12:23:18.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:18 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/765624598' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:23:18.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:18 smithi043 ceph-mon[34144]: Deploying daemon mds.f on smithi102 2024-09-12T12:23:18.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:18 smithi043 ceph-mon[34144]: mds.? [v2:172.21.15.43:6834/3282762800,v1:172.21.15.43:6835/3282762800] up:boot 2024-09-12T12:23:18.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:18 smithi043 ceph-mon[34144]: fsmap 5 up:standby 2024-09-12T12:23:18.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:18 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T12:23:18.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:18 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/765624598' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:23:19.396 INFO:journalctl@ceph.mds.f.smithi102.stdout:Sep 12 12:23:19 smithi102 podman[64234]: 2024-09-12 12:23:19.334474662 +0000 UTC m=+0.136824295 container create eea3bb9da805cd817fc39fe371265e3fb80af030950c8b38835867baf56bf6c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-f, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-12T12:23:19.730 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:19 smithi033 ceph-mon[31246]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:19.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:19 smithi043 ceph-mon[34144]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:19.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:19 smithi102 ceph-mon[34799]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:19.897 INFO:journalctl@ceph.mds.f.smithi102.stdout:Sep 12 12:23:19 smithi102 podman[64234]: 2024-09-12 12:23:19.579120761 +0000 UTC m=+0.381470414 container init eea3bb9da805cd817fc39fe371265e3fb80af030950c8b38835867baf56bf6c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-f, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-12T12:23:19.897 INFO:journalctl@ceph.mds.f.smithi102.stdout:Sep 12 12:23:19 smithi102 podman[64234]: 2024-09-12 12:23:19.581935206 +0000 UTC m=+0.384284852 container start eea3bb9da805cd817fc39fe371265e3fb80af030950c8b38835867baf56bf6c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-12T12:23:19.897 INFO:journalctl@ceph.mds.f.smithi102.stdout:Sep 12 12:23:19 smithi102 ceph-mds[64253]: -- 172.21.15.102:0/2302039479 <== mon.1 v2:172.21.15.102:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b2150d5860 con 0x55b2150b3400 2024-09-12T12:23:19.897 INFO:journalctl@ceph.mds.f.smithi102.stdout:Sep 12 12:23:19 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-f[64249]: starting mds.f at 2024-09-12T12:23:19.897 INFO:journalctl@ceph.mds.f.smithi102.stdout:Sep 12 12:23:19 smithi102 bash[64234]: eea3bb9da805cd817fc39fe371265e3fb80af030950c8b38835867baf56bf6c5 2024-09-12T12:23:19.897 INFO:journalctl@ceph.mds.f.smithi102.stdout:Sep 12 12:23:19 smithi102 systemd[1]: Started Ceph mds.f for a66dfafc-7100-11ef-bcea-c7b262605968. 2024-09-12T12:23:20.924 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:23:20.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:20 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:20.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:20 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:20.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:20 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:20.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:20 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:23:20.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:20 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:23:20.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:20 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:20.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:20 smithi033 ceph-mon[31246]: Deploying daemon mds.c on smithi102 2024-09-12T12:23:20.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:20 smithi033 ceph-mon[31246]: mds.? [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] up:boot 2024-09-12T12:23:20.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:20 smithi033 ceph-mon[31246]: fsmap 6 up:standby 2024-09-12T12:23:20.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:20 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T12:23:21.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:20 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:21.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:20 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:21.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:20 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:21.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:20 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:23:21.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:20 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:23:21.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:20 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:21.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:20 smithi043 ceph-mon[34144]: Deploying daemon mds.c on smithi102 2024-09-12T12:23:21.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:20 smithi043 ceph-mon[34144]: mds.? [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] up:boot 2024-09-12T12:23:21.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:20 smithi043 ceph-mon[34144]: fsmap 6 up:standby 2024-09-12T12:23:21.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:20 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T12:23:21.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:20 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:21.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:20 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:21.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:20 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:21.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:20 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:23:21.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:20 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:23:21.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:20 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:21.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:20 smithi102 ceph-mon[34799]: Deploying daemon mds.c on smithi102 2024-09-12T12:23:21.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:20 smithi102 ceph-mon[34799]: mds.? [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] up:boot 2024-09-12T12:23:21.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:20 smithi102 ceph-mon[34799]: fsmap 6 up:standby 2024-09-12T12:23:21.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:20 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T12:23:21.190 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:23:21.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.698+0000 7f0a27c55640 1 -- 172.21.15.33:0/3935874868 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a20112b90 msgr2=0x7f0a20114f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:21.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.698+0000 7f0a27c55640 1 --2- 172.21.15.33:0/3935874868 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a20112b90 0x7f0a20114f80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0a18009ca0 tx=0x7f0a1802a950 comp rx=0 tx=0).stop 2024-09-12T12:23:21.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.698+0000 7f0a27c55640 1 -- 172.21.15.33:0/3935874868 shutdown_connections 2024-09-12T12:23:21.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.698+0000 7f0a27c55640 1 --2- 172.21.15.33:0/3935874868 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a20112b90 0x7f0a20114f80 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:21.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.698+0000 7f0a27c55640 1 --2- 172.21.15.33:0/3935874868 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a20074eb0 0x7f0a20112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:21.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.698+0000 7f0a27c55640 1 --2- 172.21.15.33:0/3935874868 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0a20074590 0x7f0a20074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:21.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.698+0000 7f0a27c55640 1 -- 172.21.15.33:0/3935874868 >> 172.21.15.33:0/3935874868 conn(0x7f0a200fd8c0 msgr2=0x7f0a200ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:21.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.698+0000 7f0a27c55640 1 -- 172.21.15.33:0/3935874868 shutdown_connections 2024-09-12T12:23:21.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.698+0000 7f0a27c55640 1 -- 172.21.15.33:0/3935874868 wait complete. 2024-09-12T12:23:21.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.698+0000 7f0a27c55640 1 Processor -- start 2024-09-12T12:23:21.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.698+0000 7f0a27c55640 1 -- start start 2024-09-12T12:23:21.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.699+0000 7f0a27c55640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a20074590 0x7f0a201a4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:21.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.699+0000 7f0a27c55640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a20074eb0 0x7f0a201a4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:21.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.699+0000 7f0a27c55640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0a20112b90 0x7f0a2019e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:21.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.699+0000 7f0a27c55640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0a20118400 con 0x7f0a20074590 2024-09-12T12:23:21.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.699+0000 7f0a27c55640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0a20118280 con 0x7f0a20074eb0 2024-09-12T12:23:21.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.699+0000 7f0a27c55640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0a20118580 con 0x7f0a20112b90 2024-09-12T12:23:21.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.699+0000 7f0a259f1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a20074590 0x7f0a201a4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:21.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.699+0000 7f0a259f1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a20074590 0x7f0a201a4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54268/0 (socket says 172.21.15.33:54268) 2024-09-12T12:23:21.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.699+0000 7f0a259f1640 1 -- 172.21.15.33:0/1047237394 learned_addr learned my addr 172.21.15.33:0/1047237394 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:23:21.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.699+0000 7f0a261f2640 1 --2- 172.21.15.33:0/1047237394 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0a20112b90 0x7f0a2019e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:21.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.699+0000 7f0a251f0640 1 --2- 172.21.15.33:0/1047237394 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a20074eb0 0x7f0a201a4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:21.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.699+0000 7f0a259f1640 1 -- 172.21.15.33:0/1047237394 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0a20112b90 msgr2=0x7f0a2019e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:21.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.699+0000 7f0a259f1640 1 --2- 172.21.15.33:0/1047237394 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0a20112b90 0x7f0a2019e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:21.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.699+0000 7f0a259f1640 1 -- 172.21.15.33:0/1047237394 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a20074eb0 msgr2=0x7f0a201a4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:21.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.699+0000 7f0a259f1640 1 --2- 172.21.15.33:0/1047237394 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a20074eb0 0x7f0a201a4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:21.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.699+0000 7f0a259f1640 1 -- 172.21.15.33:0/1047237394 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a2019ef50 con 0x7f0a20074590 2024-09-12T12:23:21.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.699+0000 7f0a251f0640 1 --2- 172.21.15.33:0/1047237394 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a20074eb0 0x7f0a201a4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:23:21.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.699+0000 7f0a259f1640 1 --2- 172.21.15.33:0/1047237394 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a20074590 0x7f0a201a4630 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0a1400e9f0 tx=0x7f0a1400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:21.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.699+0000 7f0a12ffd640 1 -- 172.21.15.33:0/1047237394 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a1400cd80 con 0x7f0a20074590 2024-09-12T12:23:21.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.699+0000 7f0a12ffd640 1 -- 172.21.15.33:0/1047237394 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0a140108e0 con 0x7f0a20074590 2024-09-12T12:23:21.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.699+0000 7f0a27c55640 1 -- 172.21.15.33:0/1047237394 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a2019f240 con 0x7f0a20074590 2024-09-12T12:23:21.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.699+0000 7f0a12ffd640 1 -- 172.21.15.33:0/1047237394 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a14018920 con 0x7f0a20074590 2024-09-12T12:23:21.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.699+0000 7f0a27c55640 1 -- 172.21.15.33:0/1047237394 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a201ab490 con 0x7f0a20074590 2024-09-12T12:23:21.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.700+0000 7f0a27c55640 1 -- 172.21.15.33:0/1047237394 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a20075cd0 con 0x7f0a20074590 2024-09-12T12:23:21.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.702+0000 7f0a12ffd640 1 -- 172.21.15.33:0/1047237394 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f0a14010a90 con 0x7f0a20074590 2024-09-12T12:23:21.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.702+0000 7f0a12ffd640 1 --2- 172.21.15.33:0/1047237394 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0a0c0a2b80 0x7f0a0c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:21.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.702+0000 7f0a251f0640 1 --2- 172.21.15.33:0/1047237394 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0a0c0a2b80 0x7f0a0c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:21.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.702+0000 7f0a12ffd640 1 -- 172.21.15.33:0/1047237394 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f0a140cef20 con 0x7f0a20074590 2024-09-12T12:23:21.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.703+0000 7f0a251f0640 1 --2- 172.21.15.33:0/1047237394 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0a0c0a2b80 0x7f0a0c0a5040 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c005d90 tx=0x7f0a1c005d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:21.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.706+0000 7f0a12ffd640 1 -- 172.21.15.33:0/1047237394 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0a1409c320 con 0x7f0a20074590 2024-09-12T12:23:21.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:21 smithi102 ceph-mon[34799]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:21.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.919+0000 7f0a27c55640 1 -- 172.21.15.33:0/1047237394 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0a2019fce0 con 0x7f0a20074590 2024-09-12T12:23:21.919 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:21 smithi033 ceph-mon[31246]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:21.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.919+0000 7f0a12ffd640 1 -- 172.21.15.33:0/1047237394 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5560 (secure 0 0 0) 0x7f0a2019fce0 con 0x7f0a20074590 2024-09-12T12:23:21.920 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:23:21.920 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":7,"btime":"2024-09-12T12:23:20:443739+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3327066342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3327066342},{"type":"v1","addr":"172.21.15.33:6835","nonce":3327066342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/19516401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":19516401},{"type":"v1","addr":"172.21.15.33:6837","nonce":19516401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/3051073141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3051073141},{"type":"v1","addr":"172.21.15.43:6833","nonce":3051073141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3282762800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3282762800},{"type":"v1","addr":"172.21.15.43:6835","nonce":3282762800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/3051713000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3051713000},{"type":"v1","addr":"172.21.15.102:6833","nonce":3051713000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24478,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/4179527539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":4179527539},{"type":"v1","addr":"172.21.15.102:6835","nonce":4179527539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-12T12:23:21.920 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 7 2024-09-12T12:23:21.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.921+0000 7f0a27c55640 1 -- 172.21.15.33:0/1047237394 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0a0c0a2b80 msgr2=0x7f0a0c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:21.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.921+0000 7f0a27c55640 1 --2- 172.21.15.33:0/1047237394 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0a0c0a2b80 0x7f0a0c0a5040 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c005d90 tx=0x7f0a1c005d20 comp rx=0 tx=0).stop 2024-09-12T12:23:21.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.921+0000 7f0a27c55640 1 -- 172.21.15.33:0/1047237394 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a20074590 msgr2=0x7f0a201a4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:21.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.921+0000 7f0a27c55640 1 --2- 172.21.15.33:0/1047237394 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a20074590 0x7f0a201a4630 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0a1400e9f0 tx=0x7f0a1400eeb0 comp rx=0 tx=0).stop 2024-09-12T12:23:21.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.921+0000 7f0a27c55640 1 -- 172.21.15.33:0/1047237394 shutdown_connections 2024-09-12T12:23:21.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.921+0000 7f0a27c55640 1 --2- 172.21.15.33:0/1047237394 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0a0c0a2b80 0x7f0a0c0a5040 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:21.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.921+0000 7f0a27c55640 1 --2- 172.21.15.33:0/1047237394 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0a20112b90 0x7f0a2019e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:21.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.922+0000 7f0a27c55640 1 --2- 172.21.15.33:0/1047237394 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a20074eb0 0x7f0a201a4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:21.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.922+0000 7f0a27c55640 1 --2- 172.21.15.33:0/1047237394 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a20074590 0x7f0a201a4630 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:21.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.922+0000 7f0a27c55640 1 -- 172.21.15.33:0/1047237394 >> 172.21.15.33:0/1047237394 conn(0x7f0a200fd8c0 msgr2=0x7f0a200ff490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:21.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.922+0000 7f0a27c55640 1 -- 172.21.15.33:0/1047237394 shutdown_connections 2024-09-12T12:23:21.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:21.922+0000 7f0a27c55640 1 -- 172.21.15.33:0/1047237394 wait complete. 2024-09-12T12:23:22.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:21 smithi043 ceph-mon[34144]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:22.646 INFO:journalctl@ceph.mds.c.smithi102.stdout:Sep 12 12:23:22 smithi102 systemd[1]: Started Ceph mds.c for a66dfafc-7100-11ef-bcea-c7b262605968. 2024-09-12T12:23:22.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:22 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/1047237394' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:23:22.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:22 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:22.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:22 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:22.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:22 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:22.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:22 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:23:22.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:22 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:23:22.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:22 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:23.073 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:22 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/1047237394' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:23:23.073 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:22 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:23.073 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:22 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:23.073 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:22 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:23.073 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:22 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:23:23.073 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:22 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:23:23.074 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:22 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:23.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:22 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/1047237394' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:23:23.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:22 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:23.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:22 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:23.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:22 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:23.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:22 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:23:23.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:22 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:23:23.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:22 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:24.079 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:23 smithi043 ceph-mon[34144]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:24.079 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:23 smithi043 ceph-mon[34144]: Deploying daemon mds.h on smithi043 2024-09-12T12:23:24.079 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:23 smithi043 ceph-mon[34144]: mds.? [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] up:boot 2024-09-12T12:23:24.080 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:23 smithi043 ceph-mon[34144]: fsmap 7 up:standby 2024-09-12T12:23:24.080 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:23 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T12:23:24.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:23 smithi102 ceph-mon[34799]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:24.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:23 smithi102 ceph-mon[34799]: Deploying daemon mds.h on smithi043 2024-09-12T12:23:24.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:23 smithi102 ceph-mon[34799]: mds.? [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] up:boot 2024-09-12T12:23:24.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:23 smithi102 ceph-mon[34799]: fsmap 7 up:standby 2024-09-12T12:23:24.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:23 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T12:23:24.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:23 smithi033 ceph-mon[31246]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:24.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:23 smithi033 ceph-mon[31246]: Deploying daemon mds.h on smithi043 2024-09-12T12:23:24.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:23 smithi033 ceph-mon[31246]: mds.? [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] up:boot 2024-09-12T12:23:24.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:23 smithi033 ceph-mon[31246]: fsmap 7 up:standby 2024-09-12T12:23:24.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:23 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T12:23:24.724 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:23:24.994 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:23:25.115 INFO:journalctl@ceph.mds.h.smithi043.stdout:Sep 12 12:23:25 smithi043 systemd[1]: Started Ceph mds.h for a66dfafc-7100-11ef-bcea-c7b262605968. 2024-09-12T12:23:25.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.483+0000 7f4fb4ad6640 1 -- 172.21.15.33:0/3785948666 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fb0102ef0 msgr2=0x7f4fb010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:25.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.483+0000 7f4fb4ad6640 1 --2- 172.21.15.33:0/3785948666 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fb0102ef0 0x7f4fb010da40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8009ca0 tx=0x7f4fa802a950 comp rx=0 tx=0).stop 2024-09-12T12:23:25.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.483+0000 7f4fb4ad6640 1 -- 172.21.15.33:0/3785948666 shutdown_connections 2024-09-12T12:23:25.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.483+0000 7f4fb4ad6640 1 --2- 172.21.15.33:0/3785948666 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fb0102ef0 0x7f4fb010da40 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:25.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.483+0000 7f4fb4ad6640 1 --2- 172.21.15.33:0/3785948666 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4fb0102570 0x7f4fb01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:25.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.483+0000 7f4fb4ad6640 1 --2- 172.21.15.33:0/3785948666 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4fb0100e20 0x7f4fb0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:25.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.483+0000 7f4fb4ad6640 1 -- 172.21.15.33:0/3785948666 >> 172.21.15.33:0/3785948666 conn(0x7f4fb00fc7d0 msgr2=0x7f4fb00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:25.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.483+0000 7f4fb4ad6640 1 -- 172.21.15.33:0/3785948666 shutdown_connections 2024-09-12T12:23:25.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.483+0000 7f4fb4ad6640 1 -- 172.21.15.33:0/3785948666 wait complete. 2024-09-12T12:23:25.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.484+0000 7f4fb4ad6640 1 Processor -- start 2024-09-12T12:23:25.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.484+0000 7f4fb4ad6640 1 -- start start 2024-09-12T12:23:25.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.484+0000 7f4fb4ad6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4fb0100e20 0x7f4fb01983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:25.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.484+0000 7f4fb4ad6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fb0102570 0x7f4fb01988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:25.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.484+0000 7f4fb4ad6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4fb0102ef0 0x7f4fb019cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:25.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.484+0000 7f4fb4ad6640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb0110e30 con 0x7f4fb0102570 2024-09-12T12:23:25.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.484+0000 7f4fb4ad6640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb0110cb0 con 0x7f4fb0102ef0 2024-09-12T12:23:25.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.484+0000 7f4fb4ad6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb0110fb0 con 0x7f4fb0100e20 2024-09-12T12:23:25.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.485+0000 7f4fadd9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fb0102570 0x7f4fb01988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:25.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.485+0000 7f4fadd9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fb0102570 0x7f4fb01988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54284/0 (socket says 172.21.15.33:54284) 2024-09-12T12:23:25.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.485+0000 7f4fadd9b640 1 -- 172.21.15.33:0/1211964514 learned_addr learned my addr 172.21.15.33:0/1211964514 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:23:25.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.485+0000 7f4faed9d640 1 --2- 172.21.15.33:0/1211964514 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4fb0102ef0 0x7f4fb019cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:25.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.485+0000 7f4fae59c640 1 --2- 172.21.15.33:0/1211964514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4fb0100e20 0x7f4fb01983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:25.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.485+0000 7f4fadd9b640 1 -- 172.21.15.33:0/1211964514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4fb0100e20 msgr2=0x7f4fb01983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:25.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.485+0000 7f4fadd9b640 1 --2- 172.21.15.33:0/1211964514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4fb0100e20 0x7f4fb01983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:25.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.485+0000 7f4fadd9b640 1 -- 172.21.15.33:0/1211964514 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4fb0102ef0 msgr2=0x7f4fb019cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:25.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.485+0000 7f4fadd9b640 1 --2- 172.21.15.33:0/1211964514 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4fb0102ef0 0x7f4fb019cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:25.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.485+0000 7f4fadd9b640 1 -- 172.21.15.33:0/1211964514 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fb019d350 con 0x7f4fb0102570 2024-09-12T12:23:25.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.485+0000 7f4fadd9b640 1 --2- 172.21.15.33:0/1211964514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fb0102570 0x7f4fb01988e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4fa400d950 tx=0x7f4fa400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:25.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.485+0000 7f4f9f7fe640 1 -- 172.21.15.33:0/1211964514 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa4017030 con 0x7f4fb0102570 2024-09-12T12:23:25.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.485+0000 7f4f9f7fe640 1 -- 172.21.15.33:0/1211964514 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4fa4004020 con 0x7f4fb0102570 2024-09-12T12:23:25.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.485+0000 7f4fb4ad6640 1 -- 172.21.15.33:0/1211964514 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fb019d640 con 0x7f4fb0102570 2024-09-12T12:23:25.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.485+0000 7f4f9f7fe640 1 -- 172.21.15.33:0/1211964514 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa40047a0 con 0x7f4fb0102570 2024-09-12T12:23:25.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.485+0000 7f4fb4ad6640 1 -- 172.21.15.33:0/1211964514 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fb01a4f20 con 0x7f4fb0102570 2024-09-12T12:23:25.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.487+0000 7f4fb4ad6640 1 -- 172.21.15.33:0/1211964514 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fb0101200 con 0x7f4fb0102570 2024-09-12T12:23:25.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.489+0000 7f4f9f7fe640 1 -- 172.21.15.33:0/1211964514 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f4fa40041d0 con 0x7f4fb0102570 2024-09-12T12:23:25.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.489+0000 7f4f9f7fe640 1 --2- 172.21.15.33:0/1211964514 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f4f980a2b80 0x7f4f980a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:25.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.490+0000 7f4f9f7fe640 1 -- 172.21.15.33:0/1211964514 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f4fa40ce540 con 0x7f4fb0102570 2024-09-12T12:23:25.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.490+0000 7f4fae59c640 1 --2- 172.21.15.33:0/1211964514 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f4f980a2b80 0x7f4f980a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:25.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.490+0000 7f4fae59c640 1 --2- 172.21.15.33:0/1211964514 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f4f980a2b80 0x7f4f980a5040 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4fa00058c0 tx=0x7f4fa000a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:25.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.494+0000 7f4f9f7fe640 1 -- 172.21.15.33:0/1211964514 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4fa409b940 con 0x7f4fb0102570 2024-09-12T12:23:25.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.708+0000 7f4fb4ad6640 1 -- 172.21.15.33:0/1211964514 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4fb0199700 con 0x7f4fb0102570 2024-09-12T12:23:25.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.708+0000 7f4f9f7fe640 1 -- 172.21.15.33:0/1211964514 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6388 (secure 0 0 0) 0x7f4fb0199700 con 0x7f4fb0102570 2024-09-12T12:23:25.708 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:23:25.708 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":8,"btime":"2024-09-12T12:23:22:748250+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3327066342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3327066342},{"type":"v1","addr":"172.21.15.33:6835","nonce":3327066342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/19516401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":19516401},{"type":"v1","addr":"172.21.15.33:6837","nonce":19516401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/3051073141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3051073141},{"type":"v1","addr":"172.21.15.43:6833","nonce":3051073141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3282762800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3282762800},{"type":"v1","addr":"172.21.15.43:6835","nonce":3282762800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/3051713000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3051713000},{"type":"v1","addr":"172.21.15.102:6833","nonce":3051713000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24478,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/4179527539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":4179527539},{"type":"v1","addr":"172.21.15.102:6835","nonce":4179527539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24490,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2409953270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2409953270},{"type":"v1","addr":"172.21.15.102:6837","nonce":2409953270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-12T12:23:25.709 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 8 2024-09-12T12:23:25.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.710+0000 7f4fb4ad6640 1 -- 172.21.15.33:0/1211964514 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f4f980a2b80 msgr2=0x7f4f980a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:25.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.710+0000 7f4fb4ad6640 1 --2- 172.21.15.33:0/1211964514 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f4f980a2b80 0x7f4f980a5040 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4fa00058c0 tx=0x7f4fa000a250 comp rx=0 tx=0).stop 2024-09-12T12:23:25.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.710+0000 7f4fb4ad6640 1 -- 172.21.15.33:0/1211964514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fb0102570 msgr2=0x7f4fb01988e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:25.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.710+0000 7f4fb4ad6640 1 --2- 172.21.15.33:0/1211964514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fb0102570 0x7f4fb01988e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4fa400d950 tx=0x7f4fa400de10 comp rx=0 tx=0).stop 2024-09-12T12:23:25.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.710+0000 7f4fb4ad6640 1 -- 172.21.15.33:0/1211964514 shutdown_connections 2024-09-12T12:23:25.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.710+0000 7f4fb4ad6640 1 --2- 172.21.15.33:0/1211964514 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f4f980a2b80 0x7f4f980a5040 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:25.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.710+0000 7f4fb4ad6640 1 --2- 172.21.15.33:0/1211964514 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4fb0102ef0 0x7f4fb019cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:25.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.710+0000 7f4fb4ad6640 1 --2- 172.21.15.33:0/1211964514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fb0102570 0x7f4fb01988e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:25.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.710+0000 7f4fb4ad6640 1 --2- 172.21.15.33:0/1211964514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4fb0100e20 0x7f4fb01983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:25.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.710+0000 7f4fb4ad6640 1 -- 172.21.15.33:0/1211964514 >> 172.21.15.33:0/1211964514 conn(0x7f4fb00fc7d0 msgr2=0x7f4fb0069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:25.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.710+0000 7f4fb4ad6640 1 -- 172.21.15.33:0/1211964514 shutdown_connections 2024-09-12T12:23:25.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:25.711+0000 7f4fb4ad6640 1 -- 172.21.15.33:0/1211964514 wait complete. 2024-09-12T12:23:25.788 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:25 smithi102 ceph-mon[34799]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:25.789 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:25 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:25.789 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:25 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:25.789 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:25 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:25.789 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:25 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:23:25.789 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:25 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:23:25.789 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:25 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:25.789 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:25 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/1211964514' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:23:25.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:25 smithi033 ceph-mon[31246]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:25.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:25 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:25.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:25 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:25.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:25 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:25.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:25 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:23:25.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:25 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:23:25.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:25 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:25.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:25 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/1211964514' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:23:26.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:25 smithi043 ceph-mon[34144]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:26.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:25 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:26.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:25 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:26.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:25 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:26.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:25 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:23:26.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:25 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:23:26.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:25 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:26.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:25 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/1211964514' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:23:26.842 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:26 smithi102 ceph-mon[34799]: Deploying daemon mds.i on smithi102 2024-09-12T12:23:26.843 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:26 smithi102 ceph-mon[34799]: mds.? [v2:172.21.15.43:6836/2472064883,v1:172.21.15.43:6837/2472064883] up:boot 2024-09-12T12:23:26.843 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:26 smithi102 ceph-mon[34799]: fsmap 8 up:standby 2024-09-12T12:23:26.843 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:26 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T12:23:26.980 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:26 smithi033 ceph-mon[31246]: Deploying daemon mds.i on smithi102 2024-09-12T12:23:26.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:26 smithi033 ceph-mon[31246]: mds.? [v2:172.21.15.43:6836/2472064883,v1:172.21.15.43:6837/2472064883] up:boot 2024-09-12T12:23:26.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:26 smithi033 ceph-mon[31246]: fsmap 8 up:standby 2024-09-12T12:23:26.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:26 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T12:23:27.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:26 smithi043 ceph-mon[34144]: Deploying daemon mds.i on smithi102 2024-09-12T12:23:27.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:26 smithi043 ceph-mon[34144]: mds.? [v2:172.21.15.43:6836/2472064883,v1:172.21.15.43:6837/2472064883] up:boot 2024-09-12T12:23:27.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:26 smithi043 ceph-mon[34144]: fsmap 8 up:standby 2024-09-12T12:23:27.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:26 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T12:23:27.146 INFO:journalctl@ceph.mds.i.smithi102.stdout:Sep 12 12:23:27 smithi102 systemd[1]: Starting Ceph mds.i for a66dfafc-7100-11ef-bcea-c7b262605968... 2024-09-12T12:23:27.516 INFO:journalctl@ceph.mds.i.smithi102.stdout:Sep 12 12:23:27 smithi102 podman[64838]: 2024-09-12 12:23:27.142001101 +0000 UTC m=+0.016402841 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:23:27.516 INFO:journalctl@ceph.mds.i.smithi102.stdout:Sep 12 12:23:27 smithi102 podman[64838]: 2024-09-12 12:23:27.246653707 +0000 UTC m=+0.121055446 container create fbb800153a71a9acf887c0f9a6a1dbd2de26c88e1cb7961d5877668a6ba9e454 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-i, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:23:27.516 INFO:journalctl@ceph.mds.i.smithi102.stdout:Sep 12 12:23:27 smithi102 podman[64838]: 2024-09-12 12:23:27.51613413 +0000 UTC m=+0.390535868 container init fbb800153a71a9acf887c0f9a6a1dbd2de26c88e1cb7961d5877668a6ba9e454 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-12T12:23:27.773 INFO:journalctl@ceph.mds.i.smithi102.stdout:Sep 12 12:23:27 smithi102 podman[64838]: 2024-09-12 12:23:27.519055834 +0000 UTC m=+0.393457572 container start fbb800153a71a9acf887c0f9a6a1dbd2de26c88e1cb7961d5877668a6ba9e454 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-i, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-12T12:23:27.773 INFO:journalctl@ceph.mds.i.smithi102.stdout:Sep 12 12:23:27 smithi102 ceph-mds[64857]: -- 172.21.15.102:0/4271227876 <== mon.1 v2:172.21.15.102:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b1188a9860 con 0x55b118887400 2024-09-12T12:23:27.773 INFO:journalctl@ceph.mds.i.smithi102.stdout:Sep 12 12:23:27 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-i[64853]: starting mds.i at 2024-09-12T12:23:27.773 INFO:journalctl@ceph.mds.i.smithi102.stdout:Sep 12 12:23:27 smithi102 bash[64838]: fbb800153a71a9acf887c0f9a6a1dbd2de26c88e1cb7961d5877668a6ba9e454 2024-09-12T12:23:27.773 INFO:journalctl@ceph.mds.i.smithi102.stdout:Sep 12 12:23:27 smithi102 systemd[1]: Started Ceph mds.i for a66dfafc-7100-11ef-bcea-c7b262605968. 2024-09-12T12:23:28.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:27 smithi043 ceph-mon[34144]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:28.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:27 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:28.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:27 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:28.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:27 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:28.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:27 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:23:28.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:27 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:23:28.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:27 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:28.137 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:27 smithi033 ceph-mon[31246]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:28.137 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:27 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:28.137 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:27 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:28.138 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:27 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:28.138 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:27 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:23:28.138 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:27 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:23:28.138 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:27 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:28.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:27 smithi102 ceph-mon[34799]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:28.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:27 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:28.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:27 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:28.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:27 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:28.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:27 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:23:28.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:27 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:23:28.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:27 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:28.433 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:23:29.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:28 smithi043 ceph-mon[34144]: Deploying daemon mds.g on smithi033 2024-09-12T12:23:29.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:28 smithi043 ceph-mon[34144]: mds.? [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] up:boot 2024-09-12T12:23:29.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:28 smithi043 ceph-mon[34144]: fsmap 9 up:standby 2024-09-12T12:23:29.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:28 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T12:23:29.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:28 smithi102 ceph-mon[34799]: Deploying daemon mds.g on smithi033 2024-09-12T12:23:29.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:28 smithi102 ceph-mon[34799]: mds.? [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] up:boot 2024-09-12T12:23:29.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:28 smithi102 ceph-mon[34799]: fsmap 9 up:standby 2024-09-12T12:23:29.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:28 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T12:23:29.171 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:28 smithi033 ceph-mon[31246]: Deploying daemon mds.g on smithi033 2024-09-12T12:23:29.171 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:28 smithi033 ceph-mon[31246]: mds.? [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] up:boot 2024-09-12T12:23:29.171 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:28 smithi033 ceph-mon[31246]: fsmap 9 up:standby 2024-09-12T12:23:29.171 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:28 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T12:23:29.202 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:23:29.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:29.777+0000 7fd4e0c1a640 1 -- 172.21.15.33:0/756688812 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4dc101dd0 msgr2=0x7fd4dc1021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:29.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:29.777+0000 7fd4e0c1a640 1 --2- 172.21.15.33:0/756688812 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4dc101dd0 0x7fd4dc1021b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc009900 tx=0x7fd4cc02a410 comp rx=0 tx=0).stop 2024-09-12T12:23:29.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:29.778+0000 7fd4e0c1a640 1 -- 172.21.15.33:0/756688812 shutdown_connections 2024-09-12T12:23:29.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:29.778+0000 7fd4e0c1a640 1 --2- 172.21.15.33:0/756688812 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4dc106f00 0x7fd4dc10ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:29.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:29.778+0000 7fd4e0c1a640 1 --2- 172.21.15.33:0/756688812 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4dc102780 0x7fd4dc1067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:29.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:29.778+0000 7fd4e0c1a640 1 --2- 172.21.15.33:0/756688812 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4dc101dd0 0x7fd4dc1021b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:29.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:29.778+0000 7fd4e0c1a640 1 -- 172.21.15.33:0/756688812 >> 172.21.15.33:0/756688812 conn(0x7fd4dc0fd8b0 msgr2=0x7fd4dc0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:29.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:29.778+0000 7fd4e0c1a640 1 -- 172.21.15.33:0/756688812 shutdown_connections 2024-09-12T12:23:29.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:29.778+0000 7fd4e0c1a640 1 -- 172.21.15.33:0/756688812 wait complete. 2024-09-12T12:23:29.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:29.778+0000 7fd4e0c1a640 1 Processor -- start 2024-09-12T12:23:29.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:29.779+0000 7fd4e0c1a640 1 -- start start 2024-09-12T12:23:29.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:29.779+0000 7fd4e0c1a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4dc101dd0 0x7fd4dc198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:29.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:29.779+0000 7fd4e0c1a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4dc102780 0x7fd4dc198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:29.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:29.779+0000 7fd4e0c1a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4dc106f00 0x7fd4dc19cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:29.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:29.779+0000 7fd4e0c1a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd4dc111e10 con 0x7fd4dc101dd0 2024-09-12T12:23:29.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:29.779+0000 7fd4e0c1a640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd4dc111c90 con 0x7fd4dc106f00 2024-09-12T12:23:29.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:29.779+0000 7fd4e0c1a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd4dc111f90 con 0x7fd4dc102780 2024-09-12T12:23:29.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:29.779+0000 7fd4da59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4dc101dd0 0x7fd4dc198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:29.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:29.779+0000 7fd4da59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4dc101dd0 0x7fd4dc198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54302/0 (socket says 172.21.15.33:54302) 2024-09-12T12:23:29.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:29.779+0000 7fd4da59c640 1 -- 172.21.15.33:0/2799029487 learned_addr learned my addr 172.21.15.33:0/2799029487 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:23:29.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:29.779+0000 7fd4d9d9b640 1 --2- 172.21.15.33:0/2799029487 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4dc102780 0x7fd4dc198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:29.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:29.779+0000 7fd4dad9d640 1 --2- 172.21.15.33:0/2799029487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4dc106f00 0x7fd4dc19cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:29.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:29.779+0000 7fd4da59c640 1 -- 172.21.15.33:0/2799029487 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4dc102780 msgr2=0x7fd4dc198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:29.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:29.779+0000 7fd4da59c640 1 --2- 172.21.15.33:0/2799029487 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4dc102780 0x7fd4dc198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:29.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:29.779+0000 7fd4da59c640 1 -- 172.21.15.33:0/2799029487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4dc106f00 msgr2=0x7fd4dc19cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:29.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:29.779+0000 7fd4da59c640 1 --2- 172.21.15.33:0/2799029487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4dc106f00 0x7fd4dc19cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:29.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:29.779+0000 7fd4da59c640 1 -- 172.21.15.33:0/2799029487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4dc19d2e0 con 0x7fd4dc101dd0 2024-09-12T12:23:29.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:29.779+0000 7fd4dad9d640 1 --2- 172.21.15.33:0/2799029487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4dc106f00 0x7fd4dc19cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:23:29.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:29.779+0000 7fd4d9d9b640 1 --2- 172.21.15.33:0/2799029487 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4dc102780 0x7fd4dc198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:23:29.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:29.780+0000 7fd4da59c640 1 --2- 172.21.15.33:0/2799029487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4dc101dd0 0x7fd4dc198330 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc005940 tx=0x7fd4cc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:29.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:29.780+0000 7fd4cb7fe640 1 -- 172.21.15.33:0/2799029487 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc03f030 con 0x7fd4dc101dd0 2024-09-12T12:23:29.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:29.780+0000 7fd4e0c1a640 1 -- 172.21.15.33:0/2799029487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4dc19d570 con 0x7fd4dc101dd0 2024-09-12T12:23:29.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:29.780+0000 7fd4cb7fe640 1 -- 172.21.15.33:0/2799029487 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd4cc003aa0 con 0x7fd4dc101dd0 2024-09-12T12:23:29.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:29.780+0000 7fd4cb7fe640 1 -- 172.21.15.33:0/2799029487 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc035070 con 0x7fd4dc101dd0 2024-09-12T12:23:29.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:29.780+0000 7fd4e0c1a640 1 -- 172.21.15.33:0/2799029487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4dc1a4eb0 con 0x7fd4dc101dd0 2024-09-12T12:23:29.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:29.781+0000 7fd4e0c1a640 1 -- 172.21.15.33:0/2799029487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4dc1021b0 con 0x7fd4dc101dd0 2024-09-12T12:23:29.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:29.783+0000 7fd4cb7fe640 1 -- 172.21.15.33:0/2799029487 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fd4cc042030 con 0x7fd4dc101dd0 2024-09-12T12:23:29.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:29.784+0000 7fd4cb7fe640 1 --2- 172.21.15.33:0/2799029487 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd4c40a2b80 0x7fd4c40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:29.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:29.784+0000 7fd4cb7fe640 1 -- 172.21.15.33:0/2799029487 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fd4cc0ef640 con 0x7fd4dc101dd0 2024-09-12T12:23:29.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:29.784+0000 7fd4d9d9b640 1 --2- 172.21.15.33:0/2799029487 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd4c40a2b80 0x7fd4c40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:29.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:29.785+0000 7fd4d9d9b640 1 --2- 172.21.15.33:0/2799029487 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd4c40a2b80 0x7fd4c40a5040 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc0fdcd0 tx=0x7fd4d0005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:29.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:29.788+0000 7fd4cb7fe640 1 -- 172.21.15.33:0/2799029487 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd4cc0bca40 con 0x7fd4dc101dd0 2024-09-12T12:23:30.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:30.020+0000 7fd4e0c1a640 1 -- 172.21.15.33:0/2799029487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd4dc199690 con 0x7fd4dc101dd0 2024-09-12T12:23:30.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:30.021+0000 7fd4cb7fe640 1 -- 172.21.15.33:0/2799029487 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8043 (secure 0 0 0) 0x7fd4cc0bc340 con 0x7fd4dc101dd0 2024-09-12T12:23:30.022 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:23:30.022 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":10,"btime":"2024-09-12T12:23:27:771516+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3327066342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3327066342},{"type":"v1","addr":"172.21.15.33:6835","nonce":3327066342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/19516401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":19516401},{"type":"v1","addr":"172.21.15.33:6837","nonce":19516401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/3051073141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3051073141},{"type":"v1","addr":"172.21.15.43:6833","nonce":3051073141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3282762800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3282762800},{"type":"v1","addr":"172.21.15.43:6835","nonce":3282762800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/3051713000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3051713000},{"type":"v1","addr":"172.21.15.102:6833","nonce":3051713000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2472064883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2472064883},{"type":"v1","addr":"172.21.15.43:6837","nonce":2472064883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24478,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/4179527539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":4179527539},{"type":"v1","addr":"172.21.15.102:6835","nonce":4179527539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24490,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2409953270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2409953270},{"type":"v1","addr":"172.21.15.102:6837","nonce":2409953270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24499,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/1553271340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":1553271340},{"type":"v1","addr":"172.21.15.102:6839","nonce":1553271340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-12T12:23:30.022 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 10 2024-09-12T12:23:30.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:30.023+0000 7fd4e0c1a640 1 -- 172.21.15.33:0/2799029487 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd4c40a2b80 msgr2=0x7fd4c40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:30.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:30.023+0000 7fd4e0c1a640 1 --2- 172.21.15.33:0/2799029487 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd4c40a2b80 0x7fd4c40a5040 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc0fdcd0 tx=0x7fd4d0005e50 comp rx=0 tx=0).stop 2024-09-12T12:23:30.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:30.023+0000 7fd4e0c1a640 1 -- 172.21.15.33:0/2799029487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4dc101dd0 msgr2=0x7fd4dc198330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:30.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:30.023+0000 7fd4e0c1a640 1 --2- 172.21.15.33:0/2799029487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4dc101dd0 0x7fd4dc198330 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc005940 tx=0x7fd4cc004270 comp rx=0 tx=0).stop 2024-09-12T12:23:30.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:30.023+0000 7fd4e0c1a640 1 -- 172.21.15.33:0/2799029487 shutdown_connections 2024-09-12T12:23:30.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:30.023+0000 7fd4e0c1a640 1 --2- 172.21.15.33:0/2799029487 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd4c40a2b80 0x7fd4c40a5040 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:30.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:30.023+0000 7fd4e0c1a640 1 --2- 172.21.15.33:0/2799029487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4dc106f00 0x7fd4dc19cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:30.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:30.023+0000 7fd4e0c1a640 1 --2- 172.21.15.33:0/2799029487 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4dc102780 0x7fd4dc198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:30.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:30.023+0000 7fd4e0c1a640 1 --2- 172.21.15.33:0/2799029487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4dc101dd0 0x7fd4dc198330 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:30.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:30.023+0000 7fd4e0c1a640 1 -- 172.21.15.33:0/2799029487 >> 172.21.15.33:0/2799029487 conn(0x7fd4dc0fd8b0 msgr2=0x7fd4dc0fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:30.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:30.023+0000 7fd4e0c1a640 1 -- 172.21.15.33:0/2799029487 shutdown_connections 2024-09-12T12:23:30.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:30.023+0000 7fd4e0c1a640 1 -- 172.21.15.33:0/2799029487 wait complete. 2024-09-12T12:23:30.029 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:29 smithi033 ceph-mon[31246]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:30.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:29 smithi043 ceph-mon[34144]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:30.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:29 smithi102 ceph-mon[34799]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:31.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:30 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/2799029487' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:23:31.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:30 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:31.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:30 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:31.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:30 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:31.117 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:30 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:23:31.117 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:30 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:23:31.117 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:30 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:31.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:30 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/2799029487' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:23:31.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:30 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:31.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:30 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:31.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:30 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:31.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:30 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:23:31.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:30 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:23:31.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:30 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:31.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:30 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/2799029487' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:23:31.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:30 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:31.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:30 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:31.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:30 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:31.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:30 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:23:31.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:30 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:23:31.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:30 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:32.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:31 smithi043 ceph-mon[34144]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:32.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:31 smithi043 ceph-mon[34144]: Deploying daemon mds.a on smithi033 2024-09-12T12:23:32.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:31 smithi043 ceph-mon[34144]: mds.? [v2:172.21.15.33:6838/1260196118,v1:172.21.15.33:6839/1260196118] up:boot 2024-09-12T12:23:32.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:31 smithi043 ceph-mon[34144]: fsmap 10 up:standby 2024-09-12T12:23:32.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:31 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T12:23:32.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:31 smithi102 ceph-mon[34799]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:32.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:31 smithi102 ceph-mon[34799]: Deploying daemon mds.a on smithi033 2024-09-12T12:23:32.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:31 smithi102 ceph-mon[34799]: mds.? [v2:172.21.15.33:6838/1260196118,v1:172.21.15.33:6839/1260196118] up:boot 2024-09-12T12:23:32.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:31 smithi102 ceph-mon[34799]: fsmap 10 up:standby 2024-09-12T12:23:32.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:31 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T12:23:32.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:31 smithi033 ceph-mon[31246]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:32.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:31 smithi033 ceph-mon[31246]: Deploying daemon mds.a on smithi033 2024-09-12T12:23:32.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:31 smithi033 ceph-mon[31246]: mds.? [v2:172.21.15.33:6838/1260196118,v1:172.21.15.33:6839/1260196118] up:boot 2024-09-12T12:23:32.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:31 smithi033 ceph-mon[31246]: fsmap 10 up:standby 2024-09-12T12:23:32.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:31 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T12:23:32.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:32 smithi033 ceph-mon[31246]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:33.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:32 smithi043 ceph-mon[34144]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:33.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:32 smithi102 ceph-mon[34799]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:33.158 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:23:33.448 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:23:33.572 INFO:journalctl@ceph.mds.a.smithi033.stdout:Sep 12 12:23:33 smithi033 systemd[1]: Started Ceph mds.a for a66dfafc-7100-11ef-bcea-c7b262605968. 2024-09-12T12:23:34.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:33.989+0000 7f33f8d99640 1 -- 172.21.15.33:0/2327606296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33f4101420 msgr2=0x7f33f410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:34.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:33.989+0000 7f33f8d99640 1 --2- 172.21.15.33:0/2327606296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33f4101420 0x7f33f410d950 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f33ec009cd0 tx=0x7f33ec02a8e0 comp rx=0 tx=0).stop 2024-09-12T12:23:34.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:33.989+0000 7f33f8d99640 1 -- 172.21.15.33:0/2327606296 shutdown_connections 2024-09-12T12:23:34.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:33.989+0000 7f33f8d99640 1 --2- 172.21.15.33:0/2327606296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33f4101420 0x7f33f410d950 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:34.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:33.989+0000 7f33f8d99640 1 --2- 172.21.15.33:0/2327606296 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f33f4100a80 0x7f33f4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:34.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:33.989+0000 7f33f8d99640 1 --2- 172.21.15.33:0/2327606296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33f4106a80 0x7f33f4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:34.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:33.989+0000 7f33f8d99640 1 -- 172.21.15.33:0/2327606296 >> 172.21.15.33:0/2327606296 conn(0x7f33f40fc7a0 msgr2=0x7f33f40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:34.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:33.989+0000 7f33f8d99640 1 -- 172.21.15.33:0/2327606296 shutdown_connections 2024-09-12T12:23:34.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:33.989+0000 7f33f8d99640 1 -- 172.21.15.33:0/2327606296 wait complete. 2024-09-12T12:23:34.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:33.990+0000 7f33f8d99640 1 Processor -- start 2024-09-12T12:23:34.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:33.990+0000 7f33f8d99640 1 -- start start 2024-09-12T12:23:34.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:33.990+0000 7f33f8d99640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33f4100a80 0x7f33f41991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:34.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:33.990+0000 7f33f8d99640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33f4101420 0x7f33f4199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:34.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:33.990+0000 7f33f8d99640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f33f4106a80 0x7f33f41a4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:34.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:33.990+0000 7f33f8d99640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f33f4110d30 con 0x7f33f4100a80 2024-09-12T12:23:34.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:33.990+0000 7f33f8d99640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f33f4110bb0 con 0x7f33f4101420 2024-09-12T12:23:34.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:33.990+0000 7f33f8d99640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f33f4110eb0 con 0x7f33f4106a80 2024-09-12T12:23:34.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:33.990+0000 7f33f259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33f4100a80 0x7f33f41991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:34.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:33.990+0000 7f33f259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33f4100a80 0x7f33f41991e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49924/0 (socket says 172.21.15.33:49924) 2024-09-12T12:23:34.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:33.990+0000 7f33f259c640 1 -- 172.21.15.33:0/2549976432 learned_addr learned my addr 172.21.15.33:0/2549976432 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:23:34.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:33.991+0000 7f33f2d9d640 1 --2- 172.21.15.33:0/2549976432 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f33f4106a80 0x7f33f41a4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:34.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:33.991+0000 7f33f1d9b640 1 --2- 172.21.15.33:0/2549976432 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33f4101420 0x7f33f4199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:34.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:33.991+0000 7f33f259c640 1 -- 172.21.15.33:0/2549976432 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f33f4106a80 msgr2=0x7f33f41a4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:34.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:33.991+0000 7f33f259c640 1 --2- 172.21.15.33:0/2549976432 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f33f4106a80 0x7f33f41a4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:34.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:33.991+0000 7f33f259c640 1 -- 172.21.15.33:0/2549976432 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33f4101420 msgr2=0x7f33f4199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:34.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:33.991+0000 7f33f259c640 1 --2- 172.21.15.33:0/2549976432 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33f4101420 0x7f33f4199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:34.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:33.991+0000 7f33f259c640 1 -- 172.21.15.33:0/2549976432 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33f41a47a0 con 0x7f33f4100a80 2024-09-12T12:23:34.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:33.991+0000 7f33f1d9b640 1 --2- 172.21.15.33:0/2549976432 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33f4101420 0x7f33f4199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:23:34.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:33.991+0000 7f33f259c640 1 --2- 172.21.15.33:0/2549976432 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33f4100a80 0x7f33f41991e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f33e400d950 tx=0x7f33e400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:34.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:33.991+0000 7f33e37fe640 1 -- 172.21.15.33:0/2549976432 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e4017070 con 0x7f33f4100a80 2024-09-12T12:23:34.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:33.991+0000 7f33e37fe640 1 -- 172.21.15.33:0/2549976432 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f33e4009c30 con 0x7f33f4100a80 2024-09-12T12:23:34.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:33.991+0000 7f33f8d99640 1 -- 172.21.15.33:0/2549976432 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33f41a4970 con 0x7f33f4100a80 2024-09-12T12:23:34.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:33.991+0000 7f33e37fe640 1 -- 172.21.15.33:0/2549976432 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e400f620 con 0x7f33f4100a80 2024-09-12T12:23:34.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:33.991+0000 7f33f8d99640 1 -- 172.21.15.33:0/2549976432 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33f41a4e80 con 0x7f33f4100a80 2024-09-12T12:23:34.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:33.992+0000 7f33f8d99640 1 -- 172.21.15.33:0/2549976432 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33f4100ee0 con 0x7f33f4100a80 2024-09-12T12:23:34.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:33.994+0000 7f33e37fe640 1 -- 172.21.15.33:0/2549976432 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f33e40109a0 con 0x7f33f4100a80 2024-09-12T12:23:34.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:33.995+0000 7f33e37fe640 1 --2- 172.21.15.33:0/2549976432 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f33dc0a2b80 0x7f33dc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:34.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:33.995+0000 7f33f1d9b640 1 --2- 172.21.15.33:0/2549976432 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f33dc0a2b80 0x7f33dc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:34.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:33.995+0000 7f33e37fe640 1 -- 172.21.15.33:0/2549976432 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f33e40ce7e0 con 0x7f33f4100a80 2024-09-12T12:23:34.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:33.995+0000 7f33f1d9b640 1 --2- 172.21.15.33:0/2549976432 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f33dc0a2b80 0x7f33dc0a5040 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f33e8005fd0 tx=0x7f33e8005ea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:34.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:33.998+0000 7f33e37fe640 1 -- 172.21.15.33:0/2549976432 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f33e4009de0 con 0x7f33f4100a80 2024-09-12T12:23:34.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:34.208+0000 7f33f8d99640 1 -- 172.21.15.33:0/2549976432 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f33f4108ff0 con 0x7f33f4100a80 2024-09-12T12:23:34.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:34.209+0000 7f33e37fe640 1 -- 172.21.15.33:0/2549976432 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9695 (secure 0 0 0) 0x7f33e409bb40 con 0x7f33f4100a80 2024-09-12T12:23:34.209 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:23:34.209 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":12,"btime":"2024-09-12T12:23:33:799191+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3327066342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3327066342},{"type":"v1","addr":"172.21.15.33:6835","nonce":3327066342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/19516401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":19516401},{"type":"v1","addr":"172.21.15.33:6837","nonce":19516401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1260196118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1260196118},{"type":"v1","addr":"172.21.15.33:6839","nonce":1260196118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/4288248356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4288248356},{"type":"v1","addr":"172.21.15.33:6841","nonce":4288248356}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/3051073141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3051073141},{"type":"v1","addr":"172.21.15.43:6833","nonce":3051073141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3282762800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3282762800},{"type":"v1","addr":"172.21.15.43:6835","nonce":3282762800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/3051713000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3051713000},{"type":"v1","addr":"172.21.15.102:6833","nonce":3051713000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2472064883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2472064883},{"type":"v1","addr":"172.21.15.43:6837","nonce":2472064883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24478,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/4179527539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":4179527539},{"type":"v1","addr":"172.21.15.102:6835","nonce":4179527539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24490,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2409953270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2409953270},{"type":"v1","addr":"172.21.15.102:6837","nonce":2409953270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24499,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/1553271340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":1553271340},{"type":"v1","addr":"172.21.15.102:6839","nonce":1553271340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-12T12:23:34.210 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 12 2024-09-12T12:23:34.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:34.211+0000 7f33f8d99640 1 -- 172.21.15.33:0/2549976432 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f33dc0a2b80 msgr2=0x7f33dc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:34.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:34.211+0000 7f33f8d99640 1 --2- 172.21.15.33:0/2549976432 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f33dc0a2b80 0x7f33dc0a5040 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f33e8005fd0 tx=0x7f33e8005ea0 comp rx=0 tx=0).stop 2024-09-12T12:23:34.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:34.211+0000 7f33f8d99640 1 -- 172.21.15.33:0/2549976432 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33f4100a80 msgr2=0x7f33f41991e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:34.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:34.211+0000 7f33f8d99640 1 --2- 172.21.15.33:0/2549976432 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33f4100a80 0x7f33f41991e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f33e400d950 tx=0x7f33e400de10 comp rx=0 tx=0).stop 2024-09-12T12:23:34.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:34.211+0000 7f33f8d99640 1 -- 172.21.15.33:0/2549976432 shutdown_connections 2024-09-12T12:23:34.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:34.211+0000 7f33f8d99640 1 --2- 172.21.15.33:0/2549976432 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f33dc0a2b80 0x7f33dc0a5040 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:34.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:34.211+0000 7f33f8d99640 1 --2- 172.21.15.33:0/2549976432 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f33f4106a80 0x7f33f41a4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:34.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:34.211+0000 7f33f8d99640 1 --2- 172.21.15.33:0/2549976432 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33f4101420 0x7f33f4199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:34.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:34.211+0000 7f33f8d99640 1 --2- 172.21.15.33:0/2549976432 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33f4100a80 0x7f33f41991e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:34.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:34.211+0000 7f33f8d99640 1 -- 172.21.15.33:0/2549976432 >> 172.21.15.33:0/2549976432 conn(0x7f33f40fc7a0 msgr2=0x7f33f40fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:34.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:34.211+0000 7f33f8d99640 1 -- 172.21.15.33:0/2549976432 shutdown_connections 2024-09-12T12:23:34.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:34.211+0000 7f33f8d99640 1 -- 172.21.15.33:0/2549976432 wait complete. 2024-09-12T12:23:34.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:34 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:34.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:34 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:34.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:34 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:34.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:34 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:23:34.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:34 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:23:34.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:34 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:34.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:34 smithi033 ceph-mon[31246]: Deploying daemon mds.b on smithi043 2024-09-12T12:23:34.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:34 smithi033 ceph-mon[31246]: mds.? [v2:172.21.15.33:6840/4288248356,v1:172.21.15.33:6841/4288248356] up:boot 2024-09-12T12:23:34.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:34 smithi033 ceph-mon[31246]: fsmap 11 up:standby 2024-09-12T12:23:34.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:34 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T12:23:34.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:34 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/2549976432' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:23:34.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:34 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:34.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:34 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:34.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:34 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:34.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:34 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:23:34.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:34 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:23:34.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:34 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:34.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:34 smithi043 ceph-mon[34144]: Deploying daemon mds.b on smithi043 2024-09-12T12:23:34.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:34 smithi043 ceph-mon[34144]: mds.? [v2:172.21.15.33:6840/4288248356,v1:172.21.15.33:6841/4288248356] up:boot 2024-09-12T12:23:34.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:34 smithi043 ceph-mon[34144]: fsmap 11 up:standby 2024-09-12T12:23:34.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:34 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T12:23:34.867 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:34 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/2549976432' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:23:34.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:34 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:34.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:34 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:34.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:34 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:34.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:34 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:23:34.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:34 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:23:34.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:34 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:34.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:34 smithi102 ceph-mon[34799]: Deploying daemon mds.b on smithi043 2024-09-12T12:23:34.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:34 smithi102 ceph-mon[34799]: mds.? [v2:172.21.15.33:6840/4288248356,v1:172.21.15.33:6841/4288248356] up:boot 2024-09-12T12:23:34.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:34 smithi102 ceph-mon[34799]: fsmap 11 up:standby 2024-09-12T12:23:34.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:34 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T12:23:34.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:34 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/2549976432' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:23:35.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:35 smithi043 ceph-mon[34144]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:35.615 INFO:journalctl@ceph.mds.b.smithi043.stdout:Sep 12 12:23:35 smithi043 systemd[1]: Starting Ceph mds.b for a66dfafc-7100-11ef-bcea-c7b262605968... 2024-09-12T12:23:35.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:35 smithi033 ceph-mon[31246]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:35.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:35 smithi102 ceph-mon[34799]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:36.006 INFO:journalctl@ceph.mds.b.smithi043.stdout:Sep 12 12:23:35 smithi043 podman[64525]: 2024-09-12 12:23:35.633195306 +0000 UTC m=+0.016871899 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:23:36.006 INFO:journalctl@ceph.mds.b.smithi043.stdout:Sep 12 12:23:35 smithi043 podman[64525]: 2024-09-12 12:23:35.754486762 +0000 UTC m=+0.138163345 container create c860099f1dcc491f3b77b9627ba609d321e11a3131e14060470fc92b3ef71dc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-b, RELEASE=squid-b53b6d3, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-12T12:23:36.006 INFO:journalctl@ceph.mds.b.smithi043.stdout:Sep 12 12:23:36 smithi043 podman[64525]: 2024-09-12 12:23:36.006992727 +0000 UTC m=+0.390669318 container init c860099f1dcc491f3b77b9627ba609d321e11a3131e14060470fc92b3ef71dc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-b, GIT_CLEAN=True, ceph=True, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T12:23:36.365 INFO:journalctl@ceph.mds.b.smithi043.stdout:Sep 12 12:23:36 smithi043 podman[64525]: 2024-09-12 12:23:36.009895652 +0000 UTC m=+0.393572235 container start c860099f1dcc491f3b77b9627ba609d321e11a3131e14060470fc92b3ef71dc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-b, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-12T12:23:36.365 INFO:journalctl@ceph.mds.b.smithi043.stdout:Sep 12 12:23:36 smithi043 ceph-mds[64544]: -- 172.21.15.43:0/1660021303 <== mon.2 v2:172.21.15.43:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b1e6b49860 con 0x55b1e6b26800 2024-09-12T12:23:36.365 INFO:journalctl@ceph.mds.b.smithi043.stdout:Sep 12 12:23:36 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-b[64540]: starting mds.b at 2024-09-12T12:23:36.365 INFO:journalctl@ceph.mds.b.smithi043.stdout:Sep 12 12:23:36 smithi043 bash[64525]: c860099f1dcc491f3b77b9627ba609d321e11a3131e14060470fc92b3ef71dc5 2024-09-12T12:23:36.365 INFO:journalctl@ceph.mds.b.smithi043.stdout:Sep 12 12:23:36 smithi043 systemd[1]: Started Ceph mds.b for a66dfafc-7100-11ef-bcea-c7b262605968. 2024-09-12T12:23:36.886 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:23:37.267 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:37 smithi043 ceph-mon[34144]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:37.267 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:37 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:37.267 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:37 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:37.267 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:37 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:37.267 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:37 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:37.268 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:37 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:37.268 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:37 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:23:37.268 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:37 smithi043 ceph-mon[34144]: mds.? [v2:172.21.15.43:6838/1987408860,v1:172.21.15.43:6839/1987408860] up:boot 2024-09-12T12:23:37.268 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:37 smithi043 ceph-mon[34144]: fsmap 12 up:standby 2024-09-12T12:23:37.268 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:37 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T12:23:37.393 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:23:37.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:37 smithi102 ceph-mon[34799]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:37.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:37 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:37.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:37 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:37.397 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:37 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:37.397 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:37 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:37.397 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:37 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:37.397 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:37 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:23:37.397 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:37 smithi102 ceph-mon[34799]: mds.? [v2:172.21.15.43:6838/1987408860,v1:172.21.15.43:6839/1987408860] up:boot 2024-09-12T12:23:37.397 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:37 smithi102 ceph-mon[34799]: fsmap 12 up:standby 2024-09-12T12:23:37.397 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:37 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T12:23:37.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:37 smithi033 ceph-mon[31246]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:37.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:37 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:37.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:37 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:37.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:37 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:37.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:37 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:37.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:37 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:37.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:37 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:23:37.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:37 smithi033 ceph-mon[31246]: mds.? [v2:172.21.15.43:6838/1987408860,v1:172.21.15.43:6839/1987408860] up:boot 2024-09-12T12:23:37.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:37 smithi033 ceph-mon[31246]: fsmap 12 up:standby 2024-09-12T12:23:37.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:37 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T12:23:37.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:37.892+0000 7f569a642640 1 -- 172.21.15.33:0/1536088083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56941008d0 msgr2=0x7f5694100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:37.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:37.892+0000 7f569a642640 1 --2- 172.21.15.33:0/1536088083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56941008d0 0x7f5694100cb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5684009900 tx=0x7f568402a410 comp rx=0 tx=0).stop 2024-09-12T12:23:37.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:37.892+0000 7f569a642640 1 -- 172.21.15.33:0/1536088083 shutdown_connections 2024-09-12T12:23:37.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:37.892+0000 7f569a642640 1 --2- 172.21.15.33:0/1536088083 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f569410e480 0x7f5694110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:37.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:37.892+0000 7f569a642640 1 --2- 172.21.15.33:0/1536088083 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5694101280 0x7f569410df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:37.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:37.892+0000 7f569a642640 1 --2- 172.21.15.33:0/1536088083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56941008d0 0x7f5694100cb0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:37.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:37.892+0000 7f569a642640 1 -- 172.21.15.33:0/1536088083 >> 172.21.15.33:0/1536088083 conn(0x7f56940fc7a0 msgr2=0x7f56940febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:37.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:37.893+0000 7f569a642640 1 -- 172.21.15.33:0/1536088083 shutdown_connections 2024-09-12T12:23:37.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:37.893+0000 7f569a642640 1 -- 172.21.15.33:0/1536088083 wait complete. 2024-09-12T12:23:37.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:37.893+0000 7f569a642640 1 Processor -- start 2024-09-12T12:23:37.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:37.893+0000 7f569a642640 1 -- start start 2024-09-12T12:23:37.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:37.893+0000 7f569a642640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56941008d0 0x7f569419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:37.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:37.893+0000 7f569a642640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5694101280 0x7f569419ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:37.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:37.893+0000 7f569a642640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f569410e480 0x7f569419eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:37.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:37.894+0000 7f569a642640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5694114060 con 0x7f5694101280 2024-09-12T12:23:37.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:37.894+0000 7f569a642640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5694113ee0 con 0x7f56941008d0 2024-09-12T12:23:37.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:37.894+0000 7f569a642640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f56941141e0 con 0x7f569410e480 2024-09-12T12:23:37.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:37.894+0000 7f56937fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5694101280 0x7f569419ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:37.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:37.894+0000 7f56937fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5694101280 0x7f569419ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49942/0 (socket says 172.21.15.33:49942) 2024-09-12T12:23:37.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:37.894+0000 7f56937fe640 1 -- 172.21.15.33:0/781588053 learned_addr learned my addr 172.21.15.33:0/781588053 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:23:37.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:37.894+0000 7f5698bdf640 1 --2- 172.21.15.33:0/781588053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f569410e480 0x7f569419eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:37.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:37.894+0000 7f5693fff640 1 --2- 172.21.15.33:0/781588053 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56941008d0 0x7f569419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:37.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:37.894+0000 7f56937fe640 1 -- 172.21.15.33:0/781588053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f569410e480 msgr2=0x7f569419eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:37.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:37.894+0000 7f56937fe640 1 --2- 172.21.15.33:0/781588053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f569410e480 0x7f569419eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:37.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:37.894+0000 7f56937fe640 1 -- 172.21.15.33:0/781588053 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56941008d0 msgr2=0x7f569419a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:37.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:37.894+0000 7f56937fe640 1 --2- 172.21.15.33:0/781588053 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56941008d0 0x7f569419a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:37.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:37.894+0000 7f56937fe640 1 -- 172.21.15.33:0/781588053 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f569419f5d0 con 0x7f5694101280 2024-09-12T12:23:37.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:37.894+0000 7f5698bdf640 1 --2- 172.21.15.33:0/781588053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f569410e480 0x7f569419eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:23:37.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:37.894+0000 7f56937fe640 1 --2- 172.21.15.33:0/781588053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5694101280 0x7f569419ab60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f568800e9f0 tx=0x7f568800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:37.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:37.894+0000 7f56917fa640 1 -- 172.21.15.33:0/781588053 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568800cd80 con 0x7f5694101280 2024-09-12T12:23:37.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:37.894+0000 7f56917fa640 1 -- 172.21.15.33:0/781588053 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f56880054d0 con 0x7f5694101280 2024-09-12T12:23:37.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:37.894+0000 7f569a642640 1 -- 172.21.15.33:0/781588053 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f569419f8c0 con 0x7f5694101280 2024-09-12T12:23:37.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:37.894+0000 7f56917fa640 1 -- 172.21.15.33:0/781588053 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5688010490 con 0x7f5694101280 2024-09-12T12:23:37.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:37.894+0000 7f569a642640 1 -- 172.21.15.33:0/781588053 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56941a71a0 con 0x7f5694101280 2024-09-12T12:23:37.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:37.896+0000 7f569a642640 1 -- 172.21.15.33:0/781588053 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5694100cb0 con 0x7f5694101280 2024-09-12T12:23:37.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:37.897+0000 7f56917fa640 1 -- 172.21.15.33:0/781588053 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f5688005020 con 0x7f5694101280 2024-09-12T12:23:37.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:37.897+0000 7f56917fa640 1 --2- 172.21.15.33:0/781588053 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f567c0a2b80 0x7f567c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:37.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:37.897+0000 7f5693fff640 1 --2- 172.21.15.33:0/781588053 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f567c0a2b80 0x7f567c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:37.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:37.897+0000 7f56917fa640 1 -- 172.21.15.33:0/781588053 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f56880cef00 con 0x7f5694101280 2024-09-12T12:23:37.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:37.898+0000 7f5693fff640 1 --2- 172.21.15.33:0/781588053 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f567c0a2b80 0x7f567c0a5040 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5684031440 tx=0x7f5684005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:37.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:37.902+0000 7f56917fa640 1 -- 172.21.15.33:0/781588053 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f568809c300 con 0x7f5694101280 2024-09-12T12:23:38.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:38.164+0000 7f569a642640 1 -- 172.21.15.33:0/781588053 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f569402d7c0 con 0x7f5694101280 2024-09-12T12:23:38.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:38.165+0000 7f56917fa640 1 -- 172.21.15.33:0/781588053 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10521 (secure 0 0 0) 0x7f568809bc00 con 0x7f5694101280 2024-09-12T12:23:38.165 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:23:38.165 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":13,"btime":"2024-09-12T12:23:36:436679+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3327066342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3327066342},{"type":"v1","addr":"172.21.15.33:6835","nonce":3327066342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/19516401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":19516401},{"type":"v1","addr":"172.21.15.33:6837","nonce":19516401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1260196118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1260196118},{"type":"v1","addr":"172.21.15.33:6839","nonce":1260196118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/4288248356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4288248356},{"type":"v1","addr":"172.21.15.33:6841","nonce":4288248356}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/3051073141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3051073141},{"type":"v1","addr":"172.21.15.43:6833","nonce":3051073141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3282762800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3282762800},{"type":"v1","addr":"172.21.15.43:6835","nonce":3282762800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/3051713000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3051713000},{"type":"v1","addr":"172.21.15.102:6833","nonce":3051713000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2472064883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2472064883},{"type":"v1","addr":"172.21.15.43:6837","nonce":2472064883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24473,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6839/1987408860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":1987408860},{"type":"v1","addr":"172.21.15.43:6839","nonce":1987408860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24478,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/4179527539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":4179527539},{"type":"v1","addr":"172.21.15.102:6835","nonce":4179527539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24490,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2409953270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2409953270},{"type":"v1","addr":"172.21.15.102:6837","nonce":2409953270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24499,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/1553271340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":1553271340},{"type":"v1","addr":"172.21.15.102:6839","nonce":1553271340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-12T12:23:38.165 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 13 2024-09-12T12:23:38.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:38.168+0000 7f569a642640 1 -- 172.21.15.33:0/781588053 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f567c0a2b80 msgr2=0x7f567c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:38.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:38.168+0000 7f569a642640 1 --2- 172.21.15.33:0/781588053 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f567c0a2b80 0x7f567c0a5040 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5684031440 tx=0x7f5684005b50 comp rx=0 tx=0).stop 2024-09-12T12:23:38.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:38.168+0000 7f569a642640 1 -- 172.21.15.33:0/781588053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5694101280 msgr2=0x7f569419ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:38.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:38.168+0000 7f569a642640 1 --2- 172.21.15.33:0/781588053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5694101280 0x7f569419ab60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f568800e9f0 tx=0x7f568800edf0 comp rx=0 tx=0).stop 2024-09-12T12:23:38.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:38.168+0000 7f569a642640 1 -- 172.21.15.33:0/781588053 shutdown_connections 2024-09-12T12:23:38.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:38.168+0000 7f569a642640 1 --2- 172.21.15.33:0/781588053 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f567c0a2b80 0x7f567c0a5040 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:38.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:38.168+0000 7f569a642640 1 --2- 172.21.15.33:0/781588053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f569410e480 0x7f569419eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:38.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:38.168+0000 7f569a642640 1 --2- 172.21.15.33:0/781588053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5694101280 0x7f569419ab60 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:38.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:38.168+0000 7f569a642640 1 --2- 172.21.15.33:0/781588053 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56941008d0 0x7f569419a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:38.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:38.168+0000 7f569a642640 1 -- 172.21.15.33:0/781588053 >> 172.21.15.33:0/781588053 conn(0x7f56940fc7a0 msgr2=0x7f56940feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:38.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:38.169+0000 7f569a642640 1 -- 172.21.15.33:0/781588053 shutdown_connections 2024-09-12T12:23:38.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:38.169+0000 7f569a642640 1 -- 172.21.15.33:0/781588053 wait complete. 2024-09-12T12:23:38.851 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:38 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:38.852 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:38 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:38.852 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:38 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:38.852 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:38 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:38.852 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:38 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:38.852 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:38 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/781588053' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:23:38.886 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-12T12:23:39.088 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:38 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:39.089 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:38 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:39.089 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:38 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:39.089 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:38 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:39.089 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:38 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:39.089 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:38 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/781588053' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:23:39.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:38 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:39.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:38 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:39.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:38 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:39.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:38 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:39.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:38 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:39.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:38 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/781588053' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:23:39.157 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:23:39.753 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:39 smithi102 ceph-mon[34799]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:39.754 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:39 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:39.754 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:39 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:39.754 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:39 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:39.754 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:39 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:23:39.754 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:39 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:39.754 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:39 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:23:39.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.747+0000 7f8251c96640 1 -- 172.21.15.33:0/1106269799 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f824c102d30 msgr2=0x7f824c103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:39.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.747+0000 7f8251c96640 1 --2- 172.21.15.33:0/1106269799 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f824c102d30 0x7f824c103110 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f823c009930 tx=0x7f823c02a420 comp rx=0 tx=0).stop 2024-09-12T12:23:39.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.747+0000 7f8251c96640 1 -- 172.21.15.33:0/1106269799 shutdown_connections 2024-09-12T12:23:39.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.747+0000 7f8251c96640 1 --2- 172.21.15.33:0/1106269799 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f824c1082a0 0x7f824c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:39.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.747+0000 7f8251c96640 1 --2- 172.21.15.33:0/1106269799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f824c1036e0 0x7f824c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:39.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.747+0000 7f8251c96640 1 --2- 172.21.15.33:0/1106269799 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f824c102d30 0x7f824c103110 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:39.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.747+0000 7f8251c96640 1 -- 172.21.15.33:0/1106269799 >> 172.21.15.33:0/1106269799 conn(0x7f824c0fc7d0 msgr2=0x7f824c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:39.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.747+0000 7f8251c96640 1 -- 172.21.15.33:0/1106269799 shutdown_connections 2024-09-12T12:23:39.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.747+0000 7f8251c96640 1 -- 172.21.15.33:0/1106269799 wait complete. 2024-09-12T12:23:39.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.748+0000 7f8251c96640 1 Processor -- start 2024-09-12T12:23:39.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.748+0000 7f8251c96640 1 -- start start 2024-09-12T12:23:39.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.748+0000 7f8251c96640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f824c102d30 0x7f824c198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:39.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.748+0000 7f8251c96640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f824c1036e0 0x7f824c198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:39.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.748+0000 7f8251c96640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f824c1082a0 0x7f824c19cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:39.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.748+0000 7f8251c96640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f824c111f50 con 0x7f824c1082a0 2024-09-12T12:23:39.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.748+0000 7f8251c96640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f824c111dd0 con 0x7f824c1036e0 2024-09-12T12:23:39.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.748+0000 7f8251c96640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f824c1120d0 con 0x7f824c102d30 2024-09-12T12:23:39.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.748+0000 7f824bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f824c1082a0 0x7f824c19cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:39.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.748+0000 7f824b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f824c102d30 0x7f824c198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:39.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.748+0000 7f824affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f824c1036e0 0x7f824c198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:39.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.748+0000 7f824b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f824c102d30 0x7f824c198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:38712/0 (socket says 172.21.15.33:38712) 2024-09-12T12:23:39.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.748+0000 7f824bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f824c1082a0 0x7f824c19cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49956/0 (socket says 172.21.15.33:49956) 2024-09-12T12:23:39.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.748+0000 7f824b7fe640 1 -- 172.21.15.33:0/231030057 learned_addr learned my addr 172.21.15.33:0/231030057 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:23:39.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.749+0000 7f824bfff640 1 -- 172.21.15.33:0/231030057 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f824c102d30 msgr2=0x7f824c198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:39.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.749+0000 7f824bfff640 1 --2- 172.21.15.33:0/231030057 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f824c102d30 0x7f824c198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:39.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.749+0000 7f824bfff640 1 -- 172.21.15.33:0/231030057 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f824c1036e0 msgr2=0x7f824c198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:39.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.749+0000 7f824bfff640 1 --2- 172.21.15.33:0/231030057 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f824c1036e0 0x7f824c198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:39.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.749+0000 7f824bfff640 1 -- 172.21.15.33:0/231030057 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f824c19d4c0 con 0x7f824c1082a0 2024-09-12T12:23:39.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.749+0000 7f824b7fe640 1 --2- 172.21.15.33:0/231030057 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f824c102d30 0x7f824c198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:23:39.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.749+0000 7f824bfff640 1 --2- 172.21.15.33:0/231030057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f824c1082a0 0x7f824c19cde0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f824400e940 tx=0x7f824400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:39.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.749+0000 7f8248ff9640 1 -- 172.21.15.33:0/231030057 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8244004d20 con 0x7f824c1082a0 2024-09-12T12:23:39.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.749+0000 7f8248ff9640 1 -- 172.21.15.33:0/231030057 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8244005020 con 0x7f824c1082a0 2024-09-12T12:23:39.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.749+0000 7f8251c96640 1 -- 172.21.15.33:0/231030057 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f824c19d7b0 con 0x7f824c1082a0 2024-09-12T12:23:39.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.749+0000 7f8248ff9640 1 -- 172.21.15.33:0/231030057 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82440116d0 con 0x7f824c1082a0 2024-09-12T12:23:39.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.749+0000 7f8251c96640 1 -- 172.21.15.33:0/231030057 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f824c1a5090 con 0x7f824c1082a0 2024-09-12T12:23:39.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.750+0000 7f8251c96640 1 -- 172.21.15.33:0/231030057 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f824c06a850 con 0x7f824c1082a0 2024-09-12T12:23:39.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.752+0000 7f8248ff9640 1 -- 172.21.15.33:0/231030057 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f824400cb20 con 0x7f824c1082a0 2024-09-12T12:23:39.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.752+0000 7f8248ff9640 1 --2- 172.21.15.33:0/231030057 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f82340a2b80 0x7f82340a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:39.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.752+0000 7f824b7fe640 1 --2- 172.21.15.33:0/231030057 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f82340a2b80 0x7f82340a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:39.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.752+0000 7f8248ff9640 1 -- 172.21.15.33:0/231030057 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f82440cef80 con 0x7f824c1082a0 2024-09-12T12:23:39.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.753+0000 7f824b7fe640 1 --2- 172.21.15.33:0/231030057 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f82340a2b80 0x7f82340a5040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f823c000c00 tx=0x7f823c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:39.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.758+0000 7f8248ff9640 1 -- 172.21.15.33:0/231030057 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8244016030 con 0x7f824c1082a0 2024-09-12T12:23:39.791 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:39 smithi033 ceph-mon[31246]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:39.791 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:39 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:39.791 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:39 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:39.791 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:39 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:39.791 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:39 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:23:39.791 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:39 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:39.791 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:39 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:23:39.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.958+0000 7f8251c96640 1 -- 172.21.15.33:0/231030057 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f824c10a310 con 0x7f824c1082a0 2024-09-12T12:23:39.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.958+0000 7f8248ff9640 1 -- 172.21.15.33:0/231030057 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v74) ==== 84+0+65 (secure 0 0 0) 0x7f824409bd30 con 0x7f824c1082a0 2024-09-12T12:23:39.958 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:23:39.959 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2024-09-12T12:23:39.959 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:23:39.959 INFO:teuthology.orchestra.run.smithi033.stdout: "poolnum": 1, 2024-09-12T12:23:39.959 INFO:teuthology.orchestra.run.smithi033.stdout: "poolname": ".mgr" 2024-09-12T12:23:39.959 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:23:39.959 INFO:teuthology.orchestra.run.smithi033.stdout:] 2024-09-12T12:23:39.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.961+0000 7f8251c96640 1 -- 172.21.15.33:0/231030057 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f82340a2b80 msgr2=0x7f82340a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:39.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.961+0000 7f8251c96640 1 --2- 172.21.15.33:0/231030057 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f82340a2b80 0x7f82340a5040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f823c000c00 tx=0x7f823c0058d0 comp rx=0 tx=0).stop 2024-09-12T12:23:39.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.961+0000 7f8251c96640 1 -- 172.21.15.33:0/231030057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f824c1082a0 msgr2=0x7f824c19cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:39.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.961+0000 7f8251c96640 1 --2- 172.21.15.33:0/231030057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f824c1082a0 0x7f824c19cde0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f824400e940 tx=0x7f824400ee00 comp rx=0 tx=0).stop 2024-09-12T12:23:39.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.961+0000 7f8251c96640 1 -- 172.21.15.33:0/231030057 shutdown_connections 2024-09-12T12:23:39.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.961+0000 7f8251c96640 1 --2- 172.21.15.33:0/231030057 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f82340a2b80 0x7f82340a5040 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:39.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.961+0000 7f8251c96640 1 --2- 172.21.15.33:0/231030057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f824c1082a0 0x7f824c19cde0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:39.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.961+0000 7f8251c96640 1 --2- 172.21.15.33:0/231030057 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f824c1036e0 0x7f824c198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:39.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.961+0000 7f8251c96640 1 --2- 172.21.15.33:0/231030057 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f824c102d30 0x7f824c198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:39.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.961+0000 7f8251c96640 1 -- 172.21.15.33:0/231030057 >> 172.21.15.33:0/231030057 conn(0x7f824c0fc7d0 msgr2=0x7f824c105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:39.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.961+0000 7f8251c96640 1 -- 172.21.15.33:0/231030057 shutdown_connections 2024-09-12T12:23:39.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:39.961+0000 7f8251c96640 1 -- 172.21.15.33:0/231030057 wait complete. 2024-09-12T12:23:40.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:39 smithi043 ceph-mon[34144]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:40.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:39 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:40.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:39 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:40.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:39 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:40.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:39 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:23:40.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:39 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:40.117 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:39 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:23:40.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:40 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/231030057' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-12T12:23:40.991 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T12:23:40.991 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T12:23:41.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:40 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/231030057' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-12T12:23:41.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:40 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/231030057' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-12T12:23:41.369 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:23:41.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:41.841+0000 7fee4356f640 1 -- 172.21.15.33:0/1708645411 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee3c102570 msgr2=0x7fee3c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:41.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:41.841+0000 7fee4356f640 1 --2- 172.21.15.33:0/1708645411 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee3c102570 0x7fee3c1029b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fee2c009900 tx=0x7fee2c02a480 comp rx=0 tx=0).stop 2024-09-12T12:23:41.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:41.841+0000 7fee4356f640 1 -- 172.21.15.33:0/1708645411 shutdown_connections 2024-09-12T12:23:41.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:41.841+0000 7fee4356f640 1 --2- 172.21.15.33:0/1708645411 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee3c102ef0 0x7fee3c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:41.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:41.841+0000 7fee4356f640 1 --2- 172.21.15.33:0/1708645411 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee3c102570 0x7fee3c1029b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:41.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:41.841+0000 7fee4356f640 1 --2- 172.21.15.33:0/1708645411 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee3c100e20 0x7fee3c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:41.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:41.841+0000 7fee4356f640 1 -- 172.21.15.33:0/1708645411 >> 172.21.15.33:0/1708645411 conn(0x7fee3c0fc7d0 msgr2=0x7fee3c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:41.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:41.842+0000 7fee4356f640 1 -- 172.21.15.33:0/1708645411 shutdown_connections 2024-09-12T12:23:41.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:41.842+0000 7fee4356f640 1 -- 172.21.15.33:0/1708645411 wait complete. 2024-09-12T12:23:41.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:41.842+0000 7fee4356f640 1 Processor -- start 2024-09-12T12:23:41.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:41.842+0000 7fee4356f640 1 -- start start 2024-09-12T12:23:41.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:41.842+0000 7fee4356f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee3c100e20 0x7fee3c1984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:41.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:41.842+0000 7fee4356f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee3c102570 0x7fee3c198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:41.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:41.842+0000 7fee4356f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee3c102ef0 0x7fee3c19cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:41.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:41.842+0000 7fee4356f640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fee3c110e50 con 0x7fee3c102570 2024-09-12T12:23:41.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:41.842+0000 7fee4356f640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fee3c110cd0 con 0x7fee3c102ef0 2024-09-12T12:23:41.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:41.842+0000 7fee4356f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fee3c110fd0 con 0x7fee3c100e20 2024-09-12T12:23:41.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:41.843+0000 7fee40b0a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee3c102570 0x7fee3c198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:41.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:41.843+0000 7fee40b0a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee3c102570 0x7fee3c198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44984/0 (socket says 172.21.15.33:44984) 2024-09-12T12:23:41.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:41.843+0000 7fee40b0a640 1 -- 172.21.15.33:0/1015439324 learned_addr learned my addr 172.21.15.33:0/1015439324 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:23:41.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:41.843+0000 7fee41b0c640 1 --2- 172.21.15.33:0/1015439324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee3c102ef0 0x7fee3c19cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:41.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:41.843+0000 7fee4130b640 1 --2- 172.21.15.33:0/1015439324 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee3c100e20 0x7fee3c1984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:41.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:41.843+0000 7fee40b0a640 1 -- 172.21.15.33:0/1015439324 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee3c100e20 msgr2=0x7fee3c1984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:41.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:41.843+0000 7fee40b0a640 1 --2- 172.21.15.33:0/1015439324 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee3c100e20 0x7fee3c1984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:41.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:41.843+0000 7fee40b0a640 1 -- 172.21.15.33:0/1015439324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee3c102ef0 msgr2=0x7fee3c19cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:41.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:41.843+0000 7fee40b0a640 1 --2- 172.21.15.33:0/1015439324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee3c102ef0 0x7fee3c19cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:41.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:41.843+0000 7fee40b0a640 1 -- 172.21.15.33:0/1015439324 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee3c19d480 con 0x7fee3c102570 2024-09-12T12:23:41.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:41.843+0000 7fee40b0a640 1 --2- 172.21.15.33:0/1015439324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee3c102570 0x7fee3c198a10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fee2c006010 tx=0x7fee2c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:41.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:41.843+0000 7fee327fc640 1 -- 172.21.15.33:0/1015439324 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2c03f070 con 0x7fee3c102570 2024-09-12T12:23:41.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:41.843+0000 7fee327fc640 1 -- 172.21.15.33:0/1015439324 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fee2c003aa0 con 0x7fee3c102570 2024-09-12T12:23:41.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:41.843+0000 7fee4356f640 1 -- 172.21.15.33:0/1015439324 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee3c19d710 con 0x7fee3c102570 2024-09-12T12:23:41.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:41.843+0000 7fee327fc640 1 -- 172.21.15.33:0/1015439324 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2c035030 con 0x7fee3c102570 2024-09-12T12:23:41.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:41.843+0000 7fee4356f640 1 -- 172.21.15.33:0/1015439324 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee3c0fcbb0 con 0x7fee3c102570 2024-09-12T12:23:41.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:41.845+0000 7fee4356f640 1 -- 172.21.15.33:0/1015439324 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee3c1021b0 con 0x7fee3c102570 2024-09-12T12:23:41.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:41.846+0000 7fee327fc640 1 -- 172.21.15.33:0/1015439324 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fee2c042070 con 0x7fee3c102570 2024-09-12T12:23:41.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:41.846+0000 7fee327fc640 1 --2- 172.21.15.33:0/1015439324 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fee280a2b80 0x7fee280a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:41.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:41.846+0000 7fee4130b640 1 --2- 172.21.15.33:0/1015439324 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fee280a2b80 0x7fee280a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:41.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:41.846+0000 7fee327fc640 1 -- 172.21.15.33:0/1015439324 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fee2c0ef510 con 0x7fee3c102570 2024-09-12T12:23:41.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:41.847+0000 7fee4130b640 1 --2- 172.21.15.33:0/1015439324 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fee280a2b80 0x7fee280a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fee38009890 tx=0x7fee38008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:41.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:41.850+0000 7fee327fc640 1 -- 172.21.15.33:0/1015439324 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fee2c0bc910 con 0x7fee3c102570 2024-09-12T12:23:41.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:41 smithi033 ceph-mon[31246]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:41.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:41 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:41.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:41 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:41.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:41 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:41.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:41 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:42.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:42.068+0000 7fee4356f640 1 -- 172.21.15.33:0/1015439324 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fee3c199830 con 0x7fee3c102570 2024-09-12T12:23:42.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:41 smithi043 ceph-mon[34144]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:42.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:41 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:42.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:41 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:42.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:41 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:42.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:41 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:42.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:41 smithi102 ceph-mon[34799]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:42.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:41 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:42.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:41 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:42.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:41 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:42.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:41 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:42.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:42.768+0000 7fee327fc640 1 -- 172.21.15.33:0/1015439324 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v75) ==== 138+0+0 (secure 0 0 0) 0x7fee2c0bc210 con 0x7fee3c102570 2024-09-12T12:23:42.770 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' created 2024-09-12T12:23:42.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:42.771+0000 7fee4356f640 1 -- 172.21.15.33:0/1015439324 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fee280a2b80 msgr2=0x7fee280a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:42.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:42.771+0000 7fee4356f640 1 --2- 172.21.15.33:0/1015439324 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fee280a2b80 0x7fee280a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fee38009890 tx=0x7fee38008040 comp rx=0 tx=0).stop 2024-09-12T12:23:42.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:42.771+0000 7fee4356f640 1 -- 172.21.15.33:0/1015439324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee3c102570 msgr2=0x7fee3c198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:42.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:42.771+0000 7fee4356f640 1 --2- 172.21.15.33:0/1015439324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee3c102570 0x7fee3c198a10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fee2c006010 tx=0x7fee2c0042f0 comp rx=0 tx=0).stop 2024-09-12T12:23:42.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:42.771+0000 7fee4356f640 1 -- 172.21.15.33:0/1015439324 shutdown_connections 2024-09-12T12:23:42.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:42.771+0000 7fee4356f640 1 --2- 172.21.15.33:0/1015439324 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fee280a2b80 0x7fee280a5040 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:42.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:42.771+0000 7fee4356f640 1 --2- 172.21.15.33:0/1015439324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee3c102ef0 0x7fee3c19cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:42.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:42.771+0000 7fee4356f640 1 --2- 172.21.15.33:0/1015439324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee3c102570 0x7fee3c198a10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:42.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:42.771+0000 7fee4356f640 1 --2- 172.21.15.33:0/1015439324 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee3c100e20 0x7fee3c1984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:42.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:42.771+0000 7fee4356f640 1 -- 172.21.15.33:0/1015439324 >> 172.21.15.33:0/1015439324 conn(0x7fee3c0fc7d0 msgr2=0x7fee3c06a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:42.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:42.771+0000 7fee4356f640 1 -- 172.21.15.33:0/1015439324 shutdown_connections 2024-09-12T12:23:42.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:42.771+0000 7fee4356f640 1 -- 172.21.15.33:0/1015439324 wait complete. 2024-09-12T12:23:43.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:42 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/1015439324' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T12:23:43.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:42 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:43.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:42 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:43.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:42 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:43.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:42 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:23:43.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:42 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:43.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:42 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/1015439324' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T12:23:43.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:42 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:43.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:42 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:43.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:42 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:43.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:42 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:23:43.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:42 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:43.147 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:42 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/1015439324' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T12:23:43.147 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:42 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:43.147 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:42 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:43.147 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:42 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:43.147 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:42 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:23:43.147 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:42 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:23:43.447 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-12T12:23:43.708 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:23:44.033 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:43 smithi033 ceph-mon[31246]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:44.034 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:43 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/1015439324' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-12T12:23:44.034 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:43 smithi033 ceph-mon[31246]: osdmap e75: 12 total, 12 up, 12 in 2024-09-12T12:23:44.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:43 smithi043 ceph-mon[34144]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:44.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:43 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/1015439324' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-12T12:23:44.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:43 smithi043 ceph-mon[34144]: osdmap e75: 12 total, 12 up, 12 in 2024-09-12T12:23:44.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:43 smithi102 ceph-mon[34799]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:44.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:43 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/1015439324' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-12T12:23:44.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:43 smithi102 ceph-mon[34799]: osdmap e75: 12 total, 12 up, 12 in 2024-09-12T12:23:44.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.226+0000 7f76d5972640 1 -- 172.21.15.33:0/2292187303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76d0103660 msgr2=0x7f76d010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:44.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.226+0000 7f76d5972640 1 --2- 172.21.15.33:0/2292187303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76d0103660 0x7f76d010bb50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f76c4009900 tx=0x7f76c402a480 comp rx=0 tx=0).stop 2024-09-12T12:23:44.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.226+0000 7f76d5972640 1 -- 172.21.15.33:0/2292187303 shutdown_connections 2024-09-12T12:23:44.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.226+0000 7f76d5972640 1 --2- 172.21.15.33:0/2292187303 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76d010c170 0x7f76d010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:44.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.226+0000 7f76d5972640 1 --2- 172.21.15.33:0/2292187303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76d0103660 0x7f76d010bb50 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:44.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.226+0000 7f76d5972640 1 --2- 172.21.15.33:0/2292187303 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76d0102d40 0x7f76d0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:44.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.226+0000 7f76d5972640 1 -- 172.21.15.33:0/2292187303 >> 172.21.15.33:0/2292187303 conn(0x7f76d00fc7a0 msgr2=0x7f76d00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:44.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.226+0000 7f76d5972640 1 -- 172.21.15.33:0/2292187303 shutdown_connections 2024-09-12T12:23:44.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.226+0000 7f76d5972640 1 -- 172.21.15.33:0/2292187303 wait complete. 2024-09-12T12:23:44.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.227+0000 7f76d5972640 1 Processor -- start 2024-09-12T12:23:44.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.227+0000 7f76d5972640 1 -- start start 2024-09-12T12:23:44.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.227+0000 7f76d5972640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76d0102d40 0x7f76d01009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:44.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.227+0000 7f76d5972640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76d0103660 0x7f76d0100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:44.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.227+0000 7f76d5972640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76d010c170 0x7f76d0101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:44.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.227+0000 7f76d5972640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f76d0111e20 con 0x7f76d0102d40 2024-09-12T12:23:44.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.227+0000 7f76d5972640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f76d0111ca0 con 0x7f76d0103660 2024-09-12T12:23:44.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.227+0000 7f76d5972640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f76d0111fa0 con 0x7f76d010c170 2024-09-12T12:23:44.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.227+0000 7f76ceffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76d0102d40 0x7f76d01009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:44.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.227+0000 7f76ceffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76d0102d40 0x7f76d01009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44990/0 (socket says 172.21.15.33:44990) 2024-09-12T12:23:44.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.227+0000 7f76ceffd640 1 -- 172.21.15.33:0/3118702785 learned_addr learned my addr 172.21.15.33:0/3118702785 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:23:44.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.227+0000 7f76ce7fc640 1 --2- 172.21.15.33:0/3118702785 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76d0103660 0x7f76d0100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:44.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.227+0000 7f76cf7fe640 1 --2- 172.21.15.33:0/3118702785 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76d010c170 0x7f76d0101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:44.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.227+0000 7f76ceffd640 1 -- 172.21.15.33:0/3118702785 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76d010c170 msgr2=0x7f76d0101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:44.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.227+0000 7f76ceffd640 1 --2- 172.21.15.33:0/3118702785 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76d010c170 0x7f76d0101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:44.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.227+0000 7f76ceffd640 1 -- 172.21.15.33:0/3118702785 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76d0103660 msgr2=0x7f76d0100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:44.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.228+0000 7f76ceffd640 1 --2- 172.21.15.33:0/3118702785 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76d0103660 0x7f76d0100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:44.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.228+0000 7f76ceffd640 1 -- 172.21.15.33:0/3118702785 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76d01a6820 con 0x7f76d0102d40 2024-09-12T12:23:44.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.228+0000 7f76ceffd640 1 --2- 172.21.15.33:0/3118702785 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76d0102d40 0x7f76d01009a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f76c000c890 tx=0x7f76c000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:44.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.228+0000 7f76d4970640 1 -- 172.21.15.33:0/3118702785 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c0004220 con 0x7f76d0102d40 2024-09-12T12:23:44.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.228+0000 7f76d4970640 1 -- 172.21.15.33:0/3118702785 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f76c00043c0 con 0x7f76d0102d40 2024-09-12T12:23:44.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.228+0000 7f76d5972640 1 -- 172.21.15.33:0/3118702785 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76d01a6b10 con 0x7f76d0102d40 2024-09-12T12:23:44.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.228+0000 7f76d4970640 1 -- 172.21.15.33:0/3118702785 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c0004a00 con 0x7f76d0102d40 2024-09-12T12:23:44.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.228+0000 7f76d5972640 1 -- 172.21.15.33:0/3118702785 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76d01a7020 con 0x7f76d0102d40 2024-09-12T12:23:44.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.229+0000 7f76d5972640 1 -- 172.21.15.33:0/3118702785 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76d0103120 con 0x7f76d0102d40 2024-09-12T12:23:44.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.230+0000 7f76d4970640 1 -- 172.21.15.33:0/3118702785 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f76c0004ba0 con 0x7f76d0102d40 2024-09-12T12:23:44.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.231+0000 7f76d4970640 1 --2- 172.21.15.33:0/3118702785 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f76b80a2b80 0x7f76b80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:44.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.232+0000 7f76ce7fc640 1 --2- 172.21.15.33:0/3118702785 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f76b80a2b80 0x7f76b80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:44.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.232+0000 7f76d4970640 1 -- 172.21.15.33:0/3118702785 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7497+0+0 (secure 0 0 0) 0x7f76c00cea80 con 0x7f76d0102d40 2024-09-12T12:23:44.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.232+0000 7f76ce7fc640 1 --2- 172.21.15.33:0/3118702785 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f76b80a2b80 0x7f76b80a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f76c4031440 tx=0x7f76c40095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:44.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.236+0000 7f76d4970640 1 -- 172.21.15.33:0/3118702785 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f76c0014030 con 0x7f76d0102d40 2024-09-12T12:23:44.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.412+0000 7f76d5972640 1 -- 172.21.15.33:0/3118702785 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f76d0101ed0 con 0x7f76d0102d40 2024-09-12T12:23:44.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.849+0000 7f76d4970640 1 -- 172.21.15.33:0/3118702785 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v77) ==== 171+0+0 (secure 0 0 0) 0x7f76c009bd10 con 0x7f76d0102d40 2024-09-12T12:23:44.850 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' created 2024-09-12T12:23:44.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.851+0000 7f76d5972640 1 -- 172.21.15.33:0/3118702785 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f76b80a2b80 msgr2=0x7f76b80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:44.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.851+0000 7f76d5972640 1 --2- 172.21.15.33:0/3118702785 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f76b80a2b80 0x7f76b80a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f76c4031440 tx=0x7f76c40095f0 comp rx=0 tx=0).stop 2024-09-12T12:23:44.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.852+0000 7f76d5972640 1 -- 172.21.15.33:0/3118702785 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76d0102d40 msgr2=0x7f76d01009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:44.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.852+0000 7f76d5972640 1 --2- 172.21.15.33:0/3118702785 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76d0102d40 0x7f76d01009a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f76c000c890 tx=0x7f76c000cd50 comp rx=0 tx=0).stop 2024-09-12T12:23:44.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.852+0000 7f76d5972640 1 -- 172.21.15.33:0/3118702785 shutdown_connections 2024-09-12T12:23:44.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.852+0000 7f76d5972640 1 --2- 172.21.15.33:0/3118702785 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f76b80a2b80 0x7f76b80a5040 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:44.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.852+0000 7f76d5972640 1 --2- 172.21.15.33:0/3118702785 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76d010c170 0x7f76d0101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:44.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.852+0000 7f76d5972640 1 --2- 172.21.15.33:0/3118702785 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76d0103660 0x7f76d0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:44.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.852+0000 7f76d5972640 1 --2- 172.21.15.33:0/3118702785 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76d0102d40 0x7f76d01009a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:44.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.852+0000 7f76d5972640 1 -- 172.21.15.33:0/3118702785 >> 172.21.15.33:0/3118702785 conn(0x7f76d00fc7a0 msgr2=0x7f76d00fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:44.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.852+0000 7f76d5972640 1 -- 172.21.15.33:0/3118702785 shutdown_connections 2024-09-12T12:23:44.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:44.852+0000 7f76d5972640 1 -- 172.21.15.33:0/3118702785 wait complete. 2024-09-12T12:23:45.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:44 smithi043 ceph-mon[34144]: osdmap e76: 12 total, 12 up, 12 in 2024-09-12T12:23:45.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:44 smithi102 ceph-mon[34799]: osdmap e76: 12 total, 12 up, 12 in 2024-09-12T12:23:45.173 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:44 smithi033 ceph-mon[31246]: osdmap e76: 12 total, 12 up, 12 in 2024-09-12T12:23:45.452 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T12:23:45.708 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:23:46.094 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:45 smithi033 ceph-mon[31246]: pgmap v269: 33 pgs: 3 creating+peering, 29 unknown, 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:46.094 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:45 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/3118702785' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-12T12:23:46.094 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:45 smithi033 ceph-mon[31246]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T12:23:46.094 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:45 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/3118702785' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-12T12:23:46.094 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:45 smithi033 ceph-mon[31246]: osdmap e77: 12 total, 12 up, 12 in 2024-09-12T12:23:46.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:45 smithi102 ceph-mon[34799]: pgmap v269: 33 pgs: 3 creating+peering, 29 unknown, 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:46.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:45 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/3118702785' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-12T12:23:46.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:45 smithi102 ceph-mon[34799]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T12:23:46.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:45 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/3118702785' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-12T12:23:46.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:45 smithi102 ceph-mon[34799]: osdmap e77: 12 total, 12 up, 12 in 2024-09-12T12:23:46.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.179+0000 7f27b208d640 1 -- 172.21.15.33:0/1677119094 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27ac1082a0 msgr2=0x7f27ac10ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:46.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.179+0000 7f27b208d640 1 --2- 172.21.15.33:0/1677119094 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27ac1082a0 0x7f27ac10ec40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f27a4009930 tx=0x7f27a402a420 comp rx=0 tx=0).stop 2024-09-12T12:23:46.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.179+0000 7f27b208d640 1 -- 172.21.15.33:0/1677119094 shutdown_connections 2024-09-12T12:23:46.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.179+0000 7f27b208d640 1 --2- 172.21.15.33:0/1677119094 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27ac1082a0 0x7f27ac10ec40 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:46.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.179+0000 7f27b208d640 1 --2- 172.21.15.33:0/1677119094 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27ac1036e0 0x7f27ac107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:46.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.179+0000 7f27b208d640 1 --2- 172.21.15.33:0/1677119094 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27ac102d30 0x7f27ac103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:46.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.179+0000 7f27b208d640 1 -- 172.21.15.33:0/1677119094 >> 172.21.15.33:0/1677119094 conn(0x7f27ac0fc7d0 msgr2=0x7f27ac0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:46.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.179+0000 7f27b208d640 1 -- 172.21.15.33:0/1677119094 shutdown_connections 2024-09-12T12:23:46.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.179+0000 7f27b208d640 1 -- 172.21.15.33:0/1677119094 wait complete. 2024-09-12T12:23:46.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.179+0000 7f27b208d640 1 Processor -- start 2024-09-12T12:23:46.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.180+0000 7f27b208d640 1 -- start start 2024-09-12T12:23:46.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.180+0000 7f27b208d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27ac102d30 0x7f27ac100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:46.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.180+0000 7f27b208d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27ac1036e0 0x7f27ac100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:46.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.180+0000 7f27b208d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27ac1082a0 0x7f27ac101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:46.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.180+0000 7f27b208d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f27ac111f70 con 0x7f27ac102d30 2024-09-12T12:23:46.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.180+0000 7f27b208d640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f27ac111df0 con 0x7f27ac1036e0 2024-09-12T12:23:46.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.180+0000 7f27b208d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f27ac1120f0 con 0x7f27ac1082a0 2024-09-12T12:23:46.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.180+0000 7f27ab7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27ac102d30 0x7f27ac100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:46.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.180+0000 7f27ab7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27ac102d30 0x7f27ac100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45012/0 (socket says 172.21.15.33:45012) 2024-09-12T12:23:46.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.180+0000 7f27ab7fe640 1 -- 172.21.15.33:0/2393362480 learned_addr learned my addr 172.21.15.33:0/2393362480 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:23:46.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.180+0000 7f27aaffd640 1 --2- 172.21.15.33:0/2393362480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27ac1036e0 0x7f27ac100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:46.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.180+0000 7f27abfff640 1 --2- 172.21.15.33:0/2393362480 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27ac1082a0 0x7f27ac101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:46.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.180+0000 7f27ab7fe640 1 -- 172.21.15.33:0/2393362480 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27ac1082a0 msgr2=0x7f27ac101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:46.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.180+0000 7f27ab7fe640 1 --2- 172.21.15.33:0/2393362480 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27ac1082a0 0x7f27ac101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:46.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.180+0000 7f27ab7fe640 1 -- 172.21.15.33:0/2393362480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27ac1036e0 msgr2=0x7f27ac100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:46.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.180+0000 7f27ab7fe640 1 --2- 172.21.15.33:0/2393362480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27ac1036e0 0x7f27ac100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:46.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.180+0000 7f27ab7fe640 1 -- 172.21.15.33:0/2393362480 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27ac1a6950 con 0x7f27ac102d30 2024-09-12T12:23:46.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.180+0000 7f27abfff640 1 --2- 172.21.15.33:0/2393362480 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27ac1082a0 0x7f27ac101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:23:46.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.181+0000 7f27ab7fe640 1 --2- 172.21.15.33:0/2393362480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27ac102d30 0x7f27ac100990 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f279c00ea80 tx=0x7f279c00ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:46.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.181+0000 7f27a8ff9640 1 -- 172.21.15.33:0/2393362480 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279c00ce40 con 0x7f27ac102d30 2024-09-12T12:23:46.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.181+0000 7f27b208d640 1 -- 172.21.15.33:0/2393362480 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27ac1a6c40 con 0x7f27ac102d30 2024-09-12T12:23:46.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.181+0000 7f27a8ff9640 1 -- 172.21.15.33:0/2393362480 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f279c005020 con 0x7f27ac102d30 2024-09-12T12:23:46.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.181+0000 7f27a8ff9640 1 -- 172.21.15.33:0/2393362480 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279c0116d0 con 0x7f27ac102d30 2024-09-12T12:23:46.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.181+0000 7f27b208d640 1 -- 172.21.15.33:0/2393362480 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27ac1a7130 con 0x7f27ac102d30 2024-09-12T12:23:46.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.182+0000 7f27b208d640 1 -- 172.21.15.33:0/2393362480 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27ac103110 con 0x7f27ac102d30 2024-09-12T12:23:46.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.183+0000 7f27a8ff9640 1 -- 172.21.15.33:0/2393362480 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f279c0051d0 con 0x7f27ac102d30 2024-09-12T12:23:46.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.184+0000 7f27a8ff9640 1 --2- 172.21.15.33:0/2393362480 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f27940a2b80 0x7f27940a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:46.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.184+0000 7f27aaffd640 1 --2- 172.21.15.33:0/2393362480 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f27940a2b80 0x7f27940a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:46.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.184+0000 7f27a8ff9640 1 -- 172.21.15.33:0/2393362480 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7879+0+0 (secure 0 0 0) 0x7f279c0cf240 con 0x7f27ac102d30 2024-09-12T12:23:46.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.184+0000 7f27aaffd640 1 --2- 172.21.15.33:0/2393362480 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f27940a2b80 0x7f27940a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f27ac102420 tx=0x7f27a000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:46.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.188+0000 7f27a8ff9640 1 -- 172.21.15.33:0/2393362480 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f279c016030 con 0x7f27ac102d30 2024-09-12T12:23:46.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:45 smithi043 ceph-mon[34144]: pgmap v269: 33 pgs: 3 creating+peering, 29 unknown, 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:46.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:45 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/3118702785' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-12T12:23:46.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:45 smithi043 ceph-mon[34144]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T12:23:46.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:45 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/3118702785' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-12T12:23:46.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:45 smithi043 ceph-mon[34144]: osdmap e77: 12 total, 12 up, 12 in 2024-09-12T12:23:46.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.399+0000 7f27b208d640 1 -- 172.21.15.33:0/2393362480 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f27ac109d20 con 0x7f27ac102d30 2024-09-12T12:23:46.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.867+0000 7f27a8ff9640 1 -- 172.21.15.33:0/2393362480 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f279c09c2b0 con 0x7f27ac102d30 2024-09-12T12:23:46.867 INFO:teuthology.orchestra.run.smithi033.stderr:new fs with metadata pool 2 and data pool 3 2024-09-12T12:23:46.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.869+0000 7f27b208d640 1 -- 172.21.15.33:0/2393362480 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f27940a2b80 msgr2=0x7f27940a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:46.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.869+0000 7f27b208d640 1 --2- 172.21.15.33:0/2393362480 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f27940a2b80 0x7f27940a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f27ac102420 tx=0x7f27a000b390 comp rx=0 tx=0).stop 2024-09-12T12:23:46.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.869+0000 7f27b208d640 1 -- 172.21.15.33:0/2393362480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27ac102d30 msgr2=0x7f27ac100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:46.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.869+0000 7f27b208d640 1 --2- 172.21.15.33:0/2393362480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27ac102d30 0x7f27ac100990 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f279c00ea80 tx=0x7f279c00ef40 comp rx=0 tx=0).stop 2024-09-12T12:23:46.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.869+0000 7f27b208d640 1 -- 172.21.15.33:0/2393362480 shutdown_connections 2024-09-12T12:23:46.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.869+0000 7f27b208d640 1 --2- 172.21.15.33:0/2393362480 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f27940a2b80 0x7f27940a5040 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:46.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.869+0000 7f27b208d640 1 --2- 172.21.15.33:0/2393362480 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27ac1082a0 0x7f27ac101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:46.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.869+0000 7f27b208d640 1 --2- 172.21.15.33:0/2393362480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27ac1036e0 0x7f27ac100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:46.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.869+0000 7f27b208d640 1 --2- 172.21.15.33:0/2393362480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27ac102d30 0x7f27ac100990 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:46.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.869+0000 7f27b208d640 1 -- 172.21.15.33:0/2393362480 >> 172.21.15.33:0/2393362480 conn(0x7f27ac0fc7d0 msgr2=0x7f27ac105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:46.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.870+0000 7f27b208d640 1 -- 172.21.15.33:0/2393362480 shutdown_connections 2024-09-12T12:23:46.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:46.870+0000 7f27b208d640 1 -- 172.21.15.33:0/2393362480 wait complete. 2024-09-12T12:23:47.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:46 smithi043 ceph-mon[34144]: osdmap e78: 12 total, 12 up, 12 in 2024-09-12T12:23:47.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:46 smithi043 ceph-mon[34144]: pgmap v272: 97 pgs: 3 creating+peering, 90 unknown, 4 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:47.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:46 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/2393362480' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-12T12:23:47.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:46 smithi043 ceph-mon[34144]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-12T12:23:47.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:46 smithi102 ceph-mon[34799]: osdmap e78: 12 total, 12 up, 12 in 2024-09-12T12:23:47.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:46 smithi102 ceph-mon[34799]: pgmap v272: 97 pgs: 3 creating+peering, 90 unknown, 4 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:47.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:46 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/2393362480' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-12T12:23:47.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:46 smithi102 ceph-mon[34799]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-12T12:23:47.199 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:46 smithi033 ceph-mon[31246]: osdmap e78: 12 total, 12 up, 12 in 2024-09-12T12:23:47.199 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:46 smithi033 ceph-mon[31246]: pgmap v272: 97 pgs: 3 creating+peering, 90 unknown, 4 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:47.199 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:46 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/2393362480' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-12T12:23:47.199 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:46 smithi033 ceph-mon[31246]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-12T12:23:47.585 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-12T12:23:47.585 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-12T12:23:47.849 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:23:48.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:47 smithi043 ceph-mon[34144]: osdmap e79: 12 total, 12 up, 12 in 2024-09-12T12:23:48.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:47 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/2393362480' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-12T12:23:48.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:47 smithi043 ceph-mon[34144]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-12T12:23:48.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:47 smithi043 ceph-mon[34144]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-12T12:23:48.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:47 smithi033 ceph-mon[31246]: osdmap e79: 12 total, 12 up, 12 in 2024-09-12T12:23:48.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:47 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/2393362480' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-12T12:23:48.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:47 smithi033 ceph-mon[31246]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-12T12:23:48.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:47 smithi033 ceph-mon[31246]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-12T12:23:48.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:47 smithi102 ceph-mon[34799]: osdmap e79: 12 total, 12 up, 12 in 2024-09-12T12:23:48.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:47 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/2393362480' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-12T12:23:48.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:47 smithi102 ceph-mon[34799]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-12T12:23:48.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:47 smithi102 ceph-mon[34799]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-12T12:23:48.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.373+0000 7f03fde95640 1 -- 172.21.15.33:0/1971237887 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03f8106f10 msgr2=0x7f03f810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:48.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.373+0000 7f03fde95640 1 --2- 172.21.15.33:0/1971237887 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03f8106f10 0x7f03f810ea90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f03f0009ca0 tx=0x7f03f002a8c0 comp rx=0 tx=0).stop 2024-09-12T12:23:48.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.373+0000 7f03fde95640 1 -- 172.21.15.33:0/1971237887 shutdown_connections 2024-09-12T12:23:48.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.373+0000 7f03fde95640 1 --2- 172.21.15.33:0/1971237887 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03f8106f10 0x7f03f810ea90 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:48.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.373+0000 7f03fde95640 1 --2- 172.21.15.33:0/1971237887 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03f8102790 0x7f03f81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:48.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.373+0000 7f03fde95640 1 --2- 172.21.15.33:0/1971237887 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03f8101de0 0x7f03f81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:48.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.373+0000 7f03fde95640 1 -- 172.21.15.33:0/1971237887 >> 172.21.15.33:0/1971237887 conn(0x7f03f80fd8c0 msgr2=0x7f03f80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:48.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.373+0000 7f03fde95640 1 -- 172.21.15.33:0/1971237887 shutdown_connections 2024-09-12T12:23:48.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.373+0000 7f03fde95640 1 -- 172.21.15.33:0/1971237887 wait complete. 2024-09-12T12:23:48.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.374+0000 7f03fde95640 1 Processor -- start 2024-09-12T12:23:48.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.374+0000 7f03fde95640 1 -- start start 2024-09-12T12:23:48.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.375+0000 7f03fde95640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03f8101de0 0x7f03f8198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:48.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.375+0000 7f03fde95640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03f8102790 0x7f03f8198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:48.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.375+0000 7f03fde95640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03f8106f10 0x7f03f819ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:48.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.375+0000 7f03fde95640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f03f8111e40 con 0x7f03f8102790 2024-09-12T12:23:48.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.375+0000 7f03fde95640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f03f8111cc0 con 0x7f03f8101de0 2024-09-12T12:23:48.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.375+0000 7f03fde95640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f03f8111fc0 con 0x7f03f8106f10 2024-09-12T12:23:48.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.375+0000 7f03f6ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03f8102790 0x7f03f8198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:48.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.375+0000 7f03f6ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03f8102790 0x7f03f8198940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45024/0 (socket says 172.21.15.33:45024) 2024-09-12T12:23:48.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.375+0000 7f03f6ffd640 1 -- 172.21.15.33:0/839501635 learned_addr learned my addr 172.21.15.33:0/839501635 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:23:48.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.375+0000 7f03f77fe640 1 --2- 172.21.15.33:0/839501635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03f8101de0 0x7f03f8198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:48.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.375+0000 7f03f7fff640 1 --2- 172.21.15.33:0/839501635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03f8106f10 0x7f03f819ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:48.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.375+0000 7f03f6ffd640 1 -- 172.21.15.33:0/839501635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03f8106f10 msgr2=0x7f03f819ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:48.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.375+0000 7f03f6ffd640 1 --2- 172.21.15.33:0/839501635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03f8106f10 0x7f03f819ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:48.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.375+0000 7f03f6ffd640 1 -- 172.21.15.33:0/839501635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03f8101de0 msgr2=0x7f03f8198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:48.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.375+0000 7f03f6ffd640 1 --2- 172.21.15.33:0/839501635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03f8101de0 0x7f03f8198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:48.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.375+0000 7f03f6ffd640 1 -- 172.21.15.33:0/839501635 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03f819d3b0 con 0x7f03f8102790 2024-09-12T12:23:48.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.375+0000 7f03f6ffd640 1 --2- 172.21.15.33:0/839501635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03f8102790 0x7f03f8198940 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f03ec00d950 tx=0x7f03ec00dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:48.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.375+0000 7f03f4ff9640 1 -- 172.21.15.33:0/839501635 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03ec017070 con 0x7f03f8102790 2024-09-12T12:23:48.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.375+0000 7f03f4ff9640 1 -- 172.21.15.33:0/839501635 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f03ec00de80 con 0x7f03f8102790 2024-09-12T12:23:48.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.375+0000 7f03fde95640 1 -- 172.21.15.33:0/839501635 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03f819d6a0 con 0x7f03f8102790 2024-09-12T12:23:48.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.375+0000 7f03f4ff9640 1 -- 172.21.15.33:0/839501635 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03ec00f620 con 0x7f03f8102790 2024-09-12T12:23:48.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.375+0000 7f03fde95640 1 -- 172.21.15.33:0/839501635 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03f81a4f80 con 0x7f03f8102790 2024-09-12T12:23:48.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.376+0000 7f03fde95640 1 -- 172.21.15.33:0/839501635 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03f81021c0 con 0x7f03f8102790 2024-09-12T12:23:48.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.378+0000 7f03f4ff9640 1 -- 172.21.15.33:0/839501635 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f03ec009c30 con 0x7f03f8102790 2024-09-12T12:23:48.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.378+0000 7f03f4ff9640 1 --2- 172.21.15.33:0/839501635 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f03e00a2b80 0x7f03e00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:48.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.379+0000 7f03f77fe640 1 --2- 172.21.15.33:0/839501635 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f03e00a2b80 0x7f03e00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:48.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.379+0000 7f03f4ff9640 1 -- 172.21.15.33:0/839501635 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7f03ec0cec00 con 0x7f03f8102790 2024-09-12T12:23:48.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.379+0000 7f03f77fe640 1 --2- 172.21.15.33:0/839501635 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f03e00a2b80 0x7f03e00a5040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f03e8009990 tx=0x7f03e8009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:48.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.383+0000 7f03f4ff9640 1 -- 172.21.15.33:0/839501635 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f03ec09bc10 con 0x7f03f8102790 2024-09-12T12:23:48.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.568+0000 7f03fde95640 1 -- 172.21.15.33:0/839501635 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f03f810a150 con 0x7f03f8102790 2024-09-12T12:23:48.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.877+0000 7f03f4ff9640 1 -- 172.21.15.33:0/839501635 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v80) ==== 157+0+0 (secure 0 0 0) 0x7f03ec09b510 con 0x7f03f8102790 2024-09-12T12:23:48.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.879+0000 7f03fde95640 1 -- 172.21.15.33:0/839501635 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f03e00a2b80 msgr2=0x7f03e00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:48.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.879+0000 7f03fde95640 1 --2- 172.21.15.33:0/839501635 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f03e00a2b80 0x7f03e00a5040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f03e8009990 tx=0x7f03e8009110 comp rx=0 tx=0).stop 2024-09-12T12:23:48.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.879+0000 7f03fde95640 1 -- 172.21.15.33:0/839501635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03f8102790 msgr2=0x7f03f8198940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:48.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.879+0000 7f03fde95640 1 --2- 172.21.15.33:0/839501635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03f8102790 0x7f03f8198940 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f03ec00d950 tx=0x7f03ec00dd50 comp rx=0 tx=0).stop 2024-09-12T12:23:48.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.880+0000 7f03fde95640 1 -- 172.21.15.33:0/839501635 shutdown_connections 2024-09-12T12:23:48.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.880+0000 7f03fde95640 1 --2- 172.21.15.33:0/839501635 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f03e00a2b80 0x7f03e00a5040 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:48.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.880+0000 7f03fde95640 1 --2- 172.21.15.33:0/839501635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03f8106f10 0x7f03f819ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:48.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.880+0000 7f03fde95640 1 --2- 172.21.15.33:0/839501635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03f8102790 0x7f03f8198940 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:48.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.880+0000 7f03fde95640 1 --2- 172.21.15.33:0/839501635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03f8101de0 0x7f03f8198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:48.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.880+0000 7f03fde95640 1 -- 172.21.15.33:0/839501635 >> 172.21.15.33:0/839501635 conn(0x7f03f80fd8c0 msgr2=0x7f03f80fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:48.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.880+0000 7f03fde95640 1 -- 172.21.15.33:0/839501635 shutdown_connections 2024-09-12T12:23:48.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:48.880+0000 7f03fde95640 1 -- 172.21.15.33:0/839501635 wait complete. 2024-09-12T12:23:49.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:48 smithi102 ceph-mon[34799]: mds.? [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] up:active 2024-09-12T12:23:49.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:48 smithi102 ceph-mon[34799]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-12T12:23:49.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:48 smithi102 ceph-mon[34799]: pgmap v274: 97 pgs: 3 creating+peering, 13 unknown, 81 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 749 B/s wr, 6 op/s 2024-09-12T12:23:49.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:48 smithi102 ceph-mon[34799]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-12T12:23:49.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:48 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/839501635' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-12T12:23:49.165 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:48 smithi043 ceph-mon[34144]: mds.? [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] up:active 2024-09-12T12:23:49.165 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:48 smithi043 ceph-mon[34144]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-12T12:23:49.165 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:48 smithi043 ceph-mon[34144]: pgmap v274: 97 pgs: 3 creating+peering, 13 unknown, 81 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 749 B/s wr, 6 op/s 2024-09-12T12:23:49.165 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:48 smithi043 ceph-mon[34144]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-12T12:23:49.165 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:48 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/839501635' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-12T12:23:49.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:48 smithi033 ceph-mon[31246]: mds.? [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] up:active 2024-09-12T12:23:49.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:48 smithi033 ceph-mon[31246]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-12T12:23:49.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:48 smithi033 ceph-mon[31246]: pgmap v274: 97 pgs: 3 creating+peering, 13 unknown, 81 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 749 B/s wr, 6 op/s 2024-09-12T12:23:49.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:48 smithi033 ceph-mon[31246]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-12T12:23:49.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:48 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/839501635' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-12T12:23:49.586 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T12:23:49.855 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:23:50.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:49 smithi033 ceph-mon[31246]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-12T12:23:50.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:49 smithi033 ceph-mon[31246]: Cluster is now healthy 2024-09-12T12:23:50.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:49 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/839501635' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-12T12:23:50.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:49 smithi033 ceph-mon[31246]: osdmap e80: 12 total, 12 up, 12 in 2024-09-12T12:23:50.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:49 smithi102 ceph-mon[34799]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-12T12:23:50.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:49 smithi102 ceph-mon[34799]: Cluster is now healthy 2024-09-12T12:23:50.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:49 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/839501635' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-12T12:23:50.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:49 smithi102 ceph-mon[34799]: osdmap e80: 12 total, 12 up, 12 in 2024-09-12T12:23:50.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:50.319+0000 7ff174fc6640 1 -- 172.21.15.33:0/4165591700 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff170102570 msgr2=0x7ff1701029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:50.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:50.319+0000 7ff174fc6640 1 --2- 172.21.15.33:0/4165591700 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff170102570 0x7ff1701029b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff158009900 tx=0x7ff15802a480 comp rx=0 tx=0).stop 2024-09-12T12:23:50.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:50.319+0000 7ff174fc6640 1 -- 172.21.15.33:0/4165591700 shutdown_connections 2024-09-12T12:23:50.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:50.319+0000 7ff174fc6640 1 --2- 172.21.15.33:0/4165591700 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff170102ef0 0x7ff17010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:50.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:50.319+0000 7ff174fc6640 1 --2- 172.21.15.33:0/4165591700 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff170102570 0x7ff1701029b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:50.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:50.319+0000 7ff174fc6640 1 --2- 172.21.15.33:0/4165591700 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff170100e20 0x7ff170101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:50.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:50.319+0000 7ff174fc6640 1 -- 172.21.15.33:0/4165591700 >> 172.21.15.33:0/4165591700 conn(0x7ff1700fc7d0 msgr2=0x7ff1700febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:50.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:50.319+0000 7ff174fc6640 1 -- 172.21.15.33:0/4165591700 shutdown_connections 2024-09-12T12:23:50.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:50.320+0000 7ff174fc6640 1 -- 172.21.15.33:0/4165591700 wait complete. 2024-09-12T12:23:50.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:50.320+0000 7ff174fc6640 1 Processor -- start 2024-09-12T12:23:50.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:50.320+0000 7ff174fc6640 1 -- start start 2024-09-12T12:23:50.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:50.321+0000 7ff174fc6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff170100e20 0x7ff1700fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:50.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:50.321+0000 7ff174fc6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff170102570 0x7ff1700fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:50.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:50.321+0000 7ff174fc6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff170102ef0 0x7ff1700fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:50.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:50.321+0000 7ff174fc6640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff170110e70 con 0x7ff170100e20 2024-09-12T12:23:50.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:50.321+0000 7ff174fc6640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff170110cf0 con 0x7ff170102ef0 2024-09-12T12:23:50.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:50.321+0000 7ff174fc6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff170110ff0 con 0x7ff170102570 2024-09-12T12:23:50.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:50.321+0000 7ff16e59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff170100e20 0x7ff1700fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:50.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:50.321+0000 7ff16e59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff170100e20 0x7ff1700fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45042/0 (socket says 172.21.15.33:45042) 2024-09-12T12:23:50.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:50.321+0000 7ff16e59c640 1 -- 172.21.15.33:0/2839443552 learned_addr learned my addr 172.21.15.33:0/2839443552 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:23:50.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:50.321+0000 7ff165d9b640 1 --2- 172.21.15.33:0/2839443552 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff170102570 0x7ff1700fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:50.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:50.321+0000 7ff16ed9d640 1 --2- 172.21.15.33:0/2839443552 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff170102ef0 0x7ff1700fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:50.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:50.321+0000 7ff16e59c640 1 -- 172.21.15.33:0/2839443552 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff170102570 msgr2=0x7ff1700fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:50.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:50.321+0000 7ff16e59c640 1 --2- 172.21.15.33:0/2839443552 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff170102570 0x7ff1700fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:50.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:50.321+0000 7ff16e59c640 1 -- 172.21.15.33:0/2839443552 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff170102ef0 msgr2=0x7ff1700fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:50.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:50.321+0000 7ff16e59c640 1 --2- 172.21.15.33:0/2839443552 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff170102ef0 0x7ff1700fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:50.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:50.321+0000 7ff16e59c640 1 -- 172.21.15.33:0/2839443552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1701a6950 con 0x7ff170100e20 2024-09-12T12:23:50.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:50.321+0000 7ff16e59c640 1 --2- 172.21.15.33:0/2839443552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff170100e20 0x7ff1700fcc80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff16000b4a0 tx=0x7ff16000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:50.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:50.321+0000 7ff167fff640 1 -- 172.21.15.33:0/2839443552 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff160014070 con 0x7ff170100e20 2024-09-12T12:23:50.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:50.322+0000 7ff174fc6640 1 -- 172.21.15.33:0/2839443552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1701a6c40 con 0x7ff170100e20 2024-09-12T12:23:50.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:50.322+0000 7ff167fff640 1 -- 172.21.15.33:0/2839443552 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff160010ac0 con 0x7ff170100e20 2024-09-12T12:23:50.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:50.322+0000 7ff167fff640 1 -- 172.21.15.33:0/2839443552 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff160017c30 con 0x7ff170100e20 2024-09-12T12:23:50.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:50.322+0000 7ff174fc6640 1 -- 172.21.15.33:0/2839443552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1701a7150 con 0x7ff170100e20 2024-09-12T12:23:50.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:50.323+0000 7ff174fc6640 1 -- 172.21.15.33:0/2839443552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff170101200 con 0x7ff170100e20 2024-09-12T12:23:50.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:50.325+0000 7ff167fff640 1 -- 172.21.15.33:0/2839443552 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff160017070 con 0x7ff170100e20 2024-09-12T12:23:50.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:50.325+0000 7ff167fff640 1 --2- 172.21.15.33:0/2839443552 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff15c0a2b80 0x7ff15c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:50.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:50.325+0000 7ff165d9b640 1 --2- 172.21.15.33:0/2839443552 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff15c0a2b80 0x7ff15c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:50.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:50.325+0000 7ff167fff640 1 -- 172.21.15.33:0/2839443552 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8277+0+0 (secure 0 0 0) 0x7ff1600ce740 con 0x7ff170100e20 2024-09-12T12:23:50.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:50.326+0000 7ff165d9b640 1 --2- 172.21.15.33:0/2839443552 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff15c0a2b80 0x7ff15c0a5040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff158009230 tx=0x7ff1580058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:50.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:50.329+0000 7ff167fff640 1 -- 172.21.15.33:0/2839443552 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff16009b670 con 0x7ff170100e20 2024-09-12T12:23:50.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:49 smithi043 ceph-mon[34144]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-12T12:23:50.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:49 smithi043 ceph-mon[34144]: Cluster is now healthy 2024-09-12T12:23:50.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:49 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/839501635' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-12T12:23:50.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:49 smithi043 ceph-mon[34144]: osdmap e80: 12 total, 12 up, 12 in 2024-09-12T12:23:50.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:50.507+0000 7ff174fc6640 1 -- 172.21.15.33:0/2839443552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ff17010a0a0 con 0x7ff170100e20 2024-09-12T12:23:51.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:50 smithi102 ceph-mon[34799]: pgmap v276: 97 pgs: 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 7 op/s 2024-09-12T12:23:51.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:50 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/2839443552' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T12:23:51.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:50 smithi033 ceph-mon[31246]: pgmap v276: 97 pgs: 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 7 op/s 2024-09-12T12:23:51.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:50 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/2839443552' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T12:23:51.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:50 smithi043 ceph-mon[34144]: pgmap v276: 97 pgs: 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 7 op/s 2024-09-12T12:23:51.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:50 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/2839443552' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T12:23:51.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:51.881+0000 7ff167fff640 1 -- 172.21.15.33:0/2839443552 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v82) ==== 228+0+0 (secure 0 0 0) 0x7ff16009af70 con 0x7ff170100e20 2024-09-12T12:23:51.881 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data_ec' created 2024-09-12T12:23:51.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:51.884+0000 7ff174fc6640 1 -- 172.21.15.33:0/2839443552 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff15c0a2b80 msgr2=0x7ff15c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:51.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:51.884+0000 7ff174fc6640 1 --2- 172.21.15.33:0/2839443552 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff15c0a2b80 0x7ff15c0a5040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff158009230 tx=0x7ff1580058d0 comp rx=0 tx=0).stop 2024-09-12T12:23:51.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:51.884+0000 7ff174fc6640 1 -- 172.21.15.33:0/2839443552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff170100e20 msgr2=0x7ff1700fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:51.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:51.884+0000 7ff174fc6640 1 --2- 172.21.15.33:0/2839443552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff170100e20 0x7ff1700fcc80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff16000b4a0 tx=0x7ff16000b960 comp rx=0 tx=0).stop 2024-09-12T12:23:51.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:51.884+0000 7ff174fc6640 1 -- 172.21.15.33:0/2839443552 shutdown_connections 2024-09-12T12:23:51.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:51.884+0000 7ff174fc6640 1 --2- 172.21.15.33:0/2839443552 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff15c0a2b80 0x7ff15c0a5040 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:51.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:51.884+0000 7ff174fc6640 1 --2- 172.21.15.33:0/2839443552 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff170102ef0 0x7ff1700fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:51.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:51.884+0000 7ff174fc6640 1 --2- 172.21.15.33:0/2839443552 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff170102570 0x7ff1700fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:51.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:51.884+0000 7ff174fc6640 1 --2- 172.21.15.33:0/2839443552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff170100e20 0x7ff1700fcc80 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:51.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:51.884+0000 7ff174fc6640 1 -- 172.21.15.33:0/2839443552 >> 172.21.15.33:0/2839443552 conn(0x7ff1700fc7d0 msgr2=0x7ff17006a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:51.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:51.885+0000 7ff174fc6640 1 -- 172.21.15.33:0/2839443552 shutdown_connections 2024-09-12T12:23:51.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:51.885+0000 7ff174fc6640 1 -- 172.21.15.33:0/2839443552 wait complete. 2024-09-12T12:23:52.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:51 smithi102 ceph-mon[34799]: osdmap e81: 12 total, 12 up, 12 in 2024-09-12T12:23:52.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:51 smithi033 ceph-mon[31246]: osdmap e81: 12 total, 12 up, 12 in 2024-09-12T12:23:52.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:51 smithi043 ceph-mon[34144]: osdmap e81: 12 total, 12 up, 12 in 2024-09-12T12:23:52.597 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-12T12:23:52.856 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:23:52.892 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:52 smithi033 ceph-mon[31246]: pgmap v278: 97 pgs: 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-12T12:23:52.893 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:52 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/2839443552' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-12T12:23:52.893 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:52 smithi033 ceph-mon[31246]: osdmap e82: 12 total, 12 up, 12 in 2024-09-12T12:23:53.146 INFO:journalctl@ceph.mds.i.smithi102.stdout:Sep 12 12:23:52 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-i[64853]: 2024-09-12T12:23:52.782+0000 7fb8defb4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T12:23:53.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:52 smithi102 ceph-mon[34799]: pgmap v278: 97 pgs: 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-12T12:23:53.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:52 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/2839443552' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-12T12:23:53.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:52 smithi102 ceph-mon[34799]: osdmap e82: 12 total, 12 up, 12 in 2024-09-12T12:23:53.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.341+0000 7f2e8fa3f640 1 -- 172.21.15.33:0/2507199918 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e88100310 msgr2=0x7f2e881006f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:53.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.341+0000 7f2e8fa3f640 1 --2- 172.21.15.33:0/2507199918 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e88100310 0x7f2e881006f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2e84009900 tx=0x7f2e8402a410 comp rx=0 tx=0).stop 2024-09-12T12:23:53.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.341+0000 7f2e8fa3f640 1 -- 172.21.15.33:0/2507199918 shutdown_connections 2024-09-12T12:23:53.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.341+0000 7f2e8fa3f640 1 --2- 172.21.15.33:0/2507199918 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e88106f30 0x7f2e8810eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:53.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.341+0000 7f2e8fa3f640 1 --2- 172.21.15.33:0/2507199918 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e88100cc0 0x7f2e88106800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:53.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.341+0000 7f2e8fa3f640 1 --2- 172.21.15.33:0/2507199918 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e88100310 0x7f2e881006f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:53.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.341+0000 7f2e8fa3f640 1 -- 172.21.15.33:0/2507199918 >> 172.21.15.33:0/2507199918 conn(0x7f2e88077210 msgr2=0x7f2e880fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:53.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.341+0000 7f2e8fa3f640 1 -- 172.21.15.33:0/2507199918 shutdown_connections 2024-09-12T12:23:53.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.341+0000 7f2e8fa3f640 1 -- 172.21.15.33:0/2507199918 wait complete. 2024-09-12T12:23:53.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.342+0000 7f2e8fa3f640 1 Processor -- start 2024-09-12T12:23:53.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.342+0000 7f2e8fa3f640 1 -- start start 2024-09-12T12:23:53.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.342+0000 7f2e8fa3f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e88100310 0x7f2e88198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:53.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.342+0000 7f2e8fa3f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e88100cc0 0x7f2e88198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:53.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.342+0000 7f2e8fa3f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e88106f30 0x7f2e8819ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:53.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.342+0000 7f2e8fa3f640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2e88111e60 con 0x7f2e88100310 2024-09-12T12:23:53.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.342+0000 7f2e8fa3f640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2e88111ce0 con 0x7f2e88100cc0 2024-09-12T12:23:53.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.342+0000 7f2e8fa3f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2e88111fe0 con 0x7f2e88106f30 2024-09-12T12:23:53.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.342+0000 7f2e8d7db640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e88100310 0x7f2e88198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:53.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.342+0000 7f2e8d7db640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e88100310 0x7f2e88198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48516/0 (socket says 172.21.15.33:48516) 2024-09-12T12:23:53.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.342+0000 7f2e8d7db640 1 -- 172.21.15.33:0/626415975 learned_addr learned my addr 172.21.15.33:0/626415975 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:23:53.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.342+0000 7f2e8dfdc640 1 --2- 172.21.15.33:0/626415975 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e88106f30 0x7f2e8819ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:53.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.343+0000 7f2e8cfda640 1 --2- 172.21.15.33:0/626415975 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e88100cc0 0x7f2e88198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:53.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.343+0000 7f2e8d7db640 1 -- 172.21.15.33:0/626415975 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e88106f30 msgr2=0x7f2e8819ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:53.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.343+0000 7f2e8d7db640 1 --2- 172.21.15.33:0/626415975 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e88106f30 0x7f2e8819ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:53.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.343+0000 7f2e8d7db640 1 -- 172.21.15.33:0/626415975 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e88100cc0 msgr2=0x7f2e88198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:53.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.343+0000 7f2e8d7db640 1 --2- 172.21.15.33:0/626415975 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e88100cc0 0x7f2e88198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:53.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.343+0000 7f2e8d7db640 1 -- 172.21.15.33:0/626415975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e8819d3d0 con 0x7f2e88100310 2024-09-12T12:23:53.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.343+0000 7f2e8cfda640 1 --2- 172.21.15.33:0/626415975 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e88100cc0 0x7f2e88198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:23:53.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.343+0000 7f2e8d7db640 1 --2- 172.21.15.33:0/626415975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e88100310 0x7f2e88198420 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2e84006010 tx=0x7f2e84004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:53.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.343+0000 7f2e7a7fc640 1 -- 172.21.15.33:0/626415975 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8403f030 con 0x7f2e88100310 2024-09-12T12:23:53.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.343+0000 7f2e8fa3f640 1 -- 172.21.15.33:0/626415975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e8819d660 con 0x7f2e88100310 2024-09-12T12:23:53.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.343+0000 7f2e7a7fc640 1 -- 172.21.15.33:0/626415975 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2e840035f0 con 0x7f2e88100310 2024-09-12T12:23:53.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.343+0000 7f2e7a7fc640 1 -- 172.21.15.33:0/626415975 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e84035070 con 0x7f2e88100310 2024-09-12T12:23:53.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.343+0000 7f2e8fa3f640 1 -- 172.21.15.33:0/626415975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e881a4fa0 con 0x7f2e88100310 2024-09-12T12:23:53.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.344+0000 7f2e8fa3f640 1 -- 172.21.15.33:0/626415975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e881033d0 con 0x7f2e88100310 2024-09-12T12:23:53.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.345+0000 7f2e7a7fc640 1 -- 172.21.15.33:0/626415975 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2e84003b10 con 0x7f2e88100310 2024-09-12T12:23:53.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.346+0000 7f2e7a7fc640 1 --2- 172.21.15.33:0/626415975 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2e740a2b80 0x7f2e740a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:53.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.346+0000 7f2e8cfda640 1 --2- 172.21.15.33:0/626415975 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2e740a2b80 0x7f2e740a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:53.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.346+0000 7f2e7a7fc640 1 -- 172.21.15.33:0/626415975 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8770+0+0 (secure 0 0 0) 0x7f2e840efde0 con 0x7f2e88100310 2024-09-12T12:23:53.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.347+0000 7f2e8cfda640 1 --2- 172.21.15.33:0/626415975 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2e740a2b80 0x7f2e740a5040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2e88104880 tx=0x7f2e7c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:53.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.350+0000 7f2e7a7fc640 1 -- 172.21.15.33:0/626415975 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2e840bcb20 con 0x7f2e88100310 2024-09-12T12:23:53.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:52 smithi043 ceph-mon[34144]: pgmap v278: 97 pgs: 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-12T12:23:53.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:52 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/2839443552' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-12T12:23:53.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:52 smithi043 ceph-mon[34144]: osdmap e82: 12 total, 12 up, 12 in 2024-09-12T12:23:53.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.525+0000 7f2e8fa3f640 1 -- 172.21.15.33:0/626415975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f2e8810a110 con 0x7f2e88100310 2024-09-12T12:23:53.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.891+0000 7f2e7a7fc640 1 -- 172.21.15.33:0/626415975 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v84) ==== 169+0+0 (secure 0 0 0) 0x7f2e840bc420 con 0x7f2e88100310 2024-09-12T12:23:53.892 INFO:teuthology.orchestra.run.smithi033.stderr:set pool 4 allow_ec_overwrites to true 2024-09-12T12:23:53.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.894+0000 7f2e8fa3f640 1 -- 172.21.15.33:0/626415975 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2e740a2b80 msgr2=0x7f2e740a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:53.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.894+0000 7f2e8fa3f640 1 --2- 172.21.15.33:0/626415975 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2e740a2b80 0x7f2e740a5040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2e88104880 tx=0x7f2e7c008040 comp rx=0 tx=0).stop 2024-09-12T12:23:53.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.894+0000 7f2e8fa3f640 1 -- 172.21.15.33:0/626415975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e88100310 msgr2=0x7f2e88198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:53.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.894+0000 7f2e8fa3f640 1 --2- 172.21.15.33:0/626415975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e88100310 0x7f2e88198420 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2e84006010 tx=0x7f2e84004270 comp rx=0 tx=0).stop 2024-09-12T12:23:53.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.894+0000 7f2e8fa3f640 1 -- 172.21.15.33:0/626415975 shutdown_connections 2024-09-12T12:23:53.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.894+0000 7f2e8fa3f640 1 --2- 172.21.15.33:0/626415975 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2e740a2b80 0x7f2e740a5040 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:53.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.894+0000 7f2e8fa3f640 1 --2- 172.21.15.33:0/626415975 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e88106f30 0x7f2e8819ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:53.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.894+0000 7f2e8fa3f640 1 --2- 172.21.15.33:0/626415975 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e88100cc0 0x7f2e88198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:53.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.894+0000 7f2e8fa3f640 1 --2- 172.21.15.33:0/626415975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e88100310 0x7f2e88198420 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:53.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.894+0000 7f2e8fa3f640 1 -- 172.21.15.33:0/626415975 >> 172.21.15.33:0/626415975 conn(0x7f2e88077210 msgr2=0x7f2e880fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:53.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.895+0000 7f2e8fa3f640 1 -- 172.21.15.33:0/626415975 shutdown_connections 2024-09-12T12:23:53.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:53.895+0000 7f2e8fa3f640 1 -- 172.21.15.33:0/626415975 wait complete. 2024-09-12T12:23:54.226 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:53 smithi033 ceph-mon[31246]: osdmap e83: 12 total, 12 up, 12 in 2024-09-12T12:23:54.226 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:53 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/626415975' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-12T12:23:54.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:53 smithi043 ceph-mon[34144]: osdmap e83: 12 total, 12 up, 12 in 2024-09-12T12:23:54.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:53 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/626415975' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-12T12:23:54.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:53 smithi102 ceph-mon[34799]: osdmap e83: 12 total, 12 up, 12 in 2024-09-12T12:23:54.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:53 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/626415975' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-12T12:23:54.556 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-12T12:23:54.814 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:23:55.197 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:54 smithi033 ceph-mon[31246]: pgmap v281: 129 pgs: 13 creating+peering, 16 unknown, 100 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 2 op/s 2024-09-12T12:23:55.197 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:54 smithi033 ceph-mon[31246]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T12:23:55.197 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:54 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/626415975' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-12T12:23:55.197 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:54 smithi033 ceph-mon[31246]: osdmap e84: 12 total, 12 up, 12 in 2024-09-12T12:23:55.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.281+0000 7fc3a9954640 1 -- 172.21.15.33:0/2836957136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3a41036e0 msgr2=0x7fc3a4107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:55.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.281+0000 7fc3a9954640 1 --2- 172.21.15.33:0/2836957136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3a41036e0 0x7fc3a4107b90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc398009930 tx=0x7fc39802a420 comp rx=0 tx=0).stop 2024-09-12T12:23:55.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.281+0000 7fc3a9954640 1 -- 172.21.15.33:0/2836957136 shutdown_connections 2024-09-12T12:23:55.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.281+0000 7fc3a9954640 1 --2- 172.21.15.33:0/2836957136 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3a41082a0 0x7fc3a410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:55.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.281+0000 7fc3a9954640 1 --2- 172.21.15.33:0/2836957136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3a41036e0 0x7fc3a4107b90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:55.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.281+0000 7fc3a9954640 1 --2- 172.21.15.33:0/2836957136 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3a4102d30 0x7fc3a4103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:55.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.281+0000 7fc3a9954640 1 -- 172.21.15.33:0/2836957136 >> 172.21.15.33:0/2836957136 conn(0x7fc3a40fc7d0 msgr2=0x7fc3a40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:55.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.281+0000 7fc3a9954640 1 -- 172.21.15.33:0/2836957136 shutdown_connections 2024-09-12T12:23:55.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.281+0000 7fc3a9954640 1 -- 172.21.15.33:0/2836957136 wait complete. 2024-09-12T12:23:55.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.281+0000 7fc3a9954640 1 Processor -- start 2024-09-12T12:23:55.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.282+0000 7fc3a9954640 1 -- start start 2024-09-12T12:23:55.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.282+0000 7fc3a9954640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3a4102d30 0x7fc3a41984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:55.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.282+0000 7fc3a9954640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3a41036e0 0x7fc3a4198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:55.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.282+0000 7fc3a9954640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3a41082a0 0x7fc3a419cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:55.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.282+0000 7fc3a9954640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a4111f10 con 0x7fc3a4102d30 2024-09-12T12:23:55.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.282+0000 7fc3a9954640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a4111d90 con 0x7fc3a41082a0 2024-09-12T12:23:55.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.282+0000 7fc3a9954640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a4112090 con 0x7fc3a41036e0 2024-09-12T12:23:55.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.282+0000 7fc3a2ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3a4102d30 0x7fc3a41984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:55.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.282+0000 7fc3a2ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3a4102d30 0x7fc3a41984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48522/0 (socket says 172.21.15.33:48522) 2024-09-12T12:23:55.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.282+0000 7fc3a2ffd640 1 -- 172.21.15.33:0/3770844119 learned_addr learned my addr 172.21.15.33:0/3770844119 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:23:55.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.282+0000 7fc3a27fc640 1 --2- 172.21.15.33:0/3770844119 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3a41036e0 0x7fc3a4198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:55.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.282+0000 7fc3a37fe640 1 --2- 172.21.15.33:0/3770844119 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3a41082a0 0x7fc3a419cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:55.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.282+0000 7fc3a2ffd640 1 -- 172.21.15.33:0/3770844119 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3a41036e0 msgr2=0x7fc3a4198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:55.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.282+0000 7fc3a2ffd640 1 --2- 172.21.15.33:0/3770844119 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3a41036e0 0x7fc3a4198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:55.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.282+0000 7fc3a2ffd640 1 -- 172.21.15.33:0/3770844119 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3a41082a0 msgr2=0x7fc3a419cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:55.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.282+0000 7fc3a2ffd640 1 --2- 172.21.15.33:0/3770844119 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3a41082a0 0x7fc3a419cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:55.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.282+0000 7fc3a2ffd640 1 -- 172.21.15.33:0/3770844119 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3a419d4a0 con 0x7fc3a4102d30 2024-09-12T12:23:55.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.282+0000 7fc3a37fe640 1 --2- 172.21.15.33:0/3770844119 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3a41082a0 0x7fc3a419cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:23:55.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.283+0000 7fc3a2ffd640 1 --2- 172.21.15.33:0/3770844119 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3a4102d30 0x7fc3a41984f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc39400cce0 tx=0x7fc39400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:55.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.283+0000 7fc3a8952640 1 -- 172.21.15.33:0/3770844119 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc394004b20 con 0x7fc3a4102d30 2024-09-12T12:23:55.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.283+0000 7fc3a8952640 1 -- 172.21.15.33:0/3770844119 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc394004cc0 con 0x7fc3a4102d30 2024-09-12T12:23:55.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.283+0000 7fc3a9954640 1 -- 172.21.15.33:0/3770844119 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3a419d790 con 0x7fc3a4102d30 2024-09-12T12:23:55.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.283+0000 7fc3a8952640 1 -- 172.21.15.33:0/3770844119 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39400f6b0 con 0x7fc3a4102d30 2024-09-12T12:23:55.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.283+0000 7fc3a9954640 1 -- 172.21.15.33:0/3770844119 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3a41a5070 con 0x7fc3a4102d30 2024-09-12T12:23:55.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.284+0000 7fc3a9954640 1 -- 172.21.15.33:0/3770844119 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3a406a850 con 0x7fc3a4102d30 2024-09-12T12:23:55.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.285+0000 7fc3a8952640 1 -- 172.21.15.33:0/3770844119 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fc39400f850 con 0x7fc3a4102d30 2024-09-12T12:23:55.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.286+0000 7fc3a8952640 1 --2- 172.21.15.33:0/3770844119 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc38c0a2b80 0x7fc38c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:55.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.286+0000 7fc3a27fc640 1 --2- 172.21.15.33:0/3770844119 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc38c0a2b80 0x7fc38c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:55.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.286+0000 7fc3a8952640 1 -- 172.21.15.33:0/3770844119 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8770+0+0 (secure 0 0 0) 0x7fc3940cf320 con 0x7fc3a4102d30 2024-09-12T12:23:55.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.286+0000 7fc3a27fc640 1 --2- 172.21.15.33:0/3770844119 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc38c0a2b80 0x7fc38c0a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc398031440 tx=0x7fc398000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:55.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.290+0000 7fc3a8952640 1 -- 172.21.15.33:0/3770844119 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc394014030 con 0x7fc3a4102d30 2024-09-12T12:23:55.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:54 smithi043 ceph-mon[34144]: pgmap v281: 129 pgs: 13 creating+peering, 16 unknown, 100 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 2 op/s 2024-09-12T12:23:55.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:54 smithi043 ceph-mon[34144]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T12:23:55.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:54 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/626415975' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-12T12:23:55.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:54 smithi043 ceph-mon[34144]: osdmap e84: 12 total, 12 up, 12 in 2024-09-12T12:23:55.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:54 smithi102 ceph-mon[34799]: pgmap v281: 129 pgs: 13 creating+peering, 16 unknown, 100 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 2 op/s 2024-09-12T12:23:55.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:54 smithi102 ceph-mon[34799]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T12:23:55.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:54 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/626415975' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-12T12:23:55.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:54 smithi102 ceph-mon[34799]: osdmap e84: 12 total, 12 up, 12 in 2024-09-12T12:23:55.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.505+0000 7fc3a9954640 1 -- 172.21.15.33:0/3770844119 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fc3a4103110 con 0x7fc3a4102d30 2024-09-12T12:23:55.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.908+0000 7fc3a8952640 1 -- 172.21.15.33:0/3770844119 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7fc39409c060 con 0x7fc3a4102d30 2024-09-12T12:23:55.908 INFO:teuthology.orchestra.run.smithi033.stderr:added data pool 4 to fsmap 2024-09-12T12:23:55.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.911+0000 7fc3a9954640 1 -- 172.21.15.33:0/3770844119 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc38c0a2b80 msgr2=0x7fc38c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:55.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.911+0000 7fc3a9954640 1 --2- 172.21.15.33:0/3770844119 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc38c0a2b80 0x7fc38c0a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc398031440 tx=0x7fc398000bc0 comp rx=0 tx=0).stop 2024-09-12T12:23:55.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.911+0000 7fc3a9954640 1 -- 172.21.15.33:0/3770844119 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3a4102d30 msgr2=0x7fc3a41984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:55.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.911+0000 7fc3a9954640 1 --2- 172.21.15.33:0/3770844119 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3a4102d30 0x7fc3a41984f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc39400cce0 tx=0x7fc39400a620 comp rx=0 tx=0).stop 2024-09-12T12:23:55.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.911+0000 7fc3a9954640 1 -- 172.21.15.33:0/3770844119 shutdown_connections 2024-09-12T12:23:55.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.911+0000 7fc3a9954640 1 --2- 172.21.15.33:0/3770844119 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc38c0a2b80 0x7fc38c0a5040 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:55.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.911+0000 7fc3a9954640 1 --2- 172.21.15.33:0/3770844119 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3a41082a0 0x7fc3a419cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:55.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.911+0000 7fc3a9954640 1 --2- 172.21.15.33:0/3770844119 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3a41036e0 0x7fc3a4198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:55.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.911+0000 7fc3a9954640 1 --2- 172.21.15.33:0/3770844119 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3a4102d30 0x7fc3a41984f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:55.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.911+0000 7fc3a9954640 1 -- 172.21.15.33:0/3770844119 >> 172.21.15.33:0/3770844119 conn(0x7fc3a40fc7d0 msgr2=0x7fc3a4105ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:55.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.911+0000 7fc3a9954640 1 -- 172.21.15.33:0/3770844119 shutdown_connections 2024-09-12T12:23:55.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:55.911+0000 7fc3a9954640 1 -- 172.21.15.33:0/3770844119 wait complete. 2024-09-12T12:23:56.204 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:55 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/3770844119' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-12T12:23:56.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:55 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/3770844119' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-12T12:23:56.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:55 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/3770844119' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-12T12:23:56.632 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:23:56.896 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:23:57.152 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:56 smithi033 ceph-mon[31246]: pgmap v283: 129 pgs: 13 creating+peering, 12 unknown, 104 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 1 op/s 2024-09-12T12:23:57.152 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:56 smithi033 ceph-mon[31246]: osdmap e85: 12 total, 12 up, 12 in 2024-09-12T12:23:57.152 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:56 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/3770844119' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-12T12:23:57.152 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:56 smithi033 ceph-mon[31246]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-12T12:23:57.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:56 smithi043 ceph-mon[34144]: pgmap v283: 129 pgs: 13 creating+peering, 12 unknown, 104 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 1 op/s 2024-09-12T12:23:57.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:56 smithi043 ceph-mon[34144]: osdmap e85: 12 total, 12 up, 12 in 2024-09-12T12:23:57.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:56 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/3770844119' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-12T12:23:57.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:56 smithi043 ceph-mon[34144]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-12T12:23:57.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.364+0000 7fd209295640 1 -- 172.21.15.33:0/128148645 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2041000d0 msgr2=0x7fd204100530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:57.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.364+0000 7fd209295640 1 --2- 172.21.15.33:0/128148645 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2041000d0 0x7fd204100530 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec009900 tx=0x7fd1ec02a410 comp rx=0 tx=0).stop 2024-09-12T12:23:57.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.364+0000 7fd209295640 1 -- 172.21.15.33:0/128148645 shutdown_connections 2024-09-12T12:23:57.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.364+0000 7fd209295640 1 --2- 172.21.15.33:0/128148645 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd204100a70 0x7fd20410ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:57.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.364+0000 7fd209295640 1 --2- 172.21.15.33:0/128148645 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2041000d0 0x7fd204100530 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:57.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.364+0000 7fd209295640 1 --2- 172.21.15.33:0/128148645 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd204106ba0 0x7fd204106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:57.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.364+0000 7fd209295640 1 -- 172.21.15.33:0/128148645 >> 172.21.15.33:0/128148645 conn(0x7fd204077210 msgr2=0x7fd2040fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:57.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.365+0000 7fd209295640 1 -- 172.21.15.33:0/128148645 shutdown_connections 2024-09-12T12:23:57.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.365+0000 7fd209295640 1 -- 172.21.15.33:0/128148645 wait complete. 2024-09-12T12:23:57.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.365+0000 7fd209295640 1 Processor -- start 2024-09-12T12:23:57.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.365+0000 7fd209295640 1 -- start start 2024-09-12T12:23:57.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.365+0000 7fd209295640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2041000d0 0x7fd204198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:57.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.365+0000 7fd209295640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd204100a70 0x7fd2041989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:57.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.365+0000 7fd209295640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd204106ba0 0x7fd20419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:57.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.365+0000 7fd209295640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd204111f30 con 0x7fd2041000d0 2024-09-12T12:23:57.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.365+0000 7fd209295640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd204111db0 con 0x7fd204106ba0 2024-09-12T12:23:57.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.365+0000 7fd209295640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd2041120b0 con 0x7fd204100a70 2024-09-12T12:23:57.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.366+0000 7fd202ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2041000d0 0x7fd204198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:57.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.366+0000 7fd202ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2041000d0 0x7fd204198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48546/0 (socket says 172.21.15.33:48546) 2024-09-12T12:23:57.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.366+0000 7fd202ffd640 1 -- 172.21.15.33:0/2678106290 learned_addr learned my addr 172.21.15.33:0/2678106290 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:23:57.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.366+0000 7fd1fbfff640 1 --2- 172.21.15.33:0/2678106290 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd204100a70 0x7fd2041989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:57.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.366+0000 7fd2037fe640 1 --2- 172.21.15.33:0/2678106290 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd204106ba0 0x7fd20419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:57.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.366+0000 7fd202ffd640 1 -- 172.21.15.33:0/2678106290 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd204100a70 msgr2=0x7fd2041989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:57.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.366+0000 7fd202ffd640 1 --2- 172.21.15.33:0/2678106290 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd204100a70 0x7fd2041989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:57.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.366+0000 7fd202ffd640 1 -- 172.21.15.33:0/2678106290 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd204106ba0 msgr2=0x7fd20419cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:57.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.366+0000 7fd202ffd640 1 --2- 172.21.15.33:0/2678106290 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd204106ba0 0x7fd20419cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:57.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.366+0000 7fd202ffd640 1 -- 172.21.15.33:0/2678106290 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd20419d440 con 0x7fd2041000d0 2024-09-12T12:23:57.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.366+0000 7fd1fbfff640 1 --2- 172.21.15.33:0/2678106290 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd204100a70 0x7fd2041989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:23:57.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.366+0000 7fd2037fe640 1 --2- 172.21.15.33:0/2678106290 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd204106ba0 0x7fd20419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:23:57.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.366+0000 7fd202ffd640 1 --2- 172.21.15.33:0/2678106290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2041000d0 0x7fd204198490 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd1f400d950 tx=0x7fd1f400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:57.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.366+0000 7fd200ff9640 1 -- 172.21.15.33:0/2678106290 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f4017030 con 0x7fd2041000d0 2024-09-12T12:23:57.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.366+0000 7fd200ff9640 1 -- 172.21.15.33:0/2678106290 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd1f4004020 con 0x7fd2041000d0 2024-09-12T12:23:57.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.366+0000 7fd209295640 1 -- 172.21.15.33:0/2678106290 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd20419d730 con 0x7fd2041000d0 2024-09-12T12:23:57.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.366+0000 7fd200ff9640 1 -- 172.21.15.33:0/2678106290 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f40047a0 con 0x7fd2041000d0 2024-09-12T12:23:57.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.366+0000 7fd209295640 1 -- 172.21.15.33:0/2678106290 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2041a5010 con 0x7fd2041000d0 2024-09-12T12:23:57.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.367+0000 7fd209295640 1 -- 172.21.15.33:0/2678106290 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd204100530 con 0x7fd2041000d0 2024-09-12T12:23:57.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.369+0000 7fd200ff9640 1 -- 172.21.15.33:0/2678106290 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fd1f40041d0 con 0x7fd2041000d0 2024-09-12T12:23:57.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.370+0000 7fd200ff9640 1 --2- 172.21.15.33:0/2678106290 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd1f00a2c00 0x7fd1f00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:57.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.370+0000 7fd1fbfff640 1 --2- 172.21.15.33:0/2678106290 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd1f00a2c00 0x7fd1f00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:57.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.370+0000 7fd200ff9640 1 -- 172.21.15.33:0/2678106290 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7fd1f40cf3a0 con 0x7fd2041000d0 2024-09-12T12:23:57.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.370+0000 7fd1fbfff640 1 --2- 172.21.15.33:0/2678106290 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd1f00a2c00 0x7fd1f00a50c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec000c00 tx=0x7fd1ec005a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:57.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.373+0000 7fd200ff9640 1 -- 172.21.15.33:0/2678106290 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd1f409c0e0 con 0x7fd2041000d0 2024-09-12T12:23:57.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:56 smithi102 ceph-mon[34799]: pgmap v283: 129 pgs: 13 creating+peering, 12 unknown, 104 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 1 op/s 2024-09-12T12:23:57.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:56 smithi102 ceph-mon[34799]: osdmap e85: 12 total, 12 up, 12 in 2024-09-12T12:23:57.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:56 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/3770844119' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-12T12:23:57.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:56 smithi102 ceph-mon[34799]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-12T12:23:57.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.586+0000 7fd209295640 1 -- 172.21.15.33:0/2678106290 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd20410a050 con 0x7fd2041000d0 2024-09-12T12:23:57.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.586+0000 7fd200ff9640 1 -- 172.21.15.33:0/2678106290 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11839 (secure 0 0 0) 0x7fd1f409b9e0 con 0x7fd2041000d0 2024-09-12T12:23:57.587 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:23:57.587 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":17,"btime":"2024-09-12T12:23:55:898907+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3327066342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3327066342},{"type":"v1","addr":"172.21.15.33:6835","nonce":3327066342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/19516401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":19516401},{"type":"v1","addr":"172.21.15.33:6837","nonce":19516401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1260196118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1260196118},{"type":"v1","addr":"172.21.15.33:6839","nonce":1260196118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/4288248356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4288248356},{"type":"v1","addr":"172.21.15.33:6841","nonce":4288248356}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/3051073141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3051073141},{"type":"v1","addr":"172.21.15.43:6833","nonce":3051073141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3282762800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3282762800},{"type":"v1","addr":"172.21.15.43:6835","nonce":3282762800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/3051713000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3051713000},{"type":"v1","addr":"172.21.15.102:6833","nonce":3051713000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2472064883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2472064883},{"type":"v1","addr":"172.21.15.43:6837","nonce":2472064883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24473,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6839/1987408860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":1987408860},{"type":"v1","addr":"172.21.15.43:6839","nonce":1987408860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24478,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/4179527539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":4179527539},{"type":"v1","addr":"172.21.15.102:6835","nonce":4179527539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24490,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2409953270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2409953270},{"type":"v1","addr":"172.21.15.102:6837","nonce":2409953270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:23:46.400609+0000","modified":"2024-09-12T12:23:55.506520+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24499},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.102:6839/1553271340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":1553271340},{"type":"v1","addr":"172.21.15.102:6839","nonce":1553271340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24499,"qdb_cluster":[24499]},"id":1}]} 2024-09-12T12:23:57.587 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 17 2024-09-12T12:23:57.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.589+0000 7fd209295640 1 -- 172.21.15.33:0/2678106290 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd1f00a2c00 msgr2=0x7fd1f00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:57.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.589+0000 7fd209295640 1 --2- 172.21.15.33:0/2678106290 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd1f00a2c00 0x7fd1f00a50c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec000c00 tx=0x7fd1ec005a40 comp rx=0 tx=0).stop 2024-09-12T12:23:57.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.589+0000 7fd209295640 1 -- 172.21.15.33:0/2678106290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2041000d0 msgr2=0x7fd204198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:57.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.589+0000 7fd209295640 1 --2- 172.21.15.33:0/2678106290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2041000d0 0x7fd204198490 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd1f400d950 tx=0x7fd1f400de10 comp rx=0 tx=0).stop 2024-09-12T12:23:57.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.589+0000 7fd209295640 1 -- 172.21.15.33:0/2678106290 shutdown_connections 2024-09-12T12:23:57.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.589+0000 7fd209295640 1 --2- 172.21.15.33:0/2678106290 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd1f00a2c00 0x7fd1f00a50c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:57.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.589+0000 7fd209295640 1 --2- 172.21.15.33:0/2678106290 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd204106ba0 0x7fd20419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:57.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.589+0000 7fd209295640 1 --2- 172.21.15.33:0/2678106290 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd204100a70 0x7fd2041989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:57.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.589+0000 7fd209295640 1 --2- 172.21.15.33:0/2678106290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2041000d0 0x7fd204198490 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:57.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.589+0000 7fd209295640 1 -- 172.21.15.33:0/2678106290 >> 172.21.15.33:0/2678106290 conn(0x7fd204077210 msgr2=0x7fd2040fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:57.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.589+0000 7fd209295640 1 -- 172.21.15.33:0/2678106290 shutdown_connections 2024-09-12T12:23:57.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:57.589+0000 7fd209295640 1 -- 172.21.15.33:0/2678106290 wait complete. 2024-09-12T12:23:58.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:57 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/2678106290' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:23:58.300 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T12:23:58.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:57 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/2678106290' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:23:58.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:57 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/2678106290' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:23:58.558 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:23:58.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:58 smithi033 ceph-mon[31246]: pgmap v285: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:58.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:58 smithi033 ceph-mon[31246]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-12T12:23:58.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:58 smithi033 ceph-mon[31246]: Cluster is now healthy 2024-09-12T12:23:59.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.065+0000 7f9b91af9640 1 -- 172.21.15.33:0/4224326867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b8c101dd0 msgr2=0x7f9b8c1021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:59.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.065+0000 7f9b91af9640 1 --2- 172.21.15.33:0/4224326867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b8c101dd0 0x7f9b8c1021b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c009900 tx=0x7f9b7c02a410 comp rx=0 tx=0).stop 2024-09-12T12:23:59.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.065+0000 7f9b91af9640 1 -- 172.21.15.33:0/4224326867 shutdown_connections 2024-09-12T12:23:59.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.065+0000 7f9b91af9640 1 --2- 172.21.15.33:0/4224326867 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9b8c106f00 0x7f9b8c10ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:59.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.065+0000 7f9b91af9640 1 --2- 172.21.15.33:0/4224326867 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b8c102780 0x7f9b8c1067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:59.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.065+0000 7f9b91af9640 1 --2- 172.21.15.33:0/4224326867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b8c101dd0 0x7f9b8c1021b0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:59.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.065+0000 7f9b91af9640 1 -- 172.21.15.33:0/4224326867 >> 172.21.15.33:0/4224326867 conn(0x7f9b8c0fd8b0 msgr2=0x7f9b8c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:59.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.065+0000 7f9b91af9640 1 -- 172.21.15.33:0/4224326867 shutdown_connections 2024-09-12T12:23:59.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.065+0000 7f9b91af9640 1 -- 172.21.15.33:0/4224326867 wait complete. 2024-09-12T12:23:59.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.066+0000 7f9b91af9640 1 Processor -- start 2024-09-12T12:23:59.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.066+0000 7f9b91af9640 1 -- start start 2024-09-12T12:23:59.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.066+0000 7f9b91af9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9b8c101dd0 0x7f9b8c1982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:59.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.066+0000 7f9b91af9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b8c102780 0x7f9b8c1987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:59.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.066+0000 7f9b91af9640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b8c106f00 0x7f9b8c19cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:59.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.066+0000 7f9b91af9640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9b8c111e10 con 0x7f9b8c102780 2024-09-12T12:23:59.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.066+0000 7f9b91af9640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9b8c111c90 con 0x7f9b8c106f00 2024-09-12T12:23:59.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.066+0000 7f9b91af9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9b8c111f90 con 0x7f9b8c101dd0 2024-09-12T12:23:59.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.066+0000 7f9b8affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b8c102780 0x7f9b8c1987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:59.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.066+0000 7f9b8affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b8c102780 0x7f9b8c1987f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48570/0 (socket says 172.21.15.33:48570) 2024-09-12T12:23:59.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.066+0000 7f9b8affd640 1 -- 172.21.15.33:0/182561317 learned_addr learned my addr 172.21.15.33:0/182561317 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:23:59.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.066+0000 7f9b8b7fe640 1 --2- 172.21.15.33:0/182561317 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9b8c101dd0 0x7f9b8c1982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:59.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.067+0000 7f9b8bfff640 1 --2- 172.21.15.33:0/182561317 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b8c106f00 0x7f9b8c19cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:59.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.067+0000 7f9b8affd640 1 -- 172.21.15.33:0/182561317 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9b8c101dd0 msgr2=0x7f9b8c1982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:59.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.067+0000 7f9b8affd640 1 --2- 172.21.15.33:0/182561317 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9b8c101dd0 0x7f9b8c1982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:59.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.067+0000 7f9b8affd640 1 -- 172.21.15.33:0/182561317 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b8c106f00 msgr2=0x7f9b8c19cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:59.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.067+0000 7f9b8affd640 1 --2- 172.21.15.33:0/182561317 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b8c106f00 0x7f9b8c19cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:59.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.067+0000 7f9b8affd640 1 -- 172.21.15.33:0/182561317 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b8c19d260 con 0x7f9b8c102780 2024-09-12T12:23:59.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.067+0000 7f9b8affd640 1 --2- 172.21.15.33:0/182561317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b8c102780 0x7f9b8c1987f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9b8000d950 tx=0x7f9b8000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:59.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.067+0000 7f9b88ff9640 1 -- 172.21.15.33:0/182561317 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b80017070 con 0x7f9b8c102780 2024-09-12T12:23:59.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.067+0000 7f9b88ff9640 1 -- 172.21.15.33:0/182561317 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9b80009c30 con 0x7f9b8c102780 2024-09-12T12:23:59.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.067+0000 7f9b91af9640 1 -- 172.21.15.33:0/182561317 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b8c19d550 con 0x7f9b8c102780 2024-09-12T12:23:59.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.067+0000 7f9b88ff9640 1 -- 172.21.15.33:0/182561317 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b8000f620 con 0x7f9b8c102780 2024-09-12T12:23:59.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.068+0000 7f9b91af9640 1 -- 172.21.15.33:0/182561317 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b8c1a4e30 con 0x7f9b8c102780 2024-09-12T12:23:59.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.069+0000 7f9b91af9640 1 -- 172.21.15.33:0/182561317 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b8c1021b0 con 0x7f9b8c102780 2024-09-12T12:23:59.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.069+0000 7f9b88ff9640 1 -- 172.21.15.33:0/182561317 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f9b800109a0 con 0x7f9b8c102780 2024-09-12T12:23:59.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.070+0000 7f9b88ff9640 1 --2- 172.21.15.33:0/182561317 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f9b740a2c00 0x7f9b740a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:59.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.070+0000 7f9b8b7fe640 1 --2- 172.21.15.33:0/182561317 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f9b740a2c00 0x7f9b740a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:59.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.070+0000 7f9b88ff9640 1 -- 172.21.15.33:0/182561317 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f9b800cee50 con 0x7f9b8c102780 2024-09-12T12:23:59.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.071+0000 7f9b8b7fe640 1 --2- 172.21.15.33:0/182561317 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f9b740a2c00 0x7f9b740a50c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c031440 tx=0x7f9b7c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:59.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.074+0000 7f9b88ff9640 1 -- 172.21.15.33:0/182561317 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9b80009de0 con 0x7f9b8c102780 2024-09-12T12:23:59.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.250+0000 7f9b91af9640 1 -- 172.21.15.33:0/182561317 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9b8c10a0e0 con 0x7f9b8c102780 2024-09-12T12:23:59.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.252+0000 7f9b88ff9640 1 -- 172.21.15.33:0/182561317 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+24141 (secure 0 0 0) 0x7f9b8009bb70 con 0x7f9b8c102780 2024-09-12T12:23:59.252 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:23:59.252 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":85,"fsid":"a66dfafc-7100-11ef-bcea-c7b262605968","created":"2024-09-12T12:16:11.904815+0000","modified":"2024-09-12T12:23:55.506385+0000","last_up_change":"2024-09-12T12:22:57.476185+0000","last_in_change":"2024-09-12T12:22:35.192556+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:19:12.296305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:23:42.509774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:23:44.842852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T12:23:51.308720+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"74b68729-c97c-4da6-a659-75d6c147ad05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6803","nonce":963294466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6805","nonce":963294466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6809","nonce":963294466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6807","nonce":963294466}]},"public_addr":"172.21.15.33:6803/963294466","cluster_addr":"172.21.15.33:6805/963294466","heartbeat_back_addr":"172.21.15.33:6809/963294466","heartbeat_front_addr":"172.21.15.33:6807/963294466","state":["exists","up"]},{"osd":1,"uuid":"2461a388-e110-420b-9404-eb54cd39119e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6801","nonce":2306025171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6803","nonce":2306025171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6807","nonce":2306025171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6805","nonce":2306025171}]},"public_addr":"172.21.15.43:6801/2306025171","cluster_addr":"172.21.15.43:6803/2306025171","heartbeat_back_addr":"172.21.15.43:6807/2306025171","heartbeat_front_addr":"172.21.15.43:6805/2306025171","state":["exists","up"]},{"osd":2,"uuid":"4ba9dd02-977d-45fb-b366-ade15b52232b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6801","nonce":4257223217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6803","nonce":4257223217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6807","nonce":4257223217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6805","nonce":4257223217}]},"public_addr":"172.21.15.102:6801/4257223217","cluster_addr":"172.21.15.102:6803/4257223217","heartbeat_back_addr":"172.21.15.102:6807/4257223217","heartbeat_front_addr":"172.21.15.102:6805/4257223217","state":["exists","up"]},{"osd":3,"uuid":"345aa854-9ea2-4103-a186-9794af34c237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6811","nonce":2483872739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6813","nonce":2483872739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6817","nonce":2483872739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6815","nonce":2483872739}]},"public_addr":"172.21.15.33:6811/2483872739","cluster_addr":"172.21.15.33:6813/2483872739","heartbeat_back_addr":"172.21.15.33:6817/2483872739","heartbeat_front_addr":"172.21.15.33:6815/2483872739","state":["exists","up"]},{"osd":4,"uuid":"32acd6da-01d6-4a8e-9d05-3d394363d6f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6809","nonce":136043101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6811","nonce":136043101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6815","nonce":136043101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6813","nonce":136043101}]},"public_addr":"172.21.15.43:6809/136043101","cluster_addr":"172.21.15.43:6811/136043101","heartbeat_back_addr":"172.21.15.43:6815/136043101","heartbeat_front_addr":"172.21.15.43:6813/136043101","state":["exists","up"]},{"osd":5,"uuid":"dced0037-2da2-48c2-a391-f871d6ceebb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6809","nonce":2605625792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6811","nonce":2605625792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6815","nonce":2605625792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6813","nonce":2605625792}]},"public_addr":"172.21.15.102:6809/2605625792","cluster_addr":"172.21.15.102:6811/2605625792","heartbeat_back_addr":"172.21.15.102:6815/2605625792","heartbeat_front_addr":"172.21.15.102:6813/2605625792","state":["exists","up"]},{"osd":6,"uuid":"46e5532e-026a-4bb2-8847-2a3216e5d7a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6819","nonce":805864618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6821","nonce":805864618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6825","nonce":805864618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6823","nonce":805864618}]},"public_addr":"172.21.15.33:6819/805864618","cluster_addr":"172.21.15.33:6821/805864618","heartbeat_back_addr":"172.21.15.33:6825/805864618","heartbeat_front_addr":"172.21.15.33:6823/805864618","state":["exists","up"]},{"osd":7,"uuid":"c8474ab4-68cd-4475-9429-b54981247ee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6817","nonce":392537201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6819","nonce":392537201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6823","nonce":392537201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6821","nonce":392537201}]},"public_addr":"172.21.15.43:6817/392537201","cluster_addr":"172.21.15.43:6819/392537201","heartbeat_back_addr":"172.21.15.43:6823/392537201","heartbeat_front_addr":"172.21.15.43:6821/392537201","state":["exists","up"]},{"osd":8,"uuid":"e7c2ef28-8c84-44d0-ba6d-7556ec1d02dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6817","nonce":1768219597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6819","nonce":1768219597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6823","nonce":1768219597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6821","nonce":1768219597}]},"public_addr":"172.21.15.102:6817/1768219597","cluster_addr":"172.21.15.102:6819/1768219597","heartbeat_back_addr":"172.21.15.102:6823/1768219597","heartbeat_front_addr":"172.21.15.102:6821/1768219597","state":["exists","up"]},{"osd":9,"uuid":"f2500273-8b21-4984-bc41-cec5cc0c883b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6827","nonce":973136168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6829","nonce":973136168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6833","nonce":973136168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6831","nonce":973136168}]},"public_addr":"172.21.15.33:6827/973136168","cluster_addr":"172.21.15.33:6829/973136168","heartbeat_back_addr":"172.21.15.33:6833/973136168","heartbeat_front_addr":"172.21.15.33:6831/973136168","state":["exists","up"]},{"osd":10,"uuid":"954343c5-5d5b-4c30-acde-82aa695f7b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6825","nonce":248515585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6827","nonce":248515585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6831","nonce":248515585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6829","nonce":248515585}]},"public_addr":"172.21.15.43:6825/248515585","cluster_addr":"172.21.15.43:6827/248515585","heartbeat_back_addr":"172.21.15.43:6831/248515585","heartbeat_front_addr":"172.21.15.43:6829/248515585","state":["exists","up"]},{"osd":11,"uuid":"22b4147b-02ad-4514-be17-5bb395099eef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6825","nonce":2463068013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6827","nonce":2463068013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6831","nonce":2463068013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6829","nonce":2463068013}]},"public_addr":"172.21.15.102:6825/2463068013","cluster_addr":"172.21.15.102:6827/2463068013","heartbeat_back_addr":"172.21.15.102:6831/2463068013","heartbeat_front_addr":"172.21.15.102:6829/2463068013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:19.274804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:44.900294+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:08.885404+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:34.382089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:59.978538+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:25.275179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:49.429847+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:14.974792+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:40.268629+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:22:06.458679+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:22:31.813019+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:22:56.264078+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/3187741548":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6800/1381479235":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6801/1156183797":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/2222991013":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6801/1381479235":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6800/1156183797":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/3450458842":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/202580320":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/2441151017":"2024-09-13T12:16:57.792813+0000","172.21.15.33:0/1001176884":"2024-09-13T12:16:33.559150+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:23:59.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.254+0000 7f9b91af9640 1 -- 172.21.15.33:0/182561317 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f9b740a2c00 msgr2=0x7f9b740a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:59.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.254+0000 7f9b91af9640 1 --2- 172.21.15.33:0/182561317 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f9b740a2c00 0x7f9b740a50c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c031440 tx=0x7f9b7c005b50 comp rx=0 tx=0).stop 2024-09-12T12:23:59.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.254+0000 7f9b91af9640 1 -- 172.21.15.33:0/182561317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b8c102780 msgr2=0x7f9b8c1987f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:59.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.254+0000 7f9b91af9640 1 --2- 172.21.15.33:0/182561317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b8c102780 0x7f9b8c1987f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9b8000d950 tx=0x7f9b8000de10 comp rx=0 tx=0).stop 2024-09-12T12:23:59.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.254+0000 7f9b91af9640 1 -- 172.21.15.33:0/182561317 shutdown_connections 2024-09-12T12:23:59.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.254+0000 7f9b91af9640 1 --2- 172.21.15.33:0/182561317 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f9b740a2c00 0x7f9b740a50c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:59.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.254+0000 7f9b91af9640 1 --2- 172.21.15.33:0/182561317 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b8c106f00 0x7f9b8c19cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:59.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.254+0000 7f9b91af9640 1 --2- 172.21.15.33:0/182561317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b8c102780 0x7f9b8c1987f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:59.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.254+0000 7f9b91af9640 1 --2- 172.21.15.33:0/182561317 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9b8c101dd0 0x7f9b8c1982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:59.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.254+0000 7f9b91af9640 1 -- 172.21.15.33:0/182561317 >> 172.21.15.33:0/182561317 conn(0x7f9b8c0fd8b0 msgr2=0x7f9b8c0fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:59.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.254+0000 7f9b91af9640 1 -- 172.21.15.33:0/182561317 shutdown_connections 2024-09-12T12:23:59.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:23:59.254+0000 7f9b91af9640 1 -- 172.21.15.33:0/182561317 wait complete. 2024-09-12T12:23:59.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:58 smithi043 ceph-mon[34144]: pgmap v285: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:59.366 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:58 smithi043 ceph-mon[34144]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-12T12:23:59.366 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:58 smithi043 ceph-mon[34144]: Cluster is now healthy 2024-09-12T12:23:59.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:58 smithi102 ceph-mon[34799]: pgmap v285: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:23:59.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:58 smithi102 ceph-mon[34799]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-12T12:23:59.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:58 smithi102 ceph-mon[34799]: Cluster is now healthy 2024-09-12T12:23:59.944 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T12:24:00.202 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:00.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:23:59 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/182561317' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:24:00.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:23:59 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/182561317' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:24:00.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:23:59 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/182561317' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:24:00.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.675+0000 7fe2027d2640 1 -- 172.21.15.33:0/727596336 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1fc101420 msgr2=0x7fe1fc10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:00.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.675+0000 7fe2027d2640 1 --2- 172.21.15.33:0/727596336 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1fc101420 0x7fe1fc10d950 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4009cd0 tx=0x7fe1f402a8e0 comp rx=0 tx=0).stop 2024-09-12T12:24:00.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.675+0000 7fe2027d2640 1 -- 172.21.15.33:0/727596336 shutdown_connections 2024-09-12T12:24:00.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.675+0000 7fe2027d2640 1 --2- 172.21.15.33:0/727596336 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1fc101420 0x7fe1fc10d950 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:00.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.675+0000 7fe2027d2640 1 --2- 172.21.15.33:0/727596336 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1fc100a80 0x7fe1fc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:00.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.675+0000 7fe2027d2640 1 --2- 172.21.15.33:0/727596336 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1fc106a80 0x7fe1fc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:00.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.675+0000 7fe2027d2640 1 -- 172.21.15.33:0/727596336 >> 172.21.15.33:0/727596336 conn(0x7fe1fc0fc7a0 msgr2=0x7fe1fc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:00.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.675+0000 7fe2027d2640 1 -- 172.21.15.33:0/727596336 shutdown_connections 2024-09-12T12:24:00.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.675+0000 7fe2027d2640 1 -- 172.21.15.33:0/727596336 wait complete. 2024-09-12T12:24:00.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.676+0000 7fe2027d2640 1 Processor -- start 2024-09-12T12:24:00.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.676+0000 7fe2027d2640 1 -- start start 2024-09-12T12:24:00.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.676+0000 7fe2027d2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1fc100a80 0x7fe1fc1982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:00.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.676+0000 7fe2027d2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1fc101420 0x7fe1fc198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:00.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.676+0000 7fe2027d2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1fc106a80 0x7fe1fc19cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:00.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.676+0000 7fe2027d2640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe1fc110d50 con 0x7fe1fc106a80 2024-09-12T12:24:00.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.676+0000 7fe2027d2640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe1fc110bd0 con 0x7fe1fc100a80 2024-09-12T12:24:00.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.676+0000 7fe2027d2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe1fc110ed0 con 0x7fe1fc101420 2024-09-12T12:24:00.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.677+0000 7fe200d6f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1fc106a80 0x7fe1fc19cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:00.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.677+0000 7fe200d6f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1fc106a80 0x7fe1fc19cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52088/0 (socket says 172.21.15.33:52088) 2024-09-12T12:24:00.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.677+0000 7fe200d6f640 1 -- 172.21.15.33:0/2867218019 learned_addr learned my addr 172.21.15.33:0/2867218019 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:24:00.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.677+0000 7fe1fbfff640 1 --2- 172.21.15.33:0/2867218019 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1fc100a80 0x7fe1fc1982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:00.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.677+0000 7fe1fb7fe640 1 --2- 172.21.15.33:0/2867218019 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1fc101420 0x7fe1fc198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:00.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.677+0000 7fe200d6f640 1 -- 172.21.15.33:0/2867218019 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1fc101420 msgr2=0x7fe1fc198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:00.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.677+0000 7fe200d6f640 1 --2- 172.21.15.33:0/2867218019 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1fc101420 0x7fe1fc198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:00.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.677+0000 7fe200d6f640 1 -- 172.21.15.33:0/2867218019 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1fc100a80 msgr2=0x7fe1fc1982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:00.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.677+0000 7fe200d6f640 1 --2- 172.21.15.33:0/2867218019 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1fc100a80 0x7fe1fc1982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:00.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.677+0000 7fe200d6f640 1 -- 172.21.15.33:0/2867218019 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1fc19d2a0 con 0x7fe1fc106a80 2024-09-12T12:24:00.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.677+0000 7fe200d6f640 1 --2- 172.21.15.33:0/2867218019 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1fc106a80 0x7fe1fc19cbc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4005cc0 tx=0x7fe1f4003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:00.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.677+0000 7fe1f97fa640 1 -- 172.21.15.33:0/2867218019 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4004240 con 0x7fe1fc106a80 2024-09-12T12:24:00.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.677+0000 7fe2027d2640 1 -- 172.21.15.33:0/2867218019 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1fc19d530 con 0x7fe1fc106a80 2024-09-12T12:24:00.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.677+0000 7fe1f97fa640 1 -- 172.21.15.33:0/2867218019 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe1f40305a0 con 0x7fe1fc106a80 2024-09-12T12:24:00.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.677+0000 7fe1f97fa640 1 -- 172.21.15.33:0/2867218019 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f40466c0 con 0x7fe1fc106a80 2024-09-12T12:24:00.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.677+0000 7fe2027d2640 1 -- 172.21.15.33:0/2867218019 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1fc1a4e70 con 0x7fe1fc106a80 2024-09-12T12:24:00.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.678+0000 7fe2027d2640 1 -- 172.21.15.33:0/2867218019 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1fc100ee0 con 0x7fe1fc106a80 2024-09-12T12:24:00.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.680+0000 7fe1f97fa640 1 -- 172.21.15.33:0/2867218019 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fe1f4030ac0 con 0x7fe1fc106a80 2024-09-12T12:24:00.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.680+0000 7fe1f97fa640 1 --2- 172.21.15.33:0/2867218019 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe1e40a2b80 0x7fe1e40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:00.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.680+0000 7fe1fbfff640 1 --2- 172.21.15.33:0/2867218019 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe1e40a2b80 0x7fe1e40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:00.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.680+0000 7fe1f97fa640 1 -- 172.21.15.33:0/2867218019 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7fe1f402e030 con 0x7fe1fc106a80 2024-09-12T12:24:00.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.681+0000 7fe1fbfff640 1 --2- 172.21.15.33:0/2867218019 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe1e40a2b80 0x7fe1e40a5040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec009990 tx=0x7fe1ec009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:00.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.684+0000 7fe1f97fa640 1 -- 172.21.15.33:0/2867218019 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe1f404b060 con 0x7fe1fc106a80 2024-09-12T12:24:00.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.860+0000 7fe2027d2640 1 -- 172.21.15.33:0/2867218019 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe1fc10a050 con 0x7fe1fc106a80 2024-09-12T12:24:00.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.862+0000 7fe1f97fa640 1 -- 172.21.15.33:0/2867218019 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+24141 (secure 0 0 0) 0x7fe1f40bd620 con 0x7fe1fc106a80 2024-09-12T12:24:00.862 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:24:00.862 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":85,"fsid":"a66dfafc-7100-11ef-bcea-c7b262605968","created":"2024-09-12T12:16:11.904815+0000","modified":"2024-09-12T12:23:55.506385+0000","last_up_change":"2024-09-12T12:22:57.476185+0000","last_in_change":"2024-09-12T12:22:35.192556+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:19:12.296305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:23:42.509774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:23:44.842852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T12:23:51.308720+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"74b68729-c97c-4da6-a659-75d6c147ad05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6803","nonce":963294466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6805","nonce":963294466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6809","nonce":963294466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6807","nonce":963294466}]},"public_addr":"172.21.15.33:6803/963294466","cluster_addr":"172.21.15.33:6805/963294466","heartbeat_back_addr":"172.21.15.33:6809/963294466","heartbeat_front_addr":"172.21.15.33:6807/963294466","state":["exists","up"]},{"osd":1,"uuid":"2461a388-e110-420b-9404-eb54cd39119e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6801","nonce":2306025171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6803","nonce":2306025171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6807","nonce":2306025171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6805","nonce":2306025171}]},"public_addr":"172.21.15.43:6801/2306025171","cluster_addr":"172.21.15.43:6803/2306025171","heartbeat_back_addr":"172.21.15.43:6807/2306025171","heartbeat_front_addr":"172.21.15.43:6805/2306025171","state":["exists","up"]},{"osd":2,"uuid":"4ba9dd02-977d-45fb-b366-ade15b52232b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6801","nonce":4257223217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6803","nonce":4257223217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6807","nonce":4257223217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6805","nonce":4257223217}]},"public_addr":"172.21.15.102:6801/4257223217","cluster_addr":"172.21.15.102:6803/4257223217","heartbeat_back_addr":"172.21.15.102:6807/4257223217","heartbeat_front_addr":"172.21.15.102:6805/4257223217","state":["exists","up"]},{"osd":3,"uuid":"345aa854-9ea2-4103-a186-9794af34c237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6811","nonce":2483872739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6813","nonce":2483872739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6817","nonce":2483872739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6815","nonce":2483872739}]},"public_addr":"172.21.15.33:6811/2483872739","cluster_addr":"172.21.15.33:6813/2483872739","heartbeat_back_addr":"172.21.15.33:6817/2483872739","heartbeat_front_addr":"172.21.15.33:6815/2483872739","state":["exists","up"]},{"osd":4,"uuid":"32acd6da-01d6-4a8e-9d05-3d394363d6f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6809","nonce":136043101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6811","nonce":136043101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6815","nonce":136043101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6813","nonce":136043101}]},"public_addr":"172.21.15.43:6809/136043101","cluster_addr":"172.21.15.43:6811/136043101","heartbeat_back_addr":"172.21.15.43:6815/136043101","heartbeat_front_addr":"172.21.15.43:6813/136043101","state":["exists","up"]},{"osd":5,"uuid":"dced0037-2da2-48c2-a391-f871d6ceebb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6809","nonce":2605625792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6811","nonce":2605625792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6815","nonce":2605625792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6813","nonce":2605625792}]},"public_addr":"172.21.15.102:6809/2605625792","cluster_addr":"172.21.15.102:6811/2605625792","heartbeat_back_addr":"172.21.15.102:6815/2605625792","heartbeat_front_addr":"172.21.15.102:6813/2605625792","state":["exists","up"]},{"osd":6,"uuid":"46e5532e-026a-4bb2-8847-2a3216e5d7a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6819","nonce":805864618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6821","nonce":805864618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6825","nonce":805864618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6823","nonce":805864618}]},"public_addr":"172.21.15.33:6819/805864618","cluster_addr":"172.21.15.33:6821/805864618","heartbeat_back_addr":"172.21.15.33:6825/805864618","heartbeat_front_addr":"172.21.15.33:6823/805864618","state":["exists","up"]},{"osd":7,"uuid":"c8474ab4-68cd-4475-9429-b54981247ee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6817","nonce":392537201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6819","nonce":392537201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6823","nonce":392537201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6821","nonce":392537201}]},"public_addr":"172.21.15.43:6817/392537201","cluster_addr":"172.21.15.43:6819/392537201","heartbeat_back_addr":"172.21.15.43:6823/392537201","heartbeat_front_addr":"172.21.15.43:6821/392537201","state":["exists","up"]},{"osd":8,"uuid":"e7c2ef28-8c84-44d0-ba6d-7556ec1d02dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6817","nonce":1768219597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6819","nonce":1768219597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6823","nonce":1768219597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6821","nonce":1768219597}]},"public_addr":"172.21.15.102:6817/1768219597","cluster_addr":"172.21.15.102:6819/1768219597","heartbeat_back_addr":"172.21.15.102:6823/1768219597","heartbeat_front_addr":"172.21.15.102:6821/1768219597","state":["exists","up"]},{"osd":9,"uuid":"f2500273-8b21-4984-bc41-cec5cc0c883b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6827","nonce":973136168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6829","nonce":973136168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6833","nonce":973136168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6831","nonce":973136168}]},"public_addr":"172.21.15.33:6827/973136168","cluster_addr":"172.21.15.33:6829/973136168","heartbeat_back_addr":"172.21.15.33:6833/973136168","heartbeat_front_addr":"172.21.15.33:6831/973136168","state":["exists","up"]},{"osd":10,"uuid":"954343c5-5d5b-4c30-acde-82aa695f7b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6825","nonce":248515585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6827","nonce":248515585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6831","nonce":248515585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6829","nonce":248515585}]},"public_addr":"172.21.15.43:6825/248515585","cluster_addr":"172.21.15.43:6827/248515585","heartbeat_back_addr":"172.21.15.43:6831/248515585","heartbeat_front_addr":"172.21.15.43:6829/248515585","state":["exists","up"]},{"osd":11,"uuid":"22b4147b-02ad-4514-be17-5bb395099eef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6825","nonce":2463068013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6827","nonce":2463068013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6831","nonce":2463068013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6829","nonce":2463068013}]},"public_addr":"172.21.15.102:6825/2463068013","cluster_addr":"172.21.15.102:6827/2463068013","heartbeat_back_addr":"172.21.15.102:6831/2463068013","heartbeat_front_addr":"172.21.15.102:6829/2463068013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:19.274804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:44.900294+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:08.885404+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:34.382089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:59.978538+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:25.275179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:49.429847+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:14.974792+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:40.268629+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:22:06.458679+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:22:31.813019+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:22:56.264078+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/3187741548":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6800/1381479235":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6801/1156183797":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/2222991013":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6801/1381479235":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6800/1156183797":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/3450458842":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/202580320":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/2441151017":"2024-09-13T12:16:57.792813+0000","172.21.15.33:0/1001176884":"2024-09-13T12:16:33.559150+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:24:00.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.864+0000 7fe2027d2640 1 -- 172.21.15.33:0/2867218019 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe1e40a2b80 msgr2=0x7fe1e40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:00.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.864+0000 7fe2027d2640 1 --2- 172.21.15.33:0/2867218019 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe1e40a2b80 0x7fe1e40a5040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec009990 tx=0x7fe1ec009110 comp rx=0 tx=0).stop 2024-09-12T12:24:00.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.864+0000 7fe2027d2640 1 -- 172.21.15.33:0/2867218019 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1fc106a80 msgr2=0x7fe1fc19cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:00.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.864+0000 7fe2027d2640 1 --2- 172.21.15.33:0/2867218019 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1fc106a80 0x7fe1fc19cbc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4005cc0 tx=0x7fe1f4003ba0 comp rx=0 tx=0).stop 2024-09-12T12:24:00.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.864+0000 7fe2027d2640 1 -- 172.21.15.33:0/2867218019 shutdown_connections 2024-09-12T12:24:00.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.864+0000 7fe2027d2640 1 --2- 172.21.15.33:0/2867218019 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe1e40a2b80 0x7fe1e40a5040 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:00.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.864+0000 7fe2027d2640 1 --2- 172.21.15.33:0/2867218019 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1fc106a80 0x7fe1fc19cbc0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:00.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.864+0000 7fe2027d2640 1 --2- 172.21.15.33:0/2867218019 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1fc101420 0x7fe1fc198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:00.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.864+0000 7fe2027d2640 1 --2- 172.21.15.33:0/2867218019 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1fc100a80 0x7fe1fc1982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:00.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.864+0000 7fe2027d2640 1 -- 172.21.15.33:0/2867218019 >> 172.21.15.33:0/2867218019 conn(0x7fe1fc0fc7a0 msgr2=0x7fe1fc06aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:00.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.864+0000 7fe2027d2640 1 -- 172.21.15.33:0/2867218019 shutdown_connections 2024-09-12T12:24:00.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:00.864+0000 7fe2027d2640 1 -- 172.21.15.33:0/2867218019 wait complete. 2024-09-12T12:24:01.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:00 smithi033 ceph-mon[31246]: pgmap v286: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:24:01.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:00 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/2867218019' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:24:01.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:00 smithi043 ceph-mon[34144]: pgmap v286: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:24:01.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:00 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/2867218019' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:24:01.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:00 smithi102 ceph-mon[34799]: pgmap v286: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:24:01.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:00 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/2867218019' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:24:01.548 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:24:01.810 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:02.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.241+0000 7f74ad149640 1 -- 172.21.15.33:0/214141058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74a81082a0 msgr2=0x7f74a810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:02.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.241+0000 7f74ad149640 1 --2- 172.21.15.33:0/214141058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74a81082a0 0x7f74a810ec40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f74a0009cd0 tx=0x7f74a002a8e0 comp rx=0 tx=0).stop 2024-09-12T12:24:02.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.242+0000 7f74ad149640 1 -- 172.21.15.33:0/214141058 shutdown_connections 2024-09-12T12:24:02.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.242+0000 7f74ad149640 1 --2- 172.21.15.33:0/214141058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74a81082a0 0x7f74a810ec40 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:02.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.242+0000 7f74ad149640 1 --2- 172.21.15.33:0/214141058 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74a81036e0 0x7f74a8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:02.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.242+0000 7f74ad149640 1 --2- 172.21.15.33:0/214141058 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74a8102d30 0x7f74a8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:02.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.242+0000 7f74ad149640 1 -- 172.21.15.33:0/214141058 >> 172.21.15.33:0/214141058 conn(0x7f74a80fc7d0 msgr2=0x7f74a80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:02.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.242+0000 7f74ad149640 1 -- 172.21.15.33:0/214141058 shutdown_connections 2024-09-12T12:24:02.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.242+0000 7f74ad149640 1 -- 172.21.15.33:0/214141058 wait complete. 2024-09-12T12:24:02.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.242+0000 7f74ad149640 1 Processor -- start 2024-09-12T12:24:02.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.243+0000 7f74ad149640 1 -- start start 2024-09-12T12:24:02.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.243+0000 7f74ad149640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74a8102d30 0x7f74a8100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:02.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.243+0000 7f74ad149640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74a81036e0 0x7f74a8100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:02.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.243+0000 7f74ad149640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74a81082a0 0x7f74a8101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:02.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.243+0000 7f74ad149640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f74a8111fd0 con 0x7f74a8102d30 2024-09-12T12:24:02.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.243+0000 7f74ad149640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f74a8111e50 con 0x7f74a81036e0 2024-09-12T12:24:02.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.243+0000 7f74ad149640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f74a8112150 con 0x7f74a81082a0 2024-09-12T12:24:02.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.243+0000 7f74a6d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74a8102d30 0x7f74a8100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:02.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.243+0000 7f74a6d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74a8102d30 0x7f74a8100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52106/0 (socket says 172.21.15.33:52106) 2024-09-12T12:24:02.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.243+0000 7f74a6d9d640 1 -- 172.21.15.33:0/3418028108 learned_addr learned my addr 172.21.15.33:0/3418028108 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:24:02.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.243+0000 7f74a759e640 1 --2- 172.21.15.33:0/3418028108 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74a81082a0 0x7f74a8101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:02.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.243+0000 7f74a659c640 1 --2- 172.21.15.33:0/3418028108 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74a81036e0 0x7f74a8100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:02.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.243+0000 7f74a6d9d640 1 -- 172.21.15.33:0/3418028108 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74a81082a0 msgr2=0x7f74a8101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:02.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.243+0000 7f74a6d9d640 1 --2- 172.21.15.33:0/3418028108 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74a81082a0 0x7f74a8101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:02.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.243+0000 7f74a6d9d640 1 -- 172.21.15.33:0/3418028108 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74a81036e0 msgr2=0x7f74a8100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:02.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.243+0000 7f74a6d9d640 1 --2- 172.21.15.33:0/3418028108 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74a81036e0 0x7f74a8100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:02.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.243+0000 7f74a6d9d640 1 -- 172.21.15.33:0/3418028108 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74a81a69e0 con 0x7f74a8102d30 2024-09-12T12:24:02.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.243+0000 7f74a659c640 1 --2- 172.21.15.33:0/3418028108 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74a81036e0 0x7f74a8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:24:02.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.244+0000 7f74a6d9d640 1 --2- 172.21.15.33:0/3418028108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74a8102d30 0x7f74a8100990 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f749000b4a0 tx=0x7f749000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:02.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.244+0000 7f749ffff640 1 -- 172.21.15.33:0/3418028108 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7490014070 con 0x7f74a8102d30 2024-09-12T12:24:02.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.244+0000 7f749ffff640 1 -- 172.21.15.33:0/3418028108 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7490010ac0 con 0x7f74a8102d30 2024-09-12T12:24:02.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.244+0000 7f74ad149640 1 -- 172.21.15.33:0/3418028108 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74a81a6cd0 con 0x7f74a8102d30 2024-09-12T12:24:02.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.244+0000 7f749ffff640 1 -- 172.21.15.33:0/3418028108 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7490017c30 con 0x7f74a8102d30 2024-09-12T12:24:02.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.244+0000 7f74ad149640 1 -- 172.21.15.33:0/3418028108 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74a81a71c0 con 0x7f74a8102d30 2024-09-12T12:24:02.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.245+0000 7f74ad149640 1 -- 172.21.15.33:0/3418028108 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74a806a850 con 0x7f74a8102d30 2024-09-12T12:24:02.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.246+0000 7f749ffff640 1 -- 172.21.15.33:0/3418028108 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f7490017070 con 0x7f74a8102d30 2024-09-12T12:24:02.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.247+0000 7f749ffff640 1 --2- 172.21.15.33:0/3418028108 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f74940a2b80 0x7f74940a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:02.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.247+0000 7f74a659c640 1 --2- 172.21.15.33:0/3418028108 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f74940a2b80 0x7f74940a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:02.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.247+0000 7f749ffff640 1 -- 172.21.15.33:0/3418028108 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f74900ce9f0 con 0x7f74a8102d30 2024-09-12T12:24:02.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.248+0000 7f74a659c640 1 --2- 172.21.15.33:0/3418028108 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f74940a2b80 0x7f74940a5040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7498005fd0 tx=0x7f7498005ea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:02.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.250+0000 7f749ffff640 1 -- 172.21.15.33:0/3418028108 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f749009b6b0 con 0x7f74a8102d30 2024-09-12T12:24:02.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.460+0000 7f74ad149640 1 -- 172.21.15.33:0/3418028108 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f74a8103110 con 0x7f74a8102d30 2024-09-12T12:24:02.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.460+0000 7f749ffff640 1 -- 172.21.15.33:0/3418028108 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11839 (secure 0 0 0) 0x7f749009afb0 con 0x7f74a8102d30 2024-09-12T12:24:02.462 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:24:02.462 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":17,"btime":"2024-09-12T12:23:55:898907+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3327066342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3327066342},{"type":"v1","addr":"172.21.15.33:6835","nonce":3327066342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/19516401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":19516401},{"type":"v1","addr":"172.21.15.33:6837","nonce":19516401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1260196118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1260196118},{"type":"v1","addr":"172.21.15.33:6839","nonce":1260196118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/4288248356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4288248356},{"type":"v1","addr":"172.21.15.33:6841","nonce":4288248356}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/3051073141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3051073141},{"type":"v1","addr":"172.21.15.43:6833","nonce":3051073141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3282762800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3282762800},{"type":"v1","addr":"172.21.15.43:6835","nonce":3282762800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/3051713000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3051713000},{"type":"v1","addr":"172.21.15.102:6833","nonce":3051713000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2472064883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2472064883},{"type":"v1","addr":"172.21.15.43:6837","nonce":2472064883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24473,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6839/1987408860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":1987408860},{"type":"v1","addr":"172.21.15.43:6839","nonce":1987408860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24478,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/4179527539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":4179527539},{"type":"v1","addr":"172.21.15.102:6835","nonce":4179527539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24490,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2409953270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2409953270},{"type":"v1","addr":"172.21.15.102:6837","nonce":2409953270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:23:46.400609+0000","modified":"2024-09-12T12:23:55.506520+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24499},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.102:6839/1553271340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":1553271340},{"type":"v1","addr":"172.21.15.102:6839","nonce":1553271340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24499,"qdb_cluster":[24499]},"id":1}]} 2024-09-12T12:24:02.462 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 17 2024-09-12T12:24:02.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.462+0000 7f74ad149640 1 -- 172.21.15.33:0/3418028108 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f74940a2b80 msgr2=0x7f74940a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:02.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.462+0000 7f74ad149640 1 --2- 172.21.15.33:0/3418028108 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f74940a2b80 0x7f74940a5040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7498005fd0 tx=0x7f7498005ea0 comp rx=0 tx=0).stop 2024-09-12T12:24:02.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.462+0000 7f74ad149640 1 -- 172.21.15.33:0/3418028108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74a8102d30 msgr2=0x7f74a8100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:02.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.462+0000 7f74ad149640 1 --2- 172.21.15.33:0/3418028108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74a8102d30 0x7f74a8100990 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f749000b4a0 tx=0x7f749000b960 comp rx=0 tx=0).stop 2024-09-12T12:24:02.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.462+0000 7f74ad149640 1 -- 172.21.15.33:0/3418028108 shutdown_connections 2024-09-12T12:24:02.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.462+0000 7f74ad149640 1 --2- 172.21.15.33:0/3418028108 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f74940a2b80 0x7f74940a5040 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:02.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.462+0000 7f74ad149640 1 --2- 172.21.15.33:0/3418028108 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74a81082a0 0x7f74a8101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:02.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.462+0000 7f74ad149640 1 --2- 172.21.15.33:0/3418028108 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74a81036e0 0x7f74a8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:02.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.462+0000 7f74ad149640 1 --2- 172.21.15.33:0/3418028108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74a8102d30 0x7f74a8100990 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:02.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.463+0000 7f74ad149640 1 -- 172.21.15.33:0/3418028108 >> 172.21.15.33:0/3418028108 conn(0x7f74a80fc7d0 msgr2=0x7f74a8105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:02.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.463+0000 7f74ad149640 1 -- 172.21.15.33:0/3418028108 shutdown_connections 2024-09-12T12:24:02.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:02.463+0000 7f74ad149640 1 -- 172.21.15.33:0/3418028108 wait complete. 2024-09-12T12:24:03.099 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:02 smithi033 ceph-mon[31246]: pgmap v287: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:24:03.099 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:02 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/3418028108' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:24:03.130 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T12:24:03.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:02 smithi043 ceph-mon[34144]: pgmap v287: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:24:03.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:02 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/3418028108' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:24:03.388 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:03.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:02 smithi102 ceph-mon[34799]: pgmap v287: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:24:03.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:02 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/3418028108' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:24:03.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:03.834+0000 7fbf39b6f640 1 -- 172.21.15.33:0/1576918223 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf34101420 msgr2=0x7fbf3410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:03.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:03.834+0000 7fbf39b6f640 1 --2- 172.21.15.33:0/1576918223 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf34101420 0x7fbf3410d950 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c009cd0 tx=0x7fbf2c02a8e0 comp rx=0 tx=0).stop 2024-09-12T12:24:03.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:03.834+0000 7fbf39b6f640 1 -- 172.21.15.33:0/1576918223 shutdown_connections 2024-09-12T12:24:03.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:03.834+0000 7fbf39b6f640 1 --2- 172.21.15.33:0/1576918223 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf34101420 0x7fbf3410d950 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:03.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:03.834+0000 7fbf39b6f640 1 --2- 172.21.15.33:0/1576918223 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf34100a80 0x7fbf34100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:03.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:03.834+0000 7fbf39b6f640 1 --2- 172.21.15.33:0/1576918223 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf34106a80 0x7fbf34106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:03.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:03.834+0000 7fbf39b6f640 1 -- 172.21.15.33:0/1576918223 >> 172.21.15.33:0/1576918223 conn(0x7fbf340fc7a0 msgr2=0x7fbf340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:03.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:03.834+0000 7fbf39b6f640 1 -- 172.21.15.33:0/1576918223 shutdown_connections 2024-09-12T12:24:03.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:03.834+0000 7fbf39b6f640 1 -- 172.21.15.33:0/1576918223 wait complete. 2024-09-12T12:24:03.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:03.835+0000 7fbf39b6f640 1 Processor -- start 2024-09-12T12:24:03.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:03.835+0000 7fbf39b6f640 1 -- start start 2024-09-12T12:24:03.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:03.835+0000 7fbf39b6f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf34100a80 0x7fbf34199160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:03.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:03.835+0000 7fbf39b6f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf34101420 0x7fbf341996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:03.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:03.835+0000 7fbf39b6f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf34106a80 0x7fbf341a41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:03.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:03.835+0000 7fbf39b6f640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fbf34110d50 con 0x7fbf34101420 2024-09-12T12:24:03.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:03.835+0000 7fbf39b6f640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbf34110bd0 con 0x7fbf34100a80 2024-09-12T12:24:03.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:03.835+0000 7fbf39b6f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbf34110ed0 con 0x7fbf34106a80 2024-09-12T12:24:03.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:03.835+0000 7fbf337fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf34100a80 0x7fbf34199160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:03.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:03.835+0000 7fbf33fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf34106a80 0x7fbf341a41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:03.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:03.835+0000 7fbf337fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf34100a80 0x7fbf34199160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:37520/0 (socket says 172.21.15.33:37520) 2024-09-12T12:24:03.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:03.835+0000 7fbf337fe640 1 -- 172.21.15.33:0/2977829135 learned_addr learned my addr 172.21.15.33:0/2977829135 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:24:03.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:03.836+0000 7fbf2affd640 1 --2- 172.21.15.33:0/2977829135 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf34101420 0x7fbf341996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:03.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:03.836+0000 7fbf337fe640 1 -- 172.21.15.33:0/2977829135 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf34106a80 msgr2=0x7fbf341a41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:03.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:03.836+0000 7fbf337fe640 1 --2- 172.21.15.33:0/2977829135 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf34106a80 0x7fbf341a41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:03.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:03.836+0000 7fbf337fe640 1 -- 172.21.15.33:0/2977829135 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf34101420 msgr2=0x7fbf341996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:03.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:03.836+0000 7fbf337fe640 1 --2- 172.21.15.33:0/2977829135 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf34101420 0x7fbf341996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:03.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:03.836+0000 7fbf337fe640 1 -- 172.21.15.33:0/2977829135 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf341a4720 con 0x7fbf34100a80 2024-09-12T12:24:03.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:03.836+0000 7fbf33fff640 1 --2- 172.21.15.33:0/2977829135 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf34106a80 0x7fbf341a41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:24:03.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:03.836+0000 7fbf2affd640 1 --2- 172.21.15.33:0/2977829135 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf34101420 0x7fbf341996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:24:03.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:03.836+0000 7fbf337fe640 1 --2- 172.21.15.33:0/2977829135 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf34100a80 0x7fbf34199160 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbf2400c920 tx=0x7fbf2400cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:03.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:03.836+0000 7fbf317fa640 1 -- 172.21.15.33:0/2977829135 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf24007c70 con 0x7fbf34100a80 2024-09-12T12:24:03.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:03.836+0000 7fbf39b6f640 1 -- 172.21.15.33:0/2977829135 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf341a48f0 con 0x7fbf34100a80 2024-09-12T12:24:03.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:03.836+0000 7fbf317fa640 1 -- 172.21.15.33:0/2977829135 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbf24007e10 con 0x7fbf34100a80 2024-09-12T12:24:03.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:03.837+0000 7fbf317fa640 1 -- 172.21.15.33:0/2977829135 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf24018820 con 0x7fbf34100a80 2024-09-12T12:24:03.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:03.837+0000 7fbf39b6f640 1 -- 172.21.15.33:0/2977829135 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf341a4e80 con 0x7fbf34100a80 2024-09-12T12:24:03.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:03.837+0000 7fbf39b6f640 1 -- 172.21.15.33:0/2977829135 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf34100ee0 con 0x7fbf34100a80 2024-09-12T12:24:03.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:03.839+0000 7fbf317fa640 1 -- 172.21.15.33:0/2977829135 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fbf240189c0 con 0x7fbf34100a80 2024-09-12T12:24:03.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:03.840+0000 7fbf317fa640 1 --2- 172.21.15.33:0/2977829135 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fbf200a2b80 0x7fbf200a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:03.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:03.840+0000 7fbf2affd640 1 --2- 172.21.15.33:0/2977829135 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fbf200a2b80 0x7fbf200a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:03.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:03.840+0000 7fbf317fa640 1 -- 172.21.15.33:0/2977829135 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7fbf240cf700 con 0x7fbf34100a80 2024-09-12T12:24:03.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:03.840+0000 7fbf2affd640 1 --2- 172.21.15.33:0/2977829135 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fbf200a2b80 0x7fbf200a5040 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbf3406b320 tx=0x7fbf1c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:03.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:03.844+0000 7fbf317fa640 1 -- 172.21.15.33:0/2977829135 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbf24014030 con 0x7fbf34100a80 2024-09-12T12:24:04.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:04.023+0000 7fbf39b6f640 1 -- 172.21.15.33:0/2977829135 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbf34109010 con 0x7fbf34100a80 2024-09-12T12:24:04.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:04.025+0000 7fbf317fa640 1 -- 172.21.15.33:0/2977829135 <== mon.2 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+24141 (secure 0 0 0) 0x7fbf2409c450 con 0x7fbf34100a80 2024-09-12T12:24:04.026 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:24:04.026 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":85,"fsid":"a66dfafc-7100-11ef-bcea-c7b262605968","created":"2024-09-12T12:16:11.904815+0000","modified":"2024-09-12T12:23:55.506385+0000","last_up_change":"2024-09-12T12:22:57.476185+0000","last_in_change":"2024-09-12T12:22:35.192556+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:19:12.296305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:23:42.509774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:23:44.842852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T12:23:51.308720+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"74b68729-c97c-4da6-a659-75d6c147ad05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6803","nonce":963294466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6805","nonce":963294466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6809","nonce":963294466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6807","nonce":963294466}]},"public_addr":"172.21.15.33:6803/963294466","cluster_addr":"172.21.15.33:6805/963294466","heartbeat_back_addr":"172.21.15.33:6809/963294466","heartbeat_front_addr":"172.21.15.33:6807/963294466","state":["exists","up"]},{"osd":1,"uuid":"2461a388-e110-420b-9404-eb54cd39119e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6801","nonce":2306025171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6803","nonce":2306025171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6807","nonce":2306025171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6805","nonce":2306025171}]},"public_addr":"172.21.15.43:6801/2306025171","cluster_addr":"172.21.15.43:6803/2306025171","heartbeat_back_addr":"172.21.15.43:6807/2306025171","heartbeat_front_addr":"172.21.15.43:6805/2306025171","state":["exists","up"]},{"osd":2,"uuid":"4ba9dd02-977d-45fb-b366-ade15b52232b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6801","nonce":4257223217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6803","nonce":4257223217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6807","nonce":4257223217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6805","nonce":4257223217}]},"public_addr":"172.21.15.102:6801/4257223217","cluster_addr":"172.21.15.102:6803/4257223217","heartbeat_back_addr":"172.21.15.102:6807/4257223217","heartbeat_front_addr":"172.21.15.102:6805/4257223217","state":["exists","up"]},{"osd":3,"uuid":"345aa854-9ea2-4103-a186-9794af34c237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6811","nonce":2483872739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6813","nonce":2483872739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6817","nonce":2483872739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6815","nonce":2483872739}]},"public_addr":"172.21.15.33:6811/2483872739","cluster_addr":"172.21.15.33:6813/2483872739","heartbeat_back_addr":"172.21.15.33:6817/2483872739","heartbeat_front_addr":"172.21.15.33:6815/2483872739","state":["exists","up"]},{"osd":4,"uuid":"32acd6da-01d6-4a8e-9d05-3d394363d6f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6809","nonce":136043101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6811","nonce":136043101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6815","nonce":136043101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6813","nonce":136043101}]},"public_addr":"172.21.15.43:6809/136043101","cluster_addr":"172.21.15.43:6811/136043101","heartbeat_back_addr":"172.21.15.43:6815/136043101","heartbeat_front_addr":"172.21.15.43:6813/136043101","state":["exists","up"]},{"osd":5,"uuid":"dced0037-2da2-48c2-a391-f871d6ceebb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6809","nonce":2605625792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6811","nonce":2605625792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6815","nonce":2605625792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6813","nonce":2605625792}]},"public_addr":"172.21.15.102:6809/2605625792","cluster_addr":"172.21.15.102:6811/2605625792","heartbeat_back_addr":"172.21.15.102:6815/2605625792","heartbeat_front_addr":"172.21.15.102:6813/2605625792","state":["exists","up"]},{"osd":6,"uuid":"46e5532e-026a-4bb2-8847-2a3216e5d7a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6819","nonce":805864618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6821","nonce":805864618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6825","nonce":805864618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6823","nonce":805864618}]},"public_addr":"172.21.15.33:6819/805864618","cluster_addr":"172.21.15.33:6821/805864618","heartbeat_back_addr":"172.21.15.33:6825/805864618","heartbeat_front_addr":"172.21.15.33:6823/805864618","state":["exists","up"]},{"osd":7,"uuid":"c8474ab4-68cd-4475-9429-b54981247ee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6817","nonce":392537201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6819","nonce":392537201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6823","nonce":392537201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6821","nonce":392537201}]},"public_addr":"172.21.15.43:6817/392537201","cluster_addr":"172.21.15.43:6819/392537201","heartbeat_back_addr":"172.21.15.43:6823/392537201","heartbeat_front_addr":"172.21.15.43:6821/392537201","state":["exists","up"]},{"osd":8,"uuid":"e7c2ef28-8c84-44d0-ba6d-7556ec1d02dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6817","nonce":1768219597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6819","nonce":1768219597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6823","nonce":1768219597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6821","nonce":1768219597}]},"public_addr":"172.21.15.102:6817/1768219597","cluster_addr":"172.21.15.102:6819/1768219597","heartbeat_back_addr":"172.21.15.102:6823/1768219597","heartbeat_front_addr":"172.21.15.102:6821/1768219597","state":["exists","up"]},{"osd":9,"uuid":"f2500273-8b21-4984-bc41-cec5cc0c883b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6827","nonce":973136168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6829","nonce":973136168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6833","nonce":973136168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6831","nonce":973136168}]},"public_addr":"172.21.15.33:6827/973136168","cluster_addr":"172.21.15.33:6829/973136168","heartbeat_back_addr":"172.21.15.33:6833/973136168","heartbeat_front_addr":"172.21.15.33:6831/973136168","state":["exists","up"]},{"osd":10,"uuid":"954343c5-5d5b-4c30-acde-82aa695f7b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6825","nonce":248515585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6827","nonce":248515585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6831","nonce":248515585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6829","nonce":248515585}]},"public_addr":"172.21.15.43:6825/248515585","cluster_addr":"172.21.15.43:6827/248515585","heartbeat_back_addr":"172.21.15.43:6831/248515585","heartbeat_front_addr":"172.21.15.43:6829/248515585","state":["exists","up"]},{"osd":11,"uuid":"22b4147b-02ad-4514-be17-5bb395099eef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6825","nonce":2463068013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6827","nonce":2463068013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6831","nonce":2463068013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6829","nonce":2463068013}]},"public_addr":"172.21.15.102:6825/2463068013","cluster_addr":"172.21.15.102:6827/2463068013","heartbeat_back_addr":"172.21.15.102:6831/2463068013","heartbeat_front_addr":"172.21.15.102:6829/2463068013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:19.274804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:44.900294+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:08.885404+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:34.382089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:59.978538+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:25.275179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:49.429847+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:14.974792+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:40.268629+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:22:06.458679+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:22:31.813019+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:22:56.264078+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/3187741548":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6800/1381479235":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6801/1156183797":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/2222991013":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6801/1381479235":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6800/1156183797":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/3450458842":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/202580320":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/2441151017":"2024-09-13T12:16:57.792813+0000","172.21.15.33:0/1001176884":"2024-09-13T12:16:33.559150+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:24:04.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:04.027+0000 7fbf39b6f640 1 -- 172.21.15.33:0/2977829135 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fbf200a2b80 msgr2=0x7fbf200a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:04.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:04.027+0000 7fbf39b6f640 1 --2- 172.21.15.33:0/2977829135 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fbf200a2b80 0x7fbf200a5040 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbf3406b320 tx=0x7fbf1c008040 comp rx=0 tx=0).stop 2024-09-12T12:24:04.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:04.027+0000 7fbf39b6f640 1 -- 172.21.15.33:0/2977829135 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf34100a80 msgr2=0x7fbf34199160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:04.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:04.027+0000 7fbf39b6f640 1 --2- 172.21.15.33:0/2977829135 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf34100a80 0x7fbf34199160 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbf2400c920 tx=0x7fbf2400cde0 comp rx=0 tx=0).stop 2024-09-12T12:24:04.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:04.027+0000 7fbf39b6f640 1 -- 172.21.15.33:0/2977829135 shutdown_connections 2024-09-12T12:24:04.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:04.027+0000 7fbf39b6f640 1 --2- 172.21.15.33:0/2977829135 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fbf200a2b80 0x7fbf200a5040 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:04.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:04.027+0000 7fbf39b6f640 1 --2- 172.21.15.33:0/2977829135 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf34106a80 0x7fbf341a41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:04.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:04.027+0000 7fbf39b6f640 1 --2- 172.21.15.33:0/2977829135 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf34101420 0x7fbf341996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:04.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:04.027+0000 7fbf39b6f640 1 --2- 172.21.15.33:0/2977829135 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf34100a80 0x7fbf34199160 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:04.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:04.027+0000 7fbf39b6f640 1 -- 172.21.15.33:0/2977829135 >> 172.21.15.33:0/2977829135 conn(0x7fbf340fc7a0 msgr2=0x7fbf340fcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:04.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:04.027+0000 7fbf39b6f640 1 -- 172.21.15.33:0/2977829135 shutdown_connections 2024-09-12T12:24:04.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:04.027+0000 7fbf39b6f640 1 -- 172.21.15.33:0/2977829135 wait complete. 2024-09-12T12:24:04.661 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T12:23:46.400609+0000', 'modified': '2024-09-12T12:23:55.506520+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24499}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24499': {'gid': 24499, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.102:6839/1553271340', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6838', 'nonce': 1553271340}, {'type': 'v1', 'addr': '172.21.15.102:6839', 'nonce': 1553271340}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24499, 'qdb_cluster': [24499]} 2024-09-12T12:24:04.661 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T12:24:04.661 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-12T12:24:04.917 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:05.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:04 smithi033 ceph-mon[31246]: pgmap v288: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:24:05.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:04 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/2977829135' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:24:05.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.339+0000 7f5421535640 1 -- 172.21.15.33:0/1698189221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f541c102790 msgr2=0x7f541c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:05.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.339+0000 7f5421535640 1 --2- 172.21.15.33:0/1698189221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f541c102790 0x7f541c1067e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5404009900 tx=0x7f540402a410 comp rx=0 tx=0).stop 2024-09-12T12:24:05.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.339+0000 7f5421535640 1 -- 172.21.15.33:0/1698189221 shutdown_connections 2024-09-12T12:24:05.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.339+0000 7f5421535640 1 --2- 172.21.15.33:0/1698189221 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f541c106f10 0x7f541c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.339+0000 7f5421535640 1 --2- 172.21.15.33:0/1698189221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f541c102790 0x7f541c1067e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.339+0000 7f5421535640 1 --2- 172.21.15.33:0/1698189221 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f541c101de0 0x7f541c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.339+0000 7f5421535640 1 -- 172.21.15.33:0/1698189221 >> 172.21.15.33:0/1698189221 conn(0x7f541c0fd8c0 msgr2=0x7f541c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:05.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.339+0000 7f5421535640 1 -- 172.21.15.33:0/1698189221 shutdown_connections 2024-09-12T12:24:05.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.339+0000 7f5421535640 1 -- 172.21.15.33:0/1698189221 wait complete. 2024-09-12T12:24:05.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.339+0000 7f5421535640 1 Processor -- start 2024-09-12T12:24:05.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.340+0000 7f5421535640 1 -- start start 2024-09-12T12:24:05.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.340+0000 7f5421535640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f541c101de0 0x7f541c198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:05.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.340+0000 7f5421535640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f541c102790 0x7f541c198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:05.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.340+0000 7f5421535640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f541c106f10 0x7f541c19ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:05.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.340+0000 7f5421535640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f541c111e40 con 0x7f541c106f10 2024-09-12T12:24:05.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.340+0000 7f5421535640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f541c111cc0 con 0x7f541c101de0 2024-09-12T12:24:05.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.340+0000 7f5421535640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f541c111fc0 con 0x7f541c102790 2024-09-12T12:24:05.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.340+0000 7f541b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f541c106f10 0x7f541c19ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:05.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.340+0000 7f541b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f541c106f10 0x7f541c19ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52130/0 (socket says 172.21.15.33:52130) 2024-09-12T12:24:05.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.340+0000 7f541b7fe640 1 -- 172.21.15.33:0/365456497 learned_addr learned my addr 172.21.15.33:0/365456497 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:24:05.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.340+0000 7f541affd640 1 --2- 172.21.15.33:0/365456497 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f541c101de0 0x7f541c198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:05.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.340+0000 7f541a7fc640 1 --2- 172.21.15.33:0/365456497 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f541c102790 0x7f541c198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:05.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.340+0000 7f541b7fe640 1 -- 172.21.15.33:0/365456497 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f541c102790 msgr2=0x7f541c198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:05.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.340+0000 7f541b7fe640 1 --2- 172.21.15.33:0/365456497 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f541c102790 0x7f541c198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.340+0000 7f541b7fe640 1 -- 172.21.15.33:0/365456497 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f541c101de0 msgr2=0x7f541c198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:05.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.340+0000 7f541b7fe640 1 --2- 172.21.15.33:0/365456497 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f541c101de0 0x7f541c198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.340+0000 7f541b7fe640 1 -- 172.21.15.33:0/365456497 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f541c19d3b0 con 0x7f541c106f10 2024-09-12T12:24:05.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.341+0000 7f541b7fe640 1 --2- 172.21.15.33:0/365456497 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f541c106f10 0x7f541c19ccd0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f540c00c970 tx=0x7f540c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:05.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.341+0000 7f5413fff640 1 -- 172.21.15.33:0/365456497 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f540c007bb0 con 0x7f541c106f10 2024-09-12T12:24:05.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.341+0000 7f5421535640 1 -- 172.21.15.33:0/365456497 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f541c19d6a0 con 0x7f541c106f10 2024-09-12T12:24:05.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.341+0000 7f5413fff640 1 -- 172.21.15.33:0/365456497 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f540c007d50 con 0x7f541c106f10 2024-09-12T12:24:05.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.341+0000 7f5413fff640 1 -- 172.21.15.33:0/365456497 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f540c018700 con 0x7f541c106f10 2024-09-12T12:24:05.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.341+0000 7f5421535640 1 -- 172.21.15.33:0/365456497 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f541c1a4f80 con 0x7f541c106f10 2024-09-12T12:24:05.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.343+0000 7f5413fff640 1 -- 172.21.15.33:0/365456497 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f540c00fa20 con 0x7f541c106f10 2024-09-12T12:24:05.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.343+0000 7f542390e740 1 Processor -- start 2024-09-12T12:24:05.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.343+0000 7f542390e740 1 -- start start 2024-09-12T12:24:05.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.344+0000 7f542390e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cb72fde9d0 0x55cb72fdedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:05.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.344+0000 7f542390e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cb72fdf2f0 0x55cb72fe9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:05.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.344+0000 7f542390e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb72fe9bb0 0x55cb72febfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:05.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.344+0000 7f542390e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55cb72f45090 con 0x55cb72fe9bb0 2024-09-12T12:24:05.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.344+0000 7f542390e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55cb72eeca70 con 0x55cb72fde9d0 2024-09-12T12:24:05.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.344+0000 7f542390e740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55cb72f41050 con 0x55cb72fdf2f0 2024-09-12T12:24:05.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.344+0000 7f5413fff640 1 --2- 172.21.15.33:0/365456497 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f54080a2b80 0x7f54080a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:05.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.344+0000 7f541a7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb72fe9bb0 0x55cb72febfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:05.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.344+0000 7f541affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cb72fdf2f0 0x55cb72fe9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:05.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.344+0000 7f541b7fe640 1 --2- 172.21.15.33:0/365456497 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f54080a2b80 0x7f54080a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:05.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.344+0000 7f541affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cb72fdf2f0 0x55cb72fe9670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:49146/0 (socket says 172.21.15.33:49146) 2024-09-12T12:24:05.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.344+0000 7f541a7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb72fe9bb0 0x55cb72febfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52144/0 (socket says 172.21.15.33:52144) 2024-09-12T12:24:05.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.344+0000 7f541affd640 1 -- 172.21.15.33:0/3683716059 learned_addr learned my addr 172.21.15.33:0/3683716059 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:24:05.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.344+0000 7f5413fff640 1 -- 172.21.15.33:0/365456497 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f540c0cf360 con 0x7f541c106f10 2024-09-12T12:24:05.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.344+0000 7f541a7fc640 1 --2- 172.21.15.33:0/3683716059 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cb72fde9d0 0x55cb72fdedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:05.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.344+0000 7f541affd640 1 -- 172.21.15.33:0/3683716059 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cb72fde9d0 msgr2=0x55cb72fdedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:05.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.344+0000 7f541affd640 1 --2- 172.21.15.33:0/3683716059 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cb72fde9d0 0x55cb72fdedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.344+0000 7f541affd640 1 -- 172.21.15.33:0/3683716059 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb72fe9bb0 msgr2=0x55cb72febfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:05.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.344+0000 7f541affd640 1 --2- 172.21.15.33:0/3683716059 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb72fe9bb0 0x55cb72febfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.344+0000 7f541affd640 1 -- 172.21.15.33:0/3683716059 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb72ef9130 con 0x55cb72fdf2f0 2024-09-12T12:24:05.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.344+0000 7f541a7fc640 1 --2- 172.21.15.33:0/3683716059 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cb72fde9d0 0x55cb72fdedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:24:05.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.345+0000 7f541b7fe640 1 --2- 172.21.15.33:0/365456497 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f54080a2b80 0x7f54080a5040 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f540c09b680 tx=0x7f540c090e60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:05.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.345+0000 7f541affd640 1 --2- 172.21.15.33:0/3683716059 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cb72fdf2f0 0x55cb72fe9670 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f541400a4b0 tx=0x7f54140096d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bdab42f576db8a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:05.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.345+0000 7f54117fa640 1 -- 172.21.15.33:0/3683716059 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5414018020 con 0x55cb72fdf2f0 2024-09-12T12:24:05.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.345+0000 7f54117fa640 1 -- 172.21.15.33:0/3683716059 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5414014cc0 con 0x55cb72fdf2f0 2024-09-12T12:24:05.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.345+0000 7f54117fa640 1 -- 172.21.15.33:0/3683716059 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5414013c50 con 0x55cb72fdf2f0 2024-09-12T12:24:05.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.346+0000 7f542390e740 1 -- 172.21.15.33:0/3683716059 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cb72fdf2f0 msgr2=0x55cb72fe9670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:05.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.346+0000 7f542390e740 1 --2- 172.21.15.33:0/3683716059 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cb72fdf2f0 0x55cb72fe9670 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f541400a4b0 tx=0x7f54140096d0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.346+0000 7f542390e740 1 -- 172.21.15.33:0/3683716059 shutdown_connections 2024-09-12T12:24:05.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.346+0000 7f542390e740 1 --2- 172.21.15.33:0/3683716059 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb72fe9bb0 0x55cb72febfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.346+0000 7f542390e740 1 --2- 172.21.15.33:0/3683716059 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cb72fdf2f0 0x55cb72fe9670 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.346+0000 7f542390e740 1 --2- 172.21.15.33:0/3683716059 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cb72fde9d0 0x55cb72fdedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.346+0000 7f542390e740 1 -- 172.21.15.33:0/3683716059 >> 172.21.15.33:0/3683716059 conn(0x55cb72fdaf60 msgr2=0x55cb72fdb340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:05.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.346+0000 7f542390e740 1 -- 172.21.15.33:0/3683716059 shutdown_connections 2024-09-12T12:24:05.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.346+0000 7f542390e740 1 -- 172.21.15.33:0/3683716059 wait complete. 2024-09-12T12:24:05.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.346+0000 7f542390e740 1 -- start start 2024-09-12T12:24:05.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.346+0000 7f542390e740 1 Processor -- start 2024-09-12T12:24:05.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.346+0000 7f542390e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cb72fde9d0 0x55cb72fe9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:05.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.346+0000 7f542390e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cb72fdf2f0 0x55cb72fe6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:05.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.346+0000 7f542390e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb72fe9bb0 0x55cb72fe6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:05.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.346+0000 7f542390e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55cb72fec780 con 0x55cb72fe9bb0 2024-09-12T12:24:05.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.346+0000 7f542390e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55cb72efff20 con 0x55cb72fde9d0 2024-09-12T12:24:05.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.346+0000 7f542390e740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55cb72fec900 con 0x55cb72fdf2f0 2024-09-12T12:24:05.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.347+0000 7f542390e740 10 client.0 _ll_register_callbacks cb 0x55cb72ec9030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:24:05.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.347+0000 7f541a7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb72fe9bb0 0x55cb72fe6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:05.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.347+0000 7f541a7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb72fe9bb0 0x55cb72fe6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52148/0 (socket says 172.21.15.33:52148) 2024-09-12T12:24:05.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.347+0000 7f541a7fc640 1 -- 172.21.15.33:0/3464517637 learned_addr learned my addr 172.21.15.33:0/3464517637 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:24:05.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.347+0000 7f541affd640 1 --2- 172.21.15.33:0/3464517637 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cb72fdf2f0 0x55cb72fe6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:05.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.347+0000 7f541a7fc640 1 -- 172.21.15.33:0/3464517637 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cb72fdf2f0 msgr2=0x55cb72fe6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:05.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.347+0000 7f541a7fc640 1 --2- 172.21.15.33:0/3464517637 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cb72fdf2f0 0x55cb72fe6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.347+0000 7f541a7fc640 1 -- 172.21.15.33:0/3464517637 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cb72fde9d0 msgr2=0x55cb72fe9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:05.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.347+0000 7f541a7fc640 1 --2- 172.21.15.33:0/3464517637 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cb72fde9d0 0x55cb72fe9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.347+0000 7f541a7fc640 1 -- 172.21.15.33:0/3464517637 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb72cb62b0 con 0x55cb72fe9bb0 2024-09-12T12:24:05.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.347+0000 7f541a7fc640 1 --2- 172.21.15.33:0/3464517637 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb72fe9bb0 0x55cb72fe6bc0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5404009900 tx=0x7f54040092d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50030063aa125fee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:05.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.347+0000 7f54027fc640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:24:05.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.347+0000 7f54027fc640 1 -- 172.21.15.33:0/3464517637 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5404035040 con 0x55cb72fe9bb0 2024-09-12T12:24:05.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.347+0000 7f54027fc640 1 -- 172.21.15.33:0/3464517637 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f5404031af0 con 0x55cb72fe9bb0 2024-09-12T12:24:05.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.347+0000 7f542390e740 1 -- 172.21.15.33:0/3464517637 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5414014cc0 con 0x55cb72fe9bb0 2024-09-12T12:24:05.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.347+0000 7f54027fc640 1 -- 172.21.15.33:0/3464517637 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f5404004030 con 0x55cb72fe9bb0 2024-09-12T12:24:05.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.347+0000 7f542390e740 10 client.14712 fetch_fsmap learned FSMap version 17 2024-09-12T12:24:05.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.347+0000 7f542390e740 1 -- 172.21.15.33:0/3464517637 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x55cb72ff7f60 con 0x55cb72fe9bb0 2024-09-12T12:24:05.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.348+0000 7f54027fc640 1 -- 172.21.15.33:0/3464517637 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5414014cc0 con 0x55cb72fe9bb0 2024-09-12T12:24:05.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.348+0000 7f54027fc640 1 -- 172.21.15.33:0/3464517637 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f540403a040 con 0x55cb72fe9bb0 2024-09-12T12:24:05.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.348+0000 7f542390e740 10 client.14712 fetch_fsmap finished waiting for FSMap version 17 2024-09-12T12:24:05.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.348+0000 7f542390e740 10 client.14712 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T12:24:05.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.348+0000 7f542390e740 20 client.14712 populate_metadata read hostname 'smithi033' 2024-09-12T12:24:05.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.348+0000 7f542390e740 1 --2- 172.21.15.33:0/3464517637 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55cb72ffa570 0x55cb72ffb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:05.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.348+0000 7f542390e740 4 client.14712 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:24:05.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.348+0000 7f542390e740 1 -- 172.21.15.33:0/3464517637 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cb72f52600 con 0x55cb72ffa570 2024-09-12T12:24:05.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.348+0000 7f541affd640 1 --2- 172.21.15.33:0/3464517637 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55cb72ffa570 0x55cb72ffb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:05.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.349+0000 7f541affd640 1 --2- 172.21.15.33:0/3464517637 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55cb72ffa570 0x55cb72ffb9e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7c209cf491f82b2 server_cookie=1e8c7c3ab830c9f in_seq=0 out_seq=0 2024-09-12T12:24:05.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.349+0000 7f54027fc640 10 client.14712 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:24:05.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.349+0000 7f54027fc640 1 -- 172.21.15.33:0/3464517637 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cb72f52600 con 0x55cb72ffa570 2024-09-12T12:24:05.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.349+0000 7f54027fc640 10 client.14712 handle_command_reply: tid=0 2024-09-12T12:24:05.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.349+0000 7f542390e740 1 client.14712 shutdown 2024-09-12T12:24:05.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.350+0000 7f542390e740 1 -- 172.21.15.33:0/3464517637 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb72fe9bb0 msgr2=0x55cb72fe6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:05.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.350+0000 7f542390e740 1 --2- 172.21.15.33:0/3464517637 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb72fe9bb0 0x55cb72fe6bc0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5404009900 tx=0x7f54040092d0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.350+0000 7f542390e740 1 -- 172.21.15.33:0/3464517637 shutdown_connections 2024-09-12T12:24:05.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.350+0000 7f542390e740 1 --2- 172.21.15.33:0/3464517637 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55cb72ffa570 0x55cb72ffb9e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.350+0000 7f542390e740 1 --2- 172.21.15.33:0/3464517637 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb72fe9bb0 0x55cb72fe6bc0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.350+0000 7f542390e740 1 --2- 172.21.15.33:0/3464517637 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cb72fdf2f0 0x55cb72fe6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.350+0000 7f54027fc640 0 client.14712 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:24:05.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.350+0000 7f542390e740 1 --2- 172.21.15.33:0/3464517637 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cb72fde9d0 0x55cb72fe9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.350+0000 7f542390e740 1 -- 172.21.15.33:0/3464517637 >> 172.21.15.33:0/3464517637 conn(0x55cb72fdaf60 msgr2=0x55cb72fe0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:05.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.350+0000 7f542390e740 1 -- 172.21.15.33:0/3464517637 shutdown_connections 2024-09-12T12:24:05.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.350+0000 7f542390e740 1 -- 172.21.15.33:0/3464517637 wait complete. 2024-09-12T12:24:05.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.350+0000 7f542390e740 20 client.14712 trim_cache size 0 max 16384 2024-09-12T12:24:05.372 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:04 smithi043 ceph-mon[34144]: pgmap v288: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:24:05.373 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:04 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/2977829135' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:24:05.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.368+0000 7f542390e740 1 Processor -- start 2024-09-12T12:24:05.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.368+0000 7f542390e740 1 -- start start 2024-09-12T12:24:05.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.368+0000 7f542390e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cb72fde9d0 0x55cb72ffb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:05.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.368+0000 7f542390e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb72fdf2f0 0x55cb72fe6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:05.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.368+0000 7f542390e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cb72fe9bb0 0x55cb72fe6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:05.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.368+0000 7f542390e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55cb72ff9d20 con 0x55cb72fdf2f0 2024-09-12T12:24:05.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.368+0000 7f542390e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55cb72ffa3f0 con 0x55cb72fe9bb0 2024-09-12T12:24:05.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.368+0000 7f542390e740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55cb72ffaac0 con 0x55cb72fde9d0 2024-09-12T12:24:05.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.368+0000 7f541affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb72fdf2f0 0x55cb72fe6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:05.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.368+0000 7f541affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb72fdf2f0 0x55cb72fe6640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52150/0 (socket says 172.21.15.33:52150) 2024-09-12T12:24:05.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.368+0000 7f541affd640 1 -- 172.21.15.33:0/142856879 learned_addr learned my addr 172.21.15.33:0/142856879 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:24:05.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.368+0000 7f541a7fc640 1 --2- 172.21.15.33:0/142856879 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cb72fe9bb0 0x55cb72fe6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:05.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.368+0000 7f541a7fc640 1 --2- 172.21.15.33:0/142856879 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cb72fde9d0 0x55cb72ffb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:05.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.368+0000 7f541affd640 1 -- 172.21.15.33:0/142856879 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cb72fde9d0 msgr2=0x55cb72ffb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:05.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.368+0000 7f541affd640 1 --2- 172.21.15.33:0/142856879 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cb72fde9d0 0x55cb72ffb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.368+0000 7f541affd640 1 -- 172.21.15.33:0/142856879 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cb72fe9bb0 msgr2=0x55cb72fe6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:05.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.368+0000 7f541affd640 1 --2- 172.21.15.33:0/142856879 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cb72fe9bb0 0x55cb72fe6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.368+0000 7f541affd640 1 -- 172.21.15.33:0/142856879 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb72fdad90 con 0x55cb72fdf2f0 2024-09-12T12:24:05.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.369+0000 7f541affd640 1 --2- 172.21.15.33:0/142856879 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb72fdf2f0 0x55cb72fe6640 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f541400ae00 tx=0x7f541400d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9049cb2b784e5c9f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:05.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.369+0000 7f5410ff9640 1 -- 172.21.15.33:0/142856879 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5414018040 con 0x55cb72fdf2f0 2024-09-12T12:24:05.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.369+0000 7f5410ff9640 1 -- 172.21.15.33:0/142856879 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5414009c00 con 0x55cb72fdf2f0 2024-09-12T12:24:05.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.369+0000 7f5410ff9640 1 -- 172.21.15.33:0/142856879 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5414014990 con 0x55cb72fdf2f0 2024-09-12T12:24:05.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.369+0000 7f542390e740 1 -- 172.21.15.33:0/142856879 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb72fdf2f0 msgr2=0x55cb72fe6640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:05.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.369+0000 7f542390e740 1 --2- 172.21.15.33:0/142856879 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb72fdf2f0 0x55cb72fe6640 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f541400ae00 tx=0x7f541400d040 comp rx=0 tx=0).stop 2024-09-12T12:24:05.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.370+0000 7f542390e740 1 -- 172.21.15.33:0/142856879 shutdown_connections 2024-09-12T12:24:05.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.370+0000 7f542390e740 1 --2- 172.21.15.33:0/142856879 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cb72fe9bb0 0x55cb72fe6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.370+0000 7f542390e740 1 --2- 172.21.15.33:0/142856879 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb72fdf2f0 0x55cb72fe6640 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.370+0000 7f542390e740 1 --2- 172.21.15.33:0/142856879 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cb72fde9d0 0x55cb72ffb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.370+0000 7f542390e740 1 -- 172.21.15.33:0/142856879 >> 172.21.15.33:0/142856879 conn(0x55cb72fdaf60 msgr2=0x55cb72fdb340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:05.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.370+0000 7f542390e740 1 -- 172.21.15.33:0/142856879 shutdown_connections 2024-09-12T12:24:05.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.370+0000 7f542390e740 1 -- 172.21.15.33:0/142856879 wait complete. 2024-09-12T12:24:05.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.370+0000 7f542390e740 1 -- start start 2024-09-12T12:24:05.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.370+0000 7f542390e740 1 Processor -- start 2024-09-12T12:24:05.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.370+0000 7f542390e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb72fde9d0 0x55cb73003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:05.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.370+0000 7f542390e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cb72fdf2f0 0x55cb730044c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:05.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.370+0000 7f542390e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cb72fe9bb0 0x55cb72ffd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:05.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.370+0000 7f542390e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55cb72ffb860 con 0x55cb72fde9d0 2024-09-12T12:24:05.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.370+0000 7f542390e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55cb72ffb190 con 0x55cb72fe9bb0 2024-09-12T12:24:05.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.370+0000 7f542390e740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55cb72ffbf30 con 0x55cb72fdf2f0 2024-09-12T12:24:05.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.370+0000 7f542390e740 10 client.0 _ll_register_callbacks cb 0x7f5404032e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:24:05.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.370+0000 7f541a7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb72fde9d0 0x55cb73003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:05.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.370+0000 7f541a7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb72fde9d0 0x55cb73003f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52166/0 (socket says 172.21.15.33:52166) 2024-09-12T12:24:05.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.370+0000 7f541a7fc640 1 -- 172.21.15.33:0/2757635247 learned_addr learned my addr 172.21.15.33:0/2757635247 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:24:05.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.371+0000 7f541affd640 1 --2- 172.21.15.33:0/2757635247 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cb72fdf2f0 0x55cb730044c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:05.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.371+0000 7f541a7fc640 1 --2- 172.21.15.33:0/2757635247 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cb72fe9bb0 0x55cb72ffd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:05.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.371+0000 7f541a7fc640 1 -- 172.21.15.33:0/2757635247 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cb72fdf2f0 msgr2=0x55cb730044c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:05.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.371+0000 7f541a7fc640 1 --2- 172.21.15.33:0/2757635247 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cb72fdf2f0 0x55cb730044c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.371+0000 7f541a7fc640 1 -- 172.21.15.33:0/2757635247 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cb72fe9bb0 msgr2=0x55cb72ffd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:05.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.371+0000 7f541a7fc640 1 --2- 172.21.15.33:0/2757635247 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cb72fe9bb0 0x55cb72ffd330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.371+0000 7f541a7fc640 1 -- 172.21.15.33:0/2757635247 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb72ffdb60 con 0x55cb72fde9d0 2024-09-12T12:24:05.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.371+0000 7f541a7fc640 1 --2- 172.21.15.33:0/2757635247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb72fde9d0 0x55cb73003f80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5404009340 tx=0x7f5404032b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eecc64e99ed27ce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:05.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.371+0000 7f54027fc640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:24:05.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.371+0000 7f54027fc640 1 -- 172.21.15.33:0/2757635247 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5404035040 con 0x55cb72fde9d0 2024-09-12T12:24:05.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.371+0000 7f54027fc640 1 -- 172.21.15.33:0/2757635247 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f5404031aa0 con 0x55cb72fde9d0 2024-09-12T12:24:05.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.371+0000 7f542390e740 1 -- 172.21.15.33:0/2757635247 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5414009c00 con 0x55cb72fde9d0 2024-09-12T12:24:05.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.371+0000 7f54027fc640 1 -- 172.21.15.33:0/2757635247 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f5404031ca0 con 0x55cb72fde9d0 2024-09-12T12:24:05.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.371+0000 7f542390e740 10 client.14718 fetch_fsmap learned FSMap version 17 2024-09-12T12:24:05.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.371+0000 7f542390e740 1 -- 172.21.15.33:0/2757635247 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x55cb73002640 con 0x55cb72fde9d0 2024-09-12T12:24:05.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.371+0000 7f54027fc640 1 -- 172.21.15.33:0/2757635247 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5414009c00 con 0x55cb72fde9d0 2024-09-12T12:24:05.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.372+0000 7f54027fc640 1 -- 172.21.15.33:0/2757635247 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f54040047a0 con 0x55cb72fde9d0 2024-09-12T12:24:05.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.372+0000 7f542390e740 10 client.14718 fetch_fsmap finished waiting for FSMap version 17 2024-09-12T12:24:05.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.372+0000 7f542390e740 10 client.14718 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T12:24:05.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.372+0000 7f542390e740 20 client.14718 populate_metadata read hostname 'smithi033' 2024-09-12T12:24:05.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.372+0000 7f542390e740 1 --2- 172.21.15.33:0/2757635247 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55cb730693e0 0x55cb730680f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:05.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.372+0000 7f542390e740 4 client.14718 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:24:05.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.372+0000 7f542390e740 1 -- 172.21.15.33:0/2757635247 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "status"}) -- 0x55cb72f4cb10 con 0x55cb730693e0 2024-09-12T12:24:05.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.372+0000 7f541affd640 1 --2- 172.21.15.33:0/2757635247 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55cb730693e0 0x55cb730680f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:05.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.372+0000 7f541affd640 1 --2- 172.21.15.33:0/2757635247 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55cb730693e0 0x55cb730680f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eeb0338c29535170 server_cookie=13165857f3aae6ab in_seq=0 out_seq=0 2024-09-12T12:24:05.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.372+0000 7f54027fc640 10 client.14718 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:24:05.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.373+0000 7f54027fc640 1 -- 172.21.15.33:0/2757635247 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55cb72f4cb10 con 0x55cb730693e0 2024-09-12T12:24:05.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.373+0000 7f54027fc640 10 client.14718 handle_command_reply: tid=0 2024-09-12T12:24:05.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.373+0000 7f542390e740 1 client.14718 shutdown 2024-09-12T12:24:05.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.373+0000 7f542390e740 1 -- 172.21.15.33:0/2757635247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb72fde9d0 msgr2=0x55cb73003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:05.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.373+0000 7f542390e740 1 --2- 172.21.15.33:0/2757635247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb72fde9d0 0x55cb73003f80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5404009340 tx=0x7f5404032b80 comp rx=0 tx=0).stop 2024-09-12T12:24:05.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.373+0000 7f542390e740 1 -- 172.21.15.33:0/2757635247 shutdown_connections 2024-09-12T12:24:05.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.373+0000 7f542390e740 1 --2- 172.21.15.33:0/2757635247 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55cb730693e0 0x55cb730680f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.373+0000 7f542390e740 1 --2- 172.21.15.33:0/2757635247 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cb72fe9bb0 0x55cb72ffd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.373+0000 7f542390e740 1 --2- 172.21.15.33:0/2757635247 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cb72fdf2f0 0x55cb730044c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.373+0000 7f542390e740 1 --2- 172.21.15.33:0/2757635247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb72fde9d0 0x55cb73003f80 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.373+0000 7f542390e740 1 -- 172.21.15.33:0/2757635247 >> 172.21.15.33:0/2757635247 conn(0x55cb72fdaf60 msgr2=0x55cb72fe6640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:05.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.373+0000 7f54027fc640 0 client.14718 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:24:05.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.373+0000 7f542390e740 1 -- 172.21.15.33:0/2757635247 shutdown_connections 2024-09-12T12:24:05.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.373+0000 7f542390e740 1 -- 172.21.15.33:0/2757635247 wait complete. 2024-09-12T12:24:05.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.373+0000 7f542390e740 20 client.14718 trim_cache size 0 max 16384 2024-09-12T12:24:05.384 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:24:05.384 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "a66dfafc-7100-11ef-bcea-c7b262605968", 2024-09-12T12:24:05.384 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 0, 2024-09-12T12:24:05.384 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 24499, 2024-09-12T12:24:05.384 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-09-12T12:24:05.384 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-09-12T12:24:05.384 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-09-12T12:24:05.384 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 18.505557158999999, 2024-09-12T12:24:05.384 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 17, 2024-09-12T12:24:05.385 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 85, 2024-09-12T12:24:05.385 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 85, 2024-09-12T12:24:05.385 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 37.829039385999998 2024-09-12T12:24:05.385 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:24:05.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.373+0000 7f5421535640 1 -- 172.21.15.33:0/365456497 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f54080a2b80 msgr2=0x7f54080a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:05.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.373+0000 7f5421535640 1 --2- 172.21.15.33:0/365456497 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f54080a2b80 0x7f54080a5040 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f540c09b680 tx=0x7f540c090e60 comp rx=0 tx=0).stop 2024-09-12T12:24:05.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.374+0000 7f5421535640 1 -- 172.21.15.33:0/365456497 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f541c106f10 msgr2=0x7f541c19ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:05.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.374+0000 7f5421535640 1 --2- 172.21.15.33:0/365456497 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f541c106f10 0x7f541c19ccd0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f540c00c970 tx=0x7f540c00ce30 comp rx=0 tx=0).stop 2024-09-12T12:24:05.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.374+0000 7f5421535640 1 -- 172.21.15.33:0/365456497 shutdown_connections 2024-09-12T12:24:05.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.374+0000 7f5421535640 1 --2- 172.21.15.33:0/365456497 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f54080a2b80 0x7f54080a5040 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.374+0000 7f5421535640 1 --2- 172.21.15.33:0/365456497 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f541c106f10 0x7f541c19ccd0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.374+0000 7f5421535640 1 --2- 172.21.15.33:0/365456497 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f541c102790 0x7f541c198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.374+0000 7f5421535640 1 --2- 172.21.15.33:0/365456497 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f541c101de0 0x7f541c198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.374+0000 7f5421535640 1 -- 172.21.15.33:0/365456497 >> 172.21.15.33:0/365456497 conn(0x7f541c0fd8c0 msgr2=0x7f541c0fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:05.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.374+0000 7f5421535640 1 -- 172.21.15.33:0/365456497 shutdown_connections 2024-09-12T12:24:05.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:05.374+0000 7f5421535640 1 -- 172.21.15.33:0/365456497 wait complete. 2024-09-12T12:24:05.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:04 smithi102 ceph-mon[34799]: pgmap v288: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:24:05.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:04 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/2977829135' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:24:06.104 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T12:24:06.104 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-12T12:24:06.104 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-12T12:24:06.360 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:06.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:06.843+0000 7efc985b5640 1 -- 172.21.15.33:0/545656407 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc90102d40 msgr2=0x7efc90103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:06.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:06.843+0000 7efc985b5640 1 --2- 172.21.15.33:0/545656407 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc90102d40 0x7efc90103120 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7efc8c009900 tx=0x7efc8c02a480 comp rx=0 tx=0).stop 2024-09-12T12:24:06.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:06.843+0000 7efc985b5640 1 -- 172.21.15.33:0/545656407 shutdown_connections 2024-09-12T12:24:06.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:06.843+0000 7efc985b5640 1 --2- 172.21.15.33:0/545656407 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc9010c170 0x7efc9010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:06.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:06.843+0000 7efc985b5640 1 --2- 172.21.15.33:0/545656407 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc90103660 0x7efc9010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:06.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:06.843+0000 7efc985b5640 1 --2- 172.21.15.33:0/545656407 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc90102d40 0x7efc90103120 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:06.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:06.843+0000 7efc985b5640 1 -- 172.21.15.33:0/545656407 >> 172.21.15.33:0/545656407 conn(0x7efc900fc7a0 msgr2=0x7efc900febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:06.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:06.844+0000 7efc985b5640 1 -- 172.21.15.33:0/545656407 shutdown_connections 2024-09-12T12:24:06.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:06.844+0000 7efc985b5640 1 -- 172.21.15.33:0/545656407 wait complete. 2024-09-12T12:24:06.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:06.844+0000 7efc985b5640 1 Processor -- start 2024-09-12T12:24:06.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:06.844+0000 7efc985b5640 1 -- start start 2024-09-12T12:24:06.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:06.845+0000 7efc985b5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc90102d40 0x7efc90198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:06.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:06.845+0000 7efc985b5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc90103660 0x7efc90198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:06.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:06.845+0000 7efc985b5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc9010c170 0x7efc9019ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:06.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:06.845+0000 7efc985b5640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7efc90111e20 con 0x7efc9010c170 2024-09-12T12:24:06.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:06.845+0000 7efc985b5640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7efc90111ca0 con 0x7efc90102d40 2024-09-12T12:24:06.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:06.845+0000 7efc985b5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7efc90111fa0 con 0x7efc90103660 2024-09-12T12:24:06.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:06.845+0000 7efc96b52640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc9010c170 0x7efc9019ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:06.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:06.845+0000 7efc96b52640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc9010c170 0x7efc9019ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52186/0 (socket says 172.21.15.33:52186) 2024-09-12T12:24:06.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:06.845+0000 7efc96b52640 1 -- 172.21.15.33:0/3571192223 learned_addr learned my addr 172.21.15.33:0/3571192223 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:24:06.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:06.845+0000 7efc96351640 1 --2- 172.21.15.33:0/3571192223 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc90102d40 0x7efc90198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:06.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:06.845+0000 7efc95b50640 1 --2- 172.21.15.33:0/3571192223 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc90103660 0x7efc90198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:06.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:06.845+0000 7efc96b52640 1 -- 172.21.15.33:0/3571192223 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc90103660 msgr2=0x7efc90198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:06.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:06.845+0000 7efc96b52640 1 --2- 172.21.15.33:0/3571192223 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc90103660 0x7efc90198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:06.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:06.845+0000 7efc96b52640 1 -- 172.21.15.33:0/3571192223 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc90102d40 msgr2=0x7efc90198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:06.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:06.845+0000 7efc96b52640 1 --2- 172.21.15.33:0/3571192223 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc90102d40 0x7efc90198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:06.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:06.845+0000 7efc96b52640 1 -- 172.21.15.33:0/3571192223 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc9019d3b0 con 0x7efc9010c170 2024-09-12T12:24:06.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:06.845+0000 7efc95b50640 1 --2- 172.21.15.33:0/3571192223 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc90103660 0x7efc90198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:24:06.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:06.845+0000 7efc96b52640 1 --2- 172.21.15.33:0/3571192223 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc9010c170 0x7efc9019ccd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7efc8800eb10 tx=0x7efc8800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:06.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:06.845+0000 7efc877fe640 1 -- 172.21.15.33:0/3571192223 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc88004b20 con 0x7efc9010c170 2024-09-12T12:24:06.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:06.846+0000 7efc877fe640 1 -- 172.21.15.33:0/3571192223 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efc88004cc0 con 0x7efc9010c170 2024-09-12T12:24:06.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:06.846+0000 7efc985b5640 1 -- 172.21.15.33:0/3571192223 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc9019d6a0 con 0x7efc9010c170 2024-09-12T12:24:06.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:06.846+0000 7efc877fe640 1 -- 172.21.15.33:0/3571192223 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc88010690 con 0x7efc9010c170 2024-09-12T12:24:06.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:06.846+0000 7efc985b5640 1 -- 172.21.15.33:0/3571192223 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc901a4f80 con 0x7efc9010c170 2024-09-12T12:24:06.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:06.847+0000 7efc985b5640 1 -- 172.21.15.33:0/3571192223 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc90103120 con 0x7efc9010c170 2024-09-12T12:24:06.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:06.848+0000 7efc877fe640 1 -- 172.21.15.33:0/3571192223 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7efc88005000 con 0x7efc9010c170 2024-09-12T12:24:06.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:06.849+0000 7efc877fe640 1 --2- 172.21.15.33:0/3571192223 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7efc7c0a2b80 0x7efc7c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:06.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:06.849+0000 7efc96351640 1 --2- 172.21.15.33:0/3571192223 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7efc7c0a2b80 0x7efc7c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:06.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:06.849+0000 7efc877fe640 1 -- 172.21.15.33:0/3571192223 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7efc880cfd40 con 0x7efc9010c170 2024-09-12T12:24:06.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:06.849+0000 7efc96351640 1 --2- 172.21.15.33:0/3571192223 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7efc7c0a2b80 0x7efc7c0a5040 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efc8c031440 tx=0x7efc8c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:06.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:06.852+0000 7efc877fe640 1 -- 172.21.15.33:0/3571192223 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efc8809ca00 con 0x7efc9010c170 2024-09-12T12:24:07.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:07.066+0000 7efc985b5640 1 -- 172.21.15.33:0/3571192223 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7efc90106c80 con 0x7efc9010c170 2024-09-12T12:24:07.068 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:06 smithi033 ceph-mon[31246]: pgmap v289: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:24:07.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:07.067+0000 7efc877fe640 1 -- 172.21.15.33:0/3571192223 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7efc8809c300 con 0x7efc9010c170 2024-09-12T12:24:07.068 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-12T12:24:07.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:07.070+0000 7efc985b5640 1 -- 172.21.15.33:0/3571192223 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7efc7c0a2b80 msgr2=0x7efc7c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:07.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:07.070+0000 7efc985b5640 1 --2- 172.21.15.33:0/3571192223 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7efc7c0a2b80 0x7efc7c0a5040 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efc8c031440 tx=0x7efc8c005b50 comp rx=0 tx=0).stop 2024-09-12T12:24:07.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:07.070+0000 7efc985b5640 1 -- 172.21.15.33:0/3571192223 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc9010c170 msgr2=0x7efc9019ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:07.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:07.070+0000 7efc985b5640 1 --2- 172.21.15.33:0/3571192223 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc9010c170 0x7efc9019ccd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7efc8800eb10 tx=0x7efc8800c2d0 comp rx=0 tx=0).stop 2024-09-12T12:24:07.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:07.070+0000 7efc985b5640 1 -- 172.21.15.33:0/3571192223 shutdown_connections 2024-09-12T12:24:07.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:07.070+0000 7efc985b5640 1 --2- 172.21.15.33:0/3571192223 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7efc7c0a2b80 0x7efc7c0a5040 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:07.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:07.070+0000 7efc985b5640 1 --2- 172.21.15.33:0/3571192223 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc9010c170 0x7efc9019ccd0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:07.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:07.070+0000 7efc985b5640 1 --2- 172.21.15.33:0/3571192223 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc90103660 0x7efc90198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:07.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:07.070+0000 7efc985b5640 1 --2- 172.21.15.33:0/3571192223 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc90102d40 0x7efc90198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:07.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:07.070+0000 7efc985b5640 1 -- 172.21.15.33:0/3571192223 >> 172.21.15.33:0/3571192223 conn(0x7efc900fc7a0 msgr2=0x7efc900fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:07.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:07.070+0000 7efc985b5640 1 -- 172.21.15.33:0/3571192223 shutdown_connections 2024-09-12T12:24:07.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:07.070+0000 7efc985b5640 1 -- 172.21.15.33:0/3571192223 wait complete. 2024-09-12T12:24:07.183 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:06 smithi043 ceph-mon[34144]: pgmap v289: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:24:07.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:06 smithi102 ceph-mon[34799]: pgmap v289: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:24:07.781 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T12:24:07.781 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T12:24:07.781 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi033.front.sepia.ceph.com 2024-09-12T12:24:07.781 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-12T12:24:07.781 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-12T12:24:07.781 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T12:24:07.781 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T12:24:07.781 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T12:24:07.782 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-12T12:24:07.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:24:07.782 DEBUG:teuthology.orchestra.run.smithi033:> ip addr 2024-09-12T12:24:07.799 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T12:24:07.799 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T12:24:07.799 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T12:24:07.799 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:24:07.799 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2024-09-12T12:24:07.799 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:24:07.800 INFO:teuthology.orchestra.run.smithi033.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T12:24:07.800 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:14 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:24:07.800 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f0 2024-09-12T12:24:07.800 INFO:teuthology.orchestra.run.smithi033.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T12:24:07.800 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:15 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:24:07.800 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f1 2024-09-12T12:24:07.800 INFO:teuthology.orchestra.run.smithi033.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T12:24:07.800 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:94 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:24:07.800 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f0 2024-09-12T12:24:07.800 INFO:teuthology.orchestra.run.smithi033.stdout: inet 172.21.15.33/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T12:24:07.800 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft 42261sec preferred_lft 42261sec 2024-09-12T12:24:07.800 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::ae1f:6bff:fea5:d294/64 scope link 2024-09-12T12:24:07.801 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:24:07.801 INFO:teuthology.orchestra.run.smithi033.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T12:24:07.801 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:95 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:24:07.801 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f1 2024-09-12T12:24:07.802 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T12:24:07.802 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:24:07.802 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-09-12T12:24:07.802 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link add name ceph-brx type bridge 2024-09-12T12:24:07.802 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip addr flush dev ceph-brx 2024-09-12T12:24:07.802 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set ceph-brx up 2024-09-12T12:24:07.802 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T12:24:07.802 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-09-12T12:24:07.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:24:07.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:24:08.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:24:08.004 DEBUG:teuthology.orchestra.run.smithi033:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T12:24:08.030 INFO:teuthology.orchestra.run.smithi033.stdout:1 2024-09-12T12:24:08.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:24:08.031 DEBUG:teuthology.orchestra.run.smithi033:> route 2024-09-12T12:24:08.098 INFO:teuthology.orchestra.run.smithi033.stdout:Kernel IP routing table 2024-09-12T12:24:08.098 INFO:teuthology.orchestra.run.smithi033.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T12:24:08.098 INFO:teuthology.orchestra.run.smithi033.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T12:24:08.098 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T12:24:08.098 INFO:teuthology.orchestra.run.smithi033.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T12:24:08.099 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:24:08.099 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-09-12T12:24:08.099 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T12:24:08.099 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T12:24:08.099 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T12:24:08.099 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-09-12T12:24:08.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:24:08.197 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:07 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/3571192223' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T12:24:08.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:07 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/3571192223' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T12:24:08.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:24:08.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:24:08.394 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-09-12T12:24:08.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:07 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/3571192223' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T12:24:08.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:24:08.411 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list-id 2024-09-12T12:24:08.469 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:24:08.469 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-09-12T12:24:08.470 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T12:24:08.470 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-12T12:24:08.470 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-09-12T12:24:08.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:24:08.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:24:08.590 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-12T12:24:08.590 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:24:08.590 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-09-12T12:24:08.590 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-12T12:24:08.590 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T12:24:08.591 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-12T12:24:08.591 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-12T12:24:08.591 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-12T12:24:08.591 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-09-12T12:24:08.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:24:08.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:24:08.721 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:24:08.721 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-09-12T12:24:08.721 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set brx.0 up 2024-09-12T12:24:08.721 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T12:24:08.721 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-09-12T12:24:08.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:24:08.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:24:08.801 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-12T12:24:08.802 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:24:08.802 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-12T12:24:08.818 INFO:teuthology.orchestra.run.smithi033.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-12T12:24:08.818 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:24:08.818 DEBUG:teuthology.orchestra.run.smithi033:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-12T12:24:08.873 DEBUG:teuthology.orchestra.run.smithi033:> sudo modprobe fuse 2024-09-12T12:24:08.942 DEBUG:teuthology.orchestra.run.smithi033:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T12:24:08.999 INFO:teuthology.orchestra.run.smithi033.stdout:/proc 2024-09-12T12:24:08.999 INFO:teuthology.orchestra.run.smithi033.stdout:/sys 2024-09-12T12:24:08.999 INFO:teuthology.orchestra.run.smithi033.stdout:/dev 2024-09-12T12:24:08.999 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/kernel/security 2024-09-12T12:24:08.999 INFO:teuthology.orchestra.run.smithi033.stdout:/dev/shm 2024-09-12T12:24:08.999 INFO:teuthology.orchestra.run.smithi033.stdout:/dev/pts 2024-09-12T12:24:08.999 INFO:teuthology.orchestra.run.smithi033.stdout:/run 2024-09-12T12:24:08.999 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/cgroup 2024-09-12T12:24:08.999 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/pstore 2024-09-12T12:24:09.000 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/bpf 2024-09-12T12:24:09.000 INFO:teuthology.orchestra.run.smithi033.stdout:/ 2024-09-12T12:24:09.000 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/selinux 2024-09-12T12:24:09.000 INFO:teuthology.orchestra.run.smithi033.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T12:24:09.000 INFO:teuthology.orchestra.run.smithi033.stdout:/dev/hugepages 2024-09-12T12:24:09.000 INFO:teuthology.orchestra.run.smithi033.stdout:/dev/mqueue 2024-09-12T12:24:09.000 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/kernel/debug 2024-09-12T12:24:09.000 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/kernel/tracing 2024-09-12T12:24:09.000 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/fuse/connections 2024-09-12T12:24:09.000 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/kernel/config 2024-09-12T12:24:09.000 INFO:teuthology.orchestra.run.smithi033.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T12:24:09.000 INFO:teuthology.orchestra.run.smithi033.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T12:24:09.001 INFO:teuthology.orchestra.run.smithi033.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T12:24:09.001 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T12:24:09.001 INFO:teuthology.orchestra.run.smithi033.stdout:/run/user/1000 2024-09-12T12:24:09.001 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/ceph 2024-09-12T12:24:09.001 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay 2024-09-12T12:24:09.001 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/ee80439439c45bbd70e749e4424b97d228d5f9ba418e775fd242ab76c07ed138/merged 2024-09-12T12:24:09.001 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/c170c298076ba730b646470b0bb4b7812a553d4de051ad1daa5b0a7c258babde/merged 2024-09-12T12:24:09.001 INFO:teuthology.orchestra.run.smithi033.stdout:/run/user/0 2024-09-12T12:24:09.001 INFO:teuthology.orchestra.run.smithi033.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T12:24:09.001 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/b6ef5035f596b267e1c999884681c274b78fddc18c5aecd5ef29a0df83d12fc8/merged 2024-09-12T12:24:09.001 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/5a9adec0f3f3fe749f2411e749d1db42e4a43b300f7194edf1d66e5d0f7ba96f/merged 2024-09-12T12:24:09.001 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/d70cc9fb7e4bdf2458cbdefb633790a65e2fc3af271a9627052c29331d178435/merged 2024-09-12T12:24:09.001 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/f90205c1b6494802b97699d2aa2ba541c2f5f2e2aabf2a13b290527d992c03d0/merged 2024-09-12T12:24:09.001 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/bca91607499a3ef272b96cf28b398108702c8a738e4f632b88fd8d254186e81b/merged 2024-09-12T12:24:09.002 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/f1728d7a2e3ac8941a5bee48837c10fc1b359af4fa976d312dc5af85c36d60a8/merged 2024-09-12T12:24:09.002 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/f273e778d1fd2f3896ff716f2bf13da7d1f3a1c2f704dbe81c85e2da288c47ce/merged 2024-09-12T12:24:09.002 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/bc89fe647ab425f8afc56013ef9dbc384eff5ecc2ceacc679d9562df82bd4b6f/merged 2024-09-12T12:24:09.002 INFO:teuthology.orchestra.run.smithi033.stdout:/run/netns 2024-09-12T12:24:09.002 INFO:teuthology.orchestra.run.smithi033.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T12:24:09.002 INFO:teuthology.orchestra.run.smithi033.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T12:24:09.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:24:09.002 DEBUG:teuthology.orchestra.run.smithi033:> ls /sys/fs/fuse/connections 2024-09-12T12:24:09.056 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-12T12:24:09.056 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-12T12:24:09.098 DEBUG:teuthology.orchestra.run.smithi033:> sudo modprobe fuse 2024-09-12T12:24:09.124 DEBUG:teuthology.orchestra.run.smithi033:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T12:24:09.180 INFO:teuthology.orchestra.run.smithi033.stdout:/proc 2024-09-12T12:24:09.180 INFO:teuthology.orchestra.run.smithi033.stdout:/sys 2024-09-12T12:24:09.181 INFO:teuthology.orchestra.run.smithi033.stdout:/dev 2024-09-12T12:24:09.181 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/kernel/security 2024-09-12T12:24:09.181 INFO:teuthology.orchestra.run.smithi033.stdout:/dev/shm 2024-09-12T12:24:09.181 INFO:teuthology.orchestra.run.smithi033.stdout:/dev/pts 2024-09-12T12:24:09.181 INFO:teuthology.orchestra.run.smithi033.stdout:/run 2024-09-12T12:24:09.181 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/cgroup 2024-09-12T12:24:09.181 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/pstore 2024-09-12T12:24:09.181 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/bpf 2024-09-12T12:24:09.182 INFO:teuthology.orchestra.run.smithi033.stdout:/ 2024-09-12T12:24:09.182 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/selinux 2024-09-12T12:24:09.182 INFO:teuthology.orchestra.run.smithi033.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T12:24:09.182 INFO:teuthology.orchestra.run.smithi033.stdout:/dev/hugepages 2024-09-12T12:24:09.182 INFO:teuthology.orchestra.run.smithi033.stdout:/dev/mqueue 2024-09-12T12:24:09.182 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/kernel/debug 2024-09-12T12:24:09.182 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/kernel/tracing 2024-09-12T12:24:09.182 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/fuse/connections 2024-09-12T12:24:09.182 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/kernel/config 2024-09-12T12:24:09.182 INFO:teuthology.orchestra.run.smithi033.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T12:24:09.182 INFO:teuthology.orchestra.run.smithi033.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T12:24:09.182 INFO:teuthology.orchestra.run.smithi033.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T12:24:09.182 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T12:24:09.183 INFO:teuthology.orchestra.run.smithi033.stdout:/run/user/1000 2024-09-12T12:24:09.183 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/ceph 2024-09-12T12:24:09.183 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay 2024-09-12T12:24:09.183 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/ee80439439c45bbd70e749e4424b97d228d5f9ba418e775fd242ab76c07ed138/merged 2024-09-12T12:24:09.183 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/c170c298076ba730b646470b0bb4b7812a553d4de051ad1daa5b0a7c258babde/merged 2024-09-12T12:24:09.183 INFO:teuthology.orchestra.run.smithi033.stdout:/run/user/0 2024-09-12T12:24:09.183 INFO:teuthology.orchestra.run.smithi033.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T12:24:09.183 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/b6ef5035f596b267e1c999884681c274b78fddc18c5aecd5ef29a0df83d12fc8/merged 2024-09-12T12:24:09.183 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/5a9adec0f3f3fe749f2411e749d1db42e4a43b300f7194edf1d66e5d0f7ba96f/merged 2024-09-12T12:24:09.183 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/d70cc9fb7e4bdf2458cbdefb633790a65e2fc3af271a9627052c29331d178435/merged 2024-09-12T12:24:09.183 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/f90205c1b6494802b97699d2aa2ba541c2f5f2e2aabf2a13b290527d992c03d0/merged 2024-09-12T12:24:09.183 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/bca91607499a3ef272b96cf28b398108702c8a738e4f632b88fd8d254186e81b/merged 2024-09-12T12:24:09.183 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/f1728d7a2e3ac8941a5bee48837c10fc1b359af4fa976d312dc5af85c36d60a8/merged 2024-09-12T12:24:09.183 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/f273e778d1fd2f3896ff716f2bf13da7d1f3a1c2f704dbe81c85e2da288c47ce/merged 2024-09-12T12:24:09.184 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/bc89fe647ab425f8afc56013ef9dbc384eff5ecc2ceacc679d9562df82bd4b6f/merged 2024-09-12T12:24:09.184 INFO:teuthology.orchestra.run.smithi033.stdout:/run/netns 2024-09-12T12:24:09.184 INFO:teuthology.orchestra.run.smithi033.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T12:24:09.184 INFO:teuthology.orchestra.run.smithi033.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T12:24:09.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:24:09.184 DEBUG:teuthology.orchestra.run.smithi033:> ls /sys/fs/fuse/connections 2024-09-12T12:24:09.207 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi033.stderr:2024-09-12T12:24:09.206+0000 7f426b8d3480 -1 init, newargv = 0x56288d4f0af0 newargc=15 2024-09-12T12:24:09.207 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi033.stderr:ceph-fuse[75859]: starting ceph client 2024-09-12T12:24:09.213 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi033.stderr:ceph-fuse[75859]: starting fuse 2024-09-12T12:24:09.223 INFO:teuthology.orchestra.run.smithi033.stdout:120 2024-09-12T12:24:09.223 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-12T12:24:09.224 DEBUG:teuthology.orchestra.run.smithi033:> sudo stdin-killer -- python3 -c ' 2024-09-12T12:24:09.224 DEBUG:teuthology.orchestra.run.smithi033:> import glob 2024-09-12T12:24:09.224 DEBUG:teuthology.orchestra.run.smithi033:> import re 2024-09-12T12:24:09.224 DEBUG:teuthology.orchestra.run.smithi033:> import os 2024-09-12T12:24:09.224 DEBUG:teuthology.orchestra.run.smithi033:> import subprocess 2024-09-12T12:24:09.224 DEBUG:teuthology.orchestra.run.smithi033:> 2024-09-12T12:24:09.224 DEBUG:teuthology.orchestra.run.smithi033:> def _find_admin_socket(client_name): 2024-09-12T12:24:09.224 DEBUG:teuthology.orchestra.run.smithi033:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-12T12:24:09.224 DEBUG:teuthology.orchestra.run.smithi033:> files = glob.glob(asok_path) 2024-09-12T12:24:09.224 DEBUG:teuthology.orchestra.run.smithi033:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-12T12:24:09.224 DEBUG:teuthology.orchestra.run.smithi033:> 2024-09-12T12:24:09.224 DEBUG:teuthology.orchestra.run.smithi033:> # Given a non-glob path, it better be there 2024-09-12T12:24:09.225 DEBUG:teuthology.orchestra.run.smithi033:> if "*" not in asok_path: 2024-09-12T12:24:09.225 DEBUG:teuthology.orchestra.run.smithi033:> assert(len(files) == 1) 2024-09-12T12:24:09.225 DEBUG:teuthology.orchestra.run.smithi033:> return files[0] 2024-09-12T12:24:09.225 DEBUG:teuthology.orchestra.run.smithi033:> 2024-09-12T12:24:09.225 DEBUG:teuthology.orchestra.run.smithi033:> for f in files: 2024-09-12T12:24:09.225 DEBUG:teuthology.orchestra.run.smithi033:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T12:24:09.225 DEBUG:teuthology.orchestra.run.smithi033:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T12:24:09.225 DEBUG:teuthology.orchestra.run.smithi033:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T12:24:09.225 DEBUG:teuthology.orchestra.run.smithi033:> contents = proc_f.read() 2024-09-12T12:24:09.225 DEBUG:teuthology.orchestra.run.smithi033:> if mountpoint in contents: 2024-09-12T12:24:09.225 DEBUG:teuthology.orchestra.run.smithi033:> return f 2024-09-12T12:24:09.225 DEBUG:teuthology.orchestra.run.smithi033:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T12:24:09.225 DEBUG:teuthology.orchestra.run.smithi033:> 2024-09-12T12:24:09.226 DEBUG:teuthology.orchestra.run.smithi033:> print(_find_admin_socket("client.admin")) 2024-09-12T12:24:09.226 DEBUG:teuthology.orchestra.run.smithi033:> ' 2024-09-12T12:24:09.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:08 smithi033 ceph-mon[31246]: pgmap v290: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:24:09.298 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:08 smithi102 ceph-mon[34799]: pgmap v290: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:24:09.312 INFO:teuthology.orchestra.run.smithi033.stdout:/var/run/ceph/ceph-client.admin.75859.asok 2024-09-12T12:24:09.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:24:09.323 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.75859.asok 2024-09-12T12:24:09.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:24:09.323 DEBUG:teuthology.orchestra.run.smithi033:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.75859.asok status 2024-09-12T12:24:09.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:08 smithi043 ceph-mon[34144]: pgmap v290: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:24:09.462 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:24:09.462 INFO:teuthology.orchestra.run.smithi033.stdout: "metadata": { 2024-09-12T12:24:09.462 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T12:24:09.462 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T12:24:09.462 INFO:teuthology.orchestra.run.smithi033.stdout: "entity_id": "admin", 2024-09-12T12:24:09.462 INFO:teuthology.orchestra.run.smithi033.stdout: "hostname": "smithi033", 2024-09-12T12:24:09.463 INFO:teuthology.orchestra.run.smithi033.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-12T12:24:09.463 INFO:teuthology.orchestra.run.smithi033.stdout: "pid": "75859", 2024-09-12T12:24:09.463 INFO:teuthology.orchestra.run.smithi033.stdout: "root": "/" 2024-09-12T12:24:09.463 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:24:09.463 INFO:teuthology.orchestra.run.smithi033.stdout: "dentry_count": 0, 2024-09-12T12:24:09.463 INFO:teuthology.orchestra.run.smithi033.stdout: "dentry_pinned_count": 0, 2024-09-12T12:24:09.463 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 14730, 2024-09-12T12:24:09.463 INFO:teuthology.orchestra.run.smithi033.stdout: "inst": { 2024-09-12T12:24:09.463 INFO:teuthology.orchestra.run.smithi033.stdout: "name": { 2024-09-12T12:24:09.463 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "client", 2024-09-12T12:24:09.463 INFO:teuthology.orchestra.run.smithi033.stdout: "num": 14730 2024-09-12T12:24:09.463 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:24:09.463 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": { 2024-09-12T12:24:09.463 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v1", 2024-09-12T12:24:09.464 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "192.168.0.1:0", 2024-09-12T12:24:09.464 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 936685219 2024-09-12T12:24:09.464 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:24:09.464 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:24:09.464 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": { 2024-09-12T12:24:09.464 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v1", 2024-09-12T12:24:09.464 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "192.168.0.1:0", 2024-09-12T12:24:09.464 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 936685219 2024-09-12T12:24:09.464 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:24:09.464 INFO:teuthology.orchestra.run.smithi033.stdout: "inst_str": "client.14730 192.168.0.1:0/936685219", 2024-09-12T12:24:09.464 INFO:teuthology.orchestra.run.smithi033.stdout: "addr_str": "192.168.0.1:0/936685219", 2024-09-12T12:24:09.464 INFO:teuthology.orchestra.run.smithi033.stdout: "inode_count": 1, 2024-09-12T12:24:09.464 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_epoch": 17, 2024-09-12T12:24:09.465 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_epoch": 85, 2024-09-12T12:24:09.465 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_epoch_barrier": 0, 2024-09-12T12:24:09.465 INFO:teuthology.orchestra.run.smithi033.stdout: "blocklisted": false, 2024-09-12T12:24:09.465 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs" 2024-09-12T12:24:09.465 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:24:09.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:24:09.471 DEBUG:teuthology.orchestra.run.smithi033:> stat --file-system '--printf=%T 2024-09-12T12:24:09.471 DEBUG:teuthology.orchestra.run.smithi033:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-12T12:24:09.489 INFO:teuthology.orchestra.run.smithi033.stdout:fuseblk 2024-09-12T12:24:09.489 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-12T12:24:09.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:24:09.489 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-12T12:24:09.558 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-12T12:24:09.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:24:09.667 INFO:teuthology.orchestra.run.smithi033.stdout:# file: . 2024-09-12T12:24:09.667 INFO:teuthology.orchestra.run.smithi033.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-12T12:24:09.667 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:24:09.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:24:09.673 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T12:24:09.673 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:24:09.691 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-12T12:24:09.999 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:10.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.585+0000 7f28598e2640 1 -- 172.21.15.33:0/2535144246 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2854102570 msgr2=0x7f28541029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:10.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.585+0000 7f28598e2640 1 --2- 172.21.15.33:0/2535144246 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2854102570 0x7f28541029b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f283c009900 tx=0x7f283c02a480 comp rx=0 tx=0).stop 2024-09-12T12:24:10.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.585+0000 7f28598e2640 1 -- 172.21.15.33:0/2535144246 shutdown_connections 2024-09-12T12:24:10.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.585+0000 7f28598e2640 1 --2- 172.21.15.33:0/2535144246 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2854102ef0 0x7f285410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:10.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.585+0000 7f28598e2640 1 --2- 172.21.15.33:0/2535144246 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2854102570 0x7f28541029b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:10.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.585+0000 7f28598e2640 1 --2- 172.21.15.33:0/2535144246 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2854100e20 0x7f2854101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:10.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.585+0000 7f28598e2640 1 -- 172.21.15.33:0/2535144246 >> 172.21.15.33:0/2535144246 conn(0x7f28540fc7d0 msgr2=0x7f28540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:10.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.585+0000 7f28598e2640 1 -- 172.21.15.33:0/2535144246 shutdown_connections 2024-09-12T12:24:10.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.585+0000 7f28598e2640 1 -- 172.21.15.33:0/2535144246 wait complete. 2024-09-12T12:24:10.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.585+0000 7f28598e2640 1 Processor -- start 2024-09-12T12:24:10.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.585+0000 7f28598e2640 1 -- start start 2024-09-12T12:24:10.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.586+0000 7f28598e2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2854100e20 0x7f28541983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:10.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.586+0000 7f28598e2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2854102570 0x7f2854198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:10.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.586+0000 7f28598e2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2854102ef0 0x7f285419ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:10.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.586+0000 7f28598e2640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2854111f50 con 0x7f2854102ef0 2024-09-12T12:24:10.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.586+0000 7f28598e2640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2854111dd0 con 0x7f2854102570 2024-09-12T12:24:10.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.586+0000 7f28598e2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f28541120d0 con 0x7f2854100e20 2024-09-12T12:24:10.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.586+0000 7f28537fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2854102ef0 0x7f285419ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:10.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.586+0000 7f28537fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2854102ef0 0x7f285419ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38160/0 (socket says 172.21.15.33:38160) 2024-09-12T12:24:10.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.586+0000 7f28537fe640 1 -- 172.21.15.33:0/1403178856 learned_addr learned my addr 172.21.15.33:0/1403178856 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:24:10.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.586+0000 7f284a7fc640 1 --2- 172.21.15.33:0/1403178856 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2854102570 0x7f2854198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:10.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.586+0000 7f2852ffd640 1 --2- 172.21.15.33:0/1403178856 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2854100e20 0x7f28541983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:10.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.586+0000 7f28537fe640 1 -- 172.21.15.33:0/1403178856 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2854100e20 msgr2=0x7f28541983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:10.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.586+0000 7f28537fe640 1 --2- 172.21.15.33:0/1403178856 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2854100e20 0x7f28541983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:10.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.586+0000 7f28537fe640 1 -- 172.21.15.33:0/1403178856 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2854102570 msgr2=0x7f2854198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:10.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.586+0000 7f28537fe640 1 --2- 172.21.15.33:0/1403178856 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2854102570 0x7f2854198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:10.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.586+0000 7f28537fe640 1 -- 172.21.15.33:0/1403178856 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f285419d3a0 con 0x7f2854102ef0 2024-09-12T12:24:10.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.586+0000 7f2852ffd640 1 --2- 172.21.15.33:0/1403178856 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2854100e20 0x7f28541983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:24:10.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.587+0000 7f28537fe640 1 --2- 172.21.15.33:0/1403178856 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2854102ef0 0x7f285419ccc0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f284c00cce0 tx=0x7f284c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:10.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.587+0000 7f28588e0640 1 -- 172.21.15.33:0/1403178856 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284c00f450 con 0x7f2854102ef0 2024-09-12T12:24:10.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.587+0000 7f28588e0640 1 -- 172.21.15.33:0/1403178856 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f284c00faa0 con 0x7f2854102ef0 2024-09-12T12:24:10.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.587+0000 7f28598e2640 1 -- 172.21.15.33:0/1403178856 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f285419d690 con 0x7f2854102ef0 2024-09-12T12:24:10.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.587+0000 7f28588e0640 1 -- 172.21.15.33:0/1403178856 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284c018b70 con 0x7f2854102ef0 2024-09-12T12:24:10.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.587+0000 7f28598e2640 1 -- 172.21.15.33:0/1403178856 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28541a4f70 con 0x7f2854102ef0 2024-09-12T12:24:10.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.588+0000 7f28598e2640 1 -- 172.21.15.33:0/1403178856 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2854101200 con 0x7f2854102ef0 2024-09-12T12:24:10.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.589+0000 7f28588e0640 1 -- 172.21.15.33:0/1403178856 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f284c018d10 con 0x7f2854102ef0 2024-09-12T12:24:10.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.590+0000 7f28588e0640 1 --2- 172.21.15.33:0/1403178856 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f28400a2c00 0x7f28400a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:10.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.590+0000 7f2852ffd640 1 --2- 172.21.15.33:0/1403178856 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f28400a2c00 0x7f28400a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:10.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.590+0000 7f28588e0640 1 -- 172.21.15.33:0/1403178856 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f284c0cf800 con 0x7f2854102ef0 2024-09-12T12:24:10.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.590+0000 7f2852ffd640 1 --2- 172.21.15.33:0/1403178856 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f28400a2c00 0x7f28400a50c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2844009930 tx=0x7f2844008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:10.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.593+0000 7f28588e0640 1 -- 172.21.15.33:0/1403178856 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f284c014030 con 0x7f2854102ef0 2024-09-12T12:24:10.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.783+0000 7f28598e2640 1 -- 172.21.15.33:0/1403178856 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2854109090 con 0x7f2854102ef0 2024-09-12T12:24:10.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.784+0000 7f28588e0640 1 -- 172.21.15.33:0/1403178856 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v85) ==== 81+0+591 (secure 0 0 0) 0x7f284c09c5d0 con 0x7f2854102ef0 2024-09-12T12:24:10.785 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/3187741548 2024-09-13T12:16:57.792813+0000 2024-09-12T12:24:10.785 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6800/1381479235 2024-09-13T12:16:57.792813+0000 2024-09-12T12:24:10.785 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6801/1156183797 2024-09-13T12:16:33.559150+0000 2024-09-12T12:24:10.785 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/2222991013 2024-09-13T12:16:57.792813+0000 2024-09-12T12:24:10.786 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6801/1381479235 2024-09-13T12:16:57.792813+0000 2024-09-12T12:24:10.786 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6800/1156183797 2024-09-13T12:16:33.559150+0000 2024-09-12T12:24:10.786 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/3450458842 2024-09-13T12:16:33.559150+0000 2024-09-12T12:24:10.786 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/202580320 2024-09-13T12:16:33.559150+0000 2024-09-12T12:24:10.786 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/2441151017 2024-09-13T12:16:57.792813+0000 2024-09-12T12:24:10.786 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/1001176884 2024-09-13T12:16:33.559150+0000 2024-09-12T12:24:10.786 INFO:teuthology.orchestra.run.smithi033.stderr:listed 10 entries 2024-09-12T12:24:10.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.786+0000 7f28598e2640 1 -- 172.21.15.33:0/1403178856 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f28400a2c00 msgr2=0x7f28400a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:10.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.786+0000 7f28598e2640 1 --2- 172.21.15.33:0/1403178856 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f28400a2c00 0x7f28400a50c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2844009930 tx=0x7f2844008040 comp rx=0 tx=0).stop 2024-09-12T12:24:10.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.786+0000 7f28598e2640 1 -- 172.21.15.33:0/1403178856 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2854102ef0 msgr2=0x7f285419ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:10.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.786+0000 7f28598e2640 1 --2- 172.21.15.33:0/1403178856 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2854102ef0 0x7f285419ccc0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f284c00cce0 tx=0x7f284c00a620 comp rx=0 tx=0).stop 2024-09-12T12:24:10.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.786+0000 7f28598e2640 1 -- 172.21.15.33:0/1403178856 shutdown_connections 2024-09-12T12:24:10.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.786+0000 7f28598e2640 1 --2- 172.21.15.33:0/1403178856 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f28400a2c00 0x7f28400a50c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:10.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.786+0000 7f28598e2640 1 --2- 172.21.15.33:0/1403178856 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2854102ef0 0x7f285419ccc0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:10.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.786+0000 7f28598e2640 1 --2- 172.21.15.33:0/1403178856 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2854102570 0x7f2854198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:10.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.786+0000 7f28598e2640 1 --2- 172.21.15.33:0/1403178856 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2854100e20 0x7f28541983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:10.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.786+0000 7f28598e2640 1 -- 172.21.15.33:0/1403178856 >> 172.21.15.33:0/1403178856 conn(0x7f28540fc7d0 msgr2=0x7f28540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:10.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.786+0000 7f28598e2640 1 -- 172.21.15.33:0/1403178856 shutdown_connections 2024-09-12T12:24:10.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:10.786+0000 7f28598e2640 1 -- 172.21.15.33:0/1403178856 wait complete. 2024-09-12T12:24:11.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:10 smithi033 ceph-mon[31246]: pgmap v291: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:24:11.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:10 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/1403178856' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T12:24:11.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:10 smithi043 ceph-mon[34144]: pgmap v291: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:24:11.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:10 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/1403178856' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T12:24:11.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:10 smithi102 ceph-mon[34799]: pgmap v291: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:24:11.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:10 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/1403178856' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T12:24:11.552 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T12:24:11.553 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:24:11.572 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-12T12:24:11.871 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:12.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.333+0000 7f91bbb6f640 1 -- 172.21.15.33:0/1463463028 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91b4106f10 msgr2=0x7f91b410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:12.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.333+0000 7f91bbb6f640 1 --2- 172.21.15.33:0/1463463028 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91b4106f10 0x7f91b410ea90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f91ac009ca0 tx=0x7f91ac02a8c0 comp rx=0 tx=0).stop 2024-09-12T12:24:12.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.333+0000 7f91bbb6f640 1 -- 172.21.15.33:0/1463463028 shutdown_connections 2024-09-12T12:24:12.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.333+0000 7f91bbb6f640 1 --2- 172.21.15.33:0/1463463028 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91b4106f10 0x7f91b410ea90 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:12.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.333+0000 7f91bbb6f640 1 --2- 172.21.15.33:0/1463463028 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91b4102790 0x7f91b41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:12.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.333+0000 7f91bbb6f640 1 --2- 172.21.15.33:0/1463463028 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91b4101de0 0x7f91b41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:12.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.333+0000 7f91bbb6f640 1 -- 172.21.15.33:0/1463463028 >> 172.21.15.33:0/1463463028 conn(0x7f91b40fd8c0 msgr2=0x7f91b40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:12.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.333+0000 7f91bbb6f640 1 -- 172.21.15.33:0/1463463028 shutdown_connections 2024-09-12T12:24:12.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.333+0000 7f91bbb6f640 1 -- 172.21.15.33:0/1463463028 wait complete. 2024-09-12T12:24:12.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.334+0000 7f91bbb6f640 1 Processor -- start 2024-09-12T12:24:12.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.334+0000 7f91bbb6f640 1 -- start start 2024-09-12T12:24:12.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.334+0000 7f91bbb6f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91b4101de0 0x7f91b4198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:12.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.334+0000 7f91bbb6f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91b4102790 0x7f91b41987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:12.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.334+0000 7f91bbb6f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91b4106f10 0x7f91b419cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:12.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.334+0000 7f91bbb6f640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f91b4111e70 con 0x7f91b4106f10 2024-09-12T12:24:12.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.334+0000 7f91bbb6f640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f91b4111cf0 con 0x7f91b4101de0 2024-09-12T12:24:12.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.334+0000 7f91bbb6f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f91b4111ff0 con 0x7f91b4102790 2024-09-12T12:24:12.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.334+0000 7f91ba10c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91b4106f10 0x7f91b419cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:12.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.334+0000 7f91ba10c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91b4106f10 0x7f91b419cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38170/0 (socket says 172.21.15.33:38170) 2024-09-12T12:24:12.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.334+0000 7f91ba10c640 1 -- 172.21.15.33:0/459528061 learned_addr learned my addr 172.21.15.33:0/459528061 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:24:12.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.334+0000 7f91b990b640 1 --2- 172.21.15.33:0/459528061 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91b4101de0 0x7f91b4198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:12.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.334+0000 7f91b910a640 1 --2- 172.21.15.33:0/459528061 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91b4102790 0x7f91b41987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:12.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.334+0000 7f91ba10c640 1 -- 172.21.15.33:0/459528061 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91b4102790 msgr2=0x7f91b41987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:12.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.334+0000 7f91ba10c640 1 --2- 172.21.15.33:0/459528061 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91b4102790 0x7f91b41987b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:12.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.334+0000 7f91ba10c640 1 -- 172.21.15.33:0/459528061 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91b4101de0 msgr2=0x7f91b4198270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:12.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.334+0000 7f91ba10c640 1 --2- 172.21.15.33:0/459528061 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91b4101de0 0x7f91b4198270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:12.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.334+0000 7f91ba10c640 1 -- 172.21.15.33:0/459528061 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91b419d220 con 0x7f91b4106f10 2024-09-12T12:24:12.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.334+0000 7f91b910a640 1 --2- 172.21.15.33:0/459528061 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91b4102790 0x7f91b41987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:24:12.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.335+0000 7f91ba10c640 1 --2- 172.21.15.33:0/459528061 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91b4106f10 0x7f91b419cb40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f91ac031040 tx=0x7f91ac003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:12.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.335+0000 7f91aaffd640 1 -- 172.21.15.33:0/459528061 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ac003ce0 con 0x7f91b4106f10 2024-09-12T12:24:12.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.335+0000 7f91aaffd640 1 -- 172.21.15.33:0/459528061 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f91ac0044f0 con 0x7f91b4106f10 2024-09-12T12:24:12.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.335+0000 7f91bbb6f640 1 -- 172.21.15.33:0/459528061 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91b419d4b0 con 0x7f91b4106f10 2024-09-12T12:24:12.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.335+0000 7f91aaffd640 1 -- 172.21.15.33:0/459528061 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ac030c90 con 0x7f91b4106f10 2024-09-12T12:24:12.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.335+0000 7f91bbb6f640 1 -- 172.21.15.33:0/459528061 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91b41a4df0 con 0x7f91b4106f10 2024-09-12T12:24:12.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.336+0000 7f91bbb6f640 1 -- 172.21.15.33:0/459528061 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91b41021c0 con 0x7f91b4106f10 2024-09-12T12:24:12.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.338+0000 7f91aaffd640 1 -- 172.21.15.33:0/459528061 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f91ac0046a0 con 0x7f91b4106f10 2024-09-12T12:24:12.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.338+0000 7f91aaffd640 1 --2- 172.21.15.33:0/459528061 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f91a00a2c00 0x7f91a00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:12.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.339+0000 7f91b990b640 1 --2- 172.21.15.33:0/459528061 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f91a00a2c00 0x7f91a00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:12.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.339+0000 7f91aaffd640 1 -- 172.21.15.33:0/459528061 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f91ac0f0a60 con 0x7f91b4106f10 2024-09-12T12:24:12.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.339+0000 7f91b990b640 1 --2- 172.21.15.33:0/459528061 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f91a00a2c00 0x7f91a00a50c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f91b0005fd0 tx=0x7f91b000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:12.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.342+0000 7f91aaffd640 1 -- 172.21.15.33:0/459528061 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f91ac0bd720 con 0x7f91b4106f10 2024-09-12T12:24:12.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.533+0000 7f91bbb6f640 1 -- 172.21.15.33:0/459528061 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f91b41995d0 con 0x7f91b4106f10 2024-09-12T12:24:12.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.533+0000 7f91aaffd640 1 -- 172.21.15.33:0/459528061 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v85) ==== 81+0+591 (secure 0 0 0) 0x7f91b41995d0 con 0x7f91b4106f10 2024-09-12T12:24:12.535 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/3187741548 2024-09-13T12:16:57.792813+0000 2024-09-12T12:24:12.535 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6800/1381479235 2024-09-13T12:16:57.792813+0000 2024-09-12T12:24:12.535 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6801/1156183797 2024-09-13T12:16:33.559150+0000 2024-09-12T12:24:12.535 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/2222991013 2024-09-13T12:16:57.792813+0000 2024-09-12T12:24:12.535 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6801/1381479235 2024-09-13T12:16:57.792813+0000 2024-09-12T12:24:12.535 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6800/1156183797 2024-09-13T12:16:33.559150+0000 2024-09-12T12:24:12.535 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/3450458842 2024-09-13T12:16:33.559150+0000 2024-09-12T12:24:12.535 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/202580320 2024-09-13T12:16:33.559150+0000 2024-09-12T12:24:12.535 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/2441151017 2024-09-13T12:16:57.792813+0000 2024-09-12T12:24:12.535 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/1001176884 2024-09-13T12:16:33.559150+0000 2024-09-12T12:24:12.535 INFO:teuthology.orchestra.run.smithi033.stderr:listed 10 entries 2024-09-12T12:24:12.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.536+0000 7f91bbb6f640 1 -- 172.21.15.33:0/459528061 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f91a00a2c00 msgr2=0x7f91a00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:12.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.536+0000 7f91bbb6f640 1 --2- 172.21.15.33:0/459528061 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f91a00a2c00 0x7f91a00a50c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f91b0005fd0 tx=0x7f91b000b390 comp rx=0 tx=0).stop 2024-09-12T12:24:12.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.536+0000 7f91bbb6f640 1 -- 172.21.15.33:0/459528061 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91b4106f10 msgr2=0x7f91b419cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:12.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.536+0000 7f91bbb6f640 1 --2- 172.21.15.33:0/459528061 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91b4106f10 0x7f91b419cb40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f91ac031040 tx=0x7f91ac003970 comp rx=0 tx=0).stop 2024-09-12T12:24:12.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.536+0000 7f91bbb6f640 1 -- 172.21.15.33:0/459528061 shutdown_connections 2024-09-12T12:24:12.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.536+0000 7f91bbb6f640 1 --2- 172.21.15.33:0/459528061 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f91a00a2c00 0x7f91a00a50c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:12.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.536+0000 7f91bbb6f640 1 --2- 172.21.15.33:0/459528061 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91b4106f10 0x7f91b419cb40 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:12.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.536+0000 7f91bbb6f640 1 --2- 172.21.15.33:0/459528061 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91b4102790 0x7f91b41987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:12.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.536+0000 7f91bbb6f640 1 --2- 172.21.15.33:0/459528061 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91b4101de0 0x7f91b4198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:12.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.537+0000 7f91bbb6f640 1 -- 172.21.15.33:0/459528061 >> 172.21.15.33:0/459528061 conn(0x7f91b40fd8c0 msgr2=0x7f91b40ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:12.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.537+0000 7f91bbb6f640 1 -- 172.21.15.33:0/459528061 shutdown_connections 2024-09-12T12:24:12.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:12.537+0000 7f91bbb6f640 1 -- 172.21.15.33:0/459528061 wait complete. 2024-09-12T12:24:13.198 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:12 smithi033 ceph-mon[31246]: pgmap v292: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:24:13.198 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:12 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/459528061' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T12:24:13.229 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi033.front.sepia.ceph.com... 2024-09-12T12:24:13.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:24:13.230 DEBUG:teuthology.orchestra.run.smithi033:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-12T12:24:13.258 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi033.stderr:ceph-fuse[75859]: fuse finished with error 0 and tester_r 0 2024-09-12T12:24:13.260 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:24:13.369 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:12 smithi043 ceph-mon[34144]: pgmap v292: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:24:13.369 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:12 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/459528061' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T12:24:13.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:12 smithi102 ceph-mon[34799]: pgmap v292: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:24:13.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:12 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/459528061' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T12:24:15.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:14 smithi033 ceph-mon[31246]: pgmap v293: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-12T12:24:15.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:14 smithi043 ceph-mon[34144]: pgmap v293: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-12T12:24:15.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:14 smithi102 ceph-mon[34799]: pgmap v293: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-12T12:24:18.036 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:17 smithi033 ceph-mon[31246]: pgmap v294: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-12T12:24:18.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:17 smithi043 ceph-mon[34144]: pgmap v294: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-12T12:24:18.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:17 smithi102 ceph-mon[34799]: pgmap v294: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-12T12:24:19.362 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi033.front.sepia.ceph.com 2024-09-12T12:24:19.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:24:19.363 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-12T12:24:19.392 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T12:24:19.702 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:20.093 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:19 smithi033 ceph-mon[31246]: pgmap v295: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-12T12:24:20.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:19 smithi043 ceph-mon[34144]: pgmap v295: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-12T12:24:20.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:19 smithi102 ceph-mon[34799]: pgmap v295: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-12T12:24:20.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.175+0000 7fed9aa60640 1 -- 172.21.15.33:0/3692430748 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed94101df0 msgr2=0x7fed941021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:20.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.175+0000 7fed9aa60640 1 --2- 172.21.15.33:0/3692430748 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed94101df0 0x7fed941021d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fed84009900 tx=0x7fed8402a410 comp rx=0 tx=0).stop 2024-09-12T12:24:20.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.175+0000 7fed9aa60640 1 -- 172.21.15.33:0/3692430748 shutdown_connections 2024-09-12T12:24:20.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.175+0000 7fed9aa60640 1 --2- 172.21.15.33:0/3692430748 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed94106f20 0x7fed9410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:20.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.175+0000 7fed9aa60640 1 --2- 172.21.15.33:0/3692430748 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed941027a0 0x7fed941067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:20.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.175+0000 7fed9aa60640 1 --2- 172.21.15.33:0/3692430748 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed94101df0 0x7fed941021d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:20.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.175+0000 7fed9aa60640 1 -- 172.21.15.33:0/3692430748 >> 172.21.15.33:0/3692430748 conn(0x7fed940fd8b0 msgr2=0x7fed940ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:20.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.175+0000 7fed9aa60640 1 -- 172.21.15.33:0/3692430748 shutdown_connections 2024-09-12T12:24:20.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.175+0000 7fed9aa60640 1 -- 172.21.15.33:0/3692430748 wait complete. 2024-09-12T12:24:20.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.175+0000 7fed9aa60640 1 Processor -- start 2024-09-12T12:24:20.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.176+0000 7fed9aa60640 1 -- start start 2024-09-12T12:24:20.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.176+0000 7fed9aa60640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed94101df0 0x7fed94198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:20.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.176+0000 7fed9aa60640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed941027a0 0x7fed941987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:20.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.176+0000 7fed9aa60640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed94106f20 0x7fed9419cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:20.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.176+0000 7fed9aa60640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fed94111df0 con 0x7fed94106f20 2024-09-12T12:24:20.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.176+0000 7fed9aa60640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fed94111c70 con 0x7fed94101df0 2024-09-12T12:24:20.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.176+0000 7fed9aa60640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fed94111f70 con 0x7fed941027a0 2024-09-12T12:24:20.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.176+0000 7fed98ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed94106f20 0x7fed9419cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:20.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.176+0000 7fed93fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed94101df0 0x7fed94198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:20.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.176+0000 7fed93fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed94101df0 0x7fed94198270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:39074/0 (socket says 172.21.15.33:39074) 2024-09-12T12:24:20.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.176+0000 7fed93fff640 1 -- 172.21.15.33:0/2334894490 learned_addr learned my addr 172.21.15.33:0/2334894490 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:24:20.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.176+0000 7fed937fe640 1 --2- 172.21.15.33:0/2334894490 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed941027a0 0x7fed941987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:20.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.176+0000 7fed93fff640 1 -- 172.21.15.33:0/2334894490 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed941027a0 msgr2=0x7fed941987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:20.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.176+0000 7fed93fff640 1 --2- 172.21.15.33:0/2334894490 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed941027a0 0x7fed941987b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:20.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.177+0000 7fed93fff640 1 -- 172.21.15.33:0/2334894490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed94106f20 msgr2=0x7fed9419cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:20.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.177+0000 7fed93fff640 1 --2- 172.21.15.33:0/2334894490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed94106f20 0x7fed9419cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:20.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.177+0000 7fed93fff640 1 -- 172.21.15.33:0/2334894490 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed9419d220 con 0x7fed94101df0 2024-09-12T12:24:20.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.177+0000 7fed937fe640 1 --2- 172.21.15.33:0/2334894490 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed941027a0 0x7fed941987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:24:20.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.177+0000 7fed98ffd640 1 --2- 172.21.15.33:0/2334894490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed94106f20 0x7fed9419cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:24:20.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.177+0000 7fed93fff640 1 --2- 172.21.15.33:0/2334894490 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed94101df0 0x7fed94198270 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fed84006010 tx=0x7fed84004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:20.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.177+0000 7fed917fa640 1 -- 172.21.15.33:0/2334894490 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8403f030 con 0x7fed94101df0 2024-09-12T12:24:20.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.177+0000 7fed9aa60640 1 -- 172.21.15.33:0/2334894490 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed9419d4b0 con 0x7fed94101df0 2024-09-12T12:24:20.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.177+0000 7fed917fa640 1 -- 172.21.15.33:0/2334894490 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fed840035f0 con 0x7fed94101df0 2024-09-12T12:24:20.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.177+0000 7fed917fa640 1 -- 172.21.15.33:0/2334894490 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed84035070 con 0x7fed94101df0 2024-09-12T12:24:20.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.177+0000 7fed9aa60640 1 -- 172.21.15.33:0/2334894490 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed941a4df0 con 0x7fed94101df0 2024-09-12T12:24:20.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.178+0000 7fed9aa60640 1 -- 172.21.15.33:0/2334894490 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed941021d0 con 0x7fed94101df0 2024-09-12T12:24:20.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.179+0000 7fed917fa640 1 -- 172.21.15.33:0/2334894490 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fed84003b10 con 0x7fed94101df0 2024-09-12T12:24:20.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.180+0000 7fed917fa640 1 --2- 172.21.15.33:0/2334894490 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fed7c0a2b80 0x7fed7c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:20.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.180+0000 7fed917fa640 1 -- 172.21.15.33:0/2334894490 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7fed840f0070 con 0x7fed94101df0 2024-09-12T12:24:20.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.180+0000 7fed937fe640 1 --2- 172.21.15.33:0/2334894490 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fed7c0a2b80 0x7fed7c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:20.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.181+0000 7fed937fe640 1 --2- 172.21.15.33:0/2334894490 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fed7c0a2b80 0x7fed7c0a5040 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fed94108950 tx=0x7fed8800a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:20.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.184+0000 7fed917fa640 1 -- 172.21.15.33:0/2334894490 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fed840bcd30 con 0x7fed94101df0 2024-09-12T12:24:20.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.364+0000 7fed9aa60640 1 -- 172.21.15.33:0/2334894490 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fed9410a100 con 0x7fed94101df0 2024-09-12T12:24:20.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.365+0000 7fed917fa640 1 -- 172.21.15.33:0/2334894490 <== mon.2 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+24141 (secure 0 0 0) 0x7fed840bc630 con 0x7fed94101df0 2024-09-12T12:24:20.367 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:24:20.367 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":85,"fsid":"a66dfafc-7100-11ef-bcea-c7b262605968","created":"2024-09-12T12:16:11.904815+0000","modified":"2024-09-12T12:23:55.506385+0000","last_up_change":"2024-09-12T12:22:57.476185+0000","last_in_change":"2024-09-12T12:22:35.192556+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:19:12.296305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:23:42.509774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:23:44.842852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T12:23:51.308720+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"74b68729-c97c-4da6-a659-75d6c147ad05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6803","nonce":963294466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6805","nonce":963294466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6809","nonce":963294466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6807","nonce":963294466}]},"public_addr":"172.21.15.33:6803/963294466","cluster_addr":"172.21.15.33:6805/963294466","heartbeat_back_addr":"172.21.15.33:6809/963294466","heartbeat_front_addr":"172.21.15.33:6807/963294466","state":["exists","up"]},{"osd":1,"uuid":"2461a388-e110-420b-9404-eb54cd39119e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6801","nonce":2306025171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6803","nonce":2306025171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6807","nonce":2306025171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6805","nonce":2306025171}]},"public_addr":"172.21.15.43:6801/2306025171","cluster_addr":"172.21.15.43:6803/2306025171","heartbeat_back_addr":"172.21.15.43:6807/2306025171","heartbeat_front_addr":"172.21.15.43:6805/2306025171","state":["exists","up"]},{"osd":2,"uuid":"4ba9dd02-977d-45fb-b366-ade15b52232b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6801","nonce":4257223217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6803","nonce":4257223217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6807","nonce":4257223217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6805","nonce":4257223217}]},"public_addr":"172.21.15.102:6801/4257223217","cluster_addr":"172.21.15.102:6803/4257223217","heartbeat_back_addr":"172.21.15.102:6807/4257223217","heartbeat_front_addr":"172.21.15.102:6805/4257223217","state":["exists","up"]},{"osd":3,"uuid":"345aa854-9ea2-4103-a186-9794af34c237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6811","nonce":2483872739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6813","nonce":2483872739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6817","nonce":2483872739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6815","nonce":2483872739}]},"public_addr":"172.21.15.33:6811/2483872739","cluster_addr":"172.21.15.33:6813/2483872739","heartbeat_back_addr":"172.21.15.33:6817/2483872739","heartbeat_front_addr":"172.21.15.33:6815/2483872739","state":["exists","up"]},{"osd":4,"uuid":"32acd6da-01d6-4a8e-9d05-3d394363d6f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6809","nonce":136043101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6811","nonce":136043101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6815","nonce":136043101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6813","nonce":136043101}]},"public_addr":"172.21.15.43:6809/136043101","cluster_addr":"172.21.15.43:6811/136043101","heartbeat_back_addr":"172.21.15.43:6815/136043101","heartbeat_front_addr":"172.21.15.43:6813/136043101","state":["exists","up"]},{"osd":5,"uuid":"dced0037-2da2-48c2-a391-f871d6ceebb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6809","nonce":2605625792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6811","nonce":2605625792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6815","nonce":2605625792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6813","nonce":2605625792}]},"public_addr":"172.21.15.102:6809/2605625792","cluster_addr":"172.21.15.102:6811/2605625792","heartbeat_back_addr":"172.21.15.102:6815/2605625792","heartbeat_front_addr":"172.21.15.102:6813/2605625792","state":["exists","up"]},{"osd":6,"uuid":"46e5532e-026a-4bb2-8847-2a3216e5d7a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6819","nonce":805864618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6821","nonce":805864618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6825","nonce":805864618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6823","nonce":805864618}]},"public_addr":"172.21.15.33:6819/805864618","cluster_addr":"172.21.15.33:6821/805864618","heartbeat_back_addr":"172.21.15.33:6825/805864618","heartbeat_front_addr":"172.21.15.33:6823/805864618","state":["exists","up"]},{"osd":7,"uuid":"c8474ab4-68cd-4475-9429-b54981247ee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6817","nonce":392537201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6819","nonce":392537201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6823","nonce":392537201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6821","nonce":392537201}]},"public_addr":"172.21.15.43:6817/392537201","cluster_addr":"172.21.15.43:6819/392537201","heartbeat_back_addr":"172.21.15.43:6823/392537201","heartbeat_front_addr":"172.21.15.43:6821/392537201","state":["exists","up"]},{"osd":8,"uuid":"e7c2ef28-8c84-44d0-ba6d-7556ec1d02dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6817","nonce":1768219597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6819","nonce":1768219597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6823","nonce":1768219597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6821","nonce":1768219597}]},"public_addr":"172.21.15.102:6817/1768219597","cluster_addr":"172.21.15.102:6819/1768219597","heartbeat_back_addr":"172.21.15.102:6823/1768219597","heartbeat_front_addr":"172.21.15.102:6821/1768219597","state":["exists","up"]},{"osd":9,"uuid":"f2500273-8b21-4984-bc41-cec5cc0c883b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6827","nonce":973136168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6829","nonce":973136168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6833","nonce":973136168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6831","nonce":973136168}]},"public_addr":"172.21.15.33:6827/973136168","cluster_addr":"172.21.15.33:6829/973136168","heartbeat_back_addr":"172.21.15.33:6833/973136168","heartbeat_front_addr":"172.21.15.33:6831/973136168","state":["exists","up"]},{"osd":10,"uuid":"954343c5-5d5b-4c30-acde-82aa695f7b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6825","nonce":248515585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6827","nonce":248515585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6831","nonce":248515585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6829","nonce":248515585}]},"public_addr":"172.21.15.43:6825/248515585","cluster_addr":"172.21.15.43:6827/248515585","heartbeat_back_addr":"172.21.15.43:6831/248515585","heartbeat_front_addr":"172.21.15.43:6829/248515585","state":["exists","up"]},{"osd":11,"uuid":"22b4147b-02ad-4514-be17-5bb395099eef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6825","nonce":2463068013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6827","nonce":2463068013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6831","nonce":2463068013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6829","nonce":2463068013}]},"public_addr":"172.21.15.102:6825/2463068013","cluster_addr":"172.21.15.102:6827/2463068013","heartbeat_back_addr":"172.21.15.102:6831/2463068013","heartbeat_front_addr":"172.21.15.102:6829/2463068013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:19.274804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:44.900294+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:08.885404+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:34.382089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:59.978538+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:25.275179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:49.429847+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:14.974792+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:40.268629+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:22:06.458679+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:22:31.813019+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:22:56.264078+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/3187741548":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6800/1381479235":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6801/1156183797":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/2222991013":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6801/1381479235":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6800/1156183797":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/3450458842":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/202580320":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/2441151017":"2024-09-13T12:16:57.792813+0000","172.21.15.33:0/1001176884":"2024-09-13T12:16:33.559150+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:24:20.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.368+0000 7fed9aa60640 1 -- 172.21.15.33:0/2334894490 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fed7c0a2b80 msgr2=0x7fed7c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:20.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.368+0000 7fed9aa60640 1 --2- 172.21.15.33:0/2334894490 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fed7c0a2b80 0x7fed7c0a5040 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fed94108950 tx=0x7fed8800a5c0 comp rx=0 tx=0).stop 2024-09-12T12:24:20.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.368+0000 7fed9aa60640 1 -- 172.21.15.33:0/2334894490 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed94101df0 msgr2=0x7fed94198270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:20.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.368+0000 7fed9aa60640 1 --2- 172.21.15.33:0/2334894490 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed94101df0 0x7fed94198270 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fed84006010 tx=0x7fed84004270 comp rx=0 tx=0).stop 2024-09-12T12:24:20.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.368+0000 7fed9aa60640 1 -- 172.21.15.33:0/2334894490 shutdown_connections 2024-09-12T12:24:20.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.368+0000 7fed9aa60640 1 --2- 172.21.15.33:0/2334894490 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fed7c0a2b80 0x7fed7c0a5040 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:20.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.368+0000 7fed9aa60640 1 --2- 172.21.15.33:0/2334894490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed94106f20 0x7fed9419cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:20.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.368+0000 7fed9aa60640 1 --2- 172.21.15.33:0/2334894490 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed941027a0 0x7fed941987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:20.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.368+0000 7fed9aa60640 1 --2- 172.21.15.33:0/2334894490 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed94101df0 0x7fed94198270 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:20.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.368+0000 7fed9aa60640 1 -- 172.21.15.33:0/2334894490 >> 172.21.15.33:0/2334894490 conn(0x7fed940fd8b0 msgr2=0x7fed940febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:20.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.368+0000 7fed9aa60640 1 -- 172.21.15.33:0/2334894490 shutdown_connections 2024-09-12T12:24:20.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:20.368+0000 7fed9aa60640 1 -- 172.21.15.33:0/2334894490 wait complete. 2024-09-12T12:24:21.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:20 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/2334894490' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:24:21.140 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:20 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/2334894490' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:24:21.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:20 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/2334894490' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:24:21.169 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T12:24:21.428 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:21.876 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:21 smithi033 ceph-mon[31246]: pgmap v296: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-12T12:24:21.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:21.875+0000 7f590786e640 1 -- 172.21.15.33:0/151985655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f590010c170 msgr2=0x7f590010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:21.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:21.875+0000 7f590786e640 1 --2- 172.21.15.33:0/151985655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f590010c170 0x7f590010e610 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f58f8009ca0 tx=0x7f58f802a950 comp rx=0 tx=0).stop 2024-09-12T12:24:21.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:21.875+0000 7f590786e640 1 -- 172.21.15.33:0/151985655 shutdown_connections 2024-09-12T12:24:21.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:21.875+0000 7f590786e640 1 --2- 172.21.15.33:0/151985655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f590010c170 0x7f590010e610 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:21.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:21.875+0000 7f590786e640 1 --2- 172.21.15.33:0/151985655 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5900103660 0x7f590010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:21.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:21.875+0000 7f590786e640 1 --2- 172.21.15.33:0/151985655 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5900102d40 0x7f5900103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:21.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:21.875+0000 7f590786e640 1 -- 172.21.15.33:0/151985655 >> 172.21.15.33:0/151985655 conn(0x7f59000fc7a0 msgr2=0x7f59000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:21.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:21.875+0000 7f590786e640 1 -- 172.21.15.33:0/151985655 shutdown_connections 2024-09-12T12:24:21.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:21.876+0000 7f590786e640 1 -- 172.21.15.33:0/151985655 wait complete. 2024-09-12T12:24:21.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:21.876+0000 7f590786e640 1 Processor -- start 2024-09-12T12:24:21.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:21.876+0000 7f590786e640 1 -- start start 2024-09-12T12:24:21.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:21.876+0000 7f590786e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5900102d40 0x7f5900198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:21.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:21.876+0000 7f590786e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5900103660 0x7f5900198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:21.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:21.876+0000 7f590786e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f590010c170 0x7f590019cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:21.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:21.876+0000 7f590786e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5900111e20 con 0x7f5900102d40 2024-09-12T12:24:21.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:21.876+0000 7f590786e640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5900111ca0 con 0x7f5900103660 2024-09-12T12:24:21.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:21.876+0000 7f590786e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5900111fa0 con 0x7f590010c170 2024-09-12T12:24:21.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:21.877+0000 7f590560a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5900102d40 0x7f5900198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:21.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:21.877+0000 7f590560a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5900102d40 0x7f5900198320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58000/0 (socket says 172.21.15.33:58000) 2024-09-12T12:24:21.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:21.877+0000 7f590560a640 1 -- 172.21.15.33:0/508574926 learned_addr learned my addr 172.21.15.33:0/508574926 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:24:21.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:21.877+0000 7f5905e0b640 1 --2- 172.21.15.33:0/508574926 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f590010c170 0x7f590019cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:21.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:21.877+0000 7f5904e09640 1 --2- 172.21.15.33:0/508574926 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5900103660 0x7f5900198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:21.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:21.877+0000 7f590560a640 1 -- 172.21.15.33:0/508574926 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f590010c170 msgr2=0x7f590019cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:21.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:21.877+0000 7f590560a640 1 --2- 172.21.15.33:0/508574926 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f590010c170 0x7f590019cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:21.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:21.877+0000 7f590560a640 1 -- 172.21.15.33:0/508574926 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5900103660 msgr2=0x7f5900198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:21.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:21.877+0000 7f590560a640 1 --2- 172.21.15.33:0/508574926 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5900103660 0x7f5900198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:21.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:21.877+0000 7f590560a640 1 -- 172.21.15.33:0/508574926 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f590019d2d0 con 0x7f5900102d40 2024-09-12T12:24:21.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:21.877+0000 7f590560a640 1 --2- 172.21.15.33:0/508574926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5900102d40 0x7f5900198320 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f58fc00d950 tx=0x7f58fc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:21.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:21.878+0000 7f58f67fc640 1 -- 172.21.15.33:0/508574926 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58fc017070 con 0x7f5900102d40 2024-09-12T12:24:21.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:21.878+0000 7f58f67fc640 1 -- 172.21.15.33:0/508574926 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f58fc009c30 con 0x7f5900102d40 2024-09-12T12:24:21.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:21.878+0000 7f58f67fc640 1 -- 172.21.15.33:0/508574926 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58fc00f620 con 0x7f5900102d40 2024-09-12T12:24:21.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:21.878+0000 7f590786e640 1 -- 172.21.15.33:0/508574926 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f590019d5c0 con 0x7f5900102d40 2024-09-12T12:24:21.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:21.878+0000 7f590786e640 1 -- 172.21.15.33:0/508574926 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59001a4ea0 con 0x7f5900102d40 2024-09-12T12:24:21.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:21.880+0000 7f590786e640 1 -- 172.21.15.33:0/508574926 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5900103120 con 0x7f5900102d40 2024-09-12T12:24:21.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:21.881+0000 7f58f67fc640 1 -- 172.21.15.33:0/508574926 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f58fc0109a0 con 0x7f5900102d40 2024-09-12T12:24:21.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:21.881+0000 7f58f67fc640 1 --2- 172.21.15.33:0/508574926 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f58ec0a2c00 0x7f58ec0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:21.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:21.881+0000 7f5904e09640 1 --2- 172.21.15.33:0/508574926 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f58ec0a2c00 0x7f58ec0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:21.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:21.881+0000 7f58f67fc640 1 -- 172.21.15.33:0/508574926 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f58fc0cee50 con 0x7f5900102d40 2024-09-12T12:24:21.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:21.882+0000 7f5904e09640 1 --2- 172.21.15.33:0/508574926 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f58ec0a2c00 0x7f58ec0a50c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f58f00058c0 tx=0x7f58f0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:21.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:21.886+0000 7f58f67fc640 1 -- 172.21.15.33:0/508574926 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f58fc009de0 con 0x7f5900102d40 2024-09-12T12:24:22.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:22.062+0000 7f590786e640 1 -- 172.21.15.33:0/508574926 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f59001071e0 con 0x7f5900102d40 2024-09-12T12:24:22.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:22.063+0000 7f58f67fc640 1 -- 172.21.15.33:0/508574926 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+24141 (secure 0 0 0) 0x7f58fc09bb70 con 0x7f5900102d40 2024-09-12T12:24:22.064 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:24:22.064 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":85,"fsid":"a66dfafc-7100-11ef-bcea-c7b262605968","created":"2024-09-12T12:16:11.904815+0000","modified":"2024-09-12T12:23:55.506385+0000","last_up_change":"2024-09-12T12:22:57.476185+0000","last_in_change":"2024-09-12T12:22:35.192556+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:19:12.296305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:23:42.509774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:23:44.842852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T12:23:51.308720+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"74b68729-c97c-4da6-a659-75d6c147ad05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6803","nonce":963294466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6805","nonce":963294466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6809","nonce":963294466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6807","nonce":963294466}]},"public_addr":"172.21.15.33:6803/963294466","cluster_addr":"172.21.15.33:6805/963294466","heartbeat_back_addr":"172.21.15.33:6809/963294466","heartbeat_front_addr":"172.21.15.33:6807/963294466","state":["exists","up"]},{"osd":1,"uuid":"2461a388-e110-420b-9404-eb54cd39119e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6801","nonce":2306025171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6803","nonce":2306025171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6807","nonce":2306025171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6805","nonce":2306025171}]},"public_addr":"172.21.15.43:6801/2306025171","cluster_addr":"172.21.15.43:6803/2306025171","heartbeat_back_addr":"172.21.15.43:6807/2306025171","heartbeat_front_addr":"172.21.15.43:6805/2306025171","state":["exists","up"]},{"osd":2,"uuid":"4ba9dd02-977d-45fb-b366-ade15b52232b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6801","nonce":4257223217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6803","nonce":4257223217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6807","nonce":4257223217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6805","nonce":4257223217}]},"public_addr":"172.21.15.102:6801/4257223217","cluster_addr":"172.21.15.102:6803/4257223217","heartbeat_back_addr":"172.21.15.102:6807/4257223217","heartbeat_front_addr":"172.21.15.102:6805/4257223217","state":["exists","up"]},{"osd":3,"uuid":"345aa854-9ea2-4103-a186-9794af34c237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6811","nonce":2483872739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6813","nonce":2483872739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6817","nonce":2483872739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6815","nonce":2483872739}]},"public_addr":"172.21.15.33:6811/2483872739","cluster_addr":"172.21.15.33:6813/2483872739","heartbeat_back_addr":"172.21.15.33:6817/2483872739","heartbeat_front_addr":"172.21.15.33:6815/2483872739","state":["exists","up"]},{"osd":4,"uuid":"32acd6da-01d6-4a8e-9d05-3d394363d6f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6809","nonce":136043101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6811","nonce":136043101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6815","nonce":136043101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6813","nonce":136043101}]},"public_addr":"172.21.15.43:6809/136043101","cluster_addr":"172.21.15.43:6811/136043101","heartbeat_back_addr":"172.21.15.43:6815/136043101","heartbeat_front_addr":"172.21.15.43:6813/136043101","state":["exists","up"]},{"osd":5,"uuid":"dced0037-2da2-48c2-a391-f871d6ceebb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6809","nonce":2605625792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6811","nonce":2605625792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6815","nonce":2605625792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6813","nonce":2605625792}]},"public_addr":"172.21.15.102:6809/2605625792","cluster_addr":"172.21.15.102:6811/2605625792","heartbeat_back_addr":"172.21.15.102:6815/2605625792","heartbeat_front_addr":"172.21.15.102:6813/2605625792","state":["exists","up"]},{"osd":6,"uuid":"46e5532e-026a-4bb2-8847-2a3216e5d7a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6819","nonce":805864618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6821","nonce":805864618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6825","nonce":805864618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6823","nonce":805864618}]},"public_addr":"172.21.15.33:6819/805864618","cluster_addr":"172.21.15.33:6821/805864618","heartbeat_back_addr":"172.21.15.33:6825/805864618","heartbeat_front_addr":"172.21.15.33:6823/805864618","state":["exists","up"]},{"osd":7,"uuid":"c8474ab4-68cd-4475-9429-b54981247ee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6817","nonce":392537201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6819","nonce":392537201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6823","nonce":392537201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6821","nonce":392537201}]},"public_addr":"172.21.15.43:6817/392537201","cluster_addr":"172.21.15.43:6819/392537201","heartbeat_back_addr":"172.21.15.43:6823/392537201","heartbeat_front_addr":"172.21.15.43:6821/392537201","state":["exists","up"]},{"osd":8,"uuid":"e7c2ef28-8c84-44d0-ba6d-7556ec1d02dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6817","nonce":1768219597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6819","nonce":1768219597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6823","nonce":1768219597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6821","nonce":1768219597}]},"public_addr":"172.21.15.102:6817/1768219597","cluster_addr":"172.21.15.102:6819/1768219597","heartbeat_back_addr":"172.21.15.102:6823/1768219597","heartbeat_front_addr":"172.21.15.102:6821/1768219597","state":["exists","up"]},{"osd":9,"uuid":"f2500273-8b21-4984-bc41-cec5cc0c883b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6827","nonce":973136168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6829","nonce":973136168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6833","nonce":973136168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6831","nonce":973136168}]},"public_addr":"172.21.15.33:6827/973136168","cluster_addr":"172.21.15.33:6829/973136168","heartbeat_back_addr":"172.21.15.33:6833/973136168","heartbeat_front_addr":"172.21.15.33:6831/973136168","state":["exists","up"]},{"osd":10,"uuid":"954343c5-5d5b-4c30-acde-82aa695f7b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6825","nonce":248515585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6827","nonce":248515585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6831","nonce":248515585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6829","nonce":248515585}]},"public_addr":"172.21.15.43:6825/248515585","cluster_addr":"172.21.15.43:6827/248515585","heartbeat_back_addr":"172.21.15.43:6831/248515585","heartbeat_front_addr":"172.21.15.43:6829/248515585","state":["exists","up"]},{"osd":11,"uuid":"22b4147b-02ad-4514-be17-5bb395099eef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6825","nonce":2463068013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6827","nonce":2463068013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6831","nonce":2463068013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6829","nonce":2463068013}]},"public_addr":"172.21.15.102:6825/2463068013","cluster_addr":"172.21.15.102:6827/2463068013","heartbeat_back_addr":"172.21.15.102:6831/2463068013","heartbeat_front_addr":"172.21.15.102:6829/2463068013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:19.274804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:44.900294+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:08.885404+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:34.382089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:59.978538+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:25.275179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:49.429847+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:14.974792+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:40.268629+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:22:06.458679+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:22:31.813019+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:22:56.264078+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/3187741548":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6800/1381479235":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6801/1156183797":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/2222991013":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6801/1381479235":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6800/1156183797":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/3450458842":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/202580320":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/2441151017":"2024-09-13T12:16:57.792813+0000","172.21.15.33:0/1001176884":"2024-09-13T12:16:33.559150+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:24:22.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:22.065+0000 7f590786e640 1 -- 172.21.15.33:0/508574926 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f58ec0a2c00 msgr2=0x7f58ec0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:22.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:22.065+0000 7f590786e640 1 --2- 172.21.15.33:0/508574926 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f58ec0a2c00 0x7f58ec0a50c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f58f00058c0 tx=0x7f58f0005850 comp rx=0 tx=0).stop 2024-09-12T12:24:22.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:22.065+0000 7f590786e640 1 -- 172.21.15.33:0/508574926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5900102d40 msgr2=0x7f5900198320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:22.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:22.065+0000 7f590786e640 1 --2- 172.21.15.33:0/508574926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5900102d40 0x7f5900198320 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f58fc00d950 tx=0x7f58fc00de10 comp rx=0 tx=0).stop 2024-09-12T12:24:22.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:22.065+0000 7f590786e640 1 -- 172.21.15.33:0/508574926 shutdown_connections 2024-09-12T12:24:22.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:22.065+0000 7f590786e640 1 --2- 172.21.15.33:0/508574926 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f58ec0a2c00 0x7f58ec0a50c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:22.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:22.065+0000 7f590786e640 1 --2- 172.21.15.33:0/508574926 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f590010c170 0x7f590019cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:22.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:22.065+0000 7f590786e640 1 --2- 172.21.15.33:0/508574926 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5900103660 0x7f5900198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:22.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:22.065+0000 7f590786e640 1 --2- 172.21.15.33:0/508574926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5900102d40 0x7f5900198320 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:22.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:22.065+0000 7f590786e640 1 -- 172.21.15.33:0/508574926 >> 172.21.15.33:0/508574926 conn(0x7f59000fc7a0 msgr2=0x7f59000fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:22.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:22.066+0000 7f590786e640 1 -- 172.21.15.33:0/508574926 shutdown_connections 2024-09-12T12:24:22.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:22.066+0000 7f590786e640 1 -- 172.21.15.33:0/508574926 wait complete. 2024-09-12T12:24:22.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:21 smithi043 ceph-mon[34144]: pgmap v296: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-12T12:24:22.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:21 smithi102 ceph-mon[34799]: pgmap v296: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-12T12:24:22.880 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-12T12:24:23.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:22 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/508574926' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:24:23.141 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:23.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:22 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/508574926' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:24:23.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:22 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/508574926' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:24:23.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:23.609+0000 7f4a7c305640 1 -- 172.21.15.33:0/4208185789 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a741027a0 msgr2=0x7f4a741067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:23.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:23.609+0000 7f4a7c305640 1 --2- 172.21.15.33:0/4208185789 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a741027a0 0x7f4a741067f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4a64009900 tx=0x7f4a6402a410 comp rx=0 tx=0).stop 2024-09-12T12:24:23.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:23.610+0000 7f4a7c305640 1 -- 172.21.15.33:0/4208185789 shutdown_connections 2024-09-12T12:24:23.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:23.610+0000 7f4a7c305640 1 --2- 172.21.15.33:0/4208185789 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a74106f20 0x7f4a7410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:23.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:23.610+0000 7f4a7c305640 1 --2- 172.21.15.33:0/4208185789 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a741027a0 0x7f4a741067f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:23.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:23.610+0000 7f4a7c305640 1 --2- 172.21.15.33:0/4208185789 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a74101df0 0x7f4a741021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:23.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:23.610+0000 7f4a7c305640 1 -- 172.21.15.33:0/4208185789 >> 172.21.15.33:0/4208185789 conn(0x7f4a740fd8f0 msgr2=0x7f4a740ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:23.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:23.610+0000 7f4a7c305640 1 -- 172.21.15.33:0/4208185789 shutdown_connections 2024-09-12T12:24:23.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:23.610+0000 7f4a7c305640 1 -- 172.21.15.33:0/4208185789 wait complete. 2024-09-12T12:24:23.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:23.610+0000 7f4a7c305640 1 Processor -- start 2024-09-12T12:24:23.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:23.611+0000 7f4a7c305640 1 -- start start 2024-09-12T12:24:23.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:23.611+0000 7f4a7c305640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a74101df0 0x7f4a741982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:23.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:23.611+0000 7f4a7c305640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a741027a0 0x7f4a74198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:23.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:23.611+0000 7f4a7c305640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a74106f20 0x7f4a7419cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:23.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:23.611+0000 7f4a7c305640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4a74111df0 con 0x7f4a741027a0 2024-09-12T12:24:23.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:23.611+0000 7f4a7c305640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4a74111c70 con 0x7f4a74106f20 2024-09-12T12:24:23.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:23.611+0000 7f4a7c305640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4a74111f70 con 0x7f4a74101df0 2024-09-12T12:24:23.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:23.611+0000 7f4a798a0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a741027a0 0x7f4a74198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:23.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:23.611+0000 7f4a798a0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a741027a0 0x7f4a74198810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58022/0 (socket says 172.21.15.33:58022) 2024-09-12T12:24:23.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:23.611+0000 7f4a798a0640 1 -- 172.21.15.33:0/4003381886 learned_addr learned my addr 172.21.15.33:0/4003381886 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:24:23.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:23.611+0000 7f4a7a0a1640 1 --2- 172.21.15.33:0/4003381886 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a74101df0 0x7f4a741982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:23.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:23.611+0000 7f4a7a8a2640 1 --2- 172.21.15.33:0/4003381886 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a74106f20 0x7f4a7419cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:23.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:23.611+0000 7f4a798a0640 1 -- 172.21.15.33:0/4003381886 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a74101df0 msgr2=0x7f4a741982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:23.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:23.611+0000 7f4a798a0640 1 --2- 172.21.15.33:0/4003381886 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a74101df0 0x7f4a741982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:23.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:23.611+0000 7f4a798a0640 1 -- 172.21.15.33:0/4003381886 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a74106f20 msgr2=0x7f4a7419cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:23.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:23.611+0000 7f4a798a0640 1 --2- 172.21.15.33:0/4003381886 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a74106f20 0x7f4a7419cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:23.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:23.611+0000 7f4a798a0640 1 -- 172.21.15.33:0/4003381886 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a7419d280 con 0x7f4a741027a0 2024-09-12T12:24:23.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:23.611+0000 7f4a798a0640 1 --2- 172.21.15.33:0/4003381886 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a741027a0 0x7f4a74198810 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4a64005940 tx=0x7f4a64004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:23.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:23.612+0000 7f4a6b7fe640 1 -- 172.21.15.33:0/4003381886 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6403f030 con 0x7f4a741027a0 2024-09-12T12:24:23.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:23.612+0000 7f4a6b7fe640 1 -- 172.21.15.33:0/4003381886 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4a64003aa0 con 0x7f4a741027a0 2024-09-12T12:24:23.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:23.612+0000 7f4a6b7fe640 1 -- 172.21.15.33:0/4003381886 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a64035070 con 0x7f4a741027a0 2024-09-12T12:24:23.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:23.612+0000 7f4a7c305640 1 -- 172.21.15.33:0/4003381886 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a7419d510 con 0x7f4a741027a0 2024-09-12T12:24:23.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:23.612+0000 7f4a7c305640 1 -- 172.21.15.33:0/4003381886 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a741a4e50 con 0x7f4a741027a0 2024-09-12T12:24:23.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:23.613+0000 7f4a7c305640 1 -- 172.21.15.33:0/4003381886 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a741032d0 con 0x7f4a741027a0 2024-09-12T12:24:23.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:23.614+0000 7f4a6b7fe640 1 -- 172.21.15.33:0/4003381886 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f4a64042030 con 0x7f4a741027a0 2024-09-12T12:24:23.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:23.614+0000 7f4a6b7fe640 1 --2- 172.21.15.33:0/4003381886 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f4a600a2c00 0x7f4a600a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:23.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:23.615+0000 7f4a7a0a1640 1 --2- 172.21.15.33:0/4003381886 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f4a600a2c00 0x7f4a600a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:23.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:23.615+0000 7f4a6b7fe640 1 -- 172.21.15.33:0/4003381886 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f4a640efaa0 con 0x7f4a741027a0 2024-09-12T12:24:23.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:23.615+0000 7f4a7a0a1640 1 --2- 172.21.15.33:0/4003381886 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f4a600a2c00 0x7f4a600a50c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4a70005e10 tx=0x7f4a70005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:23.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:23.619+0000 7f4a6b7fe640 1 -- 172.21.15.33:0/4003381886 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4a640bc760 con 0x7f4a741027a0 2024-09-12T12:24:23.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:23.833+0000 7f4a7c305640 1 -- 172.21.15.33:0/4003381886 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f4a7410a130 con 0x7f4a741027a0 2024-09-12T12:24:24.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:23 smithi043 ceph-mon[34144]: pgmap v297: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-12T12:24:24.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:23 smithi102 ceph-mon[34799]: pgmap v297: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-12T12:24:24.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:23 smithi033 ceph-mon[31246]: pgmap v297: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-12T12:24:24.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:24.791+0000 7f4a6b7fe640 1 -- 172.21.15.33:0/4003381886 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7f4a640bc060 con 0x7f4a741027a0 2024-09-12T12:24:24.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:24.794+0000 7f4a7c305640 1 -- 172.21.15.33:0/4003381886 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f4a600a2c00 msgr2=0x7f4a600a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:24.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:24.794+0000 7f4a7c305640 1 --2- 172.21.15.33:0/4003381886 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f4a600a2c00 0x7f4a600a50c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4a70005e10 tx=0x7f4a70005da0 comp rx=0 tx=0).stop 2024-09-12T12:24:24.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:24.794+0000 7f4a7c305640 1 -- 172.21.15.33:0/4003381886 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a741027a0 msgr2=0x7f4a74198810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:24.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:24.794+0000 7f4a7c305640 1 --2- 172.21.15.33:0/4003381886 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a741027a0 0x7f4a74198810 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4a64005940 tx=0x7f4a64004270 comp rx=0 tx=0).stop 2024-09-12T12:24:24.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:24.794+0000 7f4a7c305640 1 -- 172.21.15.33:0/4003381886 shutdown_connections 2024-09-12T12:24:24.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:24.794+0000 7f4a7c305640 1 --2- 172.21.15.33:0/4003381886 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f4a600a2c00 0x7f4a600a50c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:24.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:24.794+0000 7f4a7c305640 1 --2- 172.21.15.33:0/4003381886 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a74106f20 0x7f4a7419cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:24.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:24.794+0000 7f4a7c305640 1 --2- 172.21.15.33:0/4003381886 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a741027a0 0x7f4a74198810 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:24.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:24.794+0000 7f4a7c305640 1 --2- 172.21.15.33:0/4003381886 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a74101df0 0x7f4a741982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:24.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:24.794+0000 7f4a7c305640 1 -- 172.21.15.33:0/4003381886 >> 172.21.15.33:0/4003381886 conn(0x7f4a740fd8f0 msgr2=0x7f4a740fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:24.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:24.795+0000 7f4a7c305640 1 -- 172.21.15.33:0/4003381886 shutdown_connections 2024-09-12T12:24:24.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:24.795+0000 7f4a7c305640 1 -- 172.21.15.33:0/4003381886 wait complete. 2024-09-12T12:24:25.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:24 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/4003381886' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T12:24:25.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:24 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/4003381886' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T12:24:25.166 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:24 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/4003381886' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T12:24:25.612 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-12T12:24:25.612 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-09-12T12:24:25.880 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:25.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:25 smithi033 ceph-mon[31246]: pgmap v298: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-12T12:24:25.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:25 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/4003381886' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-12T12:24:25.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:25 smithi033 ceph-mon[31246]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-12T12:24:26.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:25 smithi043 ceph-mon[34144]: pgmap v298: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-12T12:24:26.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:25 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/4003381886' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-12T12:24:26.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:25 smithi043 ceph-mon[34144]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-12T12:24:26.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:25 smithi102 ceph-mon[34799]: pgmap v298: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-12T12:24:26.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:25 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/4003381886' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-12T12:24:26.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:25 smithi102 ceph-mon[34799]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-12T12:24:26.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.352+0000 7f2dd2d5c640 1 -- 172.21.15.33:0/339825451 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2dcc102ef0 msgr2=0x7f2dcc10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:26.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.352+0000 7f2dd2d5c640 1 --2- 172.21.15.33:0/339825451 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2dcc102ef0 0x7f2dcc10da40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2dc4009ca0 tx=0x7f2dc402a950 comp rx=0 tx=0).stop 2024-09-12T12:24:26.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.352+0000 7f2dd2d5c640 1 -- 172.21.15.33:0/339825451 shutdown_connections 2024-09-12T12:24:26.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.352+0000 7f2dd2d5c640 1 --2- 172.21.15.33:0/339825451 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2dcc102ef0 0x7f2dcc10da40 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.352+0000 7f2dd2d5c640 1 --2- 172.21.15.33:0/339825451 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2dcc102570 0x7f2dcc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.352+0000 7f2dd2d5c640 1 --2- 172.21.15.33:0/339825451 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2dcc100e20 0x7f2dcc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.352+0000 7f2dd2d5c640 1 -- 172.21.15.33:0/339825451 >> 172.21.15.33:0/339825451 conn(0x7f2dcc0fc7d0 msgr2=0x7f2dcc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:26.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.352+0000 7f2dd2d5c640 1 -- 172.21.15.33:0/339825451 shutdown_connections 2024-09-12T12:24:26.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.352+0000 7f2dd2d5c640 1 -- 172.21.15.33:0/339825451 wait complete. 2024-09-12T12:24:26.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.352+0000 7f2dd2d5c640 1 Processor -- start 2024-09-12T12:24:26.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.352+0000 7f2dd2d5c640 1 -- start start 2024-09-12T12:24:26.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.353+0000 7f2dd2d5c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2dcc100e20 0x7f2dcc1992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:26.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.353+0000 7f2dd2d5c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2dcc102570 0x7f2dcc199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:26.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.353+0000 7f2dd2d5c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2dcc102ef0 0x7f2dcc1a4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:26.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.353+0000 7f2dd2d5c640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2dcc110e30 con 0x7f2dcc100e20 2024-09-12T12:24:26.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.353+0000 7f2dd2d5c640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2dcc110cb0 con 0x7f2dcc102570 2024-09-12T12:24:26.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.353+0000 7f2dd2d5c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2dcc110fb0 con 0x7f2dcc102ef0 2024-09-12T12:24:26.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.353+0000 7f2dd0af8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2dcc100e20 0x7f2dcc1992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:26.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.353+0000 7f2dd0af8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2dcc100e20 0x7f2dcc1992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58042/0 (socket says 172.21.15.33:58042) 2024-09-12T12:24:26.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.353+0000 7f2dd0af8640 1 -- 172.21.15.33:0/1368638910 learned_addr learned my addr 172.21.15.33:0/1368638910 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:24:26.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.353+0000 7f2dcbfff640 1 --2- 172.21.15.33:0/1368638910 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2dcc102570 0x7f2dcc199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:26.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.353+0000 7f2dd12f9640 1 --2- 172.21.15.33:0/1368638910 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2dcc102ef0 0x7f2dcc1a4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:26.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.353+0000 7f2dd0af8640 1 -- 172.21.15.33:0/1368638910 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2dcc102ef0 msgr2=0x7f2dcc1a4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:26.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.353+0000 7f2dd0af8640 1 --2- 172.21.15.33:0/1368638910 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2dcc102ef0 0x7f2dcc1a4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.353+0000 7f2dd0af8640 1 -- 172.21.15.33:0/1368638910 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2dcc102570 msgr2=0x7f2dcc199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:26.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.353+0000 7f2dd0af8640 1 --2- 172.21.15.33:0/1368638910 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2dcc102570 0x7f2dcc199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.353+0000 7f2dd0af8640 1 -- 172.21.15.33:0/1368638910 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dcc1a48b0 con 0x7f2dcc100e20 2024-09-12T12:24:26.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.354+0000 7f2dd0af8640 1 --2- 172.21.15.33:0/1368638910 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2dcc100e20 0x7f2dcc1992f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2dc000d950 tx=0x7f2dc000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:26.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.354+0000 7f2dc9ffb640 1 -- 172.21.15.33:0/1368638910 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc0017070 con 0x7f2dcc100e20 2024-09-12T12:24:26.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.354+0000 7f2dc9ffb640 1 -- 172.21.15.33:0/1368638910 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2dc0009c30 con 0x7f2dcc100e20 2024-09-12T12:24:26.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.354+0000 7f2dd2d5c640 1 -- 172.21.15.33:0/1368638910 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dcc1a4a80 con 0x7f2dcc100e20 2024-09-12T12:24:26.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.354+0000 7f2dc9ffb640 1 -- 172.21.15.33:0/1368638910 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc000f620 con 0x7f2dcc100e20 2024-09-12T12:24:26.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.354+0000 7f2dd2d5c640 1 -- 172.21.15.33:0/1368638910 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dcc1a4f90 con 0x7f2dcc100e20 2024-09-12T12:24:26.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.356+0000 7f2dd2d5c640 1 -- 172.21.15.33:0/1368638910 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dcc101200 con 0x7f2dcc100e20 2024-09-12T12:24:26.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.356+0000 7f2dc9ffb640 1 -- 172.21.15.33:0/1368638910 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2dc00109a0 con 0x7f2dcc100e20 2024-09-12T12:24:26.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.357+0000 7f2dc9ffb640 1 --2- 172.21.15.33:0/1368638910 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2dbc0a2b80 0x7f2dbc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:26.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.357+0000 7f2dcbfff640 1 --2- 172.21.15.33:0/1368638910 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2dbc0a2b80 0x7f2dbc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:26.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.357+0000 7f2dc9ffb640 1 -- 172.21.15.33:0/1368638910 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f2dc00ceed0 con 0x7f2dcc100e20 2024-09-12T12:24:26.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.358+0000 7f2dcbfff640 1 --2- 172.21.15.33:0/1368638910 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2dbc0a2b80 0x7f2dbc0a5040 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc06aac0 tx=0x7f2db8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:26.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.362+0000 7f2dc9ffb640 1 -- 172.21.15.33:0/1368638910 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2dc0009de0 con 0x7f2dcc100e20 2024-09-12T12:24:26.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.576+0000 7f2dd2d5c640 1 -- 172.21.15.33:0/1368638910 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f2dcc109090 con 0x7f2dcc100e20 2024-09-12T12:24:26.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.768+0000 7f2dc9ffb640 1 -- 172.21.15.33:0/1368638910 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v19) ==== 105+0+0 (secure 0 0 0) 0x7f2dc009bbf0 con 0x7f2dcc100e20 2024-09-12T12:24:26.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.772+0000 7f2dd2d5c640 1 -- 172.21.15.33:0/1368638910 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2dbc0a2b80 msgr2=0x7f2dbc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:26.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.772+0000 7f2dd2d5c640 1 --2- 172.21.15.33:0/1368638910 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2dbc0a2b80 0x7f2dbc0a5040 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc06aac0 tx=0x7f2db8005f90 comp rx=0 tx=0).stop 2024-09-12T12:24:26.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.772+0000 7f2dd2d5c640 1 -- 172.21.15.33:0/1368638910 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2dcc100e20 msgr2=0x7f2dcc1992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:26.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.772+0000 7f2dd2d5c640 1 --2- 172.21.15.33:0/1368638910 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2dcc100e20 0x7f2dcc1992f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2dc000d950 tx=0x7f2dc000de10 comp rx=0 tx=0).stop 2024-09-12T12:24:26.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.772+0000 7f2dd2d5c640 1 -- 172.21.15.33:0/1368638910 shutdown_connections 2024-09-12T12:24:26.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.772+0000 7f2dd2d5c640 1 --2- 172.21.15.33:0/1368638910 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2dbc0a2b80 0x7f2dbc0a5040 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.772+0000 7f2dd2d5c640 1 --2- 172.21.15.33:0/1368638910 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2dcc102ef0 0x7f2dcc1a4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.772+0000 7f2dd2d5c640 1 --2- 172.21.15.33:0/1368638910 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2dcc102570 0x7f2dcc199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.772+0000 7f2dd2d5c640 1 --2- 172.21.15.33:0/1368638910 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2dcc100e20 0x7f2dcc1992f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.772+0000 7f2dd2d5c640 1 -- 172.21.15.33:0/1368638910 >> 172.21.15.33:0/1368638910 conn(0x7f2dcc0fc7d0 msgr2=0x7f2dcc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:26.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.772+0000 7f2dd2d5c640 1 -- 172.21.15.33:0/1368638910 shutdown_connections 2024-09-12T12:24:26.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:26.772+0000 7f2dd2d5c640 1 -- 172.21.15.33:0/1368638910 wait complete. 2024-09-12T12:24:27.107 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:26 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/1368638910' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-12T12:24:27.107 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:26 smithi033 ceph-mon[31246]: daemon mds.c assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-12T12:24:27.107 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:26 smithi033 ceph-mon[31246]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-12T12:24:27.107 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:26 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/1368638910' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-12T12:24:27.108 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:26 smithi033 ceph-mon[31246]: fsmap cephfs:2 {0=i=up:active,1=c=up:creating} 10 up:standby 2024-09-12T12:24:27.108 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:26 smithi033 ceph-mon[31246]: daemon mds.c is now active in filesystem cephfs as rank 1 2024-09-12T12:24:27.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:26 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/1368638910' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-12T12:24:27.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:26 smithi043 ceph-mon[34144]: daemon mds.c assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-12T12:24:27.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:26 smithi043 ceph-mon[34144]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-12T12:24:27.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:26 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/1368638910' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-12T12:24:27.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:26 smithi043 ceph-mon[34144]: fsmap cephfs:2 {0=i=up:active,1=c=up:creating} 10 up:standby 2024-09-12T12:24:27.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:26 smithi043 ceph-mon[34144]: daemon mds.c is now active in filesystem cephfs as rank 1 2024-09-12T12:24:27.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:26 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/1368638910' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-12T12:24:27.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:26 smithi102 ceph-mon[34799]: daemon mds.c assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-12T12:24:27.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:26 smithi102 ceph-mon[34799]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-12T12:24:27.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:26 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/1368638910' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-12T12:24:27.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:26 smithi102 ceph-mon[34799]: fsmap cephfs:2 {0=i=up:active,1=c=up:creating} 10 up:standby 2024-09-12T12:24:27.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:26 smithi102 ceph-mon[34799]: daemon mds.c is now active in filesystem cephfs as rank 1 2024-09-12T12:24:27.537 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-12T12:24:27.802 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:28.057 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:27 smithi033 ceph-mon[31246]: pgmap v299: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:24:28.057 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:27 smithi033 ceph-mon[31246]: mds.? [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] up:active 2024-09-12T12:24:28.057 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:27 smithi033 ceph-mon[31246]: daemon mds.f assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-12T12:24:28.057 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:27 smithi033 ceph-mon[31246]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-12T12:24:28.057 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:27 smithi033 ceph-mon[31246]: Cluster is now healthy 2024-09-12T12:24:28.057 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:27 smithi033 ceph-mon[31246]: fsmap cephfs:2 {0=i=up:active,1=c=up:active} 10 up:standby 2024-09-12T12:24:28.057 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:27 smithi033 ceph-mon[31246]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:creating} 9 up:standby 2024-09-12T12:24:28.057 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:27 smithi033 ceph-mon[31246]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-09-12T12:24:28.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:27 smithi043 ceph-mon[34144]: pgmap v299: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:24:28.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:27 smithi043 ceph-mon[34144]: mds.? [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] up:active 2024-09-12T12:24:28.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:27 smithi043 ceph-mon[34144]: daemon mds.f assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-12T12:24:28.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:27 smithi043 ceph-mon[34144]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-12T12:24:28.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:27 smithi043 ceph-mon[34144]: Cluster is now healthy 2024-09-12T12:24:28.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:27 smithi043 ceph-mon[34144]: fsmap cephfs:2 {0=i=up:active,1=c=up:active} 10 up:standby 2024-09-12T12:24:28.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:27 smithi043 ceph-mon[34144]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:creating} 9 up:standby 2024-09-12T12:24:28.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:27 smithi043 ceph-mon[34144]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-09-12T12:24:28.146 INFO:journalctl@ceph.mds.i.smithi102.stdout:Sep 12 12:24:27 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-i[64853]: 2024-09-12T12:24:27.784+0000 7fb8defb4640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-12T12:24:28.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:27 smithi102 ceph-mon[34799]: pgmap v299: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:24:28.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:27 smithi102 ceph-mon[34799]: mds.? [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] up:active 2024-09-12T12:24:28.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:27 smithi102 ceph-mon[34799]: daemon mds.f assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-12T12:24:28.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:27 smithi102 ceph-mon[34799]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-12T12:24:28.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:27 smithi102 ceph-mon[34799]: Cluster is now healthy 2024-09-12T12:24:28.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:27 smithi102 ceph-mon[34799]: fsmap cephfs:2 {0=i=up:active,1=c=up:active} 10 up:standby 2024-09-12T12:24:28.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:27 smithi102 ceph-mon[34799]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:creating} 9 up:standby 2024-09-12T12:24:28.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:27 smithi102 ceph-mon[34799]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-09-12T12:24:28.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.290+0000 7fd63003f640 1 -- 172.21.15.33:0/2107100317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd628101de0 msgr2=0x7fd6281021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:28.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.290+0000 7fd63003f640 1 --2- 172.21.15.33:0/2107100317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd628101de0 0x7fd6281021c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd624009900 tx=0x7fd62402a410 comp rx=0 tx=0).stop 2024-09-12T12:24:28.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.290+0000 7fd63003f640 1 -- 172.21.15.33:0/2107100317 shutdown_connections 2024-09-12T12:24:28.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.290+0000 7fd63003f640 1 --2- 172.21.15.33:0/2107100317 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd628106f10 0x7fd62810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:28.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.290+0000 7fd63003f640 1 --2- 172.21.15.33:0/2107100317 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd628102790 0x7fd6281067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:28.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.290+0000 7fd63003f640 1 --2- 172.21.15.33:0/2107100317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd628101de0 0x7fd6281021c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:28.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.290+0000 7fd63003f640 1 -- 172.21.15.33:0/2107100317 >> 172.21.15.33:0/2107100317 conn(0x7fd6280fd8c0 msgr2=0x7fd6280ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:28.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.290+0000 7fd63003f640 1 -- 172.21.15.33:0/2107100317 shutdown_connections 2024-09-12T12:24:28.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.290+0000 7fd63003f640 1 -- 172.21.15.33:0/2107100317 wait complete. 2024-09-12T12:24:28.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.291+0000 7fd63003f640 1 Processor -- start 2024-09-12T12:24:28.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.291+0000 7fd63003f640 1 -- start start 2024-09-12T12:24:28.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.291+0000 7fd63003f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd628101de0 0x7fd628198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:28.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.291+0000 7fd63003f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd628102790 0x7fd6281988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:28.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.291+0000 7fd63003f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd628106f10 0x7fd62819cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:28.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.291+0000 7fd63003f640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd628111e20 con 0x7fd628101de0 2024-09-12T12:24:28.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.291+0000 7fd63003f640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd628111ca0 con 0x7fd628102790 2024-09-12T12:24:28.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.291+0000 7fd63003f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd628111fa0 con 0x7fd628106f10 2024-09-12T12:24:28.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.291+0000 7fd62dddb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd628101de0 0x7fd628198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:28.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.291+0000 7fd62dddb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd628101de0 0x7fd628198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58058/0 (socket says 172.21.15.33:58058) 2024-09-12T12:24:28.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.291+0000 7fd62dddb640 1 -- 172.21.15.33:0/2937732783 learned_addr learned my addr 172.21.15.33:0/2937732783 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:24:28.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.292+0000 7fd62e5dc640 1 --2- 172.21.15.33:0/2937732783 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd628106f10 0x7fd62819cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:28.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.292+0000 7fd62d5da640 1 --2- 172.21.15.33:0/2937732783 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd628102790 0x7fd6281988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:28.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.292+0000 7fd62dddb640 1 -- 172.21.15.33:0/2937732783 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd628106f10 msgr2=0x7fd62819cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:28.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.292+0000 7fd62dddb640 1 --2- 172.21.15.33:0/2937732783 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd628106f10 0x7fd62819cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:28.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.292+0000 7fd62dddb640 1 -- 172.21.15.33:0/2937732783 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd628102790 msgr2=0x7fd6281988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:28.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.292+0000 7fd62dddb640 1 --2- 172.21.15.33:0/2937732783 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd628102790 0x7fd6281988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:28.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.292+0000 7fd62dddb640 1 -- 172.21.15.33:0/2937732783 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd62819d330 con 0x7fd628101de0 2024-09-12T12:24:28.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.292+0000 7fd62dddb640 1 --2- 172.21.15.33:0/2937732783 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd628101de0 0x7fd628198380 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd624005940 tx=0x7fd624004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:28.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.292+0000 7fd61effd640 1 -- 172.21.15.33:0/2937732783 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62403f030 con 0x7fd628101de0 2024-09-12T12:24:28.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.292+0000 7fd63003f640 1 -- 172.21.15.33:0/2937732783 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd62819d5c0 con 0x7fd628101de0 2024-09-12T12:24:28.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.292+0000 7fd61effd640 1 -- 172.21.15.33:0/2937732783 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd624003aa0 con 0x7fd628101de0 2024-09-12T12:24:28.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.292+0000 7fd61effd640 1 -- 172.21.15.33:0/2937732783 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd624035070 con 0x7fd628101de0 2024-09-12T12:24:28.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.292+0000 7fd63003f640 1 -- 172.21.15.33:0/2937732783 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6281a4f00 con 0x7fd628101de0 2024-09-12T12:24:28.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.293+0000 7fd63003f640 1 -- 172.21.15.33:0/2937732783 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6281021c0 con 0x7fd628101de0 2024-09-12T12:24:28.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.295+0000 7fd61effd640 1 -- 172.21.15.33:0/2937732783 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fd624042030 con 0x7fd628101de0 2024-09-12T12:24:28.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.296+0000 7fd61effd640 1 --2- 172.21.15.33:0/2937732783 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd6140a2b80 0x7fd6140a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:28.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.296+0000 7fd62d5da640 1 --2- 172.21.15.33:0/2937732783 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd6140a2b80 0x7fd6140a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:28.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.296+0000 7fd61effd640 1 -- 172.21.15.33:0/2937732783 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7fd6240efc90 con 0x7fd628101de0 2024-09-12T12:24:28.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.296+0000 7fd62d5da640 1 --2- 172.21.15.33:0/2937732783 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd6140a2b80 0x7fd6140a5040 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd618005fd0 tx=0x7fd618005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:28.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.299+0000 7fd61effd640 1 -- 172.21.15.33:0/2937732783 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd6240bc9b0 con 0x7fd628101de0 2024-09-12T12:24:28.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.513+0000 7fd63003f640 1 -- 172.21.15.33:0/2937732783 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fd62810a0f0 con 0x7fd628101de0 2024-09-12T12:24:28.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.776+0000 7fd61effd640 1 -- 172.21.15.33:0/2937732783 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7fd6240b6e20 con 0x7fd628101de0 2024-09-12T12:24:28.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.778+0000 7fd63003f640 1 -- 172.21.15.33:0/2937732783 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd6140a2b80 msgr2=0x7fd6140a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:28.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.778+0000 7fd63003f640 1 --2- 172.21.15.33:0/2937732783 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd6140a2b80 0x7fd6140a5040 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd618005fd0 tx=0x7fd618005850 comp rx=0 tx=0).stop 2024-09-12T12:24:28.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.778+0000 7fd63003f640 1 -- 172.21.15.33:0/2937732783 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd628101de0 msgr2=0x7fd628198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:28.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.778+0000 7fd63003f640 1 --2- 172.21.15.33:0/2937732783 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd628101de0 0x7fd628198380 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd624005940 tx=0x7fd624004270 comp rx=0 tx=0).stop 2024-09-12T12:24:28.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.779+0000 7fd63003f640 1 -- 172.21.15.33:0/2937732783 shutdown_connections 2024-09-12T12:24:28.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.779+0000 7fd63003f640 1 --2- 172.21.15.33:0/2937732783 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd6140a2b80 0x7fd6140a5040 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:28.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.779+0000 7fd63003f640 1 --2- 172.21.15.33:0/2937732783 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd628106f10 0x7fd62819cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:28.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.779+0000 7fd63003f640 1 --2- 172.21.15.33:0/2937732783 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd628102790 0x7fd6281988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:28.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.779+0000 7fd63003f640 1 --2- 172.21.15.33:0/2937732783 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd628101de0 0x7fd628198380 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:28.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.779+0000 7fd63003f640 1 -- 172.21.15.33:0/2937732783 >> 172.21.15.33:0/2937732783 conn(0x7fd6280fd8c0 msgr2=0x7fd6280fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:28.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.779+0000 7fd63003f640 1 -- 172.21.15.33:0/2937732783 shutdown_connections 2024-09-12T12:24:28.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:28.779+0000 7fd63003f640 1 -- 172.21.15.33:0/2937732783 wait complete. 2024-09-12T12:24:29.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:28 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/2937732783' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T12:24:29.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:28 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/2937732783' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-12T12:24:29.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:28 smithi043 ceph-mon[34144]: mds.? [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] up:active 2024-09-12T12:24:29.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:28 smithi043 ceph-mon[34144]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 9 up:standby 2024-09-12T12:24:29.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:28 smithi043 ceph-mon[34144]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T12:24:29.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:28 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/2937732783' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T12:24:29.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:28 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/2937732783' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-12T12:24:29.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:28 smithi102 ceph-mon[34799]: mds.? [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] up:active 2024-09-12T12:24:29.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:28 smithi102 ceph-mon[34799]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 9 up:standby 2024-09-12T12:24:29.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:28 smithi102 ceph-mon[34799]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T12:24:29.150 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:28 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/2937732783' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T12:24:29.150 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:28 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/2937732783' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-12T12:24:29.150 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:28 smithi033 ceph-mon[31246]: mds.? [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] up:active 2024-09-12T12:24:29.150 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:28 smithi033 ceph-mon[31246]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 9 up:standby 2024-09-12T12:24:29.151 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:28 smithi033 ceph-mon[31246]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T12:24:29.608 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-12T12:24:29.867 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:29.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:29 smithi033 ceph-mon[31246]: pgmap v300: 129 pgs: 129 active+clean; 582 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s wr, 1 op/s 2024-09-12T12:24:30.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:29 smithi043 ceph-mon[34144]: pgmap v300: 129 pgs: 129 active+clean; 582 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s wr, 1 op/s 2024-09-12T12:24:30.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:29 smithi102 ceph-mon[34799]: pgmap v300: 129 pgs: 129 active+clean; 582 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s wr, 1 op/s 2024-09-12T12:24:30.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.367+0000 7fc3bddcc640 1 -- 172.21.15.33:0/803443570 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3b8101de0 msgr2=0x7fc3b81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:30.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.367+0000 7fc3bddcc640 1 --2- 172.21.15.33:0/803443570 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3b8101de0 0x7fc3b81021c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc3a8009900 tx=0x7fc3a802a410 comp rx=0 tx=0).stop 2024-09-12T12:24:30.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.367+0000 7fc3bddcc640 1 -- 172.21.15.33:0/803443570 shutdown_connections 2024-09-12T12:24:30.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.367+0000 7fc3bddcc640 1 --2- 172.21.15.33:0/803443570 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3b8106f10 0x7fc3b810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:30.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.367+0000 7fc3bddcc640 1 --2- 172.21.15.33:0/803443570 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3b8102790 0x7fc3b81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:30.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.367+0000 7fc3bddcc640 1 --2- 172.21.15.33:0/803443570 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3b8101de0 0x7fc3b81021c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:30.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.367+0000 7fc3bddcc640 1 -- 172.21.15.33:0/803443570 >> 172.21.15.33:0/803443570 conn(0x7fc3b80fd8c0 msgr2=0x7fc3b80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:30.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.367+0000 7fc3bddcc640 1 -- 172.21.15.33:0/803443570 shutdown_connections 2024-09-12T12:24:30.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.367+0000 7fc3bddcc640 1 -- 172.21.15.33:0/803443570 wait complete. 2024-09-12T12:24:30.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.368+0000 7fc3bddcc640 1 Processor -- start 2024-09-12T12:24:30.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.368+0000 7fc3bddcc640 1 -- start start 2024-09-12T12:24:30.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.368+0000 7fc3bddcc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3b8101de0 0x7fc3b8198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:30.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.368+0000 7fc3bddcc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3b8102790 0x7fc3b81988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:30.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.368+0000 7fc3bddcc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3b8106f10 0x7fc3b819cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:30.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.368+0000 7fc3bddcc640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b8111e20 con 0x7fc3b8101de0 2024-09-12T12:24:30.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.368+0000 7fc3bddcc640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b8111ca0 con 0x7fc3b8106f10 2024-09-12T12:24:30.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.368+0000 7fc3bddcc640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b8111fa0 con 0x7fc3b8102790 2024-09-12T12:24:30.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.368+0000 7fc3b77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3b8101de0 0x7fc3b8198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:30.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.368+0000 7fc3aeffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3b8102790 0x7fc3b81988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:30.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.368+0000 7fc3b77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3b8101de0 0x7fc3b8198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58076/0 (socket says 172.21.15.33:58076) 2024-09-12T12:24:30.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.368+0000 7fc3b77fe640 1 -- 172.21.15.33:0/1444619911 learned_addr learned my addr 172.21.15.33:0/1444619911 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:24:30.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.368+0000 7fc3b7fff640 1 --2- 172.21.15.33:0/1444619911 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3b8106f10 0x7fc3b819cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:30.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.369+0000 7fc3b77fe640 1 -- 172.21.15.33:0/1444619911 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3b8102790 msgr2=0x7fc3b81988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:30.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.369+0000 7fc3b77fe640 1 --2- 172.21.15.33:0/1444619911 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3b8102790 0x7fc3b81988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:30.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.369+0000 7fc3b77fe640 1 -- 172.21.15.33:0/1444619911 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3b8106f10 msgr2=0x7fc3b819cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:30.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.369+0000 7fc3b77fe640 1 --2- 172.21.15.33:0/1444619911 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3b8106f10 0x7fc3b819cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:30.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.369+0000 7fc3b77fe640 1 -- 172.21.15.33:0/1444619911 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3b819d310 con 0x7fc3b8101de0 2024-09-12T12:24:30.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.369+0000 7fc3b77fe640 1 --2- 172.21.15.33:0/1444619911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3b8101de0 0x7fc3b8198360 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc3a8006010 tx=0x7fc3a8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:30.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.369+0000 7fc3b57fa640 1 -- 172.21.15.33:0/1444619911 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a803f030 con 0x7fc3b8101de0 2024-09-12T12:24:30.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.369+0000 7fc3bddcc640 1 -- 172.21.15.33:0/1444619911 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3b819d5a0 con 0x7fc3b8101de0 2024-09-12T12:24:30.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.369+0000 7fc3b57fa640 1 -- 172.21.15.33:0/1444619911 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc3a80035f0 con 0x7fc3b8101de0 2024-09-12T12:24:30.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.369+0000 7fc3b57fa640 1 -- 172.21.15.33:0/1444619911 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a8035070 con 0x7fc3b8101de0 2024-09-12T12:24:30.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.369+0000 7fc3bddcc640 1 -- 172.21.15.33:0/1444619911 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3b81a4ee0 con 0x7fc3b8101de0 2024-09-12T12:24:30.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.370+0000 7fc3bddcc640 1 -- 172.21.15.33:0/1444619911 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3b81021c0 con 0x7fc3b8101de0 2024-09-12T12:24:30.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.371+0000 7fc3b57fa640 1 -- 172.21.15.33:0/1444619911 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fc3a8003b10 con 0x7fc3b8101de0 2024-09-12T12:24:30.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.372+0000 7fc3b57fa640 1 --2- 172.21.15.33:0/1444619911 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc3a40a2b80 0x7fc3a40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:30.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.372+0000 7fc3b57fa640 1 -- 172.21.15.33:0/1444619911 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7fc3a80eff30 con 0x7fc3b8101de0 2024-09-12T12:24:30.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.372+0000 7fc3aeffd640 1 --2- 172.21.15.33:0/1444619911 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc3a40a2b80 0x7fc3a40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:30.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.373+0000 7fc3aeffd640 1 --2- 172.21.15.33:0/1444619911 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc3a40a2b80 0x7fc3a40a5040 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80ffdc0 tx=0x7fc3a000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:30.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.375+0000 7fc3b57fa640 1 -- 172.21.15.33:0/1444619911 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc3a80bc600 con 0x7fc3b8101de0 2024-09-12T12:24:30.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.589+0000 7fc3bddcc640 1 -- 172.21.15.33:0/1444619911 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fc3b810a0f0 con 0x7fc3b8101de0 2024-09-12T12:24:30.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.815+0000 7fc3b57fa640 1 -- 172.21.15.33:0/1444619911 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v24) ==== 115+0+0 (secure 0 0 0) 0x7fc3a80c0900 con 0x7fc3b8101de0 2024-09-12T12:24:30.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.817+0000 7fc3bddcc640 1 -- 172.21.15.33:0/1444619911 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc3a40a2b80 msgr2=0x7fc3a40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:30.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.817+0000 7fc3bddcc640 1 --2- 172.21.15.33:0/1444619911 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc3a40a2b80 0x7fc3a40a5040 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80ffdc0 tx=0x7fc3a000a2d0 comp rx=0 tx=0).stop 2024-09-12T12:24:30.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.817+0000 7fc3bddcc640 1 -- 172.21.15.33:0/1444619911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3b8101de0 msgr2=0x7fc3b8198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:30.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.817+0000 7fc3bddcc640 1 --2- 172.21.15.33:0/1444619911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3b8101de0 0x7fc3b8198360 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc3a8006010 tx=0x7fc3a8004270 comp rx=0 tx=0).stop 2024-09-12T12:24:30.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.817+0000 7fc3bddcc640 1 -- 172.21.15.33:0/1444619911 shutdown_connections 2024-09-12T12:24:30.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.817+0000 7fc3bddcc640 1 --2- 172.21.15.33:0/1444619911 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc3a40a2b80 0x7fc3a40a5040 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:30.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.817+0000 7fc3bddcc640 1 --2- 172.21.15.33:0/1444619911 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3b8106f10 0x7fc3b819cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:30.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.817+0000 7fc3bddcc640 1 --2- 172.21.15.33:0/1444619911 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3b8102790 0x7fc3b81988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:30.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.817+0000 7fc3bddcc640 1 --2- 172.21.15.33:0/1444619911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3b8101de0 0x7fc3b8198360 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:30.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.817+0000 7fc3bddcc640 1 -- 172.21.15.33:0/1444619911 >> 172.21.15.33:0/1444619911 conn(0x7fc3b80fd8c0 msgr2=0x7fc3b80fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:30.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.818+0000 7fc3bddcc640 1 -- 172.21.15.33:0/1444619911 shutdown_connections 2024-09-12T12:24:30.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:30.818+0000 7fc3bddcc640 1 -- 172.21.15.33:0/1444619911 wait complete. 2024-09-12T12:24:30.980 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:30 smithi033 ceph-mon[31246]: pgmap v301: 129 pgs: 129 active+clean; 582 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s rd, 938 B/s wr, 3 op/s 2024-09-12T12:24:30.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:30 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/1444619911' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T12:24:31.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:30 smithi043 ceph-mon[34144]: pgmap v301: 129 pgs: 129 active+clean; 582 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s rd, 938 B/s wr, 3 op/s 2024-09-12T12:24:31.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:30 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/1444619911' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T12:24:31.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:30 smithi102 ceph-mon[34799]: pgmap v301: 129 pgs: 129 active+clean; 582 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s rd, 938 B/s wr, 3 op/s 2024-09-12T12:24:31.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:30 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/1444619911' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T12:24:31.579 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-09-12T12:24:31.579 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-12T12:24:31.844 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:32.087 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:31 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/1444619911' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-12T12:24:32.087 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:31 smithi033 ceph-mon[31246]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T12:24:32.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:31 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/1444619911' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-12T12:24:32.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:31 smithi043 ceph-mon[34144]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T12:24:32.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:31 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/1444619911' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-12T12:24:32.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:31 smithi102 ceph-mon[34799]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T12:24:32.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.320+0000 7fc9e3562640 1 -- 172.21.15.33:0/3280756996 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9dc101de0 msgr2=0x7fc9dc1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:32.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.320+0000 7fc9e3562640 1 --2- 172.21.15.33:0/3280756996 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9dc101de0 0x7fc9dc1021c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8009900 tx=0x7fc9d802a410 comp rx=0 tx=0).stop 2024-09-12T12:24:32.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.320+0000 7fc9e3562640 1 -- 172.21.15.33:0/3280756996 shutdown_connections 2024-09-12T12:24:32.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.320+0000 7fc9e3562640 1 --2- 172.21.15.33:0/3280756996 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9dc106f10 0x7fc9dc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:32.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.321+0000 7fc9e3562640 1 --2- 172.21.15.33:0/3280756996 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9dc102790 0x7fc9dc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:32.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.321+0000 7fc9e3562640 1 --2- 172.21.15.33:0/3280756996 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9dc101de0 0x7fc9dc1021c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:32.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.321+0000 7fc9e3562640 1 -- 172.21.15.33:0/3280756996 >> 172.21.15.33:0/3280756996 conn(0x7fc9dc0fd8c0 msgr2=0x7fc9dc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:32.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.321+0000 7fc9e3562640 1 -- 172.21.15.33:0/3280756996 shutdown_connections 2024-09-12T12:24:32.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.321+0000 7fc9e3562640 1 -- 172.21.15.33:0/3280756996 wait complete. 2024-09-12T12:24:32.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.321+0000 7fc9e3562640 1 Processor -- start 2024-09-12T12:24:32.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.321+0000 7fc9e3562640 1 -- start start 2024-09-12T12:24:32.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.322+0000 7fc9e3562640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9dc101de0 0x7fc9dc198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:32.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.322+0000 7fc9e3562640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9dc102790 0x7fc9dc1988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:32.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.322+0000 7fc9e3562640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9dc106f10 0x7fc9dc19cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:32.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.322+0000 7fc9e3562640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc9dc111e20 con 0x7fc9dc102790 2024-09-12T12:24:32.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.322+0000 7fc9e3562640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc9dc111ca0 con 0x7fc9dc101de0 2024-09-12T12:24:32.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.322+0000 7fc9e3562640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc9dc111fa0 con 0x7fc9dc106f10 2024-09-12T12:24:32.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.322+0000 7fc9e0afd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9dc102790 0x7fc9dc1988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:32.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.322+0000 7fc9e0afd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9dc102790 0x7fc9dc1988c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47030/0 (socket says 172.21.15.33:47030) 2024-09-12T12:24:32.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.322+0000 7fc9e0afd640 1 -- 172.21.15.33:0/440824718 learned_addr learned my addr 172.21.15.33:0/440824718 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:24:32.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.322+0000 7fc9e12fe640 1 --2- 172.21.15.33:0/440824718 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9dc101de0 0x7fc9dc198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:32.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.322+0000 7fc9e1aff640 1 --2- 172.21.15.33:0/440824718 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9dc106f10 0x7fc9dc19cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:32.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.322+0000 7fc9e0afd640 1 -- 172.21.15.33:0/440824718 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9dc106f10 msgr2=0x7fc9dc19cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:32.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.322+0000 7fc9e0afd640 1 --2- 172.21.15.33:0/440824718 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9dc106f10 0x7fc9dc19cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:32.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.322+0000 7fc9e0afd640 1 -- 172.21.15.33:0/440824718 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9dc101de0 msgr2=0x7fc9dc198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:32.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.322+0000 7fc9e0afd640 1 --2- 172.21.15.33:0/440824718 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9dc101de0 0x7fc9dc198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:32.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.322+0000 7fc9e0afd640 1 -- 172.21.15.33:0/440824718 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9dc19d330 con 0x7fc9dc102790 2024-09-12T12:24:32.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.322+0000 7fc9e1aff640 1 --2- 172.21.15.33:0/440824718 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9dc106f10 0x7fc9dc19cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:24:32.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.323+0000 7fc9e0afd640 1 --2- 172.21.15.33:0/440824718 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9dc102790 0x7fc9dc1988c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc00e9f0 tx=0x7fc9cc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:32.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.323+0000 7fc9d27fc640 1 -- 172.21.15.33:0/440824718 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc00cd80 con 0x7fc9dc102790 2024-09-12T12:24:32.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.323+0000 7fc9d27fc640 1 -- 172.21.15.33:0/440824718 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc9cc0054d0 con 0x7fc9dc102790 2024-09-12T12:24:32.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.323+0000 7fc9e3562640 1 -- 172.21.15.33:0/440824718 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9dc19d620 con 0x7fc9dc102790 2024-09-12T12:24:32.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.323+0000 7fc9d27fc640 1 -- 172.21.15.33:0/440824718 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc010490 con 0x7fc9dc102790 2024-09-12T12:24:32.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.323+0000 7fc9e3562640 1 -- 172.21.15.33:0/440824718 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9dc1a4f00 con 0x7fc9dc102790 2024-09-12T12:24:32.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.324+0000 7fc9e3562640 1 -- 172.21.15.33:0/440824718 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9dc1021c0 con 0x7fc9dc102790 2024-09-12T12:24:32.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.325+0000 7fc9d27fc640 1 -- 172.21.15.33:0/440824718 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fc9cc005000 con 0x7fc9dc102790 2024-09-12T12:24:32.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.326+0000 7fc9d27fc640 1 --2- 172.21.15.33:0/440824718 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc9c80a2b80 0x7fc9c80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:32.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.326+0000 7fc9d27fc640 1 -- 172.21.15.33:0/440824718 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7fc9cc0cf8d0 con 0x7fc9dc102790 2024-09-12T12:24:32.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.326+0000 7fc9e12fe640 1 --2- 172.21.15.33:0/440824718 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc9c80a2b80 0x7fc9c80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:32.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.326+0000 7fc9e12fe640 1 --2- 172.21.15.33:0/440824718 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc9c80a2b80 0x7fc9c80a5040 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8031440 tx=0x7fc9d8005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:32.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.329+0000 7fc9d27fc640 1 -- 172.21.15.33:0/440824718 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc9cc0541b0 con 0x7fc9dc102790 2024-09-12T12:24:32.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.527+0000 7fc9e3562640 1 -- 172.21.15.33:0/440824718 --> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fc9dc062630 con 0x7fc9c80a2b80 2024-09-12T12:24:32.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.551+0000 7fc9d27fc640 1 -- 172.21.15.33:0/440824718 <== mgr.14150 v2:172.21.15.33:6800/176202431 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc9dc062630 con 0x7fc9c80a2b80 2024-09-12T12:24:32.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.554+0000 7fc9e3562640 1 -- 172.21.15.33:0/440824718 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc9c80a2b80 msgr2=0x7fc9c80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:32.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.554+0000 7fc9e3562640 1 --2- 172.21.15.33:0/440824718 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc9c80a2b80 0x7fc9c80a5040 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8031440 tx=0x7fc9d8005b50 comp rx=0 tx=0).stop 2024-09-12T12:24:32.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.554+0000 7fc9e3562640 1 -- 172.21.15.33:0/440824718 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9dc102790 msgr2=0x7fc9dc1988c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:32.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.554+0000 7fc9e3562640 1 --2- 172.21.15.33:0/440824718 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9dc102790 0x7fc9dc1988c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc00e9f0 tx=0x7fc9cc00edf0 comp rx=0 tx=0).stop 2024-09-12T12:24:32.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.554+0000 7fc9e3562640 1 -- 172.21.15.33:0/440824718 shutdown_connections 2024-09-12T12:24:32.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.554+0000 7fc9e3562640 1 --2- 172.21.15.33:0/440824718 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc9c80a2b80 0x7fc9c80a5040 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:32.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.554+0000 7fc9e3562640 1 --2- 172.21.15.33:0/440824718 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9dc106f10 0x7fc9dc19cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:32.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.554+0000 7fc9e3562640 1 --2- 172.21.15.33:0/440824718 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9dc102790 0x7fc9dc1988c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:32.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.554+0000 7fc9e3562640 1 --2- 172.21.15.33:0/440824718 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9dc101de0 0x7fc9dc198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:32.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.554+0000 7fc9e3562640 1 -- 172.21.15.33:0/440824718 >> 172.21.15.33:0/440824718 conn(0x7fc9dc0fd8c0 msgr2=0x7fc9dc0fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:32.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.554+0000 7fc9e3562640 1 -- 172.21.15.33:0/440824718 shutdown_connections 2024-09-12T12:24:32.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:32.554+0000 7fc9e3562640 1 -- 172.21.15.33:0/440824718 wait complete. 2024-09-12T12:24:32.822 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:24:32 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:24:32.532+0000 7fd982fe7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T12:24:32.822 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:24:32 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:24:32.532+0000 7fd982fe7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T12:24:32.822 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:24:32 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:24:32.532+0000 7fd982fe7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T12:24:32.822 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:24:32 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:24:32.532+0000 7fd982fe7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T12:24:32.822 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:24:32 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:24:32.532+0000 7fd982fe7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T12:24:33.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:32 smithi043 ceph-mon[34144]: pgmap v302: 129 pgs: 129 active+clean; 583 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-12T12:24:33.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:32 smithi043 ceph-mon[34144]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:24:33.146 INFO:journalctl@ceph.mds.i.smithi102.stdout:Sep 12 12:24:32 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-i[64853]: 2024-09-12T12:24:32.785+0000 7fb8defb4640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-12T12:24:33.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:32 smithi102 ceph-mon[34799]: pgmap v302: 129 pgs: 129 active+clean; 583 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-12T12:24:33.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:32 smithi102 ceph-mon[34799]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:24:33.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:32 smithi033 ceph-mon[31246]: pgmap v302: 129 pgs: 129 active+clean; 583 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-12T12:24:33.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:32 smithi033 ceph-mon[31246]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:24:33.336 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-12T12:24:33.601 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:34.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.150+0000 7fb674616640 1 -- 172.21.15.33:0/156907892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb66c102de0 msgr2=0x7fb66c1031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:34.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.150+0000 7fb674616640 1 --2- 172.21.15.33:0/156907892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb66c102de0 0x7fb66c1031c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb668009900 tx=0x7fb66802a480 comp rx=0 tx=0).stop 2024-09-12T12:24:34.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.150+0000 7fb674616640 1 -- 172.21.15.33:0/156907892 shutdown_connections 2024-09-12T12:24:34.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.150+0000 7fb674616640 1 --2- 172.21.15.33:0/156907892 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb66c10c180 0x7fb66c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:34.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.150+0000 7fb674616640 1 --2- 172.21.15.33:0/156907892 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb66c103700 0x7fb66c10bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:34.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.150+0000 7fb674616640 1 --2- 172.21.15.33:0/156907892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb66c102de0 0x7fb66c1031c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:34.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.150+0000 7fb674616640 1 -- 172.21.15.33:0/156907892 >> 172.21.15.33:0/156907892 conn(0x7fb66c0fc7a0 msgr2=0x7fb66c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:34.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.150+0000 7fb674616640 1 -- 172.21.15.33:0/156907892 shutdown_connections 2024-09-12T12:24:34.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.150+0000 7fb674616640 1 -- 172.21.15.33:0/156907892 wait complete. 2024-09-12T12:24:34.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.151+0000 7fb674616640 1 Processor -- start 2024-09-12T12:24:34.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.151+0000 7fb674616640 1 -- start start 2024-09-12T12:24:34.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.151+0000 7fb674616640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb66c102de0 0x7fb66c19a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:34.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.151+0000 7fb674616640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb66c103700 0x7fb66c19aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:34.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.151+0000 7fb674616640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb66c10c180 0x7fb66c19ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:34.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.151+0000 7fb674616640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb66c111de0 con 0x7fb66c103700 2024-09-12T12:24:34.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.151+0000 7fb674616640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb66c111c60 con 0x7fb66c10c180 2024-09-12T12:24:34.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.151+0000 7fb674616640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb66c111f60 con 0x7fb66c102de0 2024-09-12T12:24:34.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.151+0000 7fb671bb1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb66c103700 0x7fb66c19aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:34.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.151+0000 7fb671bb1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb66c103700 0x7fb66c19aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47076/0 (socket says 172.21.15.33:47076) 2024-09-12T12:24:34.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.151+0000 7fb671bb1640 1 -- 172.21.15.33:0/1002304253 learned_addr learned my addr 172.21.15.33:0/1002304253 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:24:34.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.151+0000 7fb6723b2640 1 --2- 172.21.15.33:0/1002304253 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb66c102de0 0x7fb66c19a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:34.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.151+0000 7fb672bb3640 1 --2- 172.21.15.33:0/1002304253 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb66c10c180 0x7fb66c19ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:34.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.151+0000 7fb671bb1640 1 -- 172.21.15.33:0/1002304253 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb66c102de0 msgr2=0x7fb66c19a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:34.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.151+0000 7fb671bb1640 1 --2- 172.21.15.33:0/1002304253 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb66c102de0 0x7fb66c19a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:34.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.151+0000 7fb671bb1640 1 -- 172.21.15.33:0/1002304253 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb66c10c180 msgr2=0x7fb66c19ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:34.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.151+0000 7fb671bb1640 1 --2- 172.21.15.33:0/1002304253 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb66c10c180 0x7fb66c19ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:34.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.151+0000 7fb671bb1640 1 -- 172.21.15.33:0/1002304253 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb66c19f530 con 0x7fb66c103700 2024-09-12T12:24:34.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.151+0000 7fb672bb3640 1 --2- 172.21.15.33:0/1002304253 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb66c10c180 0x7fb66c19ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:24:34.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.152+0000 7fb671bb1640 1 --2- 172.21.15.33:0/1002304253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb66c103700 0x7fb66c19aac0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb65c00d950 tx=0x7fb65c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:34.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.152+0000 7fb6637fe640 1 -- 172.21.15.33:0/1002304253 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb65c017070 con 0x7fb66c103700 2024-09-12T12:24:34.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.152+0000 7fb6637fe640 1 -- 172.21.15.33:0/1002304253 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb65c009c30 con 0x7fb66c103700 2024-09-12T12:24:34.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.152+0000 7fb674616640 1 -- 172.21.15.33:0/1002304253 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb66c19f820 con 0x7fb66c103700 2024-09-12T12:24:34.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.152+0000 7fb6637fe640 1 -- 172.21.15.33:0/1002304253 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb65c00f620 con 0x7fb66c103700 2024-09-12T12:24:34.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.152+0000 7fb674616640 1 -- 172.21.15.33:0/1002304253 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb66c1a7100 con 0x7fb66c103700 2024-09-12T12:24:34.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.153+0000 7fb674616640 1 -- 172.21.15.33:0/1002304253 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb66c1031c0 con 0x7fb66c103700 2024-09-12T12:24:34.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.154+0000 7fb6637fe640 1 -- 172.21.15.33:0/1002304253 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb65c0109a0 con 0x7fb66c103700 2024-09-12T12:24:34.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.155+0000 7fb6637fe640 1 --2- 172.21.15.33:0/1002304253 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb6580a2c00 0x7fb6580a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:34.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.155+0000 7fb6637fe640 1 -- 172.21.15.33:0/1002304253 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7fb65c0ceeb0 con 0x7fb66c103700 2024-09-12T12:24:34.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.155+0000 7fb6723b2640 1 --2- 172.21.15.33:0/1002304253 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb6580a2c00 0x7fb6580a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:34.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.156+0000 7fb6723b2640 1 --2- 172.21.15.33:0/1002304253 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb6580a2c00 0x7fb6580a50c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb668031440 tx=0x7fb668005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:34.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.159+0000 7fb6637fe640 1 -- 172.21.15.33:0/1002304253 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb65c009de0 con 0x7fb66c103700 2024-09-12T12:24:34.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.364+0000 7fb674616640 1 -- 172.21.15.33:0/1002304253 --> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fb66c102160 con 0x7fb6580a2c00 2024-09-12T12:24:34.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.393+0000 7fb6637fe640 1 -- 172.21.15.33:0/1002304253 <== mgr.14150 v2:172.21.15.33:6800/176202431 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb66c102160 con 0x7fb6580a2c00 2024-09-12T12:24:34.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.395+0000 7fb674616640 1 -- 172.21.15.33:0/1002304253 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb6580a2c00 msgr2=0x7fb6580a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:34.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.395+0000 7fb674616640 1 --2- 172.21.15.33:0/1002304253 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb6580a2c00 0x7fb6580a50c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb668031440 tx=0x7fb668005b50 comp rx=0 tx=0).stop 2024-09-12T12:24:34.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.395+0000 7fb674616640 1 -- 172.21.15.33:0/1002304253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb66c103700 msgr2=0x7fb66c19aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:34.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.395+0000 7fb674616640 1 --2- 172.21.15.33:0/1002304253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb66c103700 0x7fb66c19aac0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb65c00d950 tx=0x7fb65c00de10 comp rx=0 tx=0).stop 2024-09-12T12:24:34.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.396+0000 7fb674616640 1 -- 172.21.15.33:0/1002304253 shutdown_connections 2024-09-12T12:24:34.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.396+0000 7fb674616640 1 --2- 172.21.15.33:0/1002304253 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb6580a2c00 0x7fb6580a50c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:34.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.396+0000 7fb674616640 1 --2- 172.21.15.33:0/1002304253 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb66c10c180 0x7fb66c19ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:34.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.396+0000 7fb674616640 1 --2- 172.21.15.33:0/1002304253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb66c103700 0x7fb66c19aac0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:34.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.396+0000 7fb674616640 1 --2- 172.21.15.33:0/1002304253 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb66c102de0 0x7fb66c19a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:34.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.396+0000 7fb674616640 1 -- 172.21.15.33:0/1002304253 >> 172.21.15.33:0/1002304253 conn(0x7fb66c0fc7a0 msgr2=0x7fb66c101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:34.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.396+0000 7fb674616640 1 -- 172.21.15.33:0/1002304253 shutdown_connections 2024-09-12T12:24:34.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:34.396+0000 7fb674616640 1 -- 172.21.15.33:0/1002304253 wait complete. 2024-09-12T12:24:34.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:34 smithi033 ceph-mon[31246]: pgmap v303: 129 pgs: 129 active+clean; 591 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-09-12T12:24:34.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:34 smithi033 ceph-mon[31246]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:24:35.167 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-12T12:24:35.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:34 smithi043 ceph-mon[34144]: pgmap v303: 129 pgs: 129 active+clean; 591 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-09-12T12:24:35.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:34 smithi043 ceph-mon[34144]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:24:35.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:34 smithi102 ceph-mon[34799]: pgmap v303: 129 pgs: 129 active+clean; 591 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-09-12T12:24:35.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:34 smithi102 ceph-mon[34799]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:24:35.429 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:35.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:35.934+0000 7f33366f1640 1 -- 172.21.15.33:0/4030522017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3330101420 msgr2=0x7f333010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:35.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:35.934+0000 7f33366f1640 1 --2- 172.21.15.33:0/4030522017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3330101420 0x7f333010d950 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3328009cd0 tx=0x7f332802a8e0 comp rx=0 tx=0).stop 2024-09-12T12:24:35.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:35.934+0000 7f33366f1640 1 -- 172.21.15.33:0/4030522017 shutdown_connections 2024-09-12T12:24:35.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:35.934+0000 7f33366f1640 1 --2- 172.21.15.33:0/4030522017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3330101420 0x7f333010d950 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:35.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:35.934+0000 7f33366f1640 1 --2- 172.21.15.33:0/4030522017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3330100a80 0x7f3330100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:35.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:35.934+0000 7f33366f1640 1 --2- 172.21.15.33:0/4030522017 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3330106a80 0x7f3330106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:35.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:35.934+0000 7f33366f1640 1 -- 172.21.15.33:0/4030522017 >> 172.21.15.33:0/4030522017 conn(0x7f33300fc7a0 msgr2=0x7f33300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:35.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:35.934+0000 7f33366f1640 1 -- 172.21.15.33:0/4030522017 shutdown_connections 2024-09-12T12:24:35.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:35.934+0000 7f33366f1640 1 -- 172.21.15.33:0/4030522017 wait complete. 2024-09-12T12:24:35.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:35.935+0000 7f33366f1640 1 Processor -- start 2024-09-12T12:24:35.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:35.935+0000 7f33366f1640 1 -- start start 2024-09-12T12:24:35.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:35.936+0000 7f33366f1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3330100a80 0x7f33301972d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:35.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:35.936+0000 7f33366f1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3330101420 0x7f3330197810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:35.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:35.936+0000 7f33366f1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3330106a80 0x7f333019bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:35.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:35.936+0000 7f33366f1640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3330110d70 con 0x7f3330101420 2024-09-12T12:24:35.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:35.936+0000 7f33366f1640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3330110bf0 con 0x7f3330106a80 2024-09-12T12:24:35.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:35.936+0000 7f33366f1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3330110ef0 con 0x7f3330100a80 2024-09-12T12:24:35.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:35.936+0000 7f332f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3330101420 0x7f3330197810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:35.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:35.936+0000 7f332f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3330101420 0x7f3330197810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47092/0 (socket says 172.21.15.33:47092) 2024-09-12T12:24:35.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:35.936+0000 7f332f7fe640 1 -- 172.21.15.33:0/2008714028 learned_addr learned my addr 172.21.15.33:0/2008714028 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:24:35.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:35.936+0000 7f3334c8e640 1 --2- 172.21.15.33:0/2008714028 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3330106a80 0x7f333019bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:35.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:35.936+0000 7f332ffff640 1 --2- 172.21.15.33:0/2008714028 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3330100a80 0x7f33301972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:35.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:35.936+0000 7f332f7fe640 1 -- 172.21.15.33:0/2008714028 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3330100a80 msgr2=0x7f33301972d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:35.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:35.936+0000 7f332f7fe640 1 --2- 172.21.15.33:0/2008714028 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3330100a80 0x7f33301972d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:35.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:35.936+0000 7f332f7fe640 1 -- 172.21.15.33:0/2008714028 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3330106a80 msgr2=0x7f333019bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:35.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:35.936+0000 7f332f7fe640 1 --2- 172.21.15.33:0/2008714028 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3330106a80 0x7f333019bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:35.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:35.936+0000 7f332f7fe640 1 -- 172.21.15.33:0/2008714028 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f333019c280 con 0x7f3330101420 2024-09-12T12:24:35.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:35.936+0000 7f332f7fe640 1 --2- 172.21.15.33:0/2008714028 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3330101420 0x7f3330197810 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f332400b4a0 tx=0x7f332400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:35.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:35.937+0000 7f332d7fa640 1 -- 172.21.15.33:0/2008714028 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3324014070 con 0x7f3330101420 2024-09-12T12:24:35.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:35.937+0000 7f33366f1640 1 -- 172.21.15.33:0/2008714028 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f333019c570 con 0x7f3330101420 2024-09-12T12:24:35.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:35.937+0000 7f332d7fa640 1 -- 172.21.15.33:0/2008714028 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3324010ac0 con 0x7f3330101420 2024-09-12T12:24:35.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:35.937+0000 7f332d7fa640 1 -- 172.21.15.33:0/2008714028 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3324017c30 con 0x7f3330101420 2024-09-12T12:24:35.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:35.937+0000 7f33366f1640 1 -- 172.21.15.33:0/2008714028 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33301a3e50 con 0x7f3330101420 2024-09-12T12:24:35.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:35.938+0000 7f33366f1640 1 -- 172.21.15.33:0/2008714028 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3330100ee0 con 0x7f3330101420 2024-09-12T12:24:35.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:35.939+0000 7f332d7fa640 1 -- 172.21.15.33:0/2008714028 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3324017070 con 0x7f3330101420 2024-09-12T12:24:35.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:35.940+0000 7f332d7fa640 1 --2- 172.21.15.33:0/2008714028 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f33180a2c10 0x7f33180a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:35.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:35.940+0000 7f332ffff640 1 --2- 172.21.15.33:0/2008714028 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f33180a2c10 0x7f33180a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:35.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:35.940+0000 7f332d7fa640 1 -- 172.21.15.33:0/2008714028 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f33240cea70 con 0x7f3330101420 2024-09-12T12:24:35.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:35.940+0000 7f332ffff640 1 --2- 172.21.15.33:0/2008714028 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f33180a2c10 0x7f33180a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3320005fd0 tx=0x7f3320005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:35.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:35.944+0000 7f332d7fa640 1 -- 172.21.15.33:0/2008714028 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f332409b6e0 con 0x7f3330101420 2024-09-12T12:24:36.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:36.153+0000 7f33366f1640 1 -- 172.21.15.33:0/2008714028 --> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f3330062630 con 0x7f33180a2c10 2024-09-12T12:24:36.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:36.158+0000 7f332d7fa640 1 -- 172.21.15.33:0/2008714028 <== mgr.14150 v2:172.21.15.33:6800/176202431 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f3330062630 con 0x7f33180a2c10 2024-09-12T12:24:36.158 INFO:teuthology.orchestra.run.smithi033.stdout:/volumes/qa/sv_0/8c00d832-14fd-4a19-874b-c5c3dfe6ba93 2024-09-12T12:24:36.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:36.160+0000 7f33366f1640 1 -- 172.21.15.33:0/2008714028 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f33180a2c10 msgr2=0x7f33180a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:36.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:36.160+0000 7f33366f1640 1 --2- 172.21.15.33:0/2008714028 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f33180a2c10 0x7f33180a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3320005fd0 tx=0x7f3320005850 comp rx=0 tx=0).stop 2024-09-12T12:24:36.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:36.160+0000 7f33366f1640 1 -- 172.21.15.33:0/2008714028 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3330101420 msgr2=0x7f3330197810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:36.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:36.160+0000 7f33366f1640 1 --2- 172.21.15.33:0/2008714028 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3330101420 0x7f3330197810 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f332400b4a0 tx=0x7f332400b960 comp rx=0 tx=0).stop 2024-09-12T12:24:36.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:36.160+0000 7f33366f1640 1 -- 172.21.15.33:0/2008714028 shutdown_connections 2024-09-12T12:24:36.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:36.160+0000 7f33366f1640 1 --2- 172.21.15.33:0/2008714028 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f33180a2c10 0x7f33180a50d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:36.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:36.160+0000 7f33366f1640 1 --2- 172.21.15.33:0/2008714028 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3330106a80 0x7f333019bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:36.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:36.160+0000 7f33366f1640 1 --2- 172.21.15.33:0/2008714028 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3330101420 0x7f3330197810 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:36.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:36.160+0000 7f33366f1640 1 --2- 172.21.15.33:0/2008714028 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3330100a80 0x7f33301972d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:36.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:36.160+0000 7f33366f1640 1 -- 172.21.15.33:0/2008714028 >> 172.21.15.33:0/2008714028 conn(0x7f33300fc7a0 msgr2=0x7f33300fd030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:36.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:36.160+0000 7f33366f1640 1 -- 172.21.15.33:0/2008714028 shutdown_connections 2024-09-12T12:24:36.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:36.160+0000 7f33366f1640 1 -- 172.21.15.33:0/2008714028 wait complete. 2024-09-12T12:24:36.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:35 smithi033 ceph-mon[31246]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-12T12:24:36.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:35 smithi043 ceph-mon[34144]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-12T12:24:36.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:35 smithi102 ceph-mon[34799]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-12T12:24:36.976 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-12T12:24:37.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:36 smithi033 ceph-mon[31246]: pgmap v304: 129 pgs: 129 active+clean; 591 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-09-12T12:24:37.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:36 smithi033 ceph-mon[31246]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:24:37.246 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:37.266 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:36 smithi043 ceph-mon[34144]: pgmap v304: 129 pgs: 129 active+clean; 591 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-09-12T12:24:37.266 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:36 smithi043 ceph-mon[34144]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:24:37.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:36 smithi102 ceph-mon[34799]: pgmap v304: 129 pgs: 129 active+clean; 591 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-09-12T12:24:37.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:36 smithi102 ceph-mon[34799]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:24:37.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.738+0000 7feb9bed3640 1 -- 172.21.15.33:0/474280284 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb94106a80 msgr2=0x7feb94106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:37.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.738+0000 7feb9bed3640 1 --2- 172.21.15.33:0/474280284 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb94106a80 0x7feb94106e60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7feb90009930 tx=0x7feb9002a420 comp rx=0 tx=0).stop 2024-09-12T12:24:37.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.738+0000 7feb9bed3640 1 -- 172.21.15.33:0/474280284 shutdown_connections 2024-09-12T12:24:37.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.738+0000 7feb9bed3640 1 --2- 172.21.15.33:0/474280284 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb94101420 0x7feb9410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:37.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.738+0000 7feb9bed3640 1 --2- 172.21.15.33:0/474280284 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb94100a80 0x7feb94100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:37.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.738+0000 7feb9bed3640 1 --2- 172.21.15.33:0/474280284 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb94106a80 0x7feb94106e60 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:37.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.738+0000 7feb9bed3640 1 -- 172.21.15.33:0/474280284 >> 172.21.15.33:0/474280284 conn(0x7feb940fc7a0 msgr2=0x7feb940febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:37.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.738+0000 7feb9bed3640 1 -- 172.21.15.33:0/474280284 shutdown_connections 2024-09-12T12:24:37.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.738+0000 7feb9bed3640 1 -- 172.21.15.33:0/474280284 wait complete. 2024-09-12T12:24:37.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.739+0000 7feb9bed3640 1 Processor -- start 2024-09-12T12:24:37.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.739+0000 7feb9bed3640 1 -- start start 2024-09-12T12:24:37.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.739+0000 7feb9bed3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb94100a80 0x7feb9410e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:37.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.739+0000 7feb9bed3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb94101420 0x7feb9410e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:37.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.739+0000 7feb9bed3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb94106a80 0x7feb9410ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:37.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.739+0000 7feb9bed3640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7feb94111e50 con 0x7feb94106a80 2024-09-12T12:24:37.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.739+0000 7feb9bed3640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7feb94111cd0 con 0x7feb94100a80 2024-09-12T12:24:37.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.739+0000 7feb9bed3640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7feb94111fd0 con 0x7feb94101420 2024-09-12T12:24:37.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.739+0000 7feb9a470640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb94106a80 0x7feb9410ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:37.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.739+0000 7feb9a470640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb94106a80 0x7feb9410ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47122/0 (socket says 172.21.15.33:47122) 2024-09-12T12:24:37.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.739+0000 7feb9a470640 1 -- 172.21.15.33:0/2850349628 learned_addr learned my addr 172.21.15.33:0/2850349628 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:24:37.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.739+0000 7feb99c6f640 1 --2- 172.21.15.33:0/2850349628 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb94100a80 0x7feb9410e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:37.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.739+0000 7feb9946e640 1 --2- 172.21.15.33:0/2850349628 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb94101420 0x7feb9410e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:37.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.739+0000 7feb9a470640 1 -- 172.21.15.33:0/2850349628 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb94101420 msgr2=0x7feb9410e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:37.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.739+0000 7feb9a470640 1 --2- 172.21.15.33:0/2850349628 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb94101420 0x7feb9410e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:37.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.739+0000 7feb9a470640 1 -- 172.21.15.33:0/2850349628 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb94100a80 msgr2=0x7feb9410e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:37.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.739+0000 7feb9a470640 1 --2- 172.21.15.33:0/2850349628 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb94100a80 0x7feb9410e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:37.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.739+0000 7feb9a470640 1 -- 172.21.15.33:0/2850349628 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb941a67d0 con 0x7feb94106a80 2024-09-12T12:24:37.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.740+0000 7feb9a470640 1 --2- 172.21.15.33:0/2850349628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb94106a80 0x7feb9410ee60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7feb8c00cce0 tx=0x7feb8c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:37.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.740+0000 7feb8affd640 1 -- 172.21.15.33:0/2850349628 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb8c00f450 con 0x7feb94106a80 2024-09-12T12:24:37.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.740+0000 7feb8affd640 1 -- 172.21.15.33:0/2850349628 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feb8c00faa0 con 0x7feb94106a80 2024-09-12T12:24:37.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.740+0000 7feb9bed3640 1 -- 172.21.15.33:0/2850349628 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb941a6ac0 con 0x7feb94106a80 2024-09-12T12:24:37.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.740+0000 7feb8affd640 1 -- 172.21.15.33:0/2850349628 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb8c018b70 con 0x7feb94106a80 2024-09-12T12:24:37.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.740+0000 7feb9bed3640 1 -- 172.21.15.33:0/2850349628 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb941a6fb0 con 0x7feb94106a80 2024-09-12T12:24:37.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.741+0000 7feb9bed3640 1 -- 172.21.15.33:0/2850349628 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb94100ee0 con 0x7feb94106a80 2024-09-12T12:24:37.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.742+0000 7feb8affd640 1 -- 172.21.15.33:0/2850349628 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7feb8c018d10 con 0x7feb94106a80 2024-09-12T12:24:37.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.743+0000 7feb8affd640 1 --2- 172.21.15.33:0/2850349628 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7feb800a2c10 0x7feb800a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:37.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.743+0000 7feb99c6f640 1 --2- 172.21.15.33:0/2850349628 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7feb800a2c10 0x7feb800a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:37.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.743+0000 7feb8affd640 1 -- 172.21.15.33:0/2850349628 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7feb8c0cf730 con 0x7feb94106a80 2024-09-12T12:24:37.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.744+0000 7feb99c6f640 1 --2- 172.21.15.33:0/2850349628 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7feb800a2c10 0x7feb800a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7feb90006010 tx=0x7feb90000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:37.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.748+0000 7feb8affd640 1 -- 172.21.15.33:0/2850349628 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feb8c014030 con 0x7feb94106a80 2024-09-12T12:24:37.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.954+0000 7feb9bed3640 1 -- 172.21.15.33:0/2850349628 --> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7feb94062630 con 0x7feb800a2c10 2024-09-12T12:24:37.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.980+0000 7feb8affd640 1 -- 172.21.15.33:0/2850349628 <== mgr.14150 v2:172.21.15.33:6800/176202431 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7feb94062630 con 0x7feb800a2c10 2024-09-12T12:24:37.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.982+0000 7feb9bed3640 1 -- 172.21.15.33:0/2850349628 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7feb800a2c10 msgr2=0x7feb800a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:37.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.982+0000 7feb9bed3640 1 --2- 172.21.15.33:0/2850349628 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7feb800a2c10 0x7feb800a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7feb90006010 tx=0x7feb90000bc0 comp rx=0 tx=0).stop 2024-09-12T12:24:37.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.982+0000 7feb9bed3640 1 -- 172.21.15.33:0/2850349628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb94106a80 msgr2=0x7feb9410ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:37.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.982+0000 7feb9bed3640 1 --2- 172.21.15.33:0/2850349628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb94106a80 0x7feb9410ee60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7feb8c00cce0 tx=0x7feb8c00a620 comp rx=0 tx=0).stop 2024-09-12T12:24:37.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.982+0000 7feb9bed3640 1 -- 172.21.15.33:0/2850349628 shutdown_connections 2024-09-12T12:24:37.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.982+0000 7feb9bed3640 1 --2- 172.21.15.33:0/2850349628 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7feb800a2c10 0x7feb800a50d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:37.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.982+0000 7feb9bed3640 1 --2- 172.21.15.33:0/2850349628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb94106a80 0x7feb9410ee60 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:37.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.982+0000 7feb9bed3640 1 --2- 172.21.15.33:0/2850349628 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb94101420 0x7feb9410e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:37.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.982+0000 7feb9bed3640 1 --2- 172.21.15.33:0/2850349628 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb94100a80 0x7feb9410e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:37.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.982+0000 7feb9bed3640 1 -- 172.21.15.33:0/2850349628 >> 172.21.15.33:0/2850349628 conn(0x7feb940fc7a0 msgr2=0x7feb940fdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:37.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.982+0000 7feb9bed3640 1 -- 172.21.15.33:0/2850349628 shutdown_connections 2024-09-12T12:24:37.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:37.982+0000 7feb9bed3640 1 -- 172.21.15.33:0/2850349628 wait complete. 2024-09-12T12:24:38.615 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-12T12:24:38.878 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:39.217 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:38 smithi102 ceph-mon[34799]: pgmap v305: 129 pgs: 129 active+clean; 591 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 3.0 KiB/s wr, 12 op/s 2024-09-12T12:24:39.217 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:38 smithi102 ceph-mon[34799]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:24:39.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:38 smithi033 ceph-mon[31246]: pgmap v305: 129 pgs: 129 active+clean; 591 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 3.0 KiB/s wr, 12 op/s 2024-09-12T12:24:39.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:38 smithi033 ceph-mon[31246]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:24:39.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:38 smithi043 ceph-mon[34144]: pgmap v305: 129 pgs: 129 active+clean; 591 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 3.0 KiB/s wr, 12 op/s 2024-09-12T12:24:39.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:38 smithi043 ceph-mon[34144]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:24:39.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.366+0000 7ffa0a56d640 1 -- 172.21.15.33:0/3823481461 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa04102d30 msgr2=0x7ffa04103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:39.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.366+0000 7ffa0a56d640 1 --2- 172.21.15.33:0/3823481461 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa04102d30 0x7ffa04103110 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff9f4009930 tx=0x7ff9f402a420 comp rx=0 tx=0).stop 2024-09-12T12:24:39.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.366+0000 7ffa0a56d640 1 -- 172.21.15.33:0/3823481461 shutdown_connections 2024-09-12T12:24:39.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.366+0000 7ffa0a56d640 1 --2- 172.21.15.33:0/3823481461 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa041082a0 0x7ffa0410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:39.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.366+0000 7ffa0a56d640 1 --2- 172.21.15.33:0/3823481461 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa041036e0 0x7ffa04107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:39.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.366+0000 7ffa0a56d640 1 --2- 172.21.15.33:0/3823481461 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa04102d30 0x7ffa04103110 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:39.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.366+0000 7ffa0a56d640 1 -- 172.21.15.33:0/3823481461 >> 172.21.15.33:0/3823481461 conn(0x7ffa040fc7d0 msgr2=0x7ffa040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:39.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.366+0000 7ffa0a56d640 1 -- 172.21.15.33:0/3823481461 shutdown_connections 2024-09-12T12:24:39.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.366+0000 7ffa0a56d640 1 -- 172.21.15.33:0/3823481461 wait complete. 2024-09-12T12:24:39.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.367+0000 7ffa0a56d640 1 Processor -- start 2024-09-12T12:24:39.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.367+0000 7ffa0a56d640 1 -- start start 2024-09-12T12:24:39.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.367+0000 7ffa0a56d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa04102d30 0x7ffa041984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:39.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.367+0000 7ffa0a56d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa041036e0 0x7ffa04198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:39.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.367+0000 7ffa0a56d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa041082a0 0x7ffa0419cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:39.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.367+0000 7ffa0a56d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ffa04111f50 con 0x7ffa041082a0 2024-09-12T12:24:39.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.367+0000 7ffa0a56d640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ffa04111dd0 con 0x7ffa04102d30 2024-09-12T12:24:39.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.367+0000 7ffa0a56d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ffa041120d0 con 0x7ffa041036e0 2024-09-12T12:24:39.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.368+0000 7ffa08b0a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa041082a0 0x7ffa0419cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:39.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.368+0000 7ffa037fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa041036e0 0x7ffa04198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:39.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.368+0000 7ffa037fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa041036e0 0x7ffa04198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:53632/0 (socket says 172.21.15.33:53632) 2024-09-12T12:24:39.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.368+0000 7ffa08b0a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa041082a0 0x7ffa0419cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47142/0 (socket says 172.21.15.33:47142) 2024-09-12T12:24:39.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.368+0000 7ffa037fe640 1 -- 172.21.15.33:0/2753301821 learned_addr learned my addr 172.21.15.33:0/2753301821 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:24:39.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.368+0000 7ffa03fff640 1 --2- 172.21.15.33:0/2753301821 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa04102d30 0x7ffa041984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:39.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.368+0000 7ffa037fe640 1 -- 172.21.15.33:0/2753301821 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa04102d30 msgr2=0x7ffa041984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:39.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.368+0000 7ffa037fe640 1 --2- 172.21.15.33:0/2753301821 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa04102d30 0x7ffa041984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:39.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.368+0000 7ffa037fe640 1 -- 172.21.15.33:0/2753301821 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa041082a0 msgr2=0x7ffa0419cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:39.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.368+0000 7ffa037fe640 1 --2- 172.21.15.33:0/2753301821 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa041082a0 0x7ffa0419cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:39.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.368+0000 7ffa037fe640 1 -- 172.21.15.33:0/2753301821 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa0419d480 con 0x7ffa041036e0 2024-09-12T12:24:39.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.368+0000 7ffa08b0a640 1 --2- 172.21.15.33:0/2753301821 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa041082a0 0x7ffa0419cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:24:39.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.368+0000 7ffa037fe640 1 --2- 172.21.15.33:0/2753301821 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa041036e0 0x7ffa04198a10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff9f800e9f0 tx=0x7ff9f800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:39.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.368+0000 7ffa017fa640 1 -- 172.21.15.33:0/2753301821 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f800ccc0 con 0x7ffa041036e0 2024-09-12T12:24:39.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.368+0000 7ffa017fa640 1 -- 172.21.15.33:0/2753301821 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff9f80108e0 con 0x7ffa041036e0 2024-09-12T12:24:39.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.368+0000 7ffa0a56d640 1 -- 172.21.15.33:0/2753301821 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa0419d770 con 0x7ffa041036e0 2024-09-12T12:24:39.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.368+0000 7ffa017fa640 1 -- 172.21.15.33:0/2753301821 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f80187c0 con 0x7ffa041036e0 2024-09-12T12:24:39.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.368+0000 7ffa0a56d640 1 -- 172.21.15.33:0/2753301821 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa041008c0 con 0x7ffa041036e0 2024-09-12T12:24:39.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.369+0000 7ffa0a56d640 1 -- 172.21.15.33:0/2753301821 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa0406a850 con 0x7ffa041036e0 2024-09-12T12:24:39.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.371+0000 7ffa017fa640 1 -- 172.21.15.33:0/2753301821 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff9f8010a90 con 0x7ffa041036e0 2024-09-12T12:24:39.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.372+0000 7ffa017fa640 1 --2- 172.21.15.33:0/2753301821 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff9ec0a2c10 0x7ff9ec0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:39.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.372+0000 7ffa017fa640 1 -- 172.21.15.33:0/2753301821 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7ff9f80cf7f0 con 0x7ffa041036e0 2024-09-12T12:24:39.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.372+0000 7ffa03fff640 1 --2- 172.21.15.33:0/2753301821 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff9ec0a2c10 0x7ff9ec0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:39.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.373+0000 7ffa03fff640 1 --2- 172.21.15.33:0/2753301821 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff9ec0a2c10 0x7ff9ec0a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff9f4000c00 tx=0x7ff9f4032ba0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:39.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.377+0000 7ffa017fa640 1 -- 172.21.15.33:0/2753301821 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff9f809c3b0 con 0x7ffa041036e0 2024-09-12T12:24:39.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.606+0000 7ffa0a56d640 1 -- 172.21.15.33:0/2753301821 --> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7ffa04062630 con 0x7ff9ec0a2c10 2024-09-12T12:24:39.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.611+0000 7ffa017fa640 1 -- 172.21.15.33:0/2753301821 <== mgr.14150 v2:172.21.15.33:6800/176202431 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7ffa04062630 con 0x7ff9ec0a2c10 2024-09-12T12:24:39.610 INFO:teuthology.orchestra.run.smithi033.stdout:/volumes/qa/sv_1/dc9373c0-b561-4049-be4b-4a7ff25949d3 2024-09-12T12:24:39.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.613+0000 7ffa0a56d640 1 -- 172.21.15.33:0/2753301821 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff9ec0a2c10 msgr2=0x7ff9ec0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:39.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.613+0000 7ffa0a56d640 1 --2- 172.21.15.33:0/2753301821 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff9ec0a2c10 0x7ff9ec0a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff9f4000c00 tx=0x7ff9f4032ba0 comp rx=0 tx=0).stop 2024-09-12T12:24:39.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.613+0000 7ffa0a56d640 1 -- 172.21.15.33:0/2753301821 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa041036e0 msgr2=0x7ffa04198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:39.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.613+0000 7ffa0a56d640 1 --2- 172.21.15.33:0/2753301821 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa041036e0 0x7ffa04198a10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff9f800e9f0 tx=0x7ff9f800eeb0 comp rx=0 tx=0).stop 2024-09-12T12:24:39.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.613+0000 7ffa0a56d640 1 -- 172.21.15.33:0/2753301821 shutdown_connections 2024-09-12T12:24:39.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.613+0000 7ffa0a56d640 1 --2- 172.21.15.33:0/2753301821 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff9ec0a2c10 0x7ff9ec0a50d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:39.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.613+0000 7ffa0a56d640 1 --2- 172.21.15.33:0/2753301821 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa041082a0 0x7ffa0419cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:39.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.613+0000 7ffa0a56d640 1 --2- 172.21.15.33:0/2753301821 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa041036e0 0x7ffa04198a10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:39.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.613+0000 7ffa0a56d640 1 --2- 172.21.15.33:0/2753301821 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa04102d30 0x7ffa041984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:39.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.613+0000 7ffa0a56d640 1 -- 172.21.15.33:0/2753301821 >> 172.21.15.33:0/2753301821 conn(0x7ffa040fc7d0 msgr2=0x7ffa04105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:39.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.613+0000 7ffa0a56d640 1 -- 172.21.15.33:0/2753301821 shutdown_connections 2024-09-12T12:24:39.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:39.613+0000 7ffa0a56d640 1 -- 172.21.15.33:0/2753301821 wait complete. 2024-09-12T12:24:40.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:39 smithi033 ceph-mon[31246]: from='client.24655 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:24:40.290 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:24:40.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:39 smithi043 ceph-mon[34144]: from='client.24655 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:24:40.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:39 smithi102 ceph-mon[34799]: from='client.24655 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:24:40.554 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:41.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.063+0000 7f09eafcd640 1 -- 172.21.15.33:0/3213133344 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09e4102ef0 msgr2=0x7f09e410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:41.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.063+0000 7f09eafcd640 1 --2- 172.21.15.33:0/3213133344 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09e4102ef0 0x7f09e410da40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f09dc009ca0 tx=0x7f09dc02a950 comp rx=0 tx=0).stop 2024-09-12T12:24:41.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.063+0000 7f09eafcd640 1 -- 172.21.15.33:0/3213133344 shutdown_connections 2024-09-12T12:24:41.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.063+0000 7f09eafcd640 1 --2- 172.21.15.33:0/3213133344 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09e4102ef0 0x7f09e410da40 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:41.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.063+0000 7f09eafcd640 1 --2- 172.21.15.33:0/3213133344 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09e4102570 0x7f09e41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:41.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.063+0000 7f09eafcd640 1 --2- 172.21.15.33:0/3213133344 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09e4100e20 0x7f09e4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:41.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.063+0000 7f09eafcd640 1 -- 172.21.15.33:0/3213133344 >> 172.21.15.33:0/3213133344 conn(0x7f09e40fc7d0 msgr2=0x7f09e40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:41.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.063+0000 7f09eafcd640 1 -- 172.21.15.33:0/3213133344 shutdown_connections 2024-09-12T12:24:41.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.063+0000 7f09eafcd640 1 -- 172.21.15.33:0/3213133344 wait complete. 2024-09-12T12:24:41.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.064+0000 7f09eafcd640 1 Processor -- start 2024-09-12T12:24:41.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.064+0000 7f09eafcd640 1 -- start start 2024-09-12T12:24:41.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.064+0000 7f09eafcd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09e4100e20 0x7f09e419a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:41.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.064+0000 7f09eafcd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09e4102570 0x7f09e419ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:41.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.064+0000 7f09eafcd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09e4102ef0 0x7f09e419f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:41.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.064+0000 7f09eafcd640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f09e4110e50 con 0x7f09e4102570 2024-09-12T12:24:41.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.064+0000 7f09eafcd640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f09e4110cd0 con 0x7f09e4100e20 2024-09-12T12:24:41.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.064+0000 7f09eafcd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f09e4110fd0 con 0x7f09e4102ef0 2024-09-12T12:24:41.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.064+0000 7f09e3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09e4102570 0x7f09e419ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:41.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.064+0000 7f09e3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09e4102570 0x7f09e419ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56706/0 (socket says 172.21.15.33:56706) 2024-09-12T12:24:41.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.064+0000 7f09e3fff640 1 -- 172.21.15.33:0/1119920204 learned_addr learned my addr 172.21.15.33:0/1119920204 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:24:41.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.064+0000 7f09e8d69640 1 --2- 172.21.15.33:0/1119920204 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09e4100e20 0x7f09e419a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:41.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.064+0000 7f09e956a640 1 --2- 172.21.15.33:0/1119920204 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09e4102ef0 0x7f09e419f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:41.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.065+0000 7f09e3fff640 1 -- 172.21.15.33:0/1119920204 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09e4102ef0 msgr2=0x7f09e419f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:41.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.065+0000 7f09e3fff640 1 --2- 172.21.15.33:0/1119920204 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09e4102ef0 0x7f09e419f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:41.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.065+0000 7f09e3fff640 1 -- 172.21.15.33:0/1119920204 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09e4100e20 msgr2=0x7f09e419a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:41.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.065+0000 7f09e3fff640 1 --2- 172.21.15.33:0/1119920204 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09e4100e20 0x7f09e419a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:41.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.065+0000 7f09e3fff640 1 -- 172.21.15.33:0/1119920204 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09e419f6f0 con 0x7f09e4102570 2024-09-12T12:24:41.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.065+0000 7f09e956a640 1 --2- 172.21.15.33:0/1119920204 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09e4102ef0 0x7f09e419f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:24:41.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.065+0000 7f09e3fff640 1 --2- 172.21.15.33:0/1119920204 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09e4102570 0x7f09e419ac80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f09d000b4a0 tx=0x7f09d000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:41.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.065+0000 7f09e1ffb640 1 -- 172.21.15.33:0/1119920204 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d0014070 con 0x7f09e4102570 2024-09-12T12:24:41.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.065+0000 7f09e1ffb640 1 -- 172.21.15.33:0/1119920204 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f09d0010ac0 con 0x7f09e4102570 2024-09-12T12:24:41.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.065+0000 7f09eafcd640 1 -- 172.21.15.33:0/1119920204 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09e419f9e0 con 0x7f09e4102570 2024-09-12T12:24:41.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.065+0000 7f09e1ffb640 1 -- 172.21.15.33:0/1119920204 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d0017c30 con 0x7f09e4102570 2024-09-12T12:24:41.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.065+0000 7f09eafcd640 1 -- 172.21.15.33:0/1119920204 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09e41a72c0 con 0x7f09e4102570 2024-09-12T12:24:41.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.066+0000 7f09eafcd640 1 -- 172.21.15.33:0/1119920204 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09e4101200 con 0x7f09e4102570 2024-09-12T12:24:41.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.067+0000 7f09e1ffb640 1 -- 172.21.15.33:0/1119920204 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f09d0017070 con 0x7f09e4102570 2024-09-12T12:24:41.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.068+0000 7f09e1ffb640 1 --2- 172.21.15.33:0/1119920204 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f09d40a2c90 0x7f09d40a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:41.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.068+0000 7f09e1ffb640 1 -- 172.21.15.33:0/1119920204 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f09d00ce940 con 0x7f09e4102570 2024-09-12T12:24:41.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.068+0000 7f09e8d69640 1 --2- 172.21.15.33:0/1119920204 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f09d40a2c90 0x7f09d40a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:41.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.069+0000 7f09e8d69640 1 --2- 172.21.15.33:0/1119920204 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f09d40a2c90 0x7f09d40a5150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f09d800bbe0 tx=0x7f09d800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:41.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.072+0000 7f09e1ffb640 1 -- 172.21.15.33:0/1119920204 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f09d009b610 con 0x7f09e4102570 2024-09-12T12:24:41.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:40 smithi033 ceph-mon[31246]: pgmap v306: 129 pgs: 129 active+clean; 624 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.5 KiB/s wr, 13 op/s 2024-09-12T12:24:41.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.284+0000 7f09eafcd640 1 -- 172.21.15.33:0/1119920204 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f09e41a74f0 con 0x7f09e4102570 2024-09-12T12:24:41.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.285+0000 7f09e1ffb640 1 -- 172.21.15.33:0/1119920204 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11912 (secure 0 0 0) 0x7f09d009af10 con 0x7f09e4102570 2024-09-12T12:24:41.285 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:24:41.285 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":24,"btime":"2024-09-12T12:24:30:808296+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3327066342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3327066342},{"type":"v1","addr":"172.21.15.33:6835","nonce":3327066342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/19516401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":19516401},{"type":"v1","addr":"172.21.15.33:6837","nonce":19516401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1260196118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1260196118},{"type":"v1","addr":"172.21.15.33:6839","nonce":1260196118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/4288248356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4288248356},{"type":"v1","addr":"172.21.15.33:6841","nonce":4288248356}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/3051073141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3051073141},{"type":"v1","addr":"172.21.15.43:6833","nonce":3051073141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3282762800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3282762800},{"type":"v1","addr":"172.21.15.43:6835","nonce":3282762800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:23:46.400609+0000","modified":"2024-09-12T12:24:30.590211+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24490,"mds_2":24478},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3051713000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3051713000},{"type":"v1","addr":"172.21.15.102:6833","nonce":3051713000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6837/2472064883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2472064883},{"type":"v1","addr":"172.21.15.43:6837","nonce":2472064883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/1987408860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":1987408860},{"type":"v1","addr":"172.21.15.43:6839","nonce":1987408860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/4179527539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":4179527539},{"type":"v1","addr":"172.21.15.102:6835","nonce":4179527539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/2409953270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2409953270},{"type":"v1","addr":"172.21.15.102:6837","nonce":2409953270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.102:6839/1553271340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":1553271340},{"type":"v1","addr":"172.21.15.102:6839","nonce":1553271340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24499,"qdb_cluster":[24478,24490,24499]},"id":1}]} 2024-09-12T12:24:41.285 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 24 2024-09-12T12:24:41.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.287+0000 7f09eafcd640 1 -- 172.21.15.33:0/1119920204 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f09d40a2c90 msgr2=0x7f09d40a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:41.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.287+0000 7f09eafcd640 1 --2- 172.21.15.33:0/1119920204 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f09d40a2c90 0x7f09d40a5150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f09d800bbe0 tx=0x7f09d800b390 comp rx=0 tx=0).stop 2024-09-12T12:24:41.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.287+0000 7f09eafcd640 1 -- 172.21.15.33:0/1119920204 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09e4102570 msgr2=0x7f09e419ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:41.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.287+0000 7f09eafcd640 1 --2- 172.21.15.33:0/1119920204 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09e4102570 0x7f09e419ac80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f09d000b4a0 tx=0x7f09d000b960 comp rx=0 tx=0).stop 2024-09-12T12:24:41.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.287+0000 7f09eafcd640 1 -- 172.21.15.33:0/1119920204 shutdown_connections 2024-09-12T12:24:41.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.287+0000 7f09eafcd640 1 --2- 172.21.15.33:0/1119920204 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f09d40a2c90 0x7f09d40a5150 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:41.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.287+0000 7f09eafcd640 1 --2- 172.21.15.33:0/1119920204 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09e4102ef0 0x7f09e419f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:41.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.287+0000 7f09eafcd640 1 --2- 172.21.15.33:0/1119920204 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09e4102570 0x7f09e419ac80 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:41.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.287+0000 7f09eafcd640 1 --2- 172.21.15.33:0/1119920204 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09e4100e20 0x7f09e419a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:41.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.287+0000 7f09eafcd640 1 -- 172.21.15.33:0/1119920204 >> 172.21.15.33:0/1119920204 conn(0x7f09e40fc7d0 msgr2=0x7f09e4069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:41.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.287+0000 7f09eafcd640 1 -- 172.21.15.33:0/1119920204 shutdown_connections 2024-09-12T12:24:41.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:41.287+0000 7f09eafcd640 1 -- 172.21.15.33:0/1119920204 wait complete. 2024-09-12T12:24:41.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:40 smithi043 ceph-mon[34144]: pgmap v306: 129 pgs: 129 active+clean; 624 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.5 KiB/s wr, 13 op/s 2024-09-12T12:24:41.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:40 smithi102 ceph-mon[34799]: pgmap v306: 129 pgs: 129 active+clean; 624 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.5 KiB/s wr, 13 op/s 2024-09-12T12:24:41.942 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T12:24:42.207 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:42.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:41 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/1119920204' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:24:42.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:41 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/1119920204' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:24:42.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:41 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/1119920204' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:24:42.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.703+0000 7f21aeb13640 1 -- 172.21.15.33:0/3180047246 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f21a81036e0 msgr2=0x7f21a8107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:42.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.703+0000 7f21aeb13640 1 --2- 172.21.15.33:0/3180047246 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f21a81036e0 0x7f21a8107b90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2194009860 tx=0x7f219402a340 comp rx=0 tx=0).stop 2024-09-12T12:24:42.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.703+0000 7f21aeb13640 1 -- 172.21.15.33:0/3180047246 shutdown_connections 2024-09-12T12:24:42.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.703+0000 7f21aeb13640 1 --2- 172.21.15.33:0/3180047246 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21a81082a0 0x7f21a810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:42.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.703+0000 7f21aeb13640 1 --2- 172.21.15.33:0/3180047246 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f21a81036e0 0x7f21a8107b90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:42.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.703+0000 7f21aeb13640 1 --2- 172.21.15.33:0/3180047246 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21a8102d30 0x7f21a8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:42.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.703+0000 7f21aeb13640 1 -- 172.21.15.33:0/3180047246 >> 172.21.15.33:0/3180047246 conn(0x7f21a80fc7d0 msgr2=0x7f21a80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:42.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.703+0000 7f21aeb13640 1 -- 172.21.15.33:0/3180047246 shutdown_connections 2024-09-12T12:24:42.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.703+0000 7f21aeb13640 1 -- 172.21.15.33:0/3180047246 wait complete. 2024-09-12T12:24:42.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.703+0000 7f21aeb13640 1 Processor -- start 2024-09-12T12:24:42.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.704+0000 7f21aeb13640 1 -- start start 2024-09-12T12:24:42.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.704+0000 7f21aeb13640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21a8102d30 0x7f21a819a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:42.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.704+0000 7f21aeb13640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f21a81036e0 0x7f21a819ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:42.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.704+0000 7f21aeb13640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21a81082a0 0x7f21a819f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:42.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.704+0000 7f21aeb13640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f21a8111f50 con 0x7f21a8102d30 2024-09-12T12:24:42.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.704+0000 7f21aeb13640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f21a8111dd0 con 0x7f21a81082a0 2024-09-12T12:24:42.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.704+0000 7f21aeb13640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f21a81120d0 con 0x7f21a81036e0 2024-09-12T12:24:42.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.704+0000 7f21ac8af640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21a8102d30 0x7f21a819a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:42.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.704+0000 7f21ac8af640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21a8102d30 0x7f21a819a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56730/0 (socket says 172.21.15.33:56730) 2024-09-12T12:24:42.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.704+0000 7f21ac8af640 1 -- 172.21.15.33:0/3478968258 learned_addr learned my addr 172.21.15.33:0/3478968258 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:24:42.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.704+0000 7f21a7fff640 1 --2- 172.21.15.33:0/3478968258 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f21a81036e0 0x7f21a819ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:42.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.704+0000 7f21ad0b0640 1 --2- 172.21.15.33:0/3478968258 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21a81082a0 0x7f21a819f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:42.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.704+0000 7f21ac8af640 1 -- 172.21.15.33:0/3478968258 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f21a81036e0 msgr2=0x7f21a819ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:42.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.704+0000 7f21ac8af640 1 --2- 172.21.15.33:0/3478968258 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f21a81036e0 0x7f21a819ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:42.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.704+0000 7f21ac8af640 1 -- 172.21.15.33:0/3478968258 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21a81082a0 msgr2=0x7f21a819f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:42.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.704+0000 7f21ac8af640 1 --2- 172.21.15.33:0/3478968258 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21a81082a0 0x7f21a819f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:42.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.704+0000 7f21ac8af640 1 -- 172.21.15.33:0/3478968258 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21a819f6e0 con 0x7f21a8102d30 2024-09-12T12:24:42.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.704+0000 7f21a7fff640 1 --2- 172.21.15.33:0/3478968258 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f21a81036e0 0x7f21a819ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:24:42.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.705+0000 7f21ac8af640 1 --2- 172.21.15.33:0/3478968258 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21a8102d30 0x7f21a819a730 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f219c00e9f0 tx=0x7f219c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:42.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.705+0000 7f21a5ffb640 1 -- 172.21.15.33:0/3478968258 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219c00cd80 con 0x7f21a8102d30 2024-09-12T12:24:42.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.705+0000 7f21aeb13640 1 -- 172.21.15.33:0/3478968258 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21a819f9d0 con 0x7f21a8102d30 2024-09-12T12:24:42.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.705+0000 7f21a5ffb640 1 -- 172.21.15.33:0/3478968258 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f219c0054d0 con 0x7f21a8102d30 2024-09-12T12:24:42.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.705+0000 7f21a5ffb640 1 -- 172.21.15.33:0/3478968258 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219c010490 con 0x7f21a8102d30 2024-09-12T12:24:42.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.705+0000 7f21aeb13640 1 -- 172.21.15.33:0/3478968258 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21a81a72b0 con 0x7f21a8102d30 2024-09-12T12:24:42.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.706+0000 7f21aeb13640 1 -- 172.21.15.33:0/3478968258 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21a8103110 con 0x7f21a8102d30 2024-09-12T12:24:42.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.708+0000 7f21a5ffb640 1 -- 172.21.15.33:0/3478968258 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f219c005020 con 0x7f21a8102d30 2024-09-12T12:24:42.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.708+0000 7f21a5ffb640 1 --2- 172.21.15.33:0/3478968258 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f21980a2c10 0x7f21980a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:42.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.708+0000 7f21a5ffb640 1 -- 172.21.15.33:0/3478968258 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f219c0cf800 con 0x7f21a8102d30 2024-09-12T12:24:42.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.708+0000 7f21a7fff640 1 --2- 172.21.15.33:0/3478968258 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f21980a2c10 0x7f21980a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:42.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.709+0000 7f21a7fff640 1 --2- 172.21.15.33:0/3478968258 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f21980a2c10 0x7f21980a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2194005940 tx=0x7f21940058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:42.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.713+0000 7f21a5ffb640 1 -- 172.21.15.33:0/3478968258 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f219c09c360 con 0x7f21a8102d30 2024-09-12T12:24:42.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.897+0000 7f21aeb13640 1 -- 172.21.15.33:0/3478968258 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f21a810c2c0 con 0x7f21a8102d30 2024-09-12T12:24:42.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.899+0000 7f21a5ffb640 1 -- 172.21.15.33:0/3478968258 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+24141 (secure 0 0 0) 0x7f219c09bc60 con 0x7f21a8102d30 2024-09-12T12:24:42.899 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:24:42.899 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":85,"fsid":"a66dfafc-7100-11ef-bcea-c7b262605968","created":"2024-09-12T12:16:11.904815+0000","modified":"2024-09-12T12:23:55.506385+0000","last_up_change":"2024-09-12T12:22:57.476185+0000","last_in_change":"2024-09-12T12:22:35.192556+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:19:12.296305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:23:42.509774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:23:44.842852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T12:23:51.308720+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"74b68729-c97c-4da6-a659-75d6c147ad05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6803","nonce":963294466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6805","nonce":963294466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6809","nonce":963294466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6807","nonce":963294466}]},"public_addr":"172.21.15.33:6803/963294466","cluster_addr":"172.21.15.33:6805/963294466","heartbeat_back_addr":"172.21.15.33:6809/963294466","heartbeat_front_addr":"172.21.15.33:6807/963294466","state":["exists","up"]},{"osd":1,"uuid":"2461a388-e110-420b-9404-eb54cd39119e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6801","nonce":2306025171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6803","nonce":2306025171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6807","nonce":2306025171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6805","nonce":2306025171}]},"public_addr":"172.21.15.43:6801/2306025171","cluster_addr":"172.21.15.43:6803/2306025171","heartbeat_back_addr":"172.21.15.43:6807/2306025171","heartbeat_front_addr":"172.21.15.43:6805/2306025171","state":["exists","up"]},{"osd":2,"uuid":"4ba9dd02-977d-45fb-b366-ade15b52232b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6801","nonce":4257223217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6803","nonce":4257223217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6807","nonce":4257223217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6805","nonce":4257223217}]},"public_addr":"172.21.15.102:6801/4257223217","cluster_addr":"172.21.15.102:6803/4257223217","heartbeat_back_addr":"172.21.15.102:6807/4257223217","heartbeat_front_addr":"172.21.15.102:6805/4257223217","state":["exists","up"]},{"osd":3,"uuid":"345aa854-9ea2-4103-a186-9794af34c237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6811","nonce":2483872739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6813","nonce":2483872739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6817","nonce":2483872739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6815","nonce":2483872739}]},"public_addr":"172.21.15.33:6811/2483872739","cluster_addr":"172.21.15.33:6813/2483872739","heartbeat_back_addr":"172.21.15.33:6817/2483872739","heartbeat_front_addr":"172.21.15.33:6815/2483872739","state":["exists","up"]},{"osd":4,"uuid":"32acd6da-01d6-4a8e-9d05-3d394363d6f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6809","nonce":136043101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6811","nonce":136043101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6815","nonce":136043101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6813","nonce":136043101}]},"public_addr":"172.21.15.43:6809/136043101","cluster_addr":"172.21.15.43:6811/136043101","heartbeat_back_addr":"172.21.15.43:6815/136043101","heartbeat_front_addr":"172.21.15.43:6813/136043101","state":["exists","up"]},{"osd":5,"uuid":"dced0037-2da2-48c2-a391-f871d6ceebb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6809","nonce":2605625792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6811","nonce":2605625792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6815","nonce":2605625792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6813","nonce":2605625792}]},"public_addr":"172.21.15.102:6809/2605625792","cluster_addr":"172.21.15.102:6811/2605625792","heartbeat_back_addr":"172.21.15.102:6815/2605625792","heartbeat_front_addr":"172.21.15.102:6813/2605625792","state":["exists","up"]},{"osd":6,"uuid":"46e5532e-026a-4bb2-8847-2a3216e5d7a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6819","nonce":805864618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6821","nonce":805864618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6825","nonce":805864618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6823","nonce":805864618}]},"public_addr":"172.21.15.33:6819/805864618","cluster_addr":"172.21.15.33:6821/805864618","heartbeat_back_addr":"172.21.15.33:6825/805864618","heartbeat_front_addr":"172.21.15.33:6823/805864618","state":["exists","up"]},{"osd":7,"uuid":"c8474ab4-68cd-4475-9429-b54981247ee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6817","nonce":392537201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6819","nonce":392537201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6823","nonce":392537201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6821","nonce":392537201}]},"public_addr":"172.21.15.43:6817/392537201","cluster_addr":"172.21.15.43:6819/392537201","heartbeat_back_addr":"172.21.15.43:6823/392537201","heartbeat_front_addr":"172.21.15.43:6821/392537201","state":["exists","up"]},{"osd":8,"uuid":"e7c2ef28-8c84-44d0-ba6d-7556ec1d02dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6817","nonce":1768219597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6819","nonce":1768219597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6823","nonce":1768219597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6821","nonce":1768219597}]},"public_addr":"172.21.15.102:6817/1768219597","cluster_addr":"172.21.15.102:6819/1768219597","heartbeat_back_addr":"172.21.15.102:6823/1768219597","heartbeat_front_addr":"172.21.15.102:6821/1768219597","state":["exists","up"]},{"osd":9,"uuid":"f2500273-8b21-4984-bc41-cec5cc0c883b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6827","nonce":973136168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6829","nonce":973136168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6833","nonce":973136168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6831","nonce":973136168}]},"public_addr":"172.21.15.33:6827/973136168","cluster_addr":"172.21.15.33:6829/973136168","heartbeat_back_addr":"172.21.15.33:6833/973136168","heartbeat_front_addr":"172.21.15.33:6831/973136168","state":["exists","up"]},{"osd":10,"uuid":"954343c5-5d5b-4c30-acde-82aa695f7b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6825","nonce":248515585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6827","nonce":248515585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6831","nonce":248515585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6829","nonce":248515585}]},"public_addr":"172.21.15.43:6825/248515585","cluster_addr":"172.21.15.43:6827/248515585","heartbeat_back_addr":"172.21.15.43:6831/248515585","heartbeat_front_addr":"172.21.15.43:6829/248515585","state":["exists","up"]},{"osd":11,"uuid":"22b4147b-02ad-4514-be17-5bb395099eef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6825","nonce":2463068013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6827","nonce":2463068013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6831","nonce":2463068013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6829","nonce":2463068013}]},"public_addr":"172.21.15.102:6825/2463068013","cluster_addr":"172.21.15.102:6827/2463068013","heartbeat_back_addr":"172.21.15.102:6831/2463068013","heartbeat_front_addr":"172.21.15.102:6829/2463068013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:19.274804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:44.900294+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:08.885404+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:34.382089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:59.978538+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:25.275179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:49.429847+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:14.974792+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:40.268629+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:22:06.458679+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:22:31.813019+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:22:56.264078+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/3187741548":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6800/1381479235":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6801/1156183797":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/2222991013":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6801/1381479235":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6800/1156183797":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/3450458842":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/202580320":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/2441151017":"2024-09-13T12:16:57.792813+0000","172.21.15.33:0/1001176884":"2024-09-13T12:16:33.559150+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:24:42.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.901+0000 7f21aeb13640 1 -- 172.21.15.33:0/3478968258 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f21980a2c10 msgr2=0x7f21980a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:42.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.902+0000 7f21aeb13640 1 --2- 172.21.15.33:0/3478968258 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f21980a2c10 0x7f21980a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2194005940 tx=0x7f21940058d0 comp rx=0 tx=0).stop 2024-09-12T12:24:42.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.902+0000 7f21aeb13640 1 -- 172.21.15.33:0/3478968258 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21a8102d30 msgr2=0x7f21a819a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:42.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.902+0000 7f21aeb13640 1 --2- 172.21.15.33:0/3478968258 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21a8102d30 0x7f21a819a730 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f219c00e9f0 tx=0x7f219c00edf0 comp rx=0 tx=0).stop 2024-09-12T12:24:42.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.902+0000 7f21aeb13640 1 -- 172.21.15.33:0/3478968258 shutdown_connections 2024-09-12T12:24:42.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.902+0000 7f21aeb13640 1 --2- 172.21.15.33:0/3478968258 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f21980a2c10 0x7f21980a50d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:42.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.902+0000 7f21aeb13640 1 --2- 172.21.15.33:0/3478968258 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21a81082a0 0x7f21a819f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:42.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.902+0000 7f21aeb13640 1 --2- 172.21.15.33:0/3478968258 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f21a81036e0 0x7f21a819ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:42.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.902+0000 7f21aeb13640 1 --2- 172.21.15.33:0/3478968258 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21a8102d30 0x7f21a819a730 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:42.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.902+0000 7f21aeb13640 1 -- 172.21.15.33:0/3478968258 >> 172.21.15.33:0/3478968258 conn(0x7f21a80fc7d0 msgr2=0x7f21a8100da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:42.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.902+0000 7f21aeb13640 1 -- 172.21.15.33:0/3478968258 shutdown_connections 2024-09-12T12:24:42.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:42.902+0000 7f21aeb13640 1 -- 172.21.15.33:0/3478968258 wait complete. 2024-09-12T12:24:43.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:42 smithi033 ceph-mon[31246]: pgmap v307: 129 pgs: 129 active+clean; 624 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.4 KiB/s wr, 12 op/s 2024-09-12T12:24:43.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:42 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:24:43.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:42 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/3478968258' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:24:43.258 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:42 smithi043 ceph-mon[34144]: pgmap v307: 129 pgs: 129 active+clean; 624 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.4 KiB/s wr, 12 op/s 2024-09-12T12:24:43.258 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:42 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:24:43.258 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:42 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/3478968258' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:24:43.364 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:42 smithi102 ceph-mon[34799]: pgmap v307: 129 pgs: 129 active+clean; 624 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.4 KiB/s wr, 12 op/s 2024-09-12T12:24:43.365 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:42 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:24:43.365 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:42 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/3478968258' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:24:43.571 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-12T12:24:43.571 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T12:24:44.480 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:44.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:44.971+0000 7fd688e5f640 1 -- 172.21.15.33:0/20987280 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd684100e20 msgr2=0x7fd684101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:44.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:44.971+0000 7fd688e5f640 1 --2- 172.21.15.33:0/20987280 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd684100e20 0x7fd684101200 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd674009900 tx=0x7fd67402a480 comp rx=0 tx=0).stop 2024-09-12T12:24:44.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:44.971+0000 7fd688e5f640 1 -- 172.21.15.33:0/20987280 shutdown_connections 2024-09-12T12:24:44.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:44.971+0000 7fd688e5f640 1 --2- 172.21.15.33:0/20987280 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd684102ef0 0x7fd68410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:44.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:44.971+0000 7fd688e5f640 1 --2- 172.21.15.33:0/20987280 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd684102570 0x7fd6841029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:44.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:44.971+0000 7fd688e5f640 1 --2- 172.21.15.33:0/20987280 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd684100e20 0x7fd684101200 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:44.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:44.971+0000 7fd688e5f640 1 -- 172.21.15.33:0/20987280 >> 172.21.15.33:0/20987280 conn(0x7fd6840fc7d0 msgr2=0x7fd6840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:44.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:44.971+0000 7fd688e5f640 1 -- 172.21.15.33:0/20987280 shutdown_connections 2024-09-12T12:24:44.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:44.971+0000 7fd688e5f640 1 -- 172.21.15.33:0/20987280 wait complete. 2024-09-12T12:24:44.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:44.972+0000 7fd688e5f640 1 Processor -- start 2024-09-12T12:24:44.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:44.972+0000 7fd688e5f640 1 -- start start 2024-09-12T12:24:44.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:44.972+0000 7fd688e5f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd684100e20 0x7fd6840fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:44.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:44.972+0000 7fd688e5f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd684102570 0x7fd6840fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:44.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:44.972+0000 7fd688e5f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd684102ef0 0x7fd6840fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:44.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:44.972+0000 7fd688e5f640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd684110e00 con 0x7fd684100e20 2024-09-12T12:24:44.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:44.972+0000 7fd688e5f640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd684110c80 con 0x7fd684102ef0 2024-09-12T12:24:44.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:44.972+0000 7fd688e5f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd684110f80 con 0x7fd684102570 2024-09-12T12:24:44.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:44.972+0000 7fd68259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd684100e20 0x7fd6840fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:44.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:44.972+0000 7fd68259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd684100e20 0x7fd6840fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56742/0 (socket says 172.21.15.33:56742) 2024-09-12T12:24:44.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:44.972+0000 7fd68259c640 1 -- 172.21.15.33:0/3710109473 learned_addr learned my addr 172.21.15.33:0/3710109473 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:24:44.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:44.972+0000 7fd681d9b640 1 --2- 172.21.15.33:0/3710109473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd684102570 0x7fd6840fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:44.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:44.972+0000 7fd682d9d640 1 --2- 172.21.15.33:0/3710109473 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd684102ef0 0x7fd6840fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:44.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:44.972+0000 7fd68259c640 1 -- 172.21.15.33:0/3710109473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd684102570 msgr2=0x7fd6840fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:44.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:44.973+0000 7fd68259c640 1 --2- 172.21.15.33:0/3710109473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd684102570 0x7fd6840fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:44.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:44.973+0000 7fd68259c640 1 -- 172.21.15.33:0/3710109473 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd684102ef0 msgr2=0x7fd6840fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:44.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:44.973+0000 7fd68259c640 1 --2- 172.21.15.33:0/3710109473 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd684102ef0 0x7fd6840fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:44.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:44.973+0000 7fd68259c640 1 -- 172.21.15.33:0/3710109473 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6841a6920 con 0x7fd684100e20 2024-09-12T12:24:44.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:44.973+0000 7fd682d9d640 1 --2- 172.21.15.33:0/3710109473 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd684102ef0 0x7fd6840fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:24:44.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:44.973+0000 7fd68259c640 1 --2- 172.21.15.33:0/3710109473 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd684100e20 0x7fd6840fcc80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd674006010 tx=0x7fd674004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:44.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:44.973+0000 7fd6737fe640 1 -- 172.21.15.33:0/3710109473 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67403f030 con 0x7fd684100e20 2024-09-12T12:24:44.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:44.973+0000 7fd6737fe640 1 -- 172.21.15.33:0/3710109473 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd674003aa0 con 0x7fd684100e20 2024-09-12T12:24:44.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:44.973+0000 7fd688e5f640 1 -- 172.21.15.33:0/3710109473 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6841a6bb0 con 0x7fd684100e20 2024-09-12T12:24:44.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:44.973+0000 7fd6737fe640 1 -- 172.21.15.33:0/3710109473 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd674035070 con 0x7fd684100e20 2024-09-12T12:24:44.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:44.973+0000 7fd688e5f640 1 -- 172.21.15.33:0/3710109473 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6841a70e0 con 0x7fd684100e20 2024-09-12T12:24:44.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:44.974+0000 7fd688e5f640 1 -- 172.21.15.33:0/3710109473 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd684101200 con 0x7fd684100e20 2024-09-12T12:24:44.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:44.975+0000 7fd6737fe640 1 -- 172.21.15.33:0/3710109473 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd674042030 con 0x7fd684100e20 2024-09-12T12:24:44.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:44.976+0000 7fd6737fe640 1 --2- 172.21.15.33:0/3710109473 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd66c0a2c90 0x7fd66c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:44.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:44.976+0000 7fd681d9b640 1 --2- 172.21.15.33:0/3710109473 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd66c0a2c90 0x7fd66c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:44.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:44.976+0000 7fd6737fe640 1 -- 172.21.15.33:0/3710109473 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7fd6740ef790 con 0x7fd684100e20 2024-09-12T12:24:44.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:44.976+0000 7fd681d9b640 1 --2- 172.21.15.33:0/3710109473 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd66c0a2c90 0x7fd66c0a5150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd6840fe710 tx=0x7fd67800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:44.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:44.980+0000 7fd6737fe640 1 -- 172.21.15.33:0/3710109473 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd6740bc2f0 con 0x7fd684100e20 2024-09-12T12:24:45.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:45.157+0000 7fd688e5f640 1 -- 172.21.15.33:0/3710109473 --> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd684062630 con 0x7fd66c0a2c90 2024-09-12T12:24:45.157 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:45 smithi033 ceph-mon[31246]: pgmap v308: 129 pgs: 129 active+clean; 636 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 6.3 KiB/s wr, 12 op/s 2024-09-12T12:24:45.157 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:45 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:24:45.157 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:45 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:24:45.158 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:45 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:24:45.158 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:45 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:24:45.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:45.167+0000 7fd6737fe640 1 -- 172.21.15.33:0/3710109473 <== mgr.14150 v2:172.21.15.33:6800/176202431 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340608 (secure 0 0 0) 0x7fd684062630 con 0x7fd66c0a2c90 2024-09-12T12:24:45.171 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:24:45.173 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-12T12:24:45.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:45.170+0000 7fd688e5f640 1 -- 172.21.15.33:0/3710109473 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd66c0a2c90 msgr2=0x7fd66c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:45.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:45.170+0000 7fd688e5f640 1 --2- 172.21.15.33:0/3710109473 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd66c0a2c90 0x7fd66c0a5150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd6840fe710 tx=0x7fd67800b390 comp rx=0 tx=0).stop 2024-09-12T12:24:45.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:45.170+0000 7fd688e5f640 1 -- 172.21.15.33:0/3710109473 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd684100e20 msgr2=0x7fd6840fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:45.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:45.170+0000 7fd688e5f640 1 --2- 172.21.15.33:0/3710109473 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd684100e20 0x7fd6840fcc80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd674006010 tx=0x7fd674004270 comp rx=0 tx=0).stop 2024-09-12T12:24:45.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:45.170+0000 7fd688e5f640 1 -- 172.21.15.33:0/3710109473 shutdown_connections 2024-09-12T12:24:45.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:45.170+0000 7fd688e5f640 1 --2- 172.21.15.33:0/3710109473 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd66c0a2c90 0x7fd66c0a5150 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:45.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:45.170+0000 7fd688e5f640 1 --2- 172.21.15.33:0/3710109473 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd684102ef0 0x7fd6840fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:45.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:45.170+0000 7fd688e5f640 1 --2- 172.21.15.33:0/3710109473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd684102570 0x7fd6840fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:45.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:45.170+0000 7fd688e5f640 1 --2- 172.21.15.33:0/3710109473 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd684100e20 0x7fd6840fcc80 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:45.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:45.170+0000 7fd688e5f640 1 -- 172.21.15.33:0/3710109473 >> 172.21.15.33:0/3710109473 conn(0x7fd6840fc7d0 msgr2=0x7fd68406a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:45.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:45.170+0000 7fd688e5f640 1 -- 172.21.15.33:0/3710109473 shutdown_connections 2024-09-12T12:24:45.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:45.170+0000 7fd688e5f640 1 -- 172.21.15.33:0/3710109473 wait complete. 2024-09-12T12:24:45.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:45 smithi043 ceph-mon[34144]: pgmap v308: 129 pgs: 129 active+clean; 636 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 6.3 KiB/s wr, 12 op/s 2024-09-12T12:24:45.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:45 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:24:45.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:45 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:24:45.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:45 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:24:45.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:45 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:24:45.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:45 smithi102 ceph-mon[34799]: pgmap v308: 129 pgs: 129 active+clean; 636 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 6.3 KiB/s wr, 12 op/s 2024-09-12T12:24:45.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:45 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:24:45.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:45 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:24:45.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:45 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:24:45.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:45 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:24:45.829 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":308,"stamp":"2024-09-12T12:24:43.888026+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":651354,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":238,"num_read_kb":229,"num_write":339,"num_write_kb":3047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":381456,"kb_used_data":11408,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124560368,"statfs":{"total":1151940427776,"available":1151549816832,"internally_reserved":0,"allocated":11681792,"data_stored":7604142,"data_compressed":320526,"data_compressed_allocated":430080,"data_compressed_original":2359296,"omap_allocated":19141,"internal_metadata":378713403},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":54266,"num_objects":10,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":106,"num_read_kb":114,"num_write":40,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003397"},"pg_stats":[{"pgid":"2.1f","version":"85'9","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:27.786565+0000","last_change":"2024-09-12T12:23:43.779951+0000","last_active":"2024-09-12T12:24:27.786565+0000","last_peered":"2024-09-12T12:24:27.786565+0000","last_clean":"2024-09-12T12:24:27.786565+0000","last_became_active":"2024-09-12T12:23:43.779641+0000","last_became_peered":"2024-09-12T12:23:43.779641+0000","last_unstale":"2024-09-12T12:24:27.786565+0000","last_undegraded":"2024-09-12T12:24:27.786565+0000","last_fullsized":"2024-09-12T12:24:27.786565+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:49.594196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.202928+0000","last_change":"2024-09-12T12:23:45.873591+0000","last_active":"2024-09-12T12:23:57.202928+0000","last_peered":"2024-09-12T12:23:57.202928+0000","last_clean":"2024-09-12T12:23:57.202928+0000","last_became_active":"2024-09-12T12:23:45.873295+0000","last_became_peered":"2024-09-12T12:23:45.873295+0000","last_unstale":"2024-09-12T12:23:57.202928+0000","last_undegraded":"2024-09-12T12:23:57.202928+0000","last_fullsized":"2024-09-12T12:23:57.202928+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:49.907824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:56.936032+0000","last_change":"2024-09-12T12:23:52.905486+0000","last_active":"2024-09-12T12:23:56.936032+0000","last_peered":"2024-09-12T12:23:56.936032+0000","last_clean":"2024-09-12T12:23:56.936032+0000","last_became_active":"2024-09-12T12:23:52.905040+0000","last_became_peered":"2024-09-12T12:23:52.905040+0000","last_unstale":"2024-09-12T12:23:56.936032+0000","last_undegraded":"2024-09-12T12:23:56.936032+0000","last_fullsized":"2024-09-12T12:23:56.936032+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:11:06.083432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.203123+0000","last_change":"2024-09-12T12:23:43.835297+0000","last_active":"2024-09-12T12:23:57.203123+0000","last_peered":"2024-09-12T12:23:57.203123+0000","last_clean":"2024-09-12T12:23:57.203123+0000","last_became_active":"2024-09-12T12:23:43.834971+0000","last_became_peered":"2024-09-12T12:23:43.834971+0000","last_unstale":"2024-09-12T12:23:57.203123+0000","last_undegraded":"2024-09-12T12:23:57.203123+0000","last_fullsized":"2024-09-12T12:23:57.203123+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:00:07.128092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.202101+0000","last_change":"2024-09-12T12:23:45.876388+0000","last_active":"2024-09-12T12:23:57.202101+0000","last_peered":"2024-09-12T12:23:57.202101+0000","last_clean":"2024-09-12T12:23:57.202101+0000","last_became_active":"2024-09-12T12:23:45.876090+0000","last_became_peered":"2024-09-12T12:23:45.876090+0000","last_unstale":"2024-09-12T12:23:57.202101+0000","last_undegraded":"2024-09-12T12:23:57.202101+0000","last_fullsized":"2024-09-12T12:23:57.202101+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:02.576991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.200986+0000","last_change":"2024-09-12T12:23:52.904665+0000","last_active":"2024-09-12T12:23:57.200986+0000","last_peered":"2024-09-12T12:23:57.200986+0000","last_clean":"2024-09-12T12:23:57.200986+0000","last_became_active":"2024-09-12T12:23:52.903758+0000","last_became_peered":"2024-09-12T12:23:52.903758+0000","last_unstale":"2024-09-12T12:23:57.200986+0000","last_undegraded":"2024-09-12T12:23:57.200986+0000","last_fullsized":"2024-09-12T12:23:57.200986+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:48.510180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"85'4","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:27.785544+0000","last_change":"2024-09-12T12:23:43.784025+0000","last_active":"2024-09-12T12:24:27.785544+0000","last_peered":"2024-09-12T12:24:27.785544+0000","last_clean":"2024-09-12T12:24:27.785544+0000","last_became_active":"2024-09-12T12:23:43.783637+0000","last_became_peered":"2024-09-12T12:23:43.783637+0000","last_unstale":"2024-09-12T12:24:27.785544+0000","last_undegraded":"2024-09-12T12:24:27.785544+0000","last_fullsized":"2024-09-12T12:24:27.785544+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:32.814644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.902670+0000","last_change":"2024-09-12T12:23:45.863775+0000","last_active":"2024-09-12T12:23:55.902670+0000","last_peered":"2024-09-12T12:23:55.902670+0000","last_clean":"2024-09-12T12:23:55.902670+0000","last_became_active":"2024-09-12T12:23:45.863437+0000","last_became_peered":"2024-09-12T12:23:45.863437+0000","last_unstale":"2024-09-12T12:23:55.902670+0000","last_undegraded":"2024-09-12T12:23:55.902670+0000","last_fullsized":"2024-09-12T12:23:55.902670+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:33.539904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.203289+0000","last_change":"2024-09-12T12:23:52.902674+0000","last_active":"2024-09-12T12:23:57.203289+0000","last_peered":"2024-09-12T12:23:57.203289+0000","last_clean":"2024-09-12T12:23:57.203289+0000","last_became_active":"2024-09-12T12:23:52.902130+0000","last_became_peered":"2024-09-12T12:23:52.902130+0000","last_unstale":"2024-09-12T12:23:57.203289+0000","last_undegraded":"2024-09-12T12:23:57.203289+0000","last_fullsized":"2024-09-12T12:23:57.203289+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:24.867630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.200955+0000","last_change":"2024-09-12T12:23:43.783171+0000","last_active":"2024-09-12T12:23:57.200955+0000","last_peered":"2024-09-12T12:23:57.200955+0000","last_clean":"2024-09-12T12:23:57.200955+0000","last_became_active":"2024-09-12T12:23:43.782849+0000","last_became_peered":"2024-09-12T12:23:43.782849+0000","last_unstale":"2024-09-12T12:23:57.200955+0000","last_undegraded":"2024-09-12T12:23:57.200955+0000","last_fullsized":"2024-09-12T12:23:57.200955+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:42:32.481914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.903489+0000","last_change":"2024-09-12T12:23:45.878131+0000","last_active":"2024-09-12T12:23:55.903489+0000","last_peered":"2024-09-12T12:23:55.903489+0000","last_clean":"2024-09-12T12:23:55.903489+0000","last_became_active":"2024-09-12T12:23:45.877838+0000","last_became_peered":"2024-09-12T12:23:45.877838+0000","last_unstale":"2024-09-12T12:23:55.903489+0000","last_undegraded":"2024-09-12T12:23:55.903489+0000","last_fullsized":"2024-09-12T12:23:55.903489+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:31.029515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.201162+0000","last_change":"2024-09-12T12:23:52.900871+0000","last_active":"2024-09-12T12:23:57.201162+0000","last_peered":"2024-09-12T12:23:57.201162+0000","last_clean":"2024-09-12T12:23:57.201162+0000","last_became_active":"2024-09-12T12:23:52.900339+0000","last_became_peered":"2024-09-12T12:23:52.900339+0000","last_unstale":"2024-09-12T12:23:57.201162+0000","last_undegraded":"2024-09-12T12:23:57.201162+0000","last_fullsized":"2024-09-12T12:23:57.201162+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:24.778852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.201637+0000","last_change":"2024-09-12T12:23:45.879124+0000","last_active":"2024-09-12T12:23:57.201637+0000","last_peered":"2024-09-12T12:23:57.201637+0000","last_clean":"2024-09-12T12:23:57.201637+0000","last_became_active":"2024-09-12T12:23:45.878770+0000","last_became_peered":"2024-09-12T12:23:45.878770+0000","last_unstale":"2024-09-12T12:23:57.201637+0000","last_undegraded":"2024-09-12T12:23:57.201637+0000","last_fullsized":"2024-09-12T12:23:57.201637+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:58.767155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:26.781151+0000","last_change":"2024-09-12T12:23:43.782666+0000","last_active":"2024-09-12T12:24:26.781151+0000","last_peered":"2024-09-12T12:24:26.781151+0000","last_clean":"2024-09-12T12:24:26.781151+0000","last_became_active":"2024-09-12T12:23:43.782235+0000","last_became_peered":"2024-09-12T12:23:43.782235+0000","last_unstale":"2024-09-12T12:24:26.781151+0000","last_undegraded":"2024-09-12T12:24:26.781151+0000","last_fullsized":"2024-09-12T12:24:26.781151+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:28.499038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.202195+0000","last_change":"2024-09-12T12:23:52.933933+0000","last_active":"2024-09-12T12:23:57.202195+0000","last_peered":"2024-09-12T12:23:57.202195+0000","last_clean":"2024-09-12T12:23:57.202195+0000","last_became_active":"2024-09-12T12:23:52.933500+0000","last_became_peered":"2024-09-12T12:23:52.933500+0000","last_unstale":"2024-09-12T12:23:57.202195+0000","last_undegraded":"2024-09-12T12:23:57.202195+0000","last_fullsized":"2024-09-12T12:23:57.202195+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:28.598435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.201664+0000","last_change":"2024-09-12T12:23:45.868518+0000","last_active":"2024-09-12T12:23:57.201664+0000","last_peered":"2024-09-12T12:23:57.201664+0000","last_clean":"2024-09-12T12:23:57.201664+0000","last_became_active":"2024-09-12T12:23:45.868198+0000","last_became_peered":"2024-09-12T12:23:45.868198+0000","last_unstale":"2024-09-12T12:23:57.201664+0000","last_undegraded":"2024-09-12T12:23:57.201664+0000","last_fullsized":"2024-09-12T12:23:57.201664+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:53.815362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"85'1","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:56.936176+0000","last_change":"2024-09-12T12:23:43.785481+0000","last_active":"2024-09-12T12:23:56.936176+0000","last_peered":"2024-09-12T12:23:56.936176+0000","last_clean":"2024-09-12T12:23:56.936176+0000","last_became_active":"2024-09-12T12:23:43.783842+0000","last_became_peered":"2024-09-12T12:23:43.783842+0000","last_unstale":"2024-09-12T12:23:56.936176+0000","last_undegraded":"2024-09-12T12:23:56.936176+0000","last_fullsized":"2024-09-12T12:23:56.936176+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:45:30.080456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"85'1","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.202989+0000","last_change":"2024-09-12T12:23:52.898648+0000","last_active":"2024-09-12T12:23:57.202989+0000","last_peered":"2024-09-12T12:23:57.202989+0000","last_clean":"2024-09-12T12:23:57.202989+0000","last_became_active":"2024-09-12T12:23:52.898242+0000","last_became_peered":"2024-09-12T12:23:52.898242+0000","last_unstale":"2024-09-12T12:23:57.202989+0000","last_undegraded":"2024-09-12T12:23:57.202989+0000","last_fullsized":"2024-09-12T12:23:57.202989+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:49:30.598747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:56.633416+0000","last_change":"2024-09-12T12:23:45.873067+0000","last_active":"2024-09-12T12:23:56.633416+0000","last_peered":"2024-09-12T12:23:56.633416+0000","last_clean":"2024-09-12T12:23:56.633416+0000","last_became_active":"2024-09-12T12:23:45.872616+0000","last_became_peered":"2024-09-12T12:23:45.872616+0000","last_unstale":"2024-09-12T12:23:56.633416+0000","last_undegraded":"2024-09-12T12:23:56.633416+0000","last_fullsized":"2024-09-12T12:23:56.633416+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:10.960252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"85'3","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:26.781289+0000","last_change":"2024-09-12T12:23:43.780706+0000","last_active":"2024-09-12T12:24:26.781289+0000","last_peered":"2024-09-12T12:24:26.781289+0000","last_clean":"2024-09-12T12:24:26.781289+0000","last_became_active":"2024-09-12T12:23:43.780387+0000","last_became_peered":"2024-09-12T12:23:43.780387+0000","last_unstale":"2024-09-12T12:24:26.781289+0000","last_undegraded":"2024-09-12T12:24:26.781289+0000","last_fullsized":"2024-09-12T12:24:26.781289+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:54.748461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.201342+0000","last_change":"2024-09-12T12:23:52.902225+0000","last_active":"2024-09-12T12:23:57.201342+0000","last_peered":"2024-09-12T12:23:57.201342+0000","last_clean":"2024-09-12T12:23:57.201342+0000","last_became_active":"2024-09-12T12:23:52.901865+0000","last_became_peered":"2024-09-12T12:23:52.901865+0000","last_unstale":"2024-09-12T12:23:57.201342+0000","last_undegraded":"2024-09-12T12:23:57.201342+0000","last_fullsized":"2024-09-12T12:23:57.201342+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:38.020994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.200445+0000","last_change":"2024-09-12T12:23:45.875816+0000","last_active":"2024-09-12T12:23:57.200445+0000","last_peered":"2024-09-12T12:23:57.200445+0000","last_clean":"2024-09-12T12:23:57.200445+0000","last_became_active":"2024-09-12T12:23:45.875419+0000","last_became_peered":"2024-09-12T12:23:45.875419+0000","last_unstale":"2024-09-12T12:23:57.200445+0000","last_undegraded":"2024-09-12T12:23:57.200445+0000","last_fullsized":"2024-09-12T12:23:57.200445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:14:04.616759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:26.780123+0000","last_change":"2024-09-12T12:23:43.836699+0000","last_active":"2024-09-12T12:24:26.780123+0000","last_peered":"2024-09-12T12:24:26.780123+0000","last_clean":"2024-09-12T12:24:26.780123+0000","last_became_active":"2024-09-12T12:23:43.836341+0000","last_became_peered":"2024-09-12T12:23:43.836341+0000","last_unstale":"2024-09-12T12:24:26.780123+0000","last_undegraded":"2024-09-12T12:24:26.780123+0000","last_fullsized":"2024-09-12T12:24:26.780123+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:40:02.767132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.202450+0000","last_change":"2024-09-12T12:23:52.933594+0000","last_active":"2024-09-12T12:23:57.202450+0000","last_peered":"2024-09-12T12:23:57.202450+0000","last_clean":"2024-09-12T12:23:57.202450+0000","last_became_active":"2024-09-12T12:23:52.933197+0000","last_became_peered":"2024-09-12T12:23:52.933197+0000","last_unstale":"2024-09-12T12:23:57.202450+0000","last_undegraded":"2024-09-12T12:23:57.202450+0000","last_fullsized":"2024-09-12T12:23:57.202450+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:34.990674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.200926+0000","last_change":"2024-09-12T12:23:45.881962+0000","last_active":"2024-09-12T12:23:57.200926+0000","last_peered":"2024-09-12T12:23:57.200926+0000","last_clean":"2024-09-12T12:23:57.200926+0000","last_became_active":"2024-09-12T12:23:45.881697+0000","last_became_peered":"2024-09-12T12:23:45.881697+0000","last_unstale":"2024-09-12T12:23:57.200926+0000","last_undegraded":"2024-09-12T12:23:57.200926+0000","last_fullsized":"2024-09-12T12:23:57.200926+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:35:49.369852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:26.778257+0000","last_change":"2024-09-12T12:23:44.235206+0000","last_active":"2024-09-12T12:24:26.778257+0000","last_peered":"2024-09-12T12:24:26.778257+0000","last_clean":"2024-09-12T12:24:26.778257+0000","last_became_active":"2024-09-12T12:23:44.234797+0000","last_became_peered":"2024-09-12T12:23:44.234797+0000","last_unstale":"2024-09-12T12:24:26.778257+0000","last_undegraded":"2024-09-12T12:24:26.778257+0000","last_fullsized":"2024-09-12T12:24:26.778257+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:51.130077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:56.936286+0000","last_change":"2024-09-12T12:23:52.902763+0000","last_active":"2024-09-12T12:23:56.936286+0000","last_peered":"2024-09-12T12:23:56.936286+0000","last_clean":"2024-09-12T12:23:56.936286+0000","last_became_active":"2024-09-12T12:23:52.902362+0000","last_became_peered":"2024-09-12T12:23:52.902362+0000","last_unstale":"2024-09-12T12:23:56.936286+0000","last_undegraded":"2024-09-12T12:23:56.936286+0000","last_fullsized":"2024-09-12T12:23:56.936286+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:39.481290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.203189+0000","last_change":"2024-09-12T12:23:45.875014+0000","last_active":"2024-09-12T12:23:57.203189+0000","last_peered":"2024-09-12T12:23:57.203189+0000","last_clean":"2024-09-12T12:23:57.203189+0000","last_became_active":"2024-09-12T12:23:45.874673+0000","last_became_peered":"2024-09-12T12:23:45.874673+0000","last_unstale":"2024-09-12T12:23:57.203189+0000","last_undegraded":"2024-09-12T12:23:57.203189+0000","last_fullsized":"2024-09-12T12:23:57.203189+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:21.035185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"85'7","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:37.880600+0000","last_change":"2024-09-12T12:23:43.778558+0000","last_active":"2024-09-12T12:24:37.880600+0000","last_peered":"2024-09-12T12:24:37.880600+0000","last_clean":"2024-09-12T12:24:37.880600+0000","last_became_active":"2024-09-12T12:23:43.778194+0000","last_became_peered":"2024-09-12T12:23:43.778194+0000","last_unstale":"2024-09-12T12:24:37.880600+0000","last_undegraded":"2024-09-12T12:24:37.880600+0000","last_fullsized":"2024-09-12T12:24:37.880600+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:11.625462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.201248+0000","last_change":"2024-09-12T12:23:52.933833+0000","last_active":"2024-09-12T12:23:57.201248+0000","last_peered":"2024-09-12T12:23:57.201248+0000","last_clean":"2024-09-12T12:23:57.201248+0000","last_became_active":"2024-09-12T12:23:52.933330+0000","last_became_peered":"2024-09-12T12:23:52.933330+0000","last_unstale":"2024-09-12T12:23:57.201248+0000","last_undegraded":"2024-09-12T12:23:57.201248+0000","last_fullsized":"2024-09-12T12:23:57.201248+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:31.129088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.906430+0000","last_change":"2024-09-12T12:23:45.872527+0000","last_active":"2024-09-12T12:23:55.906430+0000","last_peered":"2024-09-12T12:23:55.906430+0000","last_clean":"2024-09-12T12:23:55.906430+0000","last_became_active":"2024-09-12T12:23:45.872220+0000","last_became_peered":"2024-09-12T12:23:45.872220+0000","last_unstale":"2024-09-12T12:23:55.906430+0000","last_undegraded":"2024-09-12T12:23:55.906430+0000","last_fullsized":"2024-09-12T12:23:55.906430+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:38:08.734145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"85'1","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:26.778041+0000","last_change":"2024-09-12T12:23:43.835824+0000","last_active":"2024-09-12T12:24:26.778041+0000","last_peered":"2024-09-12T12:24:26.778041+0000","last_clean":"2024-09-12T12:24:26.778041+0000","last_became_active":"2024-09-12T12:23:43.835375+0000","last_became_peered":"2024-09-12T12:23:43.835375+0000","last_unstale":"2024-09-12T12:24:26.778041+0000","last_undegraded":"2024-09-12T12:24:26.778041+0000","last_fullsized":"2024-09-12T12:24:26.778041+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:58:57.547060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:56.633477+0000","last_change":"2024-09-12T12:23:52.901739+0000","last_active":"2024-09-12T12:23:56.633477+0000","last_peered":"2024-09-12T12:23:56.633477+0000","last_clean":"2024-09-12T12:23:56.633477+0000","last_became_active":"2024-09-12T12:23:52.901370+0000","last_became_peered":"2024-09-12T12:23:52.901370+0000","last_unstale":"2024-09-12T12:23:56.633477+0000","last_undegraded":"2024-09-12T12:23:56.633477+0000","last_fullsized":"2024-09-12T12:23:56.633477+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:56:44.430446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.202218+0000","last_change":"2024-09-12T12:23:45.870491+0000","last_active":"2024-09-12T12:23:57.202218+0000","last_peered":"2024-09-12T12:23:57.202218+0000","last_clean":"2024-09-12T12:23:57.202218+0000","last_became_active":"2024-09-12T12:23:45.870182+0000","last_became_peered":"2024-09-12T12:23:45.870182+0000","last_unstale":"2024-09-12T12:23:57.202218+0000","last_undegraded":"2024-09-12T12:23:57.202218+0000","last_fullsized":"2024-09-12T12:23:57.202218+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:07.094287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.201135+0000","last_change":"2024-09-12T12:23:43.837430+0000","last_active":"2024-09-12T12:23:57.201135+0000","last_peered":"2024-09-12T12:23:57.201135+0000","last_clean":"2024-09-12T12:23:57.201135+0000","last_became_active":"2024-09-12T12:23:43.837091+0000","last_became_peered":"2024-09-12T12:23:43.837091+0000","last_unstale":"2024-09-12T12:23:57.201135+0000","last_undegraded":"2024-09-12T12:23:57.201135+0000","last_fullsized":"2024-09-12T12:23:57.201135+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:30.841341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.200504+0000","last_change":"2024-09-12T12:23:52.934196+0000","last_active":"2024-09-12T12:23:57.200504+0000","last_peered":"2024-09-12T12:23:57.200504+0000","last_clean":"2024-09-12T12:23:57.200504+0000","last_became_active":"2024-09-12T12:23:52.933745+0000","last_became_peered":"2024-09-12T12:23:52.933745+0000","last_unstale":"2024-09-12T12:23:57.200504+0000","last_undegraded":"2024-09-12T12:23:57.200504+0000","last_fullsized":"2024-09-12T12:23:57.200504+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:47.139397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.202279+0000","last_change":"2024-09-12T12:23:45.876159+0000","last_active":"2024-09-12T12:23:57.202279+0000","last_peered":"2024-09-12T12:23:57.202279+0000","last_clean":"2024-09-12T12:23:57.202279+0000","last_became_active":"2024-09-12T12:23:45.875771+0000","last_became_peered":"2024-09-12T12:23:45.875771+0000","last_unstale":"2024-09-12T12:23:57.202279+0000","last_undegraded":"2024-09-12T12:23:57.202279+0000","last_fullsized":"2024-09-12T12:23:57.202279+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:55.699099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'1","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.202247+0000","last_change":"2024-09-12T12:23:43.787082+0000","last_active":"2024-09-12T12:23:57.202247+0000","last_peered":"2024-09-12T12:23:57.202247+0000","last_clean":"2024-09-12T12:23:57.202247+0000","last_became_active":"2024-09-12T12:23:43.786619+0000","last_became_peered":"2024-09-12T12:23:43.786619+0000","last_unstale":"2024-09-12T12:23:57.202247+0000","last_undegraded":"2024-09-12T12:23:57.202247+0000","last_fullsized":"2024-09-12T12:23:57.202247+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:21.120020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.906380+0000","last_change":"2024-09-12T12:23:52.899659+0000","last_active":"2024-09-12T12:23:55.906380+0000","last_peered":"2024-09-12T12:23:55.906380+0000","last_clean":"2024-09-12T12:23:55.906380+0000","last_became_active":"2024-09-12T12:23:52.899226+0000","last_became_peered":"2024-09-12T12:23:52.899226+0000","last_unstale":"2024-09-12T12:23:55.906380+0000","last_undegraded":"2024-09-12T12:23:55.906380+0000","last_fullsized":"2024-09-12T12:23:55.906380+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:41.979174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.902829+0000","last_change":"2024-09-12T12:23:45.879112+0000","last_active":"2024-09-12T12:23:55.902829+0000","last_peered":"2024-09-12T12:23:55.902829+0000","last_clean":"2024-09-12T12:23:55.902829+0000","last_became_active":"2024-09-12T12:23:45.878684+0000","last_became_peered":"2024-09-12T12:23:45.878684+0000","last_unstale":"2024-09-12T12:23:55.902829+0000","last_undegraded":"2024-09-12T12:23:55.902829+0000","last_fullsized":"2024-09-12T12:23:55.902829+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:11:18.102437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'4","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:39.806397+0000","last_change":"2024-09-12T12:23:43.835282+0000","last_active":"2024-09-12T12:24:39.806397+0000","last_peered":"2024-09-12T12:24:39.806397+0000","last_clean":"2024-09-12T12:24:39.806397+0000","last_became_active":"2024-09-12T12:23:43.834929+0000","last_became_peered":"2024-09-12T12:23:43.834929+0000","last_unstale":"2024-09-12T12:24:39.806397+0000","last_undegraded":"2024-09-12T12:24:39.806397+0000","last_fullsized":"2024-09-12T12:24:39.806397+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:59:11.516387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.906671+0000","last_change":"2024-09-12T12:23:52.934077+0000","last_active":"2024-09-12T12:23:55.906671+0000","last_peered":"2024-09-12T12:23:55.906671+0000","last_clean":"2024-09-12T12:23:55.906671+0000","last_became_active":"2024-09-12T12:23:52.933583+0000","last_became_peered":"2024-09-12T12:23:52.933583+0000","last_unstale":"2024-09-12T12:23:55.906671+0000","last_undegraded":"2024-09-12T12:23:55.906671+0000","last_fullsized":"2024-09-12T12:23:55.906671+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:06.570624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.905914+0000","last_change":"2024-09-12T12:23:45.875735+0000","last_active":"2024-09-12T12:23:55.905914+0000","last_peered":"2024-09-12T12:23:55.905914+0000","last_clean":"2024-09-12T12:23:55.905914+0000","last_became_active":"2024-09-12T12:23:45.875072+0000","last_became_peered":"2024-09-12T12:23:45.875072+0000","last_unstale":"2024-09-12T12:23:55.905914+0000","last_undegraded":"2024-09-12T12:23:55.905914+0000","last_fullsized":"2024-09-12T12:23:55.905914+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:10.508123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'3","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:27.786242+0000","last_change":"2024-09-12T12:23:43.785226+0000","last_active":"2024-09-12T12:24:27.786242+0000","last_peered":"2024-09-12T12:24:27.786242+0000","last_clean":"2024-09-12T12:24:27.786242+0000","last_became_active":"2024-09-12T12:23:43.783705+0000","last_became_peered":"2024-09-12T12:23:43.783705+0000","last_unstale":"2024-09-12T12:24:27.786242+0000","last_undegraded":"2024-09-12T12:24:27.786242+0000","last_fullsized":"2024-09-12T12:24:27.786242+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:21.269569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.903593+0000","last_change":"2024-09-12T12:23:52.934383+0000","last_active":"2024-09-12T12:23:55.903593+0000","last_peered":"2024-09-12T12:23:55.903593+0000","last_clean":"2024-09-12T12:23:55.903593+0000","last_became_active":"2024-09-12T12:23:52.933744+0000","last_became_peered":"2024-09-12T12:23:52.933744+0000","last_unstale":"2024-09-12T12:23:55.903593+0000","last_undegraded":"2024-09-12T12:23:55.903593+0000","last_fullsized":"2024-09-12T12:23:55.903593+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:44.656785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.201372+0000","last_change":"2024-09-12T12:23:45.873460+0000","last_active":"2024-09-12T12:23:57.201372+0000","last_peered":"2024-09-12T12:23:57.201372+0000","last_clean":"2024-09-12T12:23:57.201372+0000","last_became_active":"2024-09-12T12:23:45.873188+0000","last_became_peered":"2024-09-12T12:23:45.873188+0000","last_unstale":"2024-09-12T12:23:57.201372+0000","last_undegraded":"2024-09-12T12:23:57.201372+0000","last_fullsized":"2024-09-12T12:23:57.201372+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:18:29.503856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'3","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:28.787341+0000","last_change":"2024-09-12T12:23:43.781082+0000","last_active":"2024-09-12T12:24:28.787341+0000","last_peered":"2024-09-12T12:24:28.787341+0000","last_clean":"2024-09-12T12:24:28.787341+0000","last_became_active":"2024-09-12T12:23:43.780710+0000","last_became_peered":"2024-09-12T12:23:43.780710+0000","last_unstale":"2024-09-12T12:24:28.787341+0000","last_undegraded":"2024-09-12T12:24:28.787341+0000","last_fullsized":"2024-09-12T12:24:28.787341+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:13:23.748716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":343,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.201301+0000","last_change":"2024-09-12T12:22:37.536326+0000","last_active":"2024-09-12T12:23:57.201301+0000","last_peered":"2024-09-12T12:23:57.201301+0000","last_clean":"2024-09-12T12:23:57.201301+0000","last_became_active":"2024-09-12T12:22:37.535831+0000","last_became_peered":"2024-09-12T12:22:37.535831+0000","last_unstale":"2024-09-12T12:23:57.201301+0000","last_undegraded":"2024-09-12T12:23:57.201301+0000","last_fullsized":"2024-09-12T12:23:57.201301+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:19:12.296434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:19:12.296434+0000","last_clean_scrub_stamp":"2024-09-12T12:19:12.296434+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:04:49.251883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"85'1","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.202733+0000","last_change":"2024-09-12T12:23:52.899782+0000","last_active":"2024-09-12T12:23:57.202733+0000","last_peered":"2024-09-12T12:23:57.202733+0000","last_clean":"2024-09-12T12:23:57.202733+0000","last_became_active":"2024-09-12T12:23:52.898938+0000","last_became_peered":"2024-09-12T12:23:52.898938+0000","last_unstale":"2024-09-12T12:23:57.202733+0000","last_undegraded":"2024-09-12T12:23:57.202733+0000","last_fullsized":"2024-09-12T12:23:57.202733+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:21.429444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.202985+0000","last_change":"2024-09-12T12:23:45.883059+0000","last_active":"2024-09-12T12:23:57.202985+0000","last_peered":"2024-09-12T12:23:57.202985+0000","last_clean":"2024-09-12T12:23:57.202985+0000","last_became_active":"2024-09-12T12:23:45.882206+0000","last_became_peered":"2024-09-12T12:23:45.882206+0000","last_unstale":"2024-09-12T12:23:57.202985+0000","last_undegraded":"2024-09-12T12:23:57.202985+0000","last_fullsized":"2024-09-12T12:23:57.202985+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:43.068533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'3","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:27.786304+0000","last_change":"2024-09-12T12:23:44.235088+0000","last_active":"2024-09-12T12:24:27.786304+0000","last_peered":"2024-09-12T12:24:27.786304+0000","last_clean":"2024-09-12T12:24:27.786304+0000","last_became_active":"2024-09-12T12:23:44.234551+0000","last_became_peered":"2024-09-12T12:23:44.234551+0000","last_unstale":"2024-09-12T12:24:27.786304+0000","last_undegraded":"2024-09-12T12:24:27.786304+0000","last_fullsized":"2024-09-12T12:24:27.786304+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:47.474387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.902944+0000","last_change":"2024-09-12T12:23:52.897807+0000","last_active":"2024-09-12T12:23:55.902944+0000","last_peered":"2024-09-12T12:23:55.902944+0000","last_clean":"2024-09-12T12:23:55.902944+0000","last_became_active":"2024-09-12T12:23:52.897405+0000","last_became_peered":"2024-09-12T12:23:52.897405+0000","last_unstale":"2024-09-12T12:23:55.902944+0000","last_undegraded":"2024-09-12T12:23:55.902944+0000","last_fullsized":"2024-09-12T12:23:55.902944+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:34.714177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.202493+0000","last_change":"2024-09-12T12:23:45.873907+0000","last_active":"2024-09-12T12:23:57.202493+0000","last_peered":"2024-09-12T12:23:57.202493+0000","last_clean":"2024-09-12T12:23:57.202493+0000","last_became_active":"2024-09-12T12:23:45.873464+0000","last_became_peered":"2024-09-12T12:23:45.873464+0000","last_unstale":"2024-09-12T12:23:57.202493+0000","last_undegraded":"2024-09-12T12:23:57.202493+0000","last_fullsized":"2024-09-12T12:23:57.202493+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:38:18.151880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.903793+0000","last_change":"2024-09-12T12:23:43.782649+0000","last_active":"2024-09-12T12:23:55.903793+0000","last_peered":"2024-09-12T12:23:55.903793+0000","last_clean":"2024-09-12T12:23:55.903793+0000","last_became_active":"2024-09-12T12:23:43.782290+0000","last_became_peered":"2024-09-12T12:23:43.782290+0000","last_unstale":"2024-09-12T12:23:55.903793+0000","last_undegraded":"2024-09-12T12:23:55.903793+0000","last_fullsized":"2024-09-12T12:23:55.903793+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:30:56.964121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.201084+0000","last_change":"2024-09-12T12:23:52.905108+0000","last_active":"2024-09-12T12:23:57.201084+0000","last_peered":"2024-09-12T12:23:57.201084+0000","last_clean":"2024-09-12T12:23:57.201084+0000","last_became_active":"2024-09-12T12:23:52.904664+0000","last_became_peered":"2024-09-12T12:23:52.904664+0000","last_unstale":"2024-09-12T12:23:57.201084+0000","last_undegraded":"2024-09-12T12:23:57.201084+0000","last_fullsized":"2024-09-12T12:23:57.201084+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:11.177971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.201791+0000","last_change":"2024-09-12T12:23:45.875244+0000","last_active":"2024-09-12T12:23:57.201791+0000","last_peered":"2024-09-12T12:23:57.201791+0000","last_clean":"2024-09-12T12:23:57.201791+0000","last_became_active":"2024-09-12T12:23:45.874889+0000","last_became_peered":"2024-09-12T12:23:45.874889+0000","last_unstale":"2024-09-12T12:23:57.201791+0000","last_undegraded":"2024-09-12T12:23:57.201791+0000","last_fullsized":"2024-09-12T12:23:57.201791+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:30:38.192162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.906597+0000","last_change":"2024-09-12T12:23:43.783232+0000","last_active":"2024-09-12T12:23:55.906597+0000","last_peered":"2024-09-12T12:23:55.906597+0000","last_clean":"2024-09-12T12:23:55.906597+0000","last_became_active":"2024-09-12T12:23:43.782975+0000","last_became_peered":"2024-09-12T12:23:43.782975+0000","last_unstale":"2024-09-12T12:23:55.906597+0000","last_undegraded":"2024-09-12T12:23:55.906597+0000","last_fullsized":"2024-09-12T12:23:55.906597+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:45.096636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.902674+0000","last_change":"2024-09-12T12:23:52.898356+0000","last_active":"2024-09-12T12:23:55.902674+0000","last_peered":"2024-09-12T12:23:55.902674+0000","last_clean":"2024-09-12T12:23:55.902674+0000","last_became_active":"2024-09-12T12:23:52.897868+0000","last_became_peered":"2024-09-12T12:23:52.897868+0000","last_unstale":"2024-09-12T12:23:55.902674+0000","last_undegraded":"2024-09-12T12:23:55.902674+0000","last_fullsized":"2024-09-12T12:23:55.902674+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:16:36.473730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:56.633733+0000","last_change":"2024-09-12T12:23:45.881532+0000","last_active":"2024-09-12T12:23:56.633733+0000","last_peered":"2024-09-12T12:23:56.633733+0000","last_clean":"2024-09-12T12:23:56.633733+0000","last_became_active":"2024-09-12T12:23:45.880895+0000","last_became_peered":"2024-09-12T12:23:45.880895+0000","last_unstale":"2024-09-12T12:23:56.633733+0000","last_undegraded":"2024-09-12T12:23:56.633733+0000","last_fullsized":"2024-09-12T12:23:56.633733+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:09:05.249773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:28.781674+0000","last_change":"2024-09-12T12:23:43.783436+0000","last_active":"2024-09-12T12:24:28.781674+0000","last_peered":"2024-09-12T12:24:28.781674+0000","last_clean":"2024-09-12T12:24:28.781674+0000","last_became_active":"2024-09-12T12:23:43.782975+0000","last_became_peered":"2024-09-12T12:23:43.782975+0000","last_unstale":"2024-09-12T12:24:28.781674+0000","last_undegraded":"2024-09-12T12:24:28.781674+0000","last_fullsized":"2024-09-12T12:24:28.781674+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:20.840189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.902770+0000","last_change":"2024-09-12T12:23:52.903210+0000","last_active":"2024-09-12T12:23:55.902770+0000","last_peered":"2024-09-12T12:23:55.902770+0000","last_clean":"2024-09-12T12:23:55.902770+0000","last_became_active":"2024-09-12T12:23:52.902832+0000","last_became_peered":"2024-09-12T12:23:52.902832+0000","last_unstale":"2024-09-12T12:23:55.902770+0000","last_undegraded":"2024-09-12T12:23:55.902770+0000","last_fullsized":"2024-09-12T12:23:55.902770+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:46:40.506581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.903039+0000","last_change":"2024-09-12T12:23:45.880314+0000","last_active":"2024-09-12T12:23:55.903039+0000","last_peered":"2024-09-12T12:23:55.903039+0000","last_clean":"2024-09-12T12:23:55.903039+0000","last_became_active":"2024-09-12T12:23:45.879878+0000","last_became_peered":"2024-09-12T12:23:45.879878+0000","last_unstale":"2024-09-12T12:23:55.903039+0000","last_undegraded":"2024-09-12T12:23:55.903039+0000","last_fullsized":"2024-09-12T12:23:55.903039+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:47.197008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"85'15","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:27.787156+0000","last_change":"2024-09-12T12:23:43.837005+0000","last_active":"2024-09-12T12:24:27.787156+0000","last_peered":"2024-09-12T12:24:27.787156+0000","last_clean":"2024-09-12T12:24:27.787156+0000","last_became_active":"2024-09-12T12:23:43.836630+0000","last_became_peered":"2024-09-12T12:23:43.836630+0000","last_unstale":"2024-09-12T12:24:27.787156+0000","last_undegraded":"2024-09-12T12:24:27.787156+0000","last_fullsized":"2024-09-12T12:24:27.787156+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:33:06.710430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.906632+0000","last_change":"2024-09-12T12:23:52.901841+0000","last_active":"2024-09-12T12:23:55.906632+0000","last_peered":"2024-09-12T12:23:55.906632+0000","last_clean":"2024-09-12T12:23:55.906632+0000","last_became_active":"2024-09-12T12:23:52.901469+0000","last_became_peered":"2024-09-12T12:23:52.901469+0000","last_unstale":"2024-09-12T12:23:55.906632+0000","last_undegraded":"2024-09-12T12:23:55.906632+0000","last_fullsized":"2024-09-12T12:23:55.906632+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:40.472980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.201096+0000","last_change":"2024-09-12T12:23:45.874026+0000","last_active":"2024-09-12T12:23:57.201096+0000","last_peered":"2024-09-12T12:23:57.201096+0000","last_clean":"2024-09-12T12:23:57.201096+0000","last_became_active":"2024-09-12T12:23:45.873494+0000","last_became_peered":"2024-09-12T12:23:45.873494+0000","last_unstale":"2024-09-12T12:23:57.201096+0000","last_undegraded":"2024-09-12T12:23:57.201096+0000","last_fullsized":"2024-09-12T12:23:57.201096+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:28.870938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'3","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:40.808323+0000","last_change":"2024-09-12T12:23:43.781866+0000","last_active":"2024-09-12T12:24:40.808323+0000","last_peered":"2024-09-12T12:24:40.808323+0000","last_clean":"2024-09-12T12:24:40.808323+0000","last_became_active":"2024-09-12T12:23:43.781488+0000","last_became_peered":"2024-09-12T12:23:43.781488+0000","last_unstale":"2024-09-12T12:24:40.808323+0000","last_undegraded":"2024-09-12T12:24:40.808323+0000","last_fullsized":"2024-09-12T12:24:40.808323+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:13:28.729199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.201464+0000","last_change":"2024-09-12T12:23:52.903427+0000","last_active":"2024-09-12T12:23:57.201464+0000","last_peered":"2024-09-12T12:23:57.201464+0000","last_clean":"2024-09-12T12:23:57.201464+0000","last_became_active":"2024-09-12T12:23:52.903077+0000","last_became_peered":"2024-09-12T12:23:52.903077+0000","last_unstale":"2024-09-12T12:23:57.201464+0000","last_undegraded":"2024-09-12T12:23:57.201464+0000","last_fullsized":"2024-09-12T12:23:57.201464+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:26:03.409086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.201875+0000","last_change":"2024-09-12T12:23:45.873628+0000","last_active":"2024-09-12T12:23:57.201875+0000","last_peered":"2024-09-12T12:23:57.201875+0000","last_clean":"2024-09-12T12:23:57.201875+0000","last_became_active":"2024-09-12T12:23:45.873264+0000","last_became_peered":"2024-09-12T12:23:45.873264+0000","last_unstale":"2024-09-12T12:23:57.201875+0000","last_undegraded":"2024-09-12T12:23:57.201875+0000","last_fullsized":"2024-09-12T12:23:57.201875+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:17:03.257858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"85'3","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:26.780771+0000","last_change":"2024-09-12T12:23:43.787320+0000","last_active":"2024-09-12T12:24:26.780771+0000","last_peered":"2024-09-12T12:24:26.780771+0000","last_clean":"2024-09-12T12:24:26.780771+0000","last_became_active":"2024-09-12T12:23:43.786937+0000","last_became_peered":"2024-09-12T12:23:43.786937+0000","last_unstale":"2024-09-12T12:24:26.780771+0000","last_undegraded":"2024-09-12T12:24:26.780771+0000","last_fullsized":"2024-09-12T12:24:26.780771+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:19.539586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:56.633713+0000","last_change":"2024-09-12T12:23:52.904582+0000","last_active":"2024-09-12T12:23:56.633713+0000","last_peered":"2024-09-12T12:23:56.633713+0000","last_clean":"2024-09-12T12:23:56.633713+0000","last_became_active":"2024-09-12T12:23:52.904172+0000","last_became_peered":"2024-09-12T12:23:52.904172+0000","last_unstale":"2024-09-12T12:23:56.633713+0000","last_undegraded":"2024-09-12T12:23:56.633713+0000","last_fullsized":"2024-09-12T12:23:56.633713+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:26:14.734098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.906094+0000","last_change":"2024-09-12T12:23:45.878128+0000","last_active":"2024-09-12T12:23:55.906094+0000","last_peered":"2024-09-12T12:23:55.906094+0000","last_clean":"2024-09-12T12:23:55.906094+0000","last_became_active":"2024-09-12T12:23:45.877154+0000","last_became_peered":"2024-09-12T12:23:45.877154+0000","last_unstale":"2024-09-12T12:23:55.906094+0000","last_undegraded":"2024-09-12T12:23:55.906094+0000","last_fullsized":"2024-09-12T12:23:55.906094+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:06.095805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"85'6","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:27.785429+0000","last_change":"2024-09-12T12:23:43.783586+0000","last_active":"2024-09-12T12:24:27.785429+0000","last_peered":"2024-09-12T12:24:27.785429+0000","last_clean":"2024-09-12T12:24:27.785429+0000","last_became_active":"2024-09-12T12:23:43.783255+0000","last_became_peered":"2024-09-12T12:23:43.783255+0000","last_unstale":"2024-09-12T12:24:27.785429+0000","last_undegraded":"2024-09-12T12:24:27.785429+0000","last_fullsized":"2024-09-12T12:24:27.785429+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:38.609805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.903496+0000","last_change":"2024-09-12T12:23:52.901120+0000","last_active":"2024-09-12T12:23:55.903496+0000","last_peered":"2024-09-12T12:23:55.903496+0000","last_clean":"2024-09-12T12:23:55.903496+0000","last_became_active":"2024-09-12T12:23:52.900700+0000","last_became_peered":"2024-09-12T12:23:52.900700+0000","last_unstale":"2024-09-12T12:23:55.903496+0000","last_undegraded":"2024-09-12T12:23:55.903496+0000","last_fullsized":"2024-09-12T12:23:55.903496+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:18.225867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.200901+0000","last_change":"2024-09-12T12:23:45.878074+0000","last_active":"2024-09-12T12:23:57.200901+0000","last_peered":"2024-09-12T12:23:57.200901+0000","last_clean":"2024-09-12T12:23:57.200901+0000","last_became_active":"2024-09-12T12:23:45.877753+0000","last_became_peered":"2024-09-12T12:23:45.877753+0000","last_unstale":"2024-09-12T12:23:57.200901+0000","last_undegraded":"2024-09-12T12:23:57.200901+0000","last_fullsized":"2024-09-12T12:23:57.200901+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:15.515609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"85'30","reported_seq":97,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:42.810874+0000","last_change":"2024-09-12T12:23:43.787476+0000","last_active":"2024-09-12T12:24:42.810874+0000","last_peered":"2024-09-12T12:24:42.810874+0000","last_clean":"2024-09-12T12:24:42.810874+0000","last_became_active":"2024-09-12T12:23:43.786808+0000","last_became_peered":"2024-09-12T12:23:43.786808+0000","last_unstale":"2024-09-12T12:24:42.810874+0000","last_undegraded":"2024-09-12T12:24:42.810874+0000","last_fullsized":"2024-09-12T12:24:42.810874+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:08:28.046702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56749,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":73,"num_write":31,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.201138+0000","last_change":"2024-09-12T12:23:52.900089+0000","last_active":"2024-09-12T12:23:57.201138+0000","last_peered":"2024-09-12T12:23:57.201138+0000","last_clean":"2024-09-12T12:23:57.201138+0000","last_became_active":"2024-09-12T12:23:52.899711+0000","last_became_peered":"2024-09-12T12:23:52.899711+0000","last_unstale":"2024-09-12T12:23:57.201138+0000","last_undegraded":"2024-09-12T12:23:57.201138+0000","last_fullsized":"2024-09-12T12:23:57.201138+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:58:38.850382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.902811+0000","last_change":"2024-09-12T12:23:45.876773+0000","last_active":"2024-09-12T12:23:55.902811+0000","last_peered":"2024-09-12T12:23:55.902811+0000","last_clean":"2024-09-12T12:23:55.902811+0000","last_became_active":"2024-09-12T12:23:45.876394+0000","last_became_peered":"2024-09-12T12:23:45.876394+0000","last_unstale":"2024-09-12T12:23:55.902811+0000","last_undegraded":"2024-09-12T12:23:55.902811+0000","last_fullsized":"2024-09-12T12:23:55.902811+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:55.468779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"85'4","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:26.781654+0000","last_change":"2024-09-12T12:23:43.835826+0000","last_active":"2024-09-12T12:24:26.781654+0000","last_peered":"2024-09-12T12:24:26.781654+0000","last_clean":"2024-09-12T12:24:26.781654+0000","last_became_active":"2024-09-12T12:23:43.835378+0000","last_became_peered":"2024-09-12T12:23:43.835378+0000","last_unstale":"2024-09-12T12:24:26.781654+0000","last_undegraded":"2024-09-12T12:24:26.781654+0000","last_fullsized":"2024-09-12T12:24:26.781654+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:23.429407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.203349+0000","last_change":"2024-09-12T12:23:52.905212+0000","last_active":"2024-09-12T12:23:57.203349+0000","last_peered":"2024-09-12T12:23:57.203349+0000","last_clean":"2024-09-12T12:23:57.203349+0000","last_became_active":"2024-09-12T12:23:52.904675+0000","last_became_peered":"2024-09-12T12:23:52.904675+0000","last_unstale":"2024-09-12T12:23:57.203349+0000","last_undegraded":"2024-09-12T12:23:57.203349+0000","last_fullsized":"2024-09-12T12:23:57.203349+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:30.404242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.202186+0000","last_change":"2024-09-12T12:23:45.875222+0000","last_active":"2024-09-12T12:23:57.202186+0000","last_peered":"2024-09-12T12:23:57.202186+0000","last_clean":"2024-09-12T12:23:57.202186+0000","last_became_active":"2024-09-12T12:23:45.874859+0000","last_became_peered":"2024-09-12T12:23:45.874859+0000","last_unstale":"2024-09-12T12:23:57.202186+0000","last_undegraded":"2024-09-12T12:23:57.202186+0000","last_fullsized":"2024-09-12T12:23:57.202186+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:29:00.017470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"85'2","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:26.780081+0000","last_change":"2024-09-12T12:23:43.788052+0000","last_active":"2024-09-12T12:24:26.780081+0000","last_peered":"2024-09-12T12:24:26.780081+0000","last_clean":"2024-09-12T12:24:26.780081+0000","last_became_active":"2024-09-12T12:23:43.787533+0000","last_became_peered":"2024-09-12T12:23:43.787533+0000","last_unstale":"2024-09-12T12:24:26.780081+0000","last_undegraded":"2024-09-12T12:24:26.780081+0000","last_fullsized":"2024-09-12T12:24:26.780081+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:32.042395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.200497+0000","last_change":"2024-09-12T12:23:52.900856+0000","last_active":"2024-09-12T12:23:57.200497+0000","last_peered":"2024-09-12T12:23:57.200497+0000","last_clean":"2024-09-12T12:23:57.200497+0000","last_became_active":"2024-09-12T12:23:52.900444+0000","last_became_peered":"2024-09-12T12:23:52.900444+0000","last_unstale":"2024-09-12T12:23:57.200497+0000","last_undegraded":"2024-09-12T12:23:57.200497+0000","last_fullsized":"2024-09-12T12:23:57.200497+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:52:22.443801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.902938+0000","last_change":"2024-09-12T12:23:45.869666+0000","last_active":"2024-09-12T12:23:55.902938+0000","last_peered":"2024-09-12T12:23:55.902938+0000","last_clean":"2024-09-12T12:23:55.902938+0000","last_became_active":"2024-09-12T12:23:45.869308+0000","last_became_peered":"2024-09-12T12:23:45.869308+0000","last_unstale":"2024-09-12T12:23:55.902938+0000","last_undegraded":"2024-09-12T12:23:55.902938+0000","last_fullsized":"2024-09-12T12:23:55.902938+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:37:47.895807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"85'3","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:41.808705+0000","last_change":"2024-09-12T12:23:43.786124+0000","last_active":"2024-09-12T12:24:41.808705+0000","last_peered":"2024-09-12T12:24:41.808705+0000","last_clean":"2024-09-12T12:24:41.808705+0000","last_became_active":"2024-09-12T12:23:43.785772+0000","last_became_peered":"2024-09-12T12:23:43.785772+0000","last_unstale":"2024-09-12T12:24:41.808705+0000","last_undegraded":"2024-09-12T12:24:41.808705+0000","last_fullsized":"2024-09-12T12:24:41.808705+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:23.458792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.201530+0000","last_change":"2024-09-12T12:23:52.905541+0000","last_active":"2024-09-12T12:23:57.201530+0000","last_peered":"2024-09-12T12:23:57.201530+0000","last_clean":"2024-09-12T12:23:57.201530+0000","last_became_active":"2024-09-12T12:23:52.905165+0000","last_became_peered":"2024-09-12T12:23:52.905165+0000","last_unstale":"2024-09-12T12:23:57.201530+0000","last_undegraded":"2024-09-12T12:23:57.201530+0000","last_fullsized":"2024-09-12T12:23:57.201530+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:40.831208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.200737+0000","last_change":"2024-09-12T12:23:52.901738+0000","last_active":"2024-09-12T12:23:57.200737+0000","last_peered":"2024-09-12T12:23:57.200737+0000","last_clean":"2024-09-12T12:23:57.200737+0000","last_became_active":"2024-09-12T12:23:52.901348+0000","last_became_peered":"2024-09-12T12:23:52.901348+0000","last_unstale":"2024-09-12T12:23:57.200737+0000","last_undegraded":"2024-09-12T12:23:57.200737+0000","last_fullsized":"2024-09-12T12:23:57.200737+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:16:24.075130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.200665+0000","last_change":"2024-09-12T12:23:45.869431+0000","last_active":"2024-09-12T12:23:57.200665+0000","last_peered":"2024-09-12T12:23:57.200665+0000","last_clean":"2024-09-12T12:23:57.200665+0000","last_became_active":"2024-09-12T12:23:45.869078+0000","last_became_peered":"2024-09-12T12:23:45.869078+0000","last_unstale":"2024-09-12T12:23:57.200665+0000","last_undegraded":"2024-09-12T12:23:57.200665+0000","last_fullsized":"2024-09-12T12:23:57.200665+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:37:19.849489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"85'1","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.903068+0000","last_change":"2024-09-12T12:23:43.787852+0000","last_active":"2024-09-12T12:23:55.903068+0000","last_peered":"2024-09-12T12:23:55.903068+0000","last_clean":"2024-09-12T12:23:55.903068+0000","last_became_active":"2024-09-12T12:23:43.787531+0000","last_became_peered":"2024-09-12T12:23:43.787531+0000","last_unstale":"2024-09-12T12:23:55.903068+0000","last_undegraded":"2024-09-12T12:23:55.903068+0000","last_fullsized":"2024-09-12T12:23:55.903068+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:25.499020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:56.633855+0000","last_change":"2024-09-12T12:23:52.904603+0000","last_active":"2024-09-12T12:23:56.633855+0000","last_peered":"2024-09-12T12:23:56.633855+0000","last_clean":"2024-09-12T12:23:56.633855+0000","last_became_active":"2024-09-12T12:23:52.904146+0000","last_became_peered":"2024-09-12T12:23:52.904146+0000","last_unstale":"2024-09-12T12:23:56.633855+0000","last_undegraded":"2024-09-12T12:23:56.633855+0000","last_fullsized":"2024-09-12T12:23:56.633855+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:01.847489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.201536+0000","last_change":"2024-09-12T12:23:45.880381+0000","last_active":"2024-09-12T12:23:57.201536+0000","last_peered":"2024-09-12T12:23:57.201536+0000","last_clean":"2024-09-12T12:23:57.201536+0000","last_became_active":"2024-09-12T12:23:45.879865+0000","last_became_peered":"2024-09-12T12:23:45.879865+0000","last_unstale":"2024-09-12T12:23:57.201536+0000","last_undegraded":"2024-09-12T12:23:57.201536+0000","last_fullsized":"2024-09-12T12:23:57.201536+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:52.033891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"85'2","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:27.784776+0000","last_change":"2024-09-12T12:23:43.782166+0000","last_active":"2024-09-12T12:24:27.784776+0000","last_peered":"2024-09-12T12:24:27.784776+0000","last_clean":"2024-09-12T12:24:27.784776+0000","last_became_active":"2024-09-12T12:23:43.781808+0000","last_became_peered":"2024-09-12T12:23:43.781808+0000","last_unstale":"2024-09-12T12:24:27.784776+0000","last_undegraded":"2024-09-12T12:24:27.784776+0000","last_fullsized":"2024-09-12T12:24:27.784776+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:44:03.340842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"85'3","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:27.785085+0000","last_change":"2024-09-12T12:23:43.784869+0000","last_active":"2024-09-12T12:24:27.785085+0000","last_peered":"2024-09-12T12:24:27.785085+0000","last_clean":"2024-09-12T12:24:27.785085+0000","last_became_active":"2024-09-12T12:23:43.784458+0000","last_became_peered":"2024-09-12T12:23:43.784458+0000","last_unstale":"2024-09-12T12:24:27.785085+0000","last_undegraded":"2024-09-12T12:24:27.785085+0000","last_fullsized":"2024-09-12T12:24:27.785085+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:46.025169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.903203+0000","last_change":"2024-09-12T12:23:45.879258+0000","last_active":"2024-09-12T12:23:55.903203+0000","last_peered":"2024-09-12T12:23:55.903203+0000","last_clean":"2024-09-12T12:23:55.903203+0000","last_became_active":"2024-09-12T12:23:45.878934+0000","last_became_peered":"2024-09-12T12:23:45.878934+0000","last_unstale":"2024-09-12T12:23:55.903203+0000","last_undegraded":"2024-09-12T12:23:55.903203+0000","last_fullsized":"2024-09-12T12:23:55.903203+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:46:06.617621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:56.936232+0000","last_change":"2024-09-12T12:23:52.906041+0000","last_active":"2024-09-12T12:23:56.936232+0000","last_peered":"2024-09-12T12:23:56.936232+0000","last_clean":"2024-09-12T12:23:56.936232+0000","last_became_active":"2024-09-12T12:23:52.905630+0000","last_became_peered":"2024-09-12T12:23:52.905630+0000","last_unstale":"2024-09-12T12:23:56.936232+0000","last_undegraded":"2024-09-12T12:23:56.936232+0000","last_fullsized":"2024-09-12T12:23:56.936232+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:15.691085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"85'6","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:40.807966+0000","last_change":"2024-09-12T12:23:43.786307+0000","last_active":"2024-09-12T12:24:40.807966+0000","last_peered":"2024-09-12T12:24:40.807966+0000","last_clean":"2024-09-12T12:24:40.807966+0000","last_became_active":"2024-09-12T12:23:43.785950+0000","last_became_peered":"2024-09-12T12:23:43.785950+0000","last_unstale":"2024-09-12T12:24:40.807966+0000","last_undegraded":"2024-09-12T12:24:40.807966+0000","last_fullsized":"2024-09-12T12:24:40.807966+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:15:24.051024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.200605+0000","last_change":"2024-09-12T12:23:45.868002+0000","last_active":"2024-09-12T12:23:57.200605+0000","last_peered":"2024-09-12T12:23:57.200605+0000","last_clean":"2024-09-12T12:23:57.200605+0000","last_became_active":"2024-09-12T12:23:45.867448+0000","last_became_peered":"2024-09-12T12:23:45.867448+0000","last_unstale":"2024-09-12T12:23:57.200605+0000","last_undegraded":"2024-09-12T12:23:57.200605+0000","last_fullsized":"2024-09-12T12:23:57.200605+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:24:01.805345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:56.936495+0000","last_change":"2024-09-12T12:23:52.902119+0000","last_active":"2024-09-12T12:23:56.936495+0000","last_peered":"2024-09-12T12:23:56.936495+0000","last_clean":"2024-09-12T12:23:56.936495+0000","last_became_active":"2024-09-12T12:23:52.901681+0000","last_became_peered":"2024-09-12T12:23:52.901681+0000","last_unstale":"2024-09-12T12:23:56.936495+0000","last_undegraded":"2024-09-12T12:23:56.936495+0000","last_fullsized":"2024-09-12T12:23:56.936495+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:42.039729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:56.633301+0000","last_change":"2024-09-12T12:23:45.879115+0000","last_active":"2024-09-12T12:23:56.633301+0000","last_peered":"2024-09-12T12:23:56.633301+0000","last_clean":"2024-09-12T12:23:56.633301+0000","last_became_active":"2024-09-12T12:23:45.878745+0000","last_became_peered":"2024-09-12T12:23:45.878745+0000","last_unstale":"2024-09-12T12:23:56.633301+0000","last_undegraded":"2024-09-12T12:23:56.633301+0000","last_fullsized":"2024-09-12T12:23:56.633301+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:53.152875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:56.936398+0000","last_change":"2024-09-12T12:23:45.878444+0000","last_active":"2024-09-12T12:23:56.936398+0000","last_peered":"2024-09-12T12:23:56.936398+0000","last_clean":"2024-09-12T12:23:56.936398+0000","last_became_active":"2024-09-12T12:23:45.878063+0000","last_became_peered":"2024-09-12T12:23:45.878063+0000","last_unstale":"2024-09-12T12:23:56.936398+0000","last_undegraded":"2024-09-12T12:23:56.936398+0000","last_fullsized":"2024-09-12T12:23:56.936398+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:07.928598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:56.936032+0000","last_change":"2024-09-12T12:23:45.873101+0000","last_active":"2024-09-12T12:23:56.936032+0000","last_peered":"2024-09-12T12:23:56.936032+0000","last_clean":"2024-09-12T12:23:56.936032+0000","last_became_active":"2024-09-12T12:23:45.872373+0000","last_became_peered":"2024-09-12T12:23:45.872373+0000","last_unstale":"2024-09-12T12:23:56.936032+0000","last_undegraded":"2024-09-12T12:23:56.936032+0000","last_fullsized":"2024-09-12T12:23:56.936032+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:47:14.747538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.201177+0000","last_change":"2024-09-12T12:23:45.875315+0000","last_active":"2024-09-12T12:23:57.201177+0000","last_peered":"2024-09-12T12:23:57.201177+0000","last_clean":"2024-09-12T12:23:57.201177+0000","last_became_active":"2024-09-12T12:23:45.874904+0000","last_became_peered":"2024-09-12T12:23:45.874904+0000","last_unstale":"2024-09-12T12:23:57.201177+0000","last_undegraded":"2024-09-12T12:23:57.201177+0000","last_fullsized":"2024-09-12T12:23:57.201177+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:52:44.373937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.906406+0000","last_change":"2024-09-12T12:23:45.876168+0000","last_active":"2024-09-12T12:23:55.906406+0000","last_peered":"2024-09-12T12:23:55.906406+0000","last_clean":"2024-09-12T12:23:55.906406+0000","last_became_active":"2024-09-12T12:23:45.875780+0000","last_became_peered":"2024-09-12T12:23:45.875780+0000","last_unstale":"2024-09-12T12:23:55.906406+0000","last_undegraded":"2024-09-12T12:23:55.906406+0000","last_fullsized":"2024-09-12T12:23:55.906406+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:18.335692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:56.633657+0000","last_change":"2024-09-12T12:23:45.872638+0000","last_active":"2024-09-12T12:23:56.633657+0000","last_peered":"2024-09-12T12:23:56.633657+0000","last_clean":"2024-09-12T12:23:56.633657+0000","last_became_active":"2024-09-12T12:23:45.872299+0000","last_became_peered":"2024-09-12T12:23:45.872299+0000","last_unstale":"2024-09-12T12:23:56.633657+0000","last_undegraded":"2024-09-12T12:23:56.633657+0000","last_fullsized":"2024-09-12T12:23:56.633657+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:27.758613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:56.936631+0000","last_change":"2024-09-12T12:23:45.877168+0000","last_active":"2024-09-12T12:23:56.936631+0000","last_peered":"2024-09-12T12:23:56.936631+0000","last_clean":"2024-09-12T12:23:56.936631+0000","last_became_active":"2024-09-12T12:23:45.876871+0000","last_became_peered":"2024-09-12T12:23:45.876871+0000","last_unstale":"2024-09-12T12:23:56.936631+0000","last_undegraded":"2024-09-12T12:23:56.936631+0000","last_fullsized":"2024-09-12T12:23:56.936631+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:24.567415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.203166+0000","last_change":"2024-09-12T12:23:45.872423+0000","last_active":"2024-09-12T12:23:57.203166+0000","last_peered":"2024-09-12T12:23:57.203166+0000","last_clean":"2024-09-12T12:23:57.203166+0000","last_became_active":"2024-09-12T12:23:45.872138+0000","last_became_peered":"2024-09-12T12:23:45.872138+0000","last_unstale":"2024-09-12T12:23:57.203166+0000","last_undegraded":"2024-09-12T12:23:57.203166+0000","last_fullsized":"2024-09-12T12:23:57.203166+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:48.576702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.902824+0000","last_change":"2024-09-12T12:23:45.873728+0000","last_active":"2024-09-12T12:23:55.902824+0000","last_peered":"2024-09-12T12:23:55.902824+0000","last_clean":"2024-09-12T12:23:55.902824+0000","last_became_active":"2024-09-12T12:23:45.871831+0000","last_became_peered":"2024-09-12T12:23:45.871831+0000","last_unstale":"2024-09-12T12:23:55.902824+0000","last_undegraded":"2024-09-12T12:23:55.902824+0000","last_fullsized":"2024-09-12T12:23:55.902824+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:48.690705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.201427+0000","last_change":"2024-09-12T12:23:45.873035+0000","last_active":"2024-09-12T12:23:57.201427+0000","last_peered":"2024-09-12T12:23:57.201427+0000","last_clean":"2024-09-12T12:23:57.201427+0000","last_became_active":"2024-09-12T12:23:45.872660+0000","last_became_peered":"2024-09-12T12:23:45.872660+0000","last_unstale":"2024-09-12T12:23:57.201427+0000","last_undegraded":"2024-09-12T12:23:57.201427+0000","last_fullsized":"2024-09-12T12:23:57.201427+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:31.376116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.902790+0000","last_change":"2024-09-12T12:23:45.879754+0000","last_active":"2024-09-12T12:23:55.902790+0000","last_peered":"2024-09-12T12:23:55.902790+0000","last_clean":"2024-09-12T12:23:55.902790+0000","last_became_active":"2024-09-12T12:23:45.879362+0000","last_became_peered":"2024-09-12T12:23:45.879362+0000","last_unstale":"2024-09-12T12:23:55.902790+0000","last_undegraded":"2024-09-12T12:23:55.902790+0000","last_fullsized":"2024-09-12T12:23:55.902790+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:23.587083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.906361+0000","last_change":"2024-09-12T12:23:45.878297+0000","last_active":"2024-09-12T12:23:55.906361+0000","last_peered":"2024-09-12T12:23:55.906361+0000","last_clean":"2024-09-12T12:23:55.906361+0000","last_became_active":"2024-09-12T12:23:45.877127+0000","last_became_peered":"2024-09-12T12:23:45.877127+0000","last_unstale":"2024-09-12T12:23:55.906361+0000","last_undegraded":"2024-09-12T12:23:55.906361+0000","last_fullsized":"2024-09-12T12:23:55.906361+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:54.334325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:56.633493+0000","last_change":"2024-09-12T12:23:45.879078+0000","last_active":"2024-09-12T12:23:56.633493+0000","last_peered":"2024-09-12T12:23:56.633493+0000","last_clean":"2024-09-12T12:23:56.633493+0000","last_became_active":"2024-09-12T12:23:45.878799+0000","last_became_peered":"2024-09-12T12:23:45.878799+0000","last_unstale":"2024-09-12T12:23:56.633493+0000","last_undegraded":"2024-09-12T12:23:56.633493+0000","last_fullsized":"2024-09-12T12:23:56.633493+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:45.680643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:56.936537+0000","last_change":"2024-09-12T12:23:45.872739+0000","last_active":"2024-09-12T12:23:56.936537+0000","last_peered":"2024-09-12T12:23:56.936537+0000","last_clean":"2024-09-12T12:23:56.936537+0000","last_became_active":"2024-09-12T12:23:45.871931+0000","last_became_peered":"2024-09-12T12:23:45.871931+0000","last_unstale":"2024-09-12T12:23:56.936537+0000","last_undegraded":"2024-09-12T12:23:56.936537+0000","last_fullsized":"2024-09-12T12:23:56.936537+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:36:30.451737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.201485+0000","last_change":"2024-09-12T12:23:45.876717+0000","last_active":"2024-09-12T12:23:57.201485+0000","last_peered":"2024-09-12T12:23:57.201485+0000","last_clean":"2024-09-12T12:23:57.201485+0000","last_became_active":"2024-09-12T12:23:45.876372+0000","last_became_peered":"2024-09-12T12:23:45.876372+0000","last_unstale":"2024-09-12T12:23:57.201485+0000","last_undegraded":"2024-09-12T12:23:57.201485+0000","last_fullsized":"2024-09-12T12:23:57.201485+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:40:26.905442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:56.633974+0000","last_change":"2024-09-12T12:23:45.877286+0000","last_active":"2024-09-12T12:23:56.633974+0000","last_peered":"2024-09-12T12:23:56.633974+0000","last_clean":"2024-09-12T12:23:56.633974+0000","last_became_active":"2024-09-12T12:23:45.876619+0000","last_became_peered":"2024-09-12T12:23:45.876619+0000","last_unstale":"2024-09-12T12:23:56.633974+0000","last_undegraded":"2024-09-12T12:23:56.633974+0000","last_fullsized":"2024-09-12T12:23:56.633974+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:05.637917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.902361+0000","last_change":"2024-09-12T12:23:45.875244+0000","last_active":"2024-09-12T12:23:55.902361+0000","last_peered":"2024-09-12T12:23:55.902361+0000","last_clean":"2024-09-12T12:23:55.902361+0000","last_became_active":"2024-09-12T12:23:45.874908+0000","last_became_peered":"2024-09-12T12:23:45.874908+0000","last_unstale":"2024-09-12T12:23:55.902361+0000","last_undegraded":"2024-09-12T12:23:55.902361+0000","last_fullsized":"2024-09-12T12:23:55.902361+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:14.314124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.202308+0000","last_change":"2024-09-12T12:23:45.875253+0000","last_active":"2024-09-12T12:23:57.202308+0000","last_peered":"2024-09-12T12:23:57.202308+0000","last_clean":"2024-09-12T12:23:57.202308+0000","last_became_active":"2024-09-12T12:23:45.874936+0000","last_became_peered":"2024-09-12T12:23:45.874936+0000","last_unstale":"2024-09-12T12:23:57.202308+0000","last_undegraded":"2024-09-12T12:23:57.202308+0000","last_fullsized":"2024-09-12T12:23:57.202308+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:28.790546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.200746+0000","last_change":"2024-09-12T12:23:45.880503+0000","last_active":"2024-09-12T12:23:57.200746+0000","last_peered":"2024-09-12T12:23:57.200746+0000","last_clean":"2024-09-12T12:23:57.200746+0000","last_became_active":"2024-09-12T12:23:45.880184+0000","last_became_peered":"2024-09-12T12:23:45.880184+0000","last_unstale":"2024-09-12T12:23:57.200746+0000","last_undegraded":"2024-09-12T12:23:57.200746+0000","last_fullsized":"2024-09-12T12:23:57.200746+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:12.370667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.906356+0000","last_change":"2024-09-12T12:23:45.869762+0000","last_active":"2024-09-12T12:23:55.906356+0000","last_peered":"2024-09-12T12:23:55.906356+0000","last_clean":"2024-09-12T12:23:55.906356+0000","last_became_active":"2024-09-12T12:23:45.867595+0000","last_became_peered":"2024-09-12T12:23:45.867595+0000","last_unstale":"2024-09-12T12:23:55.906356+0000","last_undegraded":"2024-09-12T12:23:55.906356+0000","last_fullsized":"2024-09-12T12:23:55.906356+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:25:19.855969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.203229+0000","last_change":"2024-09-12T12:23:45.874097+0000","last_active":"2024-09-12T12:23:57.203229+0000","last_peered":"2024-09-12T12:23:57.203229+0000","last_clean":"2024-09-12T12:23:57.203229+0000","last_became_active":"2024-09-12T12:23:45.873275+0000","last_became_peered":"2024-09-12T12:23:45.873275+0000","last_unstale":"2024-09-12T12:23:57.203229+0000","last_undegraded":"2024-09-12T12:23:57.203229+0000","last_fullsized":"2024-09-12T12:23:57.203229+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:21.303339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.202859+0000","last_change":"2024-09-12T12:23:45.883354+0000","last_active":"2024-09-12T12:23:57.202859+0000","last_peered":"2024-09-12T12:23:57.202859+0000","last_clean":"2024-09-12T12:23:57.202859+0000","last_became_active":"2024-09-12T12:23:45.882673+0000","last_became_peered":"2024-09-12T12:23:45.882673+0000","last_unstale":"2024-09-12T12:23:57.202859+0000","last_undegraded":"2024-09-12T12:23:57.202859+0000","last_fullsized":"2024-09-12T12:23:57.202859+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:42.034857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.202819+0000","last_change":"2024-09-12T12:23:45.876955+0000","last_active":"2024-09-12T12:23:57.202819+0000","last_peered":"2024-09-12T12:23:57.202819+0000","last_clean":"2024-09-12T12:23:57.202819+0000","last_became_active":"2024-09-12T12:23:45.876632+0000","last_became_peered":"2024-09-12T12:23:45.876632+0000","last_unstale":"2024-09-12T12:23:57.202819+0000","last_undegraded":"2024-09-12T12:23:57.202819+0000","last_fullsized":"2024-09-12T12:23:57.202819+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:25.155739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.903139+0000","last_change":"2024-09-12T12:23:45.875166+0000","last_active":"2024-09-12T12:23:55.903139+0000","last_peered":"2024-09-12T12:23:55.903139+0000","last_clean":"2024-09-12T12:23:55.903139+0000","last_became_active":"2024-09-12T12:23:45.874835+0000","last_became_peered":"2024-09-12T12:23:45.874835+0000","last_unstale":"2024-09-12T12:23:55.903139+0000","last_undegraded":"2024-09-12T12:23:55.903139+0000","last_fullsized":"2024-09-12T12:23:55.903139+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:50.014484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.201427+0000","last_change":"2024-09-12T12:23:45.874161+0000","last_active":"2024-09-12T12:23:57.201427+0000","last_peered":"2024-09-12T12:23:57.201427+0000","last_clean":"2024-09-12T12:23:57.201427+0000","last_became_active":"2024-09-12T12:23:45.873846+0000","last_became_peered":"2024-09-12T12:23:45.873846+0000","last_unstale":"2024-09-12T12:23:57.201427+0000","last_undegraded":"2024-09-12T12:23:57.201427+0000","last_fullsized":"2024-09-12T12:23:57.201427+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:09:17.525956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.202128+0000","last_change":"2024-09-12T12:23:45.870642+0000","last_active":"2024-09-12T12:23:57.202128+0000","last_peered":"2024-09-12T12:23:57.202128+0000","last_clean":"2024-09-12T12:23:57.202128+0000","last_became_active":"2024-09-12T12:23:45.870006+0000","last_became_peered":"2024-09-12T12:23:45.870006+0000","last_unstale":"2024-09-12T12:23:57.202128+0000","last_undegraded":"2024-09-12T12:23:57.202128+0000","last_fullsized":"2024-09-12T12:23:57.202128+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:43:35.133650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.202017+0000","last_change":"2024-09-12T12:23:45.875174+0000","last_active":"2024-09-12T12:23:57.202017+0000","last_peered":"2024-09-12T12:23:57.202017+0000","last_clean":"2024-09-12T12:23:57.202017+0000","last_became_active":"2024-09-12T12:23:45.874851+0000","last_became_peered":"2024-09-12T12:23:45.874851+0000","last_unstale":"2024-09-12T12:23:57.202017+0000","last_undegraded":"2024-09-12T12:23:57.202017+0000","last_fullsized":"2024-09-12T12:23:57.202017+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:42.565644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.200559+0000","last_change":"2024-09-12T12:23:45.873170+0000","last_active":"2024-09-12T12:23:57.200559+0000","last_peered":"2024-09-12T12:23:57.200559+0000","last_clean":"2024-09-12T12:23:57.200559+0000","last_became_active":"2024-09-12T12:23:45.872814+0000","last_became_peered":"2024-09-12T12:23:45.872814+0000","last_unstale":"2024-09-12T12:23:57.200559+0000","last_undegraded":"2024-09-12T12:23:57.200559+0000","last_fullsized":"2024-09-12T12:23:57.200559+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:36.143107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.203098+0000","last_change":"2024-09-12T12:23:45.874271+0000","last_active":"2024-09-12T12:23:57.203098+0000","last_peered":"2024-09-12T12:23:57.203098+0000","last_clean":"2024-09-12T12:23:57.203098+0000","last_became_active":"2024-09-12T12:23:45.873789+0000","last_became_peered":"2024-09-12T12:23:45.873789+0000","last_unstale":"2024-09-12T12:23:57.203098+0000","last_undegraded":"2024-09-12T12:23:57.203098+0000","last_fullsized":"2024-09-12T12:23:57.203098+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:58.252706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.201577+0000","last_change":"2024-09-12T12:23:45.877236+0000","last_active":"2024-09-12T12:23:57.201577+0000","last_peered":"2024-09-12T12:23:57.201577+0000","last_clean":"2024-09-12T12:23:57.201577+0000","last_became_active":"2024-09-12T12:23:45.876920+0000","last_became_peered":"2024-09-12T12:23:45.876920+0000","last_unstale":"2024-09-12T12:23:57.201577+0000","last_undegraded":"2024-09-12T12:23:57.201577+0000","last_fullsized":"2024-09-12T12:23:57.201577+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:19:19.749103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.200832+0000","last_change":"2024-09-12T12:23:45.880480+0000","last_active":"2024-09-12T12:23:57.200832+0000","last_peered":"2024-09-12T12:23:57.200832+0000","last_clean":"2024-09-12T12:23:57.200832+0000","last_became_active":"2024-09-12T12:23:45.880163+0000","last_became_peered":"2024-09-12T12:23:45.880163+0000","last_unstale":"2024-09-12T12:23:57.200832+0000","last_undegraded":"2024-09-12T12:23:57.200832+0000","last_fullsized":"2024-09-12T12:23:57.200832+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:35.496705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:56.633947+0000","last_change":"2024-09-12T12:23:45.876975+0000","last_active":"2024-09-12T12:23:56.633947+0000","last_peered":"2024-09-12T12:23:56.633947+0000","last_clean":"2024-09-12T12:23:56.633947+0000","last_became_active":"2024-09-12T12:23:45.876501+0000","last_became_peered":"2024-09-12T12:23:45.876501+0000","last_unstale":"2024-09-12T12:23:56.633947+0000","last_undegraded":"2024-09-12T12:23:56.633947+0000","last_fullsized":"2024-09-12T12:23:56.633947+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:15.029566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60752,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":112,"num_read_kb":120,"num_write":156,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":169990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":286267,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612632,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":473868,"data_compressed":17611,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841564,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1073152,"data_stored":1117885,"data_compressed":54009,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005089,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":478200,"data_compressed":17611,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234022,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":474024,"data_compressed":17611,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462955,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36320,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708832,"statfs":{"total":95995035648,"available":95957843968,"internally_reserved":0,"allocated":999424,"data_stored":1069935,"data_compressed":54009,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626481,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":929792,"data_stored":469280,"data_compressed":17611,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855414,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1007616,"data_stored":1065523,"data_compressed":54009,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018939,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36264,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708888,"statfs":{"total":95995035648,"available":95957901312,"internally_reserved":0,"allocated":942080,"data_stored":473930,"data_compressed":17611,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247872,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":469474,"data_compressed":17611,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444101,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32164,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712988,"statfs":{"total":95995035648,"available":95962099712,"internally_reserved":0,"allocated":1003520,"data_stored":515416,"data_compressed":17611,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36312,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708840,"statfs":{"total":95995035648,"available":95957852160,"internally_reserved":0,"allocated":991232,"data_stored":525939,"data_compressed":17611,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738446,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36276,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708876,"statfs":{"total":95995035648,"available":95957889024,"internally_reserved":0,"allocated":954368,"data_stored":470668,"data_compressed":17611,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34759,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34759,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34759,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36398,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36398,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36398,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36398,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36398,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":56749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":46226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":58327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:24:45.836 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T12:24:46.123 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:46.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:46 smithi043 ceph-mon[34144]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:24:46.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:46 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:24:46.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:46 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:24:46.388 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:46 smithi033 ceph-mon[31246]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:24:46.388 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:46 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:24:46.388 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:46 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:24:46.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:46 smithi102 ceph-mon[34799]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:24:46.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:46 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:24:46.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:46 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:24:46.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.643+0000 7f81ae0a9640 1 -- 172.21.15.33:0/495927772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81a81027a0 msgr2=0x7f81a81067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:46.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.643+0000 7f81ae0a9640 1 --2- 172.21.15.33:0/495927772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81a81027a0 0x7f81a81067f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f819c009900 tx=0x7f819c02a410 comp rx=0 tx=0).stop 2024-09-12T12:24:46.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.643+0000 7f81ae0a9640 1 -- 172.21.15.33:0/495927772 shutdown_connections 2024-09-12T12:24:46.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.643+0000 7f81ae0a9640 1 --2- 172.21.15.33:0/495927772 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81a8106f20 0x7f81a810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:46.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.643+0000 7f81ae0a9640 1 --2- 172.21.15.33:0/495927772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81a81027a0 0x7f81a81067f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:46.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.643+0000 7f81ae0a9640 1 --2- 172.21.15.33:0/495927772 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81a8101df0 0x7f81a81021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:46.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.643+0000 7f81ae0a9640 1 -- 172.21.15.33:0/495927772 >> 172.21.15.33:0/495927772 conn(0x7f81a80fd8f0 msgr2=0x7f81a80ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:46.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.643+0000 7f81ae0a9640 1 -- 172.21.15.33:0/495927772 shutdown_connections 2024-09-12T12:24:46.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.643+0000 7f81ae0a9640 1 -- 172.21.15.33:0/495927772 wait complete. 2024-09-12T12:24:46.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.644+0000 7f81ae0a9640 1 Processor -- start 2024-09-12T12:24:46.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.644+0000 7f81ae0a9640 1 -- start start 2024-09-12T12:24:46.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.644+0000 7f81ae0a9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81a8101df0 0x7f81a8198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:46.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.644+0000 7f81ae0a9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81a81027a0 0x7f81a8198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:46.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.644+0000 7f81ae0a9640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81a8106f20 0x7f81a819cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:46.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.644+0000 7f81ae0a9640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f81a8111df0 con 0x7f81a81027a0 2024-09-12T12:24:46.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.644+0000 7f81ae0a9640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f81a8111c70 con 0x7f81a8106f20 2024-09-12T12:24:46.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.644+0000 7f81ae0a9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f81a8111f70 con 0x7f81a8101df0 2024-09-12T12:24:46.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.645+0000 7f81a77fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81a8101df0 0x7f81a8198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:46.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.645+0000 7f81a6ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81a81027a0 0x7f81a8198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:46.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.645+0000 7f81a77fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81a8101df0 0x7f81a8198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:48566/0 (socket says 172.21.15.33:48566) 2024-09-12T12:24:46.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.645+0000 7f81a77fe640 1 -- 172.21.15.33:0/2964764257 learned_addr learned my addr 172.21.15.33:0/2964764257 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:24:46.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.645+0000 7f81a7fff640 1 --2- 172.21.15.33:0/2964764257 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81a8106f20 0x7f81a819cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:46.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.645+0000 7f81a6ffd640 1 -- 172.21.15.33:0/2964764257 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81a8101df0 msgr2=0x7f81a8198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:46.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.645+0000 7f81a6ffd640 1 --2- 172.21.15.33:0/2964764257 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81a8101df0 0x7f81a8198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:46.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.645+0000 7f81a6ffd640 1 -- 172.21.15.33:0/2964764257 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81a8106f20 msgr2=0x7f81a819cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:46.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.645+0000 7f81a6ffd640 1 --2- 172.21.15.33:0/2964764257 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81a8106f20 0x7f81a819cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:46.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.645+0000 7f81a6ffd640 1 -- 172.21.15.33:0/2964764257 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81a819d2e0 con 0x7f81a81027a0 2024-09-12T12:24:46.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.645+0000 7f81a77fe640 1 --2- 172.21.15.33:0/2964764257 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81a8101df0 0x7f81a8198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:24:46.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.645+0000 7f81a6ffd640 1 --2- 172.21.15.33:0/2964764257 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81a81027a0 0x7f81a8198870 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f819c02a930 tx=0x7f819c0043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:46.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.646+0000 7f81a4ff9640 1 -- 172.21.15.33:0/2964764257 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f819c03f030 con 0x7f81a81027a0 2024-09-12T12:24:46.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.646+0000 7f81ae0a9640 1 -- 172.21.15.33:0/2964764257 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81a819d570 con 0x7f81a81027a0 2024-09-12T12:24:46.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.646+0000 7f81a4ff9640 1 -- 172.21.15.33:0/2964764257 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f819c003aa0 con 0x7f81a81027a0 2024-09-12T12:24:46.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.646+0000 7f81ae0a9640 1 -- 172.21.15.33:0/2964764257 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81a8074420 con 0x7f81a81027a0 2024-09-12T12:24:46.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.647+0000 7f81a4ff9640 1 -- 172.21.15.33:0/2964764257 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f819c035070 con 0x7f81a81027a0 2024-09-12T12:24:46.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.647+0000 7f81ae0a9640 1 -- 172.21.15.33:0/2964764257 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81a81032d0 con 0x7f81a81027a0 2024-09-12T12:24:46.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.648+0000 7f81a4ff9640 1 -- 172.21.15.33:0/2964764257 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f819c042030 con 0x7f81a81027a0 2024-09-12T12:24:46.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.649+0000 7f81a4ff9640 1 --2- 172.21.15.33:0/2964764257 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f81900a2c90 0x7f81900a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:46.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.649+0000 7f81a77fe640 1 --2- 172.21.15.33:0/2964764257 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f81900a2c90 0x7f81900a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:46.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.649+0000 7f81a4ff9640 1 -- 172.21.15.33:0/2964764257 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f819c0ef9d0 con 0x7f81a81027a0 2024-09-12T12:24:46.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.649+0000 7f81a77fe640 1 --2- 172.21.15.33:0/2964764257 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f81900a2c90 0x7f81900a5150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f819800f4d0 tx=0x7f819800a380 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:46.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.652+0000 7f81a4ff9640 1 -- 172.21.15.33:0/2964764257 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f819c0bbf40 con 0x7f81a81027a0 2024-09-12T12:24:46.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.827+0000 7f81ae0a9640 1 -- 172.21.15.33:0/2964764257 --> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f81a8062630 con 0x7f81900a2c90 2024-09-12T12:24:46.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.835+0000 7f81a4ff9640 1 -- 172.21.15.33:0/2964764257 <== mgr.14150 v2:172.21.15.33:6800/176202431 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340606 (secure 0 0 0) 0x7f81a8062630 con 0x7f81900a2c90 2024-09-12T12:24:46.838 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:24:46.839 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-12T12:24:46.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.838+0000 7f81ae0a9640 1 -- 172.21.15.33:0/2964764257 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f81900a2c90 msgr2=0x7f81900a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:46.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.838+0000 7f81ae0a9640 1 --2- 172.21.15.33:0/2964764257 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f81900a2c90 0x7f81900a5150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f819800f4d0 tx=0x7f819800a380 comp rx=0 tx=0).stop 2024-09-12T12:24:46.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.838+0000 7f81ae0a9640 1 -- 172.21.15.33:0/2964764257 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81a81027a0 msgr2=0x7f81a8198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:46.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.838+0000 7f81ae0a9640 1 --2- 172.21.15.33:0/2964764257 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81a81027a0 0x7f81a8198870 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f819c02a930 tx=0x7f819c0043b0 comp rx=0 tx=0).stop 2024-09-12T12:24:46.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.838+0000 7f81ae0a9640 1 -- 172.21.15.33:0/2964764257 shutdown_connections 2024-09-12T12:24:46.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.838+0000 7f81ae0a9640 1 --2- 172.21.15.33:0/2964764257 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f81900a2c90 0x7f81900a5150 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:46.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.838+0000 7f81ae0a9640 1 --2- 172.21.15.33:0/2964764257 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81a8106f20 0x7f81a819cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:46.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.838+0000 7f81ae0a9640 1 --2- 172.21.15.33:0/2964764257 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81a81027a0 0x7f81a8198870 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:46.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.838+0000 7f81ae0a9640 1 --2- 172.21.15.33:0/2964764257 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81a8101df0 0x7f81a8198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:46.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.838+0000 7f81ae0a9640 1 -- 172.21.15.33:0/2964764257 >> 172.21.15.33:0/2964764257 conn(0x7f81a80fd8f0 msgr2=0x7f81a80fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:46.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.838+0000 7f81ae0a9640 1 -- 172.21.15.33:0/2964764257 shutdown_connections 2024-09-12T12:24:46.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:46.838+0000 7f81ae0a9640 1 -- 172.21.15.33:0/2964764257 wait complete. 2024-09-12T12:24:47.313 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:47 smithi033 ceph-mon[31246]: pgmap v309: 129 pgs: 129 active+clean; 636 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-09-12T12:24:47.314 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:47 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:24:47.314 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:47 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:24:47.314 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:47 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:24:47.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:47 smithi043 ceph-mon[34144]: pgmap v309: 129 pgs: 129 active+clean; 636 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-09-12T12:24:47.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:47 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:24:47.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:47 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:24:47.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:47 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:24:47.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:47 smithi102 ceph-mon[34799]: pgmap v309: 129 pgs: 129 active+clean; 636 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-09-12T12:24:47.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:47 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:24:47.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:47 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:24:47.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:47 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:24:47.667 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":309,"stamp":"2024-09-12T12:24:45.888613+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":651354,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":238,"num_read_kb":229,"num_write":347,"num_write_kb":3048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":279,"ondisk_log_size":279,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":381456,"kb_used_data":11408,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124560368,"statfs":{"total":1151940427776,"available":1151549816832,"internally_reserved":0,"allocated":11681792,"data_stored":7604142,"data_compressed":320526,"data_compressed_allocated":430080,"data_compressed_original":2359296,"omap_allocated":19141,"internal_metadata":378713403},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":46537,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":65,"num_read_kb":77,"num_write":31,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003269"},"pg_stats":[{"pgid":"2.1f","version":"85'9","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:27.786565+0000","last_change":"2024-09-12T12:23:43.779951+0000","last_active":"2024-09-12T12:24:27.786565+0000","last_peered":"2024-09-12T12:24:27.786565+0000","last_clean":"2024-09-12T12:24:27.786565+0000","last_became_active":"2024-09-12T12:23:43.779641+0000","last_became_peered":"2024-09-12T12:23:43.779641+0000","last_unstale":"2024-09-12T12:24:27.786565+0000","last_undegraded":"2024-09-12T12:24:27.786565+0000","last_fullsized":"2024-09-12T12:24:27.786565+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:49.594196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.202928+0000","last_change":"2024-09-12T12:23:45.873591+0000","last_active":"2024-09-12T12:23:57.202928+0000","last_peered":"2024-09-12T12:23:57.202928+0000","last_clean":"2024-09-12T12:23:57.202928+0000","last_became_active":"2024-09-12T12:23:45.873295+0000","last_became_peered":"2024-09-12T12:23:45.873295+0000","last_unstale":"2024-09-12T12:23:57.202928+0000","last_undegraded":"2024-09-12T12:23:57.202928+0000","last_fullsized":"2024-09-12T12:23:57.202928+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:49.907824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:56.936032+0000","last_change":"2024-09-12T12:23:52.905486+0000","last_active":"2024-09-12T12:23:56.936032+0000","last_peered":"2024-09-12T12:23:56.936032+0000","last_clean":"2024-09-12T12:23:56.936032+0000","last_became_active":"2024-09-12T12:23:52.905040+0000","last_became_peered":"2024-09-12T12:23:52.905040+0000","last_unstale":"2024-09-12T12:23:56.936032+0000","last_undegraded":"2024-09-12T12:23:56.936032+0000","last_fullsized":"2024-09-12T12:23:56.936032+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:11:06.083432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.203123+0000","last_change":"2024-09-12T12:23:43.835297+0000","last_active":"2024-09-12T12:23:57.203123+0000","last_peered":"2024-09-12T12:23:57.203123+0000","last_clean":"2024-09-12T12:23:57.203123+0000","last_became_active":"2024-09-12T12:23:43.834971+0000","last_became_peered":"2024-09-12T12:23:43.834971+0000","last_unstale":"2024-09-12T12:23:57.203123+0000","last_undegraded":"2024-09-12T12:23:57.203123+0000","last_fullsized":"2024-09-12T12:23:57.203123+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:00:07.128092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.202101+0000","last_change":"2024-09-12T12:23:45.876388+0000","last_active":"2024-09-12T12:23:57.202101+0000","last_peered":"2024-09-12T12:23:57.202101+0000","last_clean":"2024-09-12T12:23:57.202101+0000","last_became_active":"2024-09-12T12:23:45.876090+0000","last_became_peered":"2024-09-12T12:23:45.876090+0000","last_unstale":"2024-09-12T12:23:57.202101+0000","last_undegraded":"2024-09-12T12:23:57.202101+0000","last_fullsized":"2024-09-12T12:23:57.202101+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:02.576991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.200986+0000","last_change":"2024-09-12T12:23:52.904665+0000","last_active":"2024-09-12T12:23:57.200986+0000","last_peered":"2024-09-12T12:23:57.200986+0000","last_clean":"2024-09-12T12:23:57.200986+0000","last_became_active":"2024-09-12T12:23:52.903758+0000","last_became_peered":"2024-09-12T12:23:52.903758+0000","last_unstale":"2024-09-12T12:23:57.200986+0000","last_undegraded":"2024-09-12T12:23:57.200986+0000","last_fullsized":"2024-09-12T12:23:57.200986+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:48.510180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"85'4","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:27.785544+0000","last_change":"2024-09-12T12:23:43.784025+0000","last_active":"2024-09-12T12:24:27.785544+0000","last_peered":"2024-09-12T12:24:27.785544+0000","last_clean":"2024-09-12T12:24:27.785544+0000","last_became_active":"2024-09-12T12:23:43.783637+0000","last_became_peered":"2024-09-12T12:23:43.783637+0000","last_unstale":"2024-09-12T12:24:27.785544+0000","last_undegraded":"2024-09-12T12:24:27.785544+0000","last_fullsized":"2024-09-12T12:24:27.785544+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:32.814644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.902670+0000","last_change":"2024-09-12T12:23:45.863775+0000","last_active":"2024-09-12T12:23:55.902670+0000","last_peered":"2024-09-12T12:23:55.902670+0000","last_clean":"2024-09-12T12:23:55.902670+0000","last_became_active":"2024-09-12T12:23:45.863437+0000","last_became_peered":"2024-09-12T12:23:45.863437+0000","last_unstale":"2024-09-12T12:23:55.902670+0000","last_undegraded":"2024-09-12T12:23:55.902670+0000","last_fullsized":"2024-09-12T12:23:55.902670+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:33.539904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.203289+0000","last_change":"2024-09-12T12:23:52.902674+0000","last_active":"2024-09-12T12:23:57.203289+0000","last_peered":"2024-09-12T12:23:57.203289+0000","last_clean":"2024-09-12T12:23:57.203289+0000","last_became_active":"2024-09-12T12:23:52.902130+0000","last_became_peered":"2024-09-12T12:23:52.902130+0000","last_unstale":"2024-09-12T12:23:57.203289+0000","last_undegraded":"2024-09-12T12:23:57.203289+0000","last_fullsized":"2024-09-12T12:23:57.203289+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:24.867630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.200955+0000","last_change":"2024-09-12T12:23:43.783171+0000","last_active":"2024-09-12T12:23:57.200955+0000","last_peered":"2024-09-12T12:23:57.200955+0000","last_clean":"2024-09-12T12:23:57.200955+0000","last_became_active":"2024-09-12T12:23:43.782849+0000","last_became_peered":"2024-09-12T12:23:43.782849+0000","last_unstale":"2024-09-12T12:23:57.200955+0000","last_undegraded":"2024-09-12T12:23:57.200955+0000","last_fullsized":"2024-09-12T12:23:57.200955+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:42:32.481914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.903489+0000","last_change":"2024-09-12T12:23:45.878131+0000","last_active":"2024-09-12T12:23:55.903489+0000","last_peered":"2024-09-12T12:23:55.903489+0000","last_clean":"2024-09-12T12:23:55.903489+0000","last_became_active":"2024-09-12T12:23:45.877838+0000","last_became_peered":"2024-09-12T12:23:45.877838+0000","last_unstale":"2024-09-12T12:23:55.903489+0000","last_undegraded":"2024-09-12T12:23:55.903489+0000","last_fullsized":"2024-09-12T12:23:55.903489+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:31.029515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.201162+0000","last_change":"2024-09-12T12:23:52.900871+0000","last_active":"2024-09-12T12:23:57.201162+0000","last_peered":"2024-09-12T12:23:57.201162+0000","last_clean":"2024-09-12T12:23:57.201162+0000","last_became_active":"2024-09-12T12:23:52.900339+0000","last_became_peered":"2024-09-12T12:23:52.900339+0000","last_unstale":"2024-09-12T12:23:57.201162+0000","last_undegraded":"2024-09-12T12:23:57.201162+0000","last_fullsized":"2024-09-12T12:23:57.201162+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:24.778852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.201637+0000","last_change":"2024-09-12T12:23:45.879124+0000","last_active":"2024-09-12T12:23:57.201637+0000","last_peered":"2024-09-12T12:23:57.201637+0000","last_clean":"2024-09-12T12:23:57.201637+0000","last_became_active":"2024-09-12T12:23:45.878770+0000","last_became_peered":"2024-09-12T12:23:45.878770+0000","last_unstale":"2024-09-12T12:23:57.201637+0000","last_undegraded":"2024-09-12T12:23:57.201637+0000","last_fullsized":"2024-09-12T12:23:57.201637+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:58.767155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:26.781151+0000","last_change":"2024-09-12T12:23:43.782666+0000","last_active":"2024-09-12T12:24:26.781151+0000","last_peered":"2024-09-12T12:24:26.781151+0000","last_clean":"2024-09-12T12:24:26.781151+0000","last_became_active":"2024-09-12T12:23:43.782235+0000","last_became_peered":"2024-09-12T12:23:43.782235+0000","last_unstale":"2024-09-12T12:24:26.781151+0000","last_undegraded":"2024-09-12T12:24:26.781151+0000","last_fullsized":"2024-09-12T12:24:26.781151+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:28.499038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.202195+0000","last_change":"2024-09-12T12:23:52.933933+0000","last_active":"2024-09-12T12:23:57.202195+0000","last_peered":"2024-09-12T12:23:57.202195+0000","last_clean":"2024-09-12T12:23:57.202195+0000","last_became_active":"2024-09-12T12:23:52.933500+0000","last_became_peered":"2024-09-12T12:23:52.933500+0000","last_unstale":"2024-09-12T12:23:57.202195+0000","last_undegraded":"2024-09-12T12:23:57.202195+0000","last_fullsized":"2024-09-12T12:23:57.202195+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:28.598435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.201664+0000","last_change":"2024-09-12T12:23:45.868518+0000","last_active":"2024-09-12T12:23:57.201664+0000","last_peered":"2024-09-12T12:23:57.201664+0000","last_clean":"2024-09-12T12:23:57.201664+0000","last_became_active":"2024-09-12T12:23:45.868198+0000","last_became_peered":"2024-09-12T12:23:45.868198+0000","last_unstale":"2024-09-12T12:23:57.201664+0000","last_undegraded":"2024-09-12T12:23:57.201664+0000","last_fullsized":"2024-09-12T12:23:57.201664+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:53.815362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"85'1","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:56.936176+0000","last_change":"2024-09-12T12:23:43.785481+0000","last_active":"2024-09-12T12:23:56.936176+0000","last_peered":"2024-09-12T12:23:56.936176+0000","last_clean":"2024-09-12T12:23:56.936176+0000","last_became_active":"2024-09-12T12:23:43.783842+0000","last_became_peered":"2024-09-12T12:23:43.783842+0000","last_unstale":"2024-09-12T12:23:56.936176+0000","last_undegraded":"2024-09-12T12:23:56.936176+0000","last_fullsized":"2024-09-12T12:23:56.936176+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:45:30.080456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"85'1","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.202989+0000","last_change":"2024-09-12T12:23:52.898648+0000","last_active":"2024-09-12T12:23:57.202989+0000","last_peered":"2024-09-12T12:23:57.202989+0000","last_clean":"2024-09-12T12:23:57.202989+0000","last_became_active":"2024-09-12T12:23:52.898242+0000","last_became_peered":"2024-09-12T12:23:52.898242+0000","last_unstale":"2024-09-12T12:23:57.202989+0000","last_undegraded":"2024-09-12T12:23:57.202989+0000","last_fullsized":"2024-09-12T12:23:57.202989+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:49:30.598747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:56.633416+0000","last_change":"2024-09-12T12:23:45.873067+0000","last_active":"2024-09-12T12:23:56.633416+0000","last_peered":"2024-09-12T12:23:56.633416+0000","last_clean":"2024-09-12T12:23:56.633416+0000","last_became_active":"2024-09-12T12:23:45.872616+0000","last_became_peered":"2024-09-12T12:23:45.872616+0000","last_unstale":"2024-09-12T12:23:56.633416+0000","last_undegraded":"2024-09-12T12:23:56.633416+0000","last_fullsized":"2024-09-12T12:23:56.633416+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:10.960252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"85'3","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:26.781289+0000","last_change":"2024-09-12T12:23:43.780706+0000","last_active":"2024-09-12T12:24:26.781289+0000","last_peered":"2024-09-12T12:24:26.781289+0000","last_clean":"2024-09-12T12:24:26.781289+0000","last_became_active":"2024-09-12T12:23:43.780387+0000","last_became_peered":"2024-09-12T12:23:43.780387+0000","last_unstale":"2024-09-12T12:24:26.781289+0000","last_undegraded":"2024-09-12T12:24:26.781289+0000","last_fullsized":"2024-09-12T12:24:26.781289+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:54.748461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.201342+0000","last_change":"2024-09-12T12:23:52.902225+0000","last_active":"2024-09-12T12:23:57.201342+0000","last_peered":"2024-09-12T12:23:57.201342+0000","last_clean":"2024-09-12T12:23:57.201342+0000","last_became_active":"2024-09-12T12:23:52.901865+0000","last_became_peered":"2024-09-12T12:23:52.901865+0000","last_unstale":"2024-09-12T12:23:57.201342+0000","last_undegraded":"2024-09-12T12:23:57.201342+0000","last_fullsized":"2024-09-12T12:23:57.201342+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:38.020994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.200445+0000","last_change":"2024-09-12T12:23:45.875816+0000","last_active":"2024-09-12T12:23:57.200445+0000","last_peered":"2024-09-12T12:23:57.200445+0000","last_clean":"2024-09-12T12:23:57.200445+0000","last_became_active":"2024-09-12T12:23:45.875419+0000","last_became_peered":"2024-09-12T12:23:45.875419+0000","last_unstale":"2024-09-12T12:23:57.200445+0000","last_undegraded":"2024-09-12T12:23:57.200445+0000","last_fullsized":"2024-09-12T12:23:57.200445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:14:04.616759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:26.780123+0000","last_change":"2024-09-12T12:23:43.836699+0000","last_active":"2024-09-12T12:24:26.780123+0000","last_peered":"2024-09-12T12:24:26.780123+0000","last_clean":"2024-09-12T12:24:26.780123+0000","last_became_active":"2024-09-12T12:23:43.836341+0000","last_became_peered":"2024-09-12T12:23:43.836341+0000","last_unstale":"2024-09-12T12:24:26.780123+0000","last_undegraded":"2024-09-12T12:24:26.780123+0000","last_fullsized":"2024-09-12T12:24:26.780123+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:40:02.767132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.202450+0000","last_change":"2024-09-12T12:23:52.933594+0000","last_active":"2024-09-12T12:23:57.202450+0000","last_peered":"2024-09-12T12:23:57.202450+0000","last_clean":"2024-09-12T12:23:57.202450+0000","last_became_active":"2024-09-12T12:23:52.933197+0000","last_became_peered":"2024-09-12T12:23:52.933197+0000","last_unstale":"2024-09-12T12:23:57.202450+0000","last_undegraded":"2024-09-12T12:23:57.202450+0000","last_fullsized":"2024-09-12T12:23:57.202450+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:34.990674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.200926+0000","last_change":"2024-09-12T12:23:45.881962+0000","last_active":"2024-09-12T12:23:57.200926+0000","last_peered":"2024-09-12T12:23:57.200926+0000","last_clean":"2024-09-12T12:23:57.200926+0000","last_became_active":"2024-09-12T12:23:45.881697+0000","last_became_peered":"2024-09-12T12:23:45.881697+0000","last_unstale":"2024-09-12T12:23:57.200926+0000","last_undegraded":"2024-09-12T12:23:57.200926+0000","last_fullsized":"2024-09-12T12:23:57.200926+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:35:49.369852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:26.778257+0000","last_change":"2024-09-12T12:23:44.235206+0000","last_active":"2024-09-12T12:24:26.778257+0000","last_peered":"2024-09-12T12:24:26.778257+0000","last_clean":"2024-09-12T12:24:26.778257+0000","last_became_active":"2024-09-12T12:23:44.234797+0000","last_became_peered":"2024-09-12T12:23:44.234797+0000","last_unstale":"2024-09-12T12:24:26.778257+0000","last_undegraded":"2024-09-12T12:24:26.778257+0000","last_fullsized":"2024-09-12T12:24:26.778257+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:51.130077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:56.936286+0000","last_change":"2024-09-12T12:23:52.902763+0000","last_active":"2024-09-12T12:23:56.936286+0000","last_peered":"2024-09-12T12:23:56.936286+0000","last_clean":"2024-09-12T12:23:56.936286+0000","last_became_active":"2024-09-12T12:23:52.902362+0000","last_became_peered":"2024-09-12T12:23:52.902362+0000","last_unstale":"2024-09-12T12:23:56.936286+0000","last_undegraded":"2024-09-12T12:23:56.936286+0000","last_fullsized":"2024-09-12T12:23:56.936286+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:39.481290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.203189+0000","last_change":"2024-09-12T12:23:45.875014+0000","last_active":"2024-09-12T12:23:57.203189+0000","last_peered":"2024-09-12T12:23:57.203189+0000","last_clean":"2024-09-12T12:23:57.203189+0000","last_became_active":"2024-09-12T12:23:45.874673+0000","last_became_peered":"2024-09-12T12:23:45.874673+0000","last_unstale":"2024-09-12T12:23:57.203189+0000","last_undegraded":"2024-09-12T12:23:57.203189+0000","last_fullsized":"2024-09-12T12:23:57.203189+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:21.035185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"85'11","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:42.881404+0000","last_change":"2024-09-12T12:23:43.778558+0000","last_active":"2024-09-12T12:24:42.881404+0000","last_peered":"2024-09-12T12:24:42.881404+0000","last_clean":"2024-09-12T12:24:42.881404+0000","last_became_active":"2024-09-12T12:23:43.778194+0000","last_became_peered":"2024-09-12T12:23:43.778194+0000","last_unstale":"2024-09-12T12:24:42.881404+0000","last_undegraded":"2024-09-12T12:24:42.881404+0000","last_fullsized":"2024-09-12T12:24:42.881404+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:11.625462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.201248+0000","last_change":"2024-09-12T12:23:52.933833+0000","last_active":"2024-09-12T12:23:57.201248+0000","last_peered":"2024-09-12T12:23:57.201248+0000","last_clean":"2024-09-12T12:23:57.201248+0000","last_became_active":"2024-09-12T12:23:52.933330+0000","last_became_peered":"2024-09-12T12:23:52.933330+0000","last_unstale":"2024-09-12T12:23:57.201248+0000","last_undegraded":"2024-09-12T12:23:57.201248+0000","last_fullsized":"2024-09-12T12:23:57.201248+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:31.129088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.906430+0000","last_change":"2024-09-12T12:23:45.872527+0000","last_active":"2024-09-12T12:23:55.906430+0000","last_peered":"2024-09-12T12:23:55.906430+0000","last_clean":"2024-09-12T12:23:55.906430+0000","last_became_active":"2024-09-12T12:23:45.872220+0000","last_became_peered":"2024-09-12T12:23:45.872220+0000","last_unstale":"2024-09-12T12:23:55.906430+0000","last_undegraded":"2024-09-12T12:23:55.906430+0000","last_fullsized":"2024-09-12T12:23:55.906430+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:38:08.734145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"85'1","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:26.778041+0000","last_change":"2024-09-12T12:23:43.835824+0000","last_active":"2024-09-12T12:24:26.778041+0000","last_peered":"2024-09-12T12:24:26.778041+0000","last_clean":"2024-09-12T12:24:26.778041+0000","last_became_active":"2024-09-12T12:23:43.835375+0000","last_became_peered":"2024-09-12T12:23:43.835375+0000","last_unstale":"2024-09-12T12:24:26.778041+0000","last_undegraded":"2024-09-12T12:24:26.778041+0000","last_fullsized":"2024-09-12T12:24:26.778041+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:58:57.547060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:56.633477+0000","last_change":"2024-09-12T12:23:52.901739+0000","last_active":"2024-09-12T12:23:56.633477+0000","last_peered":"2024-09-12T12:23:56.633477+0000","last_clean":"2024-09-12T12:23:56.633477+0000","last_became_active":"2024-09-12T12:23:52.901370+0000","last_became_peered":"2024-09-12T12:23:52.901370+0000","last_unstale":"2024-09-12T12:23:56.633477+0000","last_undegraded":"2024-09-12T12:23:56.633477+0000","last_fullsized":"2024-09-12T12:23:56.633477+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:56:44.430446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.202218+0000","last_change":"2024-09-12T12:23:45.870491+0000","last_active":"2024-09-12T12:23:57.202218+0000","last_peered":"2024-09-12T12:23:57.202218+0000","last_clean":"2024-09-12T12:23:57.202218+0000","last_became_active":"2024-09-12T12:23:45.870182+0000","last_became_peered":"2024-09-12T12:23:45.870182+0000","last_unstale":"2024-09-12T12:23:57.202218+0000","last_undegraded":"2024-09-12T12:23:57.202218+0000","last_fullsized":"2024-09-12T12:23:57.202218+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:07.094287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.201135+0000","last_change":"2024-09-12T12:23:43.837430+0000","last_active":"2024-09-12T12:23:57.201135+0000","last_peered":"2024-09-12T12:23:57.201135+0000","last_clean":"2024-09-12T12:23:57.201135+0000","last_became_active":"2024-09-12T12:23:43.837091+0000","last_became_peered":"2024-09-12T12:23:43.837091+0000","last_unstale":"2024-09-12T12:23:57.201135+0000","last_undegraded":"2024-09-12T12:23:57.201135+0000","last_fullsized":"2024-09-12T12:23:57.201135+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:30.841341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.200504+0000","last_change":"2024-09-12T12:23:52.934196+0000","last_active":"2024-09-12T12:23:57.200504+0000","last_peered":"2024-09-12T12:23:57.200504+0000","last_clean":"2024-09-12T12:23:57.200504+0000","last_became_active":"2024-09-12T12:23:52.933745+0000","last_became_peered":"2024-09-12T12:23:52.933745+0000","last_unstale":"2024-09-12T12:23:57.200504+0000","last_undegraded":"2024-09-12T12:23:57.200504+0000","last_fullsized":"2024-09-12T12:23:57.200504+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:47.139397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.202279+0000","last_change":"2024-09-12T12:23:45.876159+0000","last_active":"2024-09-12T12:23:57.202279+0000","last_peered":"2024-09-12T12:23:57.202279+0000","last_clean":"2024-09-12T12:23:57.202279+0000","last_became_active":"2024-09-12T12:23:45.875771+0000","last_became_peered":"2024-09-12T12:23:45.875771+0000","last_unstale":"2024-09-12T12:23:57.202279+0000","last_undegraded":"2024-09-12T12:23:57.202279+0000","last_fullsized":"2024-09-12T12:23:57.202279+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:55.699099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'1","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.202247+0000","last_change":"2024-09-12T12:23:43.787082+0000","last_active":"2024-09-12T12:23:57.202247+0000","last_peered":"2024-09-12T12:23:57.202247+0000","last_clean":"2024-09-12T12:23:57.202247+0000","last_became_active":"2024-09-12T12:23:43.786619+0000","last_became_peered":"2024-09-12T12:23:43.786619+0000","last_unstale":"2024-09-12T12:23:57.202247+0000","last_undegraded":"2024-09-12T12:23:57.202247+0000","last_fullsized":"2024-09-12T12:23:57.202247+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:21.120020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.906380+0000","last_change":"2024-09-12T12:23:52.899659+0000","last_active":"2024-09-12T12:23:55.906380+0000","last_peered":"2024-09-12T12:23:55.906380+0000","last_clean":"2024-09-12T12:23:55.906380+0000","last_became_active":"2024-09-12T12:23:52.899226+0000","last_became_peered":"2024-09-12T12:23:52.899226+0000","last_unstale":"2024-09-12T12:23:55.906380+0000","last_undegraded":"2024-09-12T12:23:55.906380+0000","last_fullsized":"2024-09-12T12:23:55.906380+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:41.979174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.902829+0000","last_change":"2024-09-12T12:23:45.879112+0000","last_active":"2024-09-12T12:23:55.902829+0000","last_peered":"2024-09-12T12:23:55.902829+0000","last_clean":"2024-09-12T12:23:55.902829+0000","last_became_active":"2024-09-12T12:23:45.878684+0000","last_became_peered":"2024-09-12T12:23:45.878684+0000","last_unstale":"2024-09-12T12:23:55.902829+0000","last_undegraded":"2024-09-12T12:23:55.902829+0000","last_fullsized":"2024-09-12T12:23:55.902829+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:11:18.102437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'4","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:39.806397+0000","last_change":"2024-09-12T12:23:43.835282+0000","last_active":"2024-09-12T12:24:39.806397+0000","last_peered":"2024-09-12T12:24:39.806397+0000","last_clean":"2024-09-12T12:24:39.806397+0000","last_became_active":"2024-09-12T12:23:43.834929+0000","last_became_peered":"2024-09-12T12:23:43.834929+0000","last_unstale":"2024-09-12T12:24:39.806397+0000","last_undegraded":"2024-09-12T12:24:39.806397+0000","last_fullsized":"2024-09-12T12:24:39.806397+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:59:11.516387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.906671+0000","last_change":"2024-09-12T12:23:52.934077+0000","last_active":"2024-09-12T12:23:55.906671+0000","last_peered":"2024-09-12T12:23:55.906671+0000","last_clean":"2024-09-12T12:23:55.906671+0000","last_became_active":"2024-09-12T12:23:52.933583+0000","last_became_peered":"2024-09-12T12:23:52.933583+0000","last_unstale":"2024-09-12T12:23:55.906671+0000","last_undegraded":"2024-09-12T12:23:55.906671+0000","last_fullsized":"2024-09-12T12:23:55.906671+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:06.570624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.905914+0000","last_change":"2024-09-12T12:23:45.875735+0000","last_active":"2024-09-12T12:23:55.905914+0000","last_peered":"2024-09-12T12:23:55.905914+0000","last_clean":"2024-09-12T12:23:55.905914+0000","last_became_active":"2024-09-12T12:23:45.875072+0000","last_became_peered":"2024-09-12T12:23:45.875072+0000","last_unstale":"2024-09-12T12:23:55.905914+0000","last_undegraded":"2024-09-12T12:23:55.905914+0000","last_fullsized":"2024-09-12T12:23:55.905914+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:10.508123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'3","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:27.786242+0000","last_change":"2024-09-12T12:23:43.785226+0000","last_active":"2024-09-12T12:24:27.786242+0000","last_peered":"2024-09-12T12:24:27.786242+0000","last_clean":"2024-09-12T12:24:27.786242+0000","last_became_active":"2024-09-12T12:23:43.783705+0000","last_became_peered":"2024-09-12T12:23:43.783705+0000","last_unstale":"2024-09-12T12:24:27.786242+0000","last_undegraded":"2024-09-12T12:24:27.786242+0000","last_fullsized":"2024-09-12T12:24:27.786242+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:21.269569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.903593+0000","last_change":"2024-09-12T12:23:52.934383+0000","last_active":"2024-09-12T12:23:55.903593+0000","last_peered":"2024-09-12T12:23:55.903593+0000","last_clean":"2024-09-12T12:23:55.903593+0000","last_became_active":"2024-09-12T12:23:52.933744+0000","last_became_peered":"2024-09-12T12:23:52.933744+0000","last_unstale":"2024-09-12T12:23:55.903593+0000","last_undegraded":"2024-09-12T12:23:55.903593+0000","last_fullsized":"2024-09-12T12:23:55.903593+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:44.656785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.201372+0000","last_change":"2024-09-12T12:23:45.873460+0000","last_active":"2024-09-12T12:23:57.201372+0000","last_peered":"2024-09-12T12:23:57.201372+0000","last_clean":"2024-09-12T12:23:57.201372+0000","last_became_active":"2024-09-12T12:23:45.873188+0000","last_became_peered":"2024-09-12T12:23:45.873188+0000","last_unstale":"2024-09-12T12:23:57.201372+0000","last_undegraded":"2024-09-12T12:23:57.201372+0000","last_fullsized":"2024-09-12T12:23:57.201372+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:18:29.503856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'3","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:28.787341+0000","last_change":"2024-09-12T12:23:43.781082+0000","last_active":"2024-09-12T12:24:28.787341+0000","last_peered":"2024-09-12T12:24:28.787341+0000","last_clean":"2024-09-12T12:24:28.787341+0000","last_became_active":"2024-09-12T12:23:43.780710+0000","last_became_peered":"2024-09-12T12:23:43.780710+0000","last_unstale":"2024-09-12T12:24:28.787341+0000","last_undegraded":"2024-09-12T12:24:28.787341+0000","last_fullsized":"2024-09-12T12:24:28.787341+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:13:23.748716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":343,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.201301+0000","last_change":"2024-09-12T12:22:37.536326+0000","last_active":"2024-09-12T12:23:57.201301+0000","last_peered":"2024-09-12T12:23:57.201301+0000","last_clean":"2024-09-12T12:23:57.201301+0000","last_became_active":"2024-09-12T12:22:37.535831+0000","last_became_peered":"2024-09-12T12:22:37.535831+0000","last_unstale":"2024-09-12T12:23:57.201301+0000","last_undegraded":"2024-09-12T12:23:57.201301+0000","last_fullsized":"2024-09-12T12:23:57.201301+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:19:12.296434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:19:12.296434+0000","last_clean_scrub_stamp":"2024-09-12T12:19:12.296434+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:04:49.251883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"85'1","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.202733+0000","last_change":"2024-09-12T12:23:52.899782+0000","last_active":"2024-09-12T12:23:57.202733+0000","last_peered":"2024-09-12T12:23:57.202733+0000","last_clean":"2024-09-12T12:23:57.202733+0000","last_became_active":"2024-09-12T12:23:52.898938+0000","last_became_peered":"2024-09-12T12:23:52.898938+0000","last_unstale":"2024-09-12T12:23:57.202733+0000","last_undegraded":"2024-09-12T12:23:57.202733+0000","last_fullsized":"2024-09-12T12:23:57.202733+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:21.429444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.202985+0000","last_change":"2024-09-12T12:23:45.883059+0000","last_active":"2024-09-12T12:23:57.202985+0000","last_peered":"2024-09-12T12:23:57.202985+0000","last_clean":"2024-09-12T12:23:57.202985+0000","last_became_active":"2024-09-12T12:23:45.882206+0000","last_became_peered":"2024-09-12T12:23:45.882206+0000","last_unstale":"2024-09-12T12:23:57.202985+0000","last_undegraded":"2024-09-12T12:23:57.202985+0000","last_fullsized":"2024-09-12T12:23:57.202985+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:43.068533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'3","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:27.786304+0000","last_change":"2024-09-12T12:23:44.235088+0000","last_active":"2024-09-12T12:24:27.786304+0000","last_peered":"2024-09-12T12:24:27.786304+0000","last_clean":"2024-09-12T12:24:27.786304+0000","last_became_active":"2024-09-12T12:23:44.234551+0000","last_became_peered":"2024-09-12T12:23:44.234551+0000","last_unstale":"2024-09-12T12:24:27.786304+0000","last_undegraded":"2024-09-12T12:24:27.786304+0000","last_fullsized":"2024-09-12T12:24:27.786304+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:47.474387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.902944+0000","last_change":"2024-09-12T12:23:52.897807+0000","last_active":"2024-09-12T12:23:55.902944+0000","last_peered":"2024-09-12T12:23:55.902944+0000","last_clean":"2024-09-12T12:23:55.902944+0000","last_became_active":"2024-09-12T12:23:52.897405+0000","last_became_peered":"2024-09-12T12:23:52.897405+0000","last_unstale":"2024-09-12T12:23:55.902944+0000","last_undegraded":"2024-09-12T12:23:55.902944+0000","last_fullsized":"2024-09-12T12:23:55.902944+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:34.714177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.202493+0000","last_change":"2024-09-12T12:23:45.873907+0000","last_active":"2024-09-12T12:23:57.202493+0000","last_peered":"2024-09-12T12:23:57.202493+0000","last_clean":"2024-09-12T12:23:57.202493+0000","last_became_active":"2024-09-12T12:23:45.873464+0000","last_became_peered":"2024-09-12T12:23:45.873464+0000","last_unstale":"2024-09-12T12:23:57.202493+0000","last_undegraded":"2024-09-12T12:23:57.202493+0000","last_fullsized":"2024-09-12T12:23:57.202493+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:38:18.151880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.903793+0000","last_change":"2024-09-12T12:23:43.782649+0000","last_active":"2024-09-12T12:23:55.903793+0000","last_peered":"2024-09-12T12:23:55.903793+0000","last_clean":"2024-09-12T12:23:55.903793+0000","last_became_active":"2024-09-12T12:23:43.782290+0000","last_became_peered":"2024-09-12T12:23:43.782290+0000","last_unstale":"2024-09-12T12:23:55.903793+0000","last_undegraded":"2024-09-12T12:23:55.903793+0000","last_fullsized":"2024-09-12T12:23:55.903793+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:30:56.964121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.201084+0000","last_change":"2024-09-12T12:23:52.905108+0000","last_active":"2024-09-12T12:23:57.201084+0000","last_peered":"2024-09-12T12:23:57.201084+0000","last_clean":"2024-09-12T12:23:57.201084+0000","last_became_active":"2024-09-12T12:23:52.904664+0000","last_became_peered":"2024-09-12T12:23:52.904664+0000","last_unstale":"2024-09-12T12:23:57.201084+0000","last_undegraded":"2024-09-12T12:23:57.201084+0000","last_fullsized":"2024-09-12T12:23:57.201084+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:11.177971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.201791+0000","last_change":"2024-09-12T12:23:45.875244+0000","last_active":"2024-09-12T12:23:57.201791+0000","last_peered":"2024-09-12T12:23:57.201791+0000","last_clean":"2024-09-12T12:23:57.201791+0000","last_became_active":"2024-09-12T12:23:45.874889+0000","last_became_peered":"2024-09-12T12:23:45.874889+0000","last_unstale":"2024-09-12T12:23:57.201791+0000","last_undegraded":"2024-09-12T12:23:57.201791+0000","last_fullsized":"2024-09-12T12:23:57.201791+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:30:38.192162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.906597+0000","last_change":"2024-09-12T12:23:43.783232+0000","last_active":"2024-09-12T12:23:55.906597+0000","last_peered":"2024-09-12T12:23:55.906597+0000","last_clean":"2024-09-12T12:23:55.906597+0000","last_became_active":"2024-09-12T12:23:43.782975+0000","last_became_peered":"2024-09-12T12:23:43.782975+0000","last_unstale":"2024-09-12T12:23:55.906597+0000","last_undegraded":"2024-09-12T12:23:55.906597+0000","last_fullsized":"2024-09-12T12:23:55.906597+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:45.096636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.902674+0000","last_change":"2024-09-12T12:23:52.898356+0000","last_active":"2024-09-12T12:23:55.902674+0000","last_peered":"2024-09-12T12:23:55.902674+0000","last_clean":"2024-09-12T12:23:55.902674+0000","last_became_active":"2024-09-12T12:23:52.897868+0000","last_became_peered":"2024-09-12T12:23:52.897868+0000","last_unstale":"2024-09-12T12:23:55.902674+0000","last_undegraded":"2024-09-12T12:23:55.902674+0000","last_fullsized":"2024-09-12T12:23:55.902674+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:16:36.473730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:56.633733+0000","last_change":"2024-09-12T12:23:45.881532+0000","last_active":"2024-09-12T12:23:56.633733+0000","last_peered":"2024-09-12T12:23:56.633733+0000","last_clean":"2024-09-12T12:23:56.633733+0000","last_became_active":"2024-09-12T12:23:45.880895+0000","last_became_peered":"2024-09-12T12:23:45.880895+0000","last_unstale":"2024-09-12T12:23:56.633733+0000","last_undegraded":"2024-09-12T12:23:56.633733+0000","last_fullsized":"2024-09-12T12:23:56.633733+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:09:05.249773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:28.781674+0000","last_change":"2024-09-12T12:23:43.783436+0000","last_active":"2024-09-12T12:24:28.781674+0000","last_peered":"2024-09-12T12:24:28.781674+0000","last_clean":"2024-09-12T12:24:28.781674+0000","last_became_active":"2024-09-12T12:23:43.782975+0000","last_became_peered":"2024-09-12T12:23:43.782975+0000","last_unstale":"2024-09-12T12:24:28.781674+0000","last_undegraded":"2024-09-12T12:24:28.781674+0000","last_fullsized":"2024-09-12T12:24:28.781674+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:20.840189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.902770+0000","last_change":"2024-09-12T12:23:52.903210+0000","last_active":"2024-09-12T12:23:55.902770+0000","last_peered":"2024-09-12T12:23:55.902770+0000","last_clean":"2024-09-12T12:23:55.902770+0000","last_became_active":"2024-09-12T12:23:52.902832+0000","last_became_peered":"2024-09-12T12:23:52.902832+0000","last_unstale":"2024-09-12T12:23:55.902770+0000","last_undegraded":"2024-09-12T12:23:55.902770+0000","last_fullsized":"2024-09-12T12:23:55.902770+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:46:40.506581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.903039+0000","last_change":"2024-09-12T12:23:45.880314+0000","last_active":"2024-09-12T12:23:55.903039+0000","last_peered":"2024-09-12T12:23:55.903039+0000","last_clean":"2024-09-12T12:23:55.903039+0000","last_became_active":"2024-09-12T12:23:45.879878+0000","last_became_peered":"2024-09-12T12:23:45.879878+0000","last_unstale":"2024-09-12T12:23:55.903039+0000","last_undegraded":"2024-09-12T12:23:55.903039+0000","last_fullsized":"2024-09-12T12:23:55.903039+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:47.197008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"85'15","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:27.787156+0000","last_change":"2024-09-12T12:23:43.837005+0000","last_active":"2024-09-12T12:24:27.787156+0000","last_peered":"2024-09-12T12:24:27.787156+0000","last_clean":"2024-09-12T12:24:27.787156+0000","last_became_active":"2024-09-12T12:23:43.836630+0000","last_became_peered":"2024-09-12T12:23:43.836630+0000","last_unstale":"2024-09-12T12:24:27.787156+0000","last_undegraded":"2024-09-12T12:24:27.787156+0000","last_fullsized":"2024-09-12T12:24:27.787156+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:33:06.710430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.906632+0000","last_change":"2024-09-12T12:23:52.901841+0000","last_active":"2024-09-12T12:23:55.906632+0000","last_peered":"2024-09-12T12:23:55.906632+0000","last_clean":"2024-09-12T12:23:55.906632+0000","last_became_active":"2024-09-12T12:23:52.901469+0000","last_became_peered":"2024-09-12T12:23:52.901469+0000","last_unstale":"2024-09-12T12:23:55.906632+0000","last_undegraded":"2024-09-12T12:23:55.906632+0000","last_fullsized":"2024-09-12T12:23:55.906632+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:40.472980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.201096+0000","last_change":"2024-09-12T12:23:45.874026+0000","last_active":"2024-09-12T12:23:57.201096+0000","last_peered":"2024-09-12T12:23:57.201096+0000","last_clean":"2024-09-12T12:23:57.201096+0000","last_became_active":"2024-09-12T12:23:45.873494+0000","last_became_peered":"2024-09-12T12:23:45.873494+0000","last_unstale":"2024-09-12T12:23:57.201096+0000","last_undegraded":"2024-09-12T12:23:57.201096+0000","last_fullsized":"2024-09-12T12:23:57.201096+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:28.870938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'3","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:40.808323+0000","last_change":"2024-09-12T12:23:43.781866+0000","last_active":"2024-09-12T12:24:40.808323+0000","last_peered":"2024-09-12T12:24:40.808323+0000","last_clean":"2024-09-12T12:24:40.808323+0000","last_became_active":"2024-09-12T12:23:43.781488+0000","last_became_peered":"2024-09-12T12:23:43.781488+0000","last_unstale":"2024-09-12T12:24:40.808323+0000","last_undegraded":"2024-09-12T12:24:40.808323+0000","last_fullsized":"2024-09-12T12:24:40.808323+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:13:28.729199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.201464+0000","last_change":"2024-09-12T12:23:52.903427+0000","last_active":"2024-09-12T12:23:57.201464+0000","last_peered":"2024-09-12T12:23:57.201464+0000","last_clean":"2024-09-12T12:23:57.201464+0000","last_became_active":"2024-09-12T12:23:52.903077+0000","last_became_peered":"2024-09-12T12:23:52.903077+0000","last_unstale":"2024-09-12T12:23:57.201464+0000","last_undegraded":"2024-09-12T12:23:57.201464+0000","last_fullsized":"2024-09-12T12:23:57.201464+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:26:03.409086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.201875+0000","last_change":"2024-09-12T12:23:45.873628+0000","last_active":"2024-09-12T12:23:57.201875+0000","last_peered":"2024-09-12T12:23:57.201875+0000","last_clean":"2024-09-12T12:23:57.201875+0000","last_became_active":"2024-09-12T12:23:45.873264+0000","last_became_peered":"2024-09-12T12:23:45.873264+0000","last_unstale":"2024-09-12T12:23:57.201875+0000","last_undegraded":"2024-09-12T12:23:57.201875+0000","last_fullsized":"2024-09-12T12:23:57.201875+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:17:03.257858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"85'3","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:26.780771+0000","last_change":"2024-09-12T12:23:43.787320+0000","last_active":"2024-09-12T12:24:26.780771+0000","last_peered":"2024-09-12T12:24:26.780771+0000","last_clean":"2024-09-12T12:24:26.780771+0000","last_became_active":"2024-09-12T12:23:43.786937+0000","last_became_peered":"2024-09-12T12:23:43.786937+0000","last_unstale":"2024-09-12T12:24:26.780771+0000","last_undegraded":"2024-09-12T12:24:26.780771+0000","last_fullsized":"2024-09-12T12:24:26.780771+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:19.539586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:56.633713+0000","last_change":"2024-09-12T12:23:52.904582+0000","last_active":"2024-09-12T12:23:56.633713+0000","last_peered":"2024-09-12T12:23:56.633713+0000","last_clean":"2024-09-12T12:23:56.633713+0000","last_became_active":"2024-09-12T12:23:52.904172+0000","last_became_peered":"2024-09-12T12:23:52.904172+0000","last_unstale":"2024-09-12T12:23:56.633713+0000","last_undegraded":"2024-09-12T12:23:56.633713+0000","last_fullsized":"2024-09-12T12:23:56.633713+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:26:14.734098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.906094+0000","last_change":"2024-09-12T12:23:45.878128+0000","last_active":"2024-09-12T12:23:55.906094+0000","last_peered":"2024-09-12T12:23:55.906094+0000","last_clean":"2024-09-12T12:23:55.906094+0000","last_became_active":"2024-09-12T12:23:45.877154+0000","last_became_peered":"2024-09-12T12:23:45.877154+0000","last_unstale":"2024-09-12T12:23:55.906094+0000","last_undegraded":"2024-09-12T12:23:55.906094+0000","last_fullsized":"2024-09-12T12:23:55.906094+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:06.095805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"85'6","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:27.785429+0000","last_change":"2024-09-12T12:23:43.783586+0000","last_active":"2024-09-12T12:24:27.785429+0000","last_peered":"2024-09-12T12:24:27.785429+0000","last_clean":"2024-09-12T12:24:27.785429+0000","last_became_active":"2024-09-12T12:23:43.783255+0000","last_became_peered":"2024-09-12T12:23:43.783255+0000","last_unstale":"2024-09-12T12:24:27.785429+0000","last_undegraded":"2024-09-12T12:24:27.785429+0000","last_fullsized":"2024-09-12T12:24:27.785429+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:38.609805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.903496+0000","last_change":"2024-09-12T12:23:52.901120+0000","last_active":"2024-09-12T12:23:55.903496+0000","last_peered":"2024-09-12T12:23:55.903496+0000","last_clean":"2024-09-12T12:23:55.903496+0000","last_became_active":"2024-09-12T12:23:52.900700+0000","last_became_peered":"2024-09-12T12:23:52.900700+0000","last_unstale":"2024-09-12T12:23:55.903496+0000","last_undegraded":"2024-09-12T12:23:55.903496+0000","last_fullsized":"2024-09-12T12:23:55.903496+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:18.225867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.200901+0000","last_change":"2024-09-12T12:23:45.878074+0000","last_active":"2024-09-12T12:23:57.200901+0000","last_peered":"2024-09-12T12:23:57.200901+0000","last_clean":"2024-09-12T12:23:57.200901+0000","last_became_active":"2024-09-12T12:23:45.877753+0000","last_became_peered":"2024-09-12T12:23:45.877753+0000","last_unstale":"2024-09-12T12:23:57.200901+0000","last_undegraded":"2024-09-12T12:23:57.200901+0000","last_fullsized":"2024-09-12T12:23:57.200901+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:15.515609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"85'30","reported_seq":97,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:42.810874+0000","last_change":"2024-09-12T12:23:43.787476+0000","last_active":"2024-09-12T12:24:42.810874+0000","last_peered":"2024-09-12T12:24:42.810874+0000","last_clean":"2024-09-12T12:24:42.810874+0000","last_became_active":"2024-09-12T12:23:43.786808+0000","last_became_peered":"2024-09-12T12:23:43.786808+0000","last_unstale":"2024-09-12T12:24:42.810874+0000","last_undegraded":"2024-09-12T12:24:42.810874+0000","last_fullsized":"2024-09-12T12:24:42.810874+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:08:28.046702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56749,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":73,"num_write":31,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.201138+0000","last_change":"2024-09-12T12:23:52.900089+0000","last_active":"2024-09-12T12:23:57.201138+0000","last_peered":"2024-09-12T12:23:57.201138+0000","last_clean":"2024-09-12T12:23:57.201138+0000","last_became_active":"2024-09-12T12:23:52.899711+0000","last_became_peered":"2024-09-12T12:23:52.899711+0000","last_unstale":"2024-09-12T12:23:57.201138+0000","last_undegraded":"2024-09-12T12:23:57.201138+0000","last_fullsized":"2024-09-12T12:23:57.201138+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:58:38.850382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.902811+0000","last_change":"2024-09-12T12:23:45.876773+0000","last_active":"2024-09-12T12:23:55.902811+0000","last_peered":"2024-09-12T12:23:55.902811+0000","last_clean":"2024-09-12T12:23:55.902811+0000","last_became_active":"2024-09-12T12:23:45.876394+0000","last_became_peered":"2024-09-12T12:23:45.876394+0000","last_unstale":"2024-09-12T12:23:55.902811+0000","last_undegraded":"2024-09-12T12:23:55.902811+0000","last_fullsized":"2024-09-12T12:23:55.902811+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:55.468779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"85'4","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:26.781654+0000","last_change":"2024-09-12T12:23:43.835826+0000","last_active":"2024-09-12T12:24:26.781654+0000","last_peered":"2024-09-12T12:24:26.781654+0000","last_clean":"2024-09-12T12:24:26.781654+0000","last_became_active":"2024-09-12T12:23:43.835378+0000","last_became_peered":"2024-09-12T12:23:43.835378+0000","last_unstale":"2024-09-12T12:24:26.781654+0000","last_undegraded":"2024-09-12T12:24:26.781654+0000","last_fullsized":"2024-09-12T12:24:26.781654+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:23.429407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.203349+0000","last_change":"2024-09-12T12:23:52.905212+0000","last_active":"2024-09-12T12:23:57.203349+0000","last_peered":"2024-09-12T12:23:57.203349+0000","last_clean":"2024-09-12T12:23:57.203349+0000","last_became_active":"2024-09-12T12:23:52.904675+0000","last_became_peered":"2024-09-12T12:23:52.904675+0000","last_unstale":"2024-09-12T12:23:57.203349+0000","last_undegraded":"2024-09-12T12:23:57.203349+0000","last_fullsized":"2024-09-12T12:23:57.203349+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:30.404242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.202186+0000","last_change":"2024-09-12T12:23:45.875222+0000","last_active":"2024-09-12T12:23:57.202186+0000","last_peered":"2024-09-12T12:23:57.202186+0000","last_clean":"2024-09-12T12:23:57.202186+0000","last_became_active":"2024-09-12T12:23:45.874859+0000","last_became_peered":"2024-09-12T12:23:45.874859+0000","last_unstale":"2024-09-12T12:23:57.202186+0000","last_undegraded":"2024-09-12T12:23:57.202186+0000","last_fullsized":"2024-09-12T12:23:57.202186+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:29:00.017470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"85'2","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:26.780081+0000","last_change":"2024-09-12T12:23:43.788052+0000","last_active":"2024-09-12T12:24:26.780081+0000","last_peered":"2024-09-12T12:24:26.780081+0000","last_clean":"2024-09-12T12:24:26.780081+0000","last_became_active":"2024-09-12T12:23:43.787533+0000","last_became_peered":"2024-09-12T12:23:43.787533+0000","last_unstale":"2024-09-12T12:24:26.780081+0000","last_undegraded":"2024-09-12T12:24:26.780081+0000","last_fullsized":"2024-09-12T12:24:26.780081+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:32.042395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.200497+0000","last_change":"2024-09-12T12:23:52.900856+0000","last_active":"2024-09-12T12:23:57.200497+0000","last_peered":"2024-09-12T12:23:57.200497+0000","last_clean":"2024-09-12T12:23:57.200497+0000","last_became_active":"2024-09-12T12:23:52.900444+0000","last_became_peered":"2024-09-12T12:23:52.900444+0000","last_unstale":"2024-09-12T12:23:57.200497+0000","last_undegraded":"2024-09-12T12:23:57.200497+0000","last_fullsized":"2024-09-12T12:23:57.200497+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:52:22.443801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.902938+0000","last_change":"2024-09-12T12:23:45.869666+0000","last_active":"2024-09-12T12:23:55.902938+0000","last_peered":"2024-09-12T12:23:55.902938+0000","last_clean":"2024-09-12T12:23:55.902938+0000","last_became_active":"2024-09-12T12:23:45.869308+0000","last_became_peered":"2024-09-12T12:23:45.869308+0000","last_unstale":"2024-09-12T12:23:55.902938+0000","last_undegraded":"2024-09-12T12:23:55.902938+0000","last_fullsized":"2024-09-12T12:23:55.902938+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:37:47.895807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"85'3","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:41.808705+0000","last_change":"2024-09-12T12:23:43.786124+0000","last_active":"2024-09-12T12:24:41.808705+0000","last_peered":"2024-09-12T12:24:41.808705+0000","last_clean":"2024-09-12T12:24:41.808705+0000","last_became_active":"2024-09-12T12:23:43.785772+0000","last_became_peered":"2024-09-12T12:23:43.785772+0000","last_unstale":"2024-09-12T12:24:41.808705+0000","last_undegraded":"2024-09-12T12:24:41.808705+0000","last_fullsized":"2024-09-12T12:24:41.808705+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:23.458792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.201530+0000","last_change":"2024-09-12T12:23:52.905541+0000","last_active":"2024-09-12T12:23:57.201530+0000","last_peered":"2024-09-12T12:23:57.201530+0000","last_clean":"2024-09-12T12:23:57.201530+0000","last_became_active":"2024-09-12T12:23:52.905165+0000","last_became_peered":"2024-09-12T12:23:52.905165+0000","last_unstale":"2024-09-12T12:23:57.201530+0000","last_undegraded":"2024-09-12T12:23:57.201530+0000","last_fullsized":"2024-09-12T12:23:57.201530+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:40.831208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.200737+0000","last_change":"2024-09-12T12:23:52.901738+0000","last_active":"2024-09-12T12:23:57.200737+0000","last_peered":"2024-09-12T12:23:57.200737+0000","last_clean":"2024-09-12T12:23:57.200737+0000","last_became_active":"2024-09-12T12:23:52.901348+0000","last_became_peered":"2024-09-12T12:23:52.901348+0000","last_unstale":"2024-09-12T12:23:57.200737+0000","last_undegraded":"2024-09-12T12:23:57.200737+0000","last_fullsized":"2024-09-12T12:23:57.200737+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:16:24.075130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.200665+0000","last_change":"2024-09-12T12:23:45.869431+0000","last_active":"2024-09-12T12:23:57.200665+0000","last_peered":"2024-09-12T12:23:57.200665+0000","last_clean":"2024-09-12T12:23:57.200665+0000","last_became_active":"2024-09-12T12:23:45.869078+0000","last_became_peered":"2024-09-12T12:23:45.869078+0000","last_unstale":"2024-09-12T12:23:57.200665+0000","last_undegraded":"2024-09-12T12:23:57.200665+0000","last_fullsized":"2024-09-12T12:23:57.200665+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:37:19.849489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"85'1","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.903068+0000","last_change":"2024-09-12T12:23:43.787852+0000","last_active":"2024-09-12T12:23:55.903068+0000","last_peered":"2024-09-12T12:23:55.903068+0000","last_clean":"2024-09-12T12:23:55.903068+0000","last_became_active":"2024-09-12T12:23:43.787531+0000","last_became_peered":"2024-09-12T12:23:43.787531+0000","last_unstale":"2024-09-12T12:23:55.903068+0000","last_undegraded":"2024-09-12T12:23:55.903068+0000","last_fullsized":"2024-09-12T12:23:55.903068+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:25.499020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:56.633855+0000","last_change":"2024-09-12T12:23:52.904603+0000","last_active":"2024-09-12T12:23:56.633855+0000","last_peered":"2024-09-12T12:23:56.633855+0000","last_clean":"2024-09-12T12:23:56.633855+0000","last_became_active":"2024-09-12T12:23:52.904146+0000","last_became_peered":"2024-09-12T12:23:52.904146+0000","last_unstale":"2024-09-12T12:23:56.633855+0000","last_undegraded":"2024-09-12T12:23:56.633855+0000","last_fullsized":"2024-09-12T12:23:56.633855+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:01.847489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.201536+0000","last_change":"2024-09-12T12:23:45.880381+0000","last_active":"2024-09-12T12:23:57.201536+0000","last_peered":"2024-09-12T12:23:57.201536+0000","last_clean":"2024-09-12T12:23:57.201536+0000","last_became_active":"2024-09-12T12:23:45.879865+0000","last_became_peered":"2024-09-12T12:23:45.879865+0000","last_unstale":"2024-09-12T12:23:57.201536+0000","last_undegraded":"2024-09-12T12:23:57.201536+0000","last_fullsized":"2024-09-12T12:23:57.201536+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:52.033891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"85'2","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:27.784776+0000","last_change":"2024-09-12T12:23:43.782166+0000","last_active":"2024-09-12T12:24:27.784776+0000","last_peered":"2024-09-12T12:24:27.784776+0000","last_clean":"2024-09-12T12:24:27.784776+0000","last_became_active":"2024-09-12T12:23:43.781808+0000","last_became_peered":"2024-09-12T12:23:43.781808+0000","last_unstale":"2024-09-12T12:24:27.784776+0000","last_undegraded":"2024-09-12T12:24:27.784776+0000","last_fullsized":"2024-09-12T12:24:27.784776+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:44:03.340842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"85'3","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:27.785085+0000","last_change":"2024-09-12T12:23:43.784869+0000","last_active":"2024-09-12T12:24:27.785085+0000","last_peered":"2024-09-12T12:24:27.785085+0000","last_clean":"2024-09-12T12:24:27.785085+0000","last_became_active":"2024-09-12T12:23:43.784458+0000","last_became_peered":"2024-09-12T12:23:43.784458+0000","last_unstale":"2024-09-12T12:24:27.785085+0000","last_undegraded":"2024-09-12T12:24:27.785085+0000","last_fullsized":"2024-09-12T12:24:27.785085+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:46.025169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.903203+0000","last_change":"2024-09-12T12:23:45.879258+0000","last_active":"2024-09-12T12:23:55.903203+0000","last_peered":"2024-09-12T12:23:55.903203+0000","last_clean":"2024-09-12T12:23:55.903203+0000","last_became_active":"2024-09-12T12:23:45.878934+0000","last_became_peered":"2024-09-12T12:23:45.878934+0000","last_unstale":"2024-09-12T12:23:55.903203+0000","last_undegraded":"2024-09-12T12:23:55.903203+0000","last_fullsized":"2024-09-12T12:23:55.903203+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:46:06.617621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:56.936232+0000","last_change":"2024-09-12T12:23:52.906041+0000","last_active":"2024-09-12T12:23:56.936232+0000","last_peered":"2024-09-12T12:23:56.936232+0000","last_clean":"2024-09-12T12:23:56.936232+0000","last_became_active":"2024-09-12T12:23:52.905630+0000","last_became_peered":"2024-09-12T12:23:52.905630+0000","last_unstale":"2024-09-12T12:23:56.936232+0000","last_undegraded":"2024-09-12T12:23:56.936232+0000","last_fullsized":"2024-09-12T12:23:56.936232+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:15.691085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"85'6","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:24:40.807966+0000","last_change":"2024-09-12T12:23:43.786307+0000","last_active":"2024-09-12T12:24:40.807966+0000","last_peered":"2024-09-12T12:24:40.807966+0000","last_clean":"2024-09-12T12:24:40.807966+0000","last_became_active":"2024-09-12T12:23:43.785950+0000","last_became_peered":"2024-09-12T12:23:43.785950+0000","last_unstale":"2024-09-12T12:24:40.807966+0000","last_undegraded":"2024-09-12T12:24:40.807966+0000","last_fullsized":"2024-09-12T12:24:40.807966+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:15:24.051024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.200605+0000","last_change":"2024-09-12T12:23:45.868002+0000","last_active":"2024-09-12T12:23:57.200605+0000","last_peered":"2024-09-12T12:23:57.200605+0000","last_clean":"2024-09-12T12:23:57.200605+0000","last_became_active":"2024-09-12T12:23:45.867448+0000","last_became_peered":"2024-09-12T12:23:45.867448+0000","last_unstale":"2024-09-12T12:23:57.200605+0000","last_undegraded":"2024-09-12T12:23:57.200605+0000","last_fullsized":"2024-09-12T12:23:57.200605+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:24:01.805345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:56.936495+0000","last_change":"2024-09-12T12:23:52.902119+0000","last_active":"2024-09-12T12:23:56.936495+0000","last_peered":"2024-09-12T12:23:56.936495+0000","last_clean":"2024-09-12T12:23:56.936495+0000","last_became_active":"2024-09-12T12:23:52.901681+0000","last_became_peered":"2024-09-12T12:23:52.901681+0000","last_unstale":"2024-09-12T12:23:56.936495+0000","last_undegraded":"2024-09-12T12:23:56.936495+0000","last_fullsized":"2024-09-12T12:23:56.936495+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:42.039729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:56.633301+0000","last_change":"2024-09-12T12:23:45.879115+0000","last_active":"2024-09-12T12:23:56.633301+0000","last_peered":"2024-09-12T12:23:56.633301+0000","last_clean":"2024-09-12T12:23:56.633301+0000","last_became_active":"2024-09-12T12:23:45.878745+0000","last_became_peered":"2024-09-12T12:23:45.878745+0000","last_unstale":"2024-09-12T12:23:56.633301+0000","last_undegraded":"2024-09-12T12:23:56.633301+0000","last_fullsized":"2024-09-12T12:23:56.633301+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:53.152875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:56.936398+0000","last_change":"2024-09-12T12:23:45.878444+0000","last_active":"2024-09-12T12:23:56.936398+0000","last_peered":"2024-09-12T12:23:56.936398+0000","last_clean":"2024-09-12T12:23:56.936398+0000","last_became_active":"2024-09-12T12:23:45.878063+0000","last_became_peered":"2024-09-12T12:23:45.878063+0000","last_unstale":"2024-09-12T12:23:56.936398+0000","last_undegraded":"2024-09-12T12:23:56.936398+0000","last_fullsized":"2024-09-12T12:23:56.936398+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:07.928598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:56.936032+0000","last_change":"2024-09-12T12:23:45.873101+0000","last_active":"2024-09-12T12:23:56.936032+0000","last_peered":"2024-09-12T12:23:56.936032+0000","last_clean":"2024-09-12T12:23:56.936032+0000","last_became_active":"2024-09-12T12:23:45.872373+0000","last_became_peered":"2024-09-12T12:23:45.872373+0000","last_unstale":"2024-09-12T12:23:56.936032+0000","last_undegraded":"2024-09-12T12:23:56.936032+0000","last_fullsized":"2024-09-12T12:23:56.936032+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:47:14.747538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.201177+0000","last_change":"2024-09-12T12:23:45.875315+0000","last_active":"2024-09-12T12:23:57.201177+0000","last_peered":"2024-09-12T12:23:57.201177+0000","last_clean":"2024-09-12T12:23:57.201177+0000","last_became_active":"2024-09-12T12:23:45.874904+0000","last_became_peered":"2024-09-12T12:23:45.874904+0000","last_unstale":"2024-09-12T12:23:57.201177+0000","last_undegraded":"2024-09-12T12:23:57.201177+0000","last_fullsized":"2024-09-12T12:23:57.201177+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:52:44.373937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.906406+0000","last_change":"2024-09-12T12:23:45.876168+0000","last_active":"2024-09-12T12:23:55.906406+0000","last_peered":"2024-09-12T12:23:55.906406+0000","last_clean":"2024-09-12T12:23:55.906406+0000","last_became_active":"2024-09-12T12:23:45.875780+0000","last_became_peered":"2024-09-12T12:23:45.875780+0000","last_unstale":"2024-09-12T12:23:55.906406+0000","last_undegraded":"2024-09-12T12:23:55.906406+0000","last_fullsized":"2024-09-12T12:23:55.906406+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:18.335692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:56.633657+0000","last_change":"2024-09-12T12:23:45.872638+0000","last_active":"2024-09-12T12:23:56.633657+0000","last_peered":"2024-09-12T12:23:56.633657+0000","last_clean":"2024-09-12T12:23:56.633657+0000","last_became_active":"2024-09-12T12:23:45.872299+0000","last_became_peered":"2024-09-12T12:23:45.872299+0000","last_unstale":"2024-09-12T12:23:56.633657+0000","last_undegraded":"2024-09-12T12:23:56.633657+0000","last_fullsized":"2024-09-12T12:23:56.633657+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:27.758613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:56.936631+0000","last_change":"2024-09-12T12:23:45.877168+0000","last_active":"2024-09-12T12:23:56.936631+0000","last_peered":"2024-09-12T12:23:56.936631+0000","last_clean":"2024-09-12T12:23:56.936631+0000","last_became_active":"2024-09-12T12:23:45.876871+0000","last_became_peered":"2024-09-12T12:23:45.876871+0000","last_unstale":"2024-09-12T12:23:56.936631+0000","last_undegraded":"2024-09-12T12:23:56.936631+0000","last_fullsized":"2024-09-12T12:23:56.936631+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:24.567415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.203166+0000","last_change":"2024-09-12T12:23:45.872423+0000","last_active":"2024-09-12T12:23:57.203166+0000","last_peered":"2024-09-12T12:23:57.203166+0000","last_clean":"2024-09-12T12:23:57.203166+0000","last_became_active":"2024-09-12T12:23:45.872138+0000","last_became_peered":"2024-09-12T12:23:45.872138+0000","last_unstale":"2024-09-12T12:23:57.203166+0000","last_undegraded":"2024-09-12T12:23:57.203166+0000","last_fullsized":"2024-09-12T12:23:57.203166+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:48.576702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.902824+0000","last_change":"2024-09-12T12:23:45.873728+0000","last_active":"2024-09-12T12:23:55.902824+0000","last_peered":"2024-09-12T12:23:55.902824+0000","last_clean":"2024-09-12T12:23:55.902824+0000","last_became_active":"2024-09-12T12:23:45.871831+0000","last_became_peered":"2024-09-12T12:23:45.871831+0000","last_unstale":"2024-09-12T12:23:55.902824+0000","last_undegraded":"2024-09-12T12:23:55.902824+0000","last_fullsized":"2024-09-12T12:23:55.902824+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:48.690705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.201427+0000","last_change":"2024-09-12T12:23:45.873035+0000","last_active":"2024-09-12T12:23:57.201427+0000","last_peered":"2024-09-12T12:23:57.201427+0000","last_clean":"2024-09-12T12:23:57.201427+0000","last_became_active":"2024-09-12T12:23:45.872660+0000","last_became_peered":"2024-09-12T12:23:45.872660+0000","last_unstale":"2024-09-12T12:23:57.201427+0000","last_undegraded":"2024-09-12T12:23:57.201427+0000","last_fullsized":"2024-09-12T12:23:57.201427+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:31.376116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.902790+0000","last_change":"2024-09-12T12:23:45.879754+0000","last_active":"2024-09-12T12:23:55.902790+0000","last_peered":"2024-09-12T12:23:55.902790+0000","last_clean":"2024-09-12T12:23:55.902790+0000","last_became_active":"2024-09-12T12:23:45.879362+0000","last_became_peered":"2024-09-12T12:23:45.879362+0000","last_unstale":"2024-09-12T12:23:55.902790+0000","last_undegraded":"2024-09-12T12:23:55.902790+0000","last_fullsized":"2024-09-12T12:23:55.902790+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:23.587083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.906361+0000","last_change":"2024-09-12T12:23:45.878297+0000","last_active":"2024-09-12T12:23:55.906361+0000","last_peered":"2024-09-12T12:23:55.906361+0000","last_clean":"2024-09-12T12:23:55.906361+0000","last_became_active":"2024-09-12T12:23:45.877127+0000","last_became_peered":"2024-09-12T12:23:45.877127+0000","last_unstale":"2024-09-12T12:23:55.906361+0000","last_undegraded":"2024-09-12T12:23:55.906361+0000","last_fullsized":"2024-09-12T12:23:55.906361+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:54.334325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:56.633493+0000","last_change":"2024-09-12T12:23:45.879078+0000","last_active":"2024-09-12T12:23:56.633493+0000","last_peered":"2024-09-12T12:23:56.633493+0000","last_clean":"2024-09-12T12:23:56.633493+0000","last_became_active":"2024-09-12T12:23:45.878799+0000","last_became_peered":"2024-09-12T12:23:45.878799+0000","last_unstale":"2024-09-12T12:23:56.633493+0000","last_undegraded":"2024-09-12T12:23:56.633493+0000","last_fullsized":"2024-09-12T12:23:56.633493+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:45.680643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:56.936537+0000","last_change":"2024-09-12T12:23:45.872739+0000","last_active":"2024-09-12T12:23:56.936537+0000","last_peered":"2024-09-12T12:23:56.936537+0000","last_clean":"2024-09-12T12:23:56.936537+0000","last_became_active":"2024-09-12T12:23:45.871931+0000","last_became_peered":"2024-09-12T12:23:45.871931+0000","last_unstale":"2024-09-12T12:23:56.936537+0000","last_undegraded":"2024-09-12T12:23:56.936537+0000","last_fullsized":"2024-09-12T12:23:56.936537+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:36:30.451737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.201485+0000","last_change":"2024-09-12T12:23:45.876717+0000","last_active":"2024-09-12T12:23:57.201485+0000","last_peered":"2024-09-12T12:23:57.201485+0000","last_clean":"2024-09-12T12:23:57.201485+0000","last_became_active":"2024-09-12T12:23:45.876372+0000","last_became_peered":"2024-09-12T12:23:45.876372+0000","last_unstale":"2024-09-12T12:23:57.201485+0000","last_undegraded":"2024-09-12T12:23:57.201485+0000","last_fullsized":"2024-09-12T12:23:57.201485+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:40:26.905442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:56.633974+0000","last_change":"2024-09-12T12:23:45.877286+0000","last_active":"2024-09-12T12:23:56.633974+0000","last_peered":"2024-09-12T12:23:56.633974+0000","last_clean":"2024-09-12T12:23:56.633974+0000","last_became_active":"2024-09-12T12:23:45.876619+0000","last_became_peered":"2024-09-12T12:23:45.876619+0000","last_unstale":"2024-09-12T12:23:56.633974+0000","last_undegraded":"2024-09-12T12:23:56.633974+0000","last_fullsized":"2024-09-12T12:23:56.633974+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:05.637917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.902361+0000","last_change":"2024-09-12T12:23:45.875244+0000","last_active":"2024-09-12T12:23:55.902361+0000","last_peered":"2024-09-12T12:23:55.902361+0000","last_clean":"2024-09-12T12:23:55.902361+0000","last_became_active":"2024-09-12T12:23:45.874908+0000","last_became_peered":"2024-09-12T12:23:45.874908+0000","last_unstale":"2024-09-12T12:23:55.902361+0000","last_undegraded":"2024-09-12T12:23:55.902361+0000","last_fullsized":"2024-09-12T12:23:55.902361+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:14.314124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.202308+0000","last_change":"2024-09-12T12:23:45.875253+0000","last_active":"2024-09-12T12:23:57.202308+0000","last_peered":"2024-09-12T12:23:57.202308+0000","last_clean":"2024-09-12T12:23:57.202308+0000","last_became_active":"2024-09-12T12:23:45.874936+0000","last_became_peered":"2024-09-12T12:23:45.874936+0000","last_unstale":"2024-09-12T12:23:57.202308+0000","last_undegraded":"2024-09-12T12:23:57.202308+0000","last_fullsized":"2024-09-12T12:23:57.202308+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:28.790546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.200746+0000","last_change":"2024-09-12T12:23:45.880503+0000","last_active":"2024-09-12T12:23:57.200746+0000","last_peered":"2024-09-12T12:23:57.200746+0000","last_clean":"2024-09-12T12:23:57.200746+0000","last_became_active":"2024-09-12T12:23:45.880184+0000","last_became_peered":"2024-09-12T12:23:45.880184+0000","last_unstale":"2024-09-12T12:23:57.200746+0000","last_undegraded":"2024-09-12T12:23:57.200746+0000","last_fullsized":"2024-09-12T12:23:57.200746+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:12.370667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.906356+0000","last_change":"2024-09-12T12:23:45.869762+0000","last_active":"2024-09-12T12:23:55.906356+0000","last_peered":"2024-09-12T12:23:55.906356+0000","last_clean":"2024-09-12T12:23:55.906356+0000","last_became_active":"2024-09-12T12:23:45.867595+0000","last_became_peered":"2024-09-12T12:23:45.867595+0000","last_unstale":"2024-09-12T12:23:55.906356+0000","last_undegraded":"2024-09-12T12:23:55.906356+0000","last_fullsized":"2024-09-12T12:23:55.906356+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:25:19.855969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.203229+0000","last_change":"2024-09-12T12:23:45.874097+0000","last_active":"2024-09-12T12:23:57.203229+0000","last_peered":"2024-09-12T12:23:57.203229+0000","last_clean":"2024-09-12T12:23:57.203229+0000","last_became_active":"2024-09-12T12:23:45.873275+0000","last_became_peered":"2024-09-12T12:23:45.873275+0000","last_unstale":"2024-09-12T12:23:57.203229+0000","last_undegraded":"2024-09-12T12:23:57.203229+0000","last_fullsized":"2024-09-12T12:23:57.203229+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:21.303339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.202859+0000","last_change":"2024-09-12T12:23:45.883354+0000","last_active":"2024-09-12T12:23:57.202859+0000","last_peered":"2024-09-12T12:23:57.202859+0000","last_clean":"2024-09-12T12:23:57.202859+0000","last_became_active":"2024-09-12T12:23:45.882673+0000","last_became_peered":"2024-09-12T12:23:45.882673+0000","last_unstale":"2024-09-12T12:23:57.202859+0000","last_undegraded":"2024-09-12T12:23:57.202859+0000","last_fullsized":"2024-09-12T12:23:57.202859+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:42.034857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.202819+0000","last_change":"2024-09-12T12:23:45.876955+0000","last_active":"2024-09-12T12:23:57.202819+0000","last_peered":"2024-09-12T12:23:57.202819+0000","last_clean":"2024-09-12T12:23:57.202819+0000","last_became_active":"2024-09-12T12:23:45.876632+0000","last_became_peered":"2024-09-12T12:23:45.876632+0000","last_unstale":"2024-09-12T12:23:57.202819+0000","last_undegraded":"2024-09-12T12:23:57.202819+0000","last_fullsized":"2024-09-12T12:23:57.202819+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:25.155739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:55.903139+0000","last_change":"2024-09-12T12:23:45.875166+0000","last_active":"2024-09-12T12:23:55.903139+0000","last_peered":"2024-09-12T12:23:55.903139+0000","last_clean":"2024-09-12T12:23:55.903139+0000","last_became_active":"2024-09-12T12:23:45.874835+0000","last_became_peered":"2024-09-12T12:23:45.874835+0000","last_unstale":"2024-09-12T12:23:55.903139+0000","last_undegraded":"2024-09-12T12:23:55.903139+0000","last_fullsized":"2024-09-12T12:23:55.903139+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:50.014484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.201427+0000","last_change":"2024-09-12T12:23:45.874161+0000","last_active":"2024-09-12T12:23:57.201427+0000","last_peered":"2024-09-12T12:23:57.201427+0000","last_clean":"2024-09-12T12:23:57.201427+0000","last_became_active":"2024-09-12T12:23:45.873846+0000","last_became_peered":"2024-09-12T12:23:45.873846+0000","last_unstale":"2024-09-12T12:23:57.201427+0000","last_undegraded":"2024-09-12T12:23:57.201427+0000","last_fullsized":"2024-09-12T12:23:57.201427+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:09:17.525956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.202128+0000","last_change":"2024-09-12T12:23:45.870642+0000","last_active":"2024-09-12T12:23:57.202128+0000","last_peered":"2024-09-12T12:23:57.202128+0000","last_clean":"2024-09-12T12:23:57.202128+0000","last_became_active":"2024-09-12T12:23:45.870006+0000","last_became_peered":"2024-09-12T12:23:45.870006+0000","last_unstale":"2024-09-12T12:23:57.202128+0000","last_undegraded":"2024-09-12T12:23:57.202128+0000","last_fullsized":"2024-09-12T12:23:57.202128+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:43:35.133650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.202017+0000","last_change":"2024-09-12T12:23:45.875174+0000","last_active":"2024-09-12T12:23:57.202017+0000","last_peered":"2024-09-12T12:23:57.202017+0000","last_clean":"2024-09-12T12:23:57.202017+0000","last_became_active":"2024-09-12T12:23:45.874851+0000","last_became_peered":"2024-09-12T12:23:45.874851+0000","last_unstale":"2024-09-12T12:23:57.202017+0000","last_undegraded":"2024-09-12T12:23:57.202017+0000","last_fullsized":"2024-09-12T12:23:57.202017+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:42.565644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.200559+0000","last_change":"2024-09-12T12:23:45.873170+0000","last_active":"2024-09-12T12:23:57.200559+0000","last_peered":"2024-09-12T12:23:57.200559+0000","last_clean":"2024-09-12T12:23:57.200559+0000","last_became_active":"2024-09-12T12:23:45.872814+0000","last_became_peered":"2024-09-12T12:23:45.872814+0000","last_unstale":"2024-09-12T12:23:57.200559+0000","last_undegraded":"2024-09-12T12:23:57.200559+0000","last_fullsized":"2024-09-12T12:23:57.200559+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:36.143107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.203098+0000","last_change":"2024-09-12T12:23:45.874271+0000","last_active":"2024-09-12T12:23:57.203098+0000","last_peered":"2024-09-12T12:23:57.203098+0000","last_clean":"2024-09-12T12:23:57.203098+0000","last_became_active":"2024-09-12T12:23:45.873789+0000","last_became_peered":"2024-09-12T12:23:45.873789+0000","last_unstale":"2024-09-12T12:23:57.203098+0000","last_undegraded":"2024-09-12T12:23:57.203098+0000","last_fullsized":"2024-09-12T12:23:57.203098+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:58.252706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.201577+0000","last_change":"2024-09-12T12:23:45.877236+0000","last_active":"2024-09-12T12:23:57.201577+0000","last_peered":"2024-09-12T12:23:57.201577+0000","last_clean":"2024-09-12T12:23:57.201577+0000","last_became_active":"2024-09-12T12:23:45.876920+0000","last_became_peered":"2024-09-12T12:23:45.876920+0000","last_unstale":"2024-09-12T12:23:57.201577+0000","last_undegraded":"2024-09-12T12:23:57.201577+0000","last_fullsized":"2024-09-12T12:23:57.201577+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:19:19.749103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:57.200832+0000","last_change":"2024-09-12T12:23:45.880480+0000","last_active":"2024-09-12T12:23:57.200832+0000","last_peered":"2024-09-12T12:23:57.200832+0000","last_clean":"2024-09-12T12:23:57.200832+0000","last_became_active":"2024-09-12T12:23:45.880163+0000","last_became_peered":"2024-09-12T12:23:45.880163+0000","last_unstale":"2024-09-12T12:23:57.200832+0000","last_undegraded":"2024-09-12T12:23:57.200832+0000","last_fullsized":"2024-09-12T12:23:57.200832+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:35.496705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T12:23:56.633947+0000","last_change":"2024-09-12T12:23:45.876975+0000","last_active":"2024-09-12T12:23:56.633947+0000","last_peered":"2024-09-12T12:23:56.633947+0000","last_clean":"2024-09-12T12:23:56.633947+0000","last_became_active":"2024-09-12T12:23:45.876501+0000","last_became_peered":"2024-09-12T12:23:45.876501+0000","last_unstale":"2024-09-12T12:23:56.633947+0000","last_undegraded":"2024-09-12T12:23:56.633947+0000","last_fullsized":"2024-09-12T12:23:56.633947+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:15.029566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60752,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":112,"num_read_kb":120,"num_write":164,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":169990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":286267,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612632,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":473868,"data_compressed":17611,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841564,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1073152,"data_stored":1117885,"data_compressed":54009,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005090,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":478200,"data_compressed":17611,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234022,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":474024,"data_compressed":17611,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462955,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36320,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708832,"statfs":{"total":95995035648,"available":95957843968,"internally_reserved":0,"allocated":999424,"data_stored":1069935,"data_compressed":54009,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626481,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":929792,"data_stored":469280,"data_compressed":17611,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855414,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1007616,"data_stored":1065523,"data_compressed":54009,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018939,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36264,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708888,"statfs":{"total":95995035648,"available":95957901312,"internally_reserved":0,"allocated":942080,"data_stored":473930,"data_compressed":17611,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247872,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":469474,"data_compressed":17611,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444101,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32164,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712988,"statfs":{"total":95995035648,"available":95962099712,"internally_reserved":0,"allocated":1003520,"data_stored":515416,"data_compressed":17611,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36312,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708840,"statfs":{"total":95995035648,"available":95957852160,"internally_reserved":0,"allocated":991232,"data_stored":525939,"data_compressed":17611,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738446,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36276,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708876,"statfs":{"total":95995035648,"available":95957889024,"internally_reserved":0,"allocated":954368,"data_stored":470668,"data_compressed":17611,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34759,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34759,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34759,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36398,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36398,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36398,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36398,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36398,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":56749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":46226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":58327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:24:47.674 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-12T12:24:47.675 INFO:tasks.cephadm:Setting up client nodes... 2024-09-12T12:24:47.675 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-12T12:24:47.944 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:48.351 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:48 smithi033 ceph-mon[31246]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:24:48.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:48 smithi043 ceph-mon[34144]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:24:48.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:48 smithi102 ceph-mon[34799]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:24:48.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.444+0000 7fc0ba728640 1 -- 172.21.15.33:0/2309407136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0b41037c0 msgr2=0x7fc0b410a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:48.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.444+0000 7fc0ba728640 1 --2- 172.21.15.33:0/2309407136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0b41037c0 0x7fc0b410a050 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac009ca0 tx=0x7fc0ac02a8c0 comp rx=0 tx=0).stop 2024-09-12T12:24:48.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.444+0000 7fc0ba728640 1 -- 172.21.15.33:0/2309407136 shutdown_connections 2024-09-12T12:24:48.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.444+0000 7fc0ba728640 1 --2- 172.21.15.33:0/2309407136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0b41037c0 0x7fc0b410a050 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:48.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.444+0000 7fc0ba728640 1 --2- 172.21.15.33:0/2309407136 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc0b4102e00 0x7fc0b4103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:48.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.444+0000 7fc0ba728640 1 --2- 172.21.15.33:0/2309407136 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0b4101c00 0x7fc0b4102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:48.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.444+0000 7fc0ba728640 1 -- 172.21.15.33:0/2309407136 >> 172.21.15.33:0/2309407136 conn(0x7fc0b40fd390 msgr2=0x7fc0b40ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:48.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.444+0000 7fc0ba728640 1 -- 172.21.15.33:0/2309407136 shutdown_connections 2024-09-12T12:24:48.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.444+0000 7fc0ba728640 1 -- 172.21.15.33:0/2309407136 wait complete. 2024-09-12T12:24:48.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.445+0000 7fc0ba728640 1 Processor -- start 2024-09-12T12:24:48.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.445+0000 7fc0ba728640 1 -- start start 2024-09-12T12:24:48.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.445+0000 7fc0ba728640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc0b4101c00 0x7fc0b4199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:48.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.445+0000 7fc0ba728640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0b4102e00 0x7fc0b419a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:48.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.445+0000 7fc0ba728640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0b41037c0 0x7fc0b41a1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:48.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.445+0000 7fc0ba728640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b410d780 con 0x7fc0b4102e00 2024-09-12T12:24:48.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.445+0000 7fc0ba728640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b410d600 con 0x7fc0b41037c0 2024-09-12T12:24:48.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.445+0000 7fc0ba728640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b410d900 con 0x7fc0b4101c00 2024-09-12T12:24:48.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.446+0000 7fc0b37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0b4102e00 0x7fc0b419a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:48.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.446+0000 7fc0b37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0b4102e00 0x7fc0b419a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56780/0 (socket says 172.21.15.33:56780) 2024-09-12T12:24:48.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.446+0000 7fc0b3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc0b4101c00 0x7fc0b4199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:48.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.446+0000 7fc0b37fe640 1 -- 172.21.15.33:0/1594955622 learned_addr learned my addr 172.21.15.33:0/1594955622 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:24:48.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.446+0000 7fc0b8cc5640 1 --2- 172.21.15.33:0/1594955622 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0b41037c0 0x7fc0b41a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:48.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.446+0000 7fc0b37fe640 1 -- 172.21.15.33:0/1594955622 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc0b4101c00 msgr2=0x7fc0b4199fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:48.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.446+0000 7fc0b37fe640 1 --2- 172.21.15.33:0/1594955622 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc0b4101c00 0x7fc0b4199fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:48.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.446+0000 7fc0b37fe640 1 -- 172.21.15.33:0/1594955622 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0b41037c0 msgr2=0x7fc0b41a1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:48.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.446+0000 7fc0b37fe640 1 --2- 172.21.15.33:0/1594955622 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0b41037c0 0x7fc0b41a1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:48.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.446+0000 7fc0b37fe640 1 -- 172.21.15.33:0/1594955622 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b41a1bf0 con 0x7fc0b4102e00 2024-09-12T12:24:48.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.446+0000 7fc0b8cc5640 1 --2- 172.21.15.33:0/1594955622 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0b41037c0 0x7fc0b41a1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:24:48.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.446+0000 7fc0b37fe640 1 --2- 172.21.15.33:0/1594955622 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0b4102e00 0x7fc0b419a500 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc0a800c970 tx=0x7fc0a800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:48.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.446+0000 7fc0b17fa640 1 -- 172.21.15.33:0/1594955622 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a8007bb0 con 0x7fc0b4102e00 2024-09-12T12:24:48.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.446+0000 7fc0b17fa640 1 -- 172.21.15.33:0/1594955622 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc0a8007d50 con 0x7fc0b4102e00 2024-09-12T12:24:48.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.446+0000 7fc0ba728640 1 -- 172.21.15.33:0/1594955622 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0b41a1ee0 con 0x7fc0b4102e00 2024-09-12T12:24:48.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.446+0000 7fc0b17fa640 1 -- 172.21.15.33:0/1594955622 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a800f450 con 0x7fc0b4102e00 2024-09-12T12:24:48.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.446+0000 7fc0ba728640 1 -- 172.21.15.33:0/1594955622 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0b41a2390 con 0x7fc0b4102e00 2024-09-12T12:24:48.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.448+0000 7fc0ba728640 1 -- 172.21.15.33:0/1594955622 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0b41a2620 con 0x7fc0b4102e00 2024-09-12T12:24:48.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.449+0000 7fc0b17fa640 1 -- 172.21.15.33:0/1594955622 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc0a8004ee0 con 0x7fc0b4102e00 2024-09-12T12:24:48.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.449+0000 7fc0b17fa640 1 --2- 172.21.15.33:0/1594955622 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc09c0a2cc0 0x7fc09c0a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:48.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.450+0000 7fc0b17fa640 1 -- 172.21.15.33:0/1594955622 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7fc0a80cf100 con 0x7fc0b4102e00 2024-09-12T12:24:48.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.450+0000 7fc0b3fff640 1 --2- 172.21.15.33:0/1594955622 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc09c0a2cc0 0x7fc09c0a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:48.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.450+0000 7fc0b3fff640 1 --2- 172.21.15.33:0/1594955622 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc09c0a2cc0 0x7fc09c0a5180 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4102c60 tx=0x7fc0a4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:48.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.454+0000 7fc0b17fa640 1 -- 172.21.15.33:0/1594955622 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc0a8014030 con 0x7fc0b4102e00 2024-09-12T12:24:48.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.700+0000 7fc0ba728640 1 -- 172.21.15.33:0/1594955622 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fc0b41a2930 con 0x7fc0b4102e00 2024-09-12T12:24:48.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.702+0000 7fc0b17fa640 1 -- 172.21.15.33:0/1594955622 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7fc0a809bcc0 con 0x7fc0b4102e00 2024-09-12T12:24:48.704 INFO:teuthology.orchestra.run.smithi033.stdout:[client.0] 2024-09-12T12:24:48.704 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQCQ3eJmSd7KKRAA9Am7h01EBRe+Ts/OZ29TCg== 2024-09-12T12:24:48.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.704+0000 7fc0ba728640 1 -- 172.21.15.33:0/1594955622 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc09c0a2cc0 msgr2=0x7fc09c0a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:48.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.704+0000 7fc0ba728640 1 --2- 172.21.15.33:0/1594955622 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc09c0a2cc0 0x7fc09c0a5180 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4102c60 tx=0x7fc0a4005f90 comp rx=0 tx=0).stop 2024-09-12T12:24:48.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.704+0000 7fc0ba728640 1 -- 172.21.15.33:0/1594955622 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0b4102e00 msgr2=0x7fc0b419a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:48.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.704+0000 7fc0ba728640 1 --2- 172.21.15.33:0/1594955622 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0b4102e00 0x7fc0b419a500 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc0a800c970 tx=0x7fc0a800ce30 comp rx=0 tx=0).stop 2024-09-12T12:24:48.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.704+0000 7fc0ba728640 1 -- 172.21.15.33:0/1594955622 shutdown_connections 2024-09-12T12:24:48.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.704+0000 7fc0ba728640 1 --2- 172.21.15.33:0/1594955622 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc09c0a2cc0 0x7fc09c0a5180 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:48.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.704+0000 7fc0ba728640 1 --2- 172.21.15.33:0/1594955622 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0b41037c0 0x7fc0b41a1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:48.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.704+0000 7fc0ba728640 1 --2- 172.21.15.33:0/1594955622 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0b4102e00 0x7fc0b419a500 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:48.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.704+0000 7fc0ba728640 1 --2- 172.21.15.33:0/1594955622 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc0b4101c00 0x7fc0b4199fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:48.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.704+0000 7fc0ba728640 1 -- 172.21.15.33:0/1594955622 >> 172.21.15.33:0/1594955622 conn(0x7fc0b40fd390 msgr2=0x7fc0b4074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:48.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.704+0000 7fc0ba728640 1 -- 172.21.15.33:0/1594955622 shutdown_connections 2024-09-12T12:24:48.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:48.704+0000 7fc0ba728640 1 -- 172.21.15.33:0/1594955622 wait complete. 2024-09-12T12:24:49.315 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:49 smithi033 ceph-mon[31246]: pgmap v310: 129 pgs: 129 active+clean; 636 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.7 KiB/s wr, 9 op/s 2024-09-12T12:24:49.315 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:49 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/1594955622' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T12:24:49.315 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:49 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/1594955622' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T12:24:49.344 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T12:24:49.344 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-12T12:24:49.344 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T12:24:49.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:49 smithi043 ceph-mon[34144]: pgmap v310: 129 pgs: 129 active+clean; 636 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.7 KiB/s wr, 9 op/s 2024-09-12T12:24:49.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:49 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/1594955622' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T12:24:49.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:49 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/1594955622' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T12:24:49.383 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T12:24:49.383 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-12T12:24:49.384 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-12T12:24:49.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:49 smithi102 ceph-mon[34799]: pgmap v310: 129 pgs: 129 active+clean; 636 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.7 KiB/s wr, 9 op/s 2024-09-12T12:24:49.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:49 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/1594955622' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T12:24:49.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:49 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/1594955622' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T12:24:49.679 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:50.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.161+0000 7f820fa3b640 1 -- 172.21.15.33:0/4024971221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f820810c170 msgr2=0x7f820810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:50.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.161+0000 7f820fa3b640 1 --2- 172.21.15.33:0/4024971221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f820810c170 0x7f820810e610 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8200009ca0 tx=0x7f820002a950 comp rx=0 tx=0).stop 2024-09-12T12:24:50.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.161+0000 7f820fa3b640 1 -- 172.21.15.33:0/4024971221 shutdown_connections 2024-09-12T12:24:50.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.161+0000 7f820fa3b640 1 --2- 172.21.15.33:0/4024971221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f820810c170 0x7f820810e610 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.161+0000 7f820fa3b640 1 --2- 172.21.15.33:0/4024971221 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8208103660 0x7f820810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.161+0000 7f820fa3b640 1 --2- 172.21.15.33:0/4024971221 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8208102d40 0x7f8208103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.161+0000 7f820fa3b640 1 -- 172.21.15.33:0/4024971221 >> 172.21.15.33:0/4024971221 conn(0x7f82080fc7a0 msgr2=0x7f82080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:50.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.161+0000 7f820fa3b640 1 -- 172.21.15.33:0/4024971221 shutdown_connections 2024-09-12T12:24:50.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.161+0000 7f820fa3b640 1 -- 172.21.15.33:0/4024971221 wait complete. 2024-09-12T12:24:50.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.162+0000 7f820fa3b640 1 Processor -- start 2024-09-12T12:24:50.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.162+0000 7f820fa3b640 1 -- start start 2024-09-12T12:24:50.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.162+0000 7f820fa3b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8208102d40 0x7f8208198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.162+0000 7f820fa3b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8208103660 0x7f82081989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.162+0000 7f820fa3b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f820810c170 0x7f820819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.162+0000 7f820fa3b640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8208111e60 con 0x7f8208102d40 2024-09-12T12:24:50.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.162+0000 7f820fa3b640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8208111ce0 con 0x7f820810c170 2024-09-12T12:24:50.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.162+0000 7f820fa3b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8208111fe0 con 0x7f8208103660 2024-09-12T12:24:50.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.162+0000 7f820d7d7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8208102d40 0x7f8208198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.162+0000 7f820d7d7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8208102d40 0x7f8208198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56802/0 (socket says 172.21.15.33:56802) 2024-09-12T12:24:50.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.162+0000 7f820d7d7640 1 -- 172.21.15.33:0/2677955068 learned_addr learned my addr 172.21.15.33:0/2677955068 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:24:50.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.162+0000 7f820dfd8640 1 --2- 172.21.15.33:0/2677955068 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f820810c170 0x7f820819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.162+0000 7f820cfd6640 1 --2- 172.21.15.33:0/2677955068 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8208103660 0x7f82081989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.162+0000 7f820d7d7640 1 -- 172.21.15.33:0/2677955068 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8208103660 msgr2=0x7f82081989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:50.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.162+0000 7f820d7d7640 1 --2- 172.21.15.33:0/2677955068 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8208103660 0x7f82081989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.162+0000 7f820d7d7640 1 -- 172.21.15.33:0/2677955068 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f820810c170 msgr2=0x7f820819cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:50.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.162+0000 7f820d7d7640 1 --2- 172.21.15.33:0/2677955068 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f820810c170 0x7f820819cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.162+0000 7f820d7d7640 1 -- 172.21.15.33:0/2677955068 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f820819d420 con 0x7f8208102d40 2024-09-12T12:24:50.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.163+0000 7f820d7d7640 1 --2- 172.21.15.33:0/2677955068 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8208102d40 0x7f8208198470 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f820400b4a0 tx=0x7f820400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:50.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.163+0000 7f81fe7fc640 1 -- 172.21.15.33:0/2677955068 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8204014070 con 0x7f8208102d40 2024-09-12T12:24:50.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.163+0000 7f81fe7fc640 1 -- 172.21.15.33:0/2677955068 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8204010ac0 con 0x7f8208102d40 2024-09-12T12:24:50.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.163+0000 7f81fe7fc640 1 -- 172.21.15.33:0/2677955068 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8204017c30 con 0x7f8208102d40 2024-09-12T12:24:50.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.163+0000 7f820fa3b640 1 -- 172.21.15.33:0/2677955068 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f820819d710 con 0x7f8208102d40 2024-09-12T12:24:50.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.163+0000 7f820fa3b640 1 -- 172.21.15.33:0/2677955068 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82081a4ff0 con 0x7f8208102d40 2024-09-12T12:24:50.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.164+0000 7f820fa3b640 1 -- 172.21.15.33:0/2677955068 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8208103120 con 0x7f8208102d40 2024-09-12T12:24:50.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.165+0000 7f81fe7fc640 1 -- 172.21.15.33:0/2677955068 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f8204017070 con 0x7f8208102d40 2024-09-12T12:24:50.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.166+0000 7f81fe7fc640 1 --2- 172.21.15.33:0/2677955068 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f81f40a2c10 0x7f81f40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.166+0000 7f820cfd6640 1 --2- 172.21.15.33:0/2677955068 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f81f40a2c10 0x7f81f40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.166+0000 7f81fe7fc640 1 -- 172.21.15.33:0/2677955068 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f82040ce9d0 con 0x7f8208102d40 2024-09-12T12:24:50.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.166+0000 7f820cfd6640 1 --2- 172.21.15.33:0/2677955068 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f81f40a2c10 0x7f81f40a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f81f80058c0 tx=0x7f81f8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:50.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.170+0000 7f81fe7fc640 1 -- 172.21.15.33:0/2677955068 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f820409b6a0 con 0x7f8208102d40 2024-09-12T12:24:50.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.392+0000 7f820fa3b640 1 -- 172.21.15.33:0/2677955068 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f8208107210 con 0x7f8208102d40 2024-09-12T12:24:50.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.397+0000 7f81fe7fc640 1 -- 172.21.15.33:0/2677955068 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+263196 (secure 0 0 0) 0x7f820409afa0 con 0x7f8208102d40 2024-09-12T12:24:50.400 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:24:50.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.400+0000 7f820fa3b640 1 -- 172.21.15.33:0/2677955068 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f81f40a2c10 msgr2=0x7f81f40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:50.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.400+0000 7f820fa3b640 1 --2- 172.21.15.33:0/2677955068 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f81f40a2c10 0x7f81f40a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f81f80058c0 tx=0x7f81f8005850 comp rx=0 tx=0).stop 2024-09-12T12:24:50.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.400+0000 7f820fa3b640 1 -- 172.21.15.33:0/2677955068 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8208102d40 msgr2=0x7f8208198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:50.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.400+0000 7f820fa3b640 1 --2- 172.21.15.33:0/2677955068 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8208102d40 0x7f8208198470 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f820400b4a0 tx=0x7f820400b960 comp rx=0 tx=0).stop 2024-09-12T12:24:50.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.400+0000 7f820fa3b640 1 -- 172.21.15.33:0/2677955068 shutdown_connections 2024-09-12T12:24:50.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.400+0000 7f820fa3b640 1 --2- 172.21.15.33:0/2677955068 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f81f40a2c10 0x7f81f40a50d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.400+0000 7f820fa3b640 1 --2- 172.21.15.33:0/2677955068 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f820810c170 0x7f820819cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.400+0000 7f820fa3b640 1 --2- 172.21.15.33:0/2677955068 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8208103660 0x7f82081989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.400+0000 7f820fa3b640 1 --2- 172.21.15.33:0/2677955068 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8208102d40 0x7f8208198470 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.400+0000 7f820fa3b640 1 -- 172.21.15.33:0/2677955068 >> 172.21.15.33:0/2677955068 conn(0x7f82080fc7a0 msgr2=0x7f82080fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:50.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.400+0000 7f820fa3b640 1 -- 172.21.15.33:0/2677955068 shutdown_connections 2024-09-12T12:24:50.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:50.400+0000 7f820fa3b640 1 -- 172.21.15.33:0/2677955068 wait complete. 2024-09-12T12:24:51.121 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":176202431},{"type":"v1","addr":"172.21.15.33:6801","nonce":176202431}]},"active_addr":"172.21.15.33:6801/176202431","active_change":"2024-09-12T12:16:57.792919+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24112,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24125,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.33:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.33:0","nonce":1815738657}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.33:0","nonce":4187934157}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.33:0","nonce":1685402607}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.33:0","nonce":118994610}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.33:0","nonce":502631414}]}]} 2024-09-12T12:24:51.126 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-12T12:24:51.127 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-12T12:24:51.127 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T12:24:51.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:51 smithi043 ceph-mon[34144]: pgmap v311: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.2 KiB/s wr, 9 op/s 2024-09-12T12:24:51.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:51 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/2677955068' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-12T12:24:51.383 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:51.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:51 smithi102 ceph-mon[34799]: pgmap v311: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.2 KiB/s wr, 9 op/s 2024-09-12T12:24:51.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:51 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/2677955068' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-12T12:24:51.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:51 smithi033 ceph-mon[31246]: pgmap v311: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.2 KiB/s wr, 9 op/s 2024-09-12T12:24:51.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:51 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/2677955068' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-12T12:24:51.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:51.878+0000 7f62014d7640 1 -- 172.21.15.33:0/3364329842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61fc101de0 msgr2=0x7f61fc1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:51.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:51.878+0000 7f62014d7640 1 --2- 172.21.15.33:0/3364329842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61fc101de0 0x7f61fc1021c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f61ec009900 tx=0x7f61ec02a410 comp rx=0 tx=0).stop 2024-09-12T12:24:51.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:51.878+0000 7f62014d7640 1 -- 172.21.15.33:0/3364329842 shutdown_connections 2024-09-12T12:24:51.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:51.878+0000 7f62014d7640 1 --2- 172.21.15.33:0/3364329842 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61fc106f10 0x7f61fc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:51.878+0000 7f62014d7640 1 --2- 172.21.15.33:0/3364329842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61fc102790 0x7f61fc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:51.878+0000 7f62014d7640 1 --2- 172.21.15.33:0/3364329842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61fc101de0 0x7f61fc1021c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:51.878+0000 7f62014d7640 1 -- 172.21.15.33:0/3364329842 >> 172.21.15.33:0/3364329842 conn(0x7f61fc0fd8c0 msgr2=0x7f61fc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:51.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:51.878+0000 7f62014d7640 1 -- 172.21.15.33:0/3364329842 shutdown_connections 2024-09-12T12:24:51.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:51.878+0000 7f62014d7640 1 -- 172.21.15.33:0/3364329842 wait complete. 2024-09-12T12:24:51.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:51.879+0000 7f62014d7640 1 Processor -- start 2024-09-12T12:24:51.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:51.879+0000 7f62014d7640 1 -- start start 2024-09-12T12:24:51.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:51.879+0000 7f62014d7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61fc101de0 0x7f61fc198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:51.879+0000 7f62014d7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61fc102790 0x7f61fc1988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:51.879+0000 7f62014d7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61fc106f10 0x7f61fc19cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:51.879+0000 7f62014d7640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f61fc111e20 con 0x7f61fc101de0 2024-09-12T12:24:51.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:51.879+0000 7f62014d7640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f61fc111ca0 con 0x7f61fc106f10 2024-09-12T12:24:51.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:51.879+0000 7f62014d7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f61fc111fa0 con 0x7f61fc102790 2024-09-12T12:24:51.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:51.879+0000 7f61faffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61fc101de0 0x7f61fc198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:51.879+0000 7f61faffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61fc101de0 0x7f61fc198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45906/0 (socket says 172.21.15.33:45906) 2024-09-12T12:24:51.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:51.879+0000 7f61faffd640 1 -- 172.21.15.33:0/1729197118 learned_addr learned my addr 172.21.15.33:0/1729197118 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:24:51.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:51.879+0000 7f61fb7fe640 1 --2- 172.21.15.33:0/1729197118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61fc106f10 0x7f61fc19cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:51.879+0000 7f61fa7fc640 1 --2- 172.21.15.33:0/1729197118 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61fc102790 0x7f61fc1988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:51.880+0000 7f61faffd640 1 -- 172.21.15.33:0/1729197118 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61fc102790 msgr2=0x7f61fc1988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:51.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:51.880+0000 7f61faffd640 1 --2- 172.21.15.33:0/1729197118 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61fc102790 0x7f61fc1988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:51.880+0000 7f61faffd640 1 -- 172.21.15.33:0/1729197118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61fc106f10 msgr2=0x7f61fc19cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:51.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:51.880+0000 7f61faffd640 1 --2- 172.21.15.33:0/1729197118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61fc106f10 0x7f61fc19cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:51.880+0000 7f61faffd640 1 -- 172.21.15.33:0/1729197118 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61fc19d310 con 0x7f61fc101de0 2024-09-12T12:24:51.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:51.880+0000 7f61faffd640 1 --2- 172.21.15.33:0/1729197118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61fc101de0 0x7f61fc198360 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f61ec005940 tx=0x7f61ec004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:51.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:51.880+0000 7f61e3fff640 1 -- 172.21.15.33:0/1729197118 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ec03f030 con 0x7f61fc101de0 2024-09-12T12:24:51.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:51.880+0000 7f61e3fff640 1 -- 172.21.15.33:0/1729197118 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f61ec003aa0 con 0x7f61fc101de0 2024-09-12T12:24:51.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:51.880+0000 7f61e3fff640 1 -- 172.21.15.33:0/1729197118 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ec035070 con 0x7f61fc101de0 2024-09-12T12:24:51.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:51.880+0000 7f62014d7640 1 -- 172.21.15.33:0/1729197118 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61fc19d5a0 con 0x7f61fc101de0 2024-09-12T12:24:51.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:51.880+0000 7f62014d7640 1 -- 172.21.15.33:0/1729197118 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61fc1a4ee0 con 0x7f61fc101de0 2024-09-12T12:24:51.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:51.881+0000 7f62014d7640 1 -- 172.21.15.33:0/1729197118 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61fc1021c0 con 0x7f61fc101de0 2024-09-12T12:24:51.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:51.882+0000 7f61e3fff640 1 -- 172.21.15.33:0/1729197118 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f61ec042030 con 0x7f61fc101de0 2024-09-12T12:24:51.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:51.883+0000 7f61e3fff640 1 --2- 172.21.15.33:0/1729197118 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f61e40a2c90 0x7f61e40a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:51.884+0000 7f61fa7fc640 1 --2- 172.21.15.33:0/1729197118 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f61e40a2c90 0x7f61e40a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:51.884+0000 7f61e3fff640 1 -- 172.21.15.33:0/1729197118 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f61ec0efa70 con 0x7f61fc101de0 2024-09-12T12:24:51.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:51.884+0000 7f61fa7fc640 1 --2- 172.21.15.33:0/1729197118 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f61e40a2c90 0x7f61e40a5150 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f61fc0fdd50 tx=0x7f61f000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:51.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:51.888+0000 7f61e3fff640 1 -- 172.21.15.33:0/1729197118 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f61ec0bbfe0 con 0x7f61fc101de0 2024-09-12T12:24:52.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:52.063+0000 7f62014d7640 1 -- 172.21.15.33:0/1729197118 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f61fc10a0f0 con 0x7f61fc101de0 2024-09-12T12:24:52.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:52.065+0000 7f61e3fff640 1 -- 172.21.15.33:0/1729197118 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+24141 (secure 0 0 0) 0x7f61ec0c02e0 con 0x7f61fc101de0 2024-09-12T12:24:52.065 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:24:52.065 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":85,"fsid":"a66dfafc-7100-11ef-bcea-c7b262605968","created":"2024-09-12T12:16:11.904815+0000","modified":"2024-09-12T12:23:55.506385+0000","last_up_change":"2024-09-12T12:22:57.476185+0000","last_in_change":"2024-09-12T12:22:35.192556+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:19:12.296305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:23:42.509774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:23:44.842852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T12:23:51.308720+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"74b68729-c97c-4da6-a659-75d6c147ad05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6803","nonce":963294466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6805","nonce":963294466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6809","nonce":963294466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6807","nonce":963294466}]},"public_addr":"172.21.15.33:6803/963294466","cluster_addr":"172.21.15.33:6805/963294466","heartbeat_back_addr":"172.21.15.33:6809/963294466","heartbeat_front_addr":"172.21.15.33:6807/963294466","state":["exists","up"]},{"osd":1,"uuid":"2461a388-e110-420b-9404-eb54cd39119e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6801","nonce":2306025171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6803","nonce":2306025171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6807","nonce":2306025171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6805","nonce":2306025171}]},"public_addr":"172.21.15.43:6801/2306025171","cluster_addr":"172.21.15.43:6803/2306025171","heartbeat_back_addr":"172.21.15.43:6807/2306025171","heartbeat_front_addr":"172.21.15.43:6805/2306025171","state":["exists","up"]},{"osd":2,"uuid":"4ba9dd02-977d-45fb-b366-ade15b52232b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6801","nonce":4257223217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6803","nonce":4257223217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6807","nonce":4257223217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6805","nonce":4257223217}]},"public_addr":"172.21.15.102:6801/4257223217","cluster_addr":"172.21.15.102:6803/4257223217","heartbeat_back_addr":"172.21.15.102:6807/4257223217","heartbeat_front_addr":"172.21.15.102:6805/4257223217","state":["exists","up"]},{"osd":3,"uuid":"345aa854-9ea2-4103-a186-9794af34c237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6811","nonce":2483872739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6813","nonce":2483872739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6817","nonce":2483872739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6815","nonce":2483872739}]},"public_addr":"172.21.15.33:6811/2483872739","cluster_addr":"172.21.15.33:6813/2483872739","heartbeat_back_addr":"172.21.15.33:6817/2483872739","heartbeat_front_addr":"172.21.15.33:6815/2483872739","state":["exists","up"]},{"osd":4,"uuid":"32acd6da-01d6-4a8e-9d05-3d394363d6f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6809","nonce":136043101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6811","nonce":136043101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6815","nonce":136043101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6813","nonce":136043101}]},"public_addr":"172.21.15.43:6809/136043101","cluster_addr":"172.21.15.43:6811/136043101","heartbeat_back_addr":"172.21.15.43:6815/136043101","heartbeat_front_addr":"172.21.15.43:6813/136043101","state":["exists","up"]},{"osd":5,"uuid":"dced0037-2da2-48c2-a391-f871d6ceebb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6809","nonce":2605625792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6811","nonce":2605625792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6815","nonce":2605625792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6813","nonce":2605625792}]},"public_addr":"172.21.15.102:6809/2605625792","cluster_addr":"172.21.15.102:6811/2605625792","heartbeat_back_addr":"172.21.15.102:6815/2605625792","heartbeat_front_addr":"172.21.15.102:6813/2605625792","state":["exists","up"]},{"osd":6,"uuid":"46e5532e-026a-4bb2-8847-2a3216e5d7a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6819","nonce":805864618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6821","nonce":805864618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6825","nonce":805864618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6823","nonce":805864618}]},"public_addr":"172.21.15.33:6819/805864618","cluster_addr":"172.21.15.33:6821/805864618","heartbeat_back_addr":"172.21.15.33:6825/805864618","heartbeat_front_addr":"172.21.15.33:6823/805864618","state":["exists","up"]},{"osd":7,"uuid":"c8474ab4-68cd-4475-9429-b54981247ee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6817","nonce":392537201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6819","nonce":392537201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6823","nonce":392537201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6821","nonce":392537201}]},"public_addr":"172.21.15.43:6817/392537201","cluster_addr":"172.21.15.43:6819/392537201","heartbeat_back_addr":"172.21.15.43:6823/392537201","heartbeat_front_addr":"172.21.15.43:6821/392537201","state":["exists","up"]},{"osd":8,"uuid":"e7c2ef28-8c84-44d0-ba6d-7556ec1d02dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6817","nonce":1768219597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6819","nonce":1768219597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6823","nonce":1768219597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6821","nonce":1768219597}]},"public_addr":"172.21.15.102:6817/1768219597","cluster_addr":"172.21.15.102:6819/1768219597","heartbeat_back_addr":"172.21.15.102:6823/1768219597","heartbeat_front_addr":"172.21.15.102:6821/1768219597","state":["exists","up"]},{"osd":9,"uuid":"f2500273-8b21-4984-bc41-cec5cc0c883b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6827","nonce":973136168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6829","nonce":973136168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6833","nonce":973136168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6831","nonce":973136168}]},"public_addr":"172.21.15.33:6827/973136168","cluster_addr":"172.21.15.33:6829/973136168","heartbeat_back_addr":"172.21.15.33:6833/973136168","heartbeat_front_addr":"172.21.15.33:6831/973136168","state":["exists","up"]},{"osd":10,"uuid":"954343c5-5d5b-4c30-acde-82aa695f7b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6825","nonce":248515585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6827","nonce":248515585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6831","nonce":248515585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6829","nonce":248515585}]},"public_addr":"172.21.15.43:6825/248515585","cluster_addr":"172.21.15.43:6827/248515585","heartbeat_back_addr":"172.21.15.43:6831/248515585","heartbeat_front_addr":"172.21.15.43:6829/248515585","state":["exists","up"]},{"osd":11,"uuid":"22b4147b-02ad-4514-be17-5bb395099eef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6825","nonce":2463068013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6827","nonce":2463068013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6831","nonce":2463068013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6829","nonce":2463068013}]},"public_addr":"172.21.15.102:6825/2463068013","cluster_addr":"172.21.15.102:6827/2463068013","heartbeat_back_addr":"172.21.15.102:6831/2463068013","heartbeat_front_addr":"172.21.15.102:6829/2463068013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:19.274804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:44.900294+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:08.885404+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:34.382089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:59.978538+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:25.275179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:49.429847+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:14.974792+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:40.268629+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:22:06.458679+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:22:31.813019+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:22:56.264078+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/3187741548":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6800/1381479235":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6801/1156183797":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/2222991013":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6801/1381479235":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6800/1156183797":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/3450458842":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/202580320":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/2441151017":"2024-09-13T12:16:57.792813+0000","172.21.15.33:0/1001176884":"2024-09-13T12:16:33.559150+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:24:52.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:52.067+0000 7f62014d7640 1 -- 172.21.15.33:0/1729197118 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f61e40a2c90 msgr2=0x7f61e40a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:52.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:52.067+0000 7f62014d7640 1 --2- 172.21.15.33:0/1729197118 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f61e40a2c90 0x7f61e40a5150 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f61fc0fdd50 tx=0x7f61f000a2d0 comp rx=0 tx=0).stop 2024-09-12T12:24:52.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:52.067+0000 7f62014d7640 1 -- 172.21.15.33:0/1729197118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61fc101de0 msgr2=0x7f61fc198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:52.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:52.067+0000 7f62014d7640 1 --2- 172.21.15.33:0/1729197118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61fc101de0 0x7f61fc198360 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f61ec005940 tx=0x7f61ec004270 comp rx=0 tx=0).stop 2024-09-12T12:24:52.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:52.067+0000 7f62014d7640 1 -- 172.21.15.33:0/1729197118 shutdown_connections 2024-09-12T12:24:52.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:52.067+0000 7f62014d7640 1 --2- 172.21.15.33:0/1729197118 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f61e40a2c90 0x7f61e40a5150 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:52.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:52.067+0000 7f62014d7640 1 --2- 172.21.15.33:0/1729197118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61fc106f10 0x7f61fc19cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:52.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:52.067+0000 7f62014d7640 1 --2- 172.21.15.33:0/1729197118 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61fc102790 0x7f61fc1988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:52.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:52.067+0000 7f62014d7640 1 --2- 172.21.15.33:0/1729197118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61fc101de0 0x7f61fc198360 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:52.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:52.067+0000 7f62014d7640 1 -- 172.21.15.33:0/1729197118 >> 172.21.15.33:0/1729197118 conn(0x7f61fc0fd8c0 msgr2=0x7f61fc0fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:52.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:52.067+0000 7f62014d7640 1 -- 172.21.15.33:0/1729197118 shutdown_connections 2024-09-12T12:24:52.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:52.067+0000 7f62014d7640 1 -- 172.21.15.33:0/1729197118 wait complete. 2024-09-12T12:24:52.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:52 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/1729197118' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:24:52.376 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:52 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/1729197118' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:24:52.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:52 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/1729197118' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:24:52.709 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-12T12:24:52.709 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T12:24:52.969 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:53.356 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:53 smithi033 ceph-mon[31246]: pgmap v312: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2024-09-12T12:24:53.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:53 smithi043 ceph-mon[34144]: pgmap v312: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2024-09-12T12:24:53.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:53 smithi102 ceph-mon[34799]: pgmap v312: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2024-09-12T12:24:53.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.439+0000 7fb07211c640 1 -- 172.21.15.33:0/3321449093 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb06c102d40 msgr2=0x7fb06c103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:53.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.439+0000 7fb07211c640 1 --2- 172.21.15.33:0/3321449093 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb06c102d40 0x7fb06c103120 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb05c009900 tx=0x7fb05c02a480 comp rx=0 tx=0).stop 2024-09-12T12:24:53.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.439+0000 7fb07211c640 1 -- 172.21.15.33:0/3321449093 shutdown_connections 2024-09-12T12:24:53.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.439+0000 7fb07211c640 1 --2- 172.21.15.33:0/3321449093 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb06c10c170 0x7fb06c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.439+0000 7fb07211c640 1 --2- 172.21.15.33:0/3321449093 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb06c103660 0x7fb06c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.439+0000 7fb07211c640 1 --2- 172.21.15.33:0/3321449093 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb06c102d40 0x7fb06c103120 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.439+0000 7fb07211c640 1 -- 172.21.15.33:0/3321449093 >> 172.21.15.33:0/3321449093 conn(0x7fb06c0fc7a0 msgr2=0x7fb06c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:53.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.439+0000 7fb07211c640 1 -- 172.21.15.33:0/3321449093 shutdown_connections 2024-09-12T12:24:53.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.439+0000 7fb07211c640 1 -- 172.21.15.33:0/3321449093 wait complete. 2024-09-12T12:24:53.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.439+0000 7fb07211c640 1 Processor -- start 2024-09-12T12:24:53.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.440+0000 7fb07211c640 1 -- start start 2024-09-12T12:24:53.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.440+0000 7fb07211c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb06c102d40 0x7fb06c1982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:53.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.440+0000 7fb07211c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb06c103660 0x7fb06c198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:53.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.440+0000 7fb07211c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb06c10c170 0x7fb06c19cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:53.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.440+0000 7fb07211c640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb06c111e20 con 0x7fb06c102d40 2024-09-12T12:24:53.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.440+0000 7fb07211c640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb06c111ca0 con 0x7fb06c103660 2024-09-12T12:24:53.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.440+0000 7fb07211c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb06c111fa0 con 0x7fb06c10c170 2024-09-12T12:24:53.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.440+0000 7fb06b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb06c102d40 0x7fb06c1982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:53.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.440+0000 7fb06b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb06c102d40 0x7fb06c1982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45934/0 (socket says 172.21.15.33:45934) 2024-09-12T12:24:53.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.440+0000 7fb06b7fe640 1 -- 172.21.15.33:0/2251088127 learned_addr learned my addr 172.21.15.33:0/2251088127 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:24:53.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.440+0000 7fb06affd640 1 --2- 172.21.15.33:0/2251088127 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb06c103660 0x7fb06c198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:53.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.440+0000 7fb06bfff640 1 --2- 172.21.15.33:0/2251088127 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb06c10c170 0x7fb06c19cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:53.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.440+0000 7fb06b7fe640 1 -- 172.21.15.33:0/2251088127 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb06c10c170 msgr2=0x7fb06c19cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:53.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.440+0000 7fb06b7fe640 1 --2- 172.21.15.33:0/2251088127 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb06c10c170 0x7fb06c19cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.440+0000 7fb06b7fe640 1 -- 172.21.15.33:0/2251088127 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb06c103660 msgr2=0x7fb06c198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:53.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.440+0000 7fb06b7fe640 1 --2- 172.21.15.33:0/2251088127 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb06c103660 0x7fb06c198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.440+0000 7fb06b7fe640 1 -- 172.21.15.33:0/2251088127 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb06c19d290 con 0x7fb06c102d40 2024-09-12T12:24:53.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.441+0000 7fb06bfff640 1 --2- 172.21.15.33:0/2251088127 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb06c10c170 0x7fb06c19cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:24:53.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.441+0000 7fb06b7fe640 1 --2- 172.21.15.33:0/2251088127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb06c102d40 0x7fb06c1982e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb05c005940 tx=0x7fb05c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:53.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.441+0000 7fb068ff9640 1 -- 172.21.15.33:0/2251088127 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb05c03f030 con 0x7fb06c102d40 2024-09-12T12:24:53.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.441+0000 7fb068ff9640 1 -- 172.21.15.33:0/2251088127 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb05c003aa0 con 0x7fb06c102d40 2024-09-12T12:24:53.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.441+0000 7fb07211c640 1 -- 172.21.15.33:0/2251088127 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb06c19d520 con 0x7fb06c102d40 2024-09-12T12:24:53.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.441+0000 7fb068ff9640 1 -- 172.21.15.33:0/2251088127 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb05c035070 con 0x7fb06c102d40 2024-09-12T12:24:53.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.441+0000 7fb07211c640 1 -- 172.21.15.33:0/2251088127 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb06c1a4e60 con 0x7fb06c102d40 2024-09-12T12:24:53.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.442+0000 7fb07211c640 1 -- 172.21.15.33:0/2251088127 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb06c103120 con 0x7fb06c102d40 2024-09-12T12:24:53.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.443+0000 7fb068ff9640 1 -- 172.21.15.33:0/2251088127 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb05c042030 con 0x7fb06c102d40 2024-09-12T12:24:53.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.444+0000 7fb068ff9640 1 --2- 172.21.15.33:0/2251088127 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb0540a2c90 0x7fb0540a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:53.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.444+0000 7fb06affd640 1 --2- 172.21.15.33:0/2251088127 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb0540a2c90 0x7fb0540a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:53.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.444+0000 7fb068ff9640 1 -- 172.21.15.33:0/2251088127 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7fb05c0efb40 con 0x7fb06c102d40 2024-09-12T12:24:53.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.445+0000 7fb06affd640 1 --2- 172.21.15.33:0/2251088127 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb0540a2c90 0x7fb0540a5150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb06c0feda0 tx=0x7fb06000b360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:53.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.448+0000 7fb068ff9640 1 -- 172.21.15.33:0/2251088127 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb05c0bc700 con 0x7fb06c102d40 2024-09-12T12:24:53.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.625+0000 7fb07211c640 1 -- 172.21.15.33:0/2251088127 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb06c1071e0 con 0x7fb06c102d40 2024-09-12T12:24:53.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.626+0000 7fb068ff9640 1 -- 172.21.15.33:0/2251088127 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+24141 (secure 0 0 0) 0x7fb05c0bc000 con 0x7fb06c102d40 2024-09-12T12:24:53.626 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:24:53.626 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":85,"fsid":"a66dfafc-7100-11ef-bcea-c7b262605968","created":"2024-09-12T12:16:11.904815+0000","modified":"2024-09-12T12:23:55.506385+0000","last_up_change":"2024-09-12T12:22:57.476185+0000","last_in_change":"2024-09-12T12:22:35.192556+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:19:12.296305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:23:42.509774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:23:44.842852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T12:23:51.308720+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"74b68729-c97c-4da6-a659-75d6c147ad05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6803","nonce":963294466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6805","nonce":963294466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6809","nonce":963294466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6807","nonce":963294466}]},"public_addr":"172.21.15.33:6803/963294466","cluster_addr":"172.21.15.33:6805/963294466","heartbeat_back_addr":"172.21.15.33:6809/963294466","heartbeat_front_addr":"172.21.15.33:6807/963294466","state":["exists","up"]},{"osd":1,"uuid":"2461a388-e110-420b-9404-eb54cd39119e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6801","nonce":2306025171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6803","nonce":2306025171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6807","nonce":2306025171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6805","nonce":2306025171}]},"public_addr":"172.21.15.43:6801/2306025171","cluster_addr":"172.21.15.43:6803/2306025171","heartbeat_back_addr":"172.21.15.43:6807/2306025171","heartbeat_front_addr":"172.21.15.43:6805/2306025171","state":["exists","up"]},{"osd":2,"uuid":"4ba9dd02-977d-45fb-b366-ade15b52232b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6801","nonce":4257223217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6803","nonce":4257223217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6807","nonce":4257223217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6805","nonce":4257223217}]},"public_addr":"172.21.15.102:6801/4257223217","cluster_addr":"172.21.15.102:6803/4257223217","heartbeat_back_addr":"172.21.15.102:6807/4257223217","heartbeat_front_addr":"172.21.15.102:6805/4257223217","state":["exists","up"]},{"osd":3,"uuid":"345aa854-9ea2-4103-a186-9794af34c237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6811","nonce":2483872739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6813","nonce":2483872739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6817","nonce":2483872739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6815","nonce":2483872739}]},"public_addr":"172.21.15.33:6811/2483872739","cluster_addr":"172.21.15.33:6813/2483872739","heartbeat_back_addr":"172.21.15.33:6817/2483872739","heartbeat_front_addr":"172.21.15.33:6815/2483872739","state":["exists","up"]},{"osd":4,"uuid":"32acd6da-01d6-4a8e-9d05-3d394363d6f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6809","nonce":136043101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6811","nonce":136043101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6815","nonce":136043101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6813","nonce":136043101}]},"public_addr":"172.21.15.43:6809/136043101","cluster_addr":"172.21.15.43:6811/136043101","heartbeat_back_addr":"172.21.15.43:6815/136043101","heartbeat_front_addr":"172.21.15.43:6813/136043101","state":["exists","up"]},{"osd":5,"uuid":"dced0037-2da2-48c2-a391-f871d6ceebb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6809","nonce":2605625792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6811","nonce":2605625792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6815","nonce":2605625792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6813","nonce":2605625792}]},"public_addr":"172.21.15.102:6809/2605625792","cluster_addr":"172.21.15.102:6811/2605625792","heartbeat_back_addr":"172.21.15.102:6815/2605625792","heartbeat_front_addr":"172.21.15.102:6813/2605625792","state":["exists","up"]},{"osd":6,"uuid":"46e5532e-026a-4bb2-8847-2a3216e5d7a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6819","nonce":805864618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6821","nonce":805864618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6825","nonce":805864618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6823","nonce":805864618}]},"public_addr":"172.21.15.33:6819/805864618","cluster_addr":"172.21.15.33:6821/805864618","heartbeat_back_addr":"172.21.15.33:6825/805864618","heartbeat_front_addr":"172.21.15.33:6823/805864618","state":["exists","up"]},{"osd":7,"uuid":"c8474ab4-68cd-4475-9429-b54981247ee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6817","nonce":392537201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6819","nonce":392537201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6823","nonce":392537201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6821","nonce":392537201}]},"public_addr":"172.21.15.43:6817/392537201","cluster_addr":"172.21.15.43:6819/392537201","heartbeat_back_addr":"172.21.15.43:6823/392537201","heartbeat_front_addr":"172.21.15.43:6821/392537201","state":["exists","up"]},{"osd":8,"uuid":"e7c2ef28-8c84-44d0-ba6d-7556ec1d02dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6817","nonce":1768219597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6819","nonce":1768219597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6823","nonce":1768219597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6821","nonce":1768219597}]},"public_addr":"172.21.15.102:6817/1768219597","cluster_addr":"172.21.15.102:6819/1768219597","heartbeat_back_addr":"172.21.15.102:6823/1768219597","heartbeat_front_addr":"172.21.15.102:6821/1768219597","state":["exists","up"]},{"osd":9,"uuid":"f2500273-8b21-4984-bc41-cec5cc0c883b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6827","nonce":973136168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6829","nonce":973136168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6833","nonce":973136168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6831","nonce":973136168}]},"public_addr":"172.21.15.33:6827/973136168","cluster_addr":"172.21.15.33:6829/973136168","heartbeat_back_addr":"172.21.15.33:6833/973136168","heartbeat_front_addr":"172.21.15.33:6831/973136168","state":["exists","up"]},{"osd":10,"uuid":"954343c5-5d5b-4c30-acde-82aa695f7b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6825","nonce":248515585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6827","nonce":248515585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6831","nonce":248515585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6829","nonce":248515585}]},"public_addr":"172.21.15.43:6825/248515585","cluster_addr":"172.21.15.43:6827/248515585","heartbeat_back_addr":"172.21.15.43:6831/248515585","heartbeat_front_addr":"172.21.15.43:6829/248515585","state":["exists","up"]},{"osd":11,"uuid":"22b4147b-02ad-4514-be17-5bb395099eef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6825","nonce":2463068013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6827","nonce":2463068013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6831","nonce":2463068013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6829","nonce":2463068013}]},"public_addr":"172.21.15.102:6825/2463068013","cluster_addr":"172.21.15.102:6827/2463068013","heartbeat_back_addr":"172.21.15.102:6831/2463068013","heartbeat_front_addr":"172.21.15.102:6829/2463068013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:19.274804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:44.900294+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:08.885404+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:34.382089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:59.978538+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:25.275179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:49.429847+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:14.974792+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:40.268629+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:22:06.458679+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:22:31.813019+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:22:56.264078+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/3187741548":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6800/1381479235":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6801/1156183797":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/2222991013":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6801/1381479235":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6800/1156183797":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/3450458842":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/202580320":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/2441151017":"2024-09-13T12:16:57.792813+0000","172.21.15.33:0/1001176884":"2024-09-13T12:16:33.559150+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:24:53.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.628+0000 7fb07211c640 1 -- 172.21.15.33:0/2251088127 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb0540a2c90 msgr2=0x7fb0540a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:53.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.628+0000 7fb07211c640 1 --2- 172.21.15.33:0/2251088127 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb0540a2c90 0x7fb0540a5150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb06c0feda0 tx=0x7fb06000b360 comp rx=0 tx=0).stop 2024-09-12T12:24:53.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.628+0000 7fb07211c640 1 -- 172.21.15.33:0/2251088127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb06c102d40 msgr2=0x7fb06c1982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:53.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.628+0000 7fb07211c640 1 --2- 172.21.15.33:0/2251088127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb06c102d40 0x7fb06c1982e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb05c005940 tx=0x7fb05c004270 comp rx=0 tx=0).stop 2024-09-12T12:24:53.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.628+0000 7fb07211c640 1 -- 172.21.15.33:0/2251088127 shutdown_connections 2024-09-12T12:24:53.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.628+0000 7fb07211c640 1 --2- 172.21.15.33:0/2251088127 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb0540a2c90 0x7fb0540a5150 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.628+0000 7fb07211c640 1 --2- 172.21.15.33:0/2251088127 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb06c10c170 0x7fb06c19cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.628+0000 7fb07211c640 1 --2- 172.21.15.33:0/2251088127 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb06c103660 0x7fb06c198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.628+0000 7fb07211c640 1 --2- 172.21.15.33:0/2251088127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb06c102d40 0x7fb06c1982e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.628+0000 7fb07211c640 1 -- 172.21.15.33:0/2251088127 >> 172.21.15.33:0/2251088127 conn(0x7fb06c0fc7a0 msgr2=0x7fb06c0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:53.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.629+0000 7fb07211c640 1 -- 172.21.15.33:0/2251088127 shutdown_connections 2024-09-12T12:24:53.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:53.629+0000 7fb07211c640 1 -- 172.21.15.33:0/2251088127 wait complete. 2024-09-12T12:24:54.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:54 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/2251088127' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:24:54.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:54 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/2251088127' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:24:54.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:54 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/2251088127' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:24:54.469 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-12T12:24:54.469 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-12T12:24:54.470 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-12T12:24:54.470 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-12T12:24:54.470 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-12T12:24:54.471 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-12T12:24:54.471 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-12T12:24:54.472 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-12T12:24:54.472 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-12T12:24:54.473 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-12T12:24:54.473 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-12T12:24:54.473 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-12T12:24:55.150 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:55.286 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:55.290 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:55.290 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:55.291 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:55.291 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:55.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:55 smithi043 ceph-mon[34144]: pgmap v313: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-09-12T12:24:55.369 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:55 smithi033 ceph-mon[31246]: pgmap v313: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-09-12T12:24:55.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:55 smithi102 ceph-mon[34799]: pgmap v313: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-09-12T12:24:55.529 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:55.529 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:55.529 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:55.530 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:55.534 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:55.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.790+0000 7fb8b8620640 1 -- 172.21.15.33:0/2357658734 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8b0100e20 msgr2=0x7fb8b0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:55.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.790+0000 7fb8b8620640 1 --2- 172.21.15.33:0/2357658734 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8b0100e20 0x7fb8b0101200 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac009900 tx=0x7fb8ac02a480 comp rx=0 tx=0).stop 2024-09-12T12:24:55.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.790+0000 7fb8b8620640 1 -- 172.21.15.33:0/2357658734 shutdown_connections 2024-09-12T12:24:55.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.790+0000 7fb8b8620640 1 --2- 172.21.15.33:0/2357658734 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8b0102ef0 0x7fb8b010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:55.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.790+0000 7fb8b8620640 1 --2- 172.21.15.33:0/2357658734 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8b0102570 0x7fb8b01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:55.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.790+0000 7fb8b8620640 1 --2- 172.21.15.33:0/2357658734 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8b0100e20 0x7fb8b0101200 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:55.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.790+0000 7fb8b8620640 1 -- 172.21.15.33:0/2357658734 >> 172.21.15.33:0/2357658734 conn(0x7fb8b00fc7d0 msgr2=0x7fb8b00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:55.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.790+0000 7fb8b8620640 1 -- 172.21.15.33:0/2357658734 shutdown_connections 2024-09-12T12:24:55.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.790+0000 7fb8b8620640 1 -- 172.21.15.33:0/2357658734 wait complete. 2024-09-12T12:24:55.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.790+0000 7fb8b8620640 1 Processor -- start 2024-09-12T12:24:55.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.791+0000 7fb8b8620640 1 -- start start 2024-09-12T12:24:55.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.791+0000 7fb8b8620640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8b0100e20 0x7fb8b0103d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:55.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.791+0000 7fb8b8620640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8b0102570 0x7fb8b01042a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:55.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.791+0000 7fb8b8620640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8b0102ef0 0x7fb8b01047e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:55.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.791+0000 7fb8b8620640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b0110e30 con 0x7fb8b0102ef0 2024-09-12T12:24:55.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.791+0000 7fb8b8620640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b0110cb0 con 0x7fb8b0102570 2024-09-12T12:24:55.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.791+0000 7fb8b8620640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b0110fb0 con 0x7fb8b0100e20 2024-09-12T12:24:55.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.791+0000 7fb8b6bbd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8b0102ef0 0x7fb8b01047e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:55.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.791+0000 7fb8b6bbd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8b0102ef0 0x7fb8b01047e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45950/0 (socket says 172.21.15.33:45950) 2024-09-12T12:24:55.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.791+0000 7fb8b6bbd640 1 -- 172.21.15.33:0/3905829302 learned_addr learned my addr 172.21.15.33:0/3905829302 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:24:55.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.791+0000 7fb8b5bbb640 1 --2- 172.21.15.33:0/3905829302 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8b0102570 0x7fb8b01042a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:55.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.791+0000 7fb8b63bc640 1 --2- 172.21.15.33:0/3905829302 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8b0100e20 0x7fb8b0103d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:55.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.791+0000 7fb8b6bbd640 1 -- 172.21.15.33:0/3905829302 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8b0100e20 msgr2=0x7fb8b0103d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:55.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.791+0000 7fb8b6bbd640 1 --2- 172.21.15.33:0/3905829302 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8b0100e20 0x7fb8b0103d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:55.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.791+0000 7fb8b6bbd640 1 -- 172.21.15.33:0/3905829302 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8b0102570 msgr2=0x7fb8b01042a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:55.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.791+0000 7fb8b6bbd640 1 --2- 172.21.15.33:0/3905829302 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8b0102570 0x7fb8b01042a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:55.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.791+0000 7fb8b6bbd640 1 -- 172.21.15.33:0/3905829302 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8b01a68d0 con 0x7fb8b0102ef0 2024-09-12T12:24:55.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.791+0000 7fb8b6bbd640 1 --2- 172.21.15.33:0/3905829302 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8b0102ef0 0x7fb8b01047e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8009fd0 tx=0x7fb8a800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:55.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.792+0000 7fb8a77fe640 1 -- 172.21.15.33:0/3905829302 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8017070 con 0x7fb8b0102ef0 2024-09-12T12:24:55.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.792+0000 7fb8a77fe640 1 -- 172.21.15.33:0/3905829302 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb8a8003e20 con 0x7fb8b0102ef0 2024-09-12T12:24:55.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.792+0000 7fb8b8620640 1 -- 172.21.15.33:0/3905829302 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8b01a6bc0 con 0x7fb8b0102ef0 2024-09-12T12:24:55.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.792+0000 7fb8a77fe640 1 -- 172.21.15.33:0/3905829302 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8010460 con 0x7fb8b0102ef0 2024-09-12T12:24:55.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.792+0000 7fb8b8620640 1 -- 172.21.15.33:0/3905829302 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8b01a70b0 con 0x7fb8b0102ef0 2024-09-12T12:24:55.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.793+0000 7fb8b8620640 1 -- 172.21.15.33:0/3905829302 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb8b00fe380 con 0x7fb8b0102ef0 2024-09-12T12:24:55.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.794+0000 7fb8a77fe640 1 -- 172.21.15.33:0/3905829302 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb8a8003970 con 0x7fb8b0102ef0 2024-09-12T12:24:55.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.795+0000 7fb8a77fe640 1 --2- 172.21.15.33:0/3905829302 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb89c0a2c10 0x7fb89c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:55.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.795+0000 7fb8b63bc640 1 --2- 172.21.15.33:0/3905829302 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb89c0a2c10 0x7fb89c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:55.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.795+0000 7fb8a77fe640 1 -- 172.21.15.33:0/3905829302 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7fb8a80cf520 con 0x7fb8b0102ef0 2024-09-12T12:24:55.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.795+0000 7fb8a77fe640 1 --2- 172.21.15.33:0/3905829302 >> [v2:172.21.15.33:6802/963294466,v1:172.21.15.33:6803/963294466] conn(0x7fb89c0ad930 0x7fb89c0afd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:55.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.795+0000 7fb8a77fe640 1 -- 172.21.15.33:0/3905829302 --> [v2:172.21.15.33:6802/963294466,v1:172.21.15.33:6803/963294466] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb8a8018ec0 con 0x7fb89c0ad930 2024-09-12T12:24:55.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.795+0000 7fb8a77fe640 1 -- 172.21.15.33:0/3905829302 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7fb8a80cf8d0 con 0x7fb8b0102ef0 2024-09-12T12:24:55.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.795+0000 7fb8b5bbb640 1 --2- 172.21.15.33:0/3905829302 >> [v2:172.21.15.33:6802/963294466,v1:172.21.15.33:6803/963294466] conn(0x7fb89c0ad930 0x7fb89c0afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:55.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.795+0000 7fb8b63bc640 1 --2- 172.21.15.33:0/3905829302 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb89c0a2c10 0x7fb89c0a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac009230 tx=0x7fb8ac0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:55.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.795+0000 7fb8b5bbb640 1 --2- 172.21.15.33:0/3905829302 >> [v2:172.21.15.33:6802/963294466,v1:172.21.15.33:6803/963294466] conn(0x7fb89c0ad930 0x7fb89c0afd70 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:55.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.796+0000 7fb8a77fe640 1 -- 172.21.15.33:0/3905829302 <== osd.0 v2:172.21.15.33:6802/963294466 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb8a8018ec0 con 0x7fb89c0ad930 2024-09-12T12:24:55.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.810+0000 7fb8b8620640 1 -- 172.21.15.33:0/3905829302 --> [v2:172.21.15.33:6802/963294466,v1:172.21.15.33:6803/963294466] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb8b01021b0 con 0x7fb89c0ad930 2024-09-12T12:24:55.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.810+0000 7fb8a77fe640 1 -- 172.21.15.33:0/3905829302 <== osd.0 v2:172.21.15.33:6802/963294466 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb8b01021b0 con 0x7fb89c0ad930 2024-09-12T12:24:55.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.811+0000 7fb8b8620640 1 -- 172.21.15.33:0/3905829302 >> [v2:172.21.15.33:6802/963294466,v1:172.21.15.33:6803/963294466] conn(0x7fb89c0ad930 msgr2=0x7fb89c0afd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:55.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.811+0000 7fb8b8620640 1 --2- 172.21.15.33:0/3905829302 >> [v2:172.21.15.33:6802/963294466,v1:172.21.15.33:6803/963294466] conn(0x7fb89c0ad930 0x7fb89c0afd70 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:55.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.811+0000 7fb8b8620640 1 -- 172.21.15.33:0/3905829302 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb89c0a2c10 msgr2=0x7fb89c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:55.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.811+0000 7fb8b8620640 1 --2- 172.21.15.33:0/3905829302 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb89c0a2c10 0x7fb89c0a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac009230 tx=0x7fb8ac0058d0 comp rx=0 tx=0).stop 2024-09-12T12:24:55.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.811+0000 7fb8b8620640 1 -- 172.21.15.33:0/3905829302 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8b0102ef0 msgr2=0x7fb8b01047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:55.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.811+0000 7fb8b8620640 1 --2- 172.21.15.33:0/3905829302 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8b0102ef0 0x7fb8b01047e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8009fd0 tx=0x7fb8a800b260 comp rx=0 tx=0).stop 2024-09-12T12:24:55.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.811+0000 7fb8b6bbd640 1 -- 172.21.15.33:0/3905829302 reap_dead start 2024-09-12T12:24:55.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.811+0000 7fb8b8620640 1 -- 172.21.15.33:0/3905829302 shutdown_connections 2024-09-12T12:24:55.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.811+0000 7fb8b8620640 1 -- 172.21.15.33:0/3905829302 >> 172.21.15.33:0/3905829302 conn(0x7fb8b00fc7d0 msgr2=0x7fb8b0106040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:55.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.811+0000 7fb8b8620640 1 -- 172.21.15.33:0/3905829302 shutdown_connections 2024-09-12T12:24:55.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:55.811+0000 7fb8b8620640 1 -- 172.21.15.33:0/3905829302 wait complete. 2024-09-12T12:24:56.510 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:24:57.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.158+0000 7fa5418a4640 1 -- 172.21.15.33:0/860764743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa53c102790 msgr2=0x7fa53c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:57.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.158+0000 7fa5418a4640 1 --2- 172.21.15.33:0/860764743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa53c102790 0x7fa53c1067e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa530009900 tx=0x7fa53002a410 comp rx=0 tx=0).stop 2024-09-12T12:24:57.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.158+0000 7fa5418a4640 1 -- 172.21.15.33:0/860764743 shutdown_connections 2024-09-12T12:24:57.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.158+0000 7fa5418a4640 1 --2- 172.21.15.33:0/860764743 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa53c106f10 0x7fa53c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:57.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.158+0000 7fa5418a4640 1 --2- 172.21.15.33:0/860764743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa53c102790 0x7fa53c1067e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:57.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.158+0000 7fa5418a4640 1 --2- 172.21.15.33:0/860764743 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa53c101de0 0x7fa53c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:57.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.158+0000 7fa5418a4640 1 -- 172.21.15.33:0/860764743 >> 172.21.15.33:0/860764743 conn(0x7fa53c0fd8c0 msgr2=0x7fa53c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:57.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.159+0000 7fa5418a4640 1 -- 172.21.15.33:0/860764743 shutdown_connections 2024-09-12T12:24:57.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.159+0000 7fa5418a4640 1 -- 172.21.15.33:0/860764743 wait complete. 2024-09-12T12:24:57.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.159+0000 7fa5418a4640 1 Processor -- start 2024-09-12T12:24:57.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.159+0000 7fa5418a4640 1 -- start start 2024-09-12T12:24:57.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.160+0000 7fa5418a4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa53c101de0 0x7fa53c19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:57.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.160+0000 7fa5418a4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa53c102790 0x7fa53c19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:57.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.160+0000 7fa5418a4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa53c106f10 0x7fa53c19eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:57.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.160+0000 7fa5418a4640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa53c111e20 con 0x7fa53c101de0 2024-09-12T12:24:57.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.160+0000 7fa5418a4640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa53c111ca0 con 0x7fa53c106f10 2024-09-12T12:24:57.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.160+0000 7fa5418a4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa53c111fa0 con 0x7fa53c102790 2024-09-12T12:24:57.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.160+0000 7fa53affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa53c101de0 0x7fa53c19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:57.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.160+0000 7fa53affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa53c101de0 0x7fa53c19a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45970/0 (socket says 172.21.15.33:45970) 2024-09-12T12:24:57.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.160+0000 7fa53affd640 1 -- 172.21.15.33:0/2508673378 learned_addr learned my addr 172.21.15.33:0/2508673378 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:24:57.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.160+0000 7fa53a7fc640 1 --2- 172.21.15.33:0/2508673378 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa53c102790 0x7fa53c19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:57.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.160+0000 7fa53b7fe640 1 --2- 172.21.15.33:0/2508673378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa53c106f10 0x7fa53c19eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:57.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.160+0000 7fa53affd640 1 -- 172.21.15.33:0/2508673378 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa53c102790 msgr2=0x7fa53c19ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:57.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.160+0000 7fa53affd640 1 --2- 172.21.15.33:0/2508673378 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa53c102790 0x7fa53c19ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:57.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.160+0000 7fa53affd640 1 -- 172.21.15.33:0/2508673378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa53c106f10 msgr2=0x7fa53c19eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:57.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.160+0000 7fa53affd640 1 --2- 172.21.15.33:0/2508673378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa53c106f10 0x7fa53c19eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:57.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.160+0000 7fa53affd640 1 -- 172.21.15.33:0/2508673378 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa53c19f5b0 con 0x7fa53c101de0 2024-09-12T12:24:57.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.160+0000 7fa53b7fe640 1 --2- 172.21.15.33:0/2508673378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa53c106f10 0x7fa53c19eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:24:57.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.160+0000 7fa53affd640 1 --2- 172.21.15.33:0/2508673378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa53c101de0 0x7fa53c19a600 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa52c00e9f0 tx=0x7fa52c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:57.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.160+0000 7fa5408a2640 1 -- 172.21.15.33:0/2508673378 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52c00cd80 con 0x7fa53c101de0 2024-09-12T12:24:57.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.161+0000 7fa5418a4640 1 -- 172.21.15.33:0/2508673378 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa53c19f8a0 con 0x7fa53c101de0 2024-09-12T12:24:57.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.161+0000 7fa5408a2640 1 -- 172.21.15.33:0/2508673378 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa52c0054d0 con 0x7fa53c101de0 2024-09-12T12:24:57.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.161+0000 7fa5408a2640 1 -- 172.21.15.33:0/2508673378 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52c010490 con 0x7fa53c101de0 2024-09-12T12:24:57.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.161+0000 7fa5418a4640 1 -- 172.21.15.33:0/2508673378 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa53c1a7180 con 0x7fa53c101de0 2024-09-12T12:24:57.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.162+0000 7fa5418a4640 1 -- 172.21.15.33:0/2508673378 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa53c10e0f0 con 0x7fa53c101de0 2024-09-12T12:24:57.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.163+0000 7fa5408a2640 1 -- 172.21.15.33:0/2508673378 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa52c005020 con 0x7fa53c101de0 2024-09-12T12:24:57.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.164+0000 7fa5408a2640 1 --2- 172.21.15.33:0/2508673378 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fa5240a2c10 0x7fa5240a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:57.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.164+0000 7fa53a7fc640 1 --2- 172.21.15.33:0/2508673378 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fa5240a2c10 0x7fa5240a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:57.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.164+0000 7fa5408a2640 1 -- 172.21.15.33:0/2508673378 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7fa52c0cff70 con 0x7fa53c101de0 2024-09-12T12:24:57.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.164+0000 7fa5408a2640 1 --2- 172.21.15.33:0/2508673378 >> [v2:172.21.15.33:6818/805864618,v1:172.21.15.33:6819/805864618] conn(0x7fa5240ad940 0x7fa5240afd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:57.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.164+0000 7fa5408a2640 1 -- 172.21.15.33:0/2508673378 --> [v2:172.21.15.33:6818/805864618,v1:172.21.15.33:6819/805864618] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa5240b0450 con 0x7fa5240ad940 2024-09-12T12:24:57.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.164+0000 7fa5408a2640 1 -- 172.21.15.33:0/2508673378 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7fa52c0d0320 con 0x7fa53c101de0 2024-09-12T12:24:57.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.164+0000 7fa53b7fe640 1 --2- 172.21.15.33:0/2508673378 >> [v2:172.21.15.33:6818/805864618,v1:172.21.15.33:6819/805864618] conn(0x7fa5240ad940 0x7fa5240afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:57.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.164+0000 7fa53a7fc640 1 --2- 172.21.15.33:0/2508673378 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fa5240a2c10 0x7fa5240a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa530031440 tx=0x7fa5300095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:57.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.165+0000 7fa53b7fe640 1 --2- 172.21.15.33:0/2508673378 >> [v2:172.21.15.33:6818/805864618,v1:172.21.15.33:6819/805864618] conn(0x7fa5240ad940 0x7fa5240afd80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:57.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.165+0000 7fa5408a2640 1 -- 172.21.15.33:0/2508673378 <== osd.6 v2:172.21.15.33:6818/805864618 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa5240b0450 con 0x7fa5240ad940 2024-09-12T12:24:57.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.179+0000 7fa5418a4640 1 -- 172.21.15.33:0/2508673378 --> [v2:172.21.15.33:6818/805864618,v1:172.21.15.33:6819/805864618] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa53c1032c0 con 0x7fa5240ad940 2024-09-12T12:24:57.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.179+0000 7fa5408a2640 1 -- 172.21.15.33:0/2508673378 <== osd.6 v2:172.21.15.33:6818/805864618 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa53c1032c0 con 0x7fa5240ad940 2024-09-12T12:24:57.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.179+0000 7fa5418a4640 1 -- 172.21.15.33:0/2508673378 >> [v2:172.21.15.33:6818/805864618,v1:172.21.15.33:6819/805864618] conn(0x7fa5240ad940 msgr2=0x7fa5240afd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:57.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.179+0000 7fa5418a4640 1 --2- 172.21.15.33:0/2508673378 >> [v2:172.21.15.33:6818/805864618,v1:172.21.15.33:6819/805864618] conn(0x7fa5240ad940 0x7fa5240afd80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:57.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.180+0000 7fa5418a4640 1 -- 172.21.15.33:0/2508673378 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fa5240a2c10 msgr2=0x7fa5240a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:57.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.180+0000 7fa5418a4640 1 --2- 172.21.15.33:0/2508673378 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fa5240a2c10 0x7fa5240a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa530031440 tx=0x7fa5300095f0 comp rx=0 tx=0).stop 2024-09-12T12:24:57.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.180+0000 7fa5418a4640 1 -- 172.21.15.33:0/2508673378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa53c101de0 msgr2=0x7fa53c19a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:57.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.180+0000 7fa5418a4640 1 --2- 172.21.15.33:0/2508673378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa53c101de0 0x7fa53c19a600 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa52c00e9f0 tx=0x7fa52c00edf0 comp rx=0 tx=0).stop 2024-09-12T12:24:57.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.180+0000 7fa53b7fe640 1 -- 172.21.15.33:0/2508673378 reap_dead start 2024-09-12T12:24:57.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.180+0000 7fa5418a4640 1 -- 172.21.15.33:0/2508673378 shutdown_connections 2024-09-12T12:24:57.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.180+0000 7fa5418a4640 1 -- 172.21.15.33:0/2508673378 >> 172.21.15.33:0/2508673378 conn(0x7fa53c0fd8c0 msgr2=0x7fa53c0fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:57.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.180+0000 7fa5418a4640 1 -- 172.21.15.33:0/2508673378 shutdown_connections 2024-09-12T12:24:57.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.180+0000 7fa5418a4640 1 -- 172.21.15.33:0/2508673378 wait complete. 2024-09-12T12:24:57.259 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:57 smithi033 ceph-mon[31246]: pgmap v314: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-12T12:24:57.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:57 smithi043 ceph-mon[34144]: pgmap v314: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-12T12:24:57.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:57 smithi102 ceph-mon[34799]: pgmap v314: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-12T12:24:57.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.462+0000 7efff7178640 1 -- 172.21.15.33:0/2714060800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efff0101410 msgr2=0x7efff010d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:57.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.462+0000 7efff7178640 1 --2- 172.21.15.33:0/2714060800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efff0101410 0x7efff010d940 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7effe8009cd0 tx=0x7effe802a8e0 comp rx=0 tx=0).stop 2024-09-12T12:24:57.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.462+0000 7efff7178640 1 -- 172.21.15.33:0/2714060800 shutdown_connections 2024-09-12T12:24:57.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.462+0000 7efff7178640 1 --2- 172.21.15.33:0/2714060800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efff0101410 0x7efff010d940 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:57.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.462+0000 7efff7178640 1 --2- 172.21.15.33:0/2714060800 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efff0100a70 0x7efff0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:57.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.462+0000 7efff7178640 1 --2- 172.21.15.33:0/2714060800 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efff0106a70 0x7efff0106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:57.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.462+0000 7efff7178640 1 -- 172.21.15.33:0/2714060800 >> 172.21.15.33:0/2714060800 conn(0x7efff00fc790 msgr2=0x7efff00febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:57.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.462+0000 7efff7178640 1 -- 172.21.15.33:0/2714060800 shutdown_connections 2024-09-12T12:24:57.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.462+0000 7efff7178640 1 -- 172.21.15.33:0/2714060800 wait complete. 2024-09-12T12:24:57.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.463+0000 7efff7178640 1 Processor -- start 2024-09-12T12:24:57.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.463+0000 7efff7178640 1 -- start start 2024-09-12T12:24:57.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.463+0000 7efff7178640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efff0100a70 0x7efff0198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:57.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.463+0000 7efff7178640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efff0101410 0x7efff01987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:57.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.463+0000 7efff7178640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efff0106a70 0x7efff019cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:57.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.463+0000 7efff7178640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7efff0110d20 con 0x7efff0101410 2024-09-12T12:24:57.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.463+0000 7efff7178640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7efff0110ba0 con 0x7efff0100a70 2024-09-12T12:24:57.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.463+0000 7efff7178640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7efff0110ea0 con 0x7efff0106a70 2024-09-12T12:24:57.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.463+0000 7effeffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efff0101410 0x7efff01987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:57.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.463+0000 7effeffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efff0101410 0x7efff01987c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45986/0 (socket says 172.21.15.33:45986) 2024-09-12T12:24:57.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.463+0000 7effeffff640 1 -- 172.21.15.33:0/1114817720 learned_addr learned my addr 172.21.15.33:0/1114817720 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:24:57.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.463+0000 7efff4f14640 1 --2- 172.21.15.33:0/1114817720 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efff0100a70 0x7efff0198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:57.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.463+0000 7efff5715640 1 --2- 172.21.15.33:0/1114817720 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efff0106a70 0x7efff019cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:57.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.463+0000 7effeffff640 1 -- 172.21.15.33:0/1114817720 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efff0106a70 msgr2=0x7efff019cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:57.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.463+0000 7effeffff640 1 --2- 172.21.15.33:0/1114817720 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efff0106a70 0x7efff019cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:57.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.463+0000 7effeffff640 1 -- 172.21.15.33:0/1114817720 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efff0100a70 msgr2=0x7efff0198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:57.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.463+0000 7effeffff640 1 --2- 172.21.15.33:0/1114817720 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efff0100a70 0x7efff0198280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:57.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.463+0000 7effeffff640 1 -- 172.21.15.33:0/1114817720 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efff019d230 con 0x7efff0101410 2024-09-12T12:24:57.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.464+0000 7effeffff640 1 --2- 172.21.15.33:0/1114817720 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efff0101410 0x7efff01987c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7effdc00c920 tx=0x7effdc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:57.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.464+0000 7effedffb640 1 -- 172.21.15.33:0/1114817720 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effdc007c70 con 0x7efff0101410 2024-09-12T12:24:57.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.464+0000 7efff7178640 1 -- 172.21.15.33:0/1114817720 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efff019d520 con 0x7efff0101410 2024-09-12T12:24:57.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.464+0000 7effedffb640 1 -- 172.21.15.33:0/1114817720 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7effdc007e10 con 0x7efff0101410 2024-09-12T12:24:57.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.464+0000 7effedffb640 1 -- 172.21.15.33:0/1114817720 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effdc018820 con 0x7efff0101410 2024-09-12T12:24:57.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.464+0000 7efff7178640 1 -- 172.21.15.33:0/1114817720 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efff01a4e00 con 0x7efff0101410 2024-09-12T12:24:57.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.465+0000 7efff7178640 1 -- 172.21.15.33:0/1114817720 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efff0062980 con 0x7efff0101410 2024-09-12T12:24:57.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.466+0000 7effedffb640 1 -- 172.21.15.33:0/1114817720 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7effdc0189c0 con 0x7efff0101410 2024-09-12T12:24:57.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.467+0000 7effedffb640 1 --2- 172.21.15.33:0/1114817720 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7effe00a2c10 0x7effe00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:57.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.467+0000 7effedffb640 1 -- 172.21.15.33:0/1114817720 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7effdc0cf630 con 0x7efff0101410 2024-09-12T12:24:57.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.467+0000 7efff4f14640 1 --2- 172.21.15.33:0/1114817720 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7effe00a2c10 0x7effe00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:57.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.467+0000 7effedffb640 1 --2- 172.21.15.33:0/1114817720 >> [v2:172.21.15.43:6808/136043101,v1:172.21.15.43:6809/136043101] conn(0x7effe00ad940 0x7effe00afd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:57.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.467+0000 7effedffb640 1 -- 172.21.15.33:0/1114817720 --> [v2:172.21.15.43:6808/136043101,v1:172.21.15.43:6809/136043101] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7effdc012ec0 con 0x7effe00ad940 2024-09-12T12:24:57.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.467+0000 7effedffb640 1 -- 172.21.15.33:0/1114817720 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7effdc0d6050 con 0x7efff0101410 2024-09-12T12:24:57.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.468+0000 7efff4f14640 1 --2- 172.21.15.33:0/1114817720 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7effe00a2c10 0x7effe00a50d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7effe4009ae0 tx=0x7effe4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:57.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.468+0000 7efff5715640 1 --2- 172.21.15.33:0/1114817720 >> [v2:172.21.15.43:6808/136043101,v1:172.21.15.43:6809/136043101] conn(0x7effe00ad940 0x7effe00afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:57.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.468+0000 7efff5715640 1 --2- 172.21.15.33:0/1114817720 >> [v2:172.21.15.43:6808/136043101,v1:172.21.15.43:6809/136043101] conn(0x7effe00ad940 0x7effe00afd80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:57.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.469+0000 7effedffb640 1 -- 172.21.15.33:0/1114817720 <== osd.4 v2:172.21.15.43:6808/136043101 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7effdc012ec0 con 0x7effe00ad940 2024-09-12T12:24:57.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.494+0000 7efff7178640 1 -- 172.21.15.33:0/1114817720 --> [v2:172.21.15.43:6808/136043101,v1:172.21.15.43:6809/136043101] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efff0062e00 con 0x7effe00ad940 2024-09-12T12:24:57.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.495+0000 7effedffb640 1 -- 172.21.15.33:0/1114817720 <== osd.4 v2:172.21.15.43:6808/136043101 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7efff0062e00 con 0x7effe00ad940 2024-09-12T12:24:57.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.495+0000 7efff7178640 1 -- 172.21.15.33:0/1114817720 >> [v2:172.21.15.43:6808/136043101,v1:172.21.15.43:6809/136043101] conn(0x7effe00ad940 msgr2=0x7effe00afd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:57.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.495+0000 7efff7178640 1 --2- 172.21.15.33:0/1114817720 >> [v2:172.21.15.43:6808/136043101,v1:172.21.15.43:6809/136043101] conn(0x7effe00ad940 0x7effe00afd80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:57.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.495+0000 7efff7178640 1 -- 172.21.15.33:0/1114817720 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7effe00a2c10 msgr2=0x7effe00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:57.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.495+0000 7efff7178640 1 --2- 172.21.15.33:0/1114817720 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7effe00a2c10 0x7effe00a50d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7effe4009ae0 tx=0x7effe4005f90 comp rx=0 tx=0).stop 2024-09-12T12:24:57.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.495+0000 7efff7178640 1 -- 172.21.15.33:0/1114817720 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efff0101410 msgr2=0x7efff01987c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:57.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.495+0000 7efff7178640 1 --2- 172.21.15.33:0/1114817720 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efff0101410 0x7efff01987c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7effdc00c920 tx=0x7effdc00cde0 comp rx=0 tx=0).stop 2024-09-12T12:24:57.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.495+0000 7efff5715640 1 -- 172.21.15.33:0/1114817720 reap_dead start 2024-09-12T12:24:57.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.496+0000 7efff7178640 1 -- 172.21.15.33:0/1114817720 shutdown_connections 2024-09-12T12:24:57.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.496+0000 7efff7178640 1 -- 172.21.15.33:0/1114817720 >> 172.21.15.33:0/1114817720 conn(0x7efff00fc790 msgr2=0x7efff006aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:57.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.496+0000 7efff7178640 1 -- 172.21.15.33:0/1114817720 shutdown_connections 2024-09-12T12:24:57.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:57.496+0000 7efff7178640 1 -- 172.21.15.33:0/1114817720 wait complete. 2024-09-12T12:24:58.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.203+0000 7f8da178e640 1 -- 172.21.15.33:0/3117377628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d9c102ef0 msgr2=0x7f8d9c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:58.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.203+0000 7f8da178e640 1 --2- 172.21.15.33:0/3117377628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d9c102ef0 0x7f8d9c10da40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8d94009ca0 tx=0x7f8d9402a950 comp rx=0 tx=0).stop 2024-09-12T12:24:58.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.203+0000 7f8da178e640 1 -- 172.21.15.33:0/3117377628 shutdown_connections 2024-09-12T12:24:58.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.203+0000 7f8da178e640 1 --2- 172.21.15.33:0/3117377628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d9c102ef0 0x7f8d9c10da40 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:58.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.203+0000 7f8da178e640 1 --2- 172.21.15.33:0/3117377628 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d9c102570 0x7f8d9c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:58.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.203+0000 7f8da178e640 1 --2- 172.21.15.33:0/3117377628 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d9c100e20 0x7f8d9c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:58.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.203+0000 7f8da178e640 1 -- 172.21.15.33:0/3117377628 >> 172.21.15.33:0/3117377628 conn(0x7f8d9c0fc7d0 msgr2=0x7f8d9c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:58.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.203+0000 7f8da178e640 1 -- 172.21.15.33:0/3117377628 shutdown_connections 2024-09-12T12:24:58.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.203+0000 7f8da178e640 1 -- 172.21.15.33:0/3117377628 wait complete. 2024-09-12T12:24:58.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.204+0000 7f8da178e640 1 Processor -- start 2024-09-12T12:24:58.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.204+0000 7f8da178e640 1 -- start start 2024-09-12T12:24:58.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.204+0000 7f8da178e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d9c100e20 0x7f8d9c198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:58.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.204+0000 7f8da178e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d9c102570 0x7f8d9c1988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:58.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.204+0000 7f8da178e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d9c102ef0 0x7f8d9c19cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:58.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.204+0000 7f8da178e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8d9c110e30 con 0x7f8d9c100e20 2024-09-12T12:24:58.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.204+0000 7f8da178e640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8d9c110cb0 con 0x7f8d9c102ef0 2024-09-12T12:24:58.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.204+0000 7f8da178e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8d9c110fb0 con 0x7f8d9c102570 2024-09-12T12:24:58.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.205+0000 7f8d9affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d9c100e20 0x7f8d9c198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:58.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.205+0000 7f8d9affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d9c100e20 0x7f8d9c198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46000/0 (socket says 172.21.15.33:46000) 2024-09-12T12:24:58.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.205+0000 7f8d9affd640 1 -- 172.21.15.33:0/1448367345 learned_addr learned my addr 172.21.15.33:0/1448367345 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:24:58.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.205+0000 7f8d93fff640 1 --2- 172.21.15.33:0/1448367345 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d9c102570 0x7f8d9c1988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:58.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.205+0000 7f8d9affd640 1 -- 172.21.15.33:0/1448367345 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d9c102570 msgr2=0x7f8d9c1988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:58.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.205+0000 7f8d9affd640 1 --2- 172.21.15.33:0/1448367345 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d9c102570 0x7f8d9c1988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:58.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.205+0000 7f8d9b7fe640 1 --2- 172.21.15.33:0/1448367345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d9c102ef0 0x7f8d9c19cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:58.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.205+0000 7f8d9affd640 1 -- 172.21.15.33:0/1448367345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d9c102ef0 msgr2=0x7f8d9c19cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:58.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.205+0000 7f8d9affd640 1 --2- 172.21.15.33:0/1448367345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d9c102ef0 0x7f8d9c19cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:58.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.205+0000 7f8d9affd640 1 -- 172.21.15.33:0/1448367345 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d9c19d310 con 0x7f8d9c100e20 2024-09-12T12:24:58.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.205+0000 7f8d9affd640 1 --2- 172.21.15.33:0/1448367345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d9c100e20 0x7f8d9c198360 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c00e9f0 tx=0x7f8d8c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:58.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.205+0000 7f8d98ff9640 1 -- 172.21.15.33:0/1448367345 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c00cd80 con 0x7f8d9c100e20 2024-09-12T12:24:58.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.205+0000 7f8da178e640 1 -- 172.21.15.33:0/1448367345 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d9c19d600 con 0x7f8d9c100e20 2024-09-12T12:24:58.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.205+0000 7f8d98ff9640 1 -- 172.21.15.33:0/1448367345 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8d8c0108e0 con 0x7f8d9c100e20 2024-09-12T12:24:58.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.205+0000 7f8d98ff9640 1 -- 172.21.15.33:0/1448367345 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c018920 con 0x7f8d9c100e20 2024-09-12T12:24:58.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.205+0000 7f8da178e640 1 -- 172.21.15.33:0/1448367345 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d9c1a4ee0 con 0x7f8d9c100e20 2024-09-12T12:24:58.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.206+0000 7f8da178e640 1 -- 172.21.15.33:0/1448367345 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8d9c062980 con 0x7f8d9c100e20 2024-09-12T12:24:58.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.209+0000 7f8d98ff9640 1 -- 172.21.15.33:0/1448367345 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f8d8c010a90 con 0x7f8d9c100e20 2024-09-12T12:24:58.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.209+0000 7f8d98ff9640 1 --2- 172.21.15.33:0/1448367345 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f8d880a2c10 0x7f8d880a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:58.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.209+0000 7f8d98ff9640 1 -- 172.21.15.33:0/1448367345 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f8d8c0d0140 con 0x7f8d9c100e20 2024-09-12T12:24:58.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.209+0000 7f8d93fff640 1 --2- 172.21.15.33:0/1448367345 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f8d880a2c10 0x7f8d880a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:58.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.210+0000 7f8d98ff9640 1 --2- 172.21.15.33:0/1448367345 >> [v2:172.21.15.102:6824/2463068013,v1:172.21.15.102:6825/2463068013] conn(0x7f8d880adde0 0x7f8d880b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:58.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.210+0000 7f8d98ff9640 1 -- 172.21.15.33:0/1448367345 --> [v2:172.21.15.102:6824/2463068013,v1:172.21.15.102:6825/2463068013] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8d8c01bec0 con 0x7f8d880adde0 2024-09-12T12:24:58.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.210+0000 7f8d98ff9640 1 -- 172.21.15.33:0/1448367345 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f8d8c0d0590 con 0x7f8d9c100e20 2024-09-12T12:24:58.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.210+0000 7f8d93fff640 1 --2- 172.21.15.33:0/1448367345 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f8d880a2c10 0x7f8d880a50d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c100010 tx=0x7f8d8400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:58.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.210+0000 7f8d9b7fe640 1 --2- 172.21.15.33:0/1448367345 >> [v2:172.21.15.102:6824/2463068013,v1:172.21.15.102:6825/2463068013] conn(0x7f8d880adde0 0x7f8d880b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:58.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.210+0000 7f8d9b7fe640 1 --2- 172.21.15.33:0/1448367345 >> [v2:172.21.15.102:6824/2463068013,v1:172.21.15.102:6825/2463068013] conn(0x7f8d880adde0 0x7f8d880b0280 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:58.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.211+0000 7f8d98ff9640 1 -- 172.21.15.33:0/1448367345 <== osd.11 v2:172.21.15.102:6824/2463068013 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8d8c01bec0 con 0x7f8d880adde0 2024-09-12T12:24:58.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.225+0000 7f8da178e640 1 -- 172.21.15.33:0/1448367345 --> [v2:172.21.15.102:6824/2463068013,v1:172.21.15.102:6825/2463068013] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8d9c062db0 con 0x7f8d880adde0 2024-09-12T12:24:58.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.226+0000 7f8d98ff9640 1 -- 172.21.15.33:0/1448367345 <== osd.11 v2:172.21.15.102:6824/2463068013 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8d9c062db0 con 0x7f8d880adde0 2024-09-12T12:24:58.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.226+0000 7f8da178e640 1 -- 172.21.15.33:0/1448367345 >> [v2:172.21.15.102:6824/2463068013,v1:172.21.15.102:6825/2463068013] conn(0x7f8d880adde0 msgr2=0x7f8d880b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:58.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.226+0000 7f8da178e640 1 --2- 172.21.15.33:0/1448367345 >> [v2:172.21.15.102:6824/2463068013,v1:172.21.15.102:6825/2463068013] conn(0x7f8d880adde0 0x7f8d880b0280 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:58.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.226+0000 7f8da178e640 1 -- 172.21.15.33:0/1448367345 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f8d880a2c10 msgr2=0x7f8d880a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:58.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.226+0000 7f8da178e640 1 --2- 172.21.15.33:0/1448367345 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f8d880a2c10 0x7f8d880a50d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c100010 tx=0x7f8d8400b390 comp rx=0 tx=0).stop 2024-09-12T12:24:58.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.226+0000 7f8da178e640 1 -- 172.21.15.33:0/1448367345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d9c100e20 msgr2=0x7f8d9c198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:58.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.226+0000 7f8da178e640 1 --2- 172.21.15.33:0/1448367345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d9c100e20 0x7f8d9c198360 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c00e9f0 tx=0x7f8d8c00eeb0 comp rx=0 tx=0).stop 2024-09-12T12:24:58.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.226+0000 7f8d9b7fe640 1 -- 172.21.15.33:0/1448367345 reap_dead start 2024-09-12T12:24:58.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.226+0000 7f8da178e640 1 -- 172.21.15.33:0/1448367345 shutdown_connections 2024-09-12T12:24:58.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.226+0000 7f8da178e640 1 -- 172.21.15.33:0/1448367345 >> 172.21.15.33:0/1448367345 conn(0x7f8d9c0fc7d0 msgr2=0x7f8d9c06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:58.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.226+0000 7f8da178e640 1 -- 172.21.15.33:0/1448367345 shutdown_connections 2024-09-12T12:24:58.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.226+0000 7f8da178e640 1 -- 172.21.15.33:0/1448367345 wait complete. 2024-09-12T12:24:58.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:58 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]: dispatch 2024-09-12T12:24:58.397 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:58 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]: dispatch 2024-09-12T12:24:58.397 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:58 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-09-12T12:24:58.397 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:58 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-09-12T12:24:58.397 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:58 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-09-12T12:24:58.398 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:58 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]: dispatch 2024-09-12T12:24:58.399 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:58 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2024-09-12T12:24:58.399 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:58 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [5, 10]}]: dispatch 2024-09-12T12:24:58.399 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:58 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]: dispatch 2024-09-12T12:24:58.400 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:58 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]: dispatch 2024-09-12T12:24:58.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:58 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]: dispatch 2024-09-12T12:24:58.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:58 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]: dispatch 2024-09-12T12:24:58.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:58 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-09-12T12:24:58.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:58 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-09-12T12:24:58.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:58 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-09-12T12:24:58.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:58 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]: dispatch 2024-09-12T12:24:58.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:58 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2024-09-12T12:24:58.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:58 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [5, 10]}]: dispatch 2024-09-12T12:24:58.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:58 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]: dispatch 2024-09-12T12:24:58.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:58 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]: dispatch 2024-09-12T12:24:58.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:58 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]: dispatch 2024-09-12T12:24:58.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:58 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]: dispatch 2024-09-12T12:24:58.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:58 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-09-12T12:24:58.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:58 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-09-12T12:24:58.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:58 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-09-12T12:24:58.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:58 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]: dispatch 2024-09-12T12:24:58.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:58 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2024-09-12T12:24:58.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:58 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [5, 10]}]: dispatch 2024-09-12T12:24:58.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:58 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]: dispatch 2024-09-12T12:24:58.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:58 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]: dispatch 2024-09-12T12:24:58.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.595+0000 7f5f347be640 1 -- 172.21.15.33:0/3255244275 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f2c102d40 msgr2=0x7f5f2c103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:58.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.595+0000 7f5f347be640 1 --2- 172.21.15.33:0/3255244275 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f2c102d40 0x7f5f2c103120 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5f28009900 tx=0x7f5f2802a480 comp rx=0 tx=0).stop 2024-09-12T12:24:58.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.595+0000 7f5f347be640 1 -- 172.21.15.33:0/3255244275 shutdown_connections 2024-09-12T12:24:58.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.595+0000 7f5f347be640 1 --2- 172.21.15.33:0/3255244275 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f2c10c170 0x7f5f2c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:58.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.595+0000 7f5f347be640 1 --2- 172.21.15.33:0/3255244275 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f2c103660 0x7f5f2c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:58.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.595+0000 7f5f347be640 1 --2- 172.21.15.33:0/3255244275 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f2c102d40 0x7f5f2c103120 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:58.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.595+0000 7f5f347be640 1 -- 172.21.15.33:0/3255244275 >> 172.21.15.33:0/3255244275 conn(0x7f5f2c0fc7a0 msgr2=0x7f5f2c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:58.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.595+0000 7f5f347be640 1 -- 172.21.15.33:0/3255244275 shutdown_connections 2024-09-12T12:24:58.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.595+0000 7f5f347be640 1 -- 172.21.15.33:0/3255244275 wait complete. 2024-09-12T12:24:58.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.596+0000 7f5f347be640 1 Processor -- start 2024-09-12T12:24:58.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.596+0000 7f5f347be640 1 -- start start 2024-09-12T12:24:58.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.596+0000 7f5f347be640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f2c102d40 0x7f5f2c198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:58.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.596+0000 7f5f347be640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f2c103660 0x7f5f2c1988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:58.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.596+0000 7f5f347be640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f2c10c170 0x7f5f2c19cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:58.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.596+0000 7f5f347be640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2c111e60 con 0x7f5f2c103660 2024-09-12T12:24:58.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.596+0000 7f5f347be640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2c111ce0 con 0x7f5f2c10c170 2024-09-12T12:24:58.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.596+0000 7f5f347be640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2c111fe0 con 0x7f5f2c102d40 2024-09-12T12:24:58.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.596+0000 7f5f31d59640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f2c103660 0x7f5f2c1988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:58.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.596+0000 7f5f31d59640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f2c103660 0x7f5f2c1988c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46022/0 (socket says 172.21.15.33:46022) 2024-09-12T12:24:58.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.596+0000 7f5f31d59640 1 -- 172.21.15.33:0/3653471881 learned_addr learned my addr 172.21.15.33:0/3653471881 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:24:58.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.596+0000 7f5f3255a640 1 --2- 172.21.15.33:0/3653471881 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f2c102d40 0x7f5f2c198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:58.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.596+0000 7f5f32d5b640 1 --2- 172.21.15.33:0/3653471881 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f2c10c170 0x7f5f2c19cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:58.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.596+0000 7f5f31d59640 1 -- 172.21.15.33:0/3653471881 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f2c102d40 msgr2=0x7f5f2c198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:58.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.596+0000 7f5f31d59640 1 --2- 172.21.15.33:0/3653471881 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f2c102d40 0x7f5f2c198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:58.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.596+0000 7f5f31d59640 1 -- 172.21.15.33:0/3653471881 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f2c10c170 msgr2=0x7f5f2c19cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:58.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.596+0000 7f5f31d59640 1 --2- 172.21.15.33:0/3653471881 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f2c10c170 0x7f5f2c19cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:58.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.596+0000 7f5f31d59640 1 -- 172.21.15.33:0/3653471881 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f2c19d330 con 0x7f5f2c103660 2024-09-12T12:24:58.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.597+0000 7f5f31d59640 1 --2- 172.21.15.33:0/3653471881 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f2c103660 0x7f5f2c1988c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c00b3f0 tx=0x7f5f1c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:58.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.597+0000 7f5f237fe640 1 -- 172.21.15.33:0/3653471881 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c015020 con 0x7f5f2c103660 2024-09-12T12:24:58.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.597+0000 7f5f347be640 1 -- 172.21.15.33:0/3653471881 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f2c19d620 con 0x7f5f2c103660 2024-09-12T12:24:58.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.597+0000 7f5f237fe640 1 -- 172.21.15.33:0/3653471881 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5f1c011ce0 con 0x7f5f2c103660 2024-09-12T12:24:58.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.597+0000 7f5f237fe640 1 -- 172.21.15.33:0/3653471881 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c010d80 con 0x7f5f2c103660 2024-09-12T12:24:58.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.597+0000 7f5f347be640 1 -- 172.21.15.33:0/3653471881 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f2c1a4f00 con 0x7f5f2c103660 2024-09-12T12:24:58.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.598+0000 7f5f347be640 1 -- 172.21.15.33:0/3653471881 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5f2c062980 con 0x7f5f2c103660 2024-09-12T12:24:58.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.599+0000 7f5f237fe640 1 -- 172.21.15.33:0/3653471881 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5f1c018020 con 0x7f5f2c103660 2024-09-12T12:24:58.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.600+0000 7f5f237fe640 1 --2- 172.21.15.33:0/3653471881 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f5f180a2c10 0x7f5f180a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:58.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.600+0000 7f5f237fe640 1 -- 172.21.15.33:0/3653471881 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f5f1c0cf440 con 0x7f5f2c103660 2024-09-12T12:24:58.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.600+0000 7f5f3255a640 1 --2- 172.21.15.33:0/3653471881 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f5f180a2c10 0x7f5f180a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:58.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.600+0000 7f5f237fe640 1 --2- 172.21.15.33:0/3653471881 >> [v2:172.21.15.33:6810/2483872739,v1:172.21.15.33:6811/2483872739] conn(0x7f5f180adde0 0x7f5f180b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:58.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.600+0000 7f5f237fe640 1 -- 172.21.15.33:0/3653471881 --> [v2:172.21.15.33:6810/2483872739,v1:172.21.15.33:6811/2483872739] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5f1c018ec0 con 0x7f5f180adde0 2024-09-12T12:24:58.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.600+0000 7f5f237fe640 1 -- 172.21.15.33:0/3653471881 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f5f1c0cf890 con 0x7f5f2c103660 2024-09-12T12:24:58.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.600+0000 7f5f32d5b640 1 --2- 172.21.15.33:0/3653471881 >> [v2:172.21.15.33:6810/2483872739,v1:172.21.15.33:6811/2483872739] conn(0x7f5f180adde0 0x7f5f180b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:58.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.601+0000 7f5f3255a640 1 --2- 172.21.15.33:0/3653471881 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f5f180a2c10 0x7f5f180a50d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5f28031440 tx=0x7f5f280095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:58.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.601+0000 7f5f32d5b640 1 --2- 172.21.15.33:0/3653471881 >> [v2:172.21.15.33:6810/2483872739,v1:172.21.15.33:6811/2483872739] conn(0x7f5f180adde0 0x7f5f180b0280 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:58.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.601+0000 7f5f237fe640 1 -- 172.21.15.33:0/3653471881 <== osd.3 v2:172.21.15.33:6810/2483872739 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5f1c018ec0 con 0x7f5f180adde0 2024-09-12T12:24:58.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.615+0000 7f5f347be640 1 -- 172.21.15.33:0/3653471881 --> [v2:172.21.15.33:6810/2483872739,v1:172.21.15.33:6811/2483872739] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5f2c062e00 con 0x7f5f180adde0 2024-09-12T12:24:58.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.615+0000 7f5f237fe640 1 -- 172.21.15.33:0/3653471881 <== osd.3 v2:172.21.15.33:6810/2483872739 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5f2c062e00 con 0x7f5f180adde0 2024-09-12T12:24:58.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.616+0000 7f5f347be640 1 -- 172.21.15.33:0/3653471881 >> [v2:172.21.15.33:6810/2483872739,v1:172.21.15.33:6811/2483872739] conn(0x7f5f180adde0 msgr2=0x7f5f180b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:58.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.616+0000 7f5f347be640 1 --2- 172.21.15.33:0/3653471881 >> [v2:172.21.15.33:6810/2483872739,v1:172.21.15.33:6811/2483872739] conn(0x7f5f180adde0 0x7f5f180b0280 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:58.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.616+0000 7f5f347be640 1 -- 172.21.15.33:0/3653471881 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f5f180a2c10 msgr2=0x7f5f180a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:58.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.616+0000 7f5f347be640 1 --2- 172.21.15.33:0/3653471881 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f5f180a2c10 0x7f5f180a50d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5f28031440 tx=0x7f5f280095f0 comp rx=0 tx=0).stop 2024-09-12T12:24:58.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.616+0000 7f5f347be640 1 -- 172.21.15.33:0/3653471881 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f2c103660 msgr2=0x7f5f2c1988c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:58.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.616+0000 7f5f347be640 1 --2- 172.21.15.33:0/3653471881 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f2c103660 0x7f5f2c1988c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c00b3f0 tx=0x7f5f1c00b8b0 comp rx=0 tx=0).stop 2024-09-12T12:24:58.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.616+0000 7f5f32d5b640 1 -- 172.21.15.33:0/3653471881 reap_dead start 2024-09-12T12:24:58.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.616+0000 7f5f347be640 1 -- 172.21.15.33:0/3653471881 shutdown_connections 2024-09-12T12:24:58.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.616+0000 7f5f347be640 1 -- 172.21.15.33:0/3653471881 >> 172.21.15.33:0/3653471881 conn(0x7f5f2c0fc7a0 msgr2=0x7f5f2c0fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:58.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.616+0000 7f5f347be640 1 -- 172.21.15.33:0/3653471881 shutdown_connections 2024-09-12T12:24:58.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:24:58.616+0000 7f5f347be640 1 -- 172.21.15.33:0/3653471881 wait complete. 2024-09-12T12:24:59.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:59 smithi033 ceph-mon[31246]: pgmap v315: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-12T12:24:59.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:59 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]': finished 2024-09-12T12:24:59.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:59 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-12T12:24:59.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:59 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-12T12:24:59.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:59 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-09-12T12:24:59.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:59 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-12T12:24:59.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:59 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]': finished 2024-09-12T12:24:59.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:59 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-09-12T12:24:59.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:59 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [5, 10]}]': finished 2024-09-12T12:24:59.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:59 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2024-09-12T12:24:59.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:59 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]': finished 2024-09-12T12:24:59.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:24:59 smithi033 ceph-mon[31246]: osdmap e86: 12 total, 12 up, 12 in 2024-09-12T12:24:59.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:59 smithi102 ceph-mon[34799]: pgmap v315: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-12T12:24:59.397 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:59 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]': finished 2024-09-12T12:24:59.397 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:59 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-12T12:24:59.397 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:59 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-12T12:24:59.398 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:59 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-09-12T12:24:59.398 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:59 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-12T12:24:59.398 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:59 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]': finished 2024-09-12T12:24:59.398 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:59 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-09-12T12:24:59.398 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:59 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [5, 10]}]': finished 2024-09-12T12:24:59.399 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:59 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2024-09-12T12:24:59.399 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:59 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]': finished 2024-09-12T12:24:59.399 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:24:59 smithi102 ceph-mon[34799]: osdmap e86: 12 total, 12 up, 12 in 2024-09-12T12:24:59.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:59 smithi043 ceph-mon[34144]: pgmap v315: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-12T12:24:59.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:59 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]': finished 2024-09-12T12:24:59.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:59 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-12T12:24:59.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:59 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-12T12:24:59.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:59 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-09-12T12:24:59.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:59 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-12T12:24:59.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:59 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]': finished 2024-09-12T12:24:59.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:59 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-09-12T12:24:59.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:59 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [5, 10]}]': finished 2024-09-12T12:24:59.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:59 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2024-09-12T12:24:59.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:59 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]': finished 2024-09-12T12:24:59.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:24:59 smithi043 ceph-mon[34144]: osdmap e86: 12 total, 12 up, 12 in 2024-09-12T12:24:59.621 INFO:teuthology.orchestra.run.smithi033.stdout:34359738449 2024-09-12T12:24:59.622 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-12T12:25:00.015 INFO:teuthology.orchestra.run.smithi033.stdout:180388626485 2024-09-12T12:25:00.015 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-12T12:25:00.252 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:00 smithi033 ceph-mon[31246]: osdmap e87: 12 total, 12 up, 12 in 2024-09-12T12:25:00.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:00 smithi102 ceph-mon[34799]: osdmap e87: 12 total, 12 up, 12 in 2024-09-12T12:25:00.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.406+0000 7f01a2392640 1 -- 172.21.15.33:0/2704336764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f019c102790 msgr2=0x7f019c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:00.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.406+0000 7f01a2392640 1 --2- 172.21.15.33:0/2704336764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f019c102790 0x7f019c1067e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0190009900 tx=0x7f019002a410 comp rx=0 tx=0).stop 2024-09-12T12:25:00.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.406+0000 7f01a2392640 1 -- 172.21.15.33:0/2704336764 shutdown_connections 2024-09-12T12:25:00.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.406+0000 7f01a2392640 1 --2- 172.21.15.33:0/2704336764 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f019c106f10 0x7f019c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:00.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.406+0000 7f01a2392640 1 --2- 172.21.15.33:0/2704336764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f019c102790 0x7f019c1067e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:00.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.406+0000 7f01a2392640 1 --2- 172.21.15.33:0/2704336764 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f019c101de0 0x7f019c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:00.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.406+0000 7f01a2392640 1 -- 172.21.15.33:0/2704336764 >> 172.21.15.33:0/2704336764 conn(0x7f019c0fd8c0 msgr2=0x7f019c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:00.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.406+0000 7f01a2392640 1 -- 172.21.15.33:0/2704336764 shutdown_connections 2024-09-12T12:25:00.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.406+0000 7f01a2392640 1 -- 172.21.15.33:0/2704336764 wait complete. 2024-09-12T12:25:00.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.407+0000 7f01a2392640 1 Processor -- start 2024-09-12T12:25:00.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.407+0000 7f01a2392640 1 -- start start 2024-09-12T12:25:00.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.407+0000 7f01a2392640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f019c101de0 0x7f019c198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:00.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.407+0000 7f01a2392640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f019c102790 0x7f019c198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:00.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.407+0000 7f01a2392640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f019c106f10 0x7f019c19ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:00.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.407+0000 7f01a2392640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f019c111e40 con 0x7f019c101de0 2024-09-12T12:25:00.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.407+0000 7f01a2392640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f019c111cc0 con 0x7f019c102790 2024-09-12T12:25:00.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.407+0000 7f01a2392640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f019c111fc0 con 0x7f019c106f10 2024-09-12T12:25:00.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.407+0000 7f019bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f019c101de0 0x7f019c198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:00.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.407+0000 7f019bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f019c101de0 0x7f019c198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46028/0 (socket says 172.21.15.33:46028) 2024-09-12T12:25:00.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.407+0000 7f019bfff640 1 -- 172.21.15.33:0/805054882 learned_addr learned my addr 172.21.15.33:0/805054882 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:00.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.408+0000 7f01a092f640 1 --2- 172.21.15.33:0/805054882 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f019c106f10 0x7f019c19ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:00.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.408+0000 7f019b7fe640 1 --2- 172.21.15.33:0/805054882 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f019c102790 0x7f019c198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:00.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.408+0000 7f019bfff640 1 -- 172.21.15.33:0/805054882 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f019c106f10 msgr2=0x7f019c19ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:00.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.408+0000 7f019bfff640 1 --2- 172.21.15.33:0/805054882 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f019c106f10 0x7f019c19ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:00.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.408+0000 7f019bfff640 1 -- 172.21.15.33:0/805054882 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f019c102790 msgr2=0x7f019c198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:00.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.408+0000 7f019bfff640 1 --2- 172.21.15.33:0/805054882 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f019c102790 0x7f019c198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:00.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.408+0000 7f019bfff640 1 -- 172.21.15.33:0/805054882 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f019c19d3b0 con 0x7f019c101de0 2024-09-12T12:25:00.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.408+0000 7f019bfff640 1 --2- 172.21.15.33:0/805054882 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f019c101de0 0x7f019c198400 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f018c00b4a0 tx=0x7f018c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:00.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.408+0000 7f01997fa640 1 -- 172.21.15.33:0/805054882 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018c014070 con 0x7f019c101de0 2024-09-12T12:25:00.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.408+0000 7f01997fa640 1 -- 172.21.15.33:0/805054882 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f018c010ac0 con 0x7f019c101de0 2024-09-12T12:25:00.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.408+0000 7f01a2392640 1 -- 172.21.15.33:0/805054882 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f019c19d6a0 con 0x7f019c101de0 2024-09-12T12:25:00.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.408+0000 7f01997fa640 1 -- 172.21.15.33:0/805054882 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018c017c30 con 0x7f019c101de0 2024-09-12T12:25:00.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.408+0000 7f01a2392640 1 -- 172.21.15.33:0/805054882 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f019c1a4f80 con 0x7f019c101de0 2024-09-12T12:25:00.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.409+0000 7f01a2392640 1 -- 172.21.15.33:0/805054882 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f019c062900 con 0x7f019c101de0 2024-09-12T12:25:00.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.411+0000 7f01997fa640 1 -- 172.21.15.33:0/805054882 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f018c017070 con 0x7f019c101de0 2024-09-12T12:25:00.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.411+0000 7f01997fa640 1 --2- 172.21.15.33:0/805054882 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f01840a2c90 0x7f01840a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:00.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.412+0000 7f019b7fe640 1 --2- 172.21.15.33:0/805054882 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f01840a2c90 0x7f01840a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:00.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.412+0000 7f01997fa640 1 -- 172.21.15.33:0/805054882 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7f018c0cea50 con 0x7f019c101de0 2024-09-12T12:25:00.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.412+0000 7f01997fa640 1 --2- 172.21.15.33:0/805054882 >> [v2:172.21.15.102:6808/2605625792,v1:172.21.15.102:6809/2605625792] conn(0x7f01840ade60 0x7f01840b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:00.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.412+0000 7f01997fa640 1 -- 172.21.15.33:0/805054882 --> [v2:172.21.15.102:6808/2605625792,v1:172.21.15.102:6809/2605625792] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f01840b09d0 con 0x7f01840ade60 2024-09-12T12:25:00.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.412+0000 7f01997fa640 1 -- 172.21.15.33:0/805054882 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f018c0ceea0 con 0x7f019c101de0 2024-09-12T12:25:00.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.412+0000 7f019b7fe640 1 --2- 172.21.15.33:0/805054882 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f01840a2c90 0x7f01840a5150 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0190031440 tx=0x7f0190005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:00.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.412+0000 7f01a092f640 1 --2- 172.21.15.33:0/805054882 >> [v2:172.21.15.102:6808/2605625792,v1:172.21.15.102:6809/2605625792] conn(0x7f01840ade60 0x7f01840b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:00.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.413+0000 7f01a092f640 1 --2- 172.21.15.33:0/805054882 >> [v2:172.21.15.102:6808/2605625792,v1:172.21.15.102:6809/2605625792] conn(0x7f01840ade60 0x7f01840b0300 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:00.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.413+0000 7f01997fa640 1 -- 172.21.15.33:0/805054882 <== osd.5 v2:172.21.15.102:6808/2605625792 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f01840b09d0 con 0x7f01840ade60 2024-09-12T12:25:00.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.429+0000 7f01a2392640 1 -- 172.21.15.33:0/805054882 --> [v2:172.21.15.102:6808/2605625792,v1:172.21.15.102:6809/2605625792] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f019c062d00 con 0x7f01840ade60 2024-09-12T12:25:00.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.429+0000 7f01997fa640 1 -- 172.21.15.33:0/805054882 <== osd.5 v2:172.21.15.102:6808/2605625792 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f019c062d00 con 0x7f01840ade60 2024-09-12T12:25:00.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.430+0000 7f01a2392640 1 -- 172.21.15.33:0/805054882 >> [v2:172.21.15.102:6808/2605625792,v1:172.21.15.102:6809/2605625792] conn(0x7f01840ade60 msgr2=0x7f01840b0300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:00.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.430+0000 7f01a2392640 1 --2- 172.21.15.33:0/805054882 >> [v2:172.21.15.102:6808/2605625792,v1:172.21.15.102:6809/2605625792] conn(0x7f01840ade60 0x7f01840b0300 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:00.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.430+0000 7f01a2392640 1 -- 172.21.15.33:0/805054882 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f01840a2c90 msgr2=0x7f01840a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:00.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.430+0000 7f01a2392640 1 --2- 172.21.15.33:0/805054882 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f01840a2c90 0x7f01840a5150 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0190031440 tx=0x7f0190005e80 comp rx=0 tx=0).stop 2024-09-12T12:25:00.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.430+0000 7f01a2392640 1 -- 172.21.15.33:0/805054882 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f019c101de0 msgr2=0x7f019c198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:00.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.430+0000 7f01a2392640 1 --2- 172.21.15.33:0/805054882 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f019c101de0 0x7f019c198400 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f018c00b4a0 tx=0x7f018c00b960 comp rx=0 tx=0).stop 2024-09-12T12:25:00.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.430+0000 7f01a092f640 1 -- 172.21.15.33:0/805054882 reap_dead start 2024-09-12T12:25:00.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.430+0000 7f01a2392640 1 -- 172.21.15.33:0/805054882 shutdown_connections 2024-09-12T12:25:00.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.430+0000 7f01a2392640 1 -- 172.21.15.33:0/805054882 >> 172.21.15.33:0/805054882 conn(0x7f019c0fd8c0 msgr2=0x7f019c0fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:00.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.430+0000 7f01a2392640 1 -- 172.21.15.33:0/805054882 shutdown_connections 2024-09-12T12:25:00.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:00.430+0000 7f01a2392640 1 -- 172.21.15.33:0/805054882 wait complete. 2024-09-12T12:25:00.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:00 smithi043 ceph-mon[34144]: osdmap e87: 12 total, 12 up, 12 in 2024-09-12T12:25:00.871 INFO:teuthology.orchestra.run.smithi033.stdout:128849018943 2024-09-12T12:25:00.871 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-12T12:25:01.293 INFO:teuthology.orchestra.run.smithi033.stdout:313532612635 2024-09-12T12:25:01.294 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-12T12:25:01.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:01 smithi102 ceph-mon[34799]: pgmap v318: 129 pgs: 3 peering, 126 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-12T12:25:01.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:01 smithi102 ceph-mon[34799]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-09-12T12:25:01.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:01 smithi033 ceph-mon[31246]: pgmap v318: 129 pgs: 3 peering, 126 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-12T12:25:01.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:01 smithi033 ceph-mon[31246]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-09-12T12:25:01.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:01 smithi043 ceph-mon[34144]: pgmap v318: 129 pgs: 3 peering, 126 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-12T12:25:01.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:01 smithi043 ceph-mon[34144]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-09-12T12:25:01.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.760+0000 7ff9ce7bb640 1 -- 172.21.15.33:0/2572029015 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9c8101420 msgr2=0x7ff9c810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:01.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.760+0000 7ff9ce7bb640 1 --2- 172.21.15.33:0/2572029015 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9c8101420 0x7ff9c810d950 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0009cd0 tx=0x7ff9c002a8e0 comp rx=0 tx=0).stop 2024-09-12T12:25:01.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.760+0000 7ff9ce7bb640 1 -- 172.21.15.33:0/2572029015 shutdown_connections 2024-09-12T12:25:01.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.760+0000 7ff9ce7bb640 1 --2- 172.21.15.33:0/2572029015 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9c8101420 0x7ff9c810d950 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:01.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.760+0000 7ff9ce7bb640 1 --2- 172.21.15.33:0/2572029015 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9c8100a80 0x7ff9c8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:01.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.760+0000 7ff9ce7bb640 1 --2- 172.21.15.33:0/2572029015 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9c8106a80 0x7ff9c8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:01.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.760+0000 7ff9ce7bb640 1 -- 172.21.15.33:0/2572029015 >> 172.21.15.33:0/2572029015 conn(0x7ff9c80fc7a0 msgr2=0x7ff9c80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:01.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.760+0000 7ff9ce7bb640 1 -- 172.21.15.33:0/2572029015 shutdown_connections 2024-09-12T12:25:01.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.760+0000 7ff9ce7bb640 1 -- 172.21.15.33:0/2572029015 wait complete. 2024-09-12T12:25:01.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.761+0000 7ff9ce7bb640 1 Processor -- start 2024-09-12T12:25:01.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.761+0000 7ff9ce7bb640 1 -- start start 2024-09-12T12:25:01.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.761+0000 7ff9ce7bb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9c8100a80 0x7ff9c81984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:01.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.761+0000 7ff9ce7bb640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9c8101420 0x7ff9c8198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:01.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.761+0000 7ff9ce7bb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9c8106a80 0x7ff9c819cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:01.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.761+0000 7ff9ce7bb640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c8111ed0 con 0x7ff9c8106a80 2024-09-12T12:25:01.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.761+0000 7ff9ce7bb640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c8111d50 con 0x7ff9c8101420 2024-09-12T12:25:01.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.761+0000 7ff9ce7bb640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c8112050 con 0x7ff9c8100a80 2024-09-12T12:25:01.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.761+0000 7ff9ccd58640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9c8106a80 0x7ff9c819cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:01.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.761+0000 7ff9ccd58640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9c8106a80 0x7ff9c819cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57468/0 (socket says 172.21.15.33:57468) 2024-09-12T12:25:01.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.761+0000 7ff9ccd58640 1 -- 172.21.15.33:0/134944247 learned_addr learned my addr 172.21.15.33:0/134944247 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:01.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.761+0000 7ff9c77fe640 1 --2- 172.21.15.33:0/134944247 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9c8101420 0x7ff9c8198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:01.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.761+0000 7ff9c7fff640 1 --2- 172.21.15.33:0/134944247 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9c8100a80 0x7ff9c81984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:01.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.762+0000 7ff9ccd58640 1 -- 172.21.15.33:0/134944247 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9c8100a80 msgr2=0x7ff9c81984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:01.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.762+0000 7ff9ccd58640 1 --2- 172.21.15.33:0/134944247 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9c8100a80 0x7ff9c81984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:01.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.762+0000 7ff9ccd58640 1 -- 172.21.15.33:0/134944247 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9c8101420 msgr2=0x7ff9c8198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:01.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.762+0000 7ff9ccd58640 1 --2- 172.21.15.33:0/134944247 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9c8101420 0x7ff9c8198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:01.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.762+0000 7ff9ccd58640 1 -- 172.21.15.33:0/134944247 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9c819d4a0 con 0x7ff9c8106a80 2024-09-12T12:25:01.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.762+0000 7ff9ccd58640 1 --2- 172.21.15.33:0/134944247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9c8106a80 0x7ff9c819cdc0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0005cc0 tx=0x7ff9c0003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:01.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.762+0000 7ff9c57fa640 1 -- 172.21.15.33:0/134944247 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c0004240 con 0x7ff9c8106a80 2024-09-12T12:25:01.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.762+0000 7ff9c57fa640 1 -- 172.21.15.33:0/134944247 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff9c00305a0 con 0x7ff9c8106a80 2024-09-12T12:25:01.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.762+0000 7ff9c57fa640 1 -- 172.21.15.33:0/134944247 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c00466c0 con 0x7ff9c8106a80 2024-09-12T12:25:01.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.762+0000 7ff9ce7bb640 1 -- 172.21.15.33:0/134944247 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9c819d730 con 0x7ff9c8106a80 2024-09-12T12:25:01.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.762+0000 7ff9ce7bb640 1 -- 172.21.15.33:0/134944247 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9c81a5070 con 0x7ff9c8106a80 2024-09-12T12:25:01.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.763+0000 7ff9ce7bb640 1 -- 172.21.15.33:0/134944247 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff9c8062980 con 0x7ff9c8106a80 2024-09-12T12:25:01.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.764+0000 7ff9c57fa640 1 -- 172.21.15.33:0/134944247 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff9c0030ac0 con 0x7ff9c8106a80 2024-09-12T12:25:01.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.765+0000 7ff9c57fa640 1 --2- 172.21.15.33:0/134944247 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff9b00a2c10 0x7ff9b00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:01.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.765+0000 7ff9c57fa640 1 -- 172.21.15.33:0/134944247 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7ff9c002e030 con 0x7ff9c8106a80 2024-09-12T12:25:01.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.765+0000 7ff9c7fff640 1 --2- 172.21.15.33:0/134944247 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff9b00a2c10 0x7ff9b00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:01.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.765+0000 7ff9c57fa640 1 --2- 172.21.15.33:0/134944247 >> [v2:172.21.15.43:6800/2306025171,v1:172.21.15.43:6801/2306025171] conn(0x7ff9b00adde0 0x7ff9b00b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:01.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.765+0000 7ff9c57fa640 1 -- 172.21.15.33:0/134944247 --> [v2:172.21.15.43:6800/2306025171,v1:172.21.15.43:6801/2306025171] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff9c002cec0 con 0x7ff9b00adde0 2024-09-12T12:25:01.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.765+0000 7ff9c57fa640 1 -- 172.21.15.33:0/134944247 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7ff9c00f0cf0 con 0x7ff9c8106a80 2024-09-12T12:25:01.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.766+0000 7ff9c7fff640 1 --2- 172.21.15.33:0/134944247 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff9b00a2c10 0x7ff9b00a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8009990 tx=0x7ff9b8009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:01.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.766+0000 7ff9c77fe640 1 --2- 172.21.15.33:0/134944247 >> [v2:172.21.15.43:6800/2306025171,v1:172.21.15.43:6801/2306025171] conn(0x7ff9b00adde0 0x7ff9b00b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:01.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.766+0000 7ff9c77fe640 1 --2- 172.21.15.33:0/134944247 >> [v2:172.21.15.43:6800/2306025171,v1:172.21.15.43:6801/2306025171] conn(0x7ff9b00adde0 0x7ff9b00b0280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:01.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.767+0000 7ff9c57fa640 1 -- 172.21.15.33:0/134944247 <== osd.1 v2:172.21.15.43:6800/2306025171 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff9c002cec0 con 0x7ff9b00adde0 2024-09-12T12:25:01.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.781+0000 7ff9ce7bb640 1 -- 172.21.15.33:0/134944247 --> [v2:172.21.15.43:6800/2306025171,v1:172.21.15.43:6801/2306025171] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff9c8062e00 con 0x7ff9b00adde0 2024-09-12T12:25:01.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.781+0000 7ff9c57fa640 1 -- 172.21.15.33:0/134944247 <== osd.1 v2:172.21.15.43:6800/2306025171 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff9c8062e00 con 0x7ff9b00adde0 2024-09-12T12:25:01.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.782+0000 7ff9ce7bb640 1 -- 172.21.15.33:0/134944247 >> [v2:172.21.15.43:6800/2306025171,v1:172.21.15.43:6801/2306025171] conn(0x7ff9b00adde0 msgr2=0x7ff9b00b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:01.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.782+0000 7ff9ce7bb640 1 --2- 172.21.15.33:0/134944247 >> [v2:172.21.15.43:6800/2306025171,v1:172.21.15.43:6801/2306025171] conn(0x7ff9b00adde0 0x7ff9b00b0280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:01.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.782+0000 7ff9ce7bb640 1 -- 172.21.15.33:0/134944247 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff9b00a2c10 msgr2=0x7ff9b00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:01.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.782+0000 7ff9ce7bb640 1 --2- 172.21.15.33:0/134944247 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff9b00a2c10 0x7ff9b00a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8009990 tx=0x7ff9b8009110 comp rx=0 tx=0).stop 2024-09-12T12:25:01.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.782+0000 7ff9ce7bb640 1 -- 172.21.15.33:0/134944247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9c8106a80 msgr2=0x7ff9c819cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:01.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.782+0000 7ff9ce7bb640 1 --2- 172.21.15.33:0/134944247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9c8106a80 0x7ff9c819cdc0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0005cc0 tx=0x7ff9c0003ba0 comp rx=0 tx=0).stop 2024-09-12T12:25:01.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.782+0000 7ff9ccd58640 1 -- 172.21.15.33:0/134944247 reap_dead start 2024-09-12T12:25:01.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.782+0000 7ff9ce7bb640 1 -- 172.21.15.33:0/134944247 shutdown_connections 2024-09-12T12:25:01.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.782+0000 7ff9ce7bb640 1 -- 172.21.15.33:0/134944247 >> 172.21.15.33:0/134944247 conn(0x7ff9c80fc7a0 msgr2=0x7ff9c80fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:01.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.782+0000 7ff9ce7bb640 1 -- 172.21.15.33:0/134944247 shutdown_connections 2024-09-12T12:25:01.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.782+0000 7ff9ce7bb640 1 -- 172.21.15.33:0/134944247 wait complete. 2024-09-12T12:25:01.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.972+0000 7f4f320cf640 1 -- 172.21.15.33:0/2419526567 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f2c102570 msgr2=0x7f4f2c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:01.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.972+0000 7f4f320cf640 1 --2- 172.21.15.33:0/2419526567 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f2c102570 0x7f4f2c1029b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4f20009900 tx=0x7f4f2002a480 comp rx=0 tx=0).stop 2024-09-12T12:25:01.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.972+0000 7f4f320cf640 1 -- 172.21.15.33:0/2419526567 shutdown_connections 2024-09-12T12:25:01.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.972+0000 7f4f320cf640 1 --2- 172.21.15.33:0/2419526567 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f2c102ef0 0x7f4f2c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:01.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.972+0000 7f4f320cf640 1 --2- 172.21.15.33:0/2419526567 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f2c102570 0x7f4f2c1029b0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:01.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.972+0000 7f4f320cf640 1 --2- 172.21.15.33:0/2419526567 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f2c100e20 0x7f4f2c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:01.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.972+0000 7f4f320cf640 1 -- 172.21.15.33:0/2419526567 >> 172.21.15.33:0/2419526567 conn(0x7f4f2c0fc7d0 msgr2=0x7f4f2c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:01.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.972+0000 7f4f320cf640 1 -- 172.21.15.33:0/2419526567 shutdown_connections 2024-09-12T12:25:01.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.972+0000 7f4f320cf640 1 -- 172.21.15.33:0/2419526567 wait complete. 2024-09-12T12:25:01.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.973+0000 7f4f320cf640 1 Processor -- start 2024-09-12T12:25:01.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.973+0000 7f4f320cf640 1 -- start start 2024-09-12T12:25:01.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.973+0000 7f4f320cf640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f2c100e20 0x7f4f2c0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:01.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.973+0000 7f4f320cf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f2c102570 0x7f4f2c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:01.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.973+0000 7f4f320cf640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f2c102ef0 0x7f4f2c0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:01.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.973+0000 7f4f320cf640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4f2c110e30 con 0x7f4f2c100e20 2024-09-12T12:25:01.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.973+0000 7f4f320cf640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4f2c110cb0 con 0x7f4f2c102ef0 2024-09-12T12:25:01.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.973+0000 7f4f320cf640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4f2c110fb0 con 0x7f4f2c102570 2024-09-12T12:25:01.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.973+0000 7f4f2b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f2c100e20 0x7f4f2c0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:01.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.973+0000 7f4f2b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f2c100e20 0x7f4f2c0fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57494/0 (socket says 172.21.15.33:57494) 2024-09-12T12:25:01.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.973+0000 7f4f2b7fe640 1 -- 172.21.15.33:0/3193734332 learned_addr learned my addr 172.21.15.33:0/3193734332 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:01.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.973+0000 7f4f2affd640 1 --2- 172.21.15.33:0/3193734332 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f2c102570 0x7f4f2c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:01.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.973+0000 7f4f2bfff640 1 --2- 172.21.15.33:0/3193734332 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f2c102ef0 0x7f4f2c0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:01.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.974+0000 7f4f2b7fe640 1 -- 172.21.15.33:0/3193734332 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f2c102570 msgr2=0x7f4f2c0fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:01.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.974+0000 7f4f2b7fe640 1 --2- 172.21.15.33:0/3193734332 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f2c102570 0x7f4f2c0fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:01.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.974+0000 7f4f2b7fe640 1 -- 172.21.15.33:0/3193734332 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f2c102ef0 msgr2=0x7f4f2c0fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:01.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.974+0000 7f4f2b7fe640 1 --2- 172.21.15.33:0/3193734332 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f2c102ef0 0x7f4f2c0fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:01.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.974+0000 7f4f2b7fe640 1 -- 172.21.15.33:0/3193734332 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f2c1a68d0 con 0x7f4f2c100e20 2024-09-12T12:25:01.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.974+0000 7f4f2bfff640 1 --2- 172.21.15.33:0/3193734332 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f2c102ef0 0x7f4f2c0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:01.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.974+0000 7f4f2b7fe640 1 --2- 172.21.15.33:0/3193734332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f2c100e20 0x7f4f2c0fcc80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c00db80 tx=0x7f4f1c00b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:01.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.974+0000 7f4f28ff9640 1 -- 172.21.15.33:0/3193734332 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c017070 con 0x7f4f2c100e20 2024-09-12T12:25:01.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.974+0000 7f4f320cf640 1 -- 172.21.15.33:0/3193734332 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f2c1a6bc0 con 0x7f4f2c100e20 2024-09-12T12:25:01.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.974+0000 7f4f28ff9640 1 -- 172.21.15.33:0/3193734332 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4f1c003b70 con 0x7f4f2c100e20 2024-09-12T12:25:01.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.974+0000 7f4f28ff9640 1 -- 172.21.15.33:0/3193734332 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c010480 con 0x7f4f2c100e20 2024-09-12T12:25:01.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.974+0000 7f4f320cf640 1 -- 172.21.15.33:0/3193734332 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f2c1a70d0 con 0x7f4f2c100e20 2024-09-12T12:25:01.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.975+0000 7f4f320cf640 1 -- 172.21.15.33:0/3193734332 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4f2c062940 con 0x7f4f2c100e20 2024-09-12T12:25:01.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.976+0000 7f4f28ff9640 1 -- 172.21.15.33:0/3193734332 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4f1c004020 con 0x7f4f2c100e20 2024-09-12T12:25:01.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.977+0000 7f4f28ff9640 1 --2- 172.21.15.33:0/3193734332 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f4f140a2c10 0x7f4f140a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:01.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.977+0000 7f4f2affd640 1 --2- 172.21.15.33:0/3193734332 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f4f140a2c10 0x7f4f140a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:01.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.977+0000 7f4f28ff9640 1 -- 172.21.15.33:0/3193734332 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7f4f1c0cf9e0 con 0x7f4f2c100e20 2024-09-12T12:25:01.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.977+0000 7f4f28ff9640 1 --2- 172.21.15.33:0/3193734332 >> [v2:172.21.15.43:6824/248515585,v1:172.21.15.43:6825/248515585] conn(0x7f4f140adde0 0x7f4f140b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:01.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.977+0000 7f4f28ff9640 1 -- 172.21.15.33:0/3193734332 --> [v2:172.21.15.43:6824/248515585,v1:172.21.15.43:6825/248515585] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4f1c01ee70 con 0x7f4f140adde0 2024-09-12T12:25:01.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.977+0000 7f4f28ff9640 1 -- 172.21.15.33:0/3193734332 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f4f1c0cfd90 con 0x7f4f2c100e20 2024-09-12T12:25:01.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.977+0000 7f4f2affd640 1 --2- 172.21.15.33:0/3193734332 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f4f140a2c10 0x7f4f140a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4f20009230 tx=0x7f4f200058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:01.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.978+0000 7f4f2bfff640 1 --2- 172.21.15.33:0/3193734332 >> [v2:172.21.15.43:6824/248515585,v1:172.21.15.43:6825/248515585] conn(0x7f4f140adde0 0x7f4f140b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:01.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.978+0000 7f4f2bfff640 1 --2- 172.21.15.33:0/3193734332 >> [v2:172.21.15.43:6824/248515585,v1:172.21.15.43:6825/248515585] conn(0x7f4f140adde0 0x7f4f140b0280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:01.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.979+0000 7f4f28ff9640 1 -- 172.21.15.33:0/3193734332 <== osd.10 v2:172.21.15.43:6824/248515585 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4f1c01ee70 con 0x7f4f140adde0 2024-09-12T12:25:01.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.992+0000 7f4f320cf640 1 -- 172.21.15.33:0/3193734332 --> [v2:172.21.15.43:6824/248515585,v1:172.21.15.43:6825/248515585] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4f2c062dc0 con 0x7f4f140adde0 2024-09-12T12:25:01.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.993+0000 7f4f28ff9640 1 -- 172.21.15.33:0/3193734332 <== osd.10 v2:172.21.15.43:6824/248515585 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4f2c062dc0 con 0x7f4f140adde0 2024-09-12T12:25:01.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.993+0000 7f4f320cf640 1 -- 172.21.15.33:0/3193734332 >> [v2:172.21.15.43:6824/248515585,v1:172.21.15.43:6825/248515585] conn(0x7f4f140adde0 msgr2=0x7f4f140b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:01.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.993+0000 7f4f320cf640 1 --2- 172.21.15.33:0/3193734332 >> [v2:172.21.15.43:6824/248515585,v1:172.21.15.43:6825/248515585] conn(0x7f4f140adde0 0x7f4f140b0280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:01.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.993+0000 7f4f320cf640 1 -- 172.21.15.33:0/3193734332 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f4f140a2c10 msgr2=0x7f4f140a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:02.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.993+0000 7f4f320cf640 1 --2- 172.21.15.33:0/3193734332 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f4f140a2c10 0x7f4f140a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4f20009230 tx=0x7f4f200058d0 comp rx=0 tx=0).stop 2024-09-12T12:25:02.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.993+0000 7f4f320cf640 1 -- 172.21.15.33:0/3193734332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f2c100e20 msgr2=0x7f4f2c0fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:02.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.993+0000 7f4f320cf640 1 --2- 172.21.15.33:0/3193734332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f2c100e20 0x7f4f2c0fcc80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c00db80 tx=0x7f4f1c00b630 comp rx=0 tx=0).stop 2024-09-12T12:25:02.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.993+0000 7f4f2bfff640 1 -- 172.21.15.33:0/3193734332 reap_dead start 2024-09-12T12:25:02.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.994+0000 7f4f320cf640 1 -- 172.21.15.33:0/3193734332 shutdown_connections 2024-09-12T12:25:02.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.994+0000 7f4f320cf640 1 -- 172.21.15.33:0/3193734332 >> 172.21.15.33:0/3193734332 conn(0x7f4f2c0fc7d0 msgr2=0x7f4f2c06a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:02.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.994+0000 7f4f320cf640 1 -- 172.21.15.33:0/3193734332 shutdown_connections 2024-09-12T12:25:02.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:01.994+0000 7f4f320cf640 1 -- 172.21.15.33:0/3193734332 wait complete. 2024-09-12T12:25:02.910 INFO:teuthology.orchestra.run.smithi033.stdout:55834574926 2024-09-12T12:25:02.910 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-12T12:25:03.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:03 smithi033 ceph-mon[31246]: pgmap v319: 129 pgs: 2 peering, 127 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s; 141 B/s, 0 objects/s recovering 2024-09-12T12:25:03.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:03 smithi102 ceph-mon[34799]: pgmap v319: 129 pgs: 2 peering, 127 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s; 141 B/s, 0 objects/s recovering 2024-09-12T12:25:03.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.473+0000 7fdd0c86a640 1 -- 172.21.15.33:0/1696750432 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd08108290 msgr2=0x7fdd0810ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:03.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.473+0000 7fdd0c86a640 1 --2- 172.21.15.33:0/1696750432 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd08108290 0x7fdd0810ec30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fdd00009930 tx=0x7fdd0002a420 comp rx=0 tx=0).stop 2024-09-12T12:25:03.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.473+0000 7fdd0c86a640 1 -- 172.21.15.33:0/1696750432 shutdown_connections 2024-09-12T12:25:03.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.473+0000 7fdd0c86a640 1 --2- 172.21.15.33:0/1696750432 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd08108290 0x7fdd0810ec30 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:03.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.473+0000 7fdd0c86a640 1 --2- 172.21.15.33:0/1696750432 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd08103740 0x7fdd08107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:03.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.473+0000 7fdd0c86a640 1 --2- 172.21.15.33:0/1696750432 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd08102d90 0x7fdd08103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:03.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.473+0000 7fdd0c86a640 1 -- 172.21.15.33:0/1696750432 >> 172.21.15.33:0/1696750432 conn(0x7fdd080fc7d0 msgr2=0x7fdd080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:03.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.473+0000 7fdd0c86a640 1 -- 172.21.15.33:0/1696750432 shutdown_connections 2024-09-12T12:25:03.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.473+0000 7fdd0c86a640 1 -- 172.21.15.33:0/1696750432 wait complete. 2024-09-12T12:25:03.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.474+0000 7fdd0c86a640 1 Processor -- start 2024-09-12T12:25:03.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.474+0000 7fdd0c86a640 1 -- start start 2024-09-12T12:25:03.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.474+0000 7fdd0c86a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd08102d90 0x7fdd08198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:03.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.475+0000 7fdd0c86a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd08103740 0x7fdd08198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:03.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.475+0000 7fdd0c86a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd08108290 0x7fdd0819ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:03.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.475+0000 7fdd0c86a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fdd08111f80 con 0x7fdd08103740 2024-09-12T12:25:03.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.475+0000 7fdd0c86a640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdd08111e00 con 0x7fdd08108290 2024-09-12T12:25:03.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.475+0000 7fdd0c86a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdd08112100 con 0x7fdd08102d90 2024-09-12T12:25:03.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.475+0000 7fdd05d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd08103740 0x7fdd08198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:03.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.475+0000 7fdd05d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd08103740 0x7fdd08198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57508/0 (socket says 172.21.15.33:57508) 2024-09-12T12:25:03.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.475+0000 7fdd05d9b640 1 -- 172.21.15.33:0/2887745266 learned_addr learned my addr 172.21.15.33:0/2887745266 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:03.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.475+0000 7fdd0659c640 1 --2- 172.21.15.33:0/2887745266 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd08102d90 0x7fdd08198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:03.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.475+0000 7fdd06d9d640 1 --2- 172.21.15.33:0/2887745266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd08108290 0x7fdd0819ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:03.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.475+0000 7fdd05d9b640 1 -- 172.21.15.33:0/2887745266 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd08102d90 msgr2=0x7fdd08198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:03.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.475+0000 7fdd05d9b640 1 --2- 172.21.15.33:0/2887745266 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd08102d90 0x7fdd08198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:03.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.475+0000 7fdd05d9b640 1 -- 172.21.15.33:0/2887745266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd08108290 msgr2=0x7fdd0819ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:03.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.475+0000 7fdd05d9b640 1 --2- 172.21.15.33:0/2887745266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd08108290 0x7fdd0819ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:03.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.475+0000 7fdd05d9b640 1 -- 172.21.15.33:0/2887745266 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd0819d3d0 con 0x7fdd08103740 2024-09-12T12:25:03.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.475+0000 7fdd05d9b640 1 --2- 172.21.15.33:0/2887745266 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd08103740 0x7fdd08198960 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc00b9c0 tx=0x7fdcfc00bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:03.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.475+0000 7fdcf77fe640 1 -- 172.21.15.33:0/2887745266 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc019070 con 0x7fdd08103740 2024-09-12T12:25:03.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.476+0000 7fdd0c86a640 1 -- 172.21.15.33:0/2887745266 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd0819d6c0 con 0x7fdd08103740 2024-09-12T12:25:03.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.476+0000 7fdcf77fe640 1 -- 172.21.15.33:0/2887745266 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdcfc014440 con 0x7fdd08103740 2024-09-12T12:25:03.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.476+0000 7fdcf77fe640 1 -- 172.21.15.33:0/2887745266 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc0125a0 con 0x7fdd08103740 2024-09-12T12:25:03.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.476+0000 7fdd0c86a640 1 -- 172.21.15.33:0/2887745266 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd081a4fa0 con 0x7fdd08103740 2024-09-12T12:25:03.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.476+0000 7fdd0c86a640 1 -- 172.21.15.33:0/2887745266 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdd08107720 con 0x7fdd08103740 2024-09-12T12:25:03.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.478+0000 7fdcf77fe640 1 -- 172.21.15.33:0/2887745266 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fdcfc01c070 con 0x7fdd08103740 2024-09-12T12:25:03.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.478+0000 7fdcf77fe640 1 --2- 172.21.15.33:0/2887745266 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fdcf00a2c10 0x7fdcf00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:03.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.479+0000 7fdd0659c640 1 --2- 172.21.15.33:0/2887745266 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fdcf00a2c10 0x7fdcf00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:03.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.479+0000 7fdcf77fe640 1 -- 172.21.15.33:0/2887745266 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7fdcfc0cf160 con 0x7fdd08103740 2024-09-12T12:25:03.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.479+0000 7fdcf77fe640 1 --2- 172.21.15.33:0/2887745266 >> [v2:172.21.15.102:6800/4257223217,v1:172.21.15.102:6801/4257223217] conn(0x7fdcf00adde0 0x7fdcf00b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:03.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.479+0000 7fdcf77fe640 1 -- 172.21.15.33:0/2887745266 --> [v2:172.21.15.102:6800/4257223217,v1:172.21.15.102:6801/4257223217] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdcfc023e50 con 0x7fdcf00adde0 2024-09-12T12:25:03.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.479+0000 7fdcf77fe640 1 -- 172.21.15.33:0/2887745266 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7fdcfc0cf510 con 0x7fdd08103740 2024-09-12T12:25:03.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.479+0000 7fdd0659c640 1 --2- 172.21.15.33:0/2887745266 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fdcf00a2c10 0x7fdcf00a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdcf800abe0 tx=0x7fdcf800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:03.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.479+0000 7fdd06d9d640 1 --2- 172.21.15.33:0/2887745266 >> [v2:172.21.15.102:6800/4257223217,v1:172.21.15.102:6801/4257223217] conn(0x7fdcf00adde0 0x7fdcf00b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:03.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.480+0000 7fdd06d9d640 1 --2- 172.21.15.33:0/2887745266 >> [v2:172.21.15.102:6800/4257223217,v1:172.21.15.102:6801/4257223217] conn(0x7fdcf00adde0 0x7fdcf00b0280 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:03.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.480+0000 7fdcf77fe640 1 -- 172.21.15.33:0/2887745266 <== osd.2 v2:172.21.15.102:6800/4257223217 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdcfc023e50 con 0x7fdcf00adde0 2024-09-12T12:25:03.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.494+0000 7fdd0c86a640 1 -- 172.21.15.33:0/2887745266 --> [v2:172.21.15.102:6800/4257223217,v1:172.21.15.102:6801/4257223217] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdd0806a7f0 con 0x7fdcf00adde0 2024-09-12T12:25:03.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.495+0000 7fdcf77fe640 1 -- 172.21.15.33:0/2887745266 <== osd.2 v2:172.21.15.102:6800/4257223217 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdd0806a7f0 con 0x7fdcf00adde0 2024-09-12T12:25:03.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.495+0000 7fdd0c86a640 1 -- 172.21.15.33:0/2887745266 >> [v2:172.21.15.102:6800/4257223217,v1:172.21.15.102:6801/4257223217] conn(0x7fdcf00adde0 msgr2=0x7fdcf00b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:03.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.495+0000 7fdd0c86a640 1 --2- 172.21.15.33:0/2887745266 >> [v2:172.21.15.102:6800/4257223217,v1:172.21.15.102:6801/4257223217] conn(0x7fdcf00adde0 0x7fdcf00b0280 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:03.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.495+0000 7fdd0c86a640 1 -- 172.21.15.33:0/2887745266 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fdcf00a2c10 msgr2=0x7fdcf00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:03.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.495+0000 7fdd0c86a640 1 --2- 172.21.15.33:0/2887745266 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fdcf00a2c10 0x7fdcf00a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdcf800abe0 tx=0x7fdcf800a2d0 comp rx=0 tx=0).stop 2024-09-12T12:25:03.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.495+0000 7fdd0c86a640 1 -- 172.21.15.33:0/2887745266 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd08103740 msgr2=0x7fdd08198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:03.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.495+0000 7fdd0c86a640 1 --2- 172.21.15.33:0/2887745266 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd08103740 0x7fdd08198960 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc00b9c0 tx=0x7fdcfc00bdc0 comp rx=0 tx=0).stop 2024-09-12T12:25:03.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.495+0000 7fdd06d9d640 1 -- 172.21.15.33:0/2887745266 reap_dead start 2024-09-12T12:25:03.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.495+0000 7fdd0c86a640 1 -- 172.21.15.33:0/2887745266 shutdown_connections 2024-09-12T12:25:03.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.495+0000 7fdd0c86a640 1 -- 172.21.15.33:0/2887745266 >> 172.21.15.33:0/2887745266 conn(0x7fdd080fc7d0 msgr2=0x7fdd08105cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:03.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.495+0000 7fdd0c86a640 1 -- 172.21.15.33:0/2887745266 shutdown_connections 2024-09-12T12:25:03.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:03.495+0000 7fdd0c86a640 1 -- 172.21.15.33:0/2887745266 wait complete. 2024-09-12T12:25:03.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:03 smithi043 ceph-mon[34144]: pgmap v319: 129 pgs: 2 peering, 127 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s; 141 B/s, 0 objects/s recovering 2024-09-12T12:25:04.063 INFO:teuthology.orchestra.run.smithi033.stdout:150323855418 2024-09-12T12:25:04.063 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-12T12:25:04.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:04 smithi033 ceph-mon[31246]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-12T12:25:04.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:04 smithi033 ceph-mon[31246]: Cluster is now healthy 2024-09-12T12:25:04.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.538+0000 7fd90db4f640 1 -- 172.21.15.33:0/2603851750 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd908102d30 msgr2=0x7fd908103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:04.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.538+0000 7fd90db4f640 1 --2- 172.21.15.33:0/2603851750 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd908102d30 0x7fd908103110 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8009930 tx=0x7fd8f802a440 comp rx=0 tx=0).stop 2024-09-12T12:25:04.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.538+0000 7fd90db4f640 1 -- 172.21.15.33:0/2603851750 shutdown_connections 2024-09-12T12:25:04.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.538+0000 7fd90db4f640 1 --2- 172.21.15.33:0/2603851750 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd9081082a0 0x7fd90810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.538+0000 7fd90db4f640 1 --2- 172.21.15.33:0/2603851750 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9081036e0 0x7fd908107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.538+0000 7fd90db4f640 1 --2- 172.21.15.33:0/2603851750 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd908102d30 0x7fd908103110 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.538+0000 7fd90db4f640 1 -- 172.21.15.33:0/2603851750 >> 172.21.15.33:0/2603851750 conn(0x7fd9080fc7d0 msgr2=0x7fd9080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:04.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.538+0000 7fd90db4f640 1 -- 172.21.15.33:0/2603851750 shutdown_connections 2024-09-12T12:25:04.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.538+0000 7fd90db4f640 1 -- 172.21.15.33:0/2603851750 wait complete. 2024-09-12T12:25:04.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.539+0000 7fd90db4f640 1 Processor -- start 2024-09-12T12:25:04.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.539+0000 7fd90db4f640 1 -- start start 2024-09-12T12:25:04.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.539+0000 7fd90db4f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd908102d30 0x7fd908198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:04.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.539+0000 7fd90db4f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9081036e0 0x7fd908198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:04.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.539+0000 7fd90db4f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9081082a0 0x7fd90819cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:04.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.539+0000 7fd90db4f640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd908111fa0 con 0x7fd9081082a0 2024-09-12T12:25:04.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.539+0000 7fd90db4f640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd908111e20 con 0x7fd9081036e0 2024-09-12T12:25:04.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.539+0000 7fd90db4f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd908112120 con 0x7fd908102d30 2024-09-12T12:25:04.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.539+0000 7fd907fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9081082a0 0x7fd90819cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:04.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.539+0000 7fd9077fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd908102d30 0x7fd908198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:04.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.539+0000 7fd907fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9081082a0 0x7fd90819cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57532/0 (socket says 172.21.15.33:57532) 2024-09-12T12:25:04.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.539+0000 7fd907fff640 1 -- 172.21.15.33:0/4141157227 learned_addr learned my addr 172.21.15.33:0/4141157227 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:04.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.539+0000 7fd8fffff640 1 --2- 172.21.15.33:0/4141157227 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9081036e0 0x7fd908198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:04.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.539+0000 7fd907fff640 1 -- 172.21.15.33:0/4141157227 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd908102d30 msgr2=0x7fd908198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:04.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.539+0000 7fd907fff640 1 --2- 172.21.15.33:0/4141157227 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd908102d30 0x7fd908198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.539+0000 7fd907fff640 1 -- 172.21.15.33:0/4141157227 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9081036e0 msgr2=0x7fd908198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:04.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.539+0000 7fd907fff640 1 --2- 172.21.15.33:0/4141157227 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9081036e0 0x7fd908198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.540+0000 7fd907fff640 1 -- 172.21.15.33:0/4141157227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd90819d4c0 con 0x7fd9081082a0 2024-09-12T12:25:04.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.540+0000 7fd907fff640 1 --2- 172.21.15.33:0/4141157227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9081082a0 0x7fd90819cde0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd90000cad0 tx=0x7fd90000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:04.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.540+0000 7fd9057fa640 1 -- 172.21.15.33:0/4141157227 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd90000ae20 con 0x7fd9081082a0 2024-09-12T12:25:04.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.540+0000 7fd9057fa640 1 -- 172.21.15.33:0/4141157227 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd900005020 con 0x7fd9081082a0 2024-09-12T12:25:04.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.540+0000 7fd9057fa640 1 -- 172.21.15.33:0/4141157227 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd90000f6b0 con 0x7fd9081082a0 2024-09-12T12:25:04.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.540+0000 7fd90db4f640 1 -- 172.21.15.33:0/4141157227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd90819d7b0 con 0x7fd9081082a0 2024-09-12T12:25:04.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.540+0000 7fd90db4f640 1 -- 172.21.15.33:0/4141157227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9081a5090 con 0x7fd9081082a0 2024-09-12T12:25:04.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.541+0000 7fd90db4f640 1 -- 172.21.15.33:0/4141157227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd908062980 con 0x7fd9081082a0 2024-09-12T12:25:04.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.542+0000 7fd9057fa640 1 -- 172.21.15.33:0/4141157227 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd9000051d0 con 0x7fd9081082a0 2024-09-12T12:25:04.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.543+0000 7fd9057fa640 1 --2- 172.21.15.33:0/4141157227 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd8f40a2c10 0x7fd8f40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:04.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.543+0000 7fd9077fe640 1 --2- 172.21.15.33:0/4141157227 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd8f40a2c10 0x7fd8f40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:04.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.543+0000 7fd9057fa640 1 -- 172.21.15.33:0/4141157227 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7fd9000cf440 con 0x7fd9081082a0 2024-09-12T12:25:04.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.543+0000 7fd9057fa640 1 --2- 172.21.15.33:0/4141157227 >> [v2:172.21.15.102:6816/1768219597,v1:172.21.15.102:6817/1768219597] conn(0x7fd8f40adde0 0x7fd8f40b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:04.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.543+0000 7fd9057fa640 1 -- 172.21.15.33:0/4141157227 --> [v2:172.21.15.102:6816/1768219597,v1:172.21.15.102:6817/1768219597] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd900004810 con 0x7fd8f40adde0 2024-09-12T12:25:04.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.543+0000 7fd9057fa640 1 -- 172.21.15.33:0/4141157227 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7fd9000d6050 con 0x7fd9081082a0 2024-09-12T12:25:04.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.543+0000 7fd9077fe640 1 --2- 172.21.15.33:0/4141157227 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd8f40a2c10 0x7fd8f40a50d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8006010 tx=0x7fd8f8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:04.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.543+0000 7fd8fffff640 1 --2- 172.21.15.33:0/4141157227 >> [v2:172.21.15.102:6816/1768219597,v1:172.21.15.102:6817/1768219597] conn(0x7fd8f40adde0 0x7fd8f40b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:04.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.544+0000 7fd8fffff640 1 --2- 172.21.15.33:0/4141157227 >> [v2:172.21.15.102:6816/1768219597,v1:172.21.15.102:6817/1768219597] conn(0x7fd8f40adde0 0x7fd8f40b0280 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:04.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.545+0000 7fd9057fa640 1 -- 172.21.15.33:0/4141157227 <== osd.8 v2:172.21.15.102:6816/1768219597 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd900004810 con 0x7fd8f40adde0 2024-09-12T12:25:04.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.558+0000 7fd90db4f640 1 -- 172.21.15.33:0/4141157227 --> [v2:172.21.15.102:6816/1768219597,v1:172.21.15.102:6817/1768219597] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd908062e00 con 0x7fd8f40adde0 2024-09-12T12:25:04.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.559+0000 7fd9057fa640 1 -- 172.21.15.33:0/4141157227 <== osd.8 v2:172.21.15.102:6816/1768219597 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd908062e00 con 0x7fd8f40adde0 2024-09-12T12:25:04.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.559+0000 7fd90db4f640 1 -- 172.21.15.33:0/4141157227 >> [v2:172.21.15.102:6816/1768219597,v1:172.21.15.102:6817/1768219597] conn(0x7fd8f40adde0 msgr2=0x7fd8f40b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:04.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.559+0000 7fd90db4f640 1 --2- 172.21.15.33:0/4141157227 >> [v2:172.21.15.102:6816/1768219597,v1:172.21.15.102:6817/1768219597] conn(0x7fd8f40adde0 0x7fd8f40b0280 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.559+0000 7fd90db4f640 1 -- 172.21.15.33:0/4141157227 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd8f40a2c10 msgr2=0x7fd8f40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:04.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.559+0000 7fd90db4f640 1 --2- 172.21.15.33:0/4141157227 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd8f40a2c10 0x7fd8f40a50d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8006010 tx=0x7fd8f8000bc0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.559+0000 7fd90db4f640 1 -- 172.21.15.33:0/4141157227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9081082a0 msgr2=0x7fd90819cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:04.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.559+0000 7fd90db4f640 1 --2- 172.21.15.33:0/4141157227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9081082a0 0x7fd90819cde0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd90000cad0 tx=0x7fd90000cf90 comp rx=0 tx=0).stop 2024-09-12T12:25:04.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.559+0000 7fd907fff640 1 -- 172.21.15.33:0/4141157227 reap_dead start 2024-09-12T12:25:04.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.559+0000 7fd90db4f640 1 -- 172.21.15.33:0/4141157227 shutdown_connections 2024-09-12T12:25:04.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.559+0000 7fd90db4f640 1 -- 172.21.15.33:0/4141157227 >> 172.21.15.33:0/4141157227 conn(0x7fd9080fc7d0 msgr2=0x7fd908105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:04.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.559+0000 7fd90db4f640 1 -- 172.21.15.33:0/4141157227 shutdown_connections 2024-09-12T12:25:04.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:04.559+0000 7fd90db4f640 1 -- 172.21.15.33:0/4141157227 wait complete. 2024-09-12T12:25:04.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:04 smithi043 ceph-mon[34144]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-12T12:25:04.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:04 smithi043 ceph-mon[34144]: Cluster is now healthy 2024-09-12T12:25:04.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:04 smithi102 ceph-mon[34799]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-12T12:25:04.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:04 smithi102 ceph-mon[34799]: Cluster is now healthy 2024-09-12T12:25:05.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.065+0000 7f86d80b0640 1 -- 172.21.15.33:0/1084423740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86d0102790 msgr2=0x7f86d01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:05.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.065+0000 7f86d80b0640 1 --2- 172.21.15.33:0/1084423740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86d0102790 0x7f86d01067e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f86c0009900 tx=0x7f86c002a410 comp rx=0 tx=0).stop 2024-09-12T12:25:05.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.065+0000 7f86d80b0640 1 -- 172.21.15.33:0/1084423740 shutdown_connections 2024-09-12T12:25:05.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.065+0000 7f86d80b0640 1 --2- 172.21.15.33:0/1084423740 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86d0106f10 0x7f86d010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.065+0000 7f86d80b0640 1 --2- 172.21.15.33:0/1084423740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86d0102790 0x7f86d01067e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.065+0000 7f86d80b0640 1 --2- 172.21.15.33:0/1084423740 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f86d0101de0 0x7f86d01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.065+0000 7f86d80b0640 1 -- 172.21.15.33:0/1084423740 >> 172.21.15.33:0/1084423740 conn(0x7f86d00fd8c0 msgr2=0x7f86d00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:05.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.065+0000 7f86d80b0640 1 -- 172.21.15.33:0/1084423740 shutdown_connections 2024-09-12T12:25:05.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.065+0000 7f86d80b0640 1 -- 172.21.15.33:0/1084423740 wait complete. 2024-09-12T12:25:05.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.066+0000 7f86d80b0640 1 Processor -- start 2024-09-12T12:25:05.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.066+0000 7f86d80b0640 1 -- start start 2024-09-12T12:25:05.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.066+0000 7f86d80b0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86d0101de0 0x7f86d00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:05.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.066+0000 7f86d80b0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86d0102790 0x7f86d0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:05.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.066+0000 7f86d80b0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f86d0106f10 0x7f86d0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:05.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.066+0000 7f86d80b0640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f86d0111e20 con 0x7f86d0102790 2024-09-12T12:25:05.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.066+0000 7f86d80b0640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f86d0111ca0 con 0x7f86d0106f10 2024-09-12T12:25:05.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.066+0000 7f86d80b0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f86d0111fa0 con 0x7f86d0101de0 2024-09-12T12:25:05.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.066+0000 7f86d564b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86d0102790 0x7f86d0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:05.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.066+0000 7f86d564b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86d0102790 0x7f86d0074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57562/0 (socket says 172.21.15.33:57562) 2024-09-12T12:25:05.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.066+0000 7f86d564b640 1 -- 172.21.15.33:0/2034595368 learned_addr learned my addr 172.21.15.33:0/2034595368 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:05.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.067+0000 7f86d5e4c640 1 --2- 172.21.15.33:0/2034595368 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86d0101de0 0x7f86d00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:05.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.067+0000 7f86d664d640 1 --2- 172.21.15.33:0/2034595368 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f86d0106f10 0x7f86d0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:05.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.067+0000 7f86d564b640 1 -- 172.21.15.33:0/2034595368 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86d0101de0 msgr2=0x7f86d00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:05.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.067+0000 7f86d564b640 1 --2- 172.21.15.33:0/2034595368 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86d0101de0 0x7f86d00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.067+0000 7f86d564b640 1 -- 172.21.15.33:0/2034595368 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f86d0106f10 msgr2=0x7f86d0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:05.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.067+0000 7f86d564b640 1 --2- 172.21.15.33:0/2034595368 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f86d0106f10 0x7f86d0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.067+0000 7f86d564b640 1 -- 172.21.15.33:0/2034595368 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86d01a67d0 con 0x7f86d0102790 2024-09-12T12:25:05.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.067+0000 7f86d564b640 1 --2- 172.21.15.33:0/2034595368 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86d0102790 0x7f86d0074a30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f86c0005940 tx=0x7f86c0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:05.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.067+0000 7f86c6ffd640 1 -- 172.21.15.33:0/2034595368 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c003f030 con 0x7f86d0102790 2024-09-12T12:25:05.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.067+0000 7f86c6ffd640 1 -- 172.21.15.33:0/2034595368 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f86c0003aa0 con 0x7f86d0102790 2024-09-12T12:25:05.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.067+0000 7f86d80b0640 1 -- 172.21.15.33:0/2034595368 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86d01a6a60 con 0x7f86d0102790 2024-09-12T12:25:05.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.067+0000 7f86c6ffd640 1 -- 172.21.15.33:0/2034595368 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c0035070 con 0x7f86d0102790 2024-09-12T12:25:05.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.067+0000 7f86d80b0640 1 -- 172.21.15.33:0/2034595368 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86d01a6f90 con 0x7f86d0102790 2024-09-12T12:25:05.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.068+0000 7f86d80b0640 1 -- 172.21.15.33:0/2034595368 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f86d0062900 con 0x7f86d0102790 2024-09-12T12:25:05.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.070+0000 7f86c6ffd640 1 -- 172.21.15.33:0/2034595368 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f86c0042030 con 0x7f86d0102790 2024-09-12T12:25:05.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.070+0000 7f86c6ffd640 1 --2- 172.21.15.33:0/2034595368 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f86bc0a2c90 0x7f86bc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:05.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.070+0000 7f86c6ffd640 1 -- 172.21.15.33:0/2034595368 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7f86c00f0320 con 0x7f86d0102790 2024-09-12T12:25:05.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.070+0000 7f86d5e4c640 1 --2- 172.21.15.33:0/2034595368 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f86bc0a2c90 0x7f86bc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:05.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.070+0000 7f86c6ffd640 1 --2- 172.21.15.33:0/2034595368 >> [v2:172.21.15.33:6826/973136168,v1:172.21.15.33:6827/973136168] conn(0x7f86bc0ade60 0x7f86bc0b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:05.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.070+0000 7f86c6ffd640 1 -- 172.21.15.33:0/2034595368 --> [v2:172.21.15.33:6826/973136168,v1:172.21.15.33:6827/973136168] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f86bc0b09d0 con 0x7f86bc0ade60 2024-09-12T12:25:05.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.070+0000 7f86c6ffd640 1 -- 172.21.15.33:0/2034595368 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f86c00f06d0 con 0x7f86d0102790 2024-09-12T12:25:05.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.071+0000 7f86d664d640 1 --2- 172.21.15.33:0/2034595368 >> [v2:172.21.15.33:6826/973136168,v1:172.21.15.33:6827/973136168] conn(0x7f86bc0ade60 0x7f86bc0b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:05.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.071+0000 7f86d5e4c640 1 --2- 172.21.15.33:0/2034595368 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f86bc0a2c90 0x7f86bc0a5150 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f86cc005d00 tx=0x7f86cc00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:05.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.071+0000 7f86d664d640 1 --2- 172.21.15.33:0/2034595368 >> [v2:172.21.15.33:6826/973136168,v1:172.21.15.33:6827/973136168] conn(0x7f86bc0ade60 0x7f86bc0b0300 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:05.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.072+0000 7f86c6ffd640 1 -- 172.21.15.33:0/2034595368 <== osd.9 v2:172.21.15.33:6826/973136168 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f86bc0b09d0 con 0x7f86bc0ade60 2024-09-12T12:25:05.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.085+0000 7f86d80b0640 1 -- 172.21.15.33:0/2034595368 --> [v2:172.21.15.33:6826/973136168,v1:172.21.15.33:6827/973136168] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f86d0062d00 con 0x7f86bc0ade60 2024-09-12T12:25:05.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.086+0000 7f86c6ffd640 1 -- 172.21.15.33:0/2034595368 <== osd.9 v2:172.21.15.33:6826/973136168 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f86d0062d00 con 0x7f86bc0ade60 2024-09-12T12:25:05.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.086+0000 7f86d80b0640 1 -- 172.21.15.33:0/2034595368 >> [v2:172.21.15.33:6826/973136168,v1:172.21.15.33:6827/973136168] conn(0x7f86bc0ade60 msgr2=0x7f86bc0b0300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:05.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.086+0000 7f86d80b0640 1 --2- 172.21.15.33:0/2034595368 >> [v2:172.21.15.33:6826/973136168,v1:172.21.15.33:6827/973136168] conn(0x7f86bc0ade60 0x7f86bc0b0300 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.086+0000 7f86d80b0640 1 -- 172.21.15.33:0/2034595368 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f86bc0a2c90 msgr2=0x7f86bc0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:05.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.086+0000 7f86d80b0640 1 --2- 172.21.15.33:0/2034595368 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f86bc0a2c90 0x7f86bc0a5150 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f86cc005d00 tx=0x7f86cc00b410 comp rx=0 tx=0).stop 2024-09-12T12:25:05.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.086+0000 7f86d80b0640 1 -- 172.21.15.33:0/2034595368 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86d0102790 msgr2=0x7f86d0074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:05.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.086+0000 7f86d80b0640 1 --2- 172.21.15.33:0/2034595368 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86d0102790 0x7f86d0074a30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f86c0005940 tx=0x7f86c0004270 comp rx=0 tx=0).stop 2024-09-12T12:25:05.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.086+0000 7f86d664d640 1 -- 172.21.15.33:0/2034595368 reap_dead start 2024-09-12T12:25:05.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.086+0000 7f86d80b0640 1 -- 172.21.15.33:0/2034595368 shutdown_connections 2024-09-12T12:25:05.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.086+0000 7f86d80b0640 1 -- 172.21.15.33:0/2034595368 >> 172.21.15.33:0/2034595368 conn(0x7f86d00fd8c0 msgr2=0x7f86d00feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:05.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.086+0000 7f86d80b0640 1 -- 172.21.15.33:0/2034595368 shutdown_connections 2024-09-12T12:25:05.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.086+0000 7f86d80b0640 1 -- 172.21.15.33:0/2034595368 wait complete. 2024-09-12T12:25:05.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:05 smithi033 ceph-mon[31246]: pgmap v320: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s; 155 B/s, 1 keys/s, 1 objects/s recovering 2024-09-12T12:25:05.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.538+0000 7fd609224640 1 -- 172.21.15.33:0/2201064731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd604101de0 msgr2=0x7fd6041021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:05.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.538+0000 7fd609224640 1 --2- 172.21.15.33:0/2201064731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd604101de0 0x7fd6041021c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4009900 tx=0x7fd5f402a410 comp rx=0 tx=0).stop 2024-09-12T12:25:05.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.538+0000 7fd609224640 1 -- 172.21.15.33:0/2201064731 shutdown_connections 2024-09-12T12:25:05.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.538+0000 7fd609224640 1 --2- 172.21.15.33:0/2201064731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd604106f10 0x7fd60410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.538+0000 7fd609224640 1 --2- 172.21.15.33:0/2201064731 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd604102790 0x7fd6041067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.538+0000 7fd609224640 1 --2- 172.21.15.33:0/2201064731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd604101de0 0x7fd6041021c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.538+0000 7fd609224640 1 -- 172.21.15.33:0/2201064731 >> 172.21.15.33:0/2201064731 conn(0x7fd6040fd8c0 msgr2=0x7fd6040ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:05.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.538+0000 7fd609224640 1 -- 172.21.15.33:0/2201064731 shutdown_connections 2024-09-12T12:25:05.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.538+0000 7fd609224640 1 -- 172.21.15.33:0/2201064731 wait complete. 2024-09-12T12:25:05.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.539+0000 7fd609224640 1 Processor -- start 2024-09-12T12:25:05.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.539+0000 7fd609224640 1 -- start start 2024-09-12T12:25:05.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.539+0000 7fd609224640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd604101de0 0x7fd604198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:05.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.539+0000 7fd609224640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd604102790 0x7fd6041988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:05.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.539+0000 7fd609224640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd604106f10 0x7fd60419cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:05.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.539+0000 7fd609224640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd604111e20 con 0x7fd604102790 2024-09-12T12:25:05.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.539+0000 7fd609224640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd604111ca0 con 0x7fd604106f10 2024-09-12T12:25:05.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.539+0000 7fd609224640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd604111fa0 con 0x7fd604101de0 2024-09-12T12:25:05.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.539+0000 7fd5fbfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd604102790 0x7fd6041988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:05.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.539+0000 7fd5fbfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd604102790 0x7fd6041988c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57588/0 (socket says 172.21.15.33:57588) 2024-09-12T12:25:05.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.539+0000 7fd5fbfff640 1 -- 172.21.15.33:0/1563729947 learned_addr learned my addr 172.21.15.33:0/1563729947 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:05.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.539+0000 7fd602d9d640 1 --2- 172.21.15.33:0/1563729947 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd604101de0 0x7fd604198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:05.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.539+0000 7fd60359e640 1 --2- 172.21.15.33:0/1563729947 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd604106f10 0x7fd60419cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:05.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.540+0000 7fd5fbfff640 1 -- 172.21.15.33:0/1563729947 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd604101de0 msgr2=0x7fd604198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:05.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.540+0000 7fd5fbfff640 1 --2- 172.21.15.33:0/1563729947 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd604101de0 0x7fd604198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.540+0000 7fd5fbfff640 1 -- 172.21.15.33:0/1563729947 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd604106f10 msgr2=0x7fd60419cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:05.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.540+0000 7fd5fbfff640 1 --2- 172.21.15.33:0/1563729947 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd604106f10 0x7fd60419cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.540+0000 7fd5fbfff640 1 -- 172.21.15.33:0/1563729947 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd60419d330 con 0x7fd604102790 2024-09-12T12:25:05.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.540+0000 7fd60359e640 1 --2- 172.21.15.33:0/1563729947 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd604106f10 0x7fd60419cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:05.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.540+0000 7fd5fbfff640 1 --2- 172.21.15.33:0/1563729947 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd604102790 0x7fd6041988c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec00c890 tx=0x7fd5ec00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:05.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.540+0000 7fd600d99640 1 -- 172.21.15.33:0/1563729947 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec004220 con 0x7fd604102790 2024-09-12T12:25:05.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.540+0000 7fd600d99640 1 -- 172.21.15.33:0/1563729947 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd5ec0043c0 con 0x7fd604102790 2024-09-12T12:25:05.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.540+0000 7fd609224640 1 -- 172.21.15.33:0/1563729947 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd60419d620 con 0x7fd604102790 2024-09-12T12:25:05.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.540+0000 7fd600d99640 1 -- 172.21.15.33:0/1563729947 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec004a00 con 0x7fd604102790 2024-09-12T12:25:05.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.540+0000 7fd609224640 1 -- 172.21.15.33:0/1563729947 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6041a4f00 con 0x7fd604102790 2024-09-12T12:25:05.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.541+0000 7fd609224640 1 -- 172.21.15.33:0/1563729947 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd604062940 con 0x7fd604102790 2024-09-12T12:25:05.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.542+0000 7fd600d99640 1 -- 172.21.15.33:0/1563729947 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd5ec004ba0 con 0x7fd604102790 2024-09-12T12:25:05.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.543+0000 7fd600d99640 1 --2- 172.21.15.33:0/1563729947 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd5f00a2c10 0x7fd5f00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:05.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.543+0000 7fd602d9d640 1 --2- 172.21.15.33:0/1563729947 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd5f00a2c10 0x7fd5f00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:05.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.543+0000 7fd600d99640 1 -- 172.21.15.33:0/1563729947 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7fd5ec0cf250 con 0x7fd604102790 2024-09-12T12:25:05.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.543+0000 7fd600d99640 1 --2- 172.21.15.33:0/1563729947 >> [v2:172.21.15.43:6816/392537201,v1:172.21.15.43:6817/392537201] conn(0x7fd5f00adde0 0x7fd5f00b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:05.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.543+0000 7fd600d99640 1 -- 172.21.15.33:0/1563729947 --> [v2:172.21.15.43:6816/392537201,v1:172.21.15.43:6817/392537201] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd5f00b0950 con 0x7fd5f00adde0 2024-09-12T12:25:05.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.543+0000 7fd600d99640 1 -- 172.21.15.33:0/1563729947 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7fd5ec0d6050 con 0x7fd604102790 2024-09-12T12:25:05.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.543+0000 7fd602d9d640 1 --2- 172.21.15.33:0/1563729947 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd5f00a2c10 0x7fd5f00a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4031440 tx=0x7fd5f4005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:05.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.543+0000 7fd60359e640 1 --2- 172.21.15.33:0/1563729947 >> [v2:172.21.15.43:6816/392537201,v1:172.21.15.43:6817/392537201] conn(0x7fd5f00adde0 0x7fd5f00b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:05.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.544+0000 7fd60359e640 1 --2- 172.21.15.33:0/1563729947 >> [v2:172.21.15.43:6816/392537201,v1:172.21.15.43:6817/392537201] conn(0x7fd5f00adde0 0x7fd5f00b0280 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:05.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.545+0000 7fd600d99640 1 -- 172.21.15.33:0/1563729947 <== osd.7 v2:172.21.15.43:6816/392537201 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd5f00b0950 con 0x7fd5f00adde0 2024-09-12T12:25:05.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.558+0000 7fd609224640 1 -- 172.21.15.33:0/1563729947 --> [v2:172.21.15.43:6816/392537201,v1:172.21.15.43:6817/392537201] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd604062dc0 con 0x7fd5f00adde0 2024-09-12T12:25:05.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.559+0000 7fd600d99640 1 -- 172.21.15.33:0/1563729947 <== osd.7 v2:172.21.15.43:6816/392537201 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd604062dc0 con 0x7fd5f00adde0 2024-09-12T12:25:05.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.559+0000 7fd609224640 1 -- 172.21.15.33:0/1563729947 >> [v2:172.21.15.43:6816/392537201,v1:172.21.15.43:6817/392537201] conn(0x7fd5f00adde0 msgr2=0x7fd5f00b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:05.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.559+0000 7fd609224640 1 --2- 172.21.15.33:0/1563729947 >> [v2:172.21.15.43:6816/392537201,v1:172.21.15.43:6817/392537201] conn(0x7fd5f00adde0 0x7fd5f00b0280 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.559+0000 7fd609224640 1 -- 172.21.15.33:0/1563729947 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd5f00a2c10 msgr2=0x7fd5f00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:05.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.559+0000 7fd609224640 1 --2- 172.21.15.33:0/1563729947 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd5f00a2c10 0x7fd5f00a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4031440 tx=0x7fd5f4005b50 comp rx=0 tx=0).stop 2024-09-12T12:25:05.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.559+0000 7fd609224640 1 -- 172.21.15.33:0/1563729947 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd604102790 msgr2=0x7fd6041988c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:05.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.559+0000 7fd609224640 1 --2- 172.21.15.33:0/1563729947 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd604102790 0x7fd6041988c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec00c890 tx=0x7fd5ec00cd50 comp rx=0 tx=0).stop 2024-09-12T12:25:05.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.559+0000 7fd60359e640 1 -- 172.21.15.33:0/1563729947 reap_dead start 2024-09-12T12:25:05.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.559+0000 7fd609224640 1 -- 172.21.15.33:0/1563729947 shutdown_connections 2024-09-12T12:25:05.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.559+0000 7fd609224640 1 -- 172.21.15.33:0/1563729947 >> 172.21.15.33:0/1563729947 conn(0x7fd6040fd8c0 msgr2=0x7fd6040fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:05.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.559+0000 7fd609224640 1 -- 172.21.15.33:0/1563729947 shutdown_connections 2024-09-12T12:25:05.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:05.559+0000 7fd609224640 1 -- 172.21.15.33:0/1563729947 wait complete. 2024-09-12T12:25:05.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:05 smithi043 ceph-mon[34144]: pgmap v320: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s; 155 B/s, 1 keys/s, 1 objects/s recovering 2024-09-12T12:25:05.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:05 smithi102 ceph-mon[34799]: pgmap v320: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s; 155 B/s, 1 keys/s, 1 objects/s recovering 2024-09-12T12:25:06.232 INFO:teuthology.orchestra.run.smithi033.stdout:283467841568 2024-09-12T12:25:06.232 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-12T12:25:06.650 INFO:teuthology.orchestra.run.smithi033.stdout:98784247876 2024-09-12T12:25:06.650 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-12T12:25:07.065 INFO:teuthology.orchestra.run.smithi033.stdout:73014444106 2024-09-12T12:25:07.066 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-12T12:25:07.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:07 smithi033 ceph-mon[31246]: pgmap v321: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s; 155 B/s, 1 keys/s, 1 objects/s recovering 2024-09-12T12:25:07.583 INFO:teuthology.orchestra.run.smithi033.stdout:231928234027 2024-09-12T12:25:07.583 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-12T12:25:07.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:07 smithi043 ceph-mon[34144]: pgmap v321: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s; 155 B/s, 1 keys/s, 1 objects/s recovering 2024-09-12T12:25:07.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:07 smithi102 ceph-mon[34799]: pgmap v321: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s; 155 B/s, 1 keys/s, 1 objects/s recovering 2024-09-12T12:25:08.039 INFO:teuthology.orchestra.run.smithi033.stdout:261993005095 2024-09-12T12:25:08.039 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-12T12:25:08.467 INFO:teuthology.orchestra.run.smithi033.stdout:201863462960 2024-09-12T12:25:08.467 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-12T12:25:08.580 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:08.581 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:08.582 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:08.594 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:08.598 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:08.598 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:08.599 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:08.604 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:08.683 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:09.332 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:09 smithi033 ceph-mon[31246]: pgmap v322: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s; 127 B/s, 1 keys/s, 1 objects/s recovering 2024-09-12T12:25:09.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.349+0000 7fdee725f640 1 -- 172.21.15.33:0/3524107100 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdee0101de0 msgr2=0x7fdee01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:09.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.349+0000 7fdee725f640 1 --2- 172.21.15.33:0/3524107100 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdee0101de0 0x7fdee01021c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fded4009900 tx=0x7fded402a410 comp rx=0 tx=0).stop 2024-09-12T12:25:09.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.349+0000 7fdee725f640 1 -- 172.21.15.33:0/3524107100 shutdown_connections 2024-09-12T12:25:09.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.349+0000 7fdee725f640 1 --2- 172.21.15.33:0/3524107100 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdee0106f10 0x7fdee010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.349+0000 7fdee725f640 1 --2- 172.21.15.33:0/3524107100 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdee0102790 0x7fdee01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.349+0000 7fdee725f640 1 --2- 172.21.15.33:0/3524107100 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdee0101de0 0x7fdee01021c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.349+0000 7fdee725f640 1 -- 172.21.15.33:0/3524107100 >> 172.21.15.33:0/3524107100 conn(0x7fdee00fd880 msgr2=0x7fdee00ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:09.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.349+0000 7fdee725f640 1 -- 172.21.15.33:0/3524107100 shutdown_connections 2024-09-12T12:25:09.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.349+0000 7fdee725f640 1 -- 172.21.15.33:0/3524107100 wait complete. 2024-09-12T12:25:09.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.350+0000 7fdee725f640 1 Processor -- start 2024-09-12T12:25:09.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.350+0000 7fdee725f640 1 -- start start 2024-09-12T12:25:09.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.350+0000 7fdee725f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdee0101de0 0x7fdee0198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:09.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.350+0000 7fdee725f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdee0102790 0x7fdee01988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:09.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.350+0000 7fdee725f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdee0106f10 0x7fdee019cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:09.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.350+0000 7fdee725f640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fdee0111de0 con 0x7fdee0102790 2024-09-12T12:25:09.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.350+0000 7fdee725f640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdee0111c60 con 0x7fdee0101de0 2024-09-12T12:25:09.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.350+0000 7fdee725f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdee0111f60 con 0x7fdee0106f10 2024-09-12T12:25:09.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.350+0000 7fdedffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdee0102790 0x7fdee01988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:09.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.350+0000 7fdedffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdee0102790 0x7fdee01988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57616/0 (socket says 172.21.15.33:57616) 2024-09-12T12:25:09.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.350+0000 7fdedffff640 1 -- 172.21.15.33:0/3699862847 learned_addr learned my addr 172.21.15.33:0/3699862847 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:09.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.350+0000 7fdee4ffb640 1 --2- 172.21.15.33:0/3699862847 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdee0101de0 0x7fdee0198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:09.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.351+0000 7fdee57fc640 1 --2- 172.21.15.33:0/3699862847 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdee0106f10 0x7fdee019cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:09.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.351+0000 7fdedffff640 1 -- 172.21.15.33:0/3699862847 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdee0106f10 msgr2=0x7fdee019cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:09.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.351+0000 7fdedffff640 1 --2- 172.21.15.33:0/3699862847 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdee0106f10 0x7fdee019cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.351+0000 7fdedffff640 1 -- 172.21.15.33:0/3699862847 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdee0101de0 msgr2=0x7fdee0198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:09.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.351+0000 7fdedffff640 1 --2- 172.21.15.33:0/3699862847 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdee0101de0 0x7fdee0198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.351+0000 7fdedffff640 1 -- 172.21.15.33:0/3699862847 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee019d320 con 0x7fdee0102790 2024-09-12T12:25:09.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.351+0000 7fdee57fc640 1 --2- 172.21.15.33:0/3699862847 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdee0106f10 0x7fdee019cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:09.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.351+0000 7fdedffff640 1 --2- 172.21.15.33:0/3699862847 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdee0102790 0x7fdee01988b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fdecc00d950 tx=0x7fdecc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:09.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.351+0000 7fdeddffb640 1 -- 172.21.15.33:0/3699862847 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdecc017070 con 0x7fdee0102790 2024-09-12T12:25:09.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.351+0000 7fdeddffb640 1 -- 172.21.15.33:0/3699862847 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdecc009c30 con 0x7fdee0102790 2024-09-12T12:25:09.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.351+0000 7fdee725f640 1 -- 172.21.15.33:0/3699862847 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdee019d610 con 0x7fdee0102790 2024-09-12T12:25:09.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.351+0000 7fdeddffb640 1 -- 172.21.15.33:0/3699862847 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdecc00f620 con 0x7fdee0102790 2024-09-12T12:25:09.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.351+0000 7fdee725f640 1 -- 172.21.15.33:0/3699862847 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdee01a4ef0 con 0x7fdee0102790 2024-09-12T12:25:09.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.352+0000 7fdee725f640 1 -- 172.21.15.33:0/3699862847 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdee01021c0 con 0x7fdee0102790 2024-09-12T12:25:09.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.354+0000 7fdeddffb640 1 -- 172.21.15.33:0/3699862847 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fdecc0109a0 con 0x7fdee0102790 2024-09-12T12:25:09.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.354+0000 7fdeddffb640 1 --2- 172.21.15.33:0/3699862847 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fded00a2c10 0x7fded00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:09.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.354+0000 7fdee4ffb640 1 --2- 172.21.15.33:0/3699862847 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fded00a2c10 0x7fded00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:09.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.354+0000 7fdeddffb640 1 -- 172.21.15.33:0/3699862847 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7fdecc0cf180 con 0x7fdee0102790 2024-09-12T12:25:09.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.355+0000 7fdee4ffb640 1 --2- 172.21.15.33:0/3699862847 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fded00a2c10 0x7fded00a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fded4031440 tx=0x7fded4005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:09.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.363+0000 7fdeddffb640 1 -- 172.21.15.33:0/3699862847 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdecc009de0 con 0x7fdee0102790 2024-09-12T12:25:09.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.544+0000 7fdee725f640 1 -- 172.21.15.33:0/3699862847 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fdee010a150 con 0x7fdee0102790 2024-09-12T12:25:09.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.544+0000 7fdeddffb640 1 -- 172.21.15.33:0/3699862847 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fdecc09bc20 con 0x7fdee0102790 2024-09-12T12:25:09.545 INFO:teuthology.orchestra.run.smithi033.stdout:150323855420 2024-09-12T12:25:09.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.546+0000 7fdee725f640 1 -- 172.21.15.33:0/3699862847 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fded00a2c10 msgr2=0x7fded00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:09.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.546+0000 7fdee725f640 1 --2- 172.21.15.33:0/3699862847 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fded00a2c10 0x7fded00a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fded4031440 tx=0x7fded4005b50 comp rx=0 tx=0).stop 2024-09-12T12:25:09.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.546+0000 7fdee725f640 1 -- 172.21.15.33:0/3699862847 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdee0102790 msgr2=0x7fdee01988b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:09.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.546+0000 7fdee725f640 1 --2- 172.21.15.33:0/3699862847 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdee0102790 0x7fdee01988b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fdecc00d950 tx=0x7fdecc00de10 comp rx=0 tx=0).stop 2024-09-12T12:25:09.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.546+0000 7fdee725f640 1 -- 172.21.15.33:0/3699862847 shutdown_connections 2024-09-12T12:25:09.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.546+0000 7fdee725f640 1 --2- 172.21.15.33:0/3699862847 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fded00a2c10 0x7fded00a50d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.546+0000 7fdee725f640 1 --2- 172.21.15.33:0/3699862847 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdee0106f10 0x7fdee019cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.546+0000 7fdee725f640 1 --2- 172.21.15.33:0/3699862847 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdee0102790 0x7fdee01988b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.546+0000 7fdee725f640 1 --2- 172.21.15.33:0/3699862847 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdee0101de0 0x7fdee0198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.546+0000 7fdee725f640 1 -- 172.21.15.33:0/3699862847 >> 172.21.15.33:0/3699862847 conn(0x7fdee00fd880 msgr2=0x7fdee00fed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:09.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.546+0000 7fdee725f640 1 -- 172.21.15.33:0/3699862847 shutdown_connections 2024-09-12T12:25:09.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:09.546+0000 7fdee725f640 1 -- 172.21.15.33:0/3699862847 wait complete. 2024-09-12T12:25:09.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:09 smithi043 ceph-mon[34144]: pgmap v322: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s; 127 B/s, 1 keys/s, 1 objects/s recovering 2024-09-12T12:25:09.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:09 smithi102 ceph-mon[34799]: pgmap v322: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s; 127 B/s, 1 keys/s, 1 objects/s recovering 2024-09-12T12:25:10.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.139+0000 7f9bab239640 1 -- 172.21.15.33:0/3388746207 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ba4102ef0 msgr2=0x7f9ba410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:10.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.139+0000 7f9bab239640 1 --2- 172.21.15.33:0/3388746207 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ba4102ef0 0x7f9ba410da40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c009ca0 tx=0x7f9b9c02a950 comp rx=0 tx=0).stop 2024-09-12T12:25:10.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.139+0000 7f9bab239640 1 -- 172.21.15.33:0/3388746207 shutdown_connections 2024-09-12T12:25:10.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.139+0000 7f9bab239640 1 --2- 172.21.15.33:0/3388746207 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ba4102ef0 0x7f9ba410da40 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:10.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.139+0000 7f9bab239640 1 --2- 172.21.15.33:0/3388746207 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ba4102570 0x7f9ba41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:10.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.139+0000 7f9bab239640 1 --2- 172.21.15.33:0/3388746207 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ba4100e20 0x7f9ba4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:10.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.139+0000 7f9bab239640 1 -- 172.21.15.33:0/3388746207 >> 172.21.15.33:0/3388746207 conn(0x7f9ba40fc7d0 msgr2=0x7f9ba40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:10.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.139+0000 7f9bab239640 1 -- 172.21.15.33:0/3388746207 shutdown_connections 2024-09-12T12:25:10.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.139+0000 7f9bab239640 1 -- 172.21.15.33:0/3388746207 wait complete. 2024-09-12T12:25:10.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.140+0000 7f9bab239640 1 Processor -- start 2024-09-12T12:25:10.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.140+0000 7f9bab239640 1 -- start start 2024-09-12T12:25:10.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.140+0000 7f9bab239640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ba4100e20 0x7f9ba40fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:10.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.140+0000 7f9bab239640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ba4102570 0x7f9ba40fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:10.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.140+0000 7f9bab239640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ba4102ef0 0x7f9ba40fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:10.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.140+0000 7f9bab239640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba4110e30 con 0x7f9ba4102ef0 2024-09-12T12:25:10.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.140+0000 7f9bab239640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba4110cb0 con 0x7f9ba4100e20 2024-09-12T12:25:10.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.140+0000 7f9bab239640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba4110fb0 con 0x7f9ba4102570 2024-09-12T12:25:10.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.140+0000 7f9ba97d6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ba4102ef0 0x7f9ba40fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:10.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.140+0000 7f9ba97d6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ba4102ef0 0x7f9ba40fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57626/0 (socket says 172.21.15.33:57626) 2024-09-12T12:25:10.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.140+0000 7f9ba97d6640 1 -- 172.21.15.33:0/3291210227 learned_addr learned my addr 172.21.15.33:0/3291210227 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:10.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.140+0000 7f9ba8fd5640 1 --2- 172.21.15.33:0/3291210227 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ba4100e20 0x7f9ba40fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:10.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.140+0000 7f9ba3fff640 1 --2- 172.21.15.33:0/3291210227 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ba4102570 0x7f9ba40fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:10.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.140+0000 7f9ba97d6640 1 -- 172.21.15.33:0/3291210227 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ba4102570 msgr2=0x7f9ba40fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:10.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.140+0000 7f9ba97d6640 1 --2- 172.21.15.33:0/3291210227 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ba4102570 0x7f9ba40fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:10.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.140+0000 7f9ba97d6640 1 -- 172.21.15.33:0/3291210227 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ba4100e20 msgr2=0x7f9ba40fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:10.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.140+0000 7f9ba97d6640 1 --2- 172.21.15.33:0/3291210227 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ba4100e20 0x7f9ba40fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:10.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.140+0000 7f9ba97d6640 1 -- 172.21.15.33:0/3291210227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba41a6870 con 0x7f9ba4102ef0 2024-09-12T12:25:10.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.140+0000 7f9ba3fff640 1 --2- 172.21.15.33:0/3291210227 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ba4102570 0x7f9ba40fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:25:10.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.140+0000 7f9ba8fd5640 1 --2- 172.21.15.33:0/3291210227 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ba4100e20 0x7f9ba40fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:10.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.141+0000 7f9ba97d6640 1 --2- 172.21.15.33:0/3291210227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ba4102ef0 0x7f9ba40fd700 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c004af0 tx=0x7f9b9c02f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:10.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.141+0000 7f9ba1ffb640 1 -- 172.21.15.33:0/3291210227 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c034040 con 0x7f9ba4102ef0 2024-09-12T12:25:10.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.141+0000 7f9ba1ffb640 1 -- 172.21.15.33:0/3291210227 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9b9c0308f0 con 0x7f9ba4102ef0 2024-09-12T12:25:10.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.141+0000 7f9bab239640 1 -- 172.21.15.33:0/3291210227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ba41a6b00 con 0x7f9ba4102ef0 2024-09-12T12:25:10.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.141+0000 7f9ba1ffb640 1 -- 172.21.15.33:0/3291210227 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c004670 con 0x7f9ba4102ef0 2024-09-12T12:25:10.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.141+0000 7f9bab239640 1 -- 172.21.15.33:0/3291210227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ba41a6fe0 con 0x7f9ba4102ef0 2024-09-12T12:25:10.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.142+0000 7f9bab239640 1 -- 172.21.15.33:0/3291210227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ba4101200 con 0x7f9ba4102ef0 2024-09-12T12:25:10.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.144+0000 7f9ba1ffb640 1 -- 172.21.15.33:0/3291210227 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f9b9c037020 con 0x7f9ba4102ef0 2024-09-12T12:25:10.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.145+0000 7f9ba1ffb640 1 --2- 172.21.15.33:0/3291210227 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f9b940a2c10 0x7f9b940a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:10.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.145+0000 7f9ba1ffb640 1 -- 172.21.15.33:0/3291210227 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7f9b9c0f0630 con 0x7f9ba4102ef0 2024-09-12T12:25:10.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.145+0000 7f9ba8fd5640 1 --2- 172.21.15.33:0/3291210227 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f9b940a2c10 0x7f9b940a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:10.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.145+0000 7f9ba8fd5640 1 --2- 172.21.15.33:0/3291210227 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f9b940a2c10 0x7f9b940a50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9b980058c0 tx=0x7f9b98005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:10.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.147+0000 7f9ba1ffb640 1 -- 172.21.15.33:0/3291210227 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9b9c0811b0 con 0x7f9ba4102ef0 2024-09-12T12:25:10.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.326+0000 7f9bab239640 1 -- 172.21.15.33:0/3291210227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f9ba410a0a0 con 0x7f9ba4102ef0 2024-09-12T12:25:10.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.326+0000 7f9ba1ffb640 1 -- 172.21.15.33:0/3291210227 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9b9c0bd1e0 con 0x7f9ba4102ef0 2024-09-12T12:25:10.328 INFO:teuthology.orchestra.run.smithi033.stdout:98784247878 2024-09-12T12:25:10.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.329+0000 7f9bab239640 1 -- 172.21.15.33:0/3291210227 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f9b940a2c10 msgr2=0x7f9b940a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:10.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.329+0000 7f9bab239640 1 --2- 172.21.15.33:0/3291210227 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f9b940a2c10 0x7f9b940a50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9b980058c0 tx=0x7f9b98005850 comp rx=0 tx=0).stop 2024-09-12T12:25:10.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.329+0000 7f9bab239640 1 -- 172.21.15.33:0/3291210227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ba4102ef0 msgr2=0x7f9ba40fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:10.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.329+0000 7f9bab239640 1 --2- 172.21.15.33:0/3291210227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ba4102ef0 0x7f9ba40fd700 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c004af0 tx=0x7f9b9c02f5d0 comp rx=0 tx=0).stop 2024-09-12T12:25:10.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.329+0000 7f9bab239640 1 -- 172.21.15.33:0/3291210227 shutdown_connections 2024-09-12T12:25:10.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.329+0000 7f9bab239640 1 --2- 172.21.15.33:0/3291210227 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f9b940a2c10 0x7f9b940a50d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:10.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.329+0000 7f9bab239640 1 --2- 172.21.15.33:0/3291210227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ba4102ef0 0x7f9ba40fd700 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:10.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.329+0000 7f9bab239640 1 --2- 172.21.15.33:0/3291210227 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ba4102570 0x7f9ba40fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:10.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.329+0000 7f9bab239640 1 --2- 172.21.15.33:0/3291210227 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ba4100e20 0x7f9ba40fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:10.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.329+0000 7f9bab239640 1 -- 172.21.15.33:0/3291210227 >> 172.21.15.33:0/3291210227 conn(0x7f9ba40fc7d0 msgr2=0x7f9ba406a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:10.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.329+0000 7f9bab239640 1 -- 172.21.15.33:0/3291210227 shutdown_connections 2024-09-12T12:25:10.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:10.329+0000 7f9bab239640 1 -- 172.21.15.33:0/3291210227 wait complete. 2024-09-12T12:25:10.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:10 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/3699862847' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-12T12:25:10.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:10 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/3699862847' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-12T12:25:10.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:10 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/3699862847' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-12T12:25:11.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.135+0000 7f72b4631640 1 -- 172.21.15.33:0/1338617126 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72ac1008d0 msgr2=0x7f72ac100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:11.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.135+0000 7f72b4631640 1 --2- 172.21.15.33:0/1338617126 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72ac1008d0 0x7f72ac100cb0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f72a8009900 tx=0x7f72a802a410 comp rx=0 tx=0).stop 2024-09-12T12:25:11.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.135+0000 7f72b4631640 1 -- 172.21.15.33:0/1338617126 shutdown_connections 2024-09-12T12:25:11.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.135+0000 7f72b4631640 1 --2- 172.21.15.33:0/1338617126 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72ac10e480 0x7f72ac110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.135+0000 7f72b4631640 1 --2- 172.21.15.33:0/1338617126 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72ac101280 0x7f72ac10df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.135+0000 7f72b4631640 1 --2- 172.21.15.33:0/1338617126 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72ac1008d0 0x7f72ac100cb0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.135+0000 7f72b4631640 1 -- 172.21.15.33:0/1338617126 >> 172.21.15.33:0/1338617126 conn(0x7f72ac0fc7a0 msgr2=0x7f72ac0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:11.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.135+0000 7f72b4631640 1 -- 172.21.15.33:0/1338617126 shutdown_connections 2024-09-12T12:25:11.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.135+0000 7f72b4631640 1 -- 172.21.15.33:0/1338617126 wait complete. 2024-09-12T12:25:11.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.136+0000 7f72b4631640 1 Processor -- start 2024-09-12T12:25:11.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.136+0000 7f72b4631640 1 -- start start 2024-09-12T12:25:11.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.136+0000 7f72b4631640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72ac1008d0 0x7f72ac1a0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:11.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.136+0000 7f72b4631640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72ac101280 0x7f72ac1a0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:11.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.136+0000 7f72b4631640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72ac10e480 0x7f72ac19a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:11.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.136+0000 7f72b4631640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f72ac114110 con 0x7f72ac10e480 2024-09-12T12:25:11.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.136+0000 7f72b4631640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f72ac113f90 con 0x7f72ac101280 2024-09-12T12:25:11.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.136+0000 7f72b4631640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f72ac114290 con 0x7f72ac1008d0 2024-09-12T12:25:11.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.136+0000 7f72b2bce640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72ac10e480 0x7f72ac19a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:11.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.136+0000 7f72b2bce640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72ac10e480 0x7f72ac19a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37200/0 (socket says 172.21.15.33:37200) 2024-09-12T12:25:11.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.136+0000 7f72b2bce640 1 -- 172.21.15.33:0/1020829653 learned_addr learned my addr 172.21.15.33:0/1020829653 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:11.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.136+0000 7f72b1bcc640 1 --2- 172.21.15.33:0/1020829653 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72ac101280 0x7f72ac1a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:11.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.136+0000 7f72b23cd640 1 --2- 172.21.15.33:0/1020829653 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72ac1008d0 0x7f72ac1a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:11.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.136+0000 7f72b2bce640 1 -- 172.21.15.33:0/1020829653 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72ac1008d0 msgr2=0x7f72ac1a0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:11.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.136+0000 7f72b2bce640 1 --2- 172.21.15.33:0/1020829653 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72ac1008d0 0x7f72ac1a0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.136+0000 7f72b2bce640 1 -- 172.21.15.33:0/1020829653 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72ac101280 msgr2=0x7f72ac1a0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:11.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.136+0000 7f72b2bce640 1 --2- 172.21.15.33:0/1020829653 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72ac101280 0x7f72ac1a0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.136+0000 7f72b2bce640 1 -- 172.21.15.33:0/1020829653 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72ac19ad20 con 0x7f72ac10e480 2024-09-12T12:25:11.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.137+0000 7f72b2bce640 1 --2- 172.21.15.33:0/1020829653 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72ac10e480 0x7f72ac19a5f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f72a400b9e0 tx=0x7f72a400bde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:11.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.137+0000 7f72a37fe640 1 -- 172.21.15.33:0/1020829653 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a4019070 con 0x7f72ac10e480 2024-09-12T12:25:11.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.137+0000 7f72a37fe640 1 -- 172.21.15.33:0/1020829653 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f72a4014440 con 0x7f72ac10e480 2024-09-12T12:25:11.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.137+0000 7f72b4631640 1 -- 172.21.15.33:0/1020829653 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72ac19b010 con 0x7f72ac10e480 2024-09-12T12:25:11.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.137+0000 7f72a37fe640 1 -- 172.21.15.33:0/1020829653 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a40125a0 con 0x7f72ac10e480 2024-09-12T12:25:11.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.137+0000 7f72b4631640 1 -- 172.21.15.33:0/1020829653 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72ac1a7300 con 0x7f72ac10e480 2024-09-12T12:25:11.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.138+0000 7f72b4631640 1 -- 172.21.15.33:0/1020829653 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72ac100d30 con 0x7f72ac10e480 2024-09-12T12:25:11.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.140+0000 7f72a37fe640 1 -- 172.21.15.33:0/1020829653 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f72a401c070 con 0x7f72ac10e480 2024-09-12T12:25:11.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.140+0000 7f72a37fe640 1 --2- 172.21.15.33:0/1020829653 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f72980a2c10 0x7f72980a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:11.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.141+0000 7f72b23cd640 1 --2- 172.21.15.33:0/1020829653 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f72980a2c10 0x7f72980a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:11.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.141+0000 7f72a37fe640 1 -- 172.21.15.33:0/1020829653 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7f72a40cee30 con 0x7f72ac10e480 2024-09-12T12:25:11.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.141+0000 7f72b23cd640 1 --2- 172.21.15.33:0/1020829653 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f72980a2c10 0x7f72980a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f72a8031440 tx=0x7f72a8005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:11.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.144+0000 7f72a37fe640 1 -- 172.21.15.33:0/1020829653 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f72a409b390 con 0x7f72ac10e480 2024-09-12T12:25:11.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.322+0000 7f72b4631640 1 -- 172.21.15.33:0/1020829653 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f72ac19bb20 con 0x7f72ac10e480 2024-09-12T12:25:11.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.322+0000 7f72a37fe640 1 -- 172.21.15.33:0/1020829653 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f72a409f690 con 0x7f72ac10e480 2024-09-12T12:25:11.323 INFO:teuthology.orchestra.run.smithi033.stdout:231928234028 2024-09-12T12:25:11.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.324+0000 7f72b4631640 1 -- 172.21.15.33:0/1020829653 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f72980a2c10 msgr2=0x7f72980a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:11.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.324+0000 7f72b4631640 1 --2- 172.21.15.33:0/1020829653 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f72980a2c10 0x7f72980a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f72a8031440 tx=0x7f72a8005e80 comp rx=0 tx=0).stop 2024-09-12T12:25:11.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.324+0000 7f72b4631640 1 -- 172.21.15.33:0/1020829653 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72ac10e480 msgr2=0x7f72ac19a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:11.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.324+0000 7f72b4631640 1 --2- 172.21.15.33:0/1020829653 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72ac10e480 0x7f72ac19a5f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f72a400b9e0 tx=0x7f72a400bde0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.324+0000 7f72b4631640 1 -- 172.21.15.33:0/1020829653 shutdown_connections 2024-09-12T12:25:11.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.324+0000 7f72b4631640 1 --2- 172.21.15.33:0/1020829653 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f72980a2c10 0x7f72980a50d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.324+0000 7f72b4631640 1 --2- 172.21.15.33:0/1020829653 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72ac10e480 0x7f72ac19a5f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.324+0000 7f72b4631640 1 --2- 172.21.15.33:0/1020829653 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72ac101280 0x7f72ac1a0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.324+0000 7f72b4631640 1 --2- 172.21.15.33:0/1020829653 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72ac1008d0 0x7f72ac1a0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.324+0000 7f72b4631640 1 -- 172.21.15.33:0/1020829653 >> 172.21.15.33:0/1020829653 conn(0x7f72ac0fc7a0 msgr2=0x7f72ac0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:11.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.325+0000 7f72b4631640 1 -- 172.21.15.33:0/1020829653 shutdown_connections 2024-09-12T12:25:11.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:11.325+0000 7f72b4631640 1 -- 172.21.15.33:0/1020829653 wait complete. 2024-09-12T12:25:11.437 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:11.439 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:11 smithi033 ceph-mon[31246]: pgmap v323: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s; 115 B/s, 0 keys/s, 1 objects/s recovering 2024-09-12T12:25:11.440 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:11 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/3291210227' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-12T12:25:11.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:11 smithi043 ceph-mon[34144]: pgmap v323: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s; 115 B/s, 0 keys/s, 1 objects/s recovering 2024-09-12T12:25:11.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:11 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/3291210227' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-12T12:25:11.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:11 smithi102 ceph-mon[34799]: pgmap v323: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s; 115 B/s, 0 keys/s, 1 objects/s recovering 2024-09-12T12:25:11.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:11 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/3291210227' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-12T12:25:12.378 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:12 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/1020829653' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-12T12:25:12.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.460+0000 7f33c5f50640 1 -- 172.21.15.33:0/2780738809 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33c0102570 msgr2=0x7f33c01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:12.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.460+0000 7f33c5f50640 1 --2- 172.21.15.33:0/2780738809 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33c0102570 0x7f33c01029b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f33a8009900 tx=0x7f33a802a480 comp rx=0 tx=0).stop 2024-09-12T12:25:12.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.460+0000 7f33c5f50640 1 -- 172.21.15.33:0/2780738809 shutdown_connections 2024-09-12T12:25:12.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.460+0000 7f33c5f50640 1 --2- 172.21.15.33:0/2780738809 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f33c0102ef0 0x7f33c010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.460+0000 7f33c5f50640 1 --2- 172.21.15.33:0/2780738809 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33c0102570 0x7f33c01029b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.460+0000 7f33c5f50640 1 --2- 172.21.15.33:0/2780738809 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33c0100e20 0x7f33c0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.460+0000 7f33c5f50640 1 -- 172.21.15.33:0/2780738809 >> 172.21.15.33:0/2780738809 conn(0x7f33c00fc7d0 msgr2=0x7f33c00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:12.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.460+0000 7f33c5f50640 1 -- 172.21.15.33:0/2780738809 shutdown_connections 2024-09-12T12:25:12.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.460+0000 7f33c5f50640 1 -- 172.21.15.33:0/2780738809 wait complete. 2024-09-12T12:25:12.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.461+0000 7f33c5f50640 1 Processor -- start 2024-09-12T12:25:12.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.461+0000 7f33c5f50640 1 -- start start 2024-09-12T12:25:12.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.461+0000 7f33c5f50640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33c0100e20 0x7f33c0198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:12.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.461+0000 7f33c5f50640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33c0102570 0x7f33c0198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:12.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.461+0000 7f33c5f50640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f33c0102ef0 0x7f33c019ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:12.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.461+0000 7f33c5f50640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f33c0110e30 con 0x7f33c0100e20 2024-09-12T12:25:12.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.461+0000 7f33c5f50640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f33c0110cb0 con 0x7f33c0102570 2024-09-12T12:25:12.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.461+0000 7f33c5f50640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f33c0110fb0 con 0x7f33c0102ef0 2024-09-12T12:25:12.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.461+0000 7f33bf7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33c0100e20 0x7f33c0198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:12.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.461+0000 7f33bf7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33c0100e20 0x7f33c0198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37216/0 (socket says 172.21.15.33:37216) 2024-09-12T12:25:12.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.461+0000 7f33bf7fe640 1 -- 172.21.15.33:0/865477623 learned_addr learned my addr 172.21.15.33:0/865477623 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:12.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.461+0000 7f33bffff640 1 --2- 172.21.15.33:0/865477623 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f33c0102ef0 0x7f33c019ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:12.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.461+0000 7f33b7fff640 1 --2- 172.21.15.33:0/865477623 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33c0102570 0x7f33c0198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:12.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.462+0000 7f33bf7fe640 1 -- 172.21.15.33:0/865477623 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f33c0102ef0 msgr2=0x7f33c019ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:12.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.462+0000 7f33bf7fe640 1 --2- 172.21.15.33:0/865477623 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f33c0102ef0 0x7f33c019ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.462+0000 7f33bf7fe640 1 -- 172.21.15.33:0/865477623 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33c0102570 msgr2=0x7f33c0198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:12.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.462+0000 7f33bf7fe640 1 --2- 172.21.15.33:0/865477623 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33c0102570 0x7f33c0198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.462+0000 7f33bf7fe640 1 -- 172.21.15.33:0/865477623 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33c019d3d0 con 0x7f33c0100e20 2024-09-12T12:25:12.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.462+0000 7f33b7fff640 1 --2- 172.21.15.33:0/865477623 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33c0102570 0x7f33c0198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:12.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.462+0000 7f33bf7fe640 1 --2- 172.21.15.33:0/865477623 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33c0100e20 0x7f33c0198420 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f33b000e9f0 tx=0x7f33b000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:12.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.462+0000 7f33bd7fa640 1 -- 172.21.15.33:0/865477623 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b000cd80 con 0x7f33c0100e20 2024-09-12T12:25:12.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.462+0000 7f33c5f50640 1 -- 172.21.15.33:0/865477623 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33c019d6c0 con 0x7f33c0100e20 2024-09-12T12:25:12.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.462+0000 7f33bd7fa640 1 -- 172.21.15.33:0/865477623 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f33b00108e0 con 0x7f33c0100e20 2024-09-12T12:25:12.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.462+0000 7f33bd7fa640 1 -- 172.21.15.33:0/865477623 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b0018920 con 0x7f33c0100e20 2024-09-12T12:25:12.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.462+0000 7f33c5f50640 1 -- 172.21.15.33:0/865477623 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33c01a4fa0 con 0x7f33c0100e20 2024-09-12T12:25:12.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.463+0000 7f33c5f50640 1 -- 172.21.15.33:0/865477623 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33c0101200 con 0x7f33c0100e20 2024-09-12T12:25:12.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.464+0000 7f33bd7fa640 1 -- 172.21.15.33:0/865477623 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f33b0010a90 con 0x7f33c0100e20 2024-09-12T12:25:12.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.465+0000 7f33bd7fa640 1 --2- 172.21.15.33:0/865477623 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f33ac0a2c10 0x7f33ac0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:12.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.465+0000 7f33b7fff640 1 --2- 172.21.15.33:0/865477623 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f33ac0a2c10 0x7f33ac0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:12.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.465+0000 7f33bd7fa640 1 -- 172.21.15.33:0/865477623 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7f33b00cf8b0 con 0x7f33c0100e20 2024-09-12T12:25:12.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.466+0000 7f33b7fff640 1 --2- 172.21.15.33:0/865477623 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f33ac0a2c10 0x7f33ac0a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f33c00fffc0 tx=0x7f33a8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:12.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.470+0000 7f33bd7fa640 1 -- 172.21.15.33:0/865477623 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f33b009c350 con 0x7f33c0100e20 2024-09-12T12:25:12.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:12 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/1020829653' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-12T12:25:12.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:12 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/1020829653' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-12T12:25:12.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.648+0000 7f33c5f50640 1 -- 172.21.15.33:0/865477623 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f33c0199780 con 0x7f33c0100e20 2024-09-12T12:25:12.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.649+0000 7f33bd7fa640 1 -- 172.21.15.33:0/865477623 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f33b009bc50 con 0x7f33c0100e20 2024-09-12T12:25:12.650 INFO:teuthology.orchestra.run.smithi033.stdout:55834574928 2024-09-12T12:25:12.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.651+0000 7f33c5f50640 1 -- 172.21.15.33:0/865477623 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f33ac0a2c10 msgr2=0x7f33ac0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:12.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.651+0000 7f33c5f50640 1 --2- 172.21.15.33:0/865477623 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f33ac0a2c10 0x7f33ac0a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f33c00fffc0 tx=0x7f33a8005a20 comp rx=0 tx=0).stop 2024-09-12T12:25:12.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.651+0000 7f33c5f50640 1 -- 172.21.15.33:0/865477623 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33c0100e20 msgr2=0x7f33c0198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:12.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.651+0000 7f33c5f50640 1 --2- 172.21.15.33:0/865477623 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33c0100e20 0x7f33c0198420 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f33b000e9f0 tx=0x7f33b000eeb0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.651+0000 7f33c5f50640 1 -- 172.21.15.33:0/865477623 shutdown_connections 2024-09-12T12:25:12.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.651+0000 7f33c5f50640 1 --2- 172.21.15.33:0/865477623 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f33ac0a2c10 0x7f33ac0a50d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.651+0000 7f33c5f50640 1 --2- 172.21.15.33:0/865477623 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f33c0102ef0 0x7f33c019ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.651+0000 7f33c5f50640 1 --2- 172.21.15.33:0/865477623 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33c0102570 0x7f33c0198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.651+0000 7f33c5f50640 1 --2- 172.21.15.33:0/865477623 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33c0100e20 0x7f33c0198420 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.651+0000 7f33c5f50640 1 -- 172.21.15.33:0/865477623 >> 172.21.15.33:0/865477623 conn(0x7f33c00fc7d0 msgr2=0x7f33c006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:12.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.651+0000 7f33c5f50640 1 -- 172.21.15.33:0/865477623 shutdown_connections 2024-09-12T12:25:12.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.651+0000 7f33c5f50640 1 -- 172.21.15.33:0/865477623 wait complete. 2024-09-12T12:25:12.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.714+0000 7f97dcc30640 1 -- 172.21.15.33:0/3084740792 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97d8101420 msgr2=0x7f97d810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:12.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.714+0000 7f97dcc30640 1 --2- 172.21.15.33:0/3084740792 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97d8101420 0x7f97d810d950 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f97d0009930 tx=0x7f97d002a420 comp rx=0 tx=0).stop 2024-09-12T12:25:12.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.714+0000 7f97dcc30640 1 -- 172.21.15.33:0/3084740792 shutdown_connections 2024-09-12T12:25:12.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.714+0000 7f97dcc30640 1 --2- 172.21.15.33:0/3084740792 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97d8101420 0x7f97d810d950 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.714+0000 7f97dcc30640 1 --2- 172.21.15.33:0/3084740792 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97d8100a80 0x7f97d8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.714+0000 7f97dcc30640 1 --2- 172.21.15.33:0/3084740792 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97d8106a80 0x7f97d8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.714+0000 7f97dcc30640 1 -- 172.21.15.33:0/3084740792 >> 172.21.15.33:0/3084740792 conn(0x7f97d80fc7a0 msgr2=0x7f97d80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:12.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.714+0000 7f97dcc30640 1 -- 172.21.15.33:0/3084740792 shutdown_connections 2024-09-12T12:25:12.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.714+0000 7f97dcc30640 1 -- 172.21.15.33:0/3084740792 wait complete. 2024-09-12T12:25:12.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.715+0000 7f97dcc30640 1 Processor -- start 2024-09-12T12:25:12.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.715+0000 7f97dcc30640 1 -- start start 2024-09-12T12:25:12.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.715+0000 7f97dcc30640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97d8100a80 0x7f97d8102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:12.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.715+0000 7f97dcc30640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97d8101420 0x7f97d8102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:12.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.715+0000 7f97dcc30640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97d8106a80 0x7f97d81030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:12.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.715+0000 7f97dcc30640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f97d8110d30 con 0x7f97d8100a80 2024-09-12T12:25:12.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.715+0000 7f97dcc30640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f97d8110bb0 con 0x7f97d8106a80 2024-09-12T12:25:12.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.715+0000 7f97dcc30640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f97d8110eb0 con 0x7f97d8101420 2024-09-12T12:25:12.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.716+0000 7f97d659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97d8100a80 0x7f97d8102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:12.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.716+0000 7f97d659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97d8100a80 0x7f97d8102650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37238/0 (socket says 172.21.15.33:37238) 2024-09-12T12:25:12.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.716+0000 7f97d659c640 1 -- 172.21.15.33:0/1488726175 learned_addr learned my addr 172.21.15.33:0/1488726175 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:12.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.716+0000 7f97d5d9b640 1 --2- 172.21.15.33:0/1488726175 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97d8101420 0x7f97d8102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:12.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.716+0000 7f97d6d9d640 1 --2- 172.21.15.33:0/1488726175 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97d8106a80 0x7f97d81030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:12.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.716+0000 7f97d659c640 1 -- 172.21.15.33:0/1488726175 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97d8101420 msgr2=0x7f97d8102b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:12.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.716+0000 7f97d659c640 1 --2- 172.21.15.33:0/1488726175 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97d8101420 0x7f97d8102b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.716+0000 7f97d659c640 1 -- 172.21.15.33:0/1488726175 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97d8106a80 msgr2=0x7f97d81030d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:12.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.716+0000 7f97d659c640 1 --2- 172.21.15.33:0/1488726175 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97d8106a80 0x7f97d81030d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.716+0000 7f97d659c640 1 -- 172.21.15.33:0/1488726175 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97d81a67e0 con 0x7f97d8100a80 2024-09-12T12:25:12.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.716+0000 7f97d6d9d640 1 --2- 172.21.15.33:0/1488726175 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97d8106a80 0x7f97d81030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:12.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.716+0000 7f97d659c640 1 --2- 172.21.15.33:0/1488726175 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97d8100a80 0x7f97d8102650 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f97c800cce0 tx=0x7f97c800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:12.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.716+0000 7f97cf7fe640 1 -- 172.21.15.33:0/1488726175 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c8004b20 con 0x7f97d8100a80 2024-09-12T12:25:12.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.716+0000 7f97cf7fe640 1 -- 172.21.15.33:0/1488726175 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f97c8004cc0 con 0x7f97d8100a80 2024-09-12T12:25:12.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.716+0000 7f97cf7fe640 1 -- 172.21.15.33:0/1488726175 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c800f6b0 con 0x7f97d8100a80 2024-09-12T12:25:12.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.716+0000 7f97dcc30640 1 -- 172.21.15.33:0/1488726175 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97d81a6ad0 con 0x7f97d8100a80 2024-09-12T12:25:12.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.716+0000 7f97dcc30640 1 -- 172.21.15.33:0/1488726175 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97d81a7010 con 0x7f97d8100a80 2024-09-12T12:25:12.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.717+0000 7f97dcc30640 1 -- 172.21.15.33:0/1488726175 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97d8100ee0 con 0x7f97d8100a80 2024-09-12T12:25:12.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.719+0000 7f97cf7fe640 1 -- 172.21.15.33:0/1488726175 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f97c800f850 con 0x7f97d8100a80 2024-09-12T12:25:12.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.719+0000 7f97cf7fe640 1 --2- 172.21.15.33:0/1488726175 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f97c40a2c10 0x7f97c40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:12.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.720+0000 7f97cf7fe640 1 -- 172.21.15.33:0/1488726175 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7f97c80cf920 con 0x7f97d8100a80 2024-09-12T12:25:12.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.720+0000 7f97d5d9b640 1 --2- 172.21.15.33:0/1488726175 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f97c40a2c10 0x7f97c40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:12.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.720+0000 7f97d5d9b640 1 --2- 172.21.15.33:0/1488726175 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f97c40a2c10 0x7f97c40a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f97d81040e0 tx=0x7f97c000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:12.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.722+0000 7f97cf7fe640 1 -- 172.21.15.33:0/1488726175 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f97c8014030 con 0x7f97d8100a80 2024-09-12T12:25:12.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.901+0000 7f97dcc30640 1 -- 172.21.15.33:0/1488726175 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f97d8103b80 con 0x7f97d8100a80 2024-09-12T12:25:12.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.901+0000 7f97cf7fe640 1 -- 172.21.15.33:0/1488726175 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f97d8103b80 con 0x7f97d8100a80 2024-09-12T12:25:12.903 INFO:teuthology.orchestra.run.smithi033.stdout:313532612638 2024-09-12T12:25:12.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.904+0000 7f97dcc30640 1 -- 172.21.15.33:0/1488726175 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f97c40a2c10 msgr2=0x7f97c40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:12.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.904+0000 7f97dcc30640 1 --2- 172.21.15.33:0/1488726175 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f97c40a2c10 0x7f97c40a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f97d81040e0 tx=0x7f97c000b390 comp rx=0 tx=0).stop 2024-09-12T12:25:12.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.904+0000 7f97dcc30640 1 -- 172.21.15.33:0/1488726175 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97d8100a80 msgr2=0x7f97d8102650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:12.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.904+0000 7f97dcc30640 1 --2- 172.21.15.33:0/1488726175 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97d8100a80 0x7f97d8102650 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f97c800cce0 tx=0x7f97c800a620 comp rx=0 tx=0).stop 2024-09-12T12:25:12.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.904+0000 7f97dcc30640 1 -- 172.21.15.33:0/1488726175 shutdown_connections 2024-09-12T12:25:12.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.904+0000 7f97dcc30640 1 --2- 172.21.15.33:0/1488726175 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f97c40a2c10 0x7f97c40a50d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.904+0000 7f97dcc30640 1 --2- 172.21.15.33:0/1488726175 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97d8106a80 0x7f97d81030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.904+0000 7f97dcc30640 1 --2- 172.21.15.33:0/1488726175 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97d8101420 0x7f97d8102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.904+0000 7f97dcc30640 1 --2- 172.21.15.33:0/1488726175 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97d8100a80 0x7f97d8102650 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.904+0000 7f97dcc30640 1 -- 172.21.15.33:0/1488726175 >> 172.21.15.33:0/1488726175 conn(0x7f97d80fc7a0 msgr2=0x7f97d8104890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:12.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.904+0000 7f97dcc30640 1 -- 172.21.15.33:0/1488726175 shutdown_connections 2024-09-12T12:25:12.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:12.904+0000 7f97dcc30640 1 -- 172.21.15.33:0/1488726175 wait complete. 2024-09-12T12:25:13.366 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574926 got 55834574928 for osd.1 2024-09-12T12:25:13.366 DEBUG:teuthology.parallel:result is None 2024-09-12T12:25:13.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:13 smithi033 ceph-mon[31246]: pgmap v324: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s; 103 B/s, 0 keys/s, 1 objects/s recovering 2024-09-12T12:25:13.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:13 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/865477623' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-12T12:25:13.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:13 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/1488726175' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-12T12:25:13.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:13 smithi043 ceph-mon[34144]: pgmap v324: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s; 103 B/s, 0 keys/s, 1 objects/s recovering 2024-09-12T12:25:13.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:13 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/865477623' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-12T12:25:13.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:13 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/1488726175' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-12T12:25:13.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:13 smithi102 ceph-mon[34799]: pgmap v324: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s; 103 B/s, 0 keys/s, 1 objects/s recovering 2024-09-12T12:25:13.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:13 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/865477623' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-12T12:25:13.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:13 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/1488726175' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-12T12:25:13.967 INFO:tasks.cephadm.ceph_manager.ceph:need seq 313532612635 got 313532612638 for osd.11 2024-09-12T12:25:13.967 DEBUG:teuthology.parallel:result is None 2024-09-12T12:25:14.335 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855418 got 150323855420 for osd.5 2024-09-12T12:25:14.335 DEBUG:teuthology.parallel:result is None 2024-09-12T12:25:14.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.514+0000 7f6dcdd7f640 1 -- 172.21.15.33:0/3124247554 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6dc8101de0 msgr2=0x7f6dc81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:14.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.514+0000 7f6dcdd7f640 1 --2- 172.21.15.33:0/3124247554 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6dc8101de0 0x7f6dc81021c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6db8009900 tx=0x7f6db802a410 comp rx=0 tx=0).stop 2024-09-12T12:25:14.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.514+0000 7f6dcdd7f640 1 -- 172.21.15.33:0/3124247554 shutdown_connections 2024-09-12T12:25:14.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.514+0000 7f6dcdd7f640 1 --2- 172.21.15.33:0/3124247554 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6dc8106f10 0x7f6dc810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:14.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.515+0000 7f6dcdd7f640 1 --2- 172.21.15.33:0/3124247554 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6dc8102790 0x7f6dc81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:14.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.515+0000 7f6dcdd7f640 1 --2- 172.21.15.33:0/3124247554 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6dc8101de0 0x7f6dc81021c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:14.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.515+0000 7f6dcdd7f640 1 -- 172.21.15.33:0/3124247554 >> 172.21.15.33:0/3124247554 conn(0x7f6dc80fd8c0 msgr2=0x7f6dc80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:14.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.515+0000 7f6dcdd7f640 1 -- 172.21.15.33:0/3124247554 shutdown_connections 2024-09-12T12:25:14.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.515+0000 7f6dcdd7f640 1 -- 172.21.15.33:0/3124247554 wait complete. 2024-09-12T12:25:14.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.515+0000 7f6dcdd7f640 1 Processor -- start 2024-09-12T12:25:14.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.515+0000 7f6dcdd7f640 1 -- start start 2024-09-12T12:25:14.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.516+0000 7f6dcdd7f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6dc8101de0 0x7f6dc8198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:14.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.516+0000 7f6dcdd7f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6dc8102790 0x7f6dc81988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:14.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.516+0000 7f6dcdd7f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6dc8106f10 0x7f6dc819cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:14.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.516+0000 7f6dcdd7f640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc8111e20 con 0x7f6dc8106f10 2024-09-12T12:25:14.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.516+0000 7f6dcdd7f640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc8111ca0 con 0x7f6dc8102790 2024-09-12T12:25:14.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.516+0000 7f6dcdd7f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc8111fa0 con 0x7f6dc8101de0 2024-09-12T12:25:14.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.516+0000 7f6dc7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6dc8106f10 0x7f6dc819cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:14.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.516+0000 7f6dc7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6dc8106f10 0x7f6dc819cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37260/0 (socket says 172.21.15.33:37260) 2024-09-12T12:25:14.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.516+0000 7f6dc7fff640 1 -- 172.21.15.33:0/2985858057 learned_addr learned my addr 172.21.15.33:0/2985858057 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:14.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.516+0000 7f6dbeffd640 1 --2- 172.21.15.33:0/2985858057 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6dc8102790 0x7f6dc81988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:14.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.516+0000 7f6dc77fe640 1 --2- 172.21.15.33:0/2985858057 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6dc8101de0 0x7f6dc8198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:14.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.516+0000 7f6dc7fff640 1 -- 172.21.15.33:0/2985858057 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6dc8101de0 msgr2=0x7f6dc8198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:14.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.516+0000 7f6dc7fff640 1 --2- 172.21.15.33:0/2985858057 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6dc8101de0 0x7f6dc8198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:14.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.516+0000 7f6dc7fff640 1 -- 172.21.15.33:0/2985858057 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6dc8102790 msgr2=0x7f6dc81988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:14.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.516+0000 7f6dc7fff640 1 --2- 172.21.15.33:0/2985858057 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6dc8102790 0x7f6dc81988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:14.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.516+0000 7f6dc7fff640 1 -- 172.21.15.33:0/2985858057 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc819d330 con 0x7f6dc8106f10 2024-09-12T12:25:14.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.516+0000 7f6dbeffd640 1 --2- 172.21.15.33:0/2985858057 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6dc8102790 0x7f6dc81988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:14.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.516+0000 7f6dc7fff640 1 --2- 172.21.15.33:0/2985858057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6dc8106f10 0x7f6dc819cc50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6dc000eaa0 tx=0x7f6dc000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:14.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.517+0000 7f6dc57fa640 1 -- 172.21.15.33:0/2985858057 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc000cdb0 con 0x7f6dc8106f10 2024-09-12T12:25:14.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.517+0000 7f6dcdd7f640 1 -- 172.21.15.33:0/2985858057 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dc819d620 con 0x7f6dc8106f10 2024-09-12T12:25:14.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.517+0000 7f6dc57fa640 1 -- 172.21.15.33:0/2985858057 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6dc0005020 con 0x7f6dc8106f10 2024-09-12T12:25:14.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.517+0000 7f6dc57fa640 1 -- 172.21.15.33:0/2985858057 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc00116d0 con 0x7f6dc8106f10 2024-09-12T12:25:14.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.517+0000 7f6dcdd7f640 1 -- 172.21.15.33:0/2985858057 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dc81a4f00 con 0x7f6dc8106f10 2024-09-12T12:25:14.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.518+0000 7f6dcdd7f640 1 -- 172.21.15.33:0/2985858057 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dc81021c0 con 0x7f6dc8106f10 2024-09-12T12:25:14.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.519+0000 7f6dc57fa640 1 -- 172.21.15.33:0/2985858057 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6dc00051d0 con 0x7f6dc8106f10 2024-09-12T12:25:14.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.520+0000 7f6dc57fa640 1 --2- 172.21.15.33:0/2985858057 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f6db40a2c10 0x7f6db40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:14.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.520+0000 7f6dc77fe640 1 --2- 172.21.15.33:0/2985858057 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f6db40a2c10 0x7f6db40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:14.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.520+0000 7f6dc57fa640 1 -- 172.21.15.33:0/2985858057 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7f6dc00cfb90 con 0x7f6dc8106f10 2024-09-12T12:25:14.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.520+0000 7f6dc77fe640 1 --2- 172.21.15.33:0/2985858057 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f6db40a2c10 0x7f6db40a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6db8031440 tx=0x7f6db80095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:14.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.523+0000 7f6dc57fa640 1 -- 172.21.15.33:0/2985858057 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6dc0016030 con 0x7f6dc8106f10 2024-09-12T12:25:14.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.703+0000 7f6dcdd7f640 1 -- 172.21.15.33:0/2985858057 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f6dc81996e0 con 0x7f6dc8106f10 2024-09-12T12:25:14.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.703+0000 7f6dc57fa640 1 -- 172.21.15.33:0/2985858057 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f6dc81996e0 con 0x7f6dc8106f10 2024-09-12T12:25:14.704 INFO:teuthology.orchestra.run.smithi033.stdout:180388626488 2024-09-12T12:25:14.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.705+0000 7f6dcdd7f640 1 -- 172.21.15.33:0/2985858057 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f6db40a2c10 msgr2=0x7f6db40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:14.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.705+0000 7f6dcdd7f640 1 --2- 172.21.15.33:0/2985858057 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f6db40a2c10 0x7f6db40a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6db8031440 tx=0x7f6db80095f0 comp rx=0 tx=0).stop 2024-09-12T12:25:14.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.705+0000 7f6dcdd7f640 1 -- 172.21.15.33:0/2985858057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6dc8106f10 msgr2=0x7f6dc819cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:14.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.705+0000 7f6dcdd7f640 1 --2- 172.21.15.33:0/2985858057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6dc8106f10 0x7f6dc819cc50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6dc000eaa0 tx=0x7f6dc000ef60 comp rx=0 tx=0).stop 2024-09-12T12:25:14.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.705+0000 7f6dcdd7f640 1 -- 172.21.15.33:0/2985858057 shutdown_connections 2024-09-12T12:25:14.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.705+0000 7f6dcdd7f640 1 --2- 172.21.15.33:0/2985858057 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f6db40a2c10 0x7f6db40a50d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:14.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.705+0000 7f6dcdd7f640 1 --2- 172.21.15.33:0/2985858057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6dc8106f10 0x7f6dc819cc50 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:14.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.705+0000 7f6dcdd7f640 1 --2- 172.21.15.33:0/2985858057 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6dc8102790 0x7f6dc81988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:14.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.705+0000 7f6dcdd7f640 1 --2- 172.21.15.33:0/2985858057 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6dc8101de0 0x7f6dc8198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:14.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.705+0000 7f6dcdd7f640 1 -- 172.21.15.33:0/2985858057 >> 172.21.15.33:0/2985858057 conn(0x7f6dc80fd8c0 msgr2=0x7f6dc80fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:14.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.705+0000 7f6dcdd7f640 1 -- 172.21.15.33:0/2985858057 shutdown_connections 2024-09-12T12:25:14.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:14.705+0000 7f6dcdd7f640 1 -- 172.21.15.33:0/2985858057 wait complete. 2024-09-12T12:25:15.467 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626485 got 180388626488 for osd.6 2024-09-12T12:25:15.468 DEBUG:teuthology.parallel:result is None 2024-09-12T12:25:15.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:15 smithi033 ceph-mon[31246]: pgmap v325: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s; 9 B/s, 0 keys/s, 0 objects/s recovering 2024-09-12T12:25:15.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:15 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/2985858057' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-12T12:25:15.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:15 smithi043 ceph-mon[34144]: pgmap v325: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s; 9 B/s, 0 keys/s, 0 objects/s recovering 2024-09-12T12:25:15.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:15 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/2985858057' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-12T12:25:15.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:15 smithi102 ceph-mon[34799]: pgmap v325: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s; 9 B/s, 0 keys/s, 0 objects/s recovering 2024-09-12T12:25:15.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:15 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/2985858057' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-12T12:25:15.984 INFO:tasks.cephadm.ceph_manager.ceph:need seq 231928234027 got 231928234028 for osd.8 2024-09-12T12:25:15.984 DEBUG:teuthology.parallel:result is None 2024-09-12T12:25:16.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.616+0000 7fc2c2d58640 1 -- 172.21.15.33:0/4232028809 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2bc106f10 msgr2=0x7fc2bc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:16.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.616+0000 7fc2c2d58640 1 --2- 172.21.15.33:0/4232028809 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2bc106f10 0x7fc2bc10ea90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4009ca0 tx=0x7fc2b402a8c0 comp rx=0 tx=0).stop 2024-09-12T12:25:16.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.616+0000 7fc2c2d58640 1 -- 172.21.15.33:0/4232028809 shutdown_connections 2024-09-12T12:25:16.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.616+0000 7fc2c2d58640 1 --2- 172.21.15.33:0/4232028809 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2bc106f10 0x7fc2bc10ea90 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:16.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.616+0000 7fc2c2d58640 1 --2- 172.21.15.33:0/4232028809 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2bc102790 0x7fc2bc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:16.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.616+0000 7fc2c2d58640 1 --2- 172.21.15.33:0/4232028809 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2bc101de0 0x7fc2bc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:16.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.616+0000 7fc2c2d58640 1 -- 172.21.15.33:0/4232028809 >> 172.21.15.33:0/4232028809 conn(0x7fc2bc0fd8c0 msgr2=0x7fc2bc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:16.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.616+0000 7fc2c2d58640 1 -- 172.21.15.33:0/4232028809 shutdown_connections 2024-09-12T12:25:16.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.616+0000 7fc2c2d58640 1 -- 172.21.15.33:0/4232028809 wait complete. 2024-09-12T12:25:16.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.617+0000 7fc2c2d58640 1 Processor -- start 2024-09-12T12:25:16.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.617+0000 7fc2c2d58640 1 -- start start 2024-09-12T12:25:16.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.617+0000 7fc2c2d58640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2bc101de0 0x7fc2bc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:16.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.617+0000 7fc2c2d58640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2bc102790 0x7fc2bc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:16.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.617+0000 7fc2c2d58640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2bc106f10 0x7fc2bc074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:16.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.617+0000 7fc2c2d58640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc2bc111e60 con 0x7fc2bc106f10 2024-09-12T12:25:16.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.617+0000 7fc2c2d58640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc2bc111ce0 con 0x7fc2bc101de0 2024-09-12T12:25:16.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.617+0000 7fc2c2d58640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc2bc111fe0 con 0x7fc2bc102790 2024-09-12T12:25:16.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.617+0000 7fc2c12f5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2bc106f10 0x7fc2bc074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:16.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.617+0000 7fc2c12f5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2bc106f10 0x7fc2bc074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37272/0 (socket says 172.21.15.33:37272) 2024-09-12T12:25:16.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.617+0000 7fc2c12f5640 1 -- 172.21.15.33:0/3593647635 learned_addr learned my addr 172.21.15.33:0/3593647635 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:16.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.617+0000 7fc2c0af4640 1 --2- 172.21.15.33:0/3593647635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2bc101de0 0x7fc2bc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:16.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.617+0000 7fc2b3fff640 1 --2- 172.21.15.33:0/3593647635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2bc102790 0x7fc2bc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:16.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.617+0000 7fc2c12f5640 1 -- 172.21.15.33:0/3593647635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2bc102790 msgr2=0x7fc2bc074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:16.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.617+0000 7fc2c12f5640 1 --2- 172.21.15.33:0/3593647635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2bc102790 0x7fc2bc074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:16.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.617+0000 7fc2c12f5640 1 -- 172.21.15.33:0/3593647635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2bc101de0 msgr2=0x7fc2bc0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:16.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.617+0000 7fc2c12f5640 1 --2- 172.21.15.33:0/3593647635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2bc101de0 0x7fc2bc0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:16.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.617+0000 7fc2c12f5640 1 -- 172.21.15.33:0/3593647635 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2bc1a68c0 con 0x7fc2bc106f10 2024-09-12T12:25:16.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.617+0000 7fc2b3fff640 1 --2- 172.21.15.33:0/3593647635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2bc102790 0x7fc2bc074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:16.050 INFO:teuthology.orchestra.run.smithi033.stdout:73014444108 2024-09-12T12:25:16.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.618+0000 7fc2c12f5640 1 --2- 172.21.15.33:0/3593647635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2bc106f10 0x7fc2bc074f70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4009dc0 tx=0x7fc2b4032ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:16.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.618+0000 7fc2b1ffb640 1 -- 172.21.15.33:0/3593647635 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b4003bf0 con 0x7fc2bc106f10 2024-09-12T12:25:16.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.618+0000 7fc2c2d58640 1 -- 172.21.15.33:0/3593647635 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2bc1a6b50 con 0x7fc2bc106f10 2024-09-12T12:25:16.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.618+0000 7fc2b1ffb640 1 -- 172.21.15.33:0/3593647635 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc2b4003d90 con 0x7fc2bc106f10 2024-09-12T12:25:16.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.618+0000 7fc2b1ffb640 1 -- 172.21.15.33:0/3593647635 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b4030b80 con 0x7fc2bc106f10 2024-09-12T12:25:16.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.618+0000 7fc2c2d58640 1 -- 172.21.15.33:0/3593647635 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2bc1a70e0 con 0x7fc2bc106f10 2024-09-12T12:25:16.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.619+0000 7fc2c2d58640 1 -- 172.21.15.33:0/3593647635 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2bc1021c0 con 0x7fc2bc106f10 2024-09-12T12:25:16.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.620+0000 7fc2b1ffb640 1 -- 172.21.15.33:0/3593647635 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc2b4004040 con 0x7fc2bc106f10 2024-09-12T12:25:16.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.621+0000 7fc2b1ffb640 1 --2- 172.21.15.33:0/3593647635 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc2a40a2c10 0x7fc2a40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:16.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.621+0000 7fc2c0af4640 1 --2- 172.21.15.33:0/3593647635 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc2a40a2c10 0x7fc2a40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:16.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.621+0000 7fc2b1ffb640 1 -- 172.21.15.33:0/3593647635 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7fc2b40f0b10 con 0x7fc2bc106f10 2024-09-12T12:25:16.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.621+0000 7fc2c0af4640 1 --2- 172.21.15.33:0/3593647635 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc2a40a2c10 0x7fc2a40a50d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8009bd0 tx=0x7fc2b8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:16.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.625+0000 7fc2b1ffb640 1 -- 172.21.15.33:0/3593647635 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc2b40bd660 con 0x7fc2bc106f10 2024-09-12T12:25:16.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.800+0000 7fc2c2d58640 1 -- 172.21.15.33:0/3593647635 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fc2bc10a150 con 0x7fc2bc106f10 2024-09-12T12:25:16.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.801+0000 7fc2b1ffb640 1 -- 172.21.15.33:0/3593647635 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc2b40bcf60 con 0x7fc2bc106f10 2024-09-12T12:25:16.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.803+0000 7fc2c2d58640 1 -- 172.21.15.33:0/3593647635 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc2a40a2c10 msgr2=0x7fc2a40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:16.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.803+0000 7fc2c2d58640 1 --2- 172.21.15.33:0/3593647635 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc2a40a2c10 0x7fc2a40a50d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8009bd0 tx=0x7fc2b8005f90 comp rx=0 tx=0).stop 2024-09-12T12:25:16.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.803+0000 7fc2c2d58640 1 -- 172.21.15.33:0/3593647635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2bc106f10 msgr2=0x7fc2bc074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:16.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.803+0000 7fc2c2d58640 1 --2- 172.21.15.33:0/3593647635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2bc106f10 0x7fc2bc074f70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4009dc0 tx=0x7fc2b4032ff0 comp rx=0 tx=0).stop 2024-09-12T12:25:16.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.803+0000 7fc2c2d58640 1 -- 172.21.15.33:0/3593647635 shutdown_connections 2024-09-12T12:25:16.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.803+0000 7fc2c2d58640 1 --2- 172.21.15.33:0/3593647635 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc2a40a2c10 0x7fc2a40a50d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:16.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.803+0000 7fc2c2d58640 1 --2- 172.21.15.33:0/3593647635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2bc106f10 0x7fc2bc074f70 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:16.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.803+0000 7fc2c2d58640 1 --2- 172.21.15.33:0/3593647635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2bc102790 0x7fc2bc074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:16.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.803+0000 7fc2c2d58640 1 --2- 172.21.15.33:0/3593647635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2bc101de0 0x7fc2bc0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:16.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.803+0000 7fc2c2d58640 1 -- 172.21.15.33:0/3593647635 >> 172.21.15.33:0/3593647635 conn(0x7fc2bc0fd8c0 msgr2=0x7fc2bc0fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:16.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.803+0000 7fc2c2d58640 1 -- 172.21.15.33:0/3593647635 shutdown_connections 2024-09-12T12:25:16.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:15.803+0000 7fc2c2d58640 1 -- 172.21.15.33:0/3593647635 wait complete. 2024-09-12T12:25:16.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:16 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/3593647635' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-12T12:25:16.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:16 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/3593647635' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-12T12:25:16.685 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:16 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/3593647635' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-12T12:25:16.717 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444106 got 73014444108 for osd.2 2024-09-12T12:25:16.718 DEBUG:teuthology.parallel:result is None 2024-09-12T12:25:16.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:16.899+0000 7f9873849640 1 -- 172.21.15.33:0/3543899858 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f986c106f10 msgr2=0x7f986c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:16.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:16.899+0000 7f9873849640 1 --2- 172.21.15.33:0/3543899858 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f986c106f10 0x7f986c10ea90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9868009900 tx=0x7f986802a410 comp rx=0 tx=0).stop 2024-09-12T12:25:16.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:16.899+0000 7f9873849640 1 -- 172.21.15.33:0/3543899858 shutdown_connections 2024-09-12T12:25:16.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:16.899+0000 7f9873849640 1 --2- 172.21.15.33:0/3543899858 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f986c106f10 0x7f986c10ea90 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:16.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:16.899+0000 7f9873849640 1 --2- 172.21.15.33:0/3543899858 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f986c102790 0x7f986c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:16.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:16.899+0000 7f9873849640 1 --2- 172.21.15.33:0/3543899858 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f986c101de0 0x7f986c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:16.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:16.899+0000 7f9873849640 1 -- 172.21.15.33:0/3543899858 >> 172.21.15.33:0/3543899858 conn(0x7f986c0fd8c0 msgr2=0x7f986c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:16.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:16.899+0000 7f9873849640 1 -- 172.21.15.33:0/3543899858 shutdown_connections 2024-09-12T12:25:16.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:16.899+0000 7f9873849640 1 -- 172.21.15.33:0/3543899858 wait complete. 2024-09-12T12:25:16.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:16.899+0000 7f9873849640 1 Processor -- start 2024-09-12T12:25:16.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:16.899+0000 7f9873849640 1 -- start start 2024-09-12T12:25:16.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:16.900+0000 7f9873849640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f986c101de0 0x7f986c198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:16.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:16.900+0000 7f9873849640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f986c102790 0x7f986c1987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:16.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:16.900+0000 7f9873849640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f986c106f10 0x7f986c19cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:16.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:16.900+0000 7f9873849640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f986c111e20 con 0x7f986c106f10 2024-09-12T12:25:16.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:16.900+0000 7f9873849640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f986c111ca0 con 0x7f986c102790 2024-09-12T12:25:16.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:16.900+0000 7f9873849640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f986c111fa0 con 0x7f986c101de0 2024-09-12T12:25:16.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:16.900+0000 7f9871de6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f986c106f10 0x7f986c19cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:16.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:16.900+0000 7f9871de6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f986c106f10 0x7f986c19cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37288/0 (socket says 172.21.15.33:37288) 2024-09-12T12:25:16.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:16.900+0000 7f9871de6640 1 -- 172.21.15.33:0/4168990210 learned_addr learned my addr 172.21.15.33:0/4168990210 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:16.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:16.900+0000 7f98715e5640 1 --2- 172.21.15.33:0/4168990210 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f986c101de0 0x7f986c198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:16.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:16.900+0000 7f9870de4640 1 --2- 172.21.15.33:0/4168990210 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f986c102790 0x7f986c1987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:16.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:16.900+0000 7f9871de6640 1 -- 172.21.15.33:0/4168990210 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f986c101de0 msgr2=0x7f986c198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:16.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:16.900+0000 7f9871de6640 1 --2- 172.21.15.33:0/4168990210 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f986c101de0 0x7f986c198280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:16.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:16.900+0000 7f9871de6640 1 -- 172.21.15.33:0/4168990210 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f986c102790 msgr2=0x7f986c1987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:16.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:16.900+0000 7f9871de6640 1 --2- 172.21.15.33:0/4168990210 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f986c102790 0x7f986c1987c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:16.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:16.900+0000 7f9871de6640 1 -- 172.21.15.33:0/4168990210 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f986c19d230 con 0x7f986c106f10 2024-09-12T12:25:16.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:16.900+0000 7f9870de4640 1 --2- 172.21.15.33:0/4168990210 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f986c102790 0x7f986c1987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:16.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:16.900+0000 7f9871de6640 1 --2- 172.21.15.33:0/4168990210 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f986c106f10 0x7f986c19cb50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9868009230 tx=0x7f9868004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:16.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:16.901+0000 7f98627fc640 1 -- 172.21.15.33:0/4168990210 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986803f030 con 0x7f986c106f10 2024-09-12T12:25:16.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:16.901+0000 7f98627fc640 1 -- 172.21.15.33:0/4168990210 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9868003aa0 con 0x7f986c106f10 2024-09-12T12:25:16.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:16.901+0000 7f9873849640 1 -- 172.21.15.33:0/4168990210 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f986c19d4c0 con 0x7f986c106f10 2024-09-12T12:25:16.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:16.901+0000 7f98627fc640 1 -- 172.21.15.33:0/4168990210 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9868035070 con 0x7f986c106f10 2024-09-12T12:25:16.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:16.901+0000 7f9873849640 1 -- 172.21.15.33:0/4168990210 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f986c1a4e00 con 0x7f986c106f10 2024-09-12T12:25:16.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:16.902+0000 7f9873849640 1 -- 172.21.15.33:0/4168990210 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f986c1032c0 con 0x7f986c106f10 2024-09-12T12:25:16.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:16.903+0000 7f98627fc640 1 -- 172.21.15.33:0/4168990210 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f9868042030 con 0x7f986c106f10 2024-09-12T12:25:16.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:16.904+0000 7f98627fc640 1 --2- 172.21.15.33:0/4168990210 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f98580a2c10 0x7f98580a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:16.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:16.904+0000 7f98715e5640 1 --2- 172.21.15.33:0/4168990210 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f98580a2c10 0x7f98580a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:16.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:16.904+0000 7f98627fc640 1 -- 172.21.15.33:0/4168990210 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7f98680efcb0 con 0x7f986c106f10 2024-09-12T12:25:16.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:16.905+0000 7f98715e5640 1 --2- 172.21.15.33:0/4168990210 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f98580a2c10 0x7f98580a50d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9864005fd0 tx=0x7f9864009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:16.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:16.909+0000 7f98627fc640 1 -- 172.21.15.33:0/4168990210 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f98680bc750 con 0x7f986c106f10 2024-09-12T12:25:17.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.087+0000 7f9873849640 1 -- 172.21.15.33:0/4168990210 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f986c10a150 con 0x7f986c106f10 2024-09-12T12:25:17.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.088+0000 7f98627fc640 1 -- 172.21.15.33:0/4168990210 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f98680bc050 con 0x7f986c106f10 2024-09-12T12:25:17.090 INFO:teuthology.orchestra.run.smithi033.stdout:283467841571 2024-09-12T12:25:17.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.090+0000 7f9873849640 1 -- 172.21.15.33:0/4168990210 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f98580a2c10 msgr2=0x7f98580a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:17.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.090+0000 7f9873849640 1 --2- 172.21.15.33:0/4168990210 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f98580a2c10 0x7f98580a50d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9864005fd0 tx=0x7f9864009680 comp rx=0 tx=0).stop 2024-09-12T12:25:17.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.090+0000 7f9873849640 1 -- 172.21.15.33:0/4168990210 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f986c106f10 msgr2=0x7f986c19cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:17.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.090+0000 7f9873849640 1 --2- 172.21.15.33:0/4168990210 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f986c106f10 0x7f986c19cb50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9868009230 tx=0x7f9868004270 comp rx=0 tx=0).stop 2024-09-12T12:25:17.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.090+0000 7f9873849640 1 -- 172.21.15.33:0/4168990210 shutdown_connections 2024-09-12T12:25:17.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.090+0000 7f9873849640 1 --2- 172.21.15.33:0/4168990210 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f98580a2c10 0x7f98580a50d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:17.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.090+0000 7f9873849640 1 --2- 172.21.15.33:0/4168990210 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f986c106f10 0x7f986c19cb50 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:17.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.090+0000 7f9873849640 1 --2- 172.21.15.33:0/4168990210 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f986c102790 0x7f986c1987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:17.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.090+0000 7f9873849640 1 --2- 172.21.15.33:0/4168990210 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f986c101de0 0x7f986c198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:17.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.090+0000 7f9873849640 1 -- 172.21.15.33:0/4168990210 >> 172.21.15.33:0/4168990210 conn(0x7f986c0fd8c0 msgr2=0x7f986c0fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:17.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.090+0000 7f9873849640 1 -- 172.21.15.33:0/4168990210 shutdown_connections 2024-09-12T12:25:17.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.090+0000 7f9873849640 1 -- 172.21.15.33:0/4168990210 wait complete. 2024-09-12T12:25:17.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.107+0000 7f1fd1200640 1 -- 172.21.15.33:0/1325980063 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fcc100e20 msgr2=0x7f1fcc101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:17.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.107+0000 7f1fd1200640 1 --2- 172.21.15.33:0/1325980063 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fcc100e20 0x7f1fcc101200 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc009900 tx=0x7f1fbc02a480 comp rx=0 tx=0).stop 2024-09-12T12:25:17.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.107+0000 7f1fd1200640 1 -- 172.21.15.33:0/1325980063 shutdown_connections 2024-09-12T12:25:17.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.107+0000 7f1fd1200640 1 --2- 172.21.15.33:0/1325980063 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fcc102ef0 0x7f1fcc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:17.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.107+0000 7f1fd1200640 1 --2- 172.21.15.33:0/1325980063 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fcc102570 0x7f1fcc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:17.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.107+0000 7f1fd1200640 1 --2- 172.21.15.33:0/1325980063 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fcc100e20 0x7f1fcc101200 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:17.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.107+0000 7f1fd1200640 1 -- 172.21.15.33:0/1325980063 >> 172.21.15.33:0/1325980063 conn(0x7f1fcc0fc7d0 msgr2=0x7f1fcc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:17.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.107+0000 7f1fd1200640 1 -- 172.21.15.33:0/1325980063 shutdown_connections 2024-09-12T12:25:17.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.107+0000 7f1fd1200640 1 -- 172.21.15.33:0/1325980063 wait complete. 2024-09-12T12:25:17.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.108+0000 7f1fd1200640 1 Processor -- start 2024-09-12T12:25:17.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.108+0000 7f1fd1200640 1 -- start start 2024-09-12T12:25:17.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.108+0000 7f1fd1200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fcc100e20 0x7f1fcc1992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:17.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.109+0000 7f1fd1200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fcc102570 0x7f1fcc199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:17.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.109+0000 7f1fd1200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fcc102ef0 0x7f1fcc1a4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:17.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.109+0000 7f1fd1200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1fcc110e80 con 0x7f1fcc100e20 2024-09-12T12:25:17.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.109+0000 7f1fd1200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1fcc110d00 con 0x7f1fcc102ef0 2024-09-12T12:25:17.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.109+0000 7f1fd1200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1fcc111000 con 0x7f1fcc102570 2024-09-12T12:25:17.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.109+0000 7f1fcad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fcc100e20 0x7f1fcc1992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:17.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.109+0000 7f1fcad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fcc100e20 0x7f1fcc1992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37310/0 (socket says 172.21.15.33:37310) 2024-09-12T12:25:17.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.109+0000 7f1fcad9d640 1 -- 172.21.15.33:0/319612029 learned_addr learned my addr 172.21.15.33:0/319612029 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:17.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.109+0000 7f1fc3fff640 1 --2- 172.21.15.33:0/319612029 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fcc102570 0x7f1fcc199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:17.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.109+0000 7f1fcb59e640 1 --2- 172.21.15.33:0/319612029 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fcc102ef0 0x7f1fcc1a4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:17.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.109+0000 7f1fcad9d640 1 -- 172.21.15.33:0/319612029 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fcc102570 msgr2=0x7f1fcc199810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:17.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.109+0000 7f1fcad9d640 1 --2- 172.21.15.33:0/319612029 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fcc102570 0x7f1fcc199810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:17.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.109+0000 7f1fcad9d640 1 -- 172.21.15.33:0/319612029 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fcc102ef0 msgr2=0x7f1fcc1a4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:17.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.109+0000 7f1fcad9d640 1 --2- 172.21.15.33:0/319612029 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fcc102ef0 0x7f1fcc1a4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:17.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.109+0000 7f1fcad9d640 1 -- 172.21.15.33:0/319612029 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fcc1a4890 con 0x7f1fcc100e20 2024-09-12T12:25:17.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.109+0000 7f1fcb59e640 1 --2- 172.21.15.33:0/319612029 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fcc102ef0 0x7f1fcc1a4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:17.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.109+0000 7f1fcad9d640 1 --2- 172.21.15.33:0/319612029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fcc100e20 0x7f1fcc1992d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc006010 tx=0x7f1fbc003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:17.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.110+0000 7f1fc8d99640 1 -- 172.21.15.33:0/319612029 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc03f070 con 0x7f1fcc100e20 2024-09-12T12:25:17.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.110+0000 7f1fd1200640 1 -- 172.21.15.33:0/319612029 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fcc1970c0 con 0x7f1fcc100e20 2024-09-12T12:25:17.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.110+0000 7f1fc8d99640 1 -- 172.21.15.33:0/319612029 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1fbc03bd20 con 0x7f1fcc100e20 2024-09-12T12:25:17.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.110+0000 7f1fc8d99640 1 -- 172.21.15.33:0/319612029 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc035030 con 0x7f1fcc100e20 2024-09-12T12:25:17.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.110+0000 7f1fd1200640 1 -- 172.21.15.33:0/319612029 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fcc1975a0 con 0x7f1fcc100e20 2024-09-12T12:25:17.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.111+0000 7f1fd1200640 1 -- 172.21.15.33:0/319612029 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fcc101200 con 0x7f1fcc100e20 2024-09-12T12:25:17.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.112+0000 7f1fc8d99640 1 -- 172.21.15.33:0/319612029 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1fbc042070 con 0x7f1fcc100e20 2024-09-12T12:25:17.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.113+0000 7f1fc8d99640 1 --2- 172.21.15.33:0/319612029 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f1fb80a2c10 0x7f1fb80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:17.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.113+0000 7f1fc8d99640 1 -- 172.21.15.33:0/319612029 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7f1fbc0efe30 con 0x7f1fcc100e20 2024-09-12T12:25:17.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.113+0000 7f1fc3fff640 1 --2- 172.21.15.33:0/319612029 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f1fb80a2c10 0x7f1fb80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:17.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.113+0000 7f1fc3fff640 1 --2- 172.21.15.33:0/319612029 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f1fb80a2c10 0x7f1fb80a50d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc06aac0 tx=0x7f1fb400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:17.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.117+0000 7f1fc8d99640 1 -- 172.21.15.33:0/319612029 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1fbc0bc8d0 con 0x7f1fcc100e20 2024-09-12T12:25:17.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.295+0000 7f1fd1200640 1 -- 172.21.15.33:0/319612029 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f1fcc109090 con 0x7f1fcc100e20 2024-09-12T12:25:17.297 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:17 smithi033 ceph-mon[31246]: pgmap v326: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T12:25:17.297 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:17 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/4168990210' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-12T12:25:17.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.296+0000 7f1fc8d99640 1 -- 172.21.15.33:0/319612029 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f1fbc0bc1d0 con 0x7f1fcc100e20 2024-09-12T12:25:17.298 INFO:teuthology.orchestra.run.smithi033.stdout:128849018946 2024-09-12T12:25:17.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.298+0000 7f1fd1200640 1 -- 172.21.15.33:0/319612029 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f1fb80a2c10 msgr2=0x7f1fb80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:17.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.298+0000 7f1fd1200640 1 --2- 172.21.15.33:0/319612029 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f1fb80a2c10 0x7f1fb80a50d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc06aac0 tx=0x7f1fb400a2d0 comp rx=0 tx=0).stop 2024-09-12T12:25:17.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.298+0000 7f1fd1200640 1 -- 172.21.15.33:0/319612029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fcc100e20 msgr2=0x7f1fcc1992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:17.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.298+0000 7f1fd1200640 1 --2- 172.21.15.33:0/319612029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fcc100e20 0x7f1fcc1992d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc006010 tx=0x7f1fbc003d50 comp rx=0 tx=0).stop 2024-09-12T12:25:17.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.298+0000 7f1fd1200640 1 -- 172.21.15.33:0/319612029 shutdown_connections 2024-09-12T12:25:17.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.298+0000 7f1fd1200640 1 --2- 172.21.15.33:0/319612029 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f1fb80a2c10 0x7f1fb80a50d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:17.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.298+0000 7f1fd1200640 1 --2- 172.21.15.33:0/319612029 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fcc102ef0 0x7f1fcc1a4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:17.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.298+0000 7f1fd1200640 1 --2- 172.21.15.33:0/319612029 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fcc102570 0x7f1fcc199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:17.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.298+0000 7f1fd1200640 1 --2- 172.21.15.33:0/319612029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fcc100e20 0x7f1fcc1992d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:17.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.298+0000 7f1fd1200640 1 -- 172.21.15.33:0/319612029 >> 172.21.15.33:0/319612029 conn(0x7f1fcc0fc7d0 msgr2=0x7f1fcc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:17.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.298+0000 7f1fd1200640 1 -- 172.21.15.33:0/319612029 shutdown_connections 2024-09-12T12:25:17.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.298+0000 7f1fd1200640 1 -- 172.21.15.33:0/319612029 wait complete. 2024-09-12T12:25:17.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:17 smithi043 ceph-mon[34144]: pgmap v326: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T12:25:17.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:17 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/4168990210' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-12T12:25:17.620 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247876 got 98784247878 for osd.3 2024-09-12T12:25:17.620 DEBUG:teuthology.parallel:result is None 2024-09-12T12:25:17.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:17 smithi102 ceph-mon[34799]: pgmap v326: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T12:25:17.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:17 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/4168990210' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-12T12:25:17.852 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:17.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.932+0000 7fc981da9640 1 -- 172.21.15.33:0/428811244 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc97c101de0 msgr2=0x7fc97c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:17.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.932+0000 7fc981da9640 1 --2- 172.21.15.33:0/428811244 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc97c101de0 0x7fc97c1021c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc964009900 tx=0x7fc96402a410 comp rx=0 tx=0).stop 2024-09-12T12:25:17.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.932+0000 7fc981da9640 1 -- 172.21.15.33:0/428811244 shutdown_connections 2024-09-12T12:25:17.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.932+0000 7fc981da9640 1 --2- 172.21.15.33:0/428811244 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc97c106f10 0x7fc97c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:17.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.932+0000 7fc981da9640 1 --2- 172.21.15.33:0/428811244 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc97c102790 0x7fc97c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:17.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.932+0000 7fc981da9640 1 --2- 172.21.15.33:0/428811244 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc97c101de0 0x7fc97c1021c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:17.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.932+0000 7fc981da9640 1 -- 172.21.15.33:0/428811244 >> 172.21.15.33:0/428811244 conn(0x7fc97c0fd8c0 msgr2=0x7fc97c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:17.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.932+0000 7fc981da9640 1 -- 172.21.15.33:0/428811244 shutdown_connections 2024-09-12T12:25:17.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.932+0000 7fc981da9640 1 -- 172.21.15.33:0/428811244 wait complete. 2024-09-12T12:25:17.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.932+0000 7fc981da9640 1 Processor -- start 2024-09-12T12:25:17.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.933+0000 7fc981da9640 1 -- start start 2024-09-12T12:25:17.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.933+0000 7fc981da9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc97c101de0 0x7fc97c19a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:17.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.933+0000 7fc981da9640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc97c102790 0x7fc97c19ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:17.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.933+0000 7fc981da9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc97c106f10 0x7fc97c19ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:17.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.933+0000 7fc981da9640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc97c111e20 con 0x7fc97c106f10 2024-09-12T12:25:17.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.933+0000 7fc981da9640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc97c111ca0 con 0x7fc97c102790 2024-09-12T12:25:17.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.933+0000 7fc981da9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc97c111fa0 con 0x7fc97c101de0 2024-09-12T12:25:17.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.933+0000 7fc97bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc97c106f10 0x7fc97c19ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:17.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.933+0000 7fc97bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc97c106f10 0x7fc97c19ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37336/0 (socket says 172.21.15.33:37336) 2024-09-12T12:25:17.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.933+0000 7fc97bfff640 1 -- 172.21.15.33:0/372200671 learned_addr learned my addr 172.21.15.33:0/372200671 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:17.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.933+0000 7fc97affd640 1 --2- 172.21.15.33:0/372200671 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc97c102790 0x7fc97c19ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:17.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.933+0000 7fc97b7fe640 1 --2- 172.21.15.33:0/372200671 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc97c101de0 0x7fc97c19a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:17.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.933+0000 7fc97bfff640 1 -- 172.21.15.33:0/372200671 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc97c101de0 msgr2=0x7fc97c19a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:17.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.933+0000 7fc97bfff640 1 --2- 172.21.15.33:0/372200671 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc97c101de0 0x7fc97c19a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:17.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.933+0000 7fc97bfff640 1 -- 172.21.15.33:0/372200671 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc97c102790 msgr2=0x7fc97c19ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:17.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.933+0000 7fc97bfff640 1 --2- 172.21.15.33:0/372200671 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc97c102790 0x7fc97c19ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:17.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.933+0000 7fc97bfff640 1 -- 172.21.15.33:0/372200671 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc97c19f570 con 0x7fc97c106f10 2024-09-12T12:25:17.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.933+0000 7fc97b7fe640 1 --2- 172.21.15.33:0/372200671 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc97c101de0 0x7fc97c19a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:17.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.933+0000 7fc97bfff640 1 --2- 172.21.15.33:0/372200671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc97c106f10 0x7fc97c19ee90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc97400eaa0 tx=0x7fc97400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:17.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.934+0000 7fc978ff9640 1 -- 172.21.15.33:0/372200671 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc97400cdb0 con 0x7fc97c106f10 2024-09-12T12:25:17.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.934+0000 7fc978ff9640 1 -- 172.21.15.33:0/372200671 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc974005020 con 0x7fc97c106f10 2024-09-12T12:25:17.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.934+0000 7fc981da9640 1 -- 172.21.15.33:0/372200671 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc97c19f860 con 0x7fc97c106f10 2024-09-12T12:25:17.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.934+0000 7fc978ff9640 1 -- 172.21.15.33:0/372200671 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9740116d0 con 0x7fc97c106f10 2024-09-12T12:25:17.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.934+0000 7fc981da9640 1 -- 172.21.15.33:0/372200671 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc97c1a7140 con 0x7fc97c106f10 2024-09-12T12:25:17.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.935+0000 7fc981da9640 1 -- 172.21.15.33:0/372200671 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc97c1021c0 con 0x7fc97c106f10 2024-09-12T12:25:17.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.936+0000 7fc978ff9640 1 -- 172.21.15.33:0/372200671 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc9740051d0 con 0x7fc97c106f10 2024-09-12T12:25:17.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.937+0000 7fc978ff9640 1 --2- 172.21.15.33:0/372200671 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc9680a2c10 0x7fc9680a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:17.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.937+0000 7fc97b7fe640 1 --2- 172.21.15.33:0/372200671 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc9680a2c10 0x7fc9680a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:17.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.937+0000 7fc978ff9640 1 -- 172.21.15.33:0/372200671 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7fc9740cfa60 con 0x7fc97c106f10 2024-09-12T12:25:17.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.937+0000 7fc97b7fe640 1 --2- 172.21.15.33:0/372200671 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc9680a2c10 0x7fc9680a50d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc964031440 tx=0x7fc964005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:17.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:17.940+0000 7fc978ff9640 1 -- 172.21.15.33:0/372200671 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc974016030 con 0x7fc97c106f10 2024-09-12T12:25:18.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.118+0000 7fc981da9640 1 -- 172.21.15.33:0/372200671 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fc97c19b920 con 0x7fc97c106f10 2024-09-12T12:25:18.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.119+0000 7fc978ff9640 1 -- 172.21.15.33:0/372200671 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc97c19b920 con 0x7fc97c106f10 2024-09-12T12:25:18.120 INFO:teuthology.orchestra.run.smithi033.stdout:34359738453 2024-09-12T12:25:18.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.121+0000 7fc981da9640 1 -- 172.21.15.33:0/372200671 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc9680a2c10 msgr2=0x7fc9680a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:18.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.121+0000 7fc981da9640 1 --2- 172.21.15.33:0/372200671 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc9680a2c10 0x7fc9680a50d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc964031440 tx=0x7fc964005a20 comp rx=0 tx=0).stop 2024-09-12T12:25:18.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.121+0000 7fc981da9640 1 -- 172.21.15.33:0/372200671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc97c106f10 msgr2=0x7fc97c19ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:18.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.121+0000 7fc981da9640 1 --2- 172.21.15.33:0/372200671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc97c106f10 0x7fc97c19ee90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc97400eaa0 tx=0x7fc97400ef60 comp rx=0 tx=0).stop 2024-09-12T12:25:18.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.121+0000 7fc981da9640 1 -- 172.21.15.33:0/372200671 shutdown_connections 2024-09-12T12:25:18.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.121+0000 7fc981da9640 1 --2- 172.21.15.33:0/372200671 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc9680a2c10 0x7fc9680a50d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:18.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.121+0000 7fc981da9640 1 --2- 172.21.15.33:0/372200671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc97c106f10 0x7fc97c19ee90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:18.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.121+0000 7fc981da9640 1 --2- 172.21.15.33:0/372200671 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc97c102790 0x7fc97c19ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:18.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.121+0000 7fc981da9640 1 --2- 172.21.15.33:0/372200671 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc97c101de0 0x7fc97c19a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:18.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.121+0000 7fc981da9640 1 -- 172.21.15.33:0/372200671 >> 172.21.15.33:0/372200671 conn(0x7fc97c0fd8c0 msgr2=0x7fc97c0fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:18.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.121+0000 7fc981da9640 1 -- 172.21.15.33:0/372200671 shutdown_connections 2024-09-12T12:25:18.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.121+0000 7fc981da9640 1 -- 172.21.15.33:0/372200671 wait complete. 2024-09-12T12:25:18.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:18 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/319612029' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-12T12:25:18.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:18 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/372200671' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-12T12:25:18.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:18 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/319612029' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-12T12:25:18.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:18 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/372200671' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-12T12:25:18.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:18 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/319612029' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-12T12:25:18.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:18 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/372200671' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-12T12:25:18.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.825+0000 7fcce325a640 1 -- 172.21.15.33:0/4154825890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccdc1027a0 msgr2=0x7fccdc1067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:18.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.825+0000 7fcce325a640 1 --2- 172.21.15.33:0/4154825890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccdc1027a0 0x7fccdc1067f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fccd0009900 tx=0x7fccd002a410 comp rx=0 tx=0).stop 2024-09-12T12:25:18.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.825+0000 7fcce325a640 1 -- 172.21.15.33:0/4154825890 shutdown_connections 2024-09-12T12:25:18.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.825+0000 7fcce325a640 1 --2- 172.21.15.33:0/4154825890 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccdc106f20 0x7fccdc10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:18.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.825+0000 7fcce325a640 1 --2- 172.21.15.33:0/4154825890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccdc1027a0 0x7fccdc1067f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:18.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.825+0000 7fcce325a640 1 --2- 172.21.15.33:0/4154825890 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fccdc101df0 0x7fccdc1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:18.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.825+0000 7fcce325a640 1 -- 172.21.15.33:0/4154825890 >> 172.21.15.33:0/4154825890 conn(0x7fccdc0fd8b0 msgr2=0x7fccdc0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:18.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.825+0000 7fcce325a640 1 -- 172.21.15.33:0/4154825890 shutdown_connections 2024-09-12T12:25:18.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.825+0000 7fcce325a640 1 -- 172.21.15.33:0/4154825890 wait complete. 2024-09-12T12:25:18.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.826+0000 7fcce325a640 1 Processor -- start 2024-09-12T12:25:18.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.826+0000 7fcce325a640 1 -- start start 2024-09-12T12:25:18.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.826+0000 7fcce325a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccdc101df0 0x7fccdc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:18.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.826+0000 7fcce325a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fccdc1027a0 0x7fccdc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:18.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.826+0000 7fcce325a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccdc106f20 0x7fccdc074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:18.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.826+0000 7fcce325a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fccdc111e50 con 0x7fccdc101df0 2024-09-12T12:25:18.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.826+0000 7fcce325a640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fccdc111cd0 con 0x7fccdc106f20 2024-09-12T12:25:18.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.826+0000 7fcce325a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fccdc111fd0 con 0x7fccdc1027a0 2024-09-12T12:25:18.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.827+0000 7fcce0ff6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccdc101df0 0x7fccdc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:18.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.827+0000 7fcce0ff6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccdc101df0 0x7fccdc0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37360/0 (socket says 172.21.15.33:37360) 2024-09-12T12:25:18.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.827+0000 7fcce0ff6640 1 -- 172.21.15.33:0/3181803937 learned_addr learned my addr 172.21.15.33:0/3181803937 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:18.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.827+0000 7fccdbfff640 1 --2- 172.21.15.33:0/3181803937 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fccdc1027a0 0x7fccdc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:18.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.827+0000 7fcce0ff6640 1 -- 172.21.15.33:0/3181803937 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fccdc1027a0 msgr2=0x7fccdc074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:18.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.827+0000 7fcce0ff6640 1 --2- 172.21.15.33:0/3181803937 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fccdc1027a0 0x7fccdc074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:18.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.827+0000 7fcce0ff6640 1 -- 172.21.15.33:0/3181803937 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccdc106f20 msgr2=0x7fccdc074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:18.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.827+0000 7fcce17f7640 1 --2- 172.21.15.33:0/3181803937 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccdc106f20 0x7fccdc074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:18.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.827+0000 7fcce0ff6640 1 --2- 172.21.15.33:0/3181803937 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccdc106f20 0x7fccdc074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:18.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.827+0000 7fcce0ff6640 1 -- 172.21.15.33:0/3181803937 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccdc1a68d0 con 0x7fccdc101df0 2024-09-12T12:25:18.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.827+0000 7fcce0ff6640 1 --2- 172.21.15.33:0/3181803937 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccdc101df0 0x7fccdc0744f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fcccc00c920 tx=0x7fcccc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:18.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.827+0000 7fccd9ffb640 1 -- 172.21.15.33:0/3181803937 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcccc007c70 con 0x7fccdc101df0 2024-09-12T12:25:18.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.827+0000 7fccd9ffb640 1 -- 172.21.15.33:0/3181803937 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcccc007e10 con 0x7fccdc101df0 2024-09-12T12:25:18.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.827+0000 7fcce325a640 1 -- 172.21.15.33:0/3181803937 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccdc1a6bc0 con 0x7fccdc101df0 2024-09-12T12:25:18.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.827+0000 7fccd9ffb640 1 -- 172.21.15.33:0/3181803937 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcccc018820 con 0x7fccdc101df0 2024-09-12T12:25:18.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.828+0000 7fcce325a640 1 -- 172.21.15.33:0/3181803937 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccdc1a70d0 con 0x7fccdc101df0 2024-09-12T12:25:18.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.829+0000 7fcce325a640 1 -- 172.21.15.33:0/3181803937 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccdc1021d0 con 0x7fccdc101df0 2024-09-12T12:25:18.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.829+0000 7fccd9ffb640 1 -- 172.21.15.33:0/3181803937 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fcccc0189c0 con 0x7fccdc101df0 2024-09-12T12:25:18.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.830+0000 7fccd9ffb640 1 --2- 172.21.15.33:0/3181803937 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fccc40a2c10 0x7fccc40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:18.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.830+0000 7fccd9ffb640 1 -- 172.21.15.33:0/3181803937 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7fcccc0cf790 con 0x7fccdc101df0 2024-09-12T12:25:18.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.830+0000 7fccdbfff640 1 --2- 172.21.15.33:0/3181803937 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fccc40a2c10 0x7fccc40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:18.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.831+0000 7fccdbfff640 1 --2- 172.21.15.33:0/3181803937 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fccc40a2c10 0x7fccc40a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fccd0031440 tx=0x7fccd00095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:18.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:18.834+0000 7fccd9ffb640 1 -- 172.21.15.33:0/3181803937 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcccc014030 con 0x7fccdc101df0 2024-09-12T12:25:19.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:19.020+0000 7fcce325a640 1 -- 172.21.15.33:0/3181803937 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fccdc10a100 con 0x7fccdc101df0 2024-09-12T12:25:19.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:19.020+0000 7fccd9ffb640 1 -- 172.21.15.33:0/3181803937 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fcccc00de20 con 0x7fccdc101df0 2024-09-12T12:25:19.021 INFO:teuthology.orchestra.run.smithi033.stdout:261993005097 2024-09-12T12:25:19.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:19.023+0000 7fcce325a640 1 -- 172.21.15.33:0/3181803937 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fccc40a2c10 msgr2=0x7fccc40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:19.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:19.023+0000 7fcce325a640 1 --2- 172.21.15.33:0/3181803937 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fccc40a2c10 0x7fccc40a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fccd0031440 tx=0x7fccd00095f0 comp rx=0 tx=0).stop 2024-09-12T12:25:19.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:19.023+0000 7fcce325a640 1 -- 172.21.15.33:0/3181803937 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccdc101df0 msgr2=0x7fccdc0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:19.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:19.023+0000 7fcce325a640 1 --2- 172.21.15.33:0/3181803937 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccdc101df0 0x7fccdc0744f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fcccc00c920 tx=0x7fcccc00cde0 comp rx=0 tx=0).stop 2024-09-12T12:25:19.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:19.023+0000 7fcce325a640 1 -- 172.21.15.33:0/3181803937 shutdown_connections 2024-09-12T12:25:19.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:19.023+0000 7fcce325a640 1 --2- 172.21.15.33:0/3181803937 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fccc40a2c10 0x7fccc40a50d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:19.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:19.023+0000 7fcce325a640 1 --2- 172.21.15.33:0/3181803937 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccdc106f20 0x7fccdc074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:19.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:19.023+0000 7fcce325a640 1 --2- 172.21.15.33:0/3181803937 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fccdc1027a0 0x7fccdc074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:19.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:19.023+0000 7fcce325a640 1 --2- 172.21.15.33:0/3181803937 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccdc101df0 0x7fccdc0744f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:19.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:19.023+0000 7fcce325a640 1 -- 172.21.15.33:0/3181803937 >> 172.21.15.33:0/3181803937 conn(0x7fccdc0fd8b0 msgr2=0x7fccdc0fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:19.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:19.023+0000 7fcce325a640 1 -- 172.21.15.33:0/3181803937 shutdown_connections 2024-09-12T12:25:19.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:19.023+0000 7fcce325a640 1 -- 172.21.15.33:0/3181803937 wait complete. 2024-09-12T12:25:19.274 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738449 got 34359738453 for osd.0 2024-09-12T12:25:19.274 DEBUG:teuthology.parallel:result is None 2024-09-12T12:25:19.501 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:19 smithi033 ceph-mon[31246]: pgmap v327: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-12T12:25:19.502 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:19 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/3181803937' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-12T12:25:19.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:19 smithi043 ceph-mon[34144]: pgmap v327: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-12T12:25:19.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:19 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/3181803937' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-12T12:25:19.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:19 smithi102 ceph-mon[34799]: pgmap v327: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-12T12:25:19.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:19 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/3181803937' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-12T12:25:19.949 INFO:tasks.cephadm.ceph_manager.ceph:need seq 261993005095 got 261993005097 for osd.9 2024-09-12T12:25:19.950 DEBUG:teuthology.parallel:result is None 2024-09-12T12:25:20.411 INFO:tasks.cephadm.ceph_manager.ceph:need seq 283467841568 got 283467841571 for osd.10 2024-09-12T12:25:20.411 DEBUG:teuthology.parallel:result is None 2024-09-12T12:25:21.076 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018943 got 128849018946 for osd.4 2024-09-12T12:25:21.076 DEBUG:teuthology.parallel:result is None 2024-09-12T12:25:21.083 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:21.362 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:21 smithi033 ceph-mon[31246]: pgmap v328: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T12:25:21.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.572+0000 7f8890e19640 1 -- 172.21.15.33:0/3823234742 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f888c10c170 msgr2=0x7f888c10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:21.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.572+0000 7f8890e19640 1 --2- 172.21.15.33:0/3823234742 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f888c10c170 0x7f888c10e610 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8884009ca0 tx=0x7f888402a950 comp rx=0 tx=0).stop 2024-09-12T12:25:21.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.572+0000 7f8890e19640 1 -- 172.21.15.33:0/3823234742 shutdown_connections 2024-09-12T12:25:21.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.572+0000 7f8890e19640 1 --2- 172.21.15.33:0/3823234742 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f888c10c170 0x7f888c10e610 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:21.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.572+0000 7f8890e19640 1 --2- 172.21.15.33:0/3823234742 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f888c103660 0x7f888c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:21.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.572+0000 7f8890e19640 1 --2- 172.21.15.33:0/3823234742 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f888c102d40 0x7f888c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:21.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.572+0000 7f8890e19640 1 -- 172.21.15.33:0/3823234742 >> 172.21.15.33:0/3823234742 conn(0x7f888c0fc7a0 msgr2=0x7f888c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:21.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.572+0000 7f8890e19640 1 -- 172.21.15.33:0/3823234742 shutdown_connections 2024-09-12T12:25:21.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.572+0000 7f8890e19640 1 -- 172.21.15.33:0/3823234742 wait complete. 2024-09-12T12:25:21.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.573+0000 7f8890e19640 1 Processor -- start 2024-09-12T12:25:21.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.573+0000 7f8890e19640 1 -- start start 2024-09-12T12:25:21.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.573+0000 7f8890e19640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f888c102d40 0x7f888c1982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:21.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.573+0000 7f8890e19640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f888c103660 0x7f888c198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:21.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.573+0000 7f8890e19640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f888c10c170 0x7f888c19cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:21.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.573+0000 7f8890e19640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f888c111e20 con 0x7f888c103660 2024-09-12T12:25:21.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.573+0000 7f8890e19640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f888c111ca0 con 0x7f888c102d40 2024-09-12T12:25:21.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.573+0000 7f8890e19640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f888c111fa0 con 0x7f888c10c170 2024-09-12T12:25:21.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.573+0000 7f8889d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f888c103660 0x7f888c198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:21.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.573+0000 7f8889d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f888c103660 0x7f888c198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37314/0 (socket says 172.21.15.33:37314) 2024-09-12T12:25:21.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.573+0000 7f8889d9b640 1 -- 172.21.15.33:0/1598150634 learned_addr learned my addr 172.21.15.33:0/1598150634 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:21.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.573+0000 7f888ad9d640 1 --2- 172.21.15.33:0/1598150634 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f888c10c170 0x7f888c19cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:21.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.573+0000 7f888a59c640 1 --2- 172.21.15.33:0/1598150634 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f888c102d40 0x7f888c1982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:21.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.574+0000 7f8889d9b640 1 -- 172.21.15.33:0/1598150634 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f888c10c170 msgr2=0x7f888c19cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:21.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.574+0000 7f8889d9b640 1 --2- 172.21.15.33:0/1598150634 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f888c10c170 0x7f888c19cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:21.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.574+0000 7f8889d9b640 1 -- 172.21.15.33:0/1598150634 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f888c102d40 msgr2=0x7f888c1982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:21.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.574+0000 7f8889d9b640 1 --2- 172.21.15.33:0/1598150634 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f888c102d40 0x7f888c1982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:21.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.574+0000 7f8889d9b640 1 -- 172.21.15.33:0/1598150634 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f888c19d290 con 0x7f888c103660 2024-09-12T12:25:21.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.574+0000 7f8889d9b640 1 --2- 172.21.15.33:0/1598150634 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f888c103660 0x7f888c198820 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f888000d740 tx=0x7f888000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:21.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.574+0000 7f887b7fe640 1 -- 172.21.15.33:0/1598150634 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8880017070 con 0x7f888c103660 2024-09-12T12:25:21.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.574+0000 7f887b7fe640 1 -- 172.21.15.33:0/1598150634 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f888000de50 con 0x7f888c103660 2024-09-12T12:25:21.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.574+0000 7f8890e19640 1 -- 172.21.15.33:0/1598150634 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f888c19d580 con 0x7f888c103660 2024-09-12T12:25:21.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.574+0000 7f887b7fe640 1 -- 172.21.15.33:0/1598150634 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888000f620 con 0x7f888c103660 2024-09-12T12:25:21.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.574+0000 7f8890e19640 1 -- 172.21.15.33:0/1598150634 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f888c1a4e60 con 0x7f888c103660 2024-09-12T12:25:21.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.575+0000 7f8890e19640 1 -- 172.21.15.33:0/1598150634 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f888c103120 con 0x7f888c103660 2024-09-12T12:25:21.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.576+0000 7f887b7fe640 1 -- 172.21.15.33:0/1598150634 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f8880009c30 con 0x7f888c103660 2024-09-12T12:25:21.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.577+0000 7f887b7fe640 1 --2- 172.21.15.33:0/1598150634 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f88740a2c10 0x7f88740a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:21.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.577+0000 7f888a59c640 1 --2- 172.21.15.33:0/1598150634 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f88740a2c10 0x7f88740a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:21.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.577+0000 7f887b7fe640 1 -- 172.21.15.33:0/1598150634 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7f88800cefe0 con 0x7f888c103660 2024-09-12T12:25:21.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.578+0000 7f888a59c640 1 --2- 172.21.15.33:0/1598150634 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f88740a2c10 0x7f88740a50d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f887c00bbe0 tx=0x7f887c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:21.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.581+0000 7f887b7fe640 1 -- 172.21.15.33:0/1598150634 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f888009b430 con 0x7f888c103660 2024-09-12T12:25:21.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:21 smithi043 ceph-mon[34144]: pgmap v328: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T12:25:21.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:21 smithi102 ceph-mon[34799]: pgmap v328: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T12:25:21.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.761+0000 7f8890e19640 1 -- 172.21.15.33:0/1598150634 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f888c1071e0 con 0x7f888c103660 2024-09-12T12:25:21.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.762+0000 7f887b7fe640 1 -- 172.21.15.33:0/1598150634 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f888009f730 con 0x7f888c103660 2024-09-12T12:25:21.763 INFO:teuthology.orchestra.run.smithi033.stdout:201863462963 2024-09-12T12:25:21.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.764+0000 7f8890e19640 1 -- 172.21.15.33:0/1598150634 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f88740a2c10 msgr2=0x7f88740a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:21.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.764+0000 7f8890e19640 1 --2- 172.21.15.33:0/1598150634 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f88740a2c10 0x7f88740a50d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f887c00bbe0 tx=0x7f887c00b390 comp rx=0 tx=0).stop 2024-09-12T12:25:21.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.764+0000 7f8890e19640 1 -- 172.21.15.33:0/1598150634 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f888c103660 msgr2=0x7f888c198820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:21.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.764+0000 7f8890e19640 1 --2- 172.21.15.33:0/1598150634 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f888c103660 0x7f888c198820 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f888000d740 tx=0x7f888000dc00 comp rx=0 tx=0).stop 2024-09-12T12:25:21.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.764+0000 7f8890e19640 1 -- 172.21.15.33:0/1598150634 shutdown_connections 2024-09-12T12:25:21.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.764+0000 7f8890e19640 1 --2- 172.21.15.33:0/1598150634 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f88740a2c10 0x7f88740a50d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:21.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.764+0000 7f8890e19640 1 --2- 172.21.15.33:0/1598150634 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f888c10c170 0x7f888c19cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:21.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.764+0000 7f8890e19640 1 --2- 172.21.15.33:0/1598150634 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f888c103660 0x7f888c198820 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:21.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.764+0000 7f8890e19640 1 --2- 172.21.15.33:0/1598150634 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f888c102d40 0x7f888c1982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:21.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.764+0000 7f8890e19640 1 -- 172.21.15.33:0/1598150634 >> 172.21.15.33:0/1598150634 conn(0x7f888c0fc7a0 msgr2=0x7f888c0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:21.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.764+0000 7f8890e19640 1 -- 172.21.15.33:0/1598150634 shutdown_connections 2024-09-12T12:25:21.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:21.764+0000 7f8890e19640 1 -- 172.21.15.33:0/1598150634 wait complete. 2024-09-12T12:25:22.369 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:22 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/1598150634' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-12T12:25:22.401 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462960 got 201863462963 for osd.7 2024-09-12T12:25:22.402 DEBUG:teuthology.parallel:result is None 2024-09-12T12:25:22.402 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-12T12:25:22.402 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T12:25:22.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:22 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/1598150634' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-12T12:25:22.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:22 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/1598150634' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-12T12:25:22.708 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:23.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.187+0000 7f1653399640 1 -- 172.21.15.33:0/3085314729 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f164c101de0 msgr2=0x7f164c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:23.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.187+0000 7f1653399640 1 --2- 172.21.15.33:0/3085314729 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f164c101de0 0x7f164c1021c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1648009900 tx=0x7f164802a410 comp rx=0 tx=0).stop 2024-09-12T12:25:23.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.187+0000 7f1653399640 1 -- 172.21.15.33:0/3085314729 shutdown_connections 2024-09-12T12:25:23.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.187+0000 7f1653399640 1 --2- 172.21.15.33:0/3085314729 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f164c106f10 0x7f164c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:23.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.187+0000 7f1653399640 1 --2- 172.21.15.33:0/3085314729 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f164c102790 0x7f164c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:23.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.187+0000 7f1653399640 1 --2- 172.21.15.33:0/3085314729 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f164c101de0 0x7f164c1021c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:23.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.187+0000 7f1653399640 1 -- 172.21.15.33:0/3085314729 >> 172.21.15.33:0/3085314729 conn(0x7f164c0fd8c0 msgr2=0x7f164c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:23.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.187+0000 7f1653399640 1 -- 172.21.15.33:0/3085314729 shutdown_connections 2024-09-12T12:25:23.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.187+0000 7f1653399640 1 -- 172.21.15.33:0/3085314729 wait complete. 2024-09-12T12:25:23.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.188+0000 7f1653399640 1 Processor -- start 2024-09-12T12:25:23.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.188+0000 7f1653399640 1 -- start start 2024-09-12T12:25:23.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.188+0000 7f1653399640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f164c101de0 0x7f164c198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:23.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.188+0000 7f1653399640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f164c102790 0x7f164c1988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:23.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.188+0000 7f1653399640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f164c106f10 0x7f164c19cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:23.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.188+0000 7f1653399640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f164c111e20 con 0x7f164c102790 2024-09-12T12:25:23.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.188+0000 7f1653399640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f164c111ca0 con 0x7f164c106f10 2024-09-12T12:25:23.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.188+0000 7f1653399640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f164c111fa0 con 0x7f164c101de0 2024-09-12T12:25:23.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.188+0000 7f1650934640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f164c102790 0x7f164c1988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:23.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.188+0000 7f1650934640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f164c102790 0x7f164c1988c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37322/0 (socket says 172.21.15.33:37322) 2024-09-12T12:25:23.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.188+0000 7f1650934640 1 -- 172.21.15.33:0/645645504 learned_addr learned my addr 172.21.15.33:0/645645504 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:23.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.188+0000 7f1651135640 1 --2- 172.21.15.33:0/645645504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f164c101de0 0x7f164c198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:23.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.189+0000 7f1651936640 1 --2- 172.21.15.33:0/645645504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f164c106f10 0x7f164c19cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:23.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.189+0000 7f1650934640 1 -- 172.21.15.33:0/645645504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f164c101de0 msgr2=0x7f164c198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:23.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.189+0000 7f1650934640 1 --2- 172.21.15.33:0/645645504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f164c101de0 0x7f164c198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:23.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.189+0000 7f1650934640 1 -- 172.21.15.33:0/645645504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f164c106f10 msgr2=0x7f164c19cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:23.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.189+0000 7f1650934640 1 --2- 172.21.15.33:0/645645504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f164c106f10 0x7f164c19cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:23.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.189+0000 7f1650934640 1 -- 172.21.15.33:0/645645504 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f164c19d330 con 0x7f164c102790 2024-09-12T12:25:23.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.189+0000 7f1651936640 1 --2- 172.21.15.33:0/645645504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f164c106f10 0x7f164c19cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:23.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.189+0000 7f1650934640 1 --2- 172.21.15.33:0/645645504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f164c102790 0x7f164c1988c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f163c00d950 tx=0x7f163c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:23.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.189+0000 7f16427fc640 1 -- 172.21.15.33:0/645645504 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c017070 con 0x7f164c102790 2024-09-12T12:25:23.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.189+0000 7f16427fc640 1 -- 172.21.15.33:0/645645504 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f163c009c30 con 0x7f164c102790 2024-09-12T12:25:23.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.189+0000 7f1653399640 1 -- 172.21.15.33:0/645645504 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f164c19d620 con 0x7f164c102790 2024-09-12T12:25:23.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.189+0000 7f16427fc640 1 -- 172.21.15.33:0/645645504 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c00f620 con 0x7f164c102790 2024-09-12T12:25:23.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.189+0000 7f1653399640 1 -- 172.21.15.33:0/645645504 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f164c1a4f00 con 0x7f164c102790 2024-09-12T12:25:23.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.190+0000 7f1653399640 1 -- 172.21.15.33:0/645645504 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f164c1021c0 con 0x7f164c102790 2024-09-12T12:25:23.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.191+0000 7f16427fc640 1 -- 172.21.15.33:0/645645504 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f163c0109a0 con 0x7f164c102790 2024-09-12T12:25:23.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.192+0000 7f16427fc640 1 --2- 172.21.15.33:0/645645504 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f16380a2c90 0x7f16380a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:23.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.192+0000 7f1651135640 1 --2- 172.21.15.33:0/645645504 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f16380a2c90 0x7f16380a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:23.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.192+0000 7f16427fc640 1 -- 172.21.15.33:0/645645504 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7f163c0cf160 con 0x7f164c102790 2024-09-12T12:25:23.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.193+0000 7f1651135640 1 --2- 172.21.15.33:0/645645504 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f16380a2c90 0x7f16380a5150 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1648031440 tx=0x7f1648005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:23.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.197+0000 7f16427fc640 1 -- 172.21.15.33:0/645645504 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f163c009de0 con 0x7f164c102790 2024-09-12T12:25:23.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.371+0000 7f1653399640 1 -- 172.21.15.33:0/645645504 --> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f164c062630 con 0x7f16380a2c90 2024-09-12T12:25:23.372 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:23 smithi033 ceph-mon[31246]: pgmap v329: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T12:25:23.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.379+0000 7f16427fc640 1 -- 172.21.15.33:0/645645504 <== mgr.14150 v2:172.21.15.33:6800/176202431 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340641 (secure 0 0 0) 0x7f164c062630 con 0x7f16380a2c90 2024-09-12T12:25:23.384 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:25:23.386 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-12T12:25:23.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.384+0000 7f1653399640 1 -- 172.21.15.33:0/645645504 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f16380a2c90 msgr2=0x7f16380a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:23.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.384+0000 7f1653399640 1 --2- 172.21.15.33:0/645645504 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f16380a2c90 0x7f16380a5150 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1648031440 tx=0x7f1648005b50 comp rx=0 tx=0).stop 2024-09-12T12:25:23.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.384+0000 7f1653399640 1 -- 172.21.15.33:0/645645504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f164c102790 msgr2=0x7f164c1988c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:23.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.384+0000 7f1653399640 1 --2- 172.21.15.33:0/645645504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f164c102790 0x7f164c1988c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f163c00d950 tx=0x7f163c00de10 comp rx=0 tx=0).stop 2024-09-12T12:25:23.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.384+0000 7f1653399640 1 -- 172.21.15.33:0/645645504 shutdown_connections 2024-09-12T12:25:23.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.384+0000 7f1653399640 1 --2- 172.21.15.33:0/645645504 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f16380a2c90 0x7f16380a5150 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:23.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.384+0000 7f1653399640 1 --2- 172.21.15.33:0/645645504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f164c106f10 0x7f164c19cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:23.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.384+0000 7f1653399640 1 --2- 172.21.15.33:0/645645504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f164c102790 0x7f164c1988c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:23.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.384+0000 7f1653399640 1 --2- 172.21.15.33:0/645645504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f164c101de0 0x7f164c198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:23.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.384+0000 7f1653399640 1 -- 172.21.15.33:0/645645504 >> 172.21.15.33:0/645645504 conn(0x7f164c0fd8c0 msgr2=0x7f164c0fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:23.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.384+0000 7f1653399640 1 -- 172.21.15.33:0/645645504 shutdown_connections 2024-09-12T12:25:23.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:23.384+0000 7f1653399640 1 -- 172.21.15.33:0/645645504 wait complete. 2024-09-12T12:25:23.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:23 smithi043 ceph-mon[34144]: pgmap v329: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T12:25:23.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:23 smithi102 ceph-mon[34799]: pgmap v329: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T12:25:24.206 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":329,"stamp":"2024-09-12T12:25:21.899183+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658745,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":452,"num_read_kb":347,"num_write":353,"num_write_kb":3058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":1181980,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":284,"ondisk_log_size":284,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":381844,"kb_used_data":11732,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124559980,"statfs":{"total":1151940427776,"available":1151549419520,"internally_reserved":0,"allocated":12013568,"data_stored":7865837,"data_compressed":392130,"data_compressed_allocated":528384,"data_compressed_original":2555904,"omap_allocated":19141,"internal_metadata":378713403},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":35,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003566"},"pg_stats":[{"pgid":"2.1f","version":"85'9","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.125088+0000","last_change":"2024-09-12T12:23:43.779951+0000","last_active":"2024-09-12T12:24:59.125088+0000","last_peered":"2024-09-12T12:24:59.125088+0000","last_clean":"2024-09-12T12:24:59.125088+0000","last_became_active":"2024-09-12T12:23:43.779641+0000","last_became_peered":"2024-09-12T12:23:43.779641+0000","last_unstale":"2024-09-12T12:24:59.125088+0000","last_undegraded":"2024-09-12T12:24:59.125088+0000","last_fullsized":"2024-09-12T12:24:59.125088+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:49.594196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.123933+0000","last_change":"2024-09-12T12:23:45.873591+0000","last_active":"2024-09-12T12:24:59.123933+0000","last_peered":"2024-09-12T12:24:59.123933+0000","last_clean":"2024-09-12T12:24:59.123933+0000","last_became_active":"2024-09-12T12:23:45.873295+0000","last_became_peered":"2024-09-12T12:23:45.873295+0000","last_unstale":"2024-09-12T12:24:59.123933+0000","last_undegraded":"2024-09-12T12:24:59.123933+0000","last_fullsized":"2024-09-12T12:24:59.123933+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:49.907824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.128750+0000","last_change":"2024-09-12T12:24:59.128750+0000","last_active":"2024-09-12T12:24:59.128750+0000","last_peered":"2024-09-12T12:24:59.128750+0000","last_clean":"2024-09-12T12:24:59.128750+0000","last_became_active":"2024-09-12T12:24:59.128296+0000","last_became_peered":"2024-09-12T12:24:59.128296+0000","last_unstale":"2024-09-12T12:24:59.128750+0000","last_undegraded":"2024-09-12T12:24:59.128750+0000","last_fullsized":"2024-09-12T12:24:59.128750+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:12:57.582164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.124176+0000","last_change":"2024-09-12T12:23:43.835297+0000","last_active":"2024-09-12T12:24:59.124176+0000","last_peered":"2024-09-12T12:24:59.124176+0000","last_clean":"2024-09-12T12:24:59.124176+0000","last_became_active":"2024-09-12T12:23:43.834971+0000","last_became_peered":"2024-09-12T12:23:43.834971+0000","last_unstale":"2024-09-12T12:24:59.124176+0000","last_undegraded":"2024-09-12T12:24:59.124176+0000","last_fullsized":"2024-09-12T12:24:59.124176+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:00:07.128092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120346+0000","last_change":"2024-09-12T12:23:45.876388+0000","last_active":"2024-09-12T12:24:59.120346+0000","last_peered":"2024-09-12T12:24:59.120346+0000","last_clean":"2024-09-12T12:24:59.120346+0000","last_became_active":"2024-09-12T12:23:45.876090+0000","last_became_peered":"2024-09-12T12:23:45.876090+0000","last_unstale":"2024-09-12T12:24:59.120346+0000","last_undegraded":"2024-09-12T12:24:59.120346+0000","last_fullsized":"2024-09-12T12:24:59.120346+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:02.576991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.123753+0000","last_change":"2024-09-12T12:23:52.904665+0000","last_active":"2024-09-12T12:24:59.123753+0000","last_peered":"2024-09-12T12:24:59.123753+0000","last_clean":"2024-09-12T12:24:59.123753+0000","last_became_active":"2024-09-12T12:23:52.903758+0000","last_became_peered":"2024-09-12T12:23:52.903758+0000","last_unstale":"2024-09-12T12:24:59.123753+0000","last_undegraded":"2024-09-12T12:24:59.123753+0000","last_fullsized":"2024-09-12T12:24:59.123753+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:48.510180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"85'4","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.134194+0000","last_change":"2024-09-12T12:24:59.134194+0000","last_active":"2024-09-12T12:24:59.134194+0000","last_peered":"2024-09-12T12:24:59.134194+0000","last_clean":"2024-09-12T12:24:59.134194+0000","last_became_active":"2024-09-12T12:24:59.124651+0000","last_became_peered":"2024-09-12T12:24:59.124651+0000","last_unstale":"2024-09-12T12:24:59.134194+0000","last_undegraded":"2024-09-12T12:24:59.134194+0000","last_fullsized":"2024-09-12T12:24:59.134194+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:59:26.516659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.122950+0000","last_change":"2024-09-12T12:23:45.863775+0000","last_active":"2024-09-12T12:24:59.122950+0000","last_peered":"2024-09-12T12:24:59.122950+0000","last_clean":"2024-09-12T12:24:59.122950+0000","last_became_active":"2024-09-12T12:23:45.863437+0000","last_became_peered":"2024-09-12T12:23:45.863437+0000","last_unstale":"2024-09-12T12:24:59.122950+0000","last_undegraded":"2024-09-12T12:24:59.122950+0000","last_fullsized":"2024-09-12T12:24:59.122950+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:33.539904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.124072+0000","last_change":"2024-09-12T12:23:52.902674+0000","last_active":"2024-09-12T12:24:59.124072+0000","last_peered":"2024-09-12T12:24:59.124072+0000","last_clean":"2024-09-12T12:24:59.124072+0000","last_became_active":"2024-09-12T12:23:52.902130+0000","last_became_peered":"2024-09-12T12:23:52.902130+0000","last_unstale":"2024-09-12T12:24:59.124072+0000","last_undegraded":"2024-09-12T12:24:59.124072+0000","last_fullsized":"2024-09-12T12:24:59.124072+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:24.867630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.144624+0000","last_change":"2024-09-12T12:24:59.144624+0000","last_active":"2024-09-12T12:24:59.144624+0000","last_peered":"2024-09-12T12:24:59.144624+0000","last_clean":"2024-09-12T12:24:59.144624+0000","last_became_active":"2024-09-12T12:24:59.129929+0000","last_became_peered":"2024-09-12T12:24:59.129929+0000","last_unstale":"2024-09-12T12:24:59.144624+0000","last_undegraded":"2024-09-12T12:24:59.144624+0000","last_fullsized":"2024-09-12T12:24:59.144624+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:05.959920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.126480+0000","last_change":"2024-09-12T12:23:45.878131+0000","last_active":"2024-09-12T12:24:59.126480+0000","last_peered":"2024-09-12T12:24:59.126480+0000","last_clean":"2024-09-12T12:24:59.126480+0000","last_became_active":"2024-09-12T12:23:45.877838+0000","last_became_peered":"2024-09-12T12:23:45.877838+0000","last_unstale":"2024-09-12T12:24:59.126480+0000","last_undegraded":"2024-09-12T12:24:59.126480+0000","last_fullsized":"2024-09-12T12:24:59.126480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:31.029515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.123971+0000","last_change":"2024-09-12T12:23:52.900871+0000","last_active":"2024-09-12T12:24:59.123971+0000","last_peered":"2024-09-12T12:24:59.123971+0000","last_clean":"2024-09-12T12:24:59.123971+0000","last_became_active":"2024-09-12T12:23:52.900339+0000","last_became_peered":"2024-09-12T12:23:52.900339+0000","last_unstale":"2024-09-12T12:24:59.123971+0000","last_undegraded":"2024-09-12T12:24:59.123971+0000","last_fullsized":"2024-09-12T12:24:59.123971+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:24.778852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120345+0000","last_change":"2024-09-12T12:23:45.879124+0000","last_active":"2024-09-12T12:24:59.120345+0000","last_peered":"2024-09-12T12:24:59.120345+0000","last_clean":"2024-09-12T12:24:59.120345+0000","last_became_active":"2024-09-12T12:23:45.878770+0000","last_became_peered":"2024-09-12T12:23:45.878770+0000","last_unstale":"2024-09-12T12:24:59.120345+0000","last_undegraded":"2024-09-12T12:24:59.120345+0000","last_fullsized":"2024-09-12T12:24:59.120345+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:58.767155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.122519+0000","last_change":"2024-09-12T12:23:43.782666+0000","last_active":"2024-09-12T12:24:59.122519+0000","last_peered":"2024-09-12T12:24:59.122519+0000","last_clean":"2024-09-12T12:24:59.122519+0000","last_became_active":"2024-09-12T12:23:43.782235+0000","last_became_peered":"2024-09-12T12:23:43.782235+0000","last_unstale":"2024-09-12T12:24:59.122519+0000","last_undegraded":"2024-09-12T12:24:59.122519+0000","last_fullsized":"2024-09-12T12:24:59.122519+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:28.499038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.124159+0000","last_change":"2024-09-12T12:23:52.933933+0000","last_active":"2024-09-12T12:24:59.124159+0000","last_peered":"2024-09-12T12:24:59.124159+0000","last_clean":"2024-09-12T12:24:59.124159+0000","last_became_active":"2024-09-12T12:23:52.933500+0000","last_became_peered":"2024-09-12T12:23:52.933500+0000","last_unstale":"2024-09-12T12:24:59.124159+0000","last_undegraded":"2024-09-12T12:24:59.124159+0000","last_fullsized":"2024-09-12T12:24:59.124159+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:28.598435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.123379+0000","last_change":"2024-09-12T12:23:45.868518+0000","last_active":"2024-09-12T12:24:59.123379+0000","last_peered":"2024-09-12T12:24:59.123379+0000","last_clean":"2024-09-12T12:24:59.123379+0000","last_became_active":"2024-09-12T12:23:45.868198+0000","last_became_peered":"2024-09-12T12:23:45.868198+0000","last_unstale":"2024-09-12T12:24:59.123379+0000","last_undegraded":"2024-09-12T12:24:59.123379+0000","last_fullsized":"2024-09-12T12:24:59.123379+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:53.815362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"85'1","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.121954+0000","last_change":"2024-09-12T12:23:43.785481+0000","last_active":"2024-09-12T12:24:59.121954+0000","last_peered":"2024-09-12T12:24:59.121954+0000","last_clean":"2024-09-12T12:24:59.121954+0000","last_became_active":"2024-09-12T12:23:43.783842+0000","last_became_peered":"2024-09-12T12:23:43.783842+0000","last_unstale":"2024-09-12T12:24:59.121954+0000","last_undegraded":"2024-09-12T12:24:59.121954+0000","last_fullsized":"2024-09-12T12:24:59.121954+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:45:30.080456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"85'1","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.124175+0000","last_change":"2024-09-12T12:23:52.898648+0000","last_active":"2024-09-12T12:24:59.124175+0000","last_peered":"2024-09-12T12:24:59.124175+0000","last_clean":"2024-09-12T12:24:59.124175+0000","last_became_active":"2024-09-12T12:23:52.898242+0000","last_became_peered":"2024-09-12T12:23:52.898242+0000","last_unstale":"2024-09-12T12:24:59.124175+0000","last_undegraded":"2024-09-12T12:24:59.124175+0000","last_fullsized":"2024-09-12T12:24:59.124175+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:49:30.598747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.119982+0000","last_change":"2024-09-12T12:23:45.873067+0000","last_active":"2024-09-12T12:24:59.119982+0000","last_peered":"2024-09-12T12:24:59.119982+0000","last_clean":"2024-09-12T12:24:59.119982+0000","last_became_active":"2024-09-12T12:23:45.872616+0000","last_became_peered":"2024-09-12T12:23:45.872616+0000","last_unstale":"2024-09-12T12:24:59.119982+0000","last_undegraded":"2024-09-12T12:24:59.119982+0000","last_fullsized":"2024-09-12T12:24:59.119982+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:10.960252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"85'3","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.123212+0000","last_change":"2024-09-12T12:23:43.780706+0000","last_active":"2024-09-12T12:24:59.123212+0000","last_peered":"2024-09-12T12:24:59.123212+0000","last_clean":"2024-09-12T12:24:59.123212+0000","last_became_active":"2024-09-12T12:23:43.780387+0000","last_became_peered":"2024-09-12T12:23:43.780387+0000","last_unstale":"2024-09-12T12:24:59.123212+0000","last_undegraded":"2024-09-12T12:24:59.123212+0000","last_fullsized":"2024-09-12T12:24:59.123212+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:54.748461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.124812+0000","last_change":"2024-09-12T12:23:52.902225+0000","last_active":"2024-09-12T12:24:59.124812+0000","last_peered":"2024-09-12T12:24:59.124812+0000","last_clean":"2024-09-12T12:24:59.124812+0000","last_became_active":"2024-09-12T12:23:52.901865+0000","last_became_peered":"2024-09-12T12:23:52.901865+0000","last_unstale":"2024-09-12T12:24:59.124812+0000","last_undegraded":"2024-09-12T12:24:59.124812+0000","last_fullsized":"2024-09-12T12:24:59.124812+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:38.020994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.122256+0000","last_change":"2024-09-12T12:23:45.875816+0000","last_active":"2024-09-12T12:24:59.122256+0000","last_peered":"2024-09-12T12:24:59.122256+0000","last_clean":"2024-09-12T12:24:59.122256+0000","last_became_active":"2024-09-12T12:23:45.875419+0000","last_became_peered":"2024-09-12T12:23:45.875419+0000","last_unstale":"2024-09-12T12:24:59.122256+0000","last_undegraded":"2024-09-12T12:24:59.122256+0000","last_fullsized":"2024-09-12T12:24:59.122256+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:14:04.616759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.122766+0000","last_change":"2024-09-12T12:23:43.836699+0000","last_active":"2024-09-12T12:24:59.122766+0000","last_peered":"2024-09-12T12:24:59.122766+0000","last_clean":"2024-09-12T12:24:59.122766+0000","last_became_active":"2024-09-12T12:23:43.836341+0000","last_became_peered":"2024-09-12T12:23:43.836341+0000","last_unstale":"2024-09-12T12:24:59.122766+0000","last_undegraded":"2024-09-12T12:24:59.122766+0000","last_fullsized":"2024-09-12T12:24:59.122766+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:40:02.767132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.124205+0000","last_change":"2024-09-12T12:23:52.933594+0000","last_active":"2024-09-12T12:24:59.124205+0000","last_peered":"2024-09-12T12:24:59.124205+0000","last_clean":"2024-09-12T12:24:59.124205+0000","last_became_active":"2024-09-12T12:23:52.933197+0000","last_became_peered":"2024-09-12T12:23:52.933197+0000","last_unstale":"2024-09-12T12:24:59.124205+0000","last_undegraded":"2024-09-12T12:24:59.124205+0000","last_fullsized":"2024-09-12T12:24:59.124205+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:34.990674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120067+0000","last_change":"2024-09-12T12:23:45.881962+0000","last_active":"2024-09-12T12:24:59.120067+0000","last_peered":"2024-09-12T12:24:59.120067+0000","last_clean":"2024-09-12T12:24:59.120067+0000","last_became_active":"2024-09-12T12:23:45.881697+0000","last_became_peered":"2024-09-12T12:23:45.881697+0000","last_unstale":"2024-09-12T12:24:59.120067+0000","last_undegraded":"2024-09-12T12:24:59.120067+0000","last_fullsized":"2024-09-12T12:24:59.120067+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:35:49.369852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.124775+0000","last_change":"2024-09-12T12:23:44.235206+0000","last_active":"2024-09-12T12:24:59.124775+0000","last_peered":"2024-09-12T12:24:59.124775+0000","last_clean":"2024-09-12T12:24:59.124775+0000","last_became_active":"2024-09-12T12:23:44.234797+0000","last_became_peered":"2024-09-12T12:23:44.234797+0000","last_unstale":"2024-09-12T12:24:59.124775+0000","last_undegraded":"2024-09-12T12:24:59.124775+0000","last_fullsized":"2024-09-12T12:24:59.124775+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:51.130077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.121852+0000","last_change":"2024-09-12T12:23:52.902763+0000","last_active":"2024-09-12T12:24:59.121852+0000","last_peered":"2024-09-12T12:24:59.121852+0000","last_clean":"2024-09-12T12:24:59.121852+0000","last_became_active":"2024-09-12T12:23:52.902362+0000","last_became_peered":"2024-09-12T12:23:52.902362+0000","last_unstale":"2024-09-12T12:24:59.121852+0000","last_undegraded":"2024-09-12T12:24:59.121852+0000","last_fullsized":"2024-09-12T12:24:59.121852+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:39.481290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.124227+0000","last_change":"2024-09-12T12:23:45.875014+0000","last_active":"2024-09-12T12:24:59.124227+0000","last_peered":"2024-09-12T12:24:59.124227+0000","last_clean":"2024-09-12T12:24:59.124227+0000","last_became_active":"2024-09-12T12:23:45.874673+0000","last_became_peered":"2024-09-12T12:23:45.874673+0000","last_unstale":"2024-09-12T12:24:59.124227+0000","last_undegraded":"2024-09-12T12:24:59.124227+0000","last_fullsized":"2024-09-12T12:24:59.124227+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:21.035185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"85'12","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.124965+0000","last_change":"2024-09-12T12:23:43.778558+0000","last_active":"2024-09-12T12:24:59.124965+0000","last_peered":"2024-09-12T12:24:59.124965+0000","last_clean":"2024-09-12T12:24:59.124965+0000","last_became_active":"2024-09-12T12:23:43.778194+0000","last_became_peered":"2024-09-12T12:23:43.778194+0000","last_unstale":"2024-09-12T12:24:59.124965+0000","last_undegraded":"2024-09-12T12:24:59.124965+0000","last_fullsized":"2024-09-12T12:24:59.124965+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:11.625462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.122733+0000","last_change":"2024-09-12T12:23:52.933833+0000","last_active":"2024-09-12T12:24:59.122733+0000","last_peered":"2024-09-12T12:24:59.122733+0000","last_clean":"2024-09-12T12:24:59.122733+0000","last_became_active":"2024-09-12T12:23:52.933330+0000","last_became_peered":"2024-09-12T12:23:52.933330+0000","last_unstale":"2024-09-12T12:24:59.122733+0000","last_undegraded":"2024-09-12T12:24:59.122733+0000","last_fullsized":"2024-09-12T12:24:59.122733+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:31.129088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.122181+0000","last_change":"2024-09-12T12:23:45.872527+0000","last_active":"2024-09-12T12:24:59.122181+0000","last_peered":"2024-09-12T12:24:59.122181+0000","last_clean":"2024-09-12T12:24:59.122181+0000","last_became_active":"2024-09-12T12:23:45.872220+0000","last_became_peered":"2024-09-12T12:23:45.872220+0000","last_unstale":"2024-09-12T12:24:59.122181+0000","last_undegraded":"2024-09-12T12:24:59.122181+0000","last_fullsized":"2024-09-12T12:24:59.122181+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:38:08.734145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"85'1","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.123645+0000","last_change":"2024-09-12T12:23:43.835824+0000","last_active":"2024-09-12T12:24:59.123645+0000","last_peered":"2024-09-12T12:24:59.123645+0000","last_clean":"2024-09-12T12:24:59.123645+0000","last_became_active":"2024-09-12T12:23:43.835375+0000","last_became_peered":"2024-09-12T12:23:43.835375+0000","last_unstale":"2024-09-12T12:24:59.123645+0000","last_undegraded":"2024-09-12T12:24:59.123645+0000","last_fullsized":"2024-09-12T12:24:59.123645+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:58:57.547060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120258+0000","last_change":"2024-09-12T12:23:52.901739+0000","last_active":"2024-09-12T12:24:59.120258+0000","last_peered":"2024-09-12T12:24:59.120258+0000","last_clean":"2024-09-12T12:24:59.120258+0000","last_became_active":"2024-09-12T12:23:52.901370+0000","last_became_peered":"2024-09-12T12:23:52.901370+0000","last_unstale":"2024-09-12T12:24:59.120258+0000","last_undegraded":"2024-09-12T12:24:59.120258+0000","last_fullsized":"2024-09-12T12:24:59.120258+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:56:44.430446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.174273+0000","last_change":"2024-09-12T12:23:45.870491+0000","last_active":"2024-09-12T12:24:59.174273+0000","last_peered":"2024-09-12T12:24:59.174273+0000","last_clean":"2024-09-12T12:24:59.174273+0000","last_became_active":"2024-09-12T12:23:45.870182+0000","last_became_peered":"2024-09-12T12:23:45.870182+0000","last_unstale":"2024-09-12T12:24:59.174273+0000","last_undegraded":"2024-09-12T12:24:59.174273+0000","last_fullsized":"2024-09-12T12:24:59.174273+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:07.094287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.124538+0000","last_change":"2024-09-12T12:23:43.837430+0000","last_active":"2024-09-12T12:24:59.124538+0000","last_peered":"2024-09-12T12:24:59.124538+0000","last_clean":"2024-09-12T12:24:59.124538+0000","last_became_active":"2024-09-12T12:23:43.837091+0000","last_became_peered":"2024-09-12T12:23:43.837091+0000","last_unstale":"2024-09-12T12:24:59.124538+0000","last_undegraded":"2024-09-12T12:24:59.124538+0000","last_fullsized":"2024-09-12T12:24:59.124538+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:30.841341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.175376+0000","last_change":"2024-09-12T12:24:59.175376+0000","last_active":"2024-09-12T12:24:59.175376+0000","last_peered":"2024-09-12T12:24:59.175376+0000","last_clean":"2024-09-12T12:24:59.175376+0000","last_became_active":"2024-09-12T12:24:59.174967+0000","last_became_peered":"2024-09-12T12:24:59.174967+0000","last_unstale":"2024-09-12T12:24:59.175376+0000","last_undegraded":"2024-09-12T12:24:59.175376+0000","last_fullsized":"2024-09-12T12:24:59.175376+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:40.039227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.174065+0000","last_change":"2024-09-12T12:23:45.876159+0000","last_active":"2024-09-12T12:24:59.174065+0000","last_peered":"2024-09-12T12:24:59.174065+0000","last_clean":"2024-09-12T12:24:59.174065+0000","last_became_active":"2024-09-12T12:23:45.875771+0000","last_became_peered":"2024-09-12T12:23:45.875771+0000","last_unstale":"2024-09-12T12:24:59.174065+0000","last_undegraded":"2024-09-12T12:24:59.174065+0000","last_fullsized":"2024-09-12T12:24:59.174065+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:55.699099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'1","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120605+0000","last_change":"2024-09-12T12:23:43.787082+0000","last_active":"2024-09-12T12:24:59.120605+0000","last_peered":"2024-09-12T12:24:59.120605+0000","last_clean":"2024-09-12T12:24:59.120605+0000","last_became_active":"2024-09-12T12:23:43.786619+0000","last_became_peered":"2024-09-12T12:23:43.786619+0000","last_unstale":"2024-09-12T12:24:59.120605+0000","last_undegraded":"2024-09-12T12:24:59.120605+0000","last_fullsized":"2024-09-12T12:24:59.120605+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:21.120020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.121984+0000","last_change":"2024-09-12T12:23:52.899659+0000","last_active":"2024-09-12T12:24:59.121984+0000","last_peered":"2024-09-12T12:24:59.121984+0000","last_clean":"2024-09-12T12:24:59.121984+0000","last_became_active":"2024-09-12T12:23:52.899226+0000","last_became_peered":"2024-09-12T12:23:52.899226+0000","last_unstale":"2024-09-12T12:24:59.121984+0000","last_undegraded":"2024-09-12T12:24:59.121984+0000","last_fullsized":"2024-09-12T12:24:59.121984+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:41.979174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.125261+0000","last_change":"2024-09-12T12:23:45.879112+0000","last_active":"2024-09-12T12:24:59.125261+0000","last_peered":"2024-09-12T12:24:59.125261+0000","last_clean":"2024-09-12T12:24:59.125261+0000","last_became_active":"2024-09-12T12:23:45.878684+0000","last_became_peered":"2024-09-12T12:23:45.878684+0000","last_unstale":"2024-09-12T12:24:59.125261+0000","last_undegraded":"2024-09-12T12:24:59.125261+0000","last_fullsized":"2024-09-12T12:24:59.125261+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:11:18.102437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'4","reported_seq":91,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:25:19.871010+0000","last_change":"2024-09-12T12:23:43.835282+0000","last_active":"2024-09-12T12:25:19.871010+0000","last_peered":"2024-09-12T12:25:19.871010+0000","last_clean":"2024-09-12T12:25:19.871010+0000","last_became_active":"2024-09-12T12:23:43.834929+0000","last_became_peered":"2024-09-12T12:23:43.834929+0000","last_unstale":"2024-09-12T12:25:19.871010+0000","last_undegraded":"2024-09-12T12:25:19.871010+0000","last_fullsized":"2024-09-12T12:25:19.871010+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:59:11.516387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.122309+0000","last_change":"2024-09-12T12:23:52.934077+0000","last_active":"2024-09-12T12:24:59.122309+0000","last_peered":"2024-09-12T12:24:59.122309+0000","last_clean":"2024-09-12T12:24:59.122309+0000","last_became_active":"2024-09-12T12:23:52.933583+0000","last_became_peered":"2024-09-12T12:23:52.933583+0000","last_unstale":"2024-09-12T12:24:59.122309+0000","last_undegraded":"2024-09-12T12:24:59.122309+0000","last_fullsized":"2024-09-12T12:24:59.122309+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:06.570624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.121172+0000","last_change":"2024-09-12T12:23:45.875735+0000","last_active":"2024-09-12T12:24:59.121172+0000","last_peered":"2024-09-12T12:24:59.121172+0000","last_clean":"2024-09-12T12:24:59.121172+0000","last_became_active":"2024-09-12T12:23:45.875072+0000","last_became_peered":"2024-09-12T12:23:45.875072+0000","last_unstale":"2024-09-12T12:24:59.121172+0000","last_undegraded":"2024-09-12T12:24:59.121172+0000","last_fullsized":"2024-09-12T12:24:59.121172+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:10.508123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'3","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120202+0000","last_change":"2024-09-12T12:23:43.785226+0000","last_active":"2024-09-12T12:24:59.120202+0000","last_peered":"2024-09-12T12:24:59.120202+0000","last_clean":"2024-09-12T12:24:59.120202+0000","last_became_active":"2024-09-12T12:23:43.783705+0000","last_became_peered":"2024-09-12T12:23:43.783705+0000","last_unstale":"2024-09-12T12:24:59.120202+0000","last_undegraded":"2024-09-12T12:24:59.120202+0000","last_fullsized":"2024-09-12T12:24:59.120202+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:21.269569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.126947+0000","last_change":"2024-09-12T12:23:52.934383+0000","last_active":"2024-09-12T12:24:59.126947+0000","last_peered":"2024-09-12T12:24:59.126947+0000","last_clean":"2024-09-12T12:24:59.126947+0000","last_became_active":"2024-09-12T12:23:52.933744+0000","last_became_peered":"2024-09-12T12:23:52.933744+0000","last_unstale":"2024-09-12T12:24:59.126947+0000","last_undegraded":"2024-09-12T12:24:59.126947+0000","last_fullsized":"2024-09-12T12:24:59.126947+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:44.656785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.123244+0000","last_change":"2024-09-12T12:23:45.873460+0000","last_active":"2024-09-12T12:24:59.123244+0000","last_peered":"2024-09-12T12:24:59.123244+0000","last_clean":"2024-09-12T12:24:59.123244+0000","last_became_active":"2024-09-12T12:23:45.873188+0000","last_became_peered":"2024-09-12T12:23:45.873188+0000","last_unstale":"2024-09-12T12:24:59.123244+0000","last_undegraded":"2024-09-12T12:24:59.123244+0000","last_fullsized":"2024-09-12T12:24:59.123244+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:18:29.503856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'3","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.124853+0000","last_change":"2024-09-12T12:23:43.781082+0000","last_active":"2024-09-12T12:24:59.124853+0000","last_peered":"2024-09-12T12:24:59.124853+0000","last_clean":"2024-09-12T12:24:59.124853+0000","last_became_active":"2024-09-12T12:23:43.780710+0000","last_became_peered":"2024-09-12T12:23:43.780710+0000","last_unstale":"2024-09-12T12:24:59.124853+0000","last_undegraded":"2024-09-12T12:24:59.124853+0000","last_fullsized":"2024-09-12T12:24:59.124853+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:13:23.748716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":348,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120440+0000","last_change":"2024-09-12T12:22:37.536326+0000","last_active":"2024-09-12T12:24:59.120440+0000","last_peered":"2024-09-12T12:24:59.120440+0000","last_clean":"2024-09-12T12:24:59.120440+0000","last_became_active":"2024-09-12T12:22:37.535831+0000","last_became_peered":"2024-09-12T12:22:37.535831+0000","last_unstale":"2024-09-12T12:24:59.120440+0000","last_undegraded":"2024-09-12T12:24:59.120440+0000","last_fullsized":"2024-09-12T12:24:59.120440+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:19:12.296434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:19:12.296434+0000","last_clean_scrub_stamp":"2024-09-12T12:19:12.296434+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:04:49.251883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"85'1","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.179285+0000","last_change":"2024-09-12T12:24:59.179285+0000","last_active":"2024-09-12T12:24:59.179285+0000","last_peered":"2024-09-12T12:24:59.179285+0000","last_clean":"2024-09-12T12:24:59.179285+0000","last_became_active":"2024-09-12T12:24:59.175202+0000","last_became_peered":"2024-09-12T12:24:59.175202+0000","last_unstale":"2024-09-12T12:24:59.179285+0000","last_undegraded":"2024-09-12T12:24:59.179285+0000","last_fullsized":"2024-09-12T12:24:59.179285+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:44.993426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,10,11,9],"acting":[7,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120857+0000","last_change":"2024-09-12T12:23:45.883059+0000","last_active":"2024-09-12T12:24:59.120857+0000","last_peered":"2024-09-12T12:24:59.120857+0000","last_clean":"2024-09-12T12:24:59.120857+0000","last_became_active":"2024-09-12T12:23:45.882206+0000","last_became_peered":"2024-09-12T12:23:45.882206+0000","last_unstale":"2024-09-12T12:24:59.120857+0000","last_undegraded":"2024-09-12T12:24:59.120857+0000","last_fullsized":"2024-09-12T12:24:59.120857+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:43.068533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'3","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.122881+0000","last_change":"2024-09-12T12:23:44.235088+0000","last_active":"2024-09-12T12:24:59.122881+0000","last_peered":"2024-09-12T12:24:59.122881+0000","last_clean":"2024-09-12T12:24:59.122881+0000","last_became_active":"2024-09-12T12:23:44.234551+0000","last_became_peered":"2024-09-12T12:23:44.234551+0000","last_unstale":"2024-09-12T12:24:59.122881+0000","last_undegraded":"2024-09-12T12:24:59.122881+0000","last_fullsized":"2024-09-12T12:24:59.122881+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:47.474387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.122638+0000","last_change":"2024-09-12T12:23:52.897807+0000","last_active":"2024-09-12T12:24:59.122638+0000","last_peered":"2024-09-12T12:24:59.122638+0000","last_clean":"2024-09-12T12:24:59.122638+0000","last_became_active":"2024-09-12T12:23:52.897405+0000","last_became_peered":"2024-09-12T12:23:52.897405+0000","last_unstale":"2024-09-12T12:24:59.122638+0000","last_undegraded":"2024-09-12T12:24:59.122638+0000","last_fullsized":"2024-09-12T12:24:59.122638+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:34.714177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120478+0000","last_change":"2024-09-12T12:23:45.873907+0000","last_active":"2024-09-12T12:24:59.120478+0000","last_peered":"2024-09-12T12:24:59.120478+0000","last_clean":"2024-09-12T12:24:59.120478+0000","last_became_active":"2024-09-12T12:23:45.873464+0000","last_became_peered":"2024-09-12T12:23:45.873464+0000","last_unstale":"2024-09-12T12:24:59.120478+0000","last_undegraded":"2024-09-12T12:24:59.120478+0000","last_fullsized":"2024-09-12T12:24:59.120478+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:38:18.151880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.126785+0000","last_change":"2024-09-12T12:23:43.782649+0000","last_active":"2024-09-12T12:24:59.126785+0000","last_peered":"2024-09-12T12:24:59.126785+0000","last_clean":"2024-09-12T12:24:59.126785+0000","last_became_active":"2024-09-12T12:23:43.782290+0000","last_became_peered":"2024-09-12T12:23:43.782290+0000","last_unstale":"2024-09-12T12:24:59.126785+0000","last_undegraded":"2024-09-12T12:24:59.126785+0000","last_fullsized":"2024-09-12T12:24:59.126785+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:30:56.964121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.119522+0000","last_change":"2024-09-12T12:23:52.905108+0000","last_active":"2024-09-12T12:24:59.119522+0000","last_peered":"2024-09-12T12:24:59.119522+0000","last_clean":"2024-09-12T12:24:59.119522+0000","last_became_active":"2024-09-12T12:23:52.904664+0000","last_became_peered":"2024-09-12T12:23:52.904664+0000","last_unstale":"2024-09-12T12:24:59.119522+0000","last_undegraded":"2024-09-12T12:24:59.119522+0000","last_fullsized":"2024-09-12T12:24:59.119522+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:11.177971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120693+0000","last_change":"2024-09-12T12:23:45.875244+0000","last_active":"2024-09-12T12:24:59.120693+0000","last_peered":"2024-09-12T12:24:59.120693+0000","last_clean":"2024-09-12T12:24:59.120693+0000","last_became_active":"2024-09-12T12:23:45.874889+0000","last_became_peered":"2024-09-12T12:23:45.874889+0000","last_unstale":"2024-09-12T12:24:59.120693+0000","last_undegraded":"2024-09-12T12:24:59.120693+0000","last_fullsized":"2024-09-12T12:24:59.120693+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:30:38.192162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.122568+0000","last_change":"2024-09-12T12:23:43.783232+0000","last_active":"2024-09-12T12:24:59.122568+0000","last_peered":"2024-09-12T12:24:59.122568+0000","last_clean":"2024-09-12T12:24:59.122568+0000","last_became_active":"2024-09-12T12:23:43.782975+0000","last_became_peered":"2024-09-12T12:23:43.782975+0000","last_unstale":"2024-09-12T12:24:59.122568+0000","last_undegraded":"2024-09-12T12:24:59.122568+0000","last_fullsized":"2024-09-12T12:24:59.122568+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:45.096636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.124304+0000","last_change":"2024-09-12T12:23:52.898356+0000","last_active":"2024-09-12T12:24:59.124304+0000","last_peered":"2024-09-12T12:24:59.124304+0000","last_clean":"2024-09-12T12:24:59.124304+0000","last_became_active":"2024-09-12T12:23:52.897868+0000","last_became_peered":"2024-09-12T12:23:52.897868+0000","last_unstale":"2024-09-12T12:24:59.124304+0000","last_undegraded":"2024-09-12T12:24:59.124304+0000","last_fullsized":"2024-09-12T12:24:59.124304+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:16:36.473730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120580+0000","last_change":"2024-09-12T12:23:45.881532+0000","last_active":"2024-09-12T12:24:59.120580+0000","last_peered":"2024-09-12T12:24:59.120580+0000","last_clean":"2024-09-12T12:24:59.120580+0000","last_became_active":"2024-09-12T12:23:45.880895+0000","last_became_peered":"2024-09-12T12:23:45.880895+0000","last_unstale":"2024-09-12T12:24:59.120580+0000","last_undegraded":"2024-09-12T12:24:59.120580+0000","last_fullsized":"2024-09-12T12:24:59.120580+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:09:05.249773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.122902+0000","last_change":"2024-09-12T12:23:43.783436+0000","last_active":"2024-09-12T12:24:59.122902+0000","last_peered":"2024-09-12T12:24:59.122902+0000","last_clean":"2024-09-12T12:24:59.122902+0000","last_became_active":"2024-09-12T12:23:43.782975+0000","last_became_peered":"2024-09-12T12:23:43.782975+0000","last_unstale":"2024-09-12T12:24:59.122902+0000","last_undegraded":"2024-09-12T12:24:59.122902+0000","last_fullsized":"2024-09-12T12:24:59.122902+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:20.840189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.124467+0000","last_change":"2024-09-12T12:23:52.903210+0000","last_active":"2024-09-12T12:24:59.124467+0000","last_peered":"2024-09-12T12:24:59.124467+0000","last_clean":"2024-09-12T12:24:59.124467+0000","last_became_active":"2024-09-12T12:23:52.902832+0000","last_became_peered":"2024-09-12T12:23:52.902832+0000","last_unstale":"2024-09-12T12:24:59.124467+0000","last_undegraded":"2024-09-12T12:24:59.124467+0000","last_fullsized":"2024-09-12T12:24:59.124467+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:46:40.506581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.124894+0000","last_change":"2024-09-12T12:23:45.880314+0000","last_active":"2024-09-12T12:24:59.124894+0000","last_peered":"2024-09-12T12:24:59.124894+0000","last_clean":"2024-09-12T12:24:59.124894+0000","last_became_active":"2024-09-12T12:23:45.879878+0000","last_became_peered":"2024-09-12T12:23:45.879878+0000","last_unstale":"2024-09-12T12:24:59.124894+0000","last_undegraded":"2024-09-12T12:24:59.124894+0000","last_fullsized":"2024-09-12T12:24:59.124894+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:47.197008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"85'15","reported_seq":73,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.142463+0000","last_change":"2024-09-12T12:24:59.142463+0000","last_active":"2024-09-12T12:24:59.142463+0000","last_peered":"2024-09-12T12:24:59.142463+0000","last_clean":"2024-09-12T12:24:59.142463+0000","last_became_active":"2024-09-12T12:24:59.128657+0000","last_became_peered":"2024-09-12T12:24:59.128657+0000","last_unstale":"2024-09-12T12:24:59.142463+0000","last_undegraded":"2024-09-12T12:24:59.142463+0000","last_fullsized":"2024-09-12T12:24:59.142463+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:52.873457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,1],"acting":[8,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.122453+0000","last_change":"2024-09-12T12:23:52.901841+0000","last_active":"2024-09-12T12:24:59.122453+0000","last_peered":"2024-09-12T12:24:59.122453+0000","last_clean":"2024-09-12T12:24:59.122453+0000","last_became_active":"2024-09-12T12:23:52.901469+0000","last_became_peered":"2024-09-12T12:23:52.901469+0000","last_unstale":"2024-09-12T12:24:59.122453+0000","last_undegraded":"2024-09-12T12:24:59.122453+0000","last_fullsized":"2024-09-12T12:24:59.122453+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:40.472980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120099+0000","last_change":"2024-09-12T12:23:45.874026+0000","last_active":"2024-09-12T12:24:59.120099+0000","last_peered":"2024-09-12T12:24:59.120099+0000","last_clean":"2024-09-12T12:24:59.120099+0000","last_became_active":"2024-09-12T12:23:45.873494+0000","last_became_peered":"2024-09-12T12:23:45.873494+0000","last_unstale":"2024-09-12T12:24:59.120099+0000","last_undegraded":"2024-09-12T12:24:59.120099+0000","last_fullsized":"2024-09-12T12:24:59.120099+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:28.870938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'3","reported_seq":87,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:25:15.864096+0000","last_change":"2024-09-12T12:23:43.781866+0000","last_active":"2024-09-12T12:25:15.864096+0000","last_peered":"2024-09-12T12:25:15.864096+0000","last_clean":"2024-09-12T12:25:15.864096+0000","last_became_active":"2024-09-12T12:23:43.781488+0000","last_became_peered":"2024-09-12T12:23:43.781488+0000","last_unstale":"2024-09-12T12:25:15.864096+0000","last_undegraded":"2024-09-12T12:25:15.864096+0000","last_fullsized":"2024-09-12T12:25:15.864096+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:13:28.729199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.124892+0000","last_change":"2024-09-12T12:23:52.903427+0000","last_active":"2024-09-12T12:24:59.124892+0000","last_peered":"2024-09-12T12:24:59.124892+0000","last_clean":"2024-09-12T12:24:59.124892+0000","last_became_active":"2024-09-12T12:23:52.903077+0000","last_became_peered":"2024-09-12T12:23:52.903077+0000","last_unstale":"2024-09-12T12:24:59.124892+0000","last_undegraded":"2024-09-12T12:24:59.124892+0000","last_fullsized":"2024-09-12T12:24:59.124892+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:26:03.409086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120412+0000","last_change":"2024-09-12T12:23:45.873628+0000","last_active":"2024-09-12T12:24:59.120412+0000","last_peered":"2024-09-12T12:24:59.120412+0000","last_clean":"2024-09-12T12:24:59.120412+0000","last_became_active":"2024-09-12T12:23:45.873264+0000","last_became_peered":"2024-09-12T12:23:45.873264+0000","last_unstale":"2024-09-12T12:24:59.120412+0000","last_undegraded":"2024-09-12T12:24:59.120412+0000","last_fullsized":"2024-09-12T12:24:59.120412+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:17:03.257858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"85'3","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.125910+0000","last_change":"2024-09-12T12:23:43.787320+0000","last_active":"2024-09-12T12:24:59.125910+0000","last_peered":"2024-09-12T12:24:59.125910+0000","last_clean":"2024-09-12T12:24:59.125910+0000","last_became_active":"2024-09-12T12:23:43.786937+0000","last_became_peered":"2024-09-12T12:23:43.786937+0000","last_unstale":"2024-09-12T12:24:59.125910+0000","last_undegraded":"2024-09-12T12:24:59.125910+0000","last_fullsized":"2024-09-12T12:24:59.125910+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:19.539586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120807+0000","last_change":"2024-09-12T12:23:52.904582+0000","last_active":"2024-09-12T12:24:59.120807+0000","last_peered":"2024-09-12T12:24:59.120807+0000","last_clean":"2024-09-12T12:24:59.120807+0000","last_became_active":"2024-09-12T12:23:52.904172+0000","last_became_peered":"2024-09-12T12:23:52.904172+0000","last_unstale":"2024-09-12T12:24:59.120807+0000","last_undegraded":"2024-09-12T12:24:59.120807+0000","last_fullsized":"2024-09-12T12:24:59.120807+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:26:14.734098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.121376+0000","last_change":"2024-09-12T12:23:45.878128+0000","last_active":"2024-09-12T12:24:59.121376+0000","last_peered":"2024-09-12T12:24:59.121376+0000","last_clean":"2024-09-12T12:24:59.121376+0000","last_became_active":"2024-09-12T12:23:45.877154+0000","last_became_peered":"2024-09-12T12:23:45.877154+0000","last_unstale":"2024-09-12T12:24:59.121376+0000","last_undegraded":"2024-09-12T12:24:59.121376+0000","last_fullsized":"2024-09-12T12:24:59.121376+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:06.095805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"85'6","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.121997+0000","last_change":"2024-09-12T12:23:43.783586+0000","last_active":"2024-09-12T12:24:59.121997+0000","last_peered":"2024-09-12T12:24:59.121997+0000","last_clean":"2024-09-12T12:24:59.121997+0000","last_became_active":"2024-09-12T12:23:43.783255+0000","last_became_peered":"2024-09-12T12:23:43.783255+0000","last_unstale":"2024-09-12T12:24:59.121997+0000","last_undegraded":"2024-09-12T12:24:59.121997+0000","last_fullsized":"2024-09-12T12:24:59.121997+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:38.609805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.126349+0000","last_change":"2024-09-12T12:23:52.901120+0000","last_active":"2024-09-12T12:24:59.126349+0000","last_peered":"2024-09-12T12:24:59.126349+0000","last_clean":"2024-09-12T12:24:59.126349+0000","last_became_active":"2024-09-12T12:23:52.900700+0000","last_became_peered":"2024-09-12T12:23:52.900700+0000","last_unstale":"2024-09-12T12:24:59.126349+0000","last_undegraded":"2024-09-12T12:24:59.126349+0000","last_fullsized":"2024-09-12T12:24:59.126349+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:18.225867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.123317+0000","last_change":"2024-09-12T12:23:45.878074+0000","last_active":"2024-09-12T12:24:59.123317+0000","last_peered":"2024-09-12T12:24:59.123317+0000","last_clean":"2024-09-12T12:24:59.123317+0000","last_became_active":"2024-09-12T12:23:45.877753+0000","last_became_peered":"2024-09-12T12:23:45.877753+0000","last_unstale":"2024-09-12T12:24:59.123317+0000","last_undegraded":"2024-09-12T12:24:59.123317+0000","last_fullsized":"2024-09-12T12:24:59.123317+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:15.515609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"85'34","reported_seq":177,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:25:18.157380+0000","last_change":"2024-09-12T12:23:43.787476+0000","last_active":"2024-09-12T12:25:18.157380+0000","last_peered":"2024-09-12T12:25:18.157380+0000","last_clean":"2024-09-12T12:25:18.157380+0000","last_became_active":"2024-09-12T12:23:43.786808+0000","last_became_peered":"2024-09-12T12:23:43.786808+0000","last_unstale":"2024-09-12T12:25:18.157380+0000","last_undegraded":"2024-09-12T12:25:18.157380+0000","last_fullsized":"2024-09-12T12:25:18.157380+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:08:28.046702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64140,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":109,"num_read_kb":116,"num_write":35,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.125469+0000","last_change":"2024-09-12T12:23:52.900089+0000","last_active":"2024-09-12T12:24:59.125469+0000","last_peered":"2024-09-12T12:24:59.125469+0000","last_clean":"2024-09-12T12:24:59.125469+0000","last_became_active":"2024-09-12T12:23:52.899711+0000","last_became_peered":"2024-09-12T12:23:52.899711+0000","last_unstale":"2024-09-12T12:24:59.125469+0000","last_undegraded":"2024-09-12T12:24:59.125469+0000","last_fullsized":"2024-09-12T12:24:59.125469+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:58:38.850382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.123076+0000","last_change":"2024-09-12T12:23:45.876773+0000","last_active":"2024-09-12T12:24:59.123076+0000","last_peered":"2024-09-12T12:24:59.123076+0000","last_clean":"2024-09-12T12:24:59.123076+0000","last_became_active":"2024-09-12T12:23:45.876394+0000","last_became_peered":"2024-09-12T12:23:45.876394+0000","last_unstale":"2024-09-12T12:24:59.123076+0000","last_undegraded":"2024-09-12T12:24:59.123076+0000","last_fullsized":"2024-09-12T12:24:59.123076+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:55.468779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"85'4","reported_seq":39,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.126665+0000","last_change":"2024-09-12T12:23:43.835826+0000","last_active":"2024-09-12T12:24:59.126665+0000","last_peered":"2024-09-12T12:24:59.126665+0000","last_clean":"2024-09-12T12:24:59.126665+0000","last_became_active":"2024-09-12T12:23:43.835378+0000","last_became_peered":"2024-09-12T12:23:43.835378+0000","last_unstale":"2024-09-12T12:24:59.126665+0000","last_undegraded":"2024-09-12T12:24:59.126665+0000","last_fullsized":"2024-09-12T12:24:59.126665+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:23.429407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.129183+0000","last_change":"2024-09-12T12:24:59.129183+0000","last_active":"2024-09-12T12:24:59.129183+0000","last_peered":"2024-09-12T12:24:59.129183+0000","last_clean":"2024-09-12T12:24:59.129183+0000","last_became_active":"2024-09-12T12:24:59.128649+0000","last_became_peered":"2024-09-12T12:24:59.128649+0000","last_unstale":"2024-09-12T12:24:59.129183+0000","last_undegraded":"2024-09-12T12:24:59.129183+0000","last_fullsized":"2024-09-12T12:24:59.129183+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:58.630436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120344+0000","last_change":"2024-09-12T12:23:45.875222+0000","last_active":"2024-09-12T12:24:59.120344+0000","last_peered":"2024-09-12T12:24:59.120344+0000","last_clean":"2024-09-12T12:24:59.120344+0000","last_became_active":"2024-09-12T12:23:45.874859+0000","last_became_peered":"2024-09-12T12:23:45.874859+0000","last_unstale":"2024-09-12T12:24:59.120344+0000","last_undegraded":"2024-09-12T12:24:59.120344+0000","last_fullsized":"2024-09-12T12:24:59.120344+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:29:00.017470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"85'2","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120804+0000","last_change":"2024-09-12T12:23:43.788052+0000","last_active":"2024-09-12T12:24:59.120804+0000","last_peered":"2024-09-12T12:24:59.120804+0000","last_clean":"2024-09-12T12:24:59.120804+0000","last_became_active":"2024-09-12T12:23:43.787533+0000","last_became_peered":"2024-09-12T12:23:43.787533+0000","last_unstale":"2024-09-12T12:24:59.120804+0000","last_undegraded":"2024-09-12T12:24:59.120804+0000","last_fullsized":"2024-09-12T12:24:59.120804+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:32.042395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.123829+0000","last_change":"2024-09-12T12:23:52.900856+0000","last_active":"2024-09-12T12:24:59.123829+0000","last_peered":"2024-09-12T12:24:59.123829+0000","last_clean":"2024-09-12T12:24:59.123829+0000","last_became_active":"2024-09-12T12:23:52.900444+0000","last_became_peered":"2024-09-12T12:23:52.900444+0000","last_unstale":"2024-09-12T12:24:59.123829+0000","last_undegraded":"2024-09-12T12:24:59.123829+0000","last_fullsized":"2024-09-12T12:24:59.123829+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:52:22.443801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.123287+0000","last_change":"2024-09-12T12:23:45.869666+0000","last_active":"2024-09-12T12:24:59.123287+0000","last_peered":"2024-09-12T12:24:59.123287+0000","last_clean":"2024-09-12T12:24:59.123287+0000","last_became_active":"2024-09-12T12:23:45.869308+0000","last_became_peered":"2024-09-12T12:23:45.869308+0000","last_unstale":"2024-09-12T12:24:59.123287+0000","last_undegraded":"2024-09-12T12:24:59.123287+0000","last_fullsized":"2024-09-12T12:24:59.123287+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:37:47.895807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"85'3","reported_seq":87,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:25:17.156184+0000","last_change":"2024-09-12T12:23:43.786124+0000","last_active":"2024-09-12T12:25:17.156184+0000","last_peered":"2024-09-12T12:25:17.156184+0000","last_clean":"2024-09-12T12:25:17.156184+0000","last_became_active":"2024-09-12T12:23:43.785772+0000","last_became_peered":"2024-09-12T12:23:43.785772+0000","last_unstale":"2024-09-12T12:25:17.156184+0000","last_undegraded":"2024-09-12T12:25:17.156184+0000","last_fullsized":"2024-09-12T12:25:17.156184+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:23.458792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.122973+0000","last_change":"2024-09-12T12:23:52.905541+0000","last_active":"2024-09-12T12:24:59.122973+0000","last_peered":"2024-09-12T12:24:59.122973+0000","last_clean":"2024-09-12T12:24:59.122973+0000","last_became_active":"2024-09-12T12:23:52.905165+0000","last_became_peered":"2024-09-12T12:23:52.905165+0000","last_unstale":"2024-09-12T12:24:59.122973+0000","last_undegraded":"2024-09-12T12:24:59.122973+0000","last_fullsized":"2024-09-12T12:24:59.122973+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:40.831208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.119944+0000","last_change":"2024-09-12T12:23:52.901738+0000","last_active":"2024-09-12T12:24:59.119944+0000","last_peered":"2024-09-12T12:24:59.119944+0000","last_clean":"2024-09-12T12:24:59.119944+0000","last_became_active":"2024-09-12T12:23:52.901348+0000","last_became_peered":"2024-09-12T12:23:52.901348+0000","last_unstale":"2024-09-12T12:24:59.119944+0000","last_undegraded":"2024-09-12T12:24:59.119944+0000","last_fullsized":"2024-09-12T12:24:59.119944+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:16:24.075130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.124431+0000","last_change":"2024-09-12T12:23:45.869431+0000","last_active":"2024-09-12T12:24:59.124431+0000","last_peered":"2024-09-12T12:24:59.124431+0000","last_clean":"2024-09-12T12:24:59.124431+0000","last_became_active":"2024-09-12T12:23:45.869078+0000","last_became_peered":"2024-09-12T12:23:45.869078+0000","last_unstale":"2024-09-12T12:24:59.124431+0000","last_undegraded":"2024-09-12T12:24:59.124431+0000","last_fullsized":"2024-09-12T12:24:59.124431+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:37:19.849489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"85'1","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.125423+0000","last_change":"2024-09-12T12:23:43.787852+0000","last_active":"2024-09-12T12:24:59.125423+0000","last_peered":"2024-09-12T12:24:59.125423+0000","last_clean":"2024-09-12T12:24:59.125423+0000","last_became_active":"2024-09-12T12:23:43.787531+0000","last_became_peered":"2024-09-12T12:23:43.787531+0000","last_unstale":"2024-09-12T12:24:59.125423+0000","last_undegraded":"2024-09-12T12:24:59.125423+0000","last_fullsized":"2024-09-12T12:24:59.125423+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:25.499020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120125+0000","last_change":"2024-09-12T12:23:52.904603+0000","last_active":"2024-09-12T12:24:59.120125+0000","last_peered":"2024-09-12T12:24:59.120125+0000","last_clean":"2024-09-12T12:24:59.120125+0000","last_became_active":"2024-09-12T12:23:52.904146+0000","last_became_peered":"2024-09-12T12:23:52.904146+0000","last_unstale":"2024-09-12T12:24:59.120125+0000","last_undegraded":"2024-09-12T12:24:59.120125+0000","last_fullsized":"2024-09-12T12:24:59.120125+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:01.847489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.123015+0000","last_change":"2024-09-12T12:23:45.880381+0000","last_active":"2024-09-12T12:24:59.123015+0000","last_peered":"2024-09-12T12:24:59.123015+0000","last_clean":"2024-09-12T12:24:59.123015+0000","last_became_active":"2024-09-12T12:23:45.879865+0000","last_became_peered":"2024-09-12T12:23:45.879865+0000","last_unstale":"2024-09-12T12:24:59.123015+0000","last_undegraded":"2024-09-12T12:24:59.123015+0000","last_fullsized":"2024-09-12T12:24:59.123015+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:52.033891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"85'2","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.121205+0000","last_change":"2024-09-12T12:23:43.782166+0000","last_active":"2024-09-12T12:24:59.121205+0000","last_peered":"2024-09-12T12:24:59.121205+0000","last_clean":"2024-09-12T12:24:59.121205+0000","last_became_active":"2024-09-12T12:23:43.781808+0000","last_became_peered":"2024-09-12T12:23:43.781808+0000","last_unstale":"2024-09-12T12:24:59.121205+0000","last_undegraded":"2024-09-12T12:24:59.121205+0000","last_fullsized":"2024-09-12T12:24:59.121205+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:44:03.340842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"85'3","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.174142+0000","last_change":"2024-09-12T12:23:43.784869+0000","last_active":"2024-09-12T12:24:59.174142+0000","last_peered":"2024-09-12T12:24:59.174142+0000","last_clean":"2024-09-12T12:24:59.174142+0000","last_became_active":"2024-09-12T12:23:43.784458+0000","last_became_peered":"2024-09-12T12:23:43.784458+0000","last_unstale":"2024-09-12T12:24:59.174142+0000","last_undegraded":"2024-09-12T12:24:59.174142+0000","last_fullsized":"2024-09-12T12:24:59.174142+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:46.025169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.126134+0000","last_change":"2024-09-12T12:23:45.879258+0000","last_active":"2024-09-12T12:24:59.126134+0000","last_peered":"2024-09-12T12:24:59.126134+0000","last_clean":"2024-09-12T12:24:59.126134+0000","last_became_active":"2024-09-12T12:23:45.878934+0000","last_became_peered":"2024-09-12T12:23:45.878934+0000","last_unstale":"2024-09-12T12:24:59.126134+0000","last_undegraded":"2024-09-12T12:24:59.126134+0000","last_fullsized":"2024-09-12T12:24:59.126134+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:46:06.617621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.121567+0000","last_change":"2024-09-12T12:23:52.906041+0000","last_active":"2024-09-12T12:24:59.121567+0000","last_peered":"2024-09-12T12:24:59.121567+0000","last_clean":"2024-09-12T12:24:59.121567+0000","last_became_active":"2024-09-12T12:23:52.905630+0000","last_became_peered":"2024-09-12T12:23:52.905630+0000","last_unstale":"2024-09-12T12:24:59.121567+0000","last_undegraded":"2024-09-12T12:24:59.121567+0000","last_fullsized":"2024-09-12T12:24:59.121567+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:15.691085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"85'6","reported_seq":104,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:25:16.155352+0000","last_change":"2024-09-12T12:24:59.136007+0000","last_active":"2024-09-12T12:25:16.155352+0000","last_peered":"2024-09-12T12:25:16.155352+0000","last_clean":"2024-09-12T12:25:16.155352+0000","last_became_active":"2024-09-12T12:24:59.128094+0000","last_became_peered":"2024-09-12T12:24:59.128094+0000","last_unstale":"2024-09-12T12:25:16.155352+0000","last_undegraded":"2024-09-12T12:25:16.155352+0000","last_fullsized":"2024-09-12T12:25:16.155352+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:37.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":49,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1015,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.123936+0000","last_change":"2024-09-12T12:23:45.868002+0000","last_active":"2024-09-12T12:24:59.123936+0000","last_peered":"2024-09-12T12:24:59.123936+0000","last_clean":"2024-09-12T12:24:59.123936+0000","last_became_active":"2024-09-12T12:23:45.867448+0000","last_became_peered":"2024-09-12T12:23:45.867448+0000","last_unstale":"2024-09-12T12:24:59.123936+0000","last_undegraded":"2024-09-12T12:24:59.123936+0000","last_fullsized":"2024-09-12T12:24:59.123936+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:24:01.805345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.122860+0000","last_change":"2024-09-12T12:23:52.902119+0000","last_active":"2024-09-12T12:24:59.122860+0000","last_peered":"2024-09-12T12:24:59.122860+0000","last_clean":"2024-09-12T12:24:59.122860+0000","last_became_active":"2024-09-12T12:23:52.901681+0000","last_became_peered":"2024-09-12T12:23:52.901681+0000","last_unstale":"2024-09-12T12:24:59.122860+0000","last_undegraded":"2024-09-12T12:24:59.122860+0000","last_fullsized":"2024-09-12T12:24:59.122860+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:42.039729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.119912+0000","last_change":"2024-09-12T12:23:45.879115+0000","last_active":"2024-09-12T12:24:59.119912+0000","last_peered":"2024-09-12T12:24:59.119912+0000","last_clean":"2024-09-12T12:24:59.119912+0000","last_became_active":"2024-09-12T12:23:45.878745+0000","last_became_peered":"2024-09-12T12:23:45.878745+0000","last_unstale":"2024-09-12T12:24:59.119912+0000","last_undegraded":"2024-09-12T12:24:59.119912+0000","last_fullsized":"2024-09-12T12:24:59.119912+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:53.152875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.122327+0000","last_change":"2024-09-12T12:23:45.878444+0000","last_active":"2024-09-12T12:24:59.122327+0000","last_peered":"2024-09-12T12:24:59.122327+0000","last_clean":"2024-09-12T12:24:59.122327+0000","last_became_active":"2024-09-12T12:23:45.878063+0000","last_became_peered":"2024-09-12T12:23:45.878063+0000","last_unstale":"2024-09-12T12:24:59.122327+0000","last_undegraded":"2024-09-12T12:24:59.122327+0000","last_fullsized":"2024-09-12T12:24:59.122327+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:07.928598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.121896+0000","last_change":"2024-09-12T12:23:45.873101+0000","last_active":"2024-09-12T12:24:59.121896+0000","last_peered":"2024-09-12T12:24:59.121896+0000","last_clean":"2024-09-12T12:24:59.121896+0000","last_became_active":"2024-09-12T12:23:45.872373+0000","last_became_peered":"2024-09-12T12:23:45.872373+0000","last_unstale":"2024-09-12T12:24:59.121896+0000","last_undegraded":"2024-09-12T12:24:59.121896+0000","last_fullsized":"2024-09-12T12:24:59.121896+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:47:14.747538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.119630+0000","last_change":"2024-09-12T12:23:45.875315+0000","last_active":"2024-09-12T12:24:59.119630+0000","last_peered":"2024-09-12T12:24:59.119630+0000","last_clean":"2024-09-12T12:24:59.119630+0000","last_became_active":"2024-09-12T12:23:45.874904+0000","last_became_peered":"2024-09-12T12:23:45.874904+0000","last_unstale":"2024-09-12T12:24:59.119630+0000","last_undegraded":"2024-09-12T12:24:59.119630+0000","last_fullsized":"2024-09-12T12:24:59.119630+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:52:44.373937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.126419+0000","last_change":"2024-09-12T12:24:59.126419+0000","last_active":"2024-09-12T12:24:59.126419+0000","last_peered":"2024-09-12T12:24:59.126419+0000","last_clean":"2024-09-12T12:24:59.126419+0000","last_became_active":"2024-09-12T12:24:59.125996+0000","last_became_peered":"2024-09-12T12:24:59.125996+0000","last_unstale":"2024-09-12T12:24:59.126419+0000","last_undegraded":"2024-09-12T12:24:59.126419+0000","last_fullsized":"2024-09-12T12:24:59.126419+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:01.495467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120759+0000","last_change":"2024-09-12T12:23:45.872638+0000","last_active":"2024-09-12T12:24:59.120759+0000","last_peered":"2024-09-12T12:24:59.120759+0000","last_clean":"2024-09-12T12:24:59.120759+0000","last_became_active":"2024-09-12T12:23:45.872299+0000","last_became_peered":"2024-09-12T12:23:45.872299+0000","last_unstale":"2024-09-12T12:24:59.120759+0000","last_undegraded":"2024-09-12T12:24:59.120759+0000","last_fullsized":"2024-09-12T12:24:59.120759+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:27.758613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.123565+0000","last_change":"2024-09-12T12:23:45.877168+0000","last_active":"2024-09-12T12:24:59.123565+0000","last_peered":"2024-09-12T12:24:59.123565+0000","last_clean":"2024-09-12T12:24:59.123565+0000","last_became_active":"2024-09-12T12:23:45.876871+0000","last_became_peered":"2024-09-12T12:23:45.876871+0000","last_unstale":"2024-09-12T12:24:59.123565+0000","last_undegraded":"2024-09-12T12:24:59.123565+0000","last_fullsized":"2024-09-12T12:24:59.123565+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:24.567415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.128436+0000","last_change":"2024-09-12T12:24:59.128436+0000","last_active":"2024-09-12T12:24:59.128436+0000","last_peered":"2024-09-12T12:24:59.128436+0000","last_clean":"2024-09-12T12:24:59.128436+0000","last_became_active":"2024-09-12T12:24:59.128125+0000","last_became_peered":"2024-09-12T12:24:59.128125+0000","last_unstale":"2024-09-12T12:24:59.128436+0000","last_undegraded":"2024-09-12T12:24:59.128436+0000","last_fullsized":"2024-09-12T12:24:59.128436+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:58.903559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.125171+0000","last_change":"2024-09-12T12:23:45.873728+0000","last_active":"2024-09-12T12:24:59.125171+0000","last_peered":"2024-09-12T12:24:59.125171+0000","last_clean":"2024-09-12T12:24:59.125171+0000","last_became_active":"2024-09-12T12:23:45.871831+0000","last_became_peered":"2024-09-12T12:23:45.871831+0000","last_unstale":"2024-09-12T12:24:59.125171+0000","last_undegraded":"2024-09-12T12:24:59.125171+0000","last_fullsized":"2024-09-12T12:24:59.125171+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:48.690705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.123114+0000","last_change":"2024-09-12T12:23:45.873035+0000","last_active":"2024-09-12T12:24:59.123114+0000","last_peered":"2024-09-12T12:24:59.123114+0000","last_clean":"2024-09-12T12:24:59.123114+0000","last_became_active":"2024-09-12T12:23:45.872660+0000","last_became_peered":"2024-09-12T12:23:45.872660+0000","last_unstale":"2024-09-12T12:24:59.123114+0000","last_undegraded":"2024-09-12T12:24:59.123114+0000","last_fullsized":"2024-09-12T12:24:59.123114+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:31.376116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.122929+0000","last_change":"2024-09-12T12:23:45.879754+0000","last_active":"2024-09-12T12:24:59.122929+0000","last_peered":"2024-09-12T12:24:59.122929+0000","last_clean":"2024-09-12T12:24:59.122929+0000","last_became_active":"2024-09-12T12:23:45.879362+0000","last_became_peered":"2024-09-12T12:23:45.879362+0000","last_unstale":"2024-09-12T12:24:59.122929+0000","last_undegraded":"2024-09-12T12:24:59.122929+0000","last_fullsized":"2024-09-12T12:24:59.122929+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:23.587083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.121740+0000","last_change":"2024-09-12T12:23:45.878297+0000","last_active":"2024-09-12T12:24:59.121740+0000","last_peered":"2024-09-12T12:24:59.121740+0000","last_clean":"2024-09-12T12:24:59.121740+0000","last_became_active":"2024-09-12T12:23:45.877127+0000","last_became_peered":"2024-09-12T12:23:45.877127+0000","last_unstale":"2024-09-12T12:24:59.121740+0000","last_undegraded":"2024-09-12T12:24:59.121740+0000","last_fullsized":"2024-09-12T12:24:59.121740+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:54.334325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.121062+0000","last_change":"2024-09-12T12:23:45.879078+0000","last_active":"2024-09-12T12:24:59.121062+0000","last_peered":"2024-09-12T12:24:59.121062+0000","last_clean":"2024-09-12T12:24:59.121062+0000","last_became_active":"2024-09-12T12:23:45.878799+0000","last_became_peered":"2024-09-12T12:23:45.878799+0000","last_unstale":"2024-09-12T12:24:59.121062+0000","last_undegraded":"2024-09-12T12:24:59.121062+0000","last_fullsized":"2024-09-12T12:24:59.121062+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:45.680643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.123023+0000","last_change":"2024-09-12T12:23:45.872739+0000","last_active":"2024-09-12T12:24:59.123023+0000","last_peered":"2024-09-12T12:24:59.123023+0000","last_clean":"2024-09-12T12:24:59.123023+0000","last_became_active":"2024-09-12T12:23:45.871931+0000","last_became_peered":"2024-09-12T12:23:45.871931+0000","last_unstale":"2024-09-12T12:24:59.123023+0000","last_undegraded":"2024-09-12T12:24:59.123023+0000","last_fullsized":"2024-09-12T12:24:59.123023+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:36:30.451737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.124907+0000","last_change":"2024-09-12T12:23:45.876717+0000","last_active":"2024-09-12T12:24:59.124907+0000","last_peered":"2024-09-12T12:24:59.124907+0000","last_clean":"2024-09-12T12:24:59.124907+0000","last_became_active":"2024-09-12T12:23:45.876372+0000","last_became_peered":"2024-09-12T12:23:45.876372+0000","last_unstale":"2024-09-12T12:24:59.124907+0000","last_undegraded":"2024-09-12T12:24:59.124907+0000","last_fullsized":"2024-09-12T12:24:59.124907+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:40:26.905442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120916+0000","last_change":"2024-09-12T12:23:45.877286+0000","last_active":"2024-09-12T12:24:59.120916+0000","last_peered":"2024-09-12T12:24:59.120916+0000","last_clean":"2024-09-12T12:24:59.120916+0000","last_became_active":"2024-09-12T12:23:45.876619+0000","last_became_peered":"2024-09-12T12:23:45.876619+0000","last_unstale":"2024-09-12T12:24:59.120916+0000","last_undegraded":"2024-09-12T12:24:59.120916+0000","last_fullsized":"2024-09-12T12:24:59.120916+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:05.637917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.122551+0000","last_change":"2024-09-12T12:23:45.875244+0000","last_active":"2024-09-12T12:24:59.122551+0000","last_peered":"2024-09-12T12:24:59.122551+0000","last_clean":"2024-09-12T12:24:59.122551+0000","last_became_active":"2024-09-12T12:23:45.874908+0000","last_became_peered":"2024-09-12T12:23:45.874908+0000","last_unstale":"2024-09-12T12:24:59.122551+0000","last_undegraded":"2024-09-12T12:24:59.122551+0000","last_fullsized":"2024-09-12T12:24:59.122551+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:14.314124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.119340+0000","last_change":"2024-09-12T12:23:45.875253+0000","last_active":"2024-09-12T12:24:59.119340+0000","last_peered":"2024-09-12T12:24:59.119340+0000","last_clean":"2024-09-12T12:24:59.119340+0000","last_became_active":"2024-09-12T12:23:45.874936+0000","last_became_peered":"2024-09-12T12:23:45.874936+0000","last_unstale":"2024-09-12T12:24:59.119340+0000","last_undegraded":"2024-09-12T12:24:59.119340+0000","last_fullsized":"2024-09-12T12:24:59.119340+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:28.790546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.119418+0000","last_change":"2024-09-12T12:23:45.880503+0000","last_active":"2024-09-12T12:24:59.119418+0000","last_peered":"2024-09-12T12:24:59.119418+0000","last_clean":"2024-09-12T12:24:59.119418+0000","last_became_active":"2024-09-12T12:23:45.880184+0000","last_became_peered":"2024-09-12T12:23:45.880184+0000","last_unstale":"2024-09-12T12:24:59.119418+0000","last_undegraded":"2024-09-12T12:24:59.119418+0000","last_fullsized":"2024-09-12T12:24:59.119418+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:12.370667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.121570+0000","last_change":"2024-09-12T12:23:45.869762+0000","last_active":"2024-09-12T12:24:59.121570+0000","last_peered":"2024-09-12T12:24:59.121570+0000","last_clean":"2024-09-12T12:24:59.121570+0000","last_became_active":"2024-09-12T12:23:45.867595+0000","last_became_peered":"2024-09-12T12:23:45.867595+0000","last_unstale":"2024-09-12T12:24:59.121570+0000","last_undegraded":"2024-09-12T12:24:59.121570+0000","last_fullsized":"2024-09-12T12:24:59.121570+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:25:19.855969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.124705+0000","last_change":"2024-09-12T12:23:45.874097+0000","last_active":"2024-09-12T12:24:59.124705+0000","last_peered":"2024-09-12T12:24:59.124705+0000","last_clean":"2024-09-12T12:24:59.124705+0000","last_became_active":"2024-09-12T12:23:45.873275+0000","last_became_peered":"2024-09-12T12:23:45.873275+0000","last_unstale":"2024-09-12T12:24:59.124705+0000","last_undegraded":"2024-09-12T12:24:59.124705+0000","last_fullsized":"2024-09-12T12:24:59.124705+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:21.303339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120689+0000","last_change":"2024-09-12T12:23:45.883354+0000","last_active":"2024-09-12T12:24:59.120689+0000","last_peered":"2024-09-12T12:24:59.120689+0000","last_clean":"2024-09-12T12:24:59.120689+0000","last_became_active":"2024-09-12T12:23:45.882673+0000","last_became_peered":"2024-09-12T12:23:45.882673+0000","last_unstale":"2024-09-12T12:24:59.120689+0000","last_undegraded":"2024-09-12T12:24:59.120689+0000","last_fullsized":"2024-09-12T12:24:59.120689+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:42.034857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.174493+0000","last_change":"2024-09-12T12:23:45.876955+0000","last_active":"2024-09-12T12:24:59.174493+0000","last_peered":"2024-09-12T12:24:59.174493+0000","last_clean":"2024-09-12T12:24:59.174493+0000","last_became_active":"2024-09-12T12:23:45.876632+0000","last_became_peered":"2024-09-12T12:23:45.876632+0000","last_unstale":"2024-09-12T12:24:59.174493+0000","last_undegraded":"2024-09-12T12:24:59.174493+0000","last_fullsized":"2024-09-12T12:24:59.174493+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:25.155739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.123449+0000","last_change":"2024-09-12T12:23:45.875166+0000","last_active":"2024-09-12T12:24:59.123449+0000","last_peered":"2024-09-12T12:24:59.123449+0000","last_clean":"2024-09-12T12:24:59.123449+0000","last_became_active":"2024-09-12T12:23:45.874835+0000","last_became_peered":"2024-09-12T12:23:45.874835+0000","last_unstale":"2024-09-12T12:24:59.123449+0000","last_undegraded":"2024-09-12T12:24:59.123449+0000","last_fullsized":"2024-09-12T12:24:59.123449+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:50.014484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.122883+0000","last_change":"2024-09-12T12:23:45.874161+0000","last_active":"2024-09-12T12:24:59.122883+0000","last_peered":"2024-09-12T12:24:59.122883+0000","last_clean":"2024-09-12T12:24:59.122883+0000","last_became_active":"2024-09-12T12:23:45.873846+0000","last_became_peered":"2024-09-12T12:23:45.873846+0000","last_unstale":"2024-09-12T12:24:59.122883+0000","last_undegraded":"2024-09-12T12:24:59.122883+0000","last_fullsized":"2024-09-12T12:24:59.122883+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:09:17.525956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120217+0000","last_change":"2024-09-12T12:23:45.870642+0000","last_active":"2024-09-12T12:24:59.120217+0000","last_peered":"2024-09-12T12:24:59.120217+0000","last_clean":"2024-09-12T12:24:59.120217+0000","last_became_active":"2024-09-12T12:23:45.870006+0000","last_became_peered":"2024-09-12T12:23:45.870006+0000","last_unstale":"2024-09-12T12:24:59.120217+0000","last_undegraded":"2024-09-12T12:24:59.120217+0000","last_fullsized":"2024-09-12T12:24:59.120217+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:43:35.133650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.174065+0000","last_change":"2024-09-12T12:23:45.875174+0000","last_active":"2024-09-12T12:24:59.174065+0000","last_peered":"2024-09-12T12:24:59.174065+0000","last_clean":"2024-09-12T12:24:59.174065+0000","last_became_active":"2024-09-12T12:23:45.874851+0000","last_became_peered":"2024-09-12T12:23:45.874851+0000","last_unstale":"2024-09-12T12:24:59.174065+0000","last_undegraded":"2024-09-12T12:24:59.174065+0000","last_fullsized":"2024-09-12T12:24:59.174065+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:42.565644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.122396+0000","last_change":"2024-09-12T12:23:45.873170+0000","last_active":"2024-09-12T12:24:59.122396+0000","last_peered":"2024-09-12T12:24:59.122396+0000","last_clean":"2024-09-12T12:24:59.122396+0000","last_became_active":"2024-09-12T12:23:45.872814+0000","last_became_peered":"2024-09-12T12:23:45.872814+0000","last_unstale":"2024-09-12T12:24:59.122396+0000","last_undegraded":"2024-09-12T12:24:59.122396+0000","last_fullsized":"2024-09-12T12:24:59.122396+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:36.143107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.124552+0000","last_change":"2024-09-12T12:23:45.874271+0000","last_active":"2024-09-12T12:24:59.124552+0000","last_peered":"2024-09-12T12:24:59.124552+0000","last_clean":"2024-09-12T12:24:59.124552+0000","last_became_active":"2024-09-12T12:23:45.873789+0000","last_became_peered":"2024-09-12T12:23:45.873789+0000","last_unstale":"2024-09-12T12:24:59.124552+0000","last_undegraded":"2024-09-12T12:24:59.124552+0000","last_fullsized":"2024-09-12T12:24:59.124552+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:58.252706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.119781+0000","last_change":"2024-09-12T12:23:45.877236+0000","last_active":"2024-09-12T12:24:59.119781+0000","last_peered":"2024-09-12T12:24:59.119781+0000","last_clean":"2024-09-12T12:24:59.119781+0000","last_became_active":"2024-09-12T12:23:45.876920+0000","last_became_peered":"2024-09-12T12:23:45.876920+0000","last_unstale":"2024-09-12T12:24:59.119781+0000","last_undegraded":"2024-09-12T12:24:59.119781+0000","last_fullsized":"2024-09-12T12:24:59.119781+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:19:19.749103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120011+0000","last_change":"2024-09-12T12:23:45.880480+0000","last_active":"2024-09-12T12:24:59.120011+0000","last_peered":"2024-09-12T12:24:59.120011+0000","last_clean":"2024-09-12T12:24:59.120011+0000","last_became_active":"2024-09-12T12:23:45.880163+0000","last_became_peered":"2024-09-12T12:23:45.880163+0000","last_unstale":"2024-09-12T12:24:59.120011+0000","last_undegraded":"2024-09-12T12:24:59.120011+0000","last_fullsized":"2024-09-12T12:24:59.120011+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:35.496705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120822+0000","last_change":"2024-09-12T12:23:45.876975+0000","last_active":"2024-09-12T12:24:59.120822+0000","last_peered":"2024-09-12T12:24:59.120822+0000","last_clean":"2024-09-12T12:24:59.120822+0000","last_became_active":"2024-09-12T12:23:45.876501+0000","last_became_peered":"2024-09-12T12:23:45.876501+0000","last_unstale":"2024-09-12T12:24:59.120822+0000","last_undegraded":"2024-09-12T12:24:59.120822+0000","last_fullsized":"2024-09-12T12:24:59.120822+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:15.029566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68143,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":326,"num_read_kb":238,"num_write":170,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1127,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":204429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":286267,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612640,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":958464,"data_stored":492806,"data_compressed":23578,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841572,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28112,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717040,"statfs":{"total":95995035648,"available":95966248960,"internally_reserved":0,"allocated":1110016,"data_stored":1148310,"data_compressed":59976,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005098,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":978944,"data_stored":497138,"data_compressed":23578,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234030,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":974848,"data_stored":492962,"data_compressed":23578,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462964,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1024000,"data_stored":1088873,"data_compressed":59976,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626490,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":954368,"data_stored":488218,"data_compressed":23578,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855422,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32196,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712956,"statfs":{"total":95995035648,"available":95962066944,"internally_reserved":0,"allocated":1028096,"data_stored":1080365,"data_compressed":59976,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018947,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":974848,"data_stored":493883,"data_compressed":23578,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247881,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":966656,"data_stored":488412,"data_compressed":23578,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444110,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32196,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712956,"statfs":{"total":95995035648,"available":95962066944,"internally_reserved":0,"allocated":1032192,"data_stored":552884,"data_compressed":23578,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1032192,"data_stored":552380,"data_compressed":23578,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738455,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36304,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708848,"statfs":{"total":95995035648,"available":95957860352,"internally_reserved":0,"allocated":978944,"data_stored":489606,"data_compressed":23578,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34759,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34759,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34759,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36398,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36398,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36398,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36398,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36398,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":64252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":64756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:25:24.212 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T12:25:24.478 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:24.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:24 smithi033 ceph-mon[31246]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:25:24.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:24 smithi043 ceph-mon[34144]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:25:24.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:24 smithi102 ceph-mon[34799]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:25:24.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:24.932+0000 7f3e2024b640 1 -- 172.21.15.33:0/2961834052 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e18102790 msgr2=0x7f3e181067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:24.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:24.932+0000 7f3e2024b640 1 --2- 172.21.15.33:0/2961834052 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e18102790 0x7f3e181067e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3e08009900 tx=0x7f3e0802a410 comp rx=0 tx=0).stop 2024-09-12T12:25:24.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:24.932+0000 7f3e2024b640 1 -- 172.21.15.33:0/2961834052 shutdown_connections 2024-09-12T12:25:24.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:24.932+0000 7f3e2024b640 1 --2- 172.21.15.33:0/2961834052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e18106f10 0x7f3e1810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:24.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:24.932+0000 7f3e2024b640 1 --2- 172.21.15.33:0/2961834052 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e18102790 0x7f3e181067e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:24.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:24.932+0000 7f3e2024b640 1 --2- 172.21.15.33:0/2961834052 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e18101de0 0x7f3e181021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:24.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:24.932+0000 7f3e2024b640 1 -- 172.21.15.33:0/2961834052 >> 172.21.15.33:0/2961834052 conn(0x7f3e180fd8c0 msgr2=0x7f3e180ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:24.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:24.932+0000 7f3e2024b640 1 -- 172.21.15.33:0/2961834052 shutdown_connections 2024-09-12T12:25:24.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:24.932+0000 7f3e2024b640 1 -- 172.21.15.33:0/2961834052 wait complete. 2024-09-12T12:25:24.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:24.933+0000 7f3e2024b640 1 Processor -- start 2024-09-12T12:25:24.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:24.933+0000 7f3e2024b640 1 -- start start 2024-09-12T12:25:24.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:24.933+0000 7f3e2024b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e18101de0 0x7f3e180744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:24.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:24.933+0000 7f3e2024b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e18102790 0x7f3e18074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:24.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:24.933+0000 7f3e2024b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e18106f10 0x7f3e18074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:24.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:24.933+0000 7f3e2024b640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3e18111de0 con 0x7f3e18106f10 2024-09-12T12:25:24.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:24.933+0000 7f3e2024b640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3e18111c60 con 0x7f3e18101de0 2024-09-12T12:25:24.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:24.933+0000 7f3e2024b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3e18111f60 con 0x7f3e18102790 2024-09-12T12:25:24.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:24.933+0000 7f3e1e7e8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e18106f10 0x7f3e18074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:24.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:24.933+0000 7f3e1e7e8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e18106f10 0x7f3e18074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37348/0 (socket says 172.21.15.33:37348) 2024-09-12T12:25:24.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:24.933+0000 7f3e1e7e8640 1 -- 172.21.15.33:0/4161874919 learned_addr learned my addr 172.21.15.33:0/4161874919 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:24.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:24.933+0000 7f3e1dfe7640 1 --2- 172.21.15.33:0/4161874919 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e18101de0 0x7f3e180744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:24.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:24.933+0000 7f3e1d7e6640 1 --2- 172.21.15.33:0/4161874919 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e18102790 0x7f3e18074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:24.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:24.934+0000 7f3e1e7e8640 1 -- 172.21.15.33:0/4161874919 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e18102790 msgr2=0x7f3e18074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:24.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:24.934+0000 7f3e1e7e8640 1 --2- 172.21.15.33:0/4161874919 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e18102790 0x7f3e18074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:24.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:24.934+0000 7f3e1e7e8640 1 -- 172.21.15.33:0/4161874919 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e18101de0 msgr2=0x7f3e180744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:24.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:24.934+0000 7f3e1e7e8640 1 --2- 172.21.15.33:0/4161874919 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e18101de0 0x7f3e180744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:24.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:24.934+0000 7f3e1e7e8640 1 -- 172.21.15.33:0/4161874919 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e181a68a0 con 0x7f3e18106f10 2024-09-12T12:25:24.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:24.934+0000 7f3e1e7e8640 1 --2- 172.21.15.33:0/4161874919 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e18106f10 0x7f3e18074f70 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3e1000cad0 tx=0x7f3e1000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:24.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:24.934+0000 7f3e0effd640 1 -- 172.21.15.33:0/4161874919 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1000ae20 con 0x7f3e18106f10 2024-09-12T12:25:24.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:24.934+0000 7f3e0effd640 1 -- 172.21.15.33:0/4161874919 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3e10005020 con 0x7f3e18106f10 2024-09-12T12:25:24.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:24.934+0000 7f3e2024b640 1 -- 172.21.15.33:0/4161874919 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e181a6b90 con 0x7f3e18106f10 2024-09-12T12:25:24.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:24.934+0000 7f3e0effd640 1 -- 172.21.15.33:0/4161874919 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1000f6b0 con 0x7f3e18106f10 2024-09-12T12:25:24.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:24.934+0000 7f3e2024b640 1 -- 172.21.15.33:0/4161874919 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e181a70a0 con 0x7f3e18106f10 2024-09-12T12:25:24.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:24.935+0000 7f3e2024b640 1 -- 172.21.15.33:0/4161874919 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e181021c0 con 0x7f3e18106f10 2024-09-12T12:25:24.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:24.936+0000 7f3e0effd640 1 -- 172.21.15.33:0/4161874919 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3e100051d0 con 0x7f3e18106f10 2024-09-12T12:25:24.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:24.937+0000 7f3e0effd640 1 --2- 172.21.15.33:0/4161874919 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f3e040a2c90 0x7f3e040a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:24.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:24.937+0000 7f3e0effd640 1 -- 172.21.15.33:0/4161874919 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7f3e100cf440 con 0x7f3e18106f10 2024-09-12T12:25:24.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:24.937+0000 7f3e1dfe7640 1 --2- 172.21.15.33:0/4161874919 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f3e040a2c90 0x7f3e040a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:24.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:24.938+0000 7f3e1dfe7640 1 --2- 172.21.15.33:0/4161874919 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f3e040a2c90 0x7f3e040a5150 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3e140058c0 tx=0x7f3e1400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:24.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:24.941+0000 7f3e0effd640 1 -- 172.21.15.33:0/4161874919 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3e10014030 con 0x7f3e18106f10 2024-09-12T12:25:25.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:25.117+0000 7f3e2024b640 1 -- 172.21.15.33:0/4161874919 --> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3e18062630 con 0x7f3e040a2c90 2024-09-12T12:25:25.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:25.127+0000 7f3e0effd640 1 -- 172.21.15.33:0/4161874919 <== mgr.14150 v2:172.21.15.33:6800/176202431 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340641 (secure 0 0 0) 0x7f3e18062630 con 0x7f3e040a2c90 2024-09-12T12:25:25.131 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:25:25.132 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-12T12:25:25.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:25.130+0000 7f3e2024b640 1 -- 172.21.15.33:0/4161874919 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f3e040a2c90 msgr2=0x7f3e040a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:25.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:25.130+0000 7f3e2024b640 1 --2- 172.21.15.33:0/4161874919 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f3e040a2c90 0x7f3e040a5150 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3e140058c0 tx=0x7f3e1400a2d0 comp rx=0 tx=0).stop 2024-09-12T12:25:25.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:25.130+0000 7f3e2024b640 1 -- 172.21.15.33:0/4161874919 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e18106f10 msgr2=0x7f3e18074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:25.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:25.130+0000 7f3e2024b640 1 --2- 172.21.15.33:0/4161874919 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e18106f10 0x7f3e18074f70 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3e1000cad0 tx=0x7f3e1000cf90 comp rx=0 tx=0).stop 2024-09-12T12:25:25.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:25.130+0000 7f3e2024b640 1 -- 172.21.15.33:0/4161874919 shutdown_connections 2024-09-12T12:25:25.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:25.130+0000 7f3e2024b640 1 --2- 172.21.15.33:0/4161874919 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f3e040a2c90 0x7f3e040a5150 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:25.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:25.130+0000 7f3e2024b640 1 --2- 172.21.15.33:0/4161874919 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e18106f10 0x7f3e18074f70 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:25.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:25.130+0000 7f3e2024b640 1 --2- 172.21.15.33:0/4161874919 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e18102790 0x7f3e18074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:25.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:25.130+0000 7f3e2024b640 1 --2- 172.21.15.33:0/4161874919 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e18101de0 0x7f3e180744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:25.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:25.130+0000 7f3e2024b640 1 -- 172.21.15.33:0/4161874919 >> 172.21.15.33:0/4161874919 conn(0x7f3e180fd8c0 msgr2=0x7f3e180fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:25.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:25.130+0000 7f3e2024b640 1 -- 172.21.15.33:0/4161874919 shutdown_connections 2024-09-12T12:25:25.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:25.130+0000 7f3e2024b640 1 -- 172.21.15.33:0/4161874919 wait complete. 2024-09-12T12:25:25.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:25 smithi033 ceph-mon[31246]: pgmap v330: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-12T12:25:25.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:25 smithi043 ceph-mon[34144]: pgmap v330: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-12T12:25:25.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:25 smithi102 ceph-mon[34799]: pgmap v330: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-12T12:25:25.953 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":330,"stamp":"2024-09-12T12:25:23.899711+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658745,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":477,"num_read_kb":357,"num_write":353,"num_write_kb":3058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":1181980,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":284,"ondisk_log_size":284,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":381844,"kb_used_data":11732,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124559980,"statfs":{"total":1151940427776,"available":1151549419520,"internally_reserved":0,"allocated":12013568,"data_stored":7865837,"data_compressed":392130,"data_compressed_allocated":528384,"data_compressed_original":2555904,"omap_allocated":19141,"internal_metadata":378713403},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":40,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003657"},"pg_stats":[{"pgid":"2.1f","version":"85'9","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.125088+0000","last_change":"2024-09-12T12:23:43.779951+0000","last_active":"2024-09-12T12:24:59.125088+0000","last_peered":"2024-09-12T12:24:59.125088+0000","last_clean":"2024-09-12T12:24:59.125088+0000","last_became_active":"2024-09-12T12:23:43.779641+0000","last_became_peered":"2024-09-12T12:23:43.779641+0000","last_unstale":"2024-09-12T12:24:59.125088+0000","last_undegraded":"2024-09-12T12:24:59.125088+0000","last_fullsized":"2024-09-12T12:24:59.125088+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:49.594196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.123933+0000","last_change":"2024-09-12T12:23:45.873591+0000","last_active":"2024-09-12T12:24:59.123933+0000","last_peered":"2024-09-12T12:24:59.123933+0000","last_clean":"2024-09-12T12:24:59.123933+0000","last_became_active":"2024-09-12T12:23:45.873295+0000","last_became_peered":"2024-09-12T12:23:45.873295+0000","last_unstale":"2024-09-12T12:24:59.123933+0000","last_undegraded":"2024-09-12T12:24:59.123933+0000","last_fullsized":"2024-09-12T12:24:59.123933+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:49.907824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.128750+0000","last_change":"2024-09-12T12:24:59.128750+0000","last_active":"2024-09-12T12:24:59.128750+0000","last_peered":"2024-09-12T12:24:59.128750+0000","last_clean":"2024-09-12T12:24:59.128750+0000","last_became_active":"2024-09-12T12:24:59.128296+0000","last_became_peered":"2024-09-12T12:24:59.128296+0000","last_unstale":"2024-09-12T12:24:59.128750+0000","last_undegraded":"2024-09-12T12:24:59.128750+0000","last_fullsized":"2024-09-12T12:24:59.128750+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:12:57.582164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.124176+0000","last_change":"2024-09-12T12:23:43.835297+0000","last_active":"2024-09-12T12:24:59.124176+0000","last_peered":"2024-09-12T12:24:59.124176+0000","last_clean":"2024-09-12T12:24:59.124176+0000","last_became_active":"2024-09-12T12:23:43.834971+0000","last_became_peered":"2024-09-12T12:23:43.834971+0000","last_unstale":"2024-09-12T12:24:59.124176+0000","last_undegraded":"2024-09-12T12:24:59.124176+0000","last_fullsized":"2024-09-12T12:24:59.124176+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:00:07.128092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120346+0000","last_change":"2024-09-12T12:23:45.876388+0000","last_active":"2024-09-12T12:24:59.120346+0000","last_peered":"2024-09-12T12:24:59.120346+0000","last_clean":"2024-09-12T12:24:59.120346+0000","last_became_active":"2024-09-12T12:23:45.876090+0000","last_became_peered":"2024-09-12T12:23:45.876090+0000","last_unstale":"2024-09-12T12:24:59.120346+0000","last_undegraded":"2024-09-12T12:24:59.120346+0000","last_fullsized":"2024-09-12T12:24:59.120346+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:02.576991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.123753+0000","last_change":"2024-09-12T12:23:52.904665+0000","last_active":"2024-09-12T12:24:59.123753+0000","last_peered":"2024-09-12T12:24:59.123753+0000","last_clean":"2024-09-12T12:24:59.123753+0000","last_became_active":"2024-09-12T12:23:52.903758+0000","last_became_peered":"2024-09-12T12:23:52.903758+0000","last_unstale":"2024-09-12T12:24:59.123753+0000","last_undegraded":"2024-09-12T12:24:59.123753+0000","last_fullsized":"2024-09-12T12:24:59.123753+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:48.510180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"85'4","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.134194+0000","last_change":"2024-09-12T12:24:59.134194+0000","last_active":"2024-09-12T12:24:59.134194+0000","last_peered":"2024-09-12T12:24:59.134194+0000","last_clean":"2024-09-12T12:24:59.134194+0000","last_became_active":"2024-09-12T12:24:59.124651+0000","last_became_peered":"2024-09-12T12:24:59.124651+0000","last_unstale":"2024-09-12T12:24:59.134194+0000","last_undegraded":"2024-09-12T12:24:59.134194+0000","last_fullsized":"2024-09-12T12:24:59.134194+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:59:26.516659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.122950+0000","last_change":"2024-09-12T12:23:45.863775+0000","last_active":"2024-09-12T12:24:59.122950+0000","last_peered":"2024-09-12T12:24:59.122950+0000","last_clean":"2024-09-12T12:24:59.122950+0000","last_became_active":"2024-09-12T12:23:45.863437+0000","last_became_peered":"2024-09-12T12:23:45.863437+0000","last_unstale":"2024-09-12T12:24:59.122950+0000","last_undegraded":"2024-09-12T12:24:59.122950+0000","last_fullsized":"2024-09-12T12:24:59.122950+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:33.539904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.124072+0000","last_change":"2024-09-12T12:23:52.902674+0000","last_active":"2024-09-12T12:24:59.124072+0000","last_peered":"2024-09-12T12:24:59.124072+0000","last_clean":"2024-09-12T12:24:59.124072+0000","last_became_active":"2024-09-12T12:23:52.902130+0000","last_became_peered":"2024-09-12T12:23:52.902130+0000","last_unstale":"2024-09-12T12:24:59.124072+0000","last_undegraded":"2024-09-12T12:24:59.124072+0000","last_fullsized":"2024-09-12T12:24:59.124072+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:24.867630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.144624+0000","last_change":"2024-09-12T12:24:59.144624+0000","last_active":"2024-09-12T12:24:59.144624+0000","last_peered":"2024-09-12T12:24:59.144624+0000","last_clean":"2024-09-12T12:24:59.144624+0000","last_became_active":"2024-09-12T12:24:59.129929+0000","last_became_peered":"2024-09-12T12:24:59.129929+0000","last_unstale":"2024-09-12T12:24:59.144624+0000","last_undegraded":"2024-09-12T12:24:59.144624+0000","last_fullsized":"2024-09-12T12:24:59.144624+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:05.959920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.126480+0000","last_change":"2024-09-12T12:23:45.878131+0000","last_active":"2024-09-12T12:24:59.126480+0000","last_peered":"2024-09-12T12:24:59.126480+0000","last_clean":"2024-09-12T12:24:59.126480+0000","last_became_active":"2024-09-12T12:23:45.877838+0000","last_became_peered":"2024-09-12T12:23:45.877838+0000","last_unstale":"2024-09-12T12:24:59.126480+0000","last_undegraded":"2024-09-12T12:24:59.126480+0000","last_fullsized":"2024-09-12T12:24:59.126480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:31.029515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.123971+0000","last_change":"2024-09-12T12:23:52.900871+0000","last_active":"2024-09-12T12:24:59.123971+0000","last_peered":"2024-09-12T12:24:59.123971+0000","last_clean":"2024-09-12T12:24:59.123971+0000","last_became_active":"2024-09-12T12:23:52.900339+0000","last_became_peered":"2024-09-12T12:23:52.900339+0000","last_unstale":"2024-09-12T12:24:59.123971+0000","last_undegraded":"2024-09-12T12:24:59.123971+0000","last_fullsized":"2024-09-12T12:24:59.123971+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:24.778852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120345+0000","last_change":"2024-09-12T12:23:45.879124+0000","last_active":"2024-09-12T12:24:59.120345+0000","last_peered":"2024-09-12T12:24:59.120345+0000","last_clean":"2024-09-12T12:24:59.120345+0000","last_became_active":"2024-09-12T12:23:45.878770+0000","last_became_peered":"2024-09-12T12:23:45.878770+0000","last_unstale":"2024-09-12T12:24:59.120345+0000","last_undegraded":"2024-09-12T12:24:59.120345+0000","last_fullsized":"2024-09-12T12:24:59.120345+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:58.767155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.122519+0000","last_change":"2024-09-12T12:23:43.782666+0000","last_active":"2024-09-12T12:24:59.122519+0000","last_peered":"2024-09-12T12:24:59.122519+0000","last_clean":"2024-09-12T12:24:59.122519+0000","last_became_active":"2024-09-12T12:23:43.782235+0000","last_became_peered":"2024-09-12T12:23:43.782235+0000","last_unstale":"2024-09-12T12:24:59.122519+0000","last_undegraded":"2024-09-12T12:24:59.122519+0000","last_fullsized":"2024-09-12T12:24:59.122519+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:28.499038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.124159+0000","last_change":"2024-09-12T12:23:52.933933+0000","last_active":"2024-09-12T12:24:59.124159+0000","last_peered":"2024-09-12T12:24:59.124159+0000","last_clean":"2024-09-12T12:24:59.124159+0000","last_became_active":"2024-09-12T12:23:52.933500+0000","last_became_peered":"2024-09-12T12:23:52.933500+0000","last_unstale":"2024-09-12T12:24:59.124159+0000","last_undegraded":"2024-09-12T12:24:59.124159+0000","last_fullsized":"2024-09-12T12:24:59.124159+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:28.598435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.123379+0000","last_change":"2024-09-12T12:23:45.868518+0000","last_active":"2024-09-12T12:24:59.123379+0000","last_peered":"2024-09-12T12:24:59.123379+0000","last_clean":"2024-09-12T12:24:59.123379+0000","last_became_active":"2024-09-12T12:23:45.868198+0000","last_became_peered":"2024-09-12T12:23:45.868198+0000","last_unstale":"2024-09-12T12:24:59.123379+0000","last_undegraded":"2024-09-12T12:24:59.123379+0000","last_fullsized":"2024-09-12T12:24:59.123379+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:53.815362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"85'1","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.121954+0000","last_change":"2024-09-12T12:23:43.785481+0000","last_active":"2024-09-12T12:24:59.121954+0000","last_peered":"2024-09-12T12:24:59.121954+0000","last_clean":"2024-09-12T12:24:59.121954+0000","last_became_active":"2024-09-12T12:23:43.783842+0000","last_became_peered":"2024-09-12T12:23:43.783842+0000","last_unstale":"2024-09-12T12:24:59.121954+0000","last_undegraded":"2024-09-12T12:24:59.121954+0000","last_fullsized":"2024-09-12T12:24:59.121954+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:45:30.080456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"85'1","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.124175+0000","last_change":"2024-09-12T12:23:52.898648+0000","last_active":"2024-09-12T12:24:59.124175+0000","last_peered":"2024-09-12T12:24:59.124175+0000","last_clean":"2024-09-12T12:24:59.124175+0000","last_became_active":"2024-09-12T12:23:52.898242+0000","last_became_peered":"2024-09-12T12:23:52.898242+0000","last_unstale":"2024-09-12T12:24:59.124175+0000","last_undegraded":"2024-09-12T12:24:59.124175+0000","last_fullsized":"2024-09-12T12:24:59.124175+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:49:30.598747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.119982+0000","last_change":"2024-09-12T12:23:45.873067+0000","last_active":"2024-09-12T12:24:59.119982+0000","last_peered":"2024-09-12T12:24:59.119982+0000","last_clean":"2024-09-12T12:24:59.119982+0000","last_became_active":"2024-09-12T12:23:45.872616+0000","last_became_peered":"2024-09-12T12:23:45.872616+0000","last_unstale":"2024-09-12T12:24:59.119982+0000","last_undegraded":"2024-09-12T12:24:59.119982+0000","last_fullsized":"2024-09-12T12:24:59.119982+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:10.960252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"85'3","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.123212+0000","last_change":"2024-09-12T12:23:43.780706+0000","last_active":"2024-09-12T12:24:59.123212+0000","last_peered":"2024-09-12T12:24:59.123212+0000","last_clean":"2024-09-12T12:24:59.123212+0000","last_became_active":"2024-09-12T12:23:43.780387+0000","last_became_peered":"2024-09-12T12:23:43.780387+0000","last_unstale":"2024-09-12T12:24:59.123212+0000","last_undegraded":"2024-09-12T12:24:59.123212+0000","last_fullsized":"2024-09-12T12:24:59.123212+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:54.748461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.124812+0000","last_change":"2024-09-12T12:23:52.902225+0000","last_active":"2024-09-12T12:24:59.124812+0000","last_peered":"2024-09-12T12:24:59.124812+0000","last_clean":"2024-09-12T12:24:59.124812+0000","last_became_active":"2024-09-12T12:23:52.901865+0000","last_became_peered":"2024-09-12T12:23:52.901865+0000","last_unstale":"2024-09-12T12:24:59.124812+0000","last_undegraded":"2024-09-12T12:24:59.124812+0000","last_fullsized":"2024-09-12T12:24:59.124812+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:38.020994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.122256+0000","last_change":"2024-09-12T12:23:45.875816+0000","last_active":"2024-09-12T12:24:59.122256+0000","last_peered":"2024-09-12T12:24:59.122256+0000","last_clean":"2024-09-12T12:24:59.122256+0000","last_became_active":"2024-09-12T12:23:45.875419+0000","last_became_peered":"2024-09-12T12:23:45.875419+0000","last_unstale":"2024-09-12T12:24:59.122256+0000","last_undegraded":"2024-09-12T12:24:59.122256+0000","last_fullsized":"2024-09-12T12:24:59.122256+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:14:04.616759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.122766+0000","last_change":"2024-09-12T12:23:43.836699+0000","last_active":"2024-09-12T12:24:59.122766+0000","last_peered":"2024-09-12T12:24:59.122766+0000","last_clean":"2024-09-12T12:24:59.122766+0000","last_became_active":"2024-09-12T12:23:43.836341+0000","last_became_peered":"2024-09-12T12:23:43.836341+0000","last_unstale":"2024-09-12T12:24:59.122766+0000","last_undegraded":"2024-09-12T12:24:59.122766+0000","last_fullsized":"2024-09-12T12:24:59.122766+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:40:02.767132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.124205+0000","last_change":"2024-09-12T12:23:52.933594+0000","last_active":"2024-09-12T12:24:59.124205+0000","last_peered":"2024-09-12T12:24:59.124205+0000","last_clean":"2024-09-12T12:24:59.124205+0000","last_became_active":"2024-09-12T12:23:52.933197+0000","last_became_peered":"2024-09-12T12:23:52.933197+0000","last_unstale":"2024-09-12T12:24:59.124205+0000","last_undegraded":"2024-09-12T12:24:59.124205+0000","last_fullsized":"2024-09-12T12:24:59.124205+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:34.990674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120067+0000","last_change":"2024-09-12T12:23:45.881962+0000","last_active":"2024-09-12T12:24:59.120067+0000","last_peered":"2024-09-12T12:24:59.120067+0000","last_clean":"2024-09-12T12:24:59.120067+0000","last_became_active":"2024-09-12T12:23:45.881697+0000","last_became_peered":"2024-09-12T12:23:45.881697+0000","last_unstale":"2024-09-12T12:24:59.120067+0000","last_undegraded":"2024-09-12T12:24:59.120067+0000","last_fullsized":"2024-09-12T12:24:59.120067+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:35:49.369852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.124775+0000","last_change":"2024-09-12T12:23:44.235206+0000","last_active":"2024-09-12T12:24:59.124775+0000","last_peered":"2024-09-12T12:24:59.124775+0000","last_clean":"2024-09-12T12:24:59.124775+0000","last_became_active":"2024-09-12T12:23:44.234797+0000","last_became_peered":"2024-09-12T12:23:44.234797+0000","last_unstale":"2024-09-12T12:24:59.124775+0000","last_undegraded":"2024-09-12T12:24:59.124775+0000","last_fullsized":"2024-09-12T12:24:59.124775+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:51.130077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.121852+0000","last_change":"2024-09-12T12:23:52.902763+0000","last_active":"2024-09-12T12:24:59.121852+0000","last_peered":"2024-09-12T12:24:59.121852+0000","last_clean":"2024-09-12T12:24:59.121852+0000","last_became_active":"2024-09-12T12:23:52.902362+0000","last_became_peered":"2024-09-12T12:23:52.902362+0000","last_unstale":"2024-09-12T12:24:59.121852+0000","last_undegraded":"2024-09-12T12:24:59.121852+0000","last_fullsized":"2024-09-12T12:24:59.121852+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:39.481290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.124227+0000","last_change":"2024-09-12T12:23:45.875014+0000","last_active":"2024-09-12T12:24:59.124227+0000","last_peered":"2024-09-12T12:24:59.124227+0000","last_clean":"2024-09-12T12:24:59.124227+0000","last_became_active":"2024-09-12T12:23:45.874673+0000","last_became_peered":"2024-09-12T12:23:45.874673+0000","last_unstale":"2024-09-12T12:24:59.124227+0000","last_undegraded":"2024-09-12T12:24:59.124227+0000","last_fullsized":"2024-09-12T12:24:59.124227+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:21.035185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"85'12","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.124965+0000","last_change":"2024-09-12T12:23:43.778558+0000","last_active":"2024-09-12T12:24:59.124965+0000","last_peered":"2024-09-12T12:24:59.124965+0000","last_clean":"2024-09-12T12:24:59.124965+0000","last_became_active":"2024-09-12T12:23:43.778194+0000","last_became_peered":"2024-09-12T12:23:43.778194+0000","last_unstale":"2024-09-12T12:24:59.124965+0000","last_undegraded":"2024-09-12T12:24:59.124965+0000","last_fullsized":"2024-09-12T12:24:59.124965+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:11.625462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.122733+0000","last_change":"2024-09-12T12:23:52.933833+0000","last_active":"2024-09-12T12:24:59.122733+0000","last_peered":"2024-09-12T12:24:59.122733+0000","last_clean":"2024-09-12T12:24:59.122733+0000","last_became_active":"2024-09-12T12:23:52.933330+0000","last_became_peered":"2024-09-12T12:23:52.933330+0000","last_unstale":"2024-09-12T12:24:59.122733+0000","last_undegraded":"2024-09-12T12:24:59.122733+0000","last_fullsized":"2024-09-12T12:24:59.122733+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:31.129088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.122181+0000","last_change":"2024-09-12T12:23:45.872527+0000","last_active":"2024-09-12T12:24:59.122181+0000","last_peered":"2024-09-12T12:24:59.122181+0000","last_clean":"2024-09-12T12:24:59.122181+0000","last_became_active":"2024-09-12T12:23:45.872220+0000","last_became_peered":"2024-09-12T12:23:45.872220+0000","last_unstale":"2024-09-12T12:24:59.122181+0000","last_undegraded":"2024-09-12T12:24:59.122181+0000","last_fullsized":"2024-09-12T12:24:59.122181+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:38:08.734145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"85'1","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.123645+0000","last_change":"2024-09-12T12:23:43.835824+0000","last_active":"2024-09-12T12:24:59.123645+0000","last_peered":"2024-09-12T12:24:59.123645+0000","last_clean":"2024-09-12T12:24:59.123645+0000","last_became_active":"2024-09-12T12:23:43.835375+0000","last_became_peered":"2024-09-12T12:23:43.835375+0000","last_unstale":"2024-09-12T12:24:59.123645+0000","last_undegraded":"2024-09-12T12:24:59.123645+0000","last_fullsized":"2024-09-12T12:24:59.123645+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:58:57.547060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120258+0000","last_change":"2024-09-12T12:23:52.901739+0000","last_active":"2024-09-12T12:24:59.120258+0000","last_peered":"2024-09-12T12:24:59.120258+0000","last_clean":"2024-09-12T12:24:59.120258+0000","last_became_active":"2024-09-12T12:23:52.901370+0000","last_became_peered":"2024-09-12T12:23:52.901370+0000","last_unstale":"2024-09-12T12:24:59.120258+0000","last_undegraded":"2024-09-12T12:24:59.120258+0000","last_fullsized":"2024-09-12T12:24:59.120258+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:56:44.430446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.174273+0000","last_change":"2024-09-12T12:23:45.870491+0000","last_active":"2024-09-12T12:24:59.174273+0000","last_peered":"2024-09-12T12:24:59.174273+0000","last_clean":"2024-09-12T12:24:59.174273+0000","last_became_active":"2024-09-12T12:23:45.870182+0000","last_became_peered":"2024-09-12T12:23:45.870182+0000","last_unstale":"2024-09-12T12:24:59.174273+0000","last_undegraded":"2024-09-12T12:24:59.174273+0000","last_fullsized":"2024-09-12T12:24:59.174273+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:07.094287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.124538+0000","last_change":"2024-09-12T12:23:43.837430+0000","last_active":"2024-09-12T12:24:59.124538+0000","last_peered":"2024-09-12T12:24:59.124538+0000","last_clean":"2024-09-12T12:24:59.124538+0000","last_became_active":"2024-09-12T12:23:43.837091+0000","last_became_peered":"2024-09-12T12:23:43.837091+0000","last_unstale":"2024-09-12T12:24:59.124538+0000","last_undegraded":"2024-09-12T12:24:59.124538+0000","last_fullsized":"2024-09-12T12:24:59.124538+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:30.841341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.175376+0000","last_change":"2024-09-12T12:24:59.175376+0000","last_active":"2024-09-12T12:24:59.175376+0000","last_peered":"2024-09-12T12:24:59.175376+0000","last_clean":"2024-09-12T12:24:59.175376+0000","last_became_active":"2024-09-12T12:24:59.174967+0000","last_became_peered":"2024-09-12T12:24:59.174967+0000","last_unstale":"2024-09-12T12:24:59.175376+0000","last_undegraded":"2024-09-12T12:24:59.175376+0000","last_fullsized":"2024-09-12T12:24:59.175376+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:40.039227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.174065+0000","last_change":"2024-09-12T12:23:45.876159+0000","last_active":"2024-09-12T12:24:59.174065+0000","last_peered":"2024-09-12T12:24:59.174065+0000","last_clean":"2024-09-12T12:24:59.174065+0000","last_became_active":"2024-09-12T12:23:45.875771+0000","last_became_peered":"2024-09-12T12:23:45.875771+0000","last_unstale":"2024-09-12T12:24:59.174065+0000","last_undegraded":"2024-09-12T12:24:59.174065+0000","last_fullsized":"2024-09-12T12:24:59.174065+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:55.699099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'1","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120605+0000","last_change":"2024-09-12T12:23:43.787082+0000","last_active":"2024-09-12T12:24:59.120605+0000","last_peered":"2024-09-12T12:24:59.120605+0000","last_clean":"2024-09-12T12:24:59.120605+0000","last_became_active":"2024-09-12T12:23:43.786619+0000","last_became_peered":"2024-09-12T12:23:43.786619+0000","last_unstale":"2024-09-12T12:24:59.120605+0000","last_undegraded":"2024-09-12T12:24:59.120605+0000","last_fullsized":"2024-09-12T12:24:59.120605+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:21.120020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.121984+0000","last_change":"2024-09-12T12:23:52.899659+0000","last_active":"2024-09-12T12:24:59.121984+0000","last_peered":"2024-09-12T12:24:59.121984+0000","last_clean":"2024-09-12T12:24:59.121984+0000","last_became_active":"2024-09-12T12:23:52.899226+0000","last_became_peered":"2024-09-12T12:23:52.899226+0000","last_unstale":"2024-09-12T12:24:59.121984+0000","last_undegraded":"2024-09-12T12:24:59.121984+0000","last_fullsized":"2024-09-12T12:24:59.121984+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:41.979174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.125261+0000","last_change":"2024-09-12T12:23:45.879112+0000","last_active":"2024-09-12T12:24:59.125261+0000","last_peered":"2024-09-12T12:24:59.125261+0000","last_clean":"2024-09-12T12:24:59.125261+0000","last_became_active":"2024-09-12T12:23:45.878684+0000","last_became_peered":"2024-09-12T12:23:45.878684+0000","last_unstale":"2024-09-12T12:24:59.125261+0000","last_undegraded":"2024-09-12T12:24:59.125261+0000","last_fullsized":"2024-09-12T12:24:59.125261+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:11:18.102437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'4","reported_seq":91,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:25:19.871010+0000","last_change":"2024-09-12T12:23:43.835282+0000","last_active":"2024-09-12T12:25:19.871010+0000","last_peered":"2024-09-12T12:25:19.871010+0000","last_clean":"2024-09-12T12:25:19.871010+0000","last_became_active":"2024-09-12T12:23:43.834929+0000","last_became_peered":"2024-09-12T12:23:43.834929+0000","last_unstale":"2024-09-12T12:25:19.871010+0000","last_undegraded":"2024-09-12T12:25:19.871010+0000","last_fullsized":"2024-09-12T12:25:19.871010+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:59:11.516387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.122309+0000","last_change":"2024-09-12T12:23:52.934077+0000","last_active":"2024-09-12T12:24:59.122309+0000","last_peered":"2024-09-12T12:24:59.122309+0000","last_clean":"2024-09-12T12:24:59.122309+0000","last_became_active":"2024-09-12T12:23:52.933583+0000","last_became_peered":"2024-09-12T12:23:52.933583+0000","last_unstale":"2024-09-12T12:24:59.122309+0000","last_undegraded":"2024-09-12T12:24:59.122309+0000","last_fullsized":"2024-09-12T12:24:59.122309+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:06.570624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.121172+0000","last_change":"2024-09-12T12:23:45.875735+0000","last_active":"2024-09-12T12:24:59.121172+0000","last_peered":"2024-09-12T12:24:59.121172+0000","last_clean":"2024-09-12T12:24:59.121172+0000","last_became_active":"2024-09-12T12:23:45.875072+0000","last_became_peered":"2024-09-12T12:23:45.875072+0000","last_unstale":"2024-09-12T12:24:59.121172+0000","last_undegraded":"2024-09-12T12:24:59.121172+0000","last_fullsized":"2024-09-12T12:24:59.121172+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:10.508123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'3","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120202+0000","last_change":"2024-09-12T12:23:43.785226+0000","last_active":"2024-09-12T12:24:59.120202+0000","last_peered":"2024-09-12T12:24:59.120202+0000","last_clean":"2024-09-12T12:24:59.120202+0000","last_became_active":"2024-09-12T12:23:43.783705+0000","last_became_peered":"2024-09-12T12:23:43.783705+0000","last_unstale":"2024-09-12T12:24:59.120202+0000","last_undegraded":"2024-09-12T12:24:59.120202+0000","last_fullsized":"2024-09-12T12:24:59.120202+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:21.269569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.126947+0000","last_change":"2024-09-12T12:23:52.934383+0000","last_active":"2024-09-12T12:24:59.126947+0000","last_peered":"2024-09-12T12:24:59.126947+0000","last_clean":"2024-09-12T12:24:59.126947+0000","last_became_active":"2024-09-12T12:23:52.933744+0000","last_became_peered":"2024-09-12T12:23:52.933744+0000","last_unstale":"2024-09-12T12:24:59.126947+0000","last_undegraded":"2024-09-12T12:24:59.126947+0000","last_fullsized":"2024-09-12T12:24:59.126947+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:44.656785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.123244+0000","last_change":"2024-09-12T12:23:45.873460+0000","last_active":"2024-09-12T12:24:59.123244+0000","last_peered":"2024-09-12T12:24:59.123244+0000","last_clean":"2024-09-12T12:24:59.123244+0000","last_became_active":"2024-09-12T12:23:45.873188+0000","last_became_peered":"2024-09-12T12:23:45.873188+0000","last_unstale":"2024-09-12T12:24:59.123244+0000","last_undegraded":"2024-09-12T12:24:59.123244+0000","last_fullsized":"2024-09-12T12:24:59.123244+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:18:29.503856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'3","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.124853+0000","last_change":"2024-09-12T12:23:43.781082+0000","last_active":"2024-09-12T12:24:59.124853+0000","last_peered":"2024-09-12T12:24:59.124853+0000","last_clean":"2024-09-12T12:24:59.124853+0000","last_became_active":"2024-09-12T12:23:43.780710+0000","last_became_peered":"2024-09-12T12:23:43.780710+0000","last_unstale":"2024-09-12T12:24:59.124853+0000","last_undegraded":"2024-09-12T12:24:59.124853+0000","last_fullsized":"2024-09-12T12:24:59.124853+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:13:23.748716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":348,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120440+0000","last_change":"2024-09-12T12:22:37.536326+0000","last_active":"2024-09-12T12:24:59.120440+0000","last_peered":"2024-09-12T12:24:59.120440+0000","last_clean":"2024-09-12T12:24:59.120440+0000","last_became_active":"2024-09-12T12:22:37.535831+0000","last_became_peered":"2024-09-12T12:22:37.535831+0000","last_unstale":"2024-09-12T12:24:59.120440+0000","last_undegraded":"2024-09-12T12:24:59.120440+0000","last_fullsized":"2024-09-12T12:24:59.120440+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:19:12.296434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:19:12.296434+0000","last_clean_scrub_stamp":"2024-09-12T12:19:12.296434+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:04:49.251883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"85'1","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.179285+0000","last_change":"2024-09-12T12:24:59.179285+0000","last_active":"2024-09-12T12:24:59.179285+0000","last_peered":"2024-09-12T12:24:59.179285+0000","last_clean":"2024-09-12T12:24:59.179285+0000","last_became_active":"2024-09-12T12:24:59.175202+0000","last_became_peered":"2024-09-12T12:24:59.175202+0000","last_unstale":"2024-09-12T12:24:59.179285+0000","last_undegraded":"2024-09-12T12:24:59.179285+0000","last_fullsized":"2024-09-12T12:24:59.179285+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:44.993426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,10,11,9],"acting":[7,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120857+0000","last_change":"2024-09-12T12:23:45.883059+0000","last_active":"2024-09-12T12:24:59.120857+0000","last_peered":"2024-09-12T12:24:59.120857+0000","last_clean":"2024-09-12T12:24:59.120857+0000","last_became_active":"2024-09-12T12:23:45.882206+0000","last_became_peered":"2024-09-12T12:23:45.882206+0000","last_unstale":"2024-09-12T12:24:59.120857+0000","last_undegraded":"2024-09-12T12:24:59.120857+0000","last_fullsized":"2024-09-12T12:24:59.120857+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:43.068533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'3","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.122881+0000","last_change":"2024-09-12T12:23:44.235088+0000","last_active":"2024-09-12T12:24:59.122881+0000","last_peered":"2024-09-12T12:24:59.122881+0000","last_clean":"2024-09-12T12:24:59.122881+0000","last_became_active":"2024-09-12T12:23:44.234551+0000","last_became_peered":"2024-09-12T12:23:44.234551+0000","last_unstale":"2024-09-12T12:24:59.122881+0000","last_undegraded":"2024-09-12T12:24:59.122881+0000","last_fullsized":"2024-09-12T12:24:59.122881+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:47.474387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.122638+0000","last_change":"2024-09-12T12:23:52.897807+0000","last_active":"2024-09-12T12:24:59.122638+0000","last_peered":"2024-09-12T12:24:59.122638+0000","last_clean":"2024-09-12T12:24:59.122638+0000","last_became_active":"2024-09-12T12:23:52.897405+0000","last_became_peered":"2024-09-12T12:23:52.897405+0000","last_unstale":"2024-09-12T12:24:59.122638+0000","last_undegraded":"2024-09-12T12:24:59.122638+0000","last_fullsized":"2024-09-12T12:24:59.122638+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:34.714177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120478+0000","last_change":"2024-09-12T12:23:45.873907+0000","last_active":"2024-09-12T12:24:59.120478+0000","last_peered":"2024-09-12T12:24:59.120478+0000","last_clean":"2024-09-12T12:24:59.120478+0000","last_became_active":"2024-09-12T12:23:45.873464+0000","last_became_peered":"2024-09-12T12:23:45.873464+0000","last_unstale":"2024-09-12T12:24:59.120478+0000","last_undegraded":"2024-09-12T12:24:59.120478+0000","last_fullsized":"2024-09-12T12:24:59.120478+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:38:18.151880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.126785+0000","last_change":"2024-09-12T12:23:43.782649+0000","last_active":"2024-09-12T12:24:59.126785+0000","last_peered":"2024-09-12T12:24:59.126785+0000","last_clean":"2024-09-12T12:24:59.126785+0000","last_became_active":"2024-09-12T12:23:43.782290+0000","last_became_peered":"2024-09-12T12:23:43.782290+0000","last_unstale":"2024-09-12T12:24:59.126785+0000","last_undegraded":"2024-09-12T12:24:59.126785+0000","last_fullsized":"2024-09-12T12:24:59.126785+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:30:56.964121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.119522+0000","last_change":"2024-09-12T12:23:52.905108+0000","last_active":"2024-09-12T12:24:59.119522+0000","last_peered":"2024-09-12T12:24:59.119522+0000","last_clean":"2024-09-12T12:24:59.119522+0000","last_became_active":"2024-09-12T12:23:52.904664+0000","last_became_peered":"2024-09-12T12:23:52.904664+0000","last_unstale":"2024-09-12T12:24:59.119522+0000","last_undegraded":"2024-09-12T12:24:59.119522+0000","last_fullsized":"2024-09-12T12:24:59.119522+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:11.177971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120693+0000","last_change":"2024-09-12T12:23:45.875244+0000","last_active":"2024-09-12T12:24:59.120693+0000","last_peered":"2024-09-12T12:24:59.120693+0000","last_clean":"2024-09-12T12:24:59.120693+0000","last_became_active":"2024-09-12T12:23:45.874889+0000","last_became_peered":"2024-09-12T12:23:45.874889+0000","last_unstale":"2024-09-12T12:24:59.120693+0000","last_undegraded":"2024-09-12T12:24:59.120693+0000","last_fullsized":"2024-09-12T12:24:59.120693+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:30:38.192162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.122568+0000","last_change":"2024-09-12T12:23:43.783232+0000","last_active":"2024-09-12T12:24:59.122568+0000","last_peered":"2024-09-12T12:24:59.122568+0000","last_clean":"2024-09-12T12:24:59.122568+0000","last_became_active":"2024-09-12T12:23:43.782975+0000","last_became_peered":"2024-09-12T12:23:43.782975+0000","last_unstale":"2024-09-12T12:24:59.122568+0000","last_undegraded":"2024-09-12T12:24:59.122568+0000","last_fullsized":"2024-09-12T12:24:59.122568+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:45.096636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.124304+0000","last_change":"2024-09-12T12:23:52.898356+0000","last_active":"2024-09-12T12:24:59.124304+0000","last_peered":"2024-09-12T12:24:59.124304+0000","last_clean":"2024-09-12T12:24:59.124304+0000","last_became_active":"2024-09-12T12:23:52.897868+0000","last_became_peered":"2024-09-12T12:23:52.897868+0000","last_unstale":"2024-09-12T12:24:59.124304+0000","last_undegraded":"2024-09-12T12:24:59.124304+0000","last_fullsized":"2024-09-12T12:24:59.124304+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:16:36.473730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120580+0000","last_change":"2024-09-12T12:23:45.881532+0000","last_active":"2024-09-12T12:24:59.120580+0000","last_peered":"2024-09-12T12:24:59.120580+0000","last_clean":"2024-09-12T12:24:59.120580+0000","last_became_active":"2024-09-12T12:23:45.880895+0000","last_became_peered":"2024-09-12T12:23:45.880895+0000","last_unstale":"2024-09-12T12:24:59.120580+0000","last_undegraded":"2024-09-12T12:24:59.120580+0000","last_fullsized":"2024-09-12T12:24:59.120580+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:09:05.249773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.122902+0000","last_change":"2024-09-12T12:23:43.783436+0000","last_active":"2024-09-12T12:24:59.122902+0000","last_peered":"2024-09-12T12:24:59.122902+0000","last_clean":"2024-09-12T12:24:59.122902+0000","last_became_active":"2024-09-12T12:23:43.782975+0000","last_became_peered":"2024-09-12T12:23:43.782975+0000","last_unstale":"2024-09-12T12:24:59.122902+0000","last_undegraded":"2024-09-12T12:24:59.122902+0000","last_fullsized":"2024-09-12T12:24:59.122902+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:20.840189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.124467+0000","last_change":"2024-09-12T12:23:52.903210+0000","last_active":"2024-09-12T12:24:59.124467+0000","last_peered":"2024-09-12T12:24:59.124467+0000","last_clean":"2024-09-12T12:24:59.124467+0000","last_became_active":"2024-09-12T12:23:52.902832+0000","last_became_peered":"2024-09-12T12:23:52.902832+0000","last_unstale":"2024-09-12T12:24:59.124467+0000","last_undegraded":"2024-09-12T12:24:59.124467+0000","last_fullsized":"2024-09-12T12:24:59.124467+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:46:40.506581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.124894+0000","last_change":"2024-09-12T12:23:45.880314+0000","last_active":"2024-09-12T12:24:59.124894+0000","last_peered":"2024-09-12T12:24:59.124894+0000","last_clean":"2024-09-12T12:24:59.124894+0000","last_became_active":"2024-09-12T12:23:45.879878+0000","last_became_peered":"2024-09-12T12:23:45.879878+0000","last_unstale":"2024-09-12T12:24:59.124894+0000","last_undegraded":"2024-09-12T12:24:59.124894+0000","last_fullsized":"2024-09-12T12:24:59.124894+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:47.197008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"85'15","reported_seq":73,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.142463+0000","last_change":"2024-09-12T12:24:59.142463+0000","last_active":"2024-09-12T12:24:59.142463+0000","last_peered":"2024-09-12T12:24:59.142463+0000","last_clean":"2024-09-12T12:24:59.142463+0000","last_became_active":"2024-09-12T12:24:59.128657+0000","last_became_peered":"2024-09-12T12:24:59.128657+0000","last_unstale":"2024-09-12T12:24:59.142463+0000","last_undegraded":"2024-09-12T12:24:59.142463+0000","last_fullsized":"2024-09-12T12:24:59.142463+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:52.873457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,1],"acting":[8,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.122453+0000","last_change":"2024-09-12T12:23:52.901841+0000","last_active":"2024-09-12T12:24:59.122453+0000","last_peered":"2024-09-12T12:24:59.122453+0000","last_clean":"2024-09-12T12:24:59.122453+0000","last_became_active":"2024-09-12T12:23:52.901469+0000","last_became_peered":"2024-09-12T12:23:52.901469+0000","last_unstale":"2024-09-12T12:24:59.122453+0000","last_undegraded":"2024-09-12T12:24:59.122453+0000","last_fullsized":"2024-09-12T12:24:59.122453+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:40.472980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120099+0000","last_change":"2024-09-12T12:23:45.874026+0000","last_active":"2024-09-12T12:24:59.120099+0000","last_peered":"2024-09-12T12:24:59.120099+0000","last_clean":"2024-09-12T12:24:59.120099+0000","last_became_active":"2024-09-12T12:23:45.873494+0000","last_became_peered":"2024-09-12T12:23:45.873494+0000","last_unstale":"2024-09-12T12:24:59.120099+0000","last_undegraded":"2024-09-12T12:24:59.120099+0000","last_fullsized":"2024-09-12T12:24:59.120099+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:28.870938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'3","reported_seq":92,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:25:20.873648+0000","last_change":"2024-09-12T12:23:43.781866+0000","last_active":"2024-09-12T12:25:20.873648+0000","last_peered":"2024-09-12T12:25:20.873648+0000","last_clean":"2024-09-12T12:25:20.873648+0000","last_became_active":"2024-09-12T12:23:43.781488+0000","last_became_peered":"2024-09-12T12:23:43.781488+0000","last_unstale":"2024-09-12T12:25:20.873648+0000","last_undegraded":"2024-09-12T12:25:20.873648+0000","last_fullsized":"2024-09-12T12:25:20.873648+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:13:28.729199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.124892+0000","last_change":"2024-09-12T12:23:52.903427+0000","last_active":"2024-09-12T12:24:59.124892+0000","last_peered":"2024-09-12T12:24:59.124892+0000","last_clean":"2024-09-12T12:24:59.124892+0000","last_became_active":"2024-09-12T12:23:52.903077+0000","last_became_peered":"2024-09-12T12:23:52.903077+0000","last_unstale":"2024-09-12T12:24:59.124892+0000","last_undegraded":"2024-09-12T12:24:59.124892+0000","last_fullsized":"2024-09-12T12:24:59.124892+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:26:03.409086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120412+0000","last_change":"2024-09-12T12:23:45.873628+0000","last_active":"2024-09-12T12:24:59.120412+0000","last_peered":"2024-09-12T12:24:59.120412+0000","last_clean":"2024-09-12T12:24:59.120412+0000","last_became_active":"2024-09-12T12:23:45.873264+0000","last_became_peered":"2024-09-12T12:23:45.873264+0000","last_unstale":"2024-09-12T12:24:59.120412+0000","last_undegraded":"2024-09-12T12:24:59.120412+0000","last_fullsized":"2024-09-12T12:24:59.120412+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:17:03.257858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"85'3","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.125910+0000","last_change":"2024-09-12T12:23:43.787320+0000","last_active":"2024-09-12T12:24:59.125910+0000","last_peered":"2024-09-12T12:24:59.125910+0000","last_clean":"2024-09-12T12:24:59.125910+0000","last_became_active":"2024-09-12T12:23:43.786937+0000","last_became_peered":"2024-09-12T12:23:43.786937+0000","last_unstale":"2024-09-12T12:24:59.125910+0000","last_undegraded":"2024-09-12T12:24:59.125910+0000","last_fullsized":"2024-09-12T12:24:59.125910+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:19.539586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120807+0000","last_change":"2024-09-12T12:23:52.904582+0000","last_active":"2024-09-12T12:24:59.120807+0000","last_peered":"2024-09-12T12:24:59.120807+0000","last_clean":"2024-09-12T12:24:59.120807+0000","last_became_active":"2024-09-12T12:23:52.904172+0000","last_became_peered":"2024-09-12T12:23:52.904172+0000","last_unstale":"2024-09-12T12:24:59.120807+0000","last_undegraded":"2024-09-12T12:24:59.120807+0000","last_fullsized":"2024-09-12T12:24:59.120807+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:26:14.734098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.121376+0000","last_change":"2024-09-12T12:23:45.878128+0000","last_active":"2024-09-12T12:24:59.121376+0000","last_peered":"2024-09-12T12:24:59.121376+0000","last_clean":"2024-09-12T12:24:59.121376+0000","last_became_active":"2024-09-12T12:23:45.877154+0000","last_became_peered":"2024-09-12T12:23:45.877154+0000","last_unstale":"2024-09-12T12:24:59.121376+0000","last_undegraded":"2024-09-12T12:24:59.121376+0000","last_fullsized":"2024-09-12T12:24:59.121376+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:06.095805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"85'6","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.121997+0000","last_change":"2024-09-12T12:23:43.783586+0000","last_active":"2024-09-12T12:24:59.121997+0000","last_peered":"2024-09-12T12:24:59.121997+0000","last_clean":"2024-09-12T12:24:59.121997+0000","last_became_active":"2024-09-12T12:23:43.783255+0000","last_became_peered":"2024-09-12T12:23:43.783255+0000","last_unstale":"2024-09-12T12:24:59.121997+0000","last_undegraded":"2024-09-12T12:24:59.121997+0000","last_fullsized":"2024-09-12T12:24:59.121997+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:38.609805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.126349+0000","last_change":"2024-09-12T12:23:52.901120+0000","last_active":"2024-09-12T12:24:59.126349+0000","last_peered":"2024-09-12T12:24:59.126349+0000","last_clean":"2024-09-12T12:24:59.126349+0000","last_became_active":"2024-09-12T12:23:52.900700+0000","last_became_peered":"2024-09-12T12:23:52.900700+0000","last_unstale":"2024-09-12T12:24:59.126349+0000","last_undegraded":"2024-09-12T12:24:59.126349+0000","last_fullsized":"2024-09-12T12:24:59.126349+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:18.225867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.123317+0000","last_change":"2024-09-12T12:23:45.878074+0000","last_active":"2024-09-12T12:24:59.123317+0000","last_peered":"2024-09-12T12:24:59.123317+0000","last_clean":"2024-09-12T12:24:59.123317+0000","last_became_active":"2024-09-12T12:23:45.877753+0000","last_became_peered":"2024-09-12T12:23:45.877753+0000","last_unstale":"2024-09-12T12:24:59.123317+0000","last_undegraded":"2024-09-12T12:24:59.123317+0000","last_fullsized":"2024-09-12T12:24:59.123317+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:15.515609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"85'34","reported_seq":187,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:25:23.164788+0000","last_change":"2024-09-12T12:23:43.787476+0000","last_active":"2024-09-12T12:25:23.164788+0000","last_peered":"2024-09-12T12:25:23.164788+0000","last_clean":"2024-09-12T12:25:23.164788+0000","last_became_active":"2024-09-12T12:23:43.786808+0000","last_became_peered":"2024-09-12T12:23:43.786808+0000","last_unstale":"2024-09-12T12:25:23.164788+0000","last_undegraded":"2024-09-12T12:25:23.164788+0000","last_fullsized":"2024-09-12T12:25:23.164788+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:08:28.046702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64140,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":119,"num_read_kb":121,"num_write":35,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.125469+0000","last_change":"2024-09-12T12:23:52.900089+0000","last_active":"2024-09-12T12:24:59.125469+0000","last_peered":"2024-09-12T12:24:59.125469+0000","last_clean":"2024-09-12T12:24:59.125469+0000","last_became_active":"2024-09-12T12:23:52.899711+0000","last_became_peered":"2024-09-12T12:23:52.899711+0000","last_unstale":"2024-09-12T12:24:59.125469+0000","last_undegraded":"2024-09-12T12:24:59.125469+0000","last_fullsized":"2024-09-12T12:24:59.125469+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:58:38.850382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.123076+0000","last_change":"2024-09-12T12:23:45.876773+0000","last_active":"2024-09-12T12:24:59.123076+0000","last_peered":"2024-09-12T12:24:59.123076+0000","last_clean":"2024-09-12T12:24:59.123076+0000","last_became_active":"2024-09-12T12:23:45.876394+0000","last_became_peered":"2024-09-12T12:23:45.876394+0000","last_unstale":"2024-09-12T12:24:59.123076+0000","last_undegraded":"2024-09-12T12:24:59.123076+0000","last_fullsized":"2024-09-12T12:24:59.123076+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:55.468779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"85'4","reported_seq":39,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.126665+0000","last_change":"2024-09-12T12:23:43.835826+0000","last_active":"2024-09-12T12:24:59.126665+0000","last_peered":"2024-09-12T12:24:59.126665+0000","last_clean":"2024-09-12T12:24:59.126665+0000","last_became_active":"2024-09-12T12:23:43.835378+0000","last_became_peered":"2024-09-12T12:23:43.835378+0000","last_unstale":"2024-09-12T12:24:59.126665+0000","last_undegraded":"2024-09-12T12:24:59.126665+0000","last_fullsized":"2024-09-12T12:24:59.126665+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:23.429407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.129183+0000","last_change":"2024-09-12T12:24:59.129183+0000","last_active":"2024-09-12T12:24:59.129183+0000","last_peered":"2024-09-12T12:24:59.129183+0000","last_clean":"2024-09-12T12:24:59.129183+0000","last_became_active":"2024-09-12T12:24:59.128649+0000","last_became_peered":"2024-09-12T12:24:59.128649+0000","last_unstale":"2024-09-12T12:24:59.129183+0000","last_undegraded":"2024-09-12T12:24:59.129183+0000","last_fullsized":"2024-09-12T12:24:59.129183+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:58.630436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120344+0000","last_change":"2024-09-12T12:23:45.875222+0000","last_active":"2024-09-12T12:24:59.120344+0000","last_peered":"2024-09-12T12:24:59.120344+0000","last_clean":"2024-09-12T12:24:59.120344+0000","last_became_active":"2024-09-12T12:23:45.874859+0000","last_became_peered":"2024-09-12T12:23:45.874859+0000","last_unstale":"2024-09-12T12:24:59.120344+0000","last_undegraded":"2024-09-12T12:24:59.120344+0000","last_fullsized":"2024-09-12T12:24:59.120344+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:29:00.017470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"85'2","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120804+0000","last_change":"2024-09-12T12:23:43.788052+0000","last_active":"2024-09-12T12:24:59.120804+0000","last_peered":"2024-09-12T12:24:59.120804+0000","last_clean":"2024-09-12T12:24:59.120804+0000","last_became_active":"2024-09-12T12:23:43.787533+0000","last_became_peered":"2024-09-12T12:23:43.787533+0000","last_unstale":"2024-09-12T12:24:59.120804+0000","last_undegraded":"2024-09-12T12:24:59.120804+0000","last_fullsized":"2024-09-12T12:24:59.120804+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:32.042395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.123829+0000","last_change":"2024-09-12T12:23:52.900856+0000","last_active":"2024-09-12T12:24:59.123829+0000","last_peered":"2024-09-12T12:24:59.123829+0000","last_clean":"2024-09-12T12:24:59.123829+0000","last_became_active":"2024-09-12T12:23:52.900444+0000","last_became_peered":"2024-09-12T12:23:52.900444+0000","last_unstale":"2024-09-12T12:24:59.123829+0000","last_undegraded":"2024-09-12T12:24:59.123829+0000","last_fullsized":"2024-09-12T12:24:59.123829+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:52:22.443801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.123287+0000","last_change":"2024-09-12T12:23:45.869666+0000","last_active":"2024-09-12T12:24:59.123287+0000","last_peered":"2024-09-12T12:24:59.123287+0000","last_clean":"2024-09-12T12:24:59.123287+0000","last_became_active":"2024-09-12T12:23:45.869308+0000","last_became_peered":"2024-09-12T12:23:45.869308+0000","last_unstale":"2024-09-12T12:24:59.123287+0000","last_undegraded":"2024-09-12T12:24:59.123287+0000","last_fullsized":"2024-09-12T12:24:59.123287+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:37:47.895807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"85'3","reported_seq":92,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:25:22.163466+0000","last_change":"2024-09-12T12:23:43.786124+0000","last_active":"2024-09-12T12:25:22.163466+0000","last_peered":"2024-09-12T12:25:22.163466+0000","last_clean":"2024-09-12T12:25:22.163466+0000","last_became_active":"2024-09-12T12:23:43.785772+0000","last_became_peered":"2024-09-12T12:23:43.785772+0000","last_unstale":"2024-09-12T12:25:22.163466+0000","last_undegraded":"2024-09-12T12:25:22.163466+0000","last_fullsized":"2024-09-12T12:25:22.163466+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:23.458792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":55,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.122973+0000","last_change":"2024-09-12T12:23:52.905541+0000","last_active":"2024-09-12T12:24:59.122973+0000","last_peered":"2024-09-12T12:24:59.122973+0000","last_clean":"2024-09-12T12:24:59.122973+0000","last_became_active":"2024-09-12T12:23:52.905165+0000","last_became_peered":"2024-09-12T12:23:52.905165+0000","last_unstale":"2024-09-12T12:24:59.122973+0000","last_undegraded":"2024-09-12T12:24:59.122973+0000","last_fullsized":"2024-09-12T12:24:59.122973+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:40.831208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.119944+0000","last_change":"2024-09-12T12:23:52.901738+0000","last_active":"2024-09-12T12:24:59.119944+0000","last_peered":"2024-09-12T12:24:59.119944+0000","last_clean":"2024-09-12T12:24:59.119944+0000","last_became_active":"2024-09-12T12:23:52.901348+0000","last_became_peered":"2024-09-12T12:23:52.901348+0000","last_unstale":"2024-09-12T12:24:59.119944+0000","last_undegraded":"2024-09-12T12:24:59.119944+0000","last_fullsized":"2024-09-12T12:24:59.119944+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:16:24.075130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.124431+0000","last_change":"2024-09-12T12:23:45.869431+0000","last_active":"2024-09-12T12:24:59.124431+0000","last_peered":"2024-09-12T12:24:59.124431+0000","last_clean":"2024-09-12T12:24:59.124431+0000","last_became_active":"2024-09-12T12:23:45.869078+0000","last_became_peered":"2024-09-12T12:23:45.869078+0000","last_unstale":"2024-09-12T12:24:59.124431+0000","last_undegraded":"2024-09-12T12:24:59.124431+0000","last_fullsized":"2024-09-12T12:24:59.124431+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:37:19.849489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"85'1","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.125423+0000","last_change":"2024-09-12T12:23:43.787852+0000","last_active":"2024-09-12T12:24:59.125423+0000","last_peered":"2024-09-12T12:24:59.125423+0000","last_clean":"2024-09-12T12:24:59.125423+0000","last_became_active":"2024-09-12T12:23:43.787531+0000","last_became_peered":"2024-09-12T12:23:43.787531+0000","last_unstale":"2024-09-12T12:24:59.125423+0000","last_undegraded":"2024-09-12T12:24:59.125423+0000","last_fullsized":"2024-09-12T12:24:59.125423+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:25.499020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120125+0000","last_change":"2024-09-12T12:23:52.904603+0000","last_active":"2024-09-12T12:24:59.120125+0000","last_peered":"2024-09-12T12:24:59.120125+0000","last_clean":"2024-09-12T12:24:59.120125+0000","last_became_active":"2024-09-12T12:23:52.904146+0000","last_became_peered":"2024-09-12T12:23:52.904146+0000","last_unstale":"2024-09-12T12:24:59.120125+0000","last_undegraded":"2024-09-12T12:24:59.120125+0000","last_fullsized":"2024-09-12T12:24:59.120125+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:01.847489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.123015+0000","last_change":"2024-09-12T12:23:45.880381+0000","last_active":"2024-09-12T12:24:59.123015+0000","last_peered":"2024-09-12T12:24:59.123015+0000","last_clean":"2024-09-12T12:24:59.123015+0000","last_became_active":"2024-09-12T12:23:45.879865+0000","last_became_peered":"2024-09-12T12:23:45.879865+0000","last_unstale":"2024-09-12T12:24:59.123015+0000","last_undegraded":"2024-09-12T12:24:59.123015+0000","last_fullsized":"2024-09-12T12:24:59.123015+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:52.033891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"85'2","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.121205+0000","last_change":"2024-09-12T12:23:43.782166+0000","last_active":"2024-09-12T12:24:59.121205+0000","last_peered":"2024-09-12T12:24:59.121205+0000","last_clean":"2024-09-12T12:24:59.121205+0000","last_became_active":"2024-09-12T12:23:43.781808+0000","last_became_peered":"2024-09-12T12:23:43.781808+0000","last_unstale":"2024-09-12T12:24:59.121205+0000","last_undegraded":"2024-09-12T12:24:59.121205+0000","last_fullsized":"2024-09-12T12:24:59.121205+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:44:03.340842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"85'3","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.174142+0000","last_change":"2024-09-12T12:23:43.784869+0000","last_active":"2024-09-12T12:24:59.174142+0000","last_peered":"2024-09-12T12:24:59.174142+0000","last_clean":"2024-09-12T12:24:59.174142+0000","last_became_active":"2024-09-12T12:23:43.784458+0000","last_became_peered":"2024-09-12T12:23:43.784458+0000","last_unstale":"2024-09-12T12:24:59.174142+0000","last_undegraded":"2024-09-12T12:24:59.174142+0000","last_fullsized":"2024-09-12T12:24:59.174142+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:46.025169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.126134+0000","last_change":"2024-09-12T12:23:45.879258+0000","last_active":"2024-09-12T12:24:59.126134+0000","last_peered":"2024-09-12T12:24:59.126134+0000","last_clean":"2024-09-12T12:24:59.126134+0000","last_became_active":"2024-09-12T12:23:45.878934+0000","last_became_peered":"2024-09-12T12:23:45.878934+0000","last_unstale":"2024-09-12T12:24:59.126134+0000","last_undegraded":"2024-09-12T12:24:59.126134+0000","last_fullsized":"2024-09-12T12:24:59.126134+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:46:06.617621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.121567+0000","last_change":"2024-09-12T12:23:52.906041+0000","last_active":"2024-09-12T12:24:59.121567+0000","last_peered":"2024-09-12T12:24:59.121567+0000","last_clean":"2024-09-12T12:24:59.121567+0000","last_became_active":"2024-09-12T12:23:52.905630+0000","last_became_peered":"2024-09-12T12:23:52.905630+0000","last_unstale":"2024-09-12T12:24:59.121567+0000","last_undegraded":"2024-09-12T12:24:59.121567+0000","last_fullsized":"2024-09-12T12:24:59.121567+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:15.691085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"85'6","reported_seq":109,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:25:21.162769+0000","last_change":"2024-09-12T12:24:59.136007+0000","last_active":"2024-09-12T12:25:21.162769+0000","last_peered":"2024-09-12T12:25:21.162769+0000","last_clean":"2024-09-12T12:25:21.162769+0000","last_became_active":"2024-09-12T12:24:59.128094+0000","last_became_peered":"2024-09-12T12:24:59.128094+0000","last_unstale":"2024-09-12T12:25:21.162769+0000","last_undegraded":"2024-09-12T12:25:21.162769+0000","last_fullsized":"2024-09-12T12:25:21.162769+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:37.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1015,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.123936+0000","last_change":"2024-09-12T12:23:45.868002+0000","last_active":"2024-09-12T12:24:59.123936+0000","last_peered":"2024-09-12T12:24:59.123936+0000","last_clean":"2024-09-12T12:24:59.123936+0000","last_became_active":"2024-09-12T12:23:45.867448+0000","last_became_peered":"2024-09-12T12:23:45.867448+0000","last_unstale":"2024-09-12T12:24:59.123936+0000","last_undegraded":"2024-09-12T12:24:59.123936+0000","last_fullsized":"2024-09-12T12:24:59.123936+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:24:01.805345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.122860+0000","last_change":"2024-09-12T12:23:52.902119+0000","last_active":"2024-09-12T12:24:59.122860+0000","last_peered":"2024-09-12T12:24:59.122860+0000","last_clean":"2024-09-12T12:24:59.122860+0000","last_became_active":"2024-09-12T12:23:52.901681+0000","last_became_peered":"2024-09-12T12:23:52.901681+0000","last_unstale":"2024-09-12T12:24:59.122860+0000","last_undegraded":"2024-09-12T12:24:59.122860+0000","last_fullsized":"2024-09-12T12:24:59.122860+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:42.039729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.119912+0000","last_change":"2024-09-12T12:23:45.879115+0000","last_active":"2024-09-12T12:24:59.119912+0000","last_peered":"2024-09-12T12:24:59.119912+0000","last_clean":"2024-09-12T12:24:59.119912+0000","last_became_active":"2024-09-12T12:23:45.878745+0000","last_became_peered":"2024-09-12T12:23:45.878745+0000","last_unstale":"2024-09-12T12:24:59.119912+0000","last_undegraded":"2024-09-12T12:24:59.119912+0000","last_fullsized":"2024-09-12T12:24:59.119912+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:53.152875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.122327+0000","last_change":"2024-09-12T12:23:45.878444+0000","last_active":"2024-09-12T12:24:59.122327+0000","last_peered":"2024-09-12T12:24:59.122327+0000","last_clean":"2024-09-12T12:24:59.122327+0000","last_became_active":"2024-09-12T12:23:45.878063+0000","last_became_peered":"2024-09-12T12:23:45.878063+0000","last_unstale":"2024-09-12T12:24:59.122327+0000","last_undegraded":"2024-09-12T12:24:59.122327+0000","last_fullsized":"2024-09-12T12:24:59.122327+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:07.928598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.121896+0000","last_change":"2024-09-12T12:23:45.873101+0000","last_active":"2024-09-12T12:24:59.121896+0000","last_peered":"2024-09-12T12:24:59.121896+0000","last_clean":"2024-09-12T12:24:59.121896+0000","last_became_active":"2024-09-12T12:23:45.872373+0000","last_became_peered":"2024-09-12T12:23:45.872373+0000","last_unstale":"2024-09-12T12:24:59.121896+0000","last_undegraded":"2024-09-12T12:24:59.121896+0000","last_fullsized":"2024-09-12T12:24:59.121896+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:47:14.747538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.119630+0000","last_change":"2024-09-12T12:23:45.875315+0000","last_active":"2024-09-12T12:24:59.119630+0000","last_peered":"2024-09-12T12:24:59.119630+0000","last_clean":"2024-09-12T12:24:59.119630+0000","last_became_active":"2024-09-12T12:23:45.874904+0000","last_became_peered":"2024-09-12T12:23:45.874904+0000","last_unstale":"2024-09-12T12:24:59.119630+0000","last_undegraded":"2024-09-12T12:24:59.119630+0000","last_fullsized":"2024-09-12T12:24:59.119630+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:52:44.373937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.126419+0000","last_change":"2024-09-12T12:24:59.126419+0000","last_active":"2024-09-12T12:24:59.126419+0000","last_peered":"2024-09-12T12:24:59.126419+0000","last_clean":"2024-09-12T12:24:59.126419+0000","last_became_active":"2024-09-12T12:24:59.125996+0000","last_became_peered":"2024-09-12T12:24:59.125996+0000","last_unstale":"2024-09-12T12:24:59.126419+0000","last_undegraded":"2024-09-12T12:24:59.126419+0000","last_fullsized":"2024-09-12T12:24:59.126419+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:01.495467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120759+0000","last_change":"2024-09-12T12:23:45.872638+0000","last_active":"2024-09-12T12:24:59.120759+0000","last_peered":"2024-09-12T12:24:59.120759+0000","last_clean":"2024-09-12T12:24:59.120759+0000","last_became_active":"2024-09-12T12:23:45.872299+0000","last_became_peered":"2024-09-12T12:23:45.872299+0000","last_unstale":"2024-09-12T12:24:59.120759+0000","last_undegraded":"2024-09-12T12:24:59.120759+0000","last_fullsized":"2024-09-12T12:24:59.120759+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:27.758613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.123565+0000","last_change":"2024-09-12T12:23:45.877168+0000","last_active":"2024-09-12T12:24:59.123565+0000","last_peered":"2024-09-12T12:24:59.123565+0000","last_clean":"2024-09-12T12:24:59.123565+0000","last_became_active":"2024-09-12T12:23:45.876871+0000","last_became_peered":"2024-09-12T12:23:45.876871+0000","last_unstale":"2024-09-12T12:24:59.123565+0000","last_undegraded":"2024-09-12T12:24:59.123565+0000","last_fullsized":"2024-09-12T12:24:59.123565+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:24.567415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.128436+0000","last_change":"2024-09-12T12:24:59.128436+0000","last_active":"2024-09-12T12:24:59.128436+0000","last_peered":"2024-09-12T12:24:59.128436+0000","last_clean":"2024-09-12T12:24:59.128436+0000","last_became_active":"2024-09-12T12:24:59.128125+0000","last_became_peered":"2024-09-12T12:24:59.128125+0000","last_unstale":"2024-09-12T12:24:59.128436+0000","last_undegraded":"2024-09-12T12:24:59.128436+0000","last_fullsized":"2024-09-12T12:24:59.128436+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:58.903559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.125171+0000","last_change":"2024-09-12T12:23:45.873728+0000","last_active":"2024-09-12T12:24:59.125171+0000","last_peered":"2024-09-12T12:24:59.125171+0000","last_clean":"2024-09-12T12:24:59.125171+0000","last_became_active":"2024-09-12T12:23:45.871831+0000","last_became_peered":"2024-09-12T12:23:45.871831+0000","last_unstale":"2024-09-12T12:24:59.125171+0000","last_undegraded":"2024-09-12T12:24:59.125171+0000","last_fullsized":"2024-09-12T12:24:59.125171+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:48.690705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.123114+0000","last_change":"2024-09-12T12:23:45.873035+0000","last_active":"2024-09-12T12:24:59.123114+0000","last_peered":"2024-09-12T12:24:59.123114+0000","last_clean":"2024-09-12T12:24:59.123114+0000","last_became_active":"2024-09-12T12:23:45.872660+0000","last_became_peered":"2024-09-12T12:23:45.872660+0000","last_unstale":"2024-09-12T12:24:59.123114+0000","last_undegraded":"2024-09-12T12:24:59.123114+0000","last_fullsized":"2024-09-12T12:24:59.123114+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:31.376116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.122929+0000","last_change":"2024-09-12T12:23:45.879754+0000","last_active":"2024-09-12T12:24:59.122929+0000","last_peered":"2024-09-12T12:24:59.122929+0000","last_clean":"2024-09-12T12:24:59.122929+0000","last_became_active":"2024-09-12T12:23:45.879362+0000","last_became_peered":"2024-09-12T12:23:45.879362+0000","last_unstale":"2024-09-12T12:24:59.122929+0000","last_undegraded":"2024-09-12T12:24:59.122929+0000","last_fullsized":"2024-09-12T12:24:59.122929+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:23.587083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.121740+0000","last_change":"2024-09-12T12:23:45.878297+0000","last_active":"2024-09-12T12:24:59.121740+0000","last_peered":"2024-09-12T12:24:59.121740+0000","last_clean":"2024-09-12T12:24:59.121740+0000","last_became_active":"2024-09-12T12:23:45.877127+0000","last_became_peered":"2024-09-12T12:23:45.877127+0000","last_unstale":"2024-09-12T12:24:59.121740+0000","last_undegraded":"2024-09-12T12:24:59.121740+0000","last_fullsized":"2024-09-12T12:24:59.121740+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:54.334325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.121062+0000","last_change":"2024-09-12T12:23:45.879078+0000","last_active":"2024-09-12T12:24:59.121062+0000","last_peered":"2024-09-12T12:24:59.121062+0000","last_clean":"2024-09-12T12:24:59.121062+0000","last_became_active":"2024-09-12T12:23:45.878799+0000","last_became_peered":"2024-09-12T12:23:45.878799+0000","last_unstale":"2024-09-12T12:24:59.121062+0000","last_undegraded":"2024-09-12T12:24:59.121062+0000","last_fullsized":"2024-09-12T12:24:59.121062+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:45.680643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.123023+0000","last_change":"2024-09-12T12:23:45.872739+0000","last_active":"2024-09-12T12:24:59.123023+0000","last_peered":"2024-09-12T12:24:59.123023+0000","last_clean":"2024-09-12T12:24:59.123023+0000","last_became_active":"2024-09-12T12:23:45.871931+0000","last_became_peered":"2024-09-12T12:23:45.871931+0000","last_unstale":"2024-09-12T12:24:59.123023+0000","last_undegraded":"2024-09-12T12:24:59.123023+0000","last_fullsized":"2024-09-12T12:24:59.123023+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:36:30.451737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.124907+0000","last_change":"2024-09-12T12:23:45.876717+0000","last_active":"2024-09-12T12:24:59.124907+0000","last_peered":"2024-09-12T12:24:59.124907+0000","last_clean":"2024-09-12T12:24:59.124907+0000","last_became_active":"2024-09-12T12:23:45.876372+0000","last_became_peered":"2024-09-12T12:23:45.876372+0000","last_unstale":"2024-09-12T12:24:59.124907+0000","last_undegraded":"2024-09-12T12:24:59.124907+0000","last_fullsized":"2024-09-12T12:24:59.124907+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:40:26.905442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120916+0000","last_change":"2024-09-12T12:23:45.877286+0000","last_active":"2024-09-12T12:24:59.120916+0000","last_peered":"2024-09-12T12:24:59.120916+0000","last_clean":"2024-09-12T12:24:59.120916+0000","last_became_active":"2024-09-12T12:23:45.876619+0000","last_became_peered":"2024-09-12T12:23:45.876619+0000","last_unstale":"2024-09-12T12:24:59.120916+0000","last_undegraded":"2024-09-12T12:24:59.120916+0000","last_fullsized":"2024-09-12T12:24:59.120916+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:05.637917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.122551+0000","last_change":"2024-09-12T12:23:45.875244+0000","last_active":"2024-09-12T12:24:59.122551+0000","last_peered":"2024-09-12T12:24:59.122551+0000","last_clean":"2024-09-12T12:24:59.122551+0000","last_became_active":"2024-09-12T12:23:45.874908+0000","last_became_peered":"2024-09-12T12:23:45.874908+0000","last_unstale":"2024-09-12T12:24:59.122551+0000","last_undegraded":"2024-09-12T12:24:59.122551+0000","last_fullsized":"2024-09-12T12:24:59.122551+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:14.314124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.119340+0000","last_change":"2024-09-12T12:23:45.875253+0000","last_active":"2024-09-12T12:24:59.119340+0000","last_peered":"2024-09-12T12:24:59.119340+0000","last_clean":"2024-09-12T12:24:59.119340+0000","last_became_active":"2024-09-12T12:23:45.874936+0000","last_became_peered":"2024-09-12T12:23:45.874936+0000","last_unstale":"2024-09-12T12:24:59.119340+0000","last_undegraded":"2024-09-12T12:24:59.119340+0000","last_fullsized":"2024-09-12T12:24:59.119340+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:28.790546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.119418+0000","last_change":"2024-09-12T12:23:45.880503+0000","last_active":"2024-09-12T12:24:59.119418+0000","last_peered":"2024-09-12T12:24:59.119418+0000","last_clean":"2024-09-12T12:24:59.119418+0000","last_became_active":"2024-09-12T12:23:45.880184+0000","last_became_peered":"2024-09-12T12:23:45.880184+0000","last_unstale":"2024-09-12T12:24:59.119418+0000","last_undegraded":"2024-09-12T12:24:59.119418+0000","last_fullsized":"2024-09-12T12:24:59.119418+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:12.370667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.121570+0000","last_change":"2024-09-12T12:23:45.869762+0000","last_active":"2024-09-12T12:24:59.121570+0000","last_peered":"2024-09-12T12:24:59.121570+0000","last_clean":"2024-09-12T12:24:59.121570+0000","last_became_active":"2024-09-12T12:23:45.867595+0000","last_became_peered":"2024-09-12T12:23:45.867595+0000","last_unstale":"2024-09-12T12:24:59.121570+0000","last_undegraded":"2024-09-12T12:24:59.121570+0000","last_fullsized":"2024-09-12T12:24:59.121570+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:25:19.855969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.124705+0000","last_change":"2024-09-12T12:23:45.874097+0000","last_active":"2024-09-12T12:24:59.124705+0000","last_peered":"2024-09-12T12:24:59.124705+0000","last_clean":"2024-09-12T12:24:59.124705+0000","last_became_active":"2024-09-12T12:23:45.873275+0000","last_became_peered":"2024-09-12T12:23:45.873275+0000","last_unstale":"2024-09-12T12:24:59.124705+0000","last_undegraded":"2024-09-12T12:24:59.124705+0000","last_fullsized":"2024-09-12T12:24:59.124705+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:21.303339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120689+0000","last_change":"2024-09-12T12:23:45.883354+0000","last_active":"2024-09-12T12:24:59.120689+0000","last_peered":"2024-09-12T12:24:59.120689+0000","last_clean":"2024-09-12T12:24:59.120689+0000","last_became_active":"2024-09-12T12:23:45.882673+0000","last_became_peered":"2024-09-12T12:23:45.882673+0000","last_unstale":"2024-09-12T12:24:59.120689+0000","last_undegraded":"2024-09-12T12:24:59.120689+0000","last_fullsized":"2024-09-12T12:24:59.120689+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:42.034857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.174493+0000","last_change":"2024-09-12T12:23:45.876955+0000","last_active":"2024-09-12T12:24:59.174493+0000","last_peered":"2024-09-12T12:24:59.174493+0000","last_clean":"2024-09-12T12:24:59.174493+0000","last_became_active":"2024-09-12T12:23:45.876632+0000","last_became_peered":"2024-09-12T12:23:45.876632+0000","last_unstale":"2024-09-12T12:24:59.174493+0000","last_undegraded":"2024-09-12T12:24:59.174493+0000","last_fullsized":"2024-09-12T12:24:59.174493+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:25.155739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.123449+0000","last_change":"2024-09-12T12:23:45.875166+0000","last_active":"2024-09-12T12:24:59.123449+0000","last_peered":"2024-09-12T12:24:59.123449+0000","last_clean":"2024-09-12T12:24:59.123449+0000","last_became_active":"2024-09-12T12:23:45.874835+0000","last_became_peered":"2024-09-12T12:23:45.874835+0000","last_unstale":"2024-09-12T12:24:59.123449+0000","last_undegraded":"2024-09-12T12:24:59.123449+0000","last_fullsized":"2024-09-12T12:24:59.123449+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:50.014484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.122883+0000","last_change":"2024-09-12T12:23:45.874161+0000","last_active":"2024-09-12T12:24:59.122883+0000","last_peered":"2024-09-12T12:24:59.122883+0000","last_clean":"2024-09-12T12:24:59.122883+0000","last_became_active":"2024-09-12T12:23:45.873846+0000","last_became_peered":"2024-09-12T12:23:45.873846+0000","last_unstale":"2024-09-12T12:24:59.122883+0000","last_undegraded":"2024-09-12T12:24:59.122883+0000","last_fullsized":"2024-09-12T12:24:59.122883+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:09:17.525956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120217+0000","last_change":"2024-09-12T12:23:45.870642+0000","last_active":"2024-09-12T12:24:59.120217+0000","last_peered":"2024-09-12T12:24:59.120217+0000","last_clean":"2024-09-12T12:24:59.120217+0000","last_became_active":"2024-09-12T12:23:45.870006+0000","last_became_peered":"2024-09-12T12:23:45.870006+0000","last_unstale":"2024-09-12T12:24:59.120217+0000","last_undegraded":"2024-09-12T12:24:59.120217+0000","last_fullsized":"2024-09-12T12:24:59.120217+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:43:35.133650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.174065+0000","last_change":"2024-09-12T12:23:45.875174+0000","last_active":"2024-09-12T12:24:59.174065+0000","last_peered":"2024-09-12T12:24:59.174065+0000","last_clean":"2024-09-12T12:24:59.174065+0000","last_became_active":"2024-09-12T12:23:45.874851+0000","last_became_peered":"2024-09-12T12:23:45.874851+0000","last_unstale":"2024-09-12T12:24:59.174065+0000","last_undegraded":"2024-09-12T12:24:59.174065+0000","last_fullsized":"2024-09-12T12:24:59.174065+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:42.565644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.122396+0000","last_change":"2024-09-12T12:23:45.873170+0000","last_active":"2024-09-12T12:24:59.122396+0000","last_peered":"2024-09-12T12:24:59.122396+0000","last_clean":"2024-09-12T12:24:59.122396+0000","last_became_active":"2024-09-12T12:23:45.872814+0000","last_became_peered":"2024-09-12T12:23:45.872814+0000","last_unstale":"2024-09-12T12:24:59.122396+0000","last_undegraded":"2024-09-12T12:24:59.122396+0000","last_fullsized":"2024-09-12T12:24:59.122396+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:36.143107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.124552+0000","last_change":"2024-09-12T12:23:45.874271+0000","last_active":"2024-09-12T12:24:59.124552+0000","last_peered":"2024-09-12T12:24:59.124552+0000","last_clean":"2024-09-12T12:24:59.124552+0000","last_became_active":"2024-09-12T12:23:45.873789+0000","last_became_peered":"2024-09-12T12:23:45.873789+0000","last_unstale":"2024-09-12T12:24:59.124552+0000","last_undegraded":"2024-09-12T12:24:59.124552+0000","last_fullsized":"2024-09-12T12:24:59.124552+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:58.252706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.119781+0000","last_change":"2024-09-12T12:23:45.877236+0000","last_active":"2024-09-12T12:24:59.119781+0000","last_peered":"2024-09-12T12:24:59.119781+0000","last_clean":"2024-09-12T12:24:59.119781+0000","last_became_active":"2024-09-12T12:23:45.876920+0000","last_became_peered":"2024-09-12T12:23:45.876920+0000","last_unstale":"2024-09-12T12:24:59.119781+0000","last_undegraded":"2024-09-12T12:24:59.119781+0000","last_fullsized":"2024-09-12T12:24:59.119781+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:19:19.749103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120011+0000","last_change":"2024-09-12T12:23:45.880480+0000","last_active":"2024-09-12T12:24:59.120011+0000","last_peered":"2024-09-12T12:24:59.120011+0000","last_clean":"2024-09-12T12:24:59.120011+0000","last_became_active":"2024-09-12T12:23:45.880163+0000","last_became_peered":"2024-09-12T12:23:45.880163+0000","last_unstale":"2024-09-12T12:24:59.120011+0000","last_undegraded":"2024-09-12T12:24:59.120011+0000","last_fullsized":"2024-09-12T12:24:59.120011+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:35.496705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T12:24:59.120822+0000","last_change":"2024-09-12T12:23:45.876975+0000","last_active":"2024-09-12T12:24:59.120822+0000","last_peered":"2024-09-12T12:24:59.120822+0000","last_clean":"2024-09-12T12:24:59.120822+0000","last_became_active":"2024-09-12T12:23:45.876501+0000","last_became_peered":"2024-09-12T12:23:45.876501+0000","last_unstale":"2024-09-12T12:24:59.120822+0000","last_undegraded":"2024-09-12T12:24:59.120822+0000","last_fullsized":"2024-09-12T12:24:59.120822+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:15.029566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68143,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":351,"num_read_kb":248,"num_write":170,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1127,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":204429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":286267,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612641,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":958464,"data_stored":492806,"data_compressed":23578,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841573,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28112,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717040,"statfs":{"total":95995035648,"available":95966248960,"internally_reserved":0,"allocated":1110016,"data_stored":1148310,"data_compressed":59976,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005098,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":978944,"data_stored":497138,"data_compressed":23578,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234031,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":974848,"data_stored":492962,"data_compressed":23578,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462964,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1024000,"data_stored":1088873,"data_compressed":59976,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626490,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":954368,"data_stored":488218,"data_compressed":23578,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855423,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32196,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712956,"statfs":{"total":95995035648,"available":95962066944,"internally_reserved":0,"allocated":1028096,"data_stored":1080365,"data_compressed":59976,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018948,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":974848,"data_stored":493883,"data_compressed":23578,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247881,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":966656,"data_stored":488412,"data_compressed":23578,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444110,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32196,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712956,"statfs":{"total":95995035648,"available":95962066944,"internally_reserved":0,"allocated":1032192,"data_stored":552884,"data_compressed":23578,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1032192,"data_stored":552380,"data_compressed":23578,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738455,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36304,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708848,"statfs":{"total":95995035648,"available":95957860352,"internally_reserved":0,"allocated":978944,"data_stored":489606,"data_compressed":23578,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34759,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34759,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34759,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36398,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36398,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36398,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36398,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36398,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":64252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":64756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:25:25.958 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-12T12:25:25.958 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T12:25:25.958 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-12T12:25:25.959 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-12T12:25:26.220 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:26.530 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:26 smithi033 ceph-mon[31246]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:25:26.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:26 smithi043 ceph-mon[34144]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:25:26.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:26 smithi102 ceph-mon[34799]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:25:26.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.732+0000 7f686eac6640 1 -- 172.21.15.33:0/2225083130 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6868106a80 msgr2=0x7f6868106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:26.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.732+0000 7f686eac6640 1 --2- 172.21.15.33:0/2225083130 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6868106a80 0x7f6868106e60 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6858009930 tx=0x7f685802a420 comp rx=0 tx=0).stop 2024-09-12T12:25:26.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.732+0000 7f686eac6640 1 -- 172.21.15.33:0/2225083130 shutdown_connections 2024-09-12T12:25:26.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.732+0000 7f686eac6640 1 --2- 172.21.15.33:0/2225083130 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6868101420 0x7f686810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:26.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.732+0000 7f686eac6640 1 --2- 172.21.15.33:0/2225083130 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6868100a80 0x7f6868100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:26.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.732+0000 7f686eac6640 1 --2- 172.21.15.33:0/2225083130 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6868106a80 0x7f6868106e60 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:26.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.732+0000 7f686eac6640 1 -- 172.21.15.33:0/2225083130 >> 172.21.15.33:0/2225083130 conn(0x7f68680fc7a0 msgr2=0x7f68680febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:26.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.732+0000 7f686eac6640 1 -- 172.21.15.33:0/2225083130 shutdown_connections 2024-09-12T12:25:26.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.732+0000 7f686eac6640 1 -- 172.21.15.33:0/2225083130 wait complete. 2024-09-12T12:25:26.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.733+0000 7f686eac6640 1 Processor -- start 2024-09-12T12:25:26.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.733+0000 7f686eac6640 1 -- start start 2024-09-12T12:25:26.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.733+0000 7f686eac6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6868100a80 0x7f68681991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:26.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.733+0000 7f686eac6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6868101420 0x7f68681996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:26.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.733+0000 7f686eac6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6868106a80 0x7f68681a4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:26.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.733+0000 7f686eac6640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6868110d30 con 0x7f6868100a80 2024-09-12T12:25:26.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.733+0000 7f686eac6640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6868110bb0 con 0x7f6868101420 2024-09-12T12:25:26.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.733+0000 7f686eac6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6868110eb0 con 0x7f6868106a80 2024-09-12T12:25:26.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.733+0000 7f686c862640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6868100a80 0x7f68681991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:26.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.733+0000 7f686c862640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6868100a80 0x7f68681991a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37374/0 (socket says 172.21.15.33:37374) 2024-09-12T12:25:26.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.733+0000 7f686c862640 1 -- 172.21.15.33:0/2557683157 learned_addr learned my addr 172.21.15.33:0/2557683157 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:26.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.733+0000 7f686d063640 1 --2- 172.21.15.33:0/2557683157 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6868106a80 0x7f68681a4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:26.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.733+0000 7f6867fff640 1 --2- 172.21.15.33:0/2557683157 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6868101420 0x7f68681996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:26.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.733+0000 7f686c862640 1 -- 172.21.15.33:0/2557683157 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6868106a80 msgr2=0x7f68681a4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:26.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.733+0000 7f686c862640 1 --2- 172.21.15.33:0/2557683157 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6868106a80 0x7f68681a4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:26.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.734+0000 7f686c862640 1 -- 172.21.15.33:0/2557683157 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6868101420 msgr2=0x7f68681996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:26.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.734+0000 7f686c862640 1 --2- 172.21.15.33:0/2557683157 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6868101420 0x7f68681996e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:26.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.734+0000 7f686c862640 1 -- 172.21.15.33:0/2557683157 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68681a4760 con 0x7f6868100a80 2024-09-12T12:25:26.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.734+0000 7f6867fff640 1 --2- 172.21.15.33:0/2557683157 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6868101420 0x7f68681996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:26.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.734+0000 7f686c862640 1 --2- 172.21.15.33:0/2557683157 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6868100a80 0x7f68681991a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6858004770 tx=0x7f68580042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:26.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.734+0000 7f6865ffb640 1 -- 172.21.15.33:0/2557683157 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685803f070 con 0x7f6868100a80 2024-09-12T12:25:26.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.734+0000 7f6865ffb640 1 -- 172.21.15.33:0/2557683157 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f685803b460 con 0x7f6868100a80 2024-09-12T12:25:26.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.734+0000 7f686eac6640 1 -- 172.21.15.33:0/2557683157 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68681a4930 con 0x7f6868100a80 2024-09-12T12:25:26.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.734+0000 7f6865ffb640 1 -- 172.21.15.33:0/2557683157 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6858035070 con 0x7f6868100a80 2024-09-12T12:25:26.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.734+0000 7f686eac6640 1 -- 172.21.15.33:0/2557683157 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68681a4de0 con 0x7f6868100a80 2024-09-12T12:25:26.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.735+0000 7f686eac6640 1 -- 172.21.15.33:0/2557683157 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6868100ee0 con 0x7f6868100a80 2024-09-12T12:25:26.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.737+0000 7f6865ffb640 1 -- 172.21.15.33:0/2557683157 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f685803b610 con 0x7f6868100a80 2024-09-12T12:25:26.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.737+0000 7f6865ffb640 1 --2- 172.21.15.33:0/2557683157 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f68540a2c90 0x7f68540a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:26.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.737+0000 7f6865ffb640 1 -- 172.21.15.33:0/2557683157 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7f68580efb50 con 0x7f6868100a80 2024-09-12T12:25:26.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.737+0000 7f6867fff640 1 --2- 172.21.15.33:0/2557683157 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f68540a2c90 0x7f68540a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:26.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.738+0000 7f6867fff640 1 --2- 172.21.15.33:0/2557683157 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f68540a2c90 0x7f68540a5150 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f686806b2e0 tx=0x7f6850005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:26.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.740+0000 7f6865ffb640 1 -- 172.21.15.33:0/2557683157 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f68580bc5f0 con 0x7f6868100a80 2024-09-12T12:25:26.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.957+0000 7f686eac6640 1 -- 172.21.15.33:0/2557683157 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f686806ad80 con 0x7f6868100a80 2024-09-12T12:25:26.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.957+0000 7f6865ffb640 1 -- 172.21.15.33:0/2557683157 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f68580bbef0 con 0x7f6868100a80 2024-09-12T12:25:26.958 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:25:26.958 INFO:teuthology.orchestra.run.smithi033.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T12:25:26.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.960+0000 7f686eac6640 1 -- 172.21.15.33:0/2557683157 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f68540a2c90 msgr2=0x7f68540a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:26.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.960+0000 7f686eac6640 1 --2- 172.21.15.33:0/2557683157 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f68540a2c90 0x7f68540a5150 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f686806b2e0 tx=0x7f6850005ec0 comp rx=0 tx=0).stop 2024-09-12T12:25:26.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.960+0000 7f686eac6640 1 -- 172.21.15.33:0/2557683157 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6868100a80 msgr2=0x7f68681991a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:26.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.960+0000 7f686eac6640 1 --2- 172.21.15.33:0/2557683157 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6868100a80 0x7f68681991a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6858004770 tx=0x7f68580042f0 comp rx=0 tx=0).stop 2024-09-12T12:25:26.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.960+0000 7f686eac6640 1 -- 172.21.15.33:0/2557683157 shutdown_connections 2024-09-12T12:25:26.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.960+0000 7f686eac6640 1 --2- 172.21.15.33:0/2557683157 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f68540a2c90 0x7f68540a5150 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:26.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.960+0000 7f686eac6640 1 --2- 172.21.15.33:0/2557683157 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6868106a80 0x7f68681a4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:26.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.960+0000 7f686eac6640 1 --2- 172.21.15.33:0/2557683157 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6868101420 0x7f68681996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:26.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.960+0000 7f686eac6640 1 --2- 172.21.15.33:0/2557683157 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6868100a80 0x7f68681991a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:26.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.960+0000 7f686eac6640 1 -- 172.21.15.33:0/2557683157 >> 172.21.15.33:0/2557683157 conn(0x7f68680fc7a0 msgr2=0x7f68680fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:26.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.960+0000 7f686eac6640 1 -- 172.21.15.33:0/2557683157 shutdown_connections 2024-09-12T12:25:26.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:26.960+0000 7f686eac6640 1 -- 172.21.15.33:0/2557683157 wait complete. 2024-09-12T12:25:27.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:27 smithi043 ceph-mon[34144]: pgmap v331: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T12:25:27.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:27 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/2557683157' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-12T12:25:27.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:27 smithi102 ceph-mon[34799]: pgmap v331: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T12:25:27.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:27 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/2557683157' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-12T12:25:27.665 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:27 smithi033 ceph-mon[31246]: pgmap v331: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T12:25:27.665 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:27 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/2557683157' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-12T12:25:27.695 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-12T12:25:27.696 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:25:27.965 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:28.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.453+0000 7f0c6de18640 1 -- 172.21.15.33:0/3521723576 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c6810c2f0 msgr2=0x7f0c6810e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:28.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.453+0000 7f0c6de18640 1 --2- 172.21.15.33:0/3521723576 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c6810c2f0 0x7f0c6810e790 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0c60009ca0 tx=0x7f0c6002a8c0 comp rx=0 tx=0).stop 2024-09-12T12:25:28.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.453+0000 7f0c6de18640 1 -- 172.21.15.33:0/3521723576 shutdown_connections 2024-09-12T12:25:28.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.453+0000 7f0c6de18640 1 --2- 172.21.15.33:0/3521723576 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c6810c2f0 0x7f0c6810e790 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:28.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.453+0000 7f0c6de18640 1 --2- 172.21.15.33:0/3521723576 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c681037a0 0x7f0c6810bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:28.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.453+0000 7f0c6de18640 1 --2- 172.21.15.33:0/3521723576 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c68102df0 0x7f0c681031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:28.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.453+0000 7f0c6de18640 1 -- 172.21.15.33:0/3521723576 >> 172.21.15.33:0/3521723576 conn(0x7f0c680fc7d0 msgr2=0x7f0c680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:28.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.453+0000 7f0c6de18640 1 -- 172.21.15.33:0/3521723576 shutdown_connections 2024-09-12T12:25:28.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.453+0000 7f0c6de18640 1 -- 172.21.15.33:0/3521723576 wait complete. 2024-09-12T12:25:28.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.453+0000 7f0c6de18640 1 Processor -- start 2024-09-12T12:25:28.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.454+0000 7f0c6de18640 1 -- start start 2024-09-12T12:25:28.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.454+0000 7f0c6de18640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c68102df0 0x7f0c681985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:28.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.454+0000 7f0c6de18640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c681037a0 0x7f0c68198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:28.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.454+0000 7f0c6de18640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c6810c2f0 0x7f0c6819ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:28.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.454+0000 7f0c6de18640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0c68111fc0 con 0x7f0c6810c2f0 2024-09-12T12:25:28.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.454+0000 7f0c6de18640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0c68111e40 con 0x7f0c681037a0 2024-09-12T12:25:28.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.454+0000 7f0c6de18640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0c68112140 con 0x7f0c68102df0 2024-09-12T12:25:28.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.454+0000 7f0c67fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c6810c2f0 0x7f0c6819ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:28.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.454+0000 7f0c677fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c68102df0 0x7f0c681985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:28.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.454+0000 7f0c66ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c681037a0 0x7f0c68198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:28.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.454+0000 7f0c677fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c68102df0 0x7f0c681985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:56892/0 (socket says 172.21.15.33:56892) 2024-09-12T12:25:28.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.454+0000 7f0c677fe640 1 -- 172.21.15.33:0/3751331986 learned_addr learned my addr 172.21.15.33:0/3751331986 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:28.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.455+0000 7f0c66ffd640 1 -- 172.21.15.33:0/3751331986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c68102df0 msgr2=0x7f0c681985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:28.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.455+0000 7f0c66ffd640 1 --2- 172.21.15.33:0/3751331986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c68102df0 0x7f0c681985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:28.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.455+0000 7f0c66ffd640 1 -- 172.21.15.33:0/3751331986 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c6810c2f0 msgr2=0x7f0c6819ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:28.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.455+0000 7f0c66ffd640 1 --2- 172.21.15.33:0/3751331986 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c6810c2f0 0x7f0c6819ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:28.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.455+0000 7f0c66ffd640 1 -- 172.21.15.33:0/3751331986 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c6819d590 con 0x7f0c681037a0 2024-09-12T12:25:28.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.455+0000 7f0c677fe640 1 --2- 172.21.15.33:0/3751331986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c68102df0 0x7f0c681985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:25:28.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.455+0000 7f0c66ffd640 1 --2- 172.21.15.33:0/3751331986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c681037a0 0x7f0c68198b20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c005fd0 tx=0x7f0c5c00dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:28.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.455+0000 7f0c64ff9640 1 -- 172.21.15.33:0/3751331986 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c009c00 con 0x7f0c681037a0 2024-09-12T12:25:28.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.455+0000 7f0c64ff9640 1 -- 172.21.15.33:0/3751331986 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0c5c009da0 con 0x7f0c681037a0 2024-09-12T12:25:28.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.455+0000 7f0c64ff9640 1 -- 172.21.15.33:0/3751331986 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c003e10 con 0x7f0c681037a0 2024-09-12T12:25:28.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.455+0000 7f0c6de18640 1 -- 172.21.15.33:0/3751331986 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c6819d880 con 0x7f0c681037a0 2024-09-12T12:25:28.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.455+0000 7f0c6de18640 1 -- 172.21.15.33:0/3751331986 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c681a5160 con 0x7f0c681037a0 2024-09-12T12:25:28.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.456+0000 7f0c6de18640 1 -- 172.21.15.33:0/3751331986 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c681031d0 con 0x7f0c681037a0 2024-09-12T12:25:28.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.457+0000 7f0c64ff9640 1 -- 172.21.15.33:0/3751331986 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f0c5c004000 con 0x7f0c681037a0 2024-09-12T12:25:28.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.458+0000 7f0c64ff9640 1 --2- 172.21.15.33:0/3751331986 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0c500a2c10 0x7f0c500a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:28.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.458+0000 7f0c677fe640 1 --2- 172.21.15.33:0/3751331986 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0c500a2c10 0x7f0c500a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:28.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.458+0000 7f0c64ff9640 1 -- 172.21.15.33:0/3751331986 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7f0c5c0cef90 con 0x7f0c681037a0 2024-09-12T12:25:28.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.459+0000 7f0c677fe640 1 --2- 172.21.15.33:0/3751331986 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0c500a2c10 0x7f0c500a50d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0c580104e0 tx=0x7f0c5800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:28.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.462+0000 7f0c64ff9640 1 -- 172.21.15.33:0/3751331986 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0c5c017020 con 0x7f0c681037a0 2024-09-12T12:25:28.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.674+0000 7f0c6de18640 1 -- 172.21.15.33:0/3751331986 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0c681072c0 con 0x7f0c681037a0 2024-09-12T12:25:28.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.675+0000 7f0c64ff9640 1 -- 172.21.15.33:0/3751331986 <== mon.2 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11912 (secure 0 0 0) 0x7f0c5c09b9d0 con 0x7f0c681037a0 2024-09-12T12:25:28.676 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:25:28.676 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":24,"btime":"2024-09-12T12:24:30:808296+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3327066342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3327066342},{"type":"v1","addr":"172.21.15.33:6835","nonce":3327066342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/19516401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":19516401},{"type":"v1","addr":"172.21.15.33:6837","nonce":19516401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1260196118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1260196118},{"type":"v1","addr":"172.21.15.33:6839","nonce":1260196118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/4288248356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4288248356},{"type":"v1","addr":"172.21.15.33:6841","nonce":4288248356}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/3051073141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3051073141},{"type":"v1","addr":"172.21.15.43:6833","nonce":3051073141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3282762800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3282762800},{"type":"v1","addr":"172.21.15.43:6835","nonce":3282762800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:23:46.400609+0000","modified":"2024-09-12T12:24:30.590211+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24490,"mds_2":24478},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3051713000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3051713000},{"type":"v1","addr":"172.21.15.102:6833","nonce":3051713000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6837/2472064883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2472064883},{"type":"v1","addr":"172.21.15.43:6837","nonce":2472064883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/1987408860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":1987408860},{"type":"v1","addr":"172.21.15.43:6839","nonce":1987408860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/4179527539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":4179527539},{"type":"v1","addr":"172.21.15.102:6835","nonce":4179527539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/2409953270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2409953270},{"type":"v1","addr":"172.21.15.102:6837","nonce":2409953270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.102:6839/1553271340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":1553271340},{"type":"v1","addr":"172.21.15.102:6839","nonce":1553271340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24499,"qdb_cluster":[24478,24490,24499]},"id":1}]} 2024-09-12T12:25:28.676 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 24 2024-09-12T12:25:28.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.678+0000 7f0c6de18640 1 -- 172.21.15.33:0/3751331986 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0c500a2c10 msgr2=0x7f0c500a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:28.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.678+0000 7f0c6de18640 1 --2- 172.21.15.33:0/3751331986 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0c500a2c10 0x7f0c500a50d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0c580104e0 tx=0x7f0c5800b410 comp rx=0 tx=0).stop 2024-09-12T12:25:28.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.678+0000 7f0c6de18640 1 -- 172.21.15.33:0/3751331986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c681037a0 msgr2=0x7f0c68198b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:28.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.678+0000 7f0c6de18640 1 --2- 172.21.15.33:0/3751331986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c681037a0 0x7f0c68198b20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c005fd0 tx=0x7f0c5c00dde0 comp rx=0 tx=0).stop 2024-09-12T12:25:28.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.679+0000 7f0c6de18640 1 -- 172.21.15.33:0/3751331986 shutdown_connections 2024-09-12T12:25:28.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.679+0000 7f0c6de18640 1 --2- 172.21.15.33:0/3751331986 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0c500a2c10 0x7f0c500a50d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:28.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.679+0000 7f0c6de18640 1 --2- 172.21.15.33:0/3751331986 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c6810c2f0 0x7f0c6819ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:28.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.679+0000 7f0c6de18640 1 --2- 172.21.15.33:0/3751331986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c681037a0 0x7f0c68198b20 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:28.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.679+0000 7f0c6de18640 1 --2- 172.21.15.33:0/3751331986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c68102df0 0x7f0c681985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:28.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.679+0000 7f0c6de18640 1 -- 172.21.15.33:0/3751331986 >> 172.21.15.33:0/3751331986 conn(0x7f0c680fc7d0 msgr2=0x7f0c680fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:28.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.679+0000 7f0c6de18640 1 -- 172.21.15.33:0/3751331986 shutdown_connections 2024-09-12T12:25:28.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:28.679+0000 7f0c6de18640 1 -- 172.21.15.33:0/3751331986 wait complete. 2024-09-12T12:25:29.361 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:25:29.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:29 smithi043 ceph-mon[34144]: pgmap v332: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-12T12:25:29.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:29 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/3751331986' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:25:29.619 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:29.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:29 smithi102 ceph-mon[34799]: pgmap v332: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-12T12:25:29.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:29 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/3751331986' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:25:29.730 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:29 smithi033 ceph-mon[31246]: pgmap v332: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-12T12:25:29.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:29 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/3751331986' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:25:30.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.110+0000 7f4f6924f640 1 -- 172.21.15.33:0/2600405068 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f64102790 msgr2=0x7f4f641067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:30.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.110+0000 7f4f6924f640 1 --2- 172.21.15.33:0/2600405068 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f64102790 0x7f4f641067e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4f58009900 tx=0x7f4f5802a410 comp rx=0 tx=0).stop 2024-09-12T12:25:30.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.110+0000 7f4f6924f640 1 -- 172.21.15.33:0/2600405068 shutdown_connections 2024-09-12T12:25:30.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.110+0000 7f4f6924f640 1 --2- 172.21.15.33:0/2600405068 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f64106f10 0x7f4f6410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:30.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.110+0000 7f4f6924f640 1 --2- 172.21.15.33:0/2600405068 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f64102790 0x7f4f641067e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:30.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.110+0000 7f4f6924f640 1 --2- 172.21.15.33:0/2600405068 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f64101de0 0x7f4f641021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:30.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.110+0000 7f4f6924f640 1 -- 172.21.15.33:0/2600405068 >> 172.21.15.33:0/2600405068 conn(0x7f4f640fd8c0 msgr2=0x7f4f640ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:30.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.110+0000 7f4f6924f640 1 -- 172.21.15.33:0/2600405068 shutdown_connections 2024-09-12T12:25:30.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.110+0000 7f4f6924f640 1 -- 172.21.15.33:0/2600405068 wait complete. 2024-09-12T12:25:30.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.111+0000 7f4f6924f640 1 Processor -- start 2024-09-12T12:25:30.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.111+0000 7f4f6924f640 1 -- start start 2024-09-12T12:25:30.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.111+0000 7f4f6924f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f64101de0 0x7f4f64198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:30.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.111+0000 7f4f6924f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f64102790 0x7f4f641989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:30.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.111+0000 7f4f6924f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f64106f10 0x7f4f6419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:30.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.112+0000 7f4f6924f640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4f64111e60 con 0x7f4f64106f10 2024-09-12T12:25:30.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.112+0000 7f4f6924f640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4f64111ce0 con 0x7f4f64101de0 2024-09-12T12:25:30.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.112+0000 7f4f6924f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4f64111fe0 con 0x7f4f64102790 2024-09-12T12:25:30.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.112+0000 7f4f6359e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f64106f10 0x7f4f6419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:30.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.112+0000 7f4f6359e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f64106f10 0x7f4f6419cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37412/0 (socket says 172.21.15.33:37412) 2024-09-12T12:25:30.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.112+0000 7f4f6359e640 1 -- 172.21.15.33:0/3672423296 learned_addr learned my addr 172.21.15.33:0/3672423296 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:30.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.112+0000 7f4f62d9d640 1 --2- 172.21.15.33:0/3672423296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f64101de0 0x7f4f64198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:30.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.112+0000 7f4f6259c640 1 --2- 172.21.15.33:0/3672423296 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f64102790 0x7f4f641989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:30.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.112+0000 7f4f6359e640 1 -- 172.21.15.33:0/3672423296 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f64102790 msgr2=0x7f4f641989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:30.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.112+0000 7f4f6359e640 1 --2- 172.21.15.33:0/3672423296 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f64102790 0x7f4f641989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:30.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.112+0000 7f4f6359e640 1 -- 172.21.15.33:0/3672423296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f64101de0 msgr2=0x7f4f64198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:30.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.112+0000 7f4f6359e640 1 --2- 172.21.15.33:0/3672423296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f64101de0 0x7f4f64198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:30.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.112+0000 7f4f6359e640 1 -- 172.21.15.33:0/3672423296 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f6419d420 con 0x7f4f64106f10 2024-09-12T12:25:30.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.112+0000 7f4f6259c640 1 --2- 172.21.15.33:0/3672423296 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f64102790 0x7f4f641989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:30.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.112+0000 7f4f6359e640 1 --2- 172.21.15.33:0/3672423296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f64106f10 0x7f4f6419cd40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c00b970 tx=0x7f4f5c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:30.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.113+0000 7f4f4bfff640 1 -- 172.21.15.33:0/3672423296 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c019070 con 0x7f4f64106f10 2024-09-12T12:25:30.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.113+0000 7f4f4bfff640 1 -- 172.21.15.33:0/3672423296 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4f5c014440 con 0x7f4f64106f10 2024-09-12T12:25:30.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.113+0000 7f4f6924f640 1 -- 172.21.15.33:0/3672423296 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f6419d710 con 0x7f4f64106f10 2024-09-12T12:25:30.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.113+0000 7f4f4bfff640 1 -- 172.21.15.33:0/3672423296 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c0075d0 con 0x7f4f64106f10 2024-09-12T12:25:30.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.113+0000 7f4f6924f640 1 -- 172.21.15.33:0/3672423296 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f641a4ff0 con 0x7f4f64106f10 2024-09-12T12:25:30.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.114+0000 7f4f6924f640 1 -- 172.21.15.33:0/3672423296 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f641021c0 con 0x7f4f64106f10 2024-09-12T12:25:30.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.115+0000 7f4f4bfff640 1 -- 172.21.15.33:0/3672423296 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4f5c01c070 con 0x7f4f64106f10 2024-09-12T12:25:30.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.116+0000 7f4f4bfff640 1 --2- 172.21.15.33:0/3672423296 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f4f4c0a2c10 0x7f4f4c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:30.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.116+0000 7f4f62d9d640 1 --2- 172.21.15.33:0/3672423296 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f4f4c0a2c10 0x7f4f4c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:30.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.116+0000 7f4f4bfff640 1 -- 172.21.15.33:0/3672423296 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7f4f5c0ce9f0 con 0x7f4f64106f10 2024-09-12T12:25:30.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.116+0000 7f4f62d9d640 1 --2- 172.21.15.33:0/3672423296 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f4f4c0a2c10 0x7f4f4c0a50d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4f54005fd0 tx=0x7f4f5400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:30.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.120+0000 7f4f4bfff640 1 -- 172.21.15.33:0/3672423296 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4f5c09af50 con 0x7f4f64106f10 2024-09-12T12:25:30.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.332+0000 7f4f6924f640 1 -- 172.21.15.33:0/3672423296 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4f6410a150 con 0x7f4f64106f10 2024-09-12T12:25:30.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.333+0000 7f4f4bfff640 1 -- 172.21.15.33:0/3672423296 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11912 (secure 0 0 0) 0x7f4f5c09f250 con 0x7f4f64106f10 2024-09-12T12:25:30.333 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:25:30.334 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":24,"btime":"2024-09-12T12:24:30:808296+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3327066342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3327066342},{"type":"v1","addr":"172.21.15.33:6835","nonce":3327066342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/19516401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":19516401},{"type":"v1","addr":"172.21.15.33:6837","nonce":19516401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1260196118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1260196118},{"type":"v1","addr":"172.21.15.33:6839","nonce":1260196118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/4288248356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4288248356},{"type":"v1","addr":"172.21.15.33:6841","nonce":4288248356}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/3051073141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3051073141},{"type":"v1","addr":"172.21.15.43:6833","nonce":3051073141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3282762800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3282762800},{"type":"v1","addr":"172.21.15.43:6835","nonce":3282762800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:23:46.400609+0000","modified":"2024-09-12T12:24:30.590211+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24490,"mds_2":24478},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3051713000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3051713000},{"type":"v1","addr":"172.21.15.102:6833","nonce":3051713000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6837/2472064883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2472064883},{"type":"v1","addr":"172.21.15.43:6837","nonce":2472064883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/1987408860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":1987408860},{"type":"v1","addr":"172.21.15.43:6839","nonce":1987408860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/4179527539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":4179527539},{"type":"v1","addr":"172.21.15.102:6835","nonce":4179527539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/2409953270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2409953270},{"type":"v1","addr":"172.21.15.102:6837","nonce":2409953270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.102:6839/1553271340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":1553271340},{"type":"v1","addr":"172.21.15.102:6839","nonce":1553271340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24499,"qdb_cluster":[24478,24490,24499]},"id":1}]} 2024-09-12T12:25:30.334 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 24 2024-09-12T12:25:30.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.335+0000 7f4f6924f640 1 -- 172.21.15.33:0/3672423296 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f4f4c0a2c10 msgr2=0x7f4f4c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:30.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.335+0000 7f4f6924f640 1 --2- 172.21.15.33:0/3672423296 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f4f4c0a2c10 0x7f4f4c0a50d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4f54005fd0 tx=0x7f4f5400b390 comp rx=0 tx=0).stop 2024-09-12T12:25:30.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.335+0000 7f4f6924f640 1 -- 172.21.15.33:0/3672423296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f64106f10 msgr2=0x7f4f6419cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:30.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.335+0000 7f4f6924f640 1 --2- 172.21.15.33:0/3672423296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f64106f10 0x7f4f6419cd40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c00b970 tx=0x7f4f5c00be30 comp rx=0 tx=0).stop 2024-09-12T12:25:30.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.336+0000 7f4f6924f640 1 -- 172.21.15.33:0/3672423296 shutdown_connections 2024-09-12T12:25:30.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.336+0000 7f4f6924f640 1 --2- 172.21.15.33:0/3672423296 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f4f4c0a2c10 0x7f4f4c0a50d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:30.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.336+0000 7f4f6924f640 1 --2- 172.21.15.33:0/3672423296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f64106f10 0x7f4f6419cd40 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:30.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.336+0000 7f4f6924f640 1 --2- 172.21.15.33:0/3672423296 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f64102790 0x7f4f641989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:30.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.336+0000 7f4f6924f640 1 --2- 172.21.15.33:0/3672423296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f64101de0 0x7f4f64198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:30.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.336+0000 7f4f6924f640 1 -- 172.21.15.33:0/3672423296 >> 172.21.15.33:0/3672423296 conn(0x7f4f640fd8c0 msgr2=0x7f4f640fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:30.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.336+0000 7f4f6924f640 1 -- 172.21.15.33:0/3672423296 shutdown_connections 2024-09-12T12:25:30.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:30.336+0000 7f4f6924f640 1 -- 172.21.15.33:0/3672423296 wait complete. 2024-09-12T12:25:31.057 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T12:25:31.320 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:31.581 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:31 smithi033 ceph-mon[31246]: pgmap v333: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T12:25:31.581 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:31 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/3672423296' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:25:31.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:31 smithi043 ceph-mon[34144]: pgmap v333: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T12:25:31.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:31 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/3672423296' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:25:31.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:31 smithi102 ceph-mon[34799]: pgmap v333: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T12:25:31.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:31 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/3672423296' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:25:31.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.811+0000 7f2ab6a3a640 1 -- 172.21.15.33:0/233646884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ab01055b0 msgr2=0x7f2ab010d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:31.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.811+0000 7f2ab6a3a640 1 --2- 172.21.15.33:0/233646884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ab01055b0 0x7f2ab010d130 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2aa800adb0 tx=0x7f2aa802b7a0 comp rx=0 tx=0).stop 2024-09-12T12:25:31.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.811+0000 7f2ab6a3a640 1 -- 172.21.15.33:0/233646884 shutdown_connections 2024-09-12T12:25:31.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.811+0000 7f2ab6a3a640 1 --2- 172.21.15.33:0/233646884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ab01055b0 0x7f2ab010d130 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:31.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.811+0000 7f2ab6a3a640 1 --2- 172.21.15.33:0/233646884 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ab0100e30 0x7f2ab0104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:31.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.811+0000 7f2ab6a3a640 1 --2- 172.21.15.33:0/233646884 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ab0100480 0x7f2ab0100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:31.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.811+0000 7f2ab6a3a640 1 -- 172.21.15.33:0/233646884 >> 172.21.15.33:0/233646884 conn(0x7f2ab0077210 msgr2=0x7f2ab00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:31.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.811+0000 7f2ab6a3a640 1 -- 172.21.15.33:0/233646884 shutdown_connections 2024-09-12T12:25:31.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.811+0000 7f2ab6a3a640 1 -- 172.21.15.33:0/233646884 wait complete. 2024-09-12T12:25:31.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.812+0000 7f2ab6a3a640 1 Processor -- start 2024-09-12T12:25:31.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.812+0000 7f2ab6a3a640 1 -- start start 2024-09-12T12:25:31.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.812+0000 7f2ab6a3a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ab0100480 0x7f2ab0195fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:31.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.812+0000 7f2ab6a3a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ab0100e30 0x7f2ab01964f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:31.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.812+0000 7f2ab6a3a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ab01055b0 0x7f2ab0196a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:31.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.812+0000 7f2ab6a3a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab010fc60 con 0x7f2ab0100e30 2024-09-12T12:25:31.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.812+0000 7f2ab6a3a640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab010fae0 con 0x7f2ab01055b0 2024-09-12T12:25:31.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.812+0000 7f2ab6a3a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab010fde0 con 0x7f2ab0100480 2024-09-12T12:25:31.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.812+0000 7f2aa7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ab0100e30 0x7f2ab01964f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:31.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.812+0000 7f2aa7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ab0100e30 0x7f2ab01964f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45672/0 (socket says 172.21.15.33:45672) 2024-09-12T12:25:31.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.812+0000 7f2aa7fff640 1 -- 172.21.15.33:0/706234216 learned_addr learned my addr 172.21.15.33:0/706234216 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:31.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.812+0000 7f2aaffff640 1 --2- 172.21.15.33:0/706234216 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ab0100480 0x7f2ab0195fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:31.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.812+0000 7f2ab4fd7640 1 --2- 172.21.15.33:0/706234216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ab01055b0 0x7f2ab0196a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:31.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.812+0000 7f2aa7fff640 1 -- 172.21.15.33:0/706234216 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ab0100480 msgr2=0x7f2ab0195fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:31.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.812+0000 7f2aa7fff640 1 --2- 172.21.15.33:0/706234216 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ab0100480 0x7f2ab0195fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:31.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.812+0000 7f2aa7fff640 1 -- 172.21.15.33:0/706234216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ab01055b0 msgr2=0x7f2ab0196a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:31.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.813+0000 7f2aa7fff640 1 --2- 172.21.15.33:0/706234216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ab01055b0 0x7f2ab0196a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:31.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.813+0000 7f2aa7fff640 1 -- 172.21.15.33:0/706234216 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ab01a6850 con 0x7f2ab0100e30 2024-09-12T12:25:31.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.813+0000 7f2ab4fd7640 1 --2- 172.21.15.33:0/706234216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ab01055b0 0x7f2ab0196a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:25:31.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.813+0000 7f2aa7fff640 1 --2- 172.21.15.33:0/706234216 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ab0100e30 0x7f2ab01964f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2a9800d950 tx=0x7f2a9800dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:31.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.813+0000 7f2aadffb640 1 -- 172.21.15.33:0/706234216 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a98017070 con 0x7f2ab0100e30 2024-09-12T12:25:31.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.813+0000 7f2aadffb640 1 -- 172.21.15.33:0/706234216 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2a9800de80 con 0x7f2ab0100e30 2024-09-12T12:25:31.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.813+0000 7f2ab6a3a640 1 -- 172.21.15.33:0/706234216 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ab01a6b40 con 0x7f2ab0100e30 2024-09-12T12:25:31.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.813+0000 7f2aadffb640 1 -- 172.21.15.33:0/706234216 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9800f620 con 0x7f2ab0100e30 2024-09-12T12:25:31.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.813+0000 7f2ab6a3a640 1 -- 172.21.15.33:0/706234216 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ab01a70d0 con 0x7f2ab0100e30 2024-09-12T12:25:31.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.814+0000 7f2ab6a3a640 1 -- 172.21.15.33:0/706234216 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ab0100860 con 0x7f2ab0100e30 2024-09-12T12:25:31.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.815+0000 7f2aadffb640 1 -- 172.21.15.33:0/706234216 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2a98009c30 con 0x7f2ab0100e30 2024-09-12T12:25:31.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.816+0000 7f2aadffb640 1 --2- 172.21.15.33:0/706234216 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2a9c0a2c90 0x7f2a9c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:31.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.816+0000 7f2aaffff640 1 --2- 172.21.15.33:0/706234216 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2a9c0a2c90 0x7f2a9c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:31.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.816+0000 7f2aadffb640 1 -- 172.21.15.33:0/706234216 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7f2a980cf130 con 0x7f2ab0100e30 2024-09-12T12:25:31.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.816+0000 7f2aaffff640 1 --2- 172.21.15.33:0/706234216 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2a9c0a2c90 0x7f2a9c0a5150 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0009990 tx=0x7f2aa0009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:31.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.820+0000 7f2aadffb640 1 -- 172.21.15.33:0/706234216 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2a9809bb70 con 0x7f2ab0100e30 2024-09-12T12:25:31.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.995+0000 7f2ab6a3a640 1 -- 172.21.15.33:0/706234216 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2ab0108200 con 0x7f2ab0100e30 2024-09-12T12:25:31.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.997+0000 7f2aadffb640 1 -- 172.21.15.33:0/706234216 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24670 (secure 0 0 0) 0x7f2a9809b470 con 0x7f2ab0100e30 2024-09-12T12:25:31.998 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:25:31.998 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":87,"fsid":"a66dfafc-7100-11ef-bcea-c7b262605968","created":"2024-09-12T12:16:11.904815+0000","modified":"2024-09-12T12:24:59.115664+0000","last_up_change":"2024-09-12T12:22:57.476185+0000","last_in_change":"2024-09-12T12:22:35.192556+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:19:12.296305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:23:42.509774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:23:44.842852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T12:23:51.308720+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"74b68729-c97c-4da6-a659-75d6c147ad05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6803","nonce":963294466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6805","nonce":963294466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6809","nonce":963294466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6807","nonce":963294466}]},"public_addr":"172.21.15.33:6803/963294466","cluster_addr":"172.21.15.33:6805/963294466","heartbeat_back_addr":"172.21.15.33:6809/963294466","heartbeat_front_addr":"172.21.15.33:6807/963294466","state":["exists","up"]},{"osd":1,"uuid":"2461a388-e110-420b-9404-eb54cd39119e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6801","nonce":2306025171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6803","nonce":2306025171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6807","nonce":2306025171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6805","nonce":2306025171}]},"public_addr":"172.21.15.43:6801/2306025171","cluster_addr":"172.21.15.43:6803/2306025171","heartbeat_back_addr":"172.21.15.43:6807/2306025171","heartbeat_front_addr":"172.21.15.43:6805/2306025171","state":["exists","up"]},{"osd":2,"uuid":"4ba9dd02-977d-45fb-b366-ade15b52232b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6801","nonce":4257223217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6803","nonce":4257223217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6807","nonce":4257223217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6805","nonce":4257223217}]},"public_addr":"172.21.15.102:6801/4257223217","cluster_addr":"172.21.15.102:6803/4257223217","heartbeat_back_addr":"172.21.15.102:6807/4257223217","heartbeat_front_addr":"172.21.15.102:6805/4257223217","state":["exists","up"]},{"osd":3,"uuid":"345aa854-9ea2-4103-a186-9794af34c237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6811","nonce":2483872739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6813","nonce":2483872739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6817","nonce":2483872739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6815","nonce":2483872739}]},"public_addr":"172.21.15.33:6811/2483872739","cluster_addr":"172.21.15.33:6813/2483872739","heartbeat_back_addr":"172.21.15.33:6817/2483872739","heartbeat_front_addr":"172.21.15.33:6815/2483872739","state":["exists","up"]},{"osd":4,"uuid":"32acd6da-01d6-4a8e-9d05-3d394363d6f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6809","nonce":136043101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6811","nonce":136043101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6815","nonce":136043101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6813","nonce":136043101}]},"public_addr":"172.21.15.43:6809/136043101","cluster_addr":"172.21.15.43:6811/136043101","heartbeat_back_addr":"172.21.15.43:6815/136043101","heartbeat_front_addr":"172.21.15.43:6813/136043101","state":["exists","up"]},{"osd":5,"uuid":"dced0037-2da2-48c2-a391-f871d6ceebb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6809","nonce":2605625792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6811","nonce":2605625792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6815","nonce":2605625792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6813","nonce":2605625792}]},"public_addr":"172.21.15.102:6809/2605625792","cluster_addr":"172.21.15.102:6811/2605625792","heartbeat_back_addr":"172.21.15.102:6815/2605625792","heartbeat_front_addr":"172.21.15.102:6813/2605625792","state":["exists","up"]},{"osd":6,"uuid":"46e5532e-026a-4bb2-8847-2a3216e5d7a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6819","nonce":805864618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6821","nonce":805864618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6825","nonce":805864618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6823","nonce":805864618}]},"public_addr":"172.21.15.33:6819/805864618","cluster_addr":"172.21.15.33:6821/805864618","heartbeat_back_addr":"172.21.15.33:6825/805864618","heartbeat_front_addr":"172.21.15.33:6823/805864618","state":["exists","up"]},{"osd":7,"uuid":"c8474ab4-68cd-4475-9429-b54981247ee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6817","nonce":392537201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6819","nonce":392537201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6823","nonce":392537201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6821","nonce":392537201}]},"public_addr":"172.21.15.43:6817/392537201","cluster_addr":"172.21.15.43:6819/392537201","heartbeat_back_addr":"172.21.15.43:6823/392537201","heartbeat_front_addr":"172.21.15.43:6821/392537201","state":["exists","up"]},{"osd":8,"uuid":"e7c2ef28-8c84-44d0-ba6d-7556ec1d02dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6817","nonce":1768219597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6819","nonce":1768219597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6823","nonce":1768219597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6821","nonce":1768219597}]},"public_addr":"172.21.15.102:6817/1768219597","cluster_addr":"172.21.15.102:6819/1768219597","heartbeat_back_addr":"172.21.15.102:6823/1768219597","heartbeat_front_addr":"172.21.15.102:6821/1768219597","state":["exists","up"]},{"osd":9,"uuid":"f2500273-8b21-4984-bc41-cec5cc0c883b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6827","nonce":973136168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6829","nonce":973136168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6833","nonce":973136168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6831","nonce":973136168}]},"public_addr":"172.21.15.33:6827/973136168","cluster_addr":"172.21.15.33:6829/973136168","heartbeat_back_addr":"172.21.15.33:6833/973136168","heartbeat_front_addr":"172.21.15.33:6831/973136168","state":["exists","up"]},{"osd":10,"uuid":"954343c5-5d5b-4c30-acde-82aa695f7b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6825","nonce":248515585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6827","nonce":248515585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6831","nonce":248515585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6829","nonce":248515585}]},"public_addr":"172.21.15.43:6825/248515585","cluster_addr":"172.21.15.43:6827/248515585","heartbeat_back_addr":"172.21.15.43:6831/248515585","heartbeat_front_addr":"172.21.15.43:6829/248515585","state":["exists","up"]},{"osd":11,"uuid":"22b4147b-02ad-4514-be17-5bb395099eef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6825","nonce":2463068013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6827","nonce":2463068013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6831","nonce":2463068013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6829","nonce":2463068013}]},"public_addr":"172.21.15.102:6825/2463068013","cluster_addr":"172.21.15.102:6827/2463068013","heartbeat_back_addr":"172.21.15.102:6831/2463068013","heartbeat_front_addr":"172.21.15.102:6829/2463068013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:19.274804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:44.900294+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:08.885404+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:34.382089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:59.978538+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:25.275179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:49.429847+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:14.974792+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:40.268629+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:22:06.458679+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:22:31.813019+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:22:56.264078+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/3187741548":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6800/1381479235":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6801/1156183797":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/2222991013":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6801/1381479235":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6800/1156183797":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/3450458842":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/202580320":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/2441151017":"2024-09-13T12:16:57.792813+0000","172.21.15.33:0/1001176884":"2024-09-13T12:16:33.559150+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:25:32.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.999+0000 7f2ab6a3a640 1 -- 172.21.15.33:0/706234216 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2a9c0a2c90 msgr2=0x7f2a9c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:32.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.999+0000 7f2ab6a3a640 1 --2- 172.21.15.33:0/706234216 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2a9c0a2c90 0x7f2a9c0a5150 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0009990 tx=0x7f2aa0009110 comp rx=0 tx=0).stop 2024-09-12T12:25:32.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.999+0000 7f2ab6a3a640 1 -- 172.21.15.33:0/706234216 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ab0100e30 msgr2=0x7f2ab01964f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:32.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.999+0000 7f2ab6a3a640 1 --2- 172.21.15.33:0/706234216 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ab0100e30 0x7f2ab01964f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2a9800d950 tx=0x7f2a9800dd50 comp rx=0 tx=0).stop 2024-09-12T12:25:32.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.999+0000 7f2ab6a3a640 1 -- 172.21.15.33:0/706234216 shutdown_connections 2024-09-12T12:25:32.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.999+0000 7f2ab6a3a640 1 --2- 172.21.15.33:0/706234216 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2a9c0a2c90 0x7f2a9c0a5150 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:32.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.999+0000 7f2ab6a3a640 1 --2- 172.21.15.33:0/706234216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ab01055b0 0x7f2ab0196a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:32.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.999+0000 7f2ab6a3a640 1 --2- 172.21.15.33:0/706234216 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ab0100e30 0x7f2ab01964f0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:32.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.999+0000 7f2ab6a3a640 1 --2- 172.21.15.33:0/706234216 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ab0100480 0x7f2ab0195fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:32.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.999+0000 7f2ab6a3a640 1 -- 172.21.15.33:0/706234216 >> 172.21.15.33:0/706234216 conn(0x7f2ab0077210 msgr2=0x7f2ab00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:32.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.999+0000 7f2ab6a3a640 1 -- 172.21.15.33:0/706234216 shutdown_connections 2024-09-12T12:25:32.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:31.999+0000 7f2ab6a3a640 1 -- 172.21.15.33:0/706234216 wait complete. 2024-09-12T12:25:32.608 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:32 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/706234216' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:25:32.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:32 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/706234216' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:25:32.641 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:25:32.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:32 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/706234216' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:25:32.901 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:33.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.352+0000 7f13e61a2640 1 -- 172.21.15.33:0/3868685987 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13e010bfc0 msgr2=0x7f13e010e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:33.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.352+0000 7f13e61a2640 1 --2- 172.21.15.33:0/3868685987 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13e010bfc0 0x7f13e010e460 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f13d8009ca0 tx=0x7f13d802a950 comp rx=0 tx=0).stop 2024-09-12T12:25:33.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.352+0000 7f13e61a2640 1 -- 172.21.15.33:0/3868685987 shutdown_connections 2024-09-12T12:25:33.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.352+0000 7f13e61a2640 1 --2- 172.21.15.33:0/3868685987 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13e010bfc0 0x7f13e010e460 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:33.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.352+0000 7f13e61a2640 1 --2- 172.21.15.33:0/3868685987 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13e01034b0 0x7f13e010b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:33.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.352+0000 7f13e61a2640 1 --2- 172.21.15.33:0/3868685987 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13e0102b90 0x7f13e0102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:33.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.352+0000 7f13e61a2640 1 -- 172.21.15.33:0/3868685987 >> 172.21.15.33:0/3868685987 conn(0x7f13e00fc630 msgr2=0x7f13e00fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:33.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.353+0000 7f13e61a2640 1 -- 172.21.15.33:0/3868685987 shutdown_connections 2024-09-12T12:25:33.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.353+0000 7f13e61a2640 1 -- 172.21.15.33:0/3868685987 wait complete. 2024-09-12T12:25:33.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.353+0000 7f13e61a2640 1 Processor -- start 2024-09-12T12:25:33.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.353+0000 7f13e61a2640 1 -- start start 2024-09-12T12:25:33.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.353+0000 7f13e61a2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13e0102b90 0x7f13e01980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:33.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.353+0000 7f13e61a2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13e01034b0 0x7f13e0198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:33.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.353+0000 7f13e61a2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13e010bfc0 0x7f13e019c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:33.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.353+0000 7f13e61a2640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f13e0111c60 con 0x7f13e01034b0 2024-09-12T12:25:33.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.353+0000 7f13e61a2640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f13e0111ae0 con 0x7f13e0102b90 2024-09-12T12:25:33.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.353+0000 7f13e61a2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f13e0111de0 con 0x7f13e010bfc0 2024-09-12T12:25:33.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.354+0000 7f13e499f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13e01034b0 0x7f13e0198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:33.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.354+0000 7f13e499f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13e01034b0 0x7f13e0198600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45678/0 (socket says 172.21.15.33:45678) 2024-09-12T12:25:33.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.354+0000 7f13e499f640 1 -- 172.21.15.33:0/2983515942 learned_addr learned my addr 172.21.15.33:0/2983515942 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:33.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.354+0000 7f13e51a0640 1 --2- 172.21.15.33:0/2983515942 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13e0102b90 0x7f13e01980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:33.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.354+0000 7f13e59a1640 1 --2- 172.21.15.33:0/2983515942 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13e010bfc0 0x7f13e019c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:33.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.354+0000 7f13e499f640 1 -- 172.21.15.33:0/2983515942 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13e010bfc0 msgr2=0x7f13e019c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:33.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.354+0000 7f13e499f640 1 --2- 172.21.15.33:0/2983515942 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13e010bfc0 0x7f13e019c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:33.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.354+0000 7f13e499f640 1 -- 172.21.15.33:0/2983515942 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13e0102b90 msgr2=0x7f13e01980c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:33.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.354+0000 7f13e499f640 1 --2- 172.21.15.33:0/2983515942 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13e0102b90 0x7f13e01980c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:33.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.354+0000 7f13e499f640 1 -- 172.21.15.33:0/2983515942 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e019d070 con 0x7f13e01034b0 2024-09-12T12:25:33.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.354+0000 7f13e499f640 1 --2- 172.21.15.33:0/2983515942 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13e01034b0 0x7f13e0198600 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f13d000c970 tx=0x7f13d000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:33.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.354+0000 7f13d67fc640 1 -- 172.21.15.33:0/2983515942 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d0007bb0 con 0x7f13e01034b0 2024-09-12T12:25:33.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.354+0000 7f13e61a2640 1 -- 172.21.15.33:0/2983515942 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13e019d360 con 0x7f13e01034b0 2024-09-12T12:25:33.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.354+0000 7f13d67fc640 1 -- 172.21.15.33:0/2983515942 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f13d0007d50 con 0x7f13e01034b0 2024-09-12T12:25:33.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.354+0000 7f13d67fc640 1 -- 172.21.15.33:0/2983515942 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d0004e10 con 0x7f13e01034b0 2024-09-12T12:25:33.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.354+0000 7f13e61a2640 1 -- 172.21.15.33:0/2983515942 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13e01a4c40 con 0x7f13e01034b0 2024-09-12T12:25:33.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.355+0000 7f13e61a2640 1 -- 172.21.15.33:0/2983515942 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13e0102f70 con 0x7f13e01034b0 2024-09-12T12:25:33.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.356+0000 7f13d67fc640 1 -- 172.21.15.33:0/2983515942 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f13d0005020 con 0x7f13e01034b0 2024-09-12T12:25:33.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.357+0000 7f13d67fc640 1 --2- 172.21.15.33:0/2983515942 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f13cc0a2c10 0x7f13cc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:33.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.357+0000 7f13e51a0640 1 --2- 172.21.15.33:0/2983515942 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f13cc0a2c10 0x7f13cc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:33.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.357+0000 7f13d67fc640 1 -- 172.21.15.33:0/2983515942 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7f13d00cf390 con 0x7f13e01034b0 2024-09-12T12:25:33.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.358+0000 7f13e51a0640 1 --2- 172.21.15.33:0/2983515942 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f13cc0a2c10 0x7f13cc0a50d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f13dc005e10 tx=0x7f13dc005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:33.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.361+0000 7f13d67fc640 1 -- 172.21.15.33:0/2983515942 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f13d0014030 con 0x7f13e01034b0 2024-09-12T12:25:33.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.571+0000 7f13e61a2640 1 -- 172.21.15.33:0/2983515942 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f13e002d7c0 con 0x7f13e01034b0 2024-09-12T12:25:33.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:33 smithi033 ceph-mon[31246]: pgmap v334: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T12:25:33.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.572+0000 7f13d67fc640 1 -- 172.21.15.33:0/2983515942 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11912 (secure 0 0 0) 0x7f13d009bdd0 con 0x7f13e01034b0 2024-09-12T12:25:33.572 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:25:33.573 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":24,"btime":"2024-09-12T12:24:30:808296+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3327066342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3327066342},{"type":"v1","addr":"172.21.15.33:6835","nonce":3327066342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/19516401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":19516401},{"type":"v1","addr":"172.21.15.33:6837","nonce":19516401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1260196118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1260196118},{"type":"v1","addr":"172.21.15.33:6839","nonce":1260196118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/4288248356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4288248356},{"type":"v1","addr":"172.21.15.33:6841","nonce":4288248356}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/3051073141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3051073141},{"type":"v1","addr":"172.21.15.43:6833","nonce":3051073141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3282762800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3282762800},{"type":"v1","addr":"172.21.15.43:6835","nonce":3282762800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:23:46.400609+0000","modified":"2024-09-12T12:24:30.590211+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24490,"mds_2":24478},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3051713000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3051713000},{"type":"v1","addr":"172.21.15.102:6833","nonce":3051713000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6837/2472064883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2472064883},{"type":"v1","addr":"172.21.15.43:6837","nonce":2472064883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/1987408860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":1987408860},{"type":"v1","addr":"172.21.15.43:6839","nonce":1987408860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/4179527539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":4179527539},{"type":"v1","addr":"172.21.15.102:6835","nonce":4179527539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/2409953270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2409953270},{"type":"v1","addr":"172.21.15.102:6837","nonce":2409953270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.102:6839/1553271340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":1553271340},{"type":"v1","addr":"172.21.15.102:6839","nonce":1553271340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24499,"qdb_cluster":[24478,24490,24499]},"id":1}]} 2024-09-12T12:25:33.573 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 24 2024-09-12T12:25:33.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.574+0000 7f13e61a2640 1 -- 172.21.15.33:0/2983515942 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f13cc0a2c10 msgr2=0x7f13cc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:33.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.574+0000 7f13e61a2640 1 --2- 172.21.15.33:0/2983515942 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f13cc0a2c10 0x7f13cc0a50d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f13dc005e10 tx=0x7f13dc005da0 comp rx=0 tx=0).stop 2024-09-12T12:25:33.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.574+0000 7f13e61a2640 1 -- 172.21.15.33:0/2983515942 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13e01034b0 msgr2=0x7f13e0198600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:33.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.574+0000 7f13e61a2640 1 --2- 172.21.15.33:0/2983515942 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13e01034b0 0x7f13e0198600 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f13d000c970 tx=0x7f13d000ce30 comp rx=0 tx=0).stop 2024-09-12T12:25:33.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.574+0000 7f13e61a2640 1 -- 172.21.15.33:0/2983515942 shutdown_connections 2024-09-12T12:25:33.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.574+0000 7f13e61a2640 1 --2- 172.21.15.33:0/2983515942 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f13cc0a2c10 0x7f13cc0a50d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:33.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.574+0000 7f13e61a2640 1 --2- 172.21.15.33:0/2983515942 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13e010bfc0 0x7f13e019c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:33.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.574+0000 7f13e61a2640 1 --2- 172.21.15.33:0/2983515942 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13e01034b0 0x7f13e0198600 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:33.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.574+0000 7f13e61a2640 1 --2- 172.21.15.33:0/2983515942 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13e0102b90 0x7f13e01980c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:33.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.574+0000 7f13e61a2640 1 -- 172.21.15.33:0/2983515942 >> 172.21.15.33:0/2983515942 conn(0x7f13e00fc630 msgr2=0x7f13e00fd290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:33.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.574+0000 7f13e61a2640 1 -- 172.21.15.33:0/2983515942 shutdown_connections 2024-09-12T12:25:33.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:33.574+0000 7f13e61a2640 1 -- 172.21.15.33:0/2983515942 wait complete. 2024-09-12T12:25:33.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:33 smithi043 ceph-mon[34144]: pgmap v334: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T12:25:33.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:33 smithi102 ceph-mon[34799]: pgmap v334: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T12:25:34.402 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-12T12:23:46.400609+0000', 'modified': '2024-09-12T12:24:30.590211+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24499, 'mds_1': 24490, 'mds_2': 24478}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24442': {'gid': 24442, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.102:6833/3051713000', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6832', 'nonce': 3051713000}, {'type': 'v1', 'addr': '172.21.15.102:6833', 'nonce': 3051713000}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24443': {'gid': 24443, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.43:6837/2472064883', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6836', 'nonce': 2472064883}, {'type': 'v1', 'addr': '172.21.15.43:6837', 'nonce': 2472064883}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24473': {'gid': 24473, 'name': 'b', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.43:6839/1987408860', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6838', 'nonce': 1987408860}, {'type': 'v1', 'addr': '172.21.15.43:6839', 'nonce': 1987408860}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24478': {'gid': 24478, 'name': 'f', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 19, 'addr': '172.21.15.102:6835/4179527539', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6834', 'nonce': 4179527539}, {'type': 'v1', 'addr': '172.21.15.102:6835', 'nonce': 4179527539}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24490': {'gid': 24490, 'name': 'c', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.102:6837/2409953270', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6836', 'nonce': 2409953270}, {'type': 'v1', 'addr': '172.21.15.102:6837', 'nonce': 2409953270}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24499': {'gid': 24499, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.102:6839/1553271340', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6838', 'nonce': 1553271340}, {'type': 'v1', 'addr': '172.21.15.102:6839', 'nonce': 1553271340}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24499, 'qdb_cluster': [24478, 24490, 24499]} 2024-09-12T12:25:34.402 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-12T12:25:34.402 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.f status 2024-09-12T12:25:34.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:34 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/2983515942' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:25:34.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:34 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/2983515942' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:25:34.662 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:34.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:34 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/2983515942' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:25:35.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.247+0000 7fc7e9cac640 1 -- 172.21.15.33:0/1824818727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7e4074590 msgr2=0x7fc7e4074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:35.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.247+0000 7fc7e9cac640 1 --2- 172.21.15.33:0/1824818727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7e4074590 0x7fc7e4074970 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4009900 tx=0x7fc7d402a480 comp rx=0 tx=0).stop 2024-09-12T12:25:35.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.247+0000 7fc7e9cac640 1 -- 172.21.15.33:0/1824818727 shutdown_connections 2024-09-12T12:25:35.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.247+0000 7fc7e9cac640 1 --2- 172.21.15.33:0/1824818727 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7e4112b90 0x7fc7e4114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:35.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.247+0000 7fc7e9cac640 1 --2- 172.21.15.33:0/1824818727 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7e4074eb0 0x7fc7e4112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:35.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.247+0000 7fc7e9cac640 1 --2- 172.21.15.33:0/1824818727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7e4074590 0x7fc7e4074970 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:35.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.247+0000 7fc7e9cac640 1 -- 172.21.15.33:0/1824818727 >> 172.21.15.33:0/1824818727 conn(0x7fc7e40fd8c0 msgr2=0x7fc7e40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:35.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.247+0000 7fc7e9cac640 1 -- 172.21.15.33:0/1824818727 shutdown_connections 2024-09-12T12:25:35.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.247+0000 7fc7e9cac640 1 -- 172.21.15.33:0/1824818727 wait complete. 2024-09-12T12:25:35.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.247+0000 7fc7e9cac640 1 Processor -- start 2024-09-12T12:25:35.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.247+0000 7fc7e9cac640 1 -- start start 2024-09-12T12:25:35.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.248+0000 7fc7e9cac640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7e4074590 0x7fc7e41a4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:35.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.248+0000 7fc7e9cac640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7e4074eb0 0x7fc7e41a4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:35.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.248+0000 7fc7e9cac640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7e4112b90 0x7fc7e419e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:35.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.248+0000 7fc7e9cac640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e4118400 con 0x7fc7e4074eb0 2024-09-12T12:25:35.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.248+0000 7fc7e9cac640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e4118280 con 0x7fc7e4112b90 2024-09-12T12:25:35.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.248+0000 7fc7e9cac640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e4118580 con 0x7fc7e4074590 2024-09-12T12:25:35.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.248+0000 7fc7dbfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7e4074eb0 0x7fc7e41a4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:35.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.248+0000 7fc7dbfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7e4074eb0 0x7fc7e41a4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45692/0 (socket says 172.21.15.33:45692) 2024-09-12T12:25:35.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.248+0000 7fc7dbfff640 1 -- 172.21.15.33:0/1253896107 learned_addr learned my addr 172.21.15.33:0/1253896107 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:35.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.248+0000 7fc7e37fe640 1 --2- 172.21.15.33:0/1253896107 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7e4074590 0x7fc7e41a4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:35.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.248+0000 7fc7e3fff640 1 --2- 172.21.15.33:0/1253896107 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7e4112b90 0x7fc7e419e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:35.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.248+0000 7fc7dbfff640 1 -- 172.21.15.33:0/1253896107 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7e4074590 msgr2=0x7fc7e41a4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:35.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.248+0000 7fc7dbfff640 1 --2- 172.21.15.33:0/1253896107 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7e4074590 0x7fc7e41a4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:35.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.248+0000 7fc7dbfff640 1 -- 172.21.15.33:0/1253896107 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7e4112b90 msgr2=0x7fc7e419e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:35.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.248+0000 7fc7dbfff640 1 --2- 172.21.15.33:0/1253896107 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7e4112b90 0x7fc7e419e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:35.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.248+0000 7fc7dbfff640 1 -- 172.21.15.33:0/1253896107 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7e419ef90 con 0x7fc7e4074eb0 2024-09-12T12:25:35.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.248+0000 7fc7e37fe640 1 --2- 172.21.15.33:0/1253896107 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7e4074590 0x7fc7e41a4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:35.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.248+0000 7fc7dbfff640 1 --2- 172.21.15.33:0/1253896107 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7e4074eb0 0x7fc7e41a4bb0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc00d950 tx=0x7fc7cc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:35.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.248+0000 7fc7e17fa640 1 -- 172.21.15.33:0/1253896107 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc017070 con 0x7fc7e4074eb0 2024-09-12T12:25:35.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.248+0000 7fc7e17fa640 1 -- 172.21.15.33:0/1253896107 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc7cc009c30 con 0x7fc7e4074eb0 2024-09-12T12:25:35.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.248+0000 7fc7e9cac640 1 -- 172.21.15.33:0/1253896107 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7e419f280 con 0x7fc7e4074eb0 2024-09-12T12:25:35.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.248+0000 7fc7e17fa640 1 -- 172.21.15.33:0/1253896107 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc00f620 con 0x7fc7e4074eb0 2024-09-12T12:25:35.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.248+0000 7fc7e9cac640 1 -- 172.21.15.33:0/1253896107 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7e41ab4d0 con 0x7fc7e4074eb0 2024-09-12T12:25:35.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.251+0000 7fc7ec085740 1 Processor -- start 2024-09-12T12:25:35.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.252+0000 7fc7e17fa640 1 -- 172.21.15.33:0/1253896107 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc7cc0109a0 con 0x7fc7e4074eb0 2024-09-12T12:25:35.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.252+0000 7fc7ec085740 1 -- start start 2024-09-12T12:25:35.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.252+0000 7fc7ec085740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee0c2d99d0 0x55ee0c2d9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:35.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.252+0000 7fc7ec085740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ee0c2da2f0 0x55ee0c2e4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:35.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.252+0000 7fc7ec085740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ee0c2e4bb0 0x55ee0c2e6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:35.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.252+0000 7fc7ec085740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55ee0c240090 con 0x55ee0c2d99d0 2024-09-12T12:25:35.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.252+0000 7fc7ec085740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ee0c1e7a70 con 0x55ee0c2da2f0 2024-09-12T12:25:35.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.252+0000 7fc7ec085740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ee0c23c050 con 0x55ee0c2e4bb0 2024-09-12T12:25:35.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.252+0000 7fc7e3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee0c2d99d0 0x55ee0c2d9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:35.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.252+0000 7fc7e3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee0c2d99d0 0x55ee0c2d9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45696/0 (socket says 172.21.15.33:45696) 2024-09-12T12:25:35.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.252+0000 7fc7e3fff640 1 -- 172.21.15.33:0/54223775 learned_addr learned my addr 172.21.15.33:0/54223775 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:35.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.252+0000 7fc7e37fe640 1 --2- 172.21.15.33:0/54223775 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ee0c2da2f0 0x55ee0c2e4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:35.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.252+0000 7fc7dbfff640 1 --2- 172.21.15.33:0/54223775 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ee0c2e4bb0 0x55ee0c2e6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:35.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.252+0000 7fc7e3fff640 1 -- 172.21.15.33:0/54223775 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ee0c2e4bb0 msgr2=0x55ee0c2e6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:35.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.252+0000 7fc7e3fff640 1 --2- 172.21.15.33:0/54223775 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ee0c2e4bb0 0x55ee0c2e6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:35.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.252+0000 7fc7e3fff640 1 -- 172.21.15.33:0/54223775 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ee0c2da2f0 msgr2=0x55ee0c2e4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:35.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.252+0000 7fc7e3fff640 1 --2- 172.21.15.33:0/54223775 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ee0c2da2f0 0x55ee0c2e4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:35.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.252+0000 7fc7e3fff640 1 -- 172.21.15.33:0/54223775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee0c1f4130 con 0x55ee0c2d99d0 2024-09-12T12:25:35.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.252+0000 7fc7e37fe640 1 --2- 172.21.15.33:0/54223775 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ee0c2da2f0 0x55ee0c2e4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:25:35.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.252+0000 7fc7dbfff640 1 --2- 172.21.15.33:0/54223775 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ee0c2e4bb0 0x55ee0c2e6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:25:35.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.252+0000 7fc7e17fa640 1 --2- 172.21.15.33:0/1253896107 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc7d00a2c10 0x7fc7d00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:35.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.252+0000 7fc7e3fff640 1 --2- 172.21.15.33:0/54223775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee0c2d99d0 0x55ee0c2d9db0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc009e30 tx=0x7fc7dc010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62604a5935e2b5e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:35.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.253+0000 7fc7e37fe640 1 --2- 172.21.15.33:0/1253896107 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc7d00a2c10 0x7fc7d00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:35.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.253+0000 7fc7e17fa640 1 -- 172.21.15.33:0/1253896107 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7fc7cc0cf230 con 0x7fc7e4074eb0 2024-09-12T12:25:35.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.253+0000 7fc7d9ffb640 1 -- 172.21.15.33:0/54223775 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc016070 con 0x55ee0c2d99d0 2024-09-12T12:25:35.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.253+0000 7fc7d9ffb640 1 -- 172.21.15.33:0/54223775 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc7dc004d20 con 0x55ee0c2d99d0 2024-09-12T12:25:35.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.253+0000 7fc7d9ffb640 1 -- 172.21.15.33:0/54223775 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc012670 con 0x55ee0c2d99d0 2024-09-12T12:25:35.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.253+0000 7fc7ec085740 1 -- 172.21.15.33:0/54223775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee0c2d99d0 msgr2=0x55ee0c2d9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:35.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.253+0000 7fc7e37fe640 1 --2- 172.21.15.33:0/1253896107 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc7d00a2c10 0x7fc7d00a50d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4031440 tx=0x7fc7d40058b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:35.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.253+0000 7fc7ec085740 1 --2- 172.21.15.33:0/54223775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee0c2d99d0 0x55ee0c2d9db0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc009e30 tx=0x7fc7dc010740 comp rx=0 tx=0).stop 2024-09-12T12:25:35.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.253+0000 7fc7ec085740 1 -- 172.21.15.33:0/54223775 shutdown_connections 2024-09-12T12:25:35.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.253+0000 7fc7ec085740 1 --2- 172.21.15.33:0/54223775 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ee0c2e4bb0 0x55ee0c2e6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:35.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.253+0000 7fc7ec085740 1 --2- 172.21.15.33:0/54223775 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ee0c2da2f0 0x55ee0c2e4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:35.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.253+0000 7fc7ec085740 1 --2- 172.21.15.33:0/54223775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee0c2d99d0 0x55ee0c2d9db0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:35.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.254+0000 7fc7ec085740 1 -- 172.21.15.33:0/54223775 >> 172.21.15.33:0/54223775 conn(0x55ee0c2d5f60 msgr2=0x55ee0c2d6340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:35.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.254+0000 7fc7ec085740 1 -- 172.21.15.33:0/54223775 shutdown_connections 2024-09-12T12:25:35.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.254+0000 7fc7ec085740 1 -- 172.21.15.33:0/54223775 wait complete. 2024-09-12T12:25:35.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.254+0000 7fc7ec085740 1 -- start start 2024-09-12T12:25:35.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.254+0000 7fc7ec085740 1 Processor -- start 2024-09-12T12:25:35.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.254+0000 7fc7ec085740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ee0c2d99d0 0x55ee0c2e4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:35.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.254+0000 7fc7ec085740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee0c2da2f0 0x55ee0c2e1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:35.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.254+0000 7fc7ec085740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ee0c2e4bb0 0x55ee0c2e1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:35.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.254+0000 7fc7ec085740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55ee0c2e7780 con 0x55ee0c2da2f0 2024-09-12T12:25:35.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.254+0000 7fc7ec085740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ee0c1faf20 con 0x55ee0c2e4bb0 2024-09-12T12:25:35.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.254+0000 7fc7ec085740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ee0c2e7900 con 0x55ee0c2d99d0 2024-09-12T12:25:35.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.254+0000 7fc7ec085740 10 client.0 _ll_register_callbacks cb 0x55ee0c1c4030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:35.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.255+0000 7fc7dbfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee0c2da2f0 0x55ee0c2e1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:35.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.255+0000 7fc7dbfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee0c2da2f0 0x55ee0c2e1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45704/0 (socket says 172.21.15.33:45704) 2024-09-12T12:25:35.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.255+0000 7fc7dbfff640 1 -- 172.21.15.33:0/3153140250 learned_addr learned my addr 172.21.15.33:0/3153140250 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:35.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.255+0000 7fc7e37fe640 1 --2- 172.21.15.33:0/3153140250 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ee0c2d99d0 0x55ee0c2e4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:35.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.255+0000 7fc7e3fff640 1 --2- 172.21.15.33:0/3153140250 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ee0c2e4bb0 0x55ee0c2e1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:35.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.255+0000 7fc7dbfff640 1 -- 172.21.15.33:0/3153140250 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ee0c2d99d0 msgr2=0x55ee0c2e4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:35.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.255+0000 7fc7dbfff640 1 --2- 172.21.15.33:0/3153140250 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ee0c2d99d0 0x55ee0c2e4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:35.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.255+0000 7fc7dbfff640 1 -- 172.21.15.33:0/3153140250 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ee0c2e4bb0 msgr2=0x55ee0c2e1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:35.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.255+0000 7fc7dbfff640 1 --2- 172.21.15.33:0/3153140250 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ee0c2e4bb0 0x55ee0c2e1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:35.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.255+0000 7fc7dbfff640 1 -- 172.21.15.33:0/3153140250 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee0bfb12b0 con 0x55ee0c2da2f0 2024-09-12T12:25:35.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.255+0000 7fc7e37fe640 1 --2- 172.21.15.33:0/3153140250 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ee0c2d99d0 0x55ee0c2e4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:35.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.255+0000 7fc7e3fff640 1 --2- 172.21.15.33:0/3153140250 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ee0c2e4bb0 0x55ee0c2e1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:25:35.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.255+0000 7fc7dbfff640 1 --2- 172.21.15.33:0/3153140250 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee0c2da2f0 0x55ee0c2e1760 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc09b560 tx=0x7fc7cc09af30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dab55cda06f3d5d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:35.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.255+0000 7fc7c2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:25:35.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.255+0000 7fc7c2ffd640 1 -- 172.21.15.33:0/3153140250 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc020070 con 0x55ee0c2da2f0 2024-09-12T12:25:35.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.255+0000 7fc7c2ffd640 1 -- 172.21.15.33:0/3153140250 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7fc7cc084b60 con 0x55ee0c2da2f0 2024-09-12T12:25:35.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.255+0000 7fc7ec085740 1 -- 172.21.15.33:0/3153140250 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7dc004d20 con 0x55ee0c2da2f0 2024-09-12T12:25:35.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.255+0000 7fc7c2ffd640 1 -- 172.21.15.33:0/3153140250 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc7cc09bcd0 con 0x55ee0c2da2f0 2024-09-12T12:25:35.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.255+0000 7fc7ec085740 10 client.15060 fetch_fsmap learned FSMap version 24 2024-09-12T12:25:35.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.255+0000 7fc7ec085740 1 -- 172.21.15.33:0/3153140250 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ee0c2f2fe0 con 0x55ee0c2da2f0 2024-09-12T12:25:35.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.255+0000 7fc7c2ffd640 1 -- 172.21.15.33:0/3153140250 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc7dc004d20 con 0x55ee0c2da2f0 2024-09-12T12:25:35.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.256+0000 7fc7c2ffd640 1 -- 172.21.15.33:0/3153140250 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7fc7cc0afaf0 con 0x55ee0c2da2f0 2024-09-12T12:25:35.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.256+0000 7fc7ec085740 10 client.15060 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T12:25:35.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.256+0000 7fc7ec085740 10 client.15060 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-12T12:25:35.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.256+0000 7fc7ec085740 20 client.15060 populate_metadata read hostname 'smithi033' 2024-09-12T12:25:35.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.256+0000 7fc7ec085740 1 --2- 172.21.15.33:0/3153140250 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x55ee0c2f5630 0x55ee0c2f6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:35.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.256+0000 7fc7ec085740 4 client.15060 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:25:35.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.256+0000 7fc7ec085740 1 -- 172.21.15.33:0/3153140250 --> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee0c24d600 con 0x55ee0c2f5630 2024-09-12T12:25:35.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.256+0000 7fc7e37fe640 1 --2- 172.21.15.33:0/3153140250 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x55ee0c2f5630 0x55ee0c2f6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:35.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.257+0000 7fc7c2ffd640 10 client.15060 ms_handle_connect on v2:172.21.15.102:6834/4179527539 2024-09-12T12:25:35.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.257+0000 7fc7e37fe640 1 --2- 172.21.15.33:0/3153140250 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x55ee0c2f5630 0x55ee0c2f6aa0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3f44cdb77f2921bd server_cookie=4f2889f52051979d in_seq=0 out_seq=0 2024-09-12T12:25:35.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.257+0000 7fc7c2ffd640 1 -- 172.21.15.33:0/3153140250 <== mds.2 v2:172.21.15.102:6834/4179527539 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ee0c24d600 con 0x55ee0c2f5630 2024-09-12T12:25:35.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.257+0000 7fc7c2ffd640 10 client.15060 handle_command_reply: tid=0 2024-09-12T12:25:35.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.257+0000 7fc7ec085740 1 client.15060 shutdown 2024-09-12T12:25:35.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.258+0000 7fc7ec085740 1 -- 172.21.15.33:0/3153140250 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee0c2da2f0 msgr2=0x55ee0c2e1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:35.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.258+0000 7fc7ec085740 1 --2- 172.21.15.33:0/3153140250 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee0c2da2f0 0x55ee0c2e1760 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc09b560 tx=0x7fc7cc09af30 comp rx=0 tx=0).stop 2024-09-12T12:25:35.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.258+0000 7fc7ec085740 1 -- 172.21.15.33:0/3153140250 shutdown_connections 2024-09-12T12:25:35.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.258+0000 7fc7ec085740 1 --2- 172.21.15.33:0/3153140250 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x55ee0c2f5630 0x55ee0c2f6aa0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:35.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.258+0000 7fc7ec085740 1 --2- 172.21.15.33:0/3153140250 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ee0c2e4bb0 0x55ee0c2e1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:35.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.258+0000 7fc7ec085740 1 --2- 172.21.15.33:0/3153140250 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee0c2da2f0 0x55ee0c2e1760 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:35.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.258+0000 7fc7ec085740 1 --2- 172.21.15.33:0/3153140250 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ee0c2d99d0 0x55ee0c2e4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:35.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.258+0000 7fc7c2ffd640 0 client.15060 ms_handle_reset on v2:172.21.15.102:6834/4179527539 2024-09-12T12:25:35.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.258+0000 7fc7ec085740 1 -- 172.21.15.33:0/3153140250 >> 172.21.15.33:0/3153140250 conn(0x55ee0c2d5f60 msgr2=0x55ee0c2dbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:35.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.258+0000 7fc7ec085740 1 -- 172.21.15.33:0/3153140250 shutdown_connections 2024-09-12T12:25:35.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.258+0000 7fc7ec085740 1 -- 172.21.15.33:0/3153140250 wait complete. 2024-09-12T12:25:35.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.258+0000 7fc7ec085740 20 client.15060 trim_cache size 0 max 16384 2024-09-12T12:25:35.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.276+0000 7fc7ec085740 1 Processor -- start 2024-09-12T12:25:35.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.276+0000 7fc7ec085740 1 -- start start 2024-09-12T12:25:35.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.276+0000 7fc7ec085740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ee0c2d99d0 0x55ee0c2f6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:35.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.276+0000 7fc7ec085740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ee0c2da2f0 0x55ee0c2e1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:35.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.276+0000 7fc7ec085740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee0c2e4bb0 0x55ee0c2e1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:35.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.276+0000 7fc7ec085740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55ee0c2f4de0 con 0x55ee0c2e4bb0 2024-09-12T12:25:35.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.276+0000 7fc7ec085740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ee0c2f54b0 con 0x55ee0c2d99d0 2024-09-12T12:25:35.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.276+0000 7fc7ec085740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ee0c2f5b80 con 0x55ee0c2da2f0 2024-09-12T12:25:35.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.276+0000 7fc7e3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee0c2e4bb0 0x55ee0c2e1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:35.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.276+0000 7fc7e3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee0c2e4bb0 0x55ee0c2e1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45710/0 (socket says 172.21.15.33:45710) 2024-09-12T12:25:35.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.276+0000 7fc7e3fff640 1 -- 172.21.15.33:0/463253198 learned_addr learned my addr 172.21.15.33:0/463253198 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:35.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.276+0000 7fc7e3fff640 1 -- 172.21.15.33:0/463253198 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ee0c2da2f0 msgr2=0x55ee0c2e1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:35.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.276+0000 7fc7e3fff640 1 --2- 172.21.15.33:0/463253198 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ee0c2da2f0 0x55ee0c2e1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:35.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.276+0000 7fc7e3fff640 1 -- 172.21.15.33:0/463253198 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ee0c2d99d0 msgr2=0x55ee0c2f6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:35.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.276+0000 7fc7e3fff640 1 --2- 172.21.15.33:0/463253198 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ee0c2d99d0 0x55ee0c2f6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:35.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.276+0000 7fc7e3fff640 1 -- 172.21.15.33:0/463253198 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee0c2e4030 con 0x55ee0c2e4bb0 2024-09-12T12:25:35.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.277+0000 7fc7e3fff640 1 --2- 172.21.15.33:0/463253198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee0c2e4bb0 0x55ee0c2e1c60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc019000 tx=0x7fc7dc005c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=303b5767cee230d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:35.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.277+0000 7fc7d97fa640 1 -- 172.21.15.33:0/463253198 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc016070 con 0x55ee0c2e4bb0 2024-09-12T12:25:35.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.277+0000 7fc7d97fa640 1 -- 172.21.15.33:0/463253198 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc7dc004cc0 con 0x55ee0c2e4bb0 2024-09-12T12:25:35.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.277+0000 7fc7d97fa640 1 -- 172.21.15.33:0/463253198 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc0127a0 con 0x55ee0c2e4bb0 2024-09-12T12:25:35.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.277+0000 7fc7ec085740 1 -- 172.21.15.33:0/463253198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee0c2e4bb0 msgr2=0x55ee0c2e1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:35.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.277+0000 7fc7ec085740 1 --2- 172.21.15.33:0/463253198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee0c2e4bb0 0x55ee0c2e1c60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc019000 tx=0x7fc7dc005c80 comp rx=0 tx=0).stop 2024-09-12T12:25:35.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.277+0000 7fc7ec085740 1 -- 172.21.15.33:0/463253198 shutdown_connections 2024-09-12T12:25:35.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.277+0000 7fc7ec085740 1 --2- 172.21.15.33:0/463253198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee0c2e4bb0 0x55ee0c2e1c60 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:35.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.277+0000 7fc7ec085740 1 --2- 172.21.15.33:0/463253198 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ee0c2da2f0 0x55ee0c2e1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:35.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.277+0000 7fc7ec085740 1 --2- 172.21.15.33:0/463253198 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ee0c2d99d0 0x55ee0c2f6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:35.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.277+0000 7fc7ec085740 1 -- 172.21.15.33:0/463253198 >> 172.21.15.33:0/463253198 conn(0x55ee0c2d5f60 msgr2=0x55ee0c2d0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:35.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.278+0000 7fc7ec085740 1 -- 172.21.15.33:0/463253198 shutdown_connections 2024-09-12T12:25:35.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.278+0000 7fc7ec085740 1 -- 172.21.15.33:0/463253198 wait complete. 2024-09-12T12:25:35.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.278+0000 7fc7ec085740 1 -- start start 2024-09-12T12:25:35.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.278+0000 7fc7ec085740 1 Processor -- start 2024-09-12T12:25:35.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.278+0000 7fc7ec085740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ee0c2d99d0 0x55ee0c2fed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:35.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.278+0000 7fc7ec085740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee0c2da2f0 0x55ee0c2ff2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:35.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.278+0000 7fc7ec085740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ee0c2e4bb0 0x55ee0c2fa210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:35.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.278+0000 7fc7ec085740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55ee0c2f6920 con 0x55ee0c2da2f0 2024-09-12T12:25:35.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.278+0000 7fc7ec085740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ee0c2f6250 con 0x55ee0c2d99d0 2024-09-12T12:25:35.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.278+0000 7fc7ec085740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ee0c2f6ff0 con 0x55ee0c2e4bb0 2024-09-12T12:25:35.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.278+0000 7fc7ec085740 10 client.0 _ll_register_callbacks cb 0x7fc7cc09b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:35.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.278+0000 7fc7dbfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee0c2da2f0 0x55ee0c2ff2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:35.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.279+0000 7fc7dbfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee0c2da2f0 0x55ee0c2ff2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45724/0 (socket says 172.21.15.33:45724) 2024-09-12T12:25:35.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.279+0000 7fc7dbfff640 1 -- 172.21.15.33:0/235794430 learned_addr learned my addr 172.21.15.33:0/235794430 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:35.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.279+0000 7fc7e3fff640 1 --2- 172.21.15.33:0/235794430 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ee0c2e4bb0 0x55ee0c2fa210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:35.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.279+0000 7fc7e37fe640 1 --2- 172.21.15.33:0/235794430 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ee0c2d99d0 0x55ee0c2fed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:35.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.279+0000 7fc7dbfff640 1 -- 172.21.15.33:0/235794430 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ee0c2e4bb0 msgr2=0x55ee0c2fa210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:35.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.279+0000 7fc7dbfff640 1 --2- 172.21.15.33:0/235794430 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ee0c2e4bb0 0x55ee0c2fa210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:35.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.279+0000 7fc7dbfff640 1 -- 172.21.15.33:0/235794430 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ee0c2d99d0 msgr2=0x55ee0c2fed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:35.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.279+0000 7fc7dbfff640 1 --2- 172.21.15.33:0/235794430 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ee0c2d99d0 0x55ee0c2fed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:35.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.279+0000 7fc7dbfff640 1 -- 172.21.15.33:0/235794430 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee0c2faa10 con 0x55ee0c2da2f0 2024-09-12T12:25:35.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.279+0000 7fc7e3fff640 1 --2- 172.21.15.33:0/235794430 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ee0c2e4bb0 0x55ee0c2fa210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:35.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.279+0000 7fc7e37fe640 1 --2- 172.21.15.33:0/235794430 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ee0c2d99d0 0x55ee0c2fed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:35.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.279+0000 7fc7dbfff640 1 --2- 172.21.15.33:0/235794430 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee0c2da2f0 0x55ee0c2ff2b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc097a30 tx=0x7fc7cc097e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfe3d6d5aecebff2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:35.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.279+0000 7fc7c2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:25:35.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.279+0000 7fc7c2ffd640 1 -- 172.21.15.33:0/235794430 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc020070 con 0x55ee0c2da2f0 2024-09-12T12:25:35.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.279+0000 7fc7ec085740 1 -- 172.21.15.33:0/235794430 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7dc004cc0 con 0x55ee0c2da2f0 2024-09-12T12:25:35.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.279+0000 7fc7c2ffd640 1 -- 172.21.15.33:0/235794430 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7fc7cc09aa20 con 0x55ee0c2da2f0 2024-09-12T12:25:35.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.279+0000 7fc7c2ffd640 1 -- 172.21.15.33:0/235794430 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc7cc09b5d0 con 0x55ee0c2da2f0 2024-09-12T12:25:35.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.279+0000 7fc7ec085740 10 client.15066 fetch_fsmap learned FSMap version 24 2024-09-12T12:25:35.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.279+0000 7fc7ec085740 1 -- 172.21.15.33:0/235794430 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ee0c35f780 con 0x55ee0c2da2f0 2024-09-12T12:25:35.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.280+0000 7fc7c2ffd640 1 -- 172.21.15.33:0/235794430 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc7dc004cc0 con 0x55ee0c2da2f0 2024-09-12T12:25:35.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.280+0000 7fc7c2ffd640 1 -- 172.21.15.33:0/235794430 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7fc7cc010460 con 0x55ee0c2da2f0 2024-09-12T12:25:35.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.280+0000 7fc7ec085740 10 client.15066 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T12:25:35.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.280+0000 7fc7ec085740 10 client.15066 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-12T12:25:35.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.280+0000 7fc7ec085740 20 client.15066 populate_metadata read hostname 'smithi033' 2024-09-12T12:25:35.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.280+0000 7fc7ec085740 1 --2- 172.21.15.33:0/235794430 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x55ee0c364250 0x55ee0c362f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:35.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.280+0000 7fc7ec085740 4 client.15066 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:25:35.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.280+0000 7fc7ec085740 1 -- 172.21.15.33:0/235794430 --> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] -- command(tid 0: {"prefix": "status"}) -- 0x55ee0c247b10 con 0x55ee0c364250 2024-09-12T12:25:35.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.280+0000 7fc7e37fe640 1 --2- 172.21.15.33:0/235794430 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x55ee0c364250 0x55ee0c362f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:35.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.280+0000 7fc7e37fe640 1 --2- 172.21.15.33:0/235794430 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x55ee0c364250 0x55ee0c362f60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ca3c3b76c7da33af server_cookie=116fe4b1cc5f84fe in_seq=0 out_seq=0 2024-09-12T12:25:35.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.280+0000 7fc7c2ffd640 10 client.15066 ms_handle_connect on v2:172.21.15.102:6834/4179527539 2024-09-12T12:25:35.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.281+0000 7fc7c2ffd640 1 -- 172.21.15.33:0/235794430 <== mds.2 v2:172.21.15.102:6834/4179527539 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55ee0c247b10 con 0x55ee0c364250 2024-09-12T12:25:35.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.281+0000 7fc7c2ffd640 10 client.15066 handle_command_reply: tid=0 2024-09-12T12:25:35.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.281+0000 7fc7ec085740 1 client.15066 shutdown 2024-09-12T12:25:35.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.281+0000 7fc7ec085740 1 -- 172.21.15.33:0/235794430 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee0c2da2f0 msgr2=0x55ee0c2ff2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:35.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.281+0000 7fc7ec085740 1 --2- 172.21.15.33:0/235794430 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee0c2da2f0 0x55ee0c2ff2b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc097a30 tx=0x7fc7cc097e70 comp rx=0 tx=0).stop 2024-09-12T12:25:35.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.281+0000 7fc7ec085740 1 -- 172.21.15.33:0/235794430 shutdown_connections 2024-09-12T12:25:35.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.281+0000 7fc7ec085740 1 --2- 172.21.15.33:0/235794430 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ee0c2e4bb0 0x55ee0c2fa210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:35.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.281+0000 7fc7ec085740 1 --2- 172.21.15.33:0/235794430 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee0c2da2f0 0x55ee0c2ff2b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:35.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.281+0000 7fc7ec085740 1 --2- 172.21.15.33:0/235794430 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x55ee0c364250 0x55ee0c362f60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:35.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.281+0000 7fc7ec085740 1 --2- 172.21.15.33:0/235794430 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ee0c2d99d0 0x55ee0c2fed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:35.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.281+0000 7fc7ec085740 1 -- 172.21.15.33:0/235794430 >> 172.21.15.33:0/235794430 conn(0x55ee0c2d5f60 msgr2=0x55ee0c2e1720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:35.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.281+0000 7fc7c2ffd640 0 client.15066 ms_handle_reset on v2:172.21.15.102:6834/4179527539 2024-09-12T12:25:35.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.281+0000 7fc7ec085740 1 -- 172.21.15.33:0/235794430 shutdown_connections 2024-09-12T12:25:35.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.281+0000 7fc7ec085740 1 -- 172.21.15.33:0/235794430 wait complete. 2024-09-12T12:25:35.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.281+0000 7fc7ec085740 20 client.15066 trim_cache size 0 max 16384 2024-09-12T12:25:35.294 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:25:35.294 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "a66dfafc-7100-11ef-bcea-c7b262605968", 2024-09-12T12:25:35.294 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 2, 2024-09-12T12:25:35.294 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 24478, 2024-09-12T12:25:35.295 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-09-12T12:25:35.295 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-09-12T12:25:35.295 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-09-12T12:25:35.295 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 67.504823189000007, 2024-09-12T12:25:35.295 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 24, 2024-09-12T12:25:35.295 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 87, 2024-09-12T12:25:35.295 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 85, 2024-09-12T12:25:35.295 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 135.67398816900001 2024-09-12T12:25:35.295 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:25:35.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.282+0000 7fc7e9cac640 1 -- 172.21.15.33:0/1253896107 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc7d00a2c10 msgr2=0x7fc7d00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:35.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.282+0000 7fc7e9cac640 1 --2- 172.21.15.33:0/1253896107 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc7d00a2c10 0x7fc7d00a50d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4031440 tx=0x7fc7d40058b0 comp rx=0 tx=0).stop 2024-09-12T12:25:35.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.282+0000 7fc7e9cac640 1 -- 172.21.15.33:0/1253896107 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7e4074eb0 msgr2=0x7fc7e41a4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:35.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.282+0000 7fc7e9cac640 1 --2- 172.21.15.33:0/1253896107 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7e4074eb0 0x7fc7e41a4bb0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc00d950 tx=0x7fc7cc00de10 comp rx=0 tx=0).stop 2024-09-12T12:25:35.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.282+0000 7fc7e9cac640 1 -- 172.21.15.33:0/1253896107 shutdown_connections 2024-09-12T12:25:35.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.282+0000 7fc7e9cac640 1 --2- 172.21.15.33:0/1253896107 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc7d00a2c10 0x7fc7d00a50d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:35.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.282+0000 7fc7e9cac640 1 --2- 172.21.15.33:0/1253896107 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7e4112b90 0x7fc7e419e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:35.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.282+0000 7fc7e9cac640 1 --2- 172.21.15.33:0/1253896107 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7e4074eb0 0x7fc7e41a4bb0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:35.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.282+0000 7fc7e9cac640 1 --2- 172.21.15.33:0/1253896107 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7e4074590 0x7fc7e41a4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:35.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.282+0000 7fc7e9cac640 1 -- 172.21.15.33:0/1253896107 >> 172.21.15.33:0/1253896107 conn(0x7fc7e40fd8c0 msgr2=0x7fc7e40ff580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:35.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.282+0000 7fc7e9cac640 1 -- 172.21.15.33:0/1253896107 shutdown_connections 2024-09-12T12:25:35.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:35.282+0000 7fc7e9cac640 1 -- 172.21.15.33:0/1253896107 wait complete. 2024-09-12T12:25:35.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:35 smithi033 ceph-mon[31246]: pgmap v335: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-12T12:25:35.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:35 smithi043 ceph-mon[34144]: pgmap v335: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-12T12:25:35.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:35 smithi102 ceph-mon[34799]: pgmap v335: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-12T12:25:36.094 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-12T12:25:36.358 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:36.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.828+0000 7fc56d2f9640 1 -- 172.21.15.33:0/2205866633 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc56810c170 msgr2=0x7fc56810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:36.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.828+0000 7fc56d2f9640 1 --2- 172.21.15.33:0/2205866633 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc56810c170 0x7fc56810e610 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc560009900 tx=0x7fc56002a480 comp rx=0 tx=0).stop 2024-09-12T12:25:36.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.828+0000 7fc56d2f9640 1 -- 172.21.15.33:0/2205866633 shutdown_connections 2024-09-12T12:25:36.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.828+0000 7fc56d2f9640 1 --2- 172.21.15.33:0/2205866633 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc56810c170 0x7fc56810e610 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.828+0000 7fc56d2f9640 1 --2- 172.21.15.33:0/2205866633 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc568103660 0x7fc56810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.828+0000 7fc56d2f9640 1 --2- 172.21.15.33:0/2205866633 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc568102d40 0x7fc568103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.828+0000 7fc56d2f9640 1 -- 172.21.15.33:0/2205866633 >> 172.21.15.33:0/2205866633 conn(0x7fc5680fc7a0 msgr2=0x7fc5680febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:36.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.828+0000 7fc56d2f9640 1 -- 172.21.15.33:0/2205866633 shutdown_connections 2024-09-12T12:25:36.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.828+0000 7fc56d2f9640 1 -- 172.21.15.33:0/2205866633 wait complete. 2024-09-12T12:25:36.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.829+0000 7fc56d2f9640 1 Processor -- start 2024-09-12T12:25:36.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.829+0000 7fc56d2f9640 1 -- start start 2024-09-12T12:25:36.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.829+0000 7fc56d2f9640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc568102d40 0x7fc568198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:36.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.829+0000 7fc56d2f9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc568103660 0x7fc568198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:36.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.829+0000 7fc56d2f9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc56810c170 0x7fc56819cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:36.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.829+0000 7fc56d2f9640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc568111e20 con 0x7fc568103660 2024-09-12T12:25:36.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.829+0000 7fc56d2f9640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc568111ca0 con 0x7fc568102d40 2024-09-12T12:25:36.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.829+0000 7fc56d2f9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc568111fa0 con 0x7fc56810c170 2024-09-12T12:25:36.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.829+0000 7fc5667fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc568103660 0x7fc568198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:36.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.829+0000 7fc5667fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc568103660 0x7fc568198880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45752/0 (socket says 172.21.15.33:45752) 2024-09-12T12:25:36.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.829+0000 7fc5667fc640 1 -- 172.21.15.33:0/1461195445 learned_addr learned my addr 172.21.15.33:0/1461195445 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:36.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.829+0000 7fc5677fe640 1 --2- 172.21.15.33:0/1461195445 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc56810c170 0x7fc56819cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:36.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.829+0000 7fc566ffd640 1 --2- 172.21.15.33:0/1461195445 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc568102d40 0x7fc568198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:36.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.830+0000 7fc5667fc640 1 -- 172.21.15.33:0/1461195445 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc56810c170 msgr2=0x7fc56819cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:36.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.830+0000 7fc5667fc640 1 --2- 172.21.15.33:0/1461195445 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc56810c170 0x7fc56819cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.830+0000 7fc5667fc640 1 -- 172.21.15.33:0/1461195445 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc568102d40 msgr2=0x7fc568198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:36.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.830+0000 7fc5667fc640 1 --2- 172.21.15.33:0/1461195445 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc568102d40 0x7fc568198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.830+0000 7fc5667fc640 1 -- 172.21.15.33:0/1461195445 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc56819d2f0 con 0x7fc568103660 2024-09-12T12:25:36.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.830+0000 7fc5667fc640 1 --2- 172.21.15.33:0/1461195445 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc568103660 0x7fc568198880 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc55c00d740 tx=0x7fc55c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:36.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.830+0000 7fc54ffff640 1 -- 172.21.15.33:0/1461195445 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55c017070 con 0x7fc568103660 2024-09-12T12:25:36.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.830+0000 7fc54ffff640 1 -- 172.21.15.33:0/1461195445 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc55c00de50 con 0x7fc568103660 2024-09-12T12:25:36.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.830+0000 7fc56d2f9640 1 -- 172.21.15.33:0/1461195445 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc56819d5e0 con 0x7fc568103660 2024-09-12T12:25:36.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.830+0000 7fc54ffff640 1 -- 172.21.15.33:0/1461195445 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55c00f620 con 0x7fc568103660 2024-09-12T12:25:36.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.830+0000 7fc56d2f9640 1 -- 172.21.15.33:0/1461195445 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5681a4ec0 con 0x7fc568103660 2024-09-12T12:25:36.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.833+0000 7fc54ffff640 1 -- 172.21.15.33:0/1461195445 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc55c009c30 con 0x7fc568103660 2024-09-12T12:25:36.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.833+0000 7fc56f6d2740 1 Processor -- start 2024-09-12T12:25:36.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.833+0000 7fc56f6d2740 1 -- start start 2024-09-12T12:25:36.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.833+0000 7fc56f6d2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0b5be89d0 0x55a0b5be8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:36.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.833+0000 7fc56f6d2740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a0b5be92f0 0x55a0b5bf3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:36.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.833+0000 7fc56f6d2740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0b5bf3bb0 0x55a0b5bf5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:36.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.833+0000 7fc56f6d2740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a0b5b4f090 con 0x55a0b5bf3bb0 2024-09-12T12:25:36.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.833+0000 7fc56f6d2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a0b5af6a70 con 0x55a0b5be89d0 2024-09-12T12:25:36.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.833+0000 7fc56f6d2740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a0b5b4b050 con 0x55a0b5be92f0 2024-09-12T12:25:36.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.834+0000 7fc5667fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0b5bf3bb0 0x55a0b5bf5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:36.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.834+0000 7fc5667fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0b5bf3bb0 0x55a0b5bf5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45756/0 (socket says 172.21.15.33:45756) 2024-09-12T12:25:36.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.834+0000 7fc5667fc640 1 -- 172.21.15.33:0/1903149421 learned_addr learned my addr 172.21.15.33:0/1903149421 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:36.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.834+0000 7fc5677fe640 1 --2- 172.21.15.33:0/1903149421 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0b5be89d0 0x55a0b5be8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:36.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.834+0000 7fc54ffff640 1 --2- 172.21.15.33:0/1461195445 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc5500a2c10 0x7fc5500a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:36.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.834+0000 7fc566ffd640 1 --2- 172.21.15.33:0/1903149421 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a0b5be92f0 0x55a0b5bf3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:36.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.834+0000 7fc5677fe640 1 --2- 172.21.15.33:0/1461195445 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc5500a2c10 0x7fc5500a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:36.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.834+0000 7fc5667fc640 1 -- 172.21.15.33:0/1903149421 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a0b5be92f0 msgr2=0x55a0b5bf3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:36.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.834+0000 7fc5667fc640 1 --2- 172.21.15.33:0/1903149421 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a0b5be92f0 0x55a0b5bf3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.834+0000 7fc5667fc640 1 -- 172.21.15.33:0/1903149421 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0b5be89d0 msgr2=0x55a0b5be8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:36.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.834+0000 7fc5667fc640 1 --2- 172.21.15.33:0/1903149421 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0b5be89d0 0x55a0b5be8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.834+0000 7fc54ffff640 1 -- 172.21.15.33:0/1461195445 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7fc55c0cf1a0 con 0x7fc568103660 2024-09-12T12:25:36.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.834+0000 7fc5667fc640 1 -- 172.21.15.33:0/1903149421 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0b5b03130 con 0x55a0b5bf3bb0 2024-09-12T12:25:36.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.834+0000 7fc5667fc640 1 --2- 172.21.15.33:0/1903149421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0b5bf3bb0 0x55a0b5bf5fa0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc55c097eb0 tx=0x7fc55c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4115ba966ec3fab7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:36.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.834+0000 7fc54d7fa640 1 -- 172.21.15.33:0/1903149421 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55c020070 con 0x55a0b5bf3bb0 2024-09-12T12:25:36.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.834+0000 7fc5677fe640 1 --2- 172.21.15.33:0/1461195445 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc5500a2c10 0x7fc5500a50d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc560005940 tx=0x7fc56002a480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:36.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.834+0000 7fc54d7fa640 1 -- 172.21.15.33:0/1903149421 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc55c09bbe0 con 0x55a0b5bf3bb0 2024-09-12T12:25:36.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.835+0000 7fc54d7fa640 1 -- 172.21.15.33:0/1903149421 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55c097b50 con 0x55a0b5bf3bb0 2024-09-12T12:25:36.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.835+0000 7fc56f6d2740 1 -- 172.21.15.33:0/1903149421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0b5bf3bb0 msgr2=0x55a0b5bf5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:36.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.835+0000 7fc56f6d2740 1 --2- 172.21.15.33:0/1903149421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0b5bf3bb0 0x55a0b5bf5fa0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc55c097eb0 tx=0x7fc55c000bc0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.835+0000 7fc56f6d2740 1 -- 172.21.15.33:0/1903149421 shutdown_connections 2024-09-12T12:25:36.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.835+0000 7fc56f6d2740 1 --2- 172.21.15.33:0/1903149421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0b5bf3bb0 0x55a0b5bf5fa0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.835+0000 7fc56f6d2740 1 --2- 172.21.15.33:0/1903149421 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a0b5be92f0 0x55a0b5bf3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.835+0000 7fc56f6d2740 1 --2- 172.21.15.33:0/1903149421 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0b5be89d0 0x55a0b5be8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.835+0000 7fc56f6d2740 1 -- 172.21.15.33:0/1903149421 >> 172.21.15.33:0/1903149421 conn(0x55a0b5be4f60 msgr2=0x55a0b5be5340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:36.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.835+0000 7fc56f6d2740 1 -- 172.21.15.33:0/1903149421 shutdown_connections 2024-09-12T12:25:36.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.835+0000 7fc56f6d2740 1 -- 172.21.15.33:0/1903149421 wait complete. 2024-09-12T12:25:36.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.836+0000 7fc56f6d2740 1 -- start start 2024-09-12T12:25:36.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.836+0000 7fc56f6d2740 1 Processor -- start 2024-09-12T12:25:36.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.836+0000 7fc56f6d2740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a0b5be89d0 0x55a0b5bf3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:36.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.836+0000 7fc56f6d2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0b5be92f0 0x55a0b5bf0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:36.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.836+0000 7fc56f6d2740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0b5bf3bb0 0x55a0b5bf0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:36.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.836+0000 7fc56f6d2740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a0b5bf6720 con 0x55a0b5bf3bb0 2024-09-12T12:25:36.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.836+0000 7fc56f6d2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a0b5b09f20 con 0x55a0b5be92f0 2024-09-12T12:25:36.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.836+0000 7fc56f6d2740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a0b5bf68a0 con 0x55a0b5be89d0 2024-09-12T12:25:36.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.836+0000 7fc56f6d2740 10 client.0 _ll_register_callbacks cb 0x55a0b5ad3030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:36.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.836+0000 7fc5677fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0b5bf3bb0 0x55a0b5bf0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:36.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.836+0000 7fc5677fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0b5bf3bb0 0x55a0b5bf0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45770/0 (socket says 172.21.15.33:45770) 2024-09-12T12:25:36.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.836+0000 7fc5677fe640 1 -- 172.21.15.33:0/1946401880 learned_addr learned my addr 172.21.15.33:0/1946401880 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:36.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.836+0000 7fc5667fc640 1 --2- 172.21.15.33:0/1946401880 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0b5be92f0 0x55a0b5bf0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:36.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.836+0000 7fc566ffd640 1 --2- 172.21.15.33:0/1946401880 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a0b5be89d0 0x55a0b5bf3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:36.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.836+0000 7fc5677fe640 1 -- 172.21.15.33:0/1946401880 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a0b5be89d0 msgr2=0x55a0b5bf3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:36.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.836+0000 7fc5677fe640 1 --2- 172.21.15.33:0/1946401880 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a0b5be89d0 0x55a0b5bf3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.836+0000 7fc5677fe640 1 -- 172.21.15.33:0/1946401880 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0b5be92f0 msgr2=0x55a0b5bf0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:36.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.836+0000 7fc5677fe640 1 --2- 172.21.15.33:0/1946401880 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0b5be92f0 0x55a0b5bf0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.836+0000 7fc5677fe640 1 -- 172.21.15.33:0/1946401880 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0b58c02b0 con 0x55a0b5bf3bb0 2024-09-12T12:25:36.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.836+0000 7fc566ffd640 1 --2- 172.21.15.33:0/1946401880 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a0b5be89d0 0x55a0b5bf3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:25:36.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.836+0000 7fc5667fc640 1 --2- 172.21.15.33:0/1946401880 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0b5be92f0 0x55a0b5bf0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:25:36.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.837+0000 7fc5677fe640 1 --2- 172.21.15.33:0/1946401880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0b5bf3bb0 0x55a0b5bf0cc0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc560033000 tx=0x7fc560009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9f5096764a81e7a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:36.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.837+0000 7fc54aff5640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:25:36.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.837+0000 7fc54aff5640 1 -- 172.21.15.33:0/1946401880 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc560052020 con 0x55a0b5bf3bb0 2024-09-12T12:25:36.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.837+0000 7fc54aff5640 1 -- 172.21.15.33:0/1946401880 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7fc560004390 con 0x55a0b5bf3bb0 2024-09-12T12:25:36.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.837+0000 7fc56f6d2740 1 -- 172.21.15.33:0/1946401880 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc55c09bbe0 con 0x55a0b5bf3bb0 2024-09-12T12:25:36.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.837+0000 7fc54aff5640 1 -- 172.21.15.33:0/1946401880 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc56005d050 con 0x55a0b5bf3bb0 2024-09-12T12:25:36.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.837+0000 7fc56f6d2740 10 client.15078 fetch_fsmap learned FSMap version 24 2024-09-12T12:25:36.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.837+0000 7fc56f6d2740 1 -- 172.21.15.33:0/1946401880 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a0b5c02030 con 0x55a0b5bf3bb0 2024-09-12T12:25:36.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.837+0000 7fc54aff5640 1 -- 172.21.15.33:0/1946401880 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc55c09bbe0 con 0x55a0b5bf3bb0 2024-09-12T12:25:36.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.837+0000 7fc54aff5640 1 -- 172.21.15.33:0/1946401880 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7fc560004a20 con 0x55a0b5bf3bb0 2024-09-12T12:25:36.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.837+0000 7fc56f6d2740 10 client.15078 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T12:25:36.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.837+0000 7fc56f6d2740 10 client.15078 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T12:25:36.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.837+0000 7fc56f6d2740 20 client.15078 populate_metadata read hostname 'smithi033' 2024-09-12T12:25:36.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.837+0000 7fc56f6d2740 1 --2- 172.21.15.33:0/1946401880 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x55a0b5c046e0 0x55a0b5c05b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:36.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.837+0000 7fc56f6d2740 4 client.15078 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:25:36.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.837+0000 7fc56f6d2740 1 -- 172.21.15.33:0/1946401880 --> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a0b5b5c600 con 0x55a0b5c046e0 2024-09-12T12:25:36.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.838+0000 7fc566ffd640 1 --2- 172.21.15.33:0/1946401880 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x55a0b5c046e0 0x55a0b5c05b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:36.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.838+0000 7fc566ffd640 1 --2- 172.21.15.33:0/1946401880 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x55a0b5c046e0 0x55a0b5c05b50 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5eb9e7898339b202 server_cookie=d4c885581e37882 in_seq=0 out_seq=0 2024-09-12T12:25:36.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.838+0000 7fc54aff5640 10 client.15078 ms_handle_connect on v2:172.21.15.102:6836/2409953270 2024-09-12T12:25:36.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.839+0000 7fc54aff5640 1 -- 172.21.15.33:0/1946401880 <== mds.1 v2:172.21.15.102:6836/2409953270 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a0b5b5c600 con 0x55a0b5c046e0 2024-09-12T12:25:36.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.839+0000 7fc54aff5640 10 client.15078 handle_command_reply: tid=0 2024-09-12T12:25:36.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.839+0000 7fc56f6d2740 1 client.15078 shutdown 2024-09-12T12:25:36.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.839+0000 7fc56f6d2740 1 -- 172.21.15.33:0/1946401880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0b5bf3bb0 msgr2=0x55a0b5bf0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:36.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.839+0000 7fc56f6d2740 1 --2- 172.21.15.33:0/1946401880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0b5bf3bb0 0x55a0b5bf0cc0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc560033000 tx=0x7fc560009260 comp rx=0 tx=0).stop 2024-09-12T12:25:36.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.839+0000 7fc56f6d2740 1 -- 172.21.15.33:0/1946401880 shutdown_connections 2024-09-12T12:25:36.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.839+0000 7fc56f6d2740 1 --2- 172.21.15.33:0/1946401880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0b5bf3bb0 0x55a0b5bf0cc0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.839+0000 7fc56f6d2740 1 --2- 172.21.15.33:0/1946401880 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0b5be92f0 0x55a0b5bf0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.839+0000 7fc56f6d2740 1 --2- 172.21.15.33:0/1946401880 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x55a0b5c046e0 0x55a0b5c05b50 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.839+0000 7fc54aff5640 0 client.15078 ms_handle_reset on v2:172.21.15.102:6836/2409953270 2024-09-12T12:25:36.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.839+0000 7fc56f6d2740 1 --2- 172.21.15.33:0/1946401880 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a0b5be89d0 0x55a0b5bf3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.839+0000 7fc56f6d2740 1 -- 172.21.15.33:0/1946401880 >> 172.21.15.33:0/1946401880 conn(0x55a0b5be4f60 msgr2=0x55a0b5beac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:36.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.839+0000 7fc56f6d2740 1 -- 172.21.15.33:0/1946401880 shutdown_connections 2024-09-12T12:25:36.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.839+0000 7fc56f6d2740 1 -- 172.21.15.33:0/1946401880 wait complete. 2024-09-12T12:25:36.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.840+0000 7fc56f6d2740 20 client.15078 trim_cache size 0 max 16384 2024-09-12T12:25:36.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.857+0000 7fc56f6d2740 1 Processor -- start 2024-09-12T12:25:36.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.857+0000 7fc56f6d2740 1 -- start start 2024-09-12T12:25:36.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.858+0000 7fc56f6d2740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a0b5be89d0 0x55a0b5bf0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:36.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.858+0000 7fc56f6d2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0b5be92f0 0x55a0b5bf0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:36.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.858+0000 7fc56f6d2740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0b5bf3bb0 0x55a0b5bf0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:36.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.858+0000 7fc56f6d2740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a0b5c03e90 con 0x55a0b5bf3bb0 2024-09-12T12:25:36.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.858+0000 7fc56f6d2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a0b5c04560 con 0x55a0b5be92f0 2024-09-12T12:25:36.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.858+0000 7fc56f6d2740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a0b5c04c30 con 0x55a0b5be89d0 2024-09-12T12:25:36.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.858+0000 7fc5677fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0b5bf3bb0 0x55a0b5bf0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:36.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.858+0000 7fc5677fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0b5bf3bb0 0x55a0b5bf0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45780/0 (socket says 172.21.15.33:45780) 2024-09-12T12:25:36.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.858+0000 7fc5677fe640 1 -- 172.21.15.33:0/1658033143 learned_addr learned my addr 172.21.15.33:0/1658033143 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:36.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.858+0000 7fc566ffd640 1 --2- 172.21.15.33:0/1658033143 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a0b5be89d0 0x55a0b5bf0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:36.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.858+0000 7fc5677fe640 1 -- 172.21.15.33:0/1658033143 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a0b5be89d0 msgr2=0x55a0b5bf0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:36.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.858+0000 7fc5677fe640 1 --2- 172.21.15.33:0/1658033143 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a0b5be89d0 0x55a0b5bf0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.858+0000 7fc5677fe640 1 -- 172.21.15.33:0/1658033143 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0b5be92f0 msgr2=0x55a0b5bf0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:36.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.858+0000 7fc5677fe640 1 --2- 172.21.15.33:0/1658033143 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0b5be92f0 0x55a0b5bf0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.858+0000 7fc5677fe640 1 -- 172.21.15.33:0/1658033143 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0b5be9120 con 0x55a0b5bf3bb0 2024-09-12T12:25:36.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.858+0000 7fc5677fe640 1 --2- 172.21.15.33:0/1658033143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0b5bf3bb0 0x55a0b5bf0c80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc560009230 tx=0x7fc560005410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53794de0b3ec0243 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:36.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.858+0000 7fc54cff9640 1 -- 172.21.15.33:0/1658033143 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc560066070 con 0x55a0b5bf3bb0 2024-09-12T12:25:36.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.858+0000 7fc54cff9640 1 -- 172.21.15.33:0/1658033143 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc5600046c0 con 0x55a0b5bf3bb0 2024-09-12T12:25:36.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.858+0000 7fc54cff9640 1 -- 172.21.15.33:0/1658033143 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc560052040 con 0x55a0b5bf3bb0 2024-09-12T12:25:36.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.859+0000 7fc56f6d2740 1 -- 172.21.15.33:0/1658033143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0b5bf3bb0 msgr2=0x55a0b5bf0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:36.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.859+0000 7fc56f6d2740 1 --2- 172.21.15.33:0/1658033143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0b5bf3bb0 0x55a0b5bf0c80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc560009230 tx=0x7fc560005410 comp rx=0 tx=0).stop 2024-09-12T12:25:36.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.859+0000 7fc56f6d2740 1 -- 172.21.15.33:0/1658033143 shutdown_connections 2024-09-12T12:25:36.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.859+0000 7fc56f6d2740 1 --2- 172.21.15.33:0/1658033143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0b5bf3bb0 0x55a0b5bf0c80 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.859+0000 7fc56f6d2740 1 --2- 172.21.15.33:0/1658033143 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0b5be92f0 0x55a0b5bf0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.859+0000 7fc56f6d2740 1 --2- 172.21.15.33:0/1658033143 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a0b5be89d0 0x55a0b5bf0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.859+0000 7fc56f6d2740 1 -- 172.21.15.33:0/1658033143 >> 172.21.15.33:0/1658033143 conn(0x55a0b5be4f60 msgr2=0x55a0b5bdfce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:36.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.859+0000 7fc56f6d2740 1 -- 172.21.15.33:0/1658033143 shutdown_connections 2024-09-12T12:25:36.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.859+0000 7fc56f6d2740 1 -- 172.21.15.33:0/1658033143 wait complete. 2024-09-12T12:25:36.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.860+0000 7fc56f6d2740 1 -- start start 2024-09-12T12:25:36.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.860+0000 7fc56f6d2740 1 Processor -- start 2024-09-12T12:25:36.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.860+0000 7fc56f6d2740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0b5be89d0 0x55a0b5c07050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:36.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.860+0000 7fc56f6d2740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a0b5be92f0 0x55a0b5c07590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:36.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.860+0000 7fc56f6d2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0b5bf3bb0 0x55a0b5c6cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:36.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.860+0000 7fc56f6d2740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a0b5c059d0 con 0x55a0b5be89d0 2024-09-12T12:25:36.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.860+0000 7fc56f6d2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a0b5c05300 con 0x55a0b5bf3bb0 2024-09-12T12:25:36.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.860+0000 7fc56f6d2740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a0b5c060a0 con 0x55a0b5be92f0 2024-09-12T12:25:36.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.860+0000 7fc56f6d2740 10 client.0 _ll_register_callbacks cb 0x7fc560005bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:36.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.860+0000 7fc566ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0b5be89d0 0x55a0b5c07050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:36.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.860+0000 7fc566ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0b5be89d0 0x55a0b5c07050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45786/0 (socket says 172.21.15.33:45786) 2024-09-12T12:25:36.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.860+0000 7fc566ffd640 1 -- 172.21.15.33:0/728042026 learned_addr learned my addr 172.21.15.33:0/728042026 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:36.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.860+0000 7fc5677fe640 1 --2- 172.21.15.33:0/728042026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0b5bf3bb0 0x55a0b5c6cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:36.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.860+0000 7fc5667fc640 1 --2- 172.21.15.33:0/728042026 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a0b5be92f0 0x55a0b5c07590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:36.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.860+0000 7fc566ffd640 1 -- 172.21.15.33:0/728042026 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a0b5be92f0 msgr2=0x55a0b5c07590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:36.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.860+0000 7fc566ffd640 1 --2- 172.21.15.33:0/728042026 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a0b5be92f0 0x55a0b5c07590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.860+0000 7fc566ffd640 1 -- 172.21.15.33:0/728042026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0b5bf3bb0 msgr2=0x55a0b5c6cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:36.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.860+0000 7fc566ffd640 1 --2- 172.21.15.33:0/728042026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0b5bf3bb0 0x55a0b5c6cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.860+0000 7fc566ffd640 1 -- 172.21.15.33:0/728042026 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0b5c6d320 con 0x55a0b5be89d0 2024-09-12T12:25:36.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.860+0000 7fc5677fe640 1 --2- 172.21.15.33:0/728042026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0b5bf3bb0 0x55a0b5c6cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:36.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.861+0000 7fc566ffd640 1 --2- 172.21.15.33:0/728042026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0b5be89d0 0x55a0b5c07050 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc558004c60 tx=0x7fc558012920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=546c6d3f6340700d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:36.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.861+0000 7fc54aff5640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:25:36.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.861+0000 7fc54aff5640 1 -- 172.21.15.33:0/728042026 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc558005450 con 0x55a0b5be89d0 2024-09-12T12:25:36.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.861+0000 7fc54aff5640 1 -- 172.21.15.33:0/728042026 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7fc5580055f0 con 0x55a0b5be89d0 2024-09-12T12:25:36.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.861+0000 7fc56f6d2740 1 -- 172.21.15.33:0/728042026 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5600046c0 con 0x55a0b5be89d0 2024-09-12T12:25:36.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.861+0000 7fc54aff5640 1 -- 172.21.15.33:0/728042026 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc55802c050 con 0x55a0b5be89d0 2024-09-12T12:25:36.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.861+0000 7fc56f6d2740 10 client.15084 fetch_fsmap learned FSMap version 24 2024-09-12T12:25:36.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.861+0000 7fc56f6d2740 1 -- 172.21.15.33:0/728042026 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a0b5c6e4d0 con 0x55a0b5be89d0 2024-09-12T12:25:36.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.861+0000 7fc54aff5640 1 -- 172.21.15.33:0/728042026 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc5600046c0 con 0x55a0b5be89d0 2024-09-12T12:25:36.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.861+0000 7fc54aff5640 1 -- 172.21.15.33:0/728042026 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7fc55800f040 con 0x55a0b5be89d0 2024-09-12T12:25:36.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.861+0000 7fc56f6d2740 10 client.15084 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T12:25:36.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.861+0000 7fc56f6d2740 10 client.15084 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T12:25:36.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.861+0000 7fc56f6d2740 20 client.15084 populate_metadata read hostname 'smithi033' 2024-09-12T12:25:36.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.861+0000 7fc56f6d2740 1 --2- 172.21.15.33:0/728042026 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x55a0b5c046e0 0x55a0b5c71dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:36.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.861+0000 7fc56f6d2740 4 client.15084 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:25:36.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.861+0000 7fc56f6d2740 1 -- 172.21.15.33:0/728042026 --> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] -- command(tid 0: {"prefix": "status"}) -- 0x55a0b5b56b10 con 0x55a0b5c046e0 2024-09-12T12:25:36.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.862+0000 7fc5667fc640 1 --2- 172.21.15.33:0/728042026 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x55a0b5c046e0 0x55a0b5c71dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:36.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.862+0000 7fc5667fc640 1 --2- 172.21.15.33:0/728042026 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x55a0b5c046e0 0x55a0b5c71dc0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cf303beb129df7f1 server_cookie=edde886fa22844dc in_seq=0 out_seq=0 2024-09-12T12:25:36.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.862+0000 7fc54aff5640 10 client.15084 ms_handle_connect on v2:172.21.15.102:6836/2409953270 2024-09-12T12:25:36.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.862+0000 7fc54aff5640 1 -- 172.21.15.33:0/728042026 <== mds.1 v2:172.21.15.102:6836/2409953270 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55a0b5b56b10 con 0x55a0b5c046e0 2024-09-12T12:25:36.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.862+0000 7fc54aff5640 10 client.15084 handle_command_reply: tid=0 2024-09-12T12:25:36.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.862+0000 7fc56f6d2740 1 client.15084 shutdown 2024-09-12T12:25:36.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.862+0000 7fc56f6d2740 1 -- 172.21.15.33:0/728042026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0b5be89d0 msgr2=0x55a0b5c07050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:36.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.862+0000 7fc56f6d2740 1 --2- 172.21.15.33:0/728042026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0b5be89d0 0x55a0b5c07050 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc558004c60 tx=0x7fc558012920 comp rx=0 tx=0).stop 2024-09-12T12:25:36.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.862+0000 7fc56f6d2740 1 -- 172.21.15.33:0/728042026 shutdown_connections 2024-09-12T12:25:36.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.862+0000 7fc56f6d2740 1 --2- 172.21.15.33:0/728042026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0b5bf3bb0 0x55a0b5c6cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.862+0000 7fc56f6d2740 1 --2- 172.21.15.33:0/728042026 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x55a0b5c046e0 0x55a0b5c71dc0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.862+0000 7fc56f6d2740 1 --2- 172.21.15.33:0/728042026 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a0b5be92f0 0x55a0b5c07590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.862+0000 7fc56f6d2740 1 --2- 172.21.15.33:0/728042026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0b5be89d0 0x55a0b5c07050 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.862+0000 7fc54aff5640 0 client.15084 ms_handle_reset on v2:172.21.15.102:6836/2409953270 2024-09-12T12:25:36.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.862+0000 7fc56f6d2740 1 -- 172.21.15.33:0/728042026 >> 172.21.15.33:0/728042026 conn(0x55a0b5be4f60 msgr2=0x55a0b5bf0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:36.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.863+0000 7fc56f6d2740 1 -- 172.21.15.33:0/728042026 shutdown_connections 2024-09-12T12:25:36.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.863+0000 7fc56f6d2740 1 -- 172.21.15.33:0/728042026 wait complete. 2024-09-12T12:25:36.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.863+0000 7fc56f6d2740 20 client.15084 trim_cache size 0 max 16384 2024-09-12T12:25:36.868 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:25:36.868 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "a66dfafc-7100-11ef-bcea-c7b262605968", 2024-09-12T12:25:36.868 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 1, 2024-09-12T12:25:36.868 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 24490, 2024-09-12T12:25:36.869 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-09-12T12:25:36.869 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-09-12T12:25:36.869 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-09-12T12:25:36.869 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 70.092679798000006, 2024-09-12T12:25:36.869 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 24, 2024-09-12T12:25:36.869 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 87, 2024-09-12T12:25:36.869 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 85, 2024-09-12T12:25:36.869 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 134.62459480300001 2024-09-12T12:25:36.869 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:25:36.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.863+0000 7fc56d2f9640 1 -- 172.21.15.33:0/1461195445 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc5500a2c10 msgr2=0x7fc5500a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:36.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.863+0000 7fc56d2f9640 1 --2- 172.21.15.33:0/1461195445 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc5500a2c10 0x7fc5500a50d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc560005940 tx=0x7fc56002a480 comp rx=0 tx=0).stop 2024-09-12T12:25:36.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.863+0000 7fc56d2f9640 1 -- 172.21.15.33:0/1461195445 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc568103660 msgr2=0x7fc568198880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:36.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.863+0000 7fc56d2f9640 1 --2- 172.21.15.33:0/1461195445 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc568103660 0x7fc568198880 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc55c00d740 tx=0x7fc55c00dc00 comp rx=0 tx=0).stop 2024-09-12T12:25:36.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.863+0000 7fc56d2f9640 1 -- 172.21.15.33:0/1461195445 shutdown_connections 2024-09-12T12:25:36.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.863+0000 7fc56d2f9640 1 --2- 172.21.15.33:0/1461195445 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc5500a2c10 0x7fc5500a50d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.863+0000 7fc56d2f9640 1 --2- 172.21.15.33:0/1461195445 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc56810c170 0x7fc56819cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.863+0000 7fc56d2f9640 1 --2- 172.21.15.33:0/1461195445 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc568103660 0x7fc568198880 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.863+0000 7fc56d2f9640 1 --2- 172.21.15.33:0/1461195445 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc568102d40 0x7fc568198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:36.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.863+0000 7fc56d2f9640 1 -- 172.21.15.33:0/1461195445 >> 172.21.15.33:0/1461195445 conn(0x7fc5680fc7a0 msgr2=0x7fc5680fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:36.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.863+0000 7fc56d2f9640 1 -- 172.21.15.33:0/1461195445 shutdown_connections 2024-09-12T12:25:36.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:36.863+0000 7fc56d2f9640 1 -- 172.21.15.33:0/1461195445 wait complete. 2024-09-12T12:25:37.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:37 smithi033 ceph-mon[31246]: pgmap v336: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T12:25:37.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:37 smithi043 ceph-mon[34144]: pgmap v336: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T12:25:37.616 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-12T12:25:37.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:37 smithi102 ceph-mon[34799]: pgmap v336: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T12:25:37.873 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:38.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.358+0000 7f28d4c48640 1 -- 172.21.15.33:0/2437822513 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28d0106f50 msgr2=0x7f28d010eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:38.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.358+0000 7f28d4c48640 1 --2- 172.21.15.33:0/2437822513 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28d0106f50 0x7f28d010eaf0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f28c8009cd0 tx=0x7f28c802a8e0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.358+0000 7f28d4c48640 1 -- 172.21.15.33:0/2437822513 shutdown_connections 2024-09-12T12:25:38.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.358+0000 7f28d4c48640 1 --2- 172.21.15.33:0/2437822513 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28d0106f50 0x7f28d010eaf0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.358+0000 7f28d4c48640 1 --2- 172.21.15.33:0/2437822513 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28d0100ca0 0x7f28d0106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.358+0000 7f28d4c48640 1 --2- 172.21.15.33:0/2437822513 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28d01002f0 0x7f28d01006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.358+0000 7f28d4c48640 1 -- 172.21.15.33:0/2437822513 >> 172.21.15.33:0/2437822513 conn(0x7f28d0077210 msgr2=0x7f28d00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:38.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.358+0000 7f28d4c48640 1 -- 172.21.15.33:0/2437822513 shutdown_connections 2024-09-12T12:25:38.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.358+0000 7f28d4c48640 1 -- 172.21.15.33:0/2437822513 wait complete. 2024-09-12T12:25:38.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.359+0000 7f28d4c48640 1 Processor -- start 2024-09-12T12:25:38.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.359+0000 7f28d4c48640 1 -- start start 2024-09-12T12:25:38.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.359+0000 7f28d4c48640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28d01002f0 0x7f28d0198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:38.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.359+0000 7f28d4c48640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28d0100ca0 0x7f28d01988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:38.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.359+0000 7f28d4c48640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28d0106f50 0x7f28d019cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:38.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.359+0000 7f28d4c48640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f28d0111e50 con 0x7f28d0100ca0 2024-09-12T12:25:38.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.359+0000 7f28d4c48640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f28d0111cd0 con 0x7f28d0106f50 2024-09-12T12:25:38.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.359+0000 7f28d4c48640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f28d0111fd0 con 0x7f28d01002f0 2024-09-12T12:25:38.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.359+0000 7f28c7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28d0100ca0 0x7f28d01988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:38.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.359+0000 7f28c7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28d0100ca0 0x7f28d01988d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45804/0 (socket says 172.21.15.33:45804) 2024-09-12T12:25:38.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.359+0000 7f28c7fff640 1 -- 172.21.15.33:0/4195968901 learned_addr learned my addr 172.21.15.33:0/4195968901 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:38.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.359+0000 7f28ce59c640 1 --2- 172.21.15.33:0/4195968901 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28d01002f0 0x7f28d0198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:38.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.360+0000 7f28ced9d640 1 --2- 172.21.15.33:0/4195968901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28d0106f50 0x7f28d019cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:38.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.360+0000 7f28c7fff640 1 -- 172.21.15.33:0/4195968901 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28d01002f0 msgr2=0x7f28d0198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:38.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.360+0000 7f28c7fff640 1 --2- 172.21.15.33:0/4195968901 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28d01002f0 0x7f28d0198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.360+0000 7f28c7fff640 1 -- 172.21.15.33:0/4195968901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28d0106f50 msgr2=0x7f28d019cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:38.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.360+0000 7f28c7fff640 1 --2- 172.21.15.33:0/4195968901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28d0106f50 0x7f28d019cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.360+0000 7f28c7fff640 1 -- 172.21.15.33:0/4195968901 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28d019d340 con 0x7f28d0100ca0 2024-09-12T12:25:38.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.360+0000 7f28c7fff640 1 --2- 172.21.15.33:0/4195968901 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28d0100ca0 0x7f28d01988d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f28b800d770 tx=0x7f28b800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:38.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.360+0000 7f28c77fe640 1 -- 172.21.15.33:0/4195968901 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b8017070 con 0x7f28d0100ca0 2024-09-12T12:25:38.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.360+0000 7f28d4c48640 1 -- 172.21.15.33:0/4195968901 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28d019d630 con 0x7f28d0100ca0 2024-09-12T12:25:38.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.360+0000 7f28c77fe640 1 -- 172.21.15.33:0/4195968901 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f28b8009c30 con 0x7f28d0100ca0 2024-09-12T12:25:38.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.360+0000 7f28c77fe640 1 -- 172.21.15.33:0/4195968901 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b800f620 con 0x7f28d0100ca0 2024-09-12T12:25:38.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.360+0000 7f28d4c48640 1 -- 172.21.15.33:0/4195968901 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28d01a4f10 con 0x7f28d0100ca0 2024-09-12T12:25:38.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.362+0000 7f28c77fe640 1 -- 172.21.15.33:0/4195968901 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f28b801a070 con 0x7f28d0100ca0 2024-09-12T12:25:38.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.363+0000 7f28d7021740 1 Processor -- start 2024-09-12T12:25:38.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.363+0000 7f28d7021740 1 -- start start 2024-09-12T12:25:38.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.363+0000 7f28d7021740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586ed3cd8b0 0x5586ed3cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:38.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.363+0000 7f28d7021740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586ed3ce1d0 0x5586ed3dca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:38.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.363+0000 7f28d7021740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586ed3dcfc0 0x5586ed3df3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:38.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.363+0000 7f28d7021740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5586ed334090 con 0x5586ed3ce1d0 2024-09-12T12:25:38.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.363+0000 7f28d7021740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5586ed2dba70 con 0x5586ed3cd8b0 2024-09-12T12:25:38.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.363+0000 7f28d7021740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5586ed330050 con 0x5586ed3dcfc0 2024-09-12T12:25:38.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.363+0000 7f28ce59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586ed3ce1d0 0x5586ed3dca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:38.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.363+0000 7f28ce59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586ed3ce1d0 0x5586ed3dca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45814/0 (socket says 172.21.15.33:45814) 2024-09-12T12:25:38.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.363+0000 7f28ce59c640 1 -- 172.21.15.33:0/3219624937 learned_addr learned my addr 172.21.15.33:0/3219624937 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:38.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.363+0000 7f28ced9d640 1 --2- 172.21.15.33:0/3219624937 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586ed3cd8b0 0x5586ed3cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:38.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.363+0000 7f28c77fe640 1 --2- 172.21.15.33:0/4195968901 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f28bc0a2c10 0x7f28bc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:38.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.363+0000 7f28ced9d640 1 --2- 172.21.15.33:0/4195968901 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f28bc0a2c10 0x7f28bc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:38.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.364+0000 7f28c77fe640 1 -- 172.21.15.33:0/4195968901 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7f28b80ceff0 con 0x7f28d0100ca0 2024-09-12T12:25:38.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.364+0000 7f28c7fff640 1 --2- 172.21.15.33:0/3219624937 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586ed3dcfc0 0x5586ed3df3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:38.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.364+0000 7f28ced9d640 1 -- 172.21.15.33:0/3219624937 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586ed3dcfc0 msgr2=0x5586ed3df3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:38.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.364+0000 7f28ced9d640 1 --2- 172.21.15.33:0/3219624937 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586ed3dcfc0 0x5586ed3df3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.364+0000 7f28ced9d640 1 -- 172.21.15.33:0/3219624937 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586ed3ce1d0 msgr2=0x5586ed3dca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:38.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.364+0000 7f28ced9d640 1 --2- 172.21.15.33:0/3219624937 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586ed3ce1d0 0x5586ed3dca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.364+0000 7f28ced9d640 1 -- 172.21.15.33:0/3219624937 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586ed2e8130 con 0x5586ed3cd8b0 2024-09-12T12:25:38.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.364+0000 7f28ce59c640 1 --2- 172.21.15.33:0/3219624937 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586ed3ce1d0 0x5586ed3dca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:25:38.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.364+0000 7f28ced9d640 1 --2- 172.21.15.33:0/3219624937 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586ed3cd8b0 0x5586ed3cdc90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f28c8005e30 tx=0x7f28c8031950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=438075e73f78959c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:38.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.364+0000 7f28ced9d640 1 --2- 172.21.15.33:0/4195968901 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f28bc0a2c10 0x7f28bc0a50d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f28c8045000 tx=0x7f28c8048000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:38.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.364+0000 7f28c4ff9640 1 -- 172.21.15.33:0/3219624937 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c8004410 con 0x5586ed3cd8b0 2024-09-12T12:25:38.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.364+0000 7f28c4ff9640 1 -- 172.21.15.33:0/3219624937 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f28c8036040 con 0x5586ed3cd8b0 2024-09-12T12:25:38.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.364+0000 7f28c4ff9640 1 -- 172.21.15.33:0/3219624937 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c8030d50 con 0x5586ed3cd8b0 2024-09-12T12:25:38.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.365+0000 7f28d7021740 1 -- 172.21.15.33:0/3219624937 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586ed3cd8b0 msgr2=0x5586ed3cdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:38.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.365+0000 7f28d7021740 1 --2- 172.21.15.33:0/3219624937 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586ed3cd8b0 0x5586ed3cdc90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f28c8005e30 tx=0x7f28c8031950 comp rx=0 tx=0).stop 2024-09-12T12:25:38.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.365+0000 7f28d7021740 1 -- 172.21.15.33:0/3219624937 shutdown_connections 2024-09-12T12:25:38.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.365+0000 7f28d7021740 1 --2- 172.21.15.33:0/3219624937 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586ed3dcfc0 0x5586ed3df3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.365+0000 7f28d7021740 1 --2- 172.21.15.33:0/3219624937 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586ed3ce1d0 0x5586ed3dca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.365+0000 7f28d7021740 1 --2- 172.21.15.33:0/3219624937 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586ed3cd8b0 0x5586ed3cdc90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.365+0000 7f28d7021740 1 -- 172.21.15.33:0/3219624937 >> 172.21.15.33:0/3219624937 conn(0x5586ed3c9f60 msgr2=0x5586ed3ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:38.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.365+0000 7f28d7021740 1 -- 172.21.15.33:0/3219624937 shutdown_connections 2024-09-12T12:25:38.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.365+0000 7f28d7021740 1 -- 172.21.15.33:0/3219624937 wait complete. 2024-09-12T12:25:38.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.366+0000 7f28d7021740 1 -- start start 2024-09-12T12:25:38.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.366+0000 7f28d7021740 1 Processor -- start 2024-09-12T12:25:38.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.366+0000 7f28d7021740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586ed3cd8b0 0x5586ed3dc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:38.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.366+0000 7f28d7021740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586ed3ce1d0 0x5586ed3d9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:38.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.366+0000 7f28d7021740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586ed3dcfc0 0x5586ed3da0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:38.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.366+0000 7f28d7021740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5586ed3dfb90 con 0x5586ed3cd8b0 2024-09-12T12:25:38.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.366+0000 7f28d7021740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5586ed2eef20 con 0x5586ed3ce1d0 2024-09-12T12:25:38.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.366+0000 7f28d7021740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5586ed3dfd10 con 0x5586ed3dcfc0 2024-09-12T12:25:38.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.366+0000 7f28d7021740 10 client.0 _ll_register_callbacks cb 0x5586ed2b8030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:38.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.366+0000 7f28ce59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586ed3cd8b0 0x5586ed3dc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:38.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.366+0000 7f28ce59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586ed3cd8b0 0x5586ed3dc850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45820/0 (socket says 172.21.15.33:45820) 2024-09-12T12:25:38.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.366+0000 7f28ce59c640 1 -- 172.21.15.33:0/768451076 learned_addr learned my addr 172.21.15.33:0/768451076 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:38.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.366+0000 7f28c7fff640 1 --2- 172.21.15.33:0/768451076 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586ed3ce1d0 0x5586ed3d9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:38.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.366+0000 7f28ced9d640 1 --2- 172.21.15.33:0/768451076 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586ed3dcfc0 0x5586ed3da0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:38.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.366+0000 7f28ce59c640 1 -- 172.21.15.33:0/768451076 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586ed3dcfc0 msgr2=0x5586ed3da0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:38.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.366+0000 7f28ce59c640 1 --2- 172.21.15.33:0/768451076 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586ed3dcfc0 0x5586ed3da0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.366+0000 7f28ce59c640 1 -- 172.21.15.33:0/768451076 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586ed3ce1d0 msgr2=0x5586ed3d9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:38.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.366+0000 7f28ce59c640 1 --2- 172.21.15.33:0/768451076 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586ed3ce1d0 0x5586ed3d9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.366+0000 7f28ce59c640 1 -- 172.21.15.33:0/768451076 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586ed0a52b0 con 0x5586ed3cd8b0 2024-09-12T12:25:38.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.366+0000 7f28ced9d640 1 --2- 172.21.15.33:0/768451076 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586ed3dcfc0 0x5586ed3da0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:38.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.367+0000 7f28ce59c640 1 --2- 172.21.15.33:0/768451076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586ed3cd8b0 0x5586ed3dc850 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f28c0011440 tx=0x7f28c0011900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2af8590b015b0d8e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:38.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.367+0000 7f28b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:25:38.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.367+0000 7f28b5ffb640 1 -- 172.21.15.33:0/768451076 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c001f060 con 0x5586ed3cd8b0 2024-09-12T12:25:38.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.367+0000 7f28d7021740 1 -- 172.21.15.33:0/768451076 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28c8036040 con 0x5586ed3cd8b0 2024-09-12T12:25:38.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.367+0000 7f28b5ffb640 1 -- 172.21.15.33:0/768451076 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7f28c0010700 con 0x5586ed3cd8b0 2024-09-12T12:25:38.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.367+0000 7f28b5ffb640 1 -- 172.21.15.33:0/768451076 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f28c0026050 con 0x5586ed3cd8b0 2024-09-12T12:25:38.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.367+0000 7f28d7021740 10 client.15096 fetch_fsmap learned FSMap version 24 2024-09-12T12:25:38.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.367+0000 7f28d7021740 1 -- 172.21.15.33:0/768451076 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5586ed3eb590 con 0x5586ed3cd8b0 2024-09-12T12:25:38.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.367+0000 7f28b5ffb640 1 -- 172.21.15.33:0/768451076 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f28c8036040 con 0x5586ed3cd8b0 2024-09-12T12:25:38.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.367+0000 7f28b5ffb640 1 -- 172.21.15.33:0/768451076 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f28c001ab00 con 0x5586ed3cd8b0 2024-09-12T12:25:38.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.367+0000 7f28d7021740 10 client.15096 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T12:25:38.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.367+0000 7f28d7021740 10 client.15096 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T12:25:38.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.367+0000 7f28d7021740 20 client.15096 populate_metadata read hostname 'smithi033' 2024-09-12T12:25:38.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.367+0000 7f28d7021740 1 --2- 172.21.15.33:0/768451076 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5586ed3edb30 0x5586ed3eefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:38.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.367+0000 7f28d7021740 4 client.15096 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:25:38.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.367+0000 7f28d7021740 1 -- 172.21.15.33:0/768451076 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5586ed341600 con 0x5586ed3edb30 2024-09-12T12:25:38.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.368+0000 7f28c7fff640 1 --2- 172.21.15.33:0/768451076 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5586ed3edb30 0x5586ed3eefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:38.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.368+0000 7f28c7fff640 1 --2- 172.21.15.33:0/768451076 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5586ed3edb30 0x5586ed3eefa0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d3a58e92e5e442a server_cookie=3d0a257b561dca1c in_seq=0 out_seq=0 2024-09-12T12:25:38.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.368+0000 7f28b5ffb640 10 client.15096 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:25:38.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.369+0000 7f28b5ffb640 1 -- 172.21.15.33:0/768451076 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5586ed341600 con 0x5586ed3edb30 2024-09-12T12:25:38.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.369+0000 7f28b5ffb640 10 client.15096 handle_command_reply: tid=0 2024-09-12T12:25:38.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.369+0000 7f28d7021740 1 client.15096 shutdown 2024-09-12T12:25:38.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.369+0000 7f28d7021740 1 -- 172.21.15.33:0/768451076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586ed3cd8b0 msgr2=0x5586ed3dc850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:38.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.369+0000 7f28d7021740 1 --2- 172.21.15.33:0/768451076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586ed3cd8b0 0x5586ed3dc850 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f28c0011440 tx=0x7f28c0011900 comp rx=0 tx=0).stop 2024-09-12T12:25:38.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.369+0000 7f28d7021740 1 -- 172.21.15.33:0/768451076 shutdown_connections 2024-09-12T12:25:38.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.369+0000 7f28d7021740 1 --2- 172.21.15.33:0/768451076 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5586ed3edb30 0x5586ed3eefa0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.369+0000 7f28d7021740 1 --2- 172.21.15.33:0/768451076 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586ed3dcfc0 0x5586ed3da0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.369+0000 7f28d7021740 1 --2- 172.21.15.33:0/768451076 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586ed3ce1d0 0x5586ed3d9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.369+0000 7f28b5ffb640 0 client.15096 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:25:38.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.369+0000 7f28d7021740 1 --2- 172.21.15.33:0/768451076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586ed3cd8b0 0x5586ed3dc850 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.369+0000 7f28d7021740 1 -- 172.21.15.33:0/768451076 >> 172.21.15.33:0/768451076 conn(0x5586ed3c9f60 msgr2=0x5586ed3cfcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:38.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.369+0000 7f28d7021740 1 -- 172.21.15.33:0/768451076 shutdown_connections 2024-09-12T12:25:38.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.369+0000 7f28d7021740 1 -- 172.21.15.33:0/768451076 wait complete. 2024-09-12T12:25:38.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.369+0000 7f28d7021740 20 client.15096 trim_cache size 0 max 16384 2024-09-12T12:25:38.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.387+0000 7f28d7021740 1 Processor -- start 2024-09-12T12:25:38.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.387+0000 7f28d7021740 1 -- start start 2024-09-12T12:25:38.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.388+0000 7f28d7021740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586ed3cd8b0 0x5586ed3ee8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:38.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.388+0000 7f28d7021740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586ed3ce1d0 0x5586ed3d8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:38.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.388+0000 7f28d7021740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586ed3dcfc0 0x5586ed3d6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:38.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.388+0000 7f28d7021740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5586ed3ed2e0 con 0x5586ed3ce1d0 2024-09-12T12:25:38.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.388+0000 7f28d7021740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5586ed3ed9b0 con 0x5586ed3dcfc0 2024-09-12T12:25:38.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.388+0000 7f28d7021740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5586ed3ee080 con 0x5586ed3cd8b0 2024-09-12T12:25:38.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.388+0000 7f28c7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586ed3ce1d0 0x5586ed3d8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:38.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.388+0000 7f28c7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586ed3ce1d0 0x5586ed3d8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45832/0 (socket says 172.21.15.33:45832) 2024-09-12T12:25:38.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.388+0000 7f28c7fff640 1 -- 172.21.15.33:0/105722301 learned_addr learned my addr 172.21.15.33:0/105722301 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:38.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.388+0000 7f28ced9d640 1 --2- 172.21.15.33:0/105722301 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586ed3dcfc0 0x5586ed3d6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:38.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.388+0000 7f28c7fff640 1 -- 172.21.15.33:0/105722301 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586ed3cd8b0 msgr2=0x5586ed3ee8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:38.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.388+0000 7f28c7fff640 1 --2- 172.21.15.33:0/105722301 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586ed3cd8b0 0x5586ed3ee8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.388+0000 7f28c7fff640 1 -- 172.21.15.33:0/105722301 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586ed3dcfc0 msgr2=0x5586ed3d6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:38.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.388+0000 7f28c7fff640 1 --2- 172.21.15.33:0/105722301 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586ed3dcfc0 0x5586ed3d6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.388+0000 7f28c7fff640 1 -- 172.21.15.33:0/105722301 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586ed3d8b50 con 0x5586ed3ce1d0 2024-09-12T12:25:38.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.388+0000 7f28c7fff640 1 --2- 172.21.15.33:0/105722301 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586ed3ce1d0 0x5586ed3d8470 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f28b809b320 tx=0x7f28b80cf2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1da8e051fd9b2dc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:38.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.388+0000 7f28b7fff640 1 -- 172.21.15.33:0/105722301 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b8021040 con 0x5586ed3ce1d0 2024-09-12T12:25:38.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.388+0000 7f28b7fff640 1 -- 172.21.15.33:0/105722301 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f28b80a4000 con 0x5586ed3ce1d0 2024-09-12T12:25:38.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.388+0000 7f28b7fff640 1 -- 172.21.15.33:0/105722301 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b8097b90 con 0x5586ed3ce1d0 2024-09-12T12:25:38.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.389+0000 7f28d7021740 1 -- 172.21.15.33:0/105722301 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586ed3ce1d0 msgr2=0x5586ed3d8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:38.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.389+0000 7f28d7021740 1 --2- 172.21.15.33:0/105722301 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586ed3ce1d0 0x5586ed3d8470 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f28b809b320 tx=0x7f28b80cf2b0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.389+0000 7f28d7021740 1 -- 172.21.15.33:0/105722301 shutdown_connections 2024-09-12T12:25:38.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.389+0000 7f28d7021740 1 --2- 172.21.15.33:0/105722301 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586ed3dcfc0 0x5586ed3d6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.389+0000 7f28d7021740 1 --2- 172.21.15.33:0/105722301 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586ed3ce1d0 0x5586ed3d8470 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.389+0000 7f28d7021740 1 --2- 172.21.15.33:0/105722301 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586ed3cd8b0 0x5586ed3ee8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.389+0000 7f28d7021740 1 -- 172.21.15.33:0/105722301 >> 172.21.15.33:0/105722301 conn(0x5586ed3c9f60 msgr2=0x5586ed3d5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:38.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.389+0000 7f28d7021740 1 -- 172.21.15.33:0/105722301 shutdown_connections 2024-09-12T12:25:38.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.389+0000 7f28d7021740 1 -- 172.21.15.33:0/105722301 wait complete. 2024-09-12T12:25:38.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.389+0000 7f28d7021740 1 -- start start 2024-09-12T12:25:38.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.390+0000 7f28d7021740 1 Processor -- start 2024-09-12T12:25:38.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.390+0000 7f28d7021740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586ed3cd8b0 0x5586ed3f77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:38.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.390+0000 7f28d7021740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586ed3ce1d0 0x5586ed3d6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:38.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.390+0000 7f28d7021740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586ed3dcfc0 0x5586ed3d6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:38.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.390+0000 7f28d7021740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5586ed3eee20 con 0x5586ed3cd8b0 2024-09-12T12:25:38.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.390+0000 7f28d7021740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5586ed3ee750 con 0x5586ed3dcfc0 2024-09-12T12:25:38.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.390+0000 7f28d7021740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5586ed3ef4f0 con 0x5586ed3ce1d0 2024-09-12T12:25:38.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.390+0000 7f28d7021740 10 client.0 _ll_register_callbacks cb 0x7f28c000bc30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:38.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.390+0000 7f28ce59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586ed3cd8b0 0x5586ed3f77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:38.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.390+0000 7f28ce59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586ed3cd8b0 0x5586ed3f77b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45842/0 (socket says 172.21.15.33:45842) 2024-09-12T12:25:38.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.390+0000 7f28ce59c640 1 -- 172.21.15.33:0/1046761049 learned_addr learned my addr 172.21.15.33:0/1046761049 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:38.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.390+0000 7f28ced9d640 1 --2- 172.21.15.33:0/1046761049 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586ed3dcfc0 0x5586ed3d6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:38.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.390+0000 7f28ce59c640 1 -- 172.21.15.33:0/1046761049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586ed3ce1d0 msgr2=0x5586ed3d6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:38.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.390+0000 7f28c7fff640 1 --2- 172.21.15.33:0/1046761049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586ed3ce1d0 0x5586ed3d6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:38.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.390+0000 7f28ce59c640 1 --2- 172.21.15.33:0/1046761049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586ed3ce1d0 0x5586ed3d6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.390+0000 7f28ce59c640 1 -- 172.21.15.33:0/1046761049 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586ed3dcfc0 msgr2=0x5586ed3d6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:38.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.390+0000 7f28ce59c640 1 --2- 172.21.15.33:0/1046761049 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586ed3dcfc0 0x5586ed3d6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.390+0000 7f28ce59c640 1 -- 172.21.15.33:0/1046761049 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586ed3d7490 con 0x5586ed3cd8b0 2024-09-12T12:25:38.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.390+0000 7f28c7fff640 1 --2- 172.21.15.33:0/1046761049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586ed3ce1d0 0x5586ed3d6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:25:38.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.390+0000 7f28ced9d640 1 --2- 172.21.15.33:0/1046761049 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586ed3dcfc0 0x5586ed3d6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:38.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.390+0000 7f28ce59c640 1 --2- 172.21.15.33:0/1046761049 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586ed3cd8b0 0x5586ed3f77b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f28c000f410 tx=0x7f28c000fbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd8a69e91e38f034 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:38.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.390+0000 7f28b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:25:38.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.391+0000 7f28b5ffb640 1 -- 172.21.15.33:0/1046761049 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c002f060 con 0x5586ed3cd8b0 2024-09-12T12:25:38.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.391+0000 7f28b5ffb640 1 -- 172.21.15.33:0/1046761049 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7f28c0005070 con 0x5586ed3cd8b0 2024-09-12T12:25:38.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.391+0000 7f28d7021740 1 -- 172.21.15.33:0/1046761049 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28b80a4000 con 0x5586ed3cd8b0 2024-09-12T12:25:38.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.391+0000 7f28b5ffb640 1 -- 172.21.15.33:0/1046761049 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f28c0036050 con 0x5586ed3cd8b0 2024-09-12T12:25:38.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.391+0000 7f28d7021740 10 client.15102 fetch_fsmap learned FSMap version 24 2024-09-12T12:25:38.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.391+0000 7f28d7021740 1 -- 172.21.15.33:0/1046761049 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5586ed3f6000 con 0x5586ed3cd8b0 2024-09-12T12:25:38.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.391+0000 7f28b5ffb640 1 -- 172.21.15.33:0/1046761049 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f28b80a4000 con 0x5586ed3cd8b0 2024-09-12T12:25:38.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.391+0000 7f28b5ffb640 1 -- 172.21.15.33:0/1046761049 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f28c0010720 con 0x5586ed3cd8b0 2024-09-12T12:25:38.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.391+0000 7f28d7021740 10 client.15102 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T12:25:38.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.391+0000 7f28d7021740 10 client.15102 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T12:25:38.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.391+0000 7f28d7021740 20 client.15102 populate_metadata read hostname 'smithi033' 2024-09-12T12:25:38.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.391+0000 7f28d7021740 1 --2- 172.21.15.33:0/1046761049 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5586ed45cc70 0x5586ed45b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:38.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.391+0000 7f28d7021740 4 client.15102 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:25:38.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.391+0000 7f28d7021740 1 -- 172.21.15.33:0/1046761049 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "status"}) -- 0x5586ed33bb10 con 0x5586ed45cc70 2024-09-12T12:25:38.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.392+0000 7f28c7fff640 1 --2- 172.21.15.33:0/1046761049 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5586ed45cc70 0x5586ed45b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:38.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.392+0000 7f28c7fff640 1 --2- 172.21.15.33:0/1046761049 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5586ed45cc70 0x5586ed45b980 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc404ba4d14e1afc server_cookie=f8e81f8d3b4258db in_seq=0 out_seq=0 2024-09-12T12:25:38.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.392+0000 7f28b5ffb640 10 client.15102 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:25:38.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.392+0000 7f28b5ffb640 1 -- 172.21.15.33:0/1046761049 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x5586ed33bb10 con 0x5586ed45cc70 2024-09-12T12:25:38.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.392+0000 7f28b5ffb640 10 client.15102 handle_command_reply: tid=0 2024-09-12T12:25:38.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.392+0000 7f28d7021740 1 client.15102 shutdown 2024-09-12T12:25:38.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.392+0000 7f28d7021740 1 -- 172.21.15.33:0/1046761049 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586ed3cd8b0 msgr2=0x5586ed3f77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:38.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.392+0000 7f28d7021740 1 --2- 172.21.15.33:0/1046761049 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586ed3cd8b0 0x5586ed3f77b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f28c000f410 tx=0x7f28c000fbc0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.392+0000 7f28d7021740 1 -- 172.21.15.33:0/1046761049 shutdown_connections 2024-09-12T12:25:38.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.392+0000 7f28d7021740 1 --2- 172.21.15.33:0/1046761049 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5586ed45cc70 0x5586ed45b980 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.392+0000 7f28d7021740 1 --2- 172.21.15.33:0/1046761049 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586ed3dcfc0 0x5586ed3d6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.393+0000 7f28b5ffb640 0 client.15102 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:25:38.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.392+0000 7f28d7021740 1 --2- 172.21.15.33:0/1046761049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586ed3ce1d0 0x5586ed3d6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.393+0000 7f28d7021740 1 --2- 172.21.15.33:0/1046761049 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586ed3cd8b0 0x5586ed3f77b0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.393+0000 7f28d7021740 1 -- 172.21.15.33:0/1046761049 >> 172.21.15.33:0/1046761049 conn(0x5586ed3c9f60 msgr2=0x5586ed3d5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:38.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.393+0000 7f28d7021740 1 -- 172.21.15.33:0/1046761049 shutdown_connections 2024-09-12T12:25:38.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.393+0000 7f28d7021740 1 -- 172.21.15.33:0/1046761049 wait complete. 2024-09-12T12:25:38.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.393+0000 7f28d7021740 20 client.15102 trim_cache size 0 max 16384 2024-09-12T12:25:38.410 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:25:38.410 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "a66dfafc-7100-11ef-bcea-c7b262605968", 2024-09-12T12:25:38.410 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 0, 2024-09-12T12:25:38.410 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 24499, 2024-09-12T12:25:38.410 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-09-12T12:25:38.410 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-09-12T12:25:38.410 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-09-12T12:25:38.411 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 111.524242769, 2024-09-12T12:25:38.411 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 24, 2024-09-12T12:25:38.411 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 87, 2024-09-12T12:25:38.411 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 85, 2024-09-12T12:25:38.411 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 130.847716276 2024-09-12T12:25:38.411 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:25:38.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.393+0000 7f28d4c48640 1 -- 172.21.15.33:0/4195968901 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f28bc0a2c10 msgr2=0x7f28bc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:38.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.393+0000 7f28d4c48640 1 --2- 172.21.15.33:0/4195968901 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f28bc0a2c10 0x7f28bc0a50d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f28c8045000 tx=0x7f28c8048000 comp rx=0 tx=0).stop 2024-09-12T12:25:38.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.393+0000 7f28d4c48640 1 -- 172.21.15.33:0/4195968901 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28d0100ca0 msgr2=0x7f28d01988d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:38.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.393+0000 7f28d4c48640 1 --2- 172.21.15.33:0/4195968901 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28d0100ca0 0x7f28d01988d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f28b800d770 tx=0x7f28b800dc30 comp rx=0 tx=0).stop 2024-09-12T12:25:38.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.393+0000 7f28d4c48640 1 -- 172.21.15.33:0/4195968901 shutdown_connections 2024-09-12T12:25:38.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.393+0000 7f28d4c48640 1 --2- 172.21.15.33:0/4195968901 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f28bc0a2c10 0x7f28bc0a50d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.393+0000 7f28d4c48640 1 --2- 172.21.15.33:0/4195968901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28d0106f50 0x7f28d019cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.393+0000 7f28d4c48640 1 --2- 172.21.15.33:0/4195968901 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28d0100ca0 0x7f28d01988d0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.393+0000 7f28d4c48640 1 --2- 172.21.15.33:0/4195968901 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28d01002f0 0x7f28d0198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:38.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.393+0000 7f28d4c48640 1 -- 172.21.15.33:0/4195968901 >> 172.21.15.33:0/4195968901 conn(0x7f28d0077210 msgr2=0x7f28d0105190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:38.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.393+0000 7f28d4c48640 1 -- 172.21.15.33:0/4195968901 shutdown_connections 2024-09-12T12:25:38.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:38.394+0000 7f28d4c48640 1 -- 172.21.15.33:0/4195968901 wait complete. 2024-09-12T12:25:39.292 INFO:tasks.cephadm:Setup complete, yielding 2024-09-12T12:25:39.292 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-12T12:25:39.302 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi033.front.sepia.ceph.com 2024-09-12T12:25:39.302 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- bash -c 'ceph orch status' 2024-09-12T12:25:39.327 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:39 smithi033 ceph-mon[31246]: pgmap v337: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-12T12:25:39.560 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:39.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:39 smithi043 ceph-mon[34144]: pgmap v337: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-12T12:25:39.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:39 smithi102 ceph-mon[34799]: pgmap v337: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-12T12:25:40.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.043+0000 7fbc03b64640 1 -- 172.21.15.33:0/3142555068 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbfc105790 msgr2=0x7fbbfc105c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:40.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.043+0000 7fbc03b64640 1 --2- 172.21.15.33:0/3142555068 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbfc105790 0x7fbbfc105c40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4009ca0 tx=0x7fbbf402a8c0 comp rx=0 tx=0).stop 2024-09-12T12:25:40.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.043+0000 7fbc03b64640 1 -- 172.21.15.33:0/3142555068 shutdown_connections 2024-09-12T12:25:40.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.043+0000 7fbc03b64640 1 --2- 172.21.15.33:0/3142555068 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbfc105790 0x7fbbfc105c40 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:40.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.043+0000 7fbc03b64640 1 --2- 172.21.15.33:0/3142555068 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbbfc102de0 0x7fbbfc105250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:40.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.043+0000 7fbc03b64640 1 --2- 172.21.15.33:0/3142555068 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbbfc100490 0x7fbbfc1028a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:40.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.043+0000 7fbc03b64640 1 -- 172.21.15.33:0/3142555068 >> 172.21.15.33:0/3142555068 conn(0x7fbbfc0fc2a0 msgr2=0x7fbbfc0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:40.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.043+0000 7fbc03b64640 1 -- 172.21.15.33:0/3142555068 shutdown_connections 2024-09-12T12:25:40.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.043+0000 7fbc03b64640 1 -- 172.21.15.33:0/3142555068 wait complete. 2024-09-12T12:25:40.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.044+0000 7fbc03b64640 1 Processor -- start 2024-09-12T12:25:40.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.044+0000 7fbc03b64640 1 -- start start 2024-09-12T12:25:40.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.044+0000 7fbc03b64640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbbfc100490 0x7fbbfc19e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:40.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.044+0000 7fbc03b64640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbbfc102de0 0x7fbbfc19e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:40.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.044+0000 7fbc03b64640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbfc105790 0x7fbbfc1a59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:40.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.044+0000 7fbc03b64640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fbbfc113d50 con 0x7fbbfc105790 2024-09-12T12:25:40.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.044+0000 7fbc03b64640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbbfc113bd0 con 0x7fbbfc100490 2024-09-12T12:25:40.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.044+0000 7fbc03b64640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbbfc113ed0 con 0x7fbbfc102de0 2024-09-12T12:25:40.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.044+0000 7fbc02101640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbfc105790 0x7fbbfc1a59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:40.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.044+0000 7fbc02101640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbfc105790 0x7fbbfc1a59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45858/0 (socket says 172.21.15.33:45858) 2024-09-12T12:25:40.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.044+0000 7fbc02101640 1 -- 172.21.15.33:0/869641955 learned_addr learned my addr 172.21.15.33:0/869641955 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:40.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.045+0000 7fbc010ff640 1 --2- 172.21.15.33:0/869641955 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbbfc102de0 0x7fbbfc19e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:40.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.045+0000 7fbc01900640 1 --2- 172.21.15.33:0/869641955 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbbfc100490 0x7fbbfc19e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:40.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.045+0000 7fbc02101640 1 -- 172.21.15.33:0/869641955 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbbfc102de0 msgr2=0x7fbbfc19e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:40.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.045+0000 7fbc02101640 1 --2- 172.21.15.33:0/869641955 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbbfc102de0 0x7fbbfc19e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:40.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.045+0000 7fbc02101640 1 -- 172.21.15.33:0/869641955 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbbfc100490 msgr2=0x7fbbfc19e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:40.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.045+0000 7fbc02101640 1 --2- 172.21.15.33:0/869641955 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbbfc100490 0x7fbbfc19e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:40.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.045+0000 7fbc02101640 1 -- 172.21.15.33:0/869641955 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbfc1a6020 con 0x7fbbfc105790 2024-09-12T12:25:40.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.045+0000 7fbc01900640 1 --2- 172.21.15.33:0/869641955 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbbfc100490 0x7fbbfc19e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:40.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.045+0000 7fbc02101640 1 --2- 172.21.15.33:0/869641955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbfc105790 0x7fbbfc1a59b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4009dc0 tx=0x7fbbf4003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:40.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.045+0000 7fbbf2ffd640 1 -- 172.21.15.33:0/869641955 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf4032ec0 con 0x7fbbfc105790 2024-09-12T12:25:40.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.045+0000 7fbbf2ffd640 1 -- 172.21.15.33:0/869641955 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbbf40044f0 con 0x7fbbfc105790 2024-09-12T12:25:40.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.045+0000 7fbc03b64640 1 -- 172.21.15.33:0/869641955 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbfc1a62b0 con 0x7fbbfc105790 2024-09-12T12:25:40.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.045+0000 7fbbf2ffd640 1 -- 172.21.15.33:0/869641955 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf4030d40 con 0x7fbbfc105790 2024-09-12T12:25:40.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.045+0000 7fbc03b64640 1 -- 172.21.15.33:0/869641955 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbfc1a6840 con 0x7fbbfc105790 2024-09-12T12:25:40.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.046+0000 7fbc03b64640 1 -- 172.21.15.33:0/869641955 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbfc0fdd90 con 0x7fbbfc105790 2024-09-12T12:25:40.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.047+0000 7fbbf2ffd640 1 -- 172.21.15.33:0/869641955 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fbbf4004040 con 0x7fbbfc105790 2024-09-12T12:25:40.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.048+0000 7fbbf2ffd640 1 --2- 172.21.15.33:0/869641955 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fbbe80a2e60 0x7fbbe80a5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:40.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.049+0000 7fbc01900640 1 --2- 172.21.15.33:0/869641955 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fbbe80a2e60 0x7fbbe80a5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:40.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.049+0000 7fbbf2ffd640 1 -- 172.21.15.33:0/869641955 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7fbbf40f0940 con 0x7fbbfc105790 2024-09-12T12:25:40.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.049+0000 7fbc01900640 1 --2- 172.21.15.33:0/869641955 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fbbe80a2e60 0x7fbbe80a5320 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbbf80058c0 tx=0x7fbbf8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:40.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.053+0000 7fbbf2ffd640 1 -- 172.21.15.33:0/869641955 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbbf40bd4f0 con 0x7fbbfc105790 2024-09-12T12:25:40.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.243+0000 7fbc03b64640 1 -- 172.21.15.33:0/869641955 --> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fbbfc062630 con 0x7fbbe80a2e60 2024-09-12T12:25:40.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.244+0000 7fbbf2ffd640 1 -- 172.21.15.33:0/869641955 <== mgr.14150 v2:172.21.15.33:6800/176202431 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fbbfc062630 con 0x7fbbe80a2e60 2024-09-12T12:25:40.244 INFO:teuthology.orchestra.run.smithi033.stdout:Backend: cephadm 2024-09-12T12:25:40.244 INFO:teuthology.orchestra.run.smithi033.stdout:Available: Yes 2024-09-12T12:25:40.244 INFO:teuthology.orchestra.run.smithi033.stdout:Paused: No 2024-09-12T12:25:40.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.246+0000 7fbc03b64640 1 -- 172.21.15.33:0/869641955 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fbbe80a2e60 msgr2=0x7fbbe80a5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:40.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.246+0000 7fbc03b64640 1 --2- 172.21.15.33:0/869641955 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fbbe80a2e60 0x7fbbe80a5320 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbbf80058c0 tx=0x7fbbf8005850 comp rx=0 tx=0).stop 2024-09-12T12:25:40.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.246+0000 7fbc03b64640 1 -- 172.21.15.33:0/869641955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbfc105790 msgr2=0x7fbbfc1a59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:40.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.246+0000 7fbc03b64640 1 --2- 172.21.15.33:0/869641955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbfc105790 0x7fbbfc1a59b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4009dc0 tx=0x7fbbf4003ba0 comp rx=0 tx=0).stop 2024-09-12T12:25:40.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.246+0000 7fbc03b64640 1 -- 172.21.15.33:0/869641955 shutdown_connections 2024-09-12T12:25:40.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.246+0000 7fbc03b64640 1 --2- 172.21.15.33:0/869641955 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fbbe80a2e60 0x7fbbe80a5320 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:40.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.246+0000 7fbc03b64640 1 --2- 172.21.15.33:0/869641955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbfc105790 0x7fbbfc1a59b0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:40.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.246+0000 7fbc03b64640 1 --2- 172.21.15.33:0/869641955 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbbfc102de0 0x7fbbfc19e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:40.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.246+0000 7fbc03b64640 1 --2- 172.21.15.33:0/869641955 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbbfc100490 0x7fbbfc19e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:40.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.246+0000 7fbc03b64640 1 -- 172.21.15.33:0/869641955 >> 172.21.15.33:0/869641955 conn(0x7fbbfc0fc2a0 msgr2=0x7fbbfc100e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:40.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.247+0000 7fbc03b64640 1 -- 172.21.15.33:0/869641955 shutdown_connections 2024-09-12T12:25:40.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:40.247+0000 7fbc03b64640 1 -- 172.21.15.33:0/869641955 wait complete. 2024-09-12T12:25:40.910 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-12T12:25:41.211 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:41.560 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:41 smithi033 ceph-mon[31246]: pgmap v338: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T12:25:41.560 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:41 smithi033 ceph-mon[31246]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:25:41.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:41 smithi043 ceph-mon[34144]: pgmap v338: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T12:25:41.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:41 smithi043 ceph-mon[34144]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:25:41.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:41 smithi102 ceph-mon[34799]: pgmap v338: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T12:25:41.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:41 smithi102 ceph-mon[34799]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:25:41.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.730+0000 7ff801366640 1 -- 172.21.15.33:0/3481014532 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7fc1037c0 msgr2=0x7ff7fc10a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:41.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.730+0000 7ff801366640 1 --2- 172.21.15.33:0/3481014532 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7fc1037c0 0x7ff7fc10a050 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff7f4009900 tx=0x7ff7f402a410 comp rx=0 tx=0).stop 2024-09-12T12:25:41.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.730+0000 7ff801366640 1 -- 172.21.15.33:0/3481014532 shutdown_connections 2024-09-12T12:25:41.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.730+0000 7ff801366640 1 --2- 172.21.15.33:0/3481014532 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7fc1037c0 0x7ff7fc10a050 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:41.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.730+0000 7ff801366640 1 --2- 172.21.15.33:0/3481014532 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7fc102e00 0x7ff7fc103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:41.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.730+0000 7ff801366640 1 --2- 172.21.15.33:0/3481014532 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7fc101c00 0x7ff7fc102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:41.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.730+0000 7ff801366640 1 -- 172.21.15.33:0/3481014532 >> 172.21.15.33:0/3481014532 conn(0x7ff7fc0fd390 msgr2=0x7ff7fc0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:41.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.730+0000 7ff801366640 1 -- 172.21.15.33:0/3481014532 shutdown_connections 2024-09-12T12:25:41.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.730+0000 7ff801366640 1 -- 172.21.15.33:0/3481014532 wait complete. 2024-09-12T12:25:41.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.730+0000 7ff801366640 1 Processor -- start 2024-09-12T12:25:41.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.731+0000 7ff801366640 1 -- start start 2024-09-12T12:25:41.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.731+0000 7ff801366640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7fc101c00 0x7ff7fc197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:41.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.731+0000 7ff801366640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7fc102e00 0x7ff7fc198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:41.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.731+0000 7ff801366640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7fc1037c0 0x7ff7fc19f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:41.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.731+0000 7ff801366640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff7fc10d730 con 0x7ff7fc1037c0 2024-09-12T12:25:41.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.731+0000 7ff801366640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff7fc10d5b0 con 0x7ff7fc102e00 2024-09-12T12:25:41.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.731+0000 7ff801366640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff7fc10d8b0 con 0x7ff7fc101c00 2024-09-12T12:25:41.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.731+0000 7ff7fb7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7fc1037c0 0x7ff7fc19f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:41.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.731+0000 7ff7fb7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7fc1037c0 0x7ff7fc19f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60730/0 (socket says 172.21.15.33:60730) 2024-09-12T12:25:41.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.731+0000 7ff7fb7fe640 1 -- 172.21.15.33:0/3138331714 learned_addr learned my addr 172.21.15.33:0/3138331714 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:41.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.731+0000 7ff7fa7fc640 1 --2- 172.21.15.33:0/3138331714 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7fc102e00 0x7ff7fc198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:41.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.731+0000 7ff7faffd640 1 --2- 172.21.15.33:0/3138331714 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7fc101c00 0x7ff7fc197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:41.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.731+0000 7ff7fb7fe640 1 -- 172.21.15.33:0/3138331714 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7fc101c00 msgr2=0x7ff7fc197de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:41.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.731+0000 7ff7fb7fe640 1 --2- 172.21.15.33:0/3138331714 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7fc101c00 0x7ff7fc197de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:41.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.731+0000 7ff7fb7fe640 1 -- 172.21.15.33:0/3138331714 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7fc102e00 msgr2=0x7ff7fc198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:41.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.731+0000 7ff7fb7fe640 1 --2- 172.21.15.33:0/3138331714 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7fc102e00 0x7ff7fc198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:41.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.731+0000 7ff7fb7fe640 1 -- 172.21.15.33:0/3138331714 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7fc19fa10 con 0x7ff7fc1037c0 2024-09-12T12:25:41.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.731+0000 7ff7faffd640 1 --2- 172.21.15.33:0/3138331714 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7fc101c00 0x7ff7fc197de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:41.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.732+0000 7ff7fb7fe640 1 --2- 172.21.15.33:0/3138331714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7fc1037c0 0x7ff7fc19f3a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff7f4005940 tx=0x7ff7f4031a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:41.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.732+0000 7ff7f3fff640 1 -- 172.21.15.33:0/3138331714 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f403f030 con 0x7ff7fc1037c0 2024-09-12T12:25:41.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.732+0000 7ff7f3fff640 1 -- 172.21.15.33:0/3138331714 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff7f4003aa0 con 0x7ff7fc1037c0 2024-09-12T12:25:41.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.732+0000 7ff801366640 1 -- 172.21.15.33:0/3138331714 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7fc19fca0 con 0x7ff7fc1037c0 2024-09-12T12:25:41.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.732+0000 7ff7f3fff640 1 -- 172.21.15.33:0/3138331714 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f4035070 con 0x7ff7fc1037c0 2024-09-12T12:25:41.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.732+0000 7ff801366640 1 -- 172.21.15.33:0/3138331714 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7fc1a0180 con 0x7ff7fc1037c0 2024-09-12T12:25:41.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.733+0000 7ff801366640 1 -- 172.21.15.33:0/3138331714 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7fc1090a0 con 0x7ff7fc1037c0 2024-09-12T12:25:41.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.734+0000 7ff7f3fff640 1 -- 172.21.15.33:0/3138331714 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff7f4042030 con 0x7ff7fc1037c0 2024-09-12T12:25:41.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.735+0000 7ff7f3fff640 1 --2- 172.21.15.33:0/3138331714 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff7e80a2c40 0x7ff7e80a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:41.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.735+0000 7ff7faffd640 1 --2- 172.21.15.33:0/3138331714 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff7e80a2c40 0x7ff7e80a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:41.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.735+0000 7ff7f3fff640 1 -- 172.21.15.33:0/3138331714 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7ff7f40efaf0 con 0x7ff7fc1037c0 2024-09-12T12:25:41.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.735+0000 7ff7faffd640 1 --2- 172.21.15.33:0/3138331714 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff7e80a2c40 0x7ff7e80a5100 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc102c60 tx=0x7ff7ec009520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:41.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.739+0000 7ff7f3fff640 1 -- 172.21.15.33:0/3138331714 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff7f40bc590 con 0x7ff7fc1037c0 2024-09-12T12:25:41.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.924+0000 7ff801366640 1 -- 172.21.15.33:0/3138331714 --> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7ff7fc062630 con 0x7ff7e80a2c40 2024-09-12T12:25:41.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.938+0000 7ff7f3fff640 1 -- 172.21.15.33:0/3138331714 <== mgr.14150 v2:172.21.15.33:6800/176202431 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4061 (secure 0 0 0) 0x7ff7fc062630 con 0x7ff7e80a2c40 2024-09-12T12:25:41.938 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-12T12:25:41.938 INFO:teuthology.orchestra.run.smithi033.stdout:mds.a smithi033 running (2m) 55s ago 2m 13.5M - 19.1.1-298-gb53b6d3e 54467abc55f8 81dda58d444e 2024-09-12T12:25:41.939 INFO:teuthology.orchestra.run.smithi033.stdout:mds.b smithi043 running (2m) 57s ago 2m 16.5M - 19.1.1-298-gb53b6d3e 54467abc55f8 c860099f1dcc 2024-09-12T12:25:41.939 INFO:teuthology.orchestra.run.smithi033.stdout:mds.c smithi102 running (2m) 57s ago 2m 17.4M - 19.1.1-298-gb53b6d3e 54467abc55f8 8b36d0a05f75 2024-09-12T12:25:41.939 INFO:teuthology.orchestra.run.smithi033.stdout:mds.d smithi033 running (2m) 55s ago 2m 14.5M - 19.1.1-298-gb53b6d3e 54467abc55f8 81299e4097b5 2024-09-12T12:25:41.939 INFO:teuthology.orchestra.run.smithi033.stdout:mds.e smithi043 running (2m) 57s ago 2m 14.4M - 19.1.1-298-gb53b6d3e 54467abc55f8 4e4042335ac0 2024-09-12T12:25:41.939 INFO:teuthology.orchestra.run.smithi033.stdout:mds.f smithi102 running (2m) 57s ago 2m 16.2M - 19.1.1-298-gb53b6d3e 54467abc55f8 eea3bb9da805 2024-09-12T12:25:41.939 INFO:teuthology.orchestra.run.smithi033.stdout:mds.g smithi033 running (2m) 55s ago 2m 14.3M - 19.1.1-298-gb53b6d3e 54467abc55f8 5908ad7e8bb7 2024-09-12T12:25:41.939 INFO:teuthology.orchestra.run.smithi033.stdout:mds.h smithi043 running (2m) 57s ago 2m 15.5M - 19.1.1-298-gb53b6d3e 54467abc55f8 c8566af98aa5 2024-09-12T12:25:41.939 INFO:teuthology.orchestra.run.smithi033.stdout:mds.i smithi102 running (2m) 57s ago 2m 26.0M - 19.1.1-298-gb53b6d3e 54467abc55f8 fbb800153a71 2024-09-12T12:25:41.939 INFO:teuthology.orchestra.run.smithi033.stdout:mds.j smithi033 running (2m) 55s ago 2m 14.2M - 19.1.1-298-gb53b6d3e 54467abc55f8 d5fe62fc2d57 2024-09-12T12:25:41.939 INFO:teuthology.orchestra.run.smithi033.stdout:mds.k smithi043 running (2m) 57s ago 2m 14.5M - 19.1.1-298-gb53b6d3e 54467abc55f8 10eabded2624 2024-09-12T12:25:41.939 INFO:teuthology.orchestra.run.smithi033.stdout:mds.l smithi102 running (2m) 57s ago 2m 20.2M - 19.1.1-298-gb53b6d3e 54467abc55f8 2f116b64dca2 2024-09-12T12:25:41.939 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.x smithi033 *:9283,8765 running (9m) 55s ago 9m 507M - 19.1.1-298-gb53b6d3e 54467abc55f8 9b12cb9dca8a 2024-09-12T12:25:41.940 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.y smithi043 *:8443,8765 running (7m) 57s ago 7m 442M - 19.1.1-298-gb53b6d3e 54467abc55f8 a16592404a0d 2024-09-12T12:25:41.940 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.z smithi102 *:8443,8765 running (7m) 57s ago 7m 441M - 19.1.1-298-gb53b6d3e 54467abc55f8 503ee8567d1e 2024-09-12T12:25:41.940 INFO:teuthology.orchestra.run.smithi033.stdout:mon.a smithi033 running (9m) 55s ago 9m 49.5M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 9782252fc412 2024-09-12T12:25:41.940 INFO:teuthology.orchestra.run.smithi033.stdout:mon.b smithi043 running (8m) 57s ago 8m 40.0M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 9967b2583464 2024-09-12T12:25:41.940 INFO:teuthology.orchestra.run.smithi033.stdout:mon.c smithi102 running (8m) 57s ago 8m 39.1M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 63281261a819 2024-09-12T12:25:41.940 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (7m) 55s ago 7m 59.5M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 06ce36c41f1a 2024-09-12T12:25:41.940 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi043 running (7m) 57s ago 7m 56.2M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 421e1ca27327 2024-09-12T12:25:41.940 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi102 running (6m) 57s ago 6m 59.8M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 88263820d3a1 2024-09-12T12:25:41.940 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi033 running (6m) 55s ago 6m 44.1M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 5a54aab433d3 2024-09-12T12:25:41.940 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi043 running (5m) 57s ago 5m 52.7M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 76afde3eabe3 2024-09-12T12:25:41.940 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi102 running (5m) 57s ago 5m 55.9M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 a1904e488cb5 2024-09-12T12:25:41.940 INFO:teuthology.orchestra.run.smithi033.stdout:osd.6 smithi033 running (4m) 55s ago 4m 52.5M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 1a3546b05d24 2024-09-12T12:25:41.940 INFO:teuthology.orchestra.run.smithi033.stdout:osd.7 smithi043 running (4m) 57s ago 4m 54.6M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 afebe004094b 2024-09-12T12:25:41.940 INFO:teuthology.orchestra.run.smithi033.stdout:osd.8 smithi102 running (4m) 57s ago 4m 42.6M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 8fee956938af 2024-09-12T12:25:41.941 INFO:teuthology.orchestra.run.smithi033.stdout:osd.9 smithi033 running (3m) 55s ago 3m 43.3M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 cc7b2e9445d2 2024-09-12T12:25:41.941 INFO:teuthology.orchestra.run.smithi033.stdout:osd.10 smithi043 running (3m) 57s ago 3m 45.5M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 c052649645b4 2024-09-12T12:25:41.941 INFO:teuthology.orchestra.run.smithi033.stdout:osd.11 smithi102 running (2m) 57s ago 2m 42.0M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 4bcbc54994d9 2024-09-12T12:25:41.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.940+0000 7ff801366640 1 -- 172.21.15.33:0/3138331714 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff7e80a2c40 msgr2=0x7ff7e80a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:41.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.940+0000 7ff801366640 1 --2- 172.21.15.33:0/3138331714 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff7e80a2c40 0x7ff7e80a5100 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc102c60 tx=0x7ff7ec009520 comp rx=0 tx=0).stop 2024-09-12T12:25:41.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.940+0000 7ff801366640 1 -- 172.21.15.33:0/3138331714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7fc1037c0 msgr2=0x7ff7fc19f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:41.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.940+0000 7ff801366640 1 --2- 172.21.15.33:0/3138331714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7fc1037c0 0x7ff7fc19f3a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff7f4005940 tx=0x7ff7f4031a30 comp rx=0 tx=0).stop 2024-09-12T12:25:41.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.940+0000 7ff801366640 1 -- 172.21.15.33:0/3138331714 shutdown_connections 2024-09-12T12:25:41.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.940+0000 7ff801366640 1 --2- 172.21.15.33:0/3138331714 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff7e80a2c40 0x7ff7e80a5100 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:41.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.940+0000 7ff801366640 1 --2- 172.21.15.33:0/3138331714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7fc1037c0 0x7ff7fc19f3a0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:41.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.940+0000 7ff801366640 1 --2- 172.21.15.33:0/3138331714 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7fc102e00 0x7ff7fc198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:41.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.940+0000 7ff801366640 1 --2- 172.21.15.33:0/3138331714 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7fc101c00 0x7ff7fc197de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:41.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.940+0000 7ff801366640 1 -- 172.21.15.33:0/3138331714 >> 172.21.15.33:0/3138331714 conn(0x7ff7fc0fd390 msgr2=0x7ff7fc106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:41.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.940+0000 7ff801366640 1 -- 172.21.15.33:0/3138331714 shutdown_connections 2024-09-12T12:25:41.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:41.940+0000 7ff801366640 1 -- 172.21.15.33:0/3138331714 wait complete. 2024-09-12T12:25:42.792 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-12T12:25:43.056 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:43.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:43 smithi033 ceph-mon[31246]: pgmap v339: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T12:25:43.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:43 smithi033 ceph-mon[31246]: from='client.15114 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:25:43.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.545+0000 7f09d3386640 1 -- 172.21.15.33:0/2082326824 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09cc1026d0 msgr2=0x7f09cc108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:43.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.545+0000 7f09d3386640 1 --2- 172.21.15.33:0/2082326824 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09cc1026d0 0x7f09cc108f60 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f09c4009ca0 tx=0x7f09c402a8c0 comp rx=0 tx=0).stop 2024-09-12T12:25:43.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.545+0000 7f09d3386640 1 -- 172.21.15.33:0/2082326824 shutdown_connections 2024-09-12T12:25:43.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.545+0000 7f09d3386640 1 --2- 172.21.15.33:0/2082326824 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09cc1026d0 0x7f09cc108f60 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:43.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.545+0000 7f09d3386640 1 --2- 172.21.15.33:0/2082326824 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09cc101d10 0x7f09cc102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:43.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.545+0000 7f09d3386640 1 --2- 172.21.15.33:0/2082326824 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09cc100b10 0x7f09cc100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:43.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.545+0000 7f09d3386640 1 -- 172.21.15.33:0/2082326824 >> 172.21.15.33:0/2082326824 conn(0x7f09cc0fc2a0 msgr2=0x7f09cc0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:43.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.545+0000 7f09d3386640 1 -- 172.21.15.33:0/2082326824 shutdown_connections 2024-09-12T12:25:43.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.545+0000 7f09d3386640 1 -- 172.21.15.33:0/2082326824 wait complete. 2024-09-12T12:25:43.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.546+0000 7f09d3386640 1 Processor -- start 2024-09-12T12:25:43.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.546+0000 7f09d3386640 1 -- start start 2024-09-12T12:25:43.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.546+0000 7f09d3386640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09cc100b10 0x7f09cc06b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:43.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.546+0000 7f09d3386640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09cc101d10 0x7f09cc19cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:43.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.546+0000 7f09d3386640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09cc1026d0 0x7f09cc19f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:43.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.546+0000 7f09d3386640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f09cc10c620 con 0x7f09cc101d10 2024-09-12T12:25:43.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.546+0000 7f09d3386640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f09cc10c4a0 con 0x7f09cc1026d0 2024-09-12T12:25:43.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.546+0000 7f09d3386640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f09cc10c7a0 con 0x7f09cc100b10 2024-09-12T12:25:43.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.546+0000 7f09d0921640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09cc101d10 0x7f09cc19cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:43.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.546+0000 7f09d0921640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09cc101d10 0x7f09cc19cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60750/0 (socket says 172.21.15.33:60750) 2024-09-12T12:25:43.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.546+0000 7f09d0921640 1 -- 172.21.15.33:0/3118622370 learned_addr learned my addr 172.21.15.33:0/3118622370 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:43.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.546+0000 7f09d1923640 1 --2- 172.21.15.33:0/3118622370 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09cc1026d0 0x7f09cc19f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:43.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.546+0000 7f09d1122640 1 --2- 172.21.15.33:0/3118622370 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09cc100b10 0x7f09cc06b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:43.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.546+0000 7f09d0921640 1 -- 172.21.15.33:0/3118622370 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09cc100b10 msgr2=0x7f09cc06b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:43.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.546+0000 7f09d0921640 1 --2- 172.21.15.33:0/3118622370 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09cc100b10 0x7f09cc06b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:43.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.546+0000 7f09d0921640 1 -- 172.21.15.33:0/3118622370 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09cc1026d0 msgr2=0x7f09cc19f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:43.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.546+0000 7f09d0921640 1 --2- 172.21.15.33:0/3118622370 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09cc1026d0 0x7f09cc19f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:43.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.546+0000 7f09d0921640 1 -- 172.21.15.33:0/3118622370 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09cc19f9f0 con 0x7f09cc101d10 2024-09-12T12:25:43.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.547+0000 7f09d1923640 1 --2- 172.21.15.33:0/3118622370 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09cc1026d0 0x7f09cc19f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:43.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.547+0000 7f09d0921640 1 --2- 172.21.15.33:0/3118622370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09cc101d10 0x7f09cc19cae0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f09c000e9f0 tx=0x7f09c000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:43.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.547+0000 7f09be7fc640 1 -- 172.21.15.33:0/3118622370 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c000cd80 con 0x7f09cc101d10 2024-09-12T12:25:43.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.547+0000 7f09be7fc640 1 -- 172.21.15.33:0/3118622370 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f09c00108e0 con 0x7f09cc101d10 2024-09-12T12:25:43.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.547+0000 7f09be7fc640 1 -- 172.21.15.33:0/3118622370 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c0018920 con 0x7f09cc101d10 2024-09-12T12:25:43.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.547+0000 7f09d3386640 1 -- 172.21.15.33:0/3118622370 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09cc19fce0 con 0x7f09cc101d10 2024-09-12T12:25:43.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.547+0000 7f09d3386640 1 -- 172.21.15.33:0/3118622370 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09cc1a01c0 con 0x7f09cc101d10 2024-09-12T12:25:43.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.548+0000 7f09d3386640 1 -- 172.21.15.33:0/3118622370 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09cc107f10 con 0x7f09cc101d10 2024-09-12T12:25:43.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.549+0000 7f09be7fc640 1 -- 172.21.15.33:0/3118622370 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f09c0010a90 con 0x7f09cc101d10 2024-09-12T12:25:43.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.550+0000 7f09be7fc640 1 --2- 172.21.15.33:0/3118622370 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f09b80a2c10 0x7f09b80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:43.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.550+0000 7f09d1122640 1 --2- 172.21.15.33:0/3118622370 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f09b80a2c10 0x7f09b80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:43.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.550+0000 7f09be7fc640 1 -- 172.21.15.33:0/3118622370 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7f09c00cfe90 con 0x7f09cc101d10 2024-09-12T12:25:43.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.550+0000 7f09d1122640 1 --2- 172.21.15.33:0/3118622370 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f09b80a2c10 0x7f09b80a50d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f09cc06b870 tx=0x7f09c8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:43.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.553+0000 7f09be7fc640 1 -- 172.21.15.33:0/3118622370 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f09c009c930 con 0x7f09cc101d10 2024-09-12T12:25:43.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:43 smithi043 ceph-mon[34144]: pgmap v339: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T12:25:43.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:43 smithi043 ceph-mon[34144]: from='client.15114 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:25:43.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:43 smithi102 ceph-mon[34799]: pgmap v339: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T12:25:43.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:43 smithi102 ceph-mon[34799]: from='client.15114 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:25:43.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.740+0000 7f09d3386640 1 -- 172.21.15.33:0/3118622370 --> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f09cc062630 con 0x7f09b80a2c10 2024-09-12T12:25:43.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.746+0000 7f09be7fc640 1 -- 172.21.15.33:0/3118622370 <== mgr.14150 v2:172.21.15.33:6800/176202431 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f09cc062630 con 0x7f09b80a2c10 2024-09-12T12:25:43.746 INFO:teuthology.orchestra.run.smithi033.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-12T12:25:43.746 INFO:teuthology.orchestra.run.smithi033.stdout:mds.all 12/12 59s ago 2m smithi033=a;smithi033=d;smithi033=g;smithi033=j;smithi043=b;smithi043=e;smithi043=h;smithi043=k;smithi102=c;smithi102=f;smithi102=i;smithi102=l;count:12 2024-09-12T12:25:43.746 INFO:teuthology.orchestra.run.smithi033.stdout:mgr 3/3 59s ago 7m smithi033=x;smithi043=y;smithi102=z;count:3 2024-09-12T12:25:43.746 INFO:teuthology.orchestra.run.smithi033.stdout:mon 3/3 59s ago 8m smithi033:172.21.15.33=a;smithi043:172.21.15.43=b;smithi102:172.21.15.102=c;count:3 2024-09-12T12:25:43.746 INFO:teuthology.orchestra.run.smithi033.stdout:osd 12 59s ago - 2024-09-12T12:25:43.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.748+0000 7f09d3386640 1 -- 172.21.15.33:0/3118622370 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f09b80a2c10 msgr2=0x7f09b80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:43.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.748+0000 7f09d3386640 1 --2- 172.21.15.33:0/3118622370 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f09b80a2c10 0x7f09b80a50d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f09cc06b870 tx=0x7f09c8005f90 comp rx=0 tx=0).stop 2024-09-12T12:25:43.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.748+0000 7f09d3386640 1 -- 172.21.15.33:0/3118622370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09cc101d10 msgr2=0x7f09cc19cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:43.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.748+0000 7f09d3386640 1 --2- 172.21.15.33:0/3118622370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09cc101d10 0x7f09cc19cae0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f09c000e9f0 tx=0x7f09c000eeb0 comp rx=0 tx=0).stop 2024-09-12T12:25:43.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.748+0000 7f09d3386640 1 -- 172.21.15.33:0/3118622370 shutdown_connections 2024-09-12T12:25:43.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.748+0000 7f09d3386640 1 --2- 172.21.15.33:0/3118622370 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f09b80a2c10 0x7f09b80a50d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:43.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.748+0000 7f09d3386640 1 --2- 172.21.15.33:0/3118622370 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09cc1026d0 0x7f09cc19f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:43.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.748+0000 7f09d3386640 1 --2- 172.21.15.33:0/3118622370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09cc101d10 0x7f09cc19cae0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:43.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.748+0000 7f09d3386640 1 --2- 172.21.15.33:0/3118622370 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09cc100b10 0x7f09cc06b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:43.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.748+0000 7f09d3386640 1 -- 172.21.15.33:0/3118622370 >> 172.21.15.33:0/3118622370 conn(0x7f09cc0fc2a0 msgr2=0x7f09cc1050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:43.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.748+0000 7f09d3386640 1 -- 172.21.15.33:0/3118622370 shutdown_connections 2024-09-12T12:25:43.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:43.748+0000 7f09d3386640 1 -- 172.21.15.33:0/3118622370 wait complete. 2024-09-12T12:25:44.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:44 smithi033 ceph-mon[31246]: from='client.15120 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:25:44.567 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-12T12:25:44.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:44 smithi043 ceph-mon[34144]: from='client.15120 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:25:44.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:44 smithi102 ceph-mon[34799]: from='client.15120 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:25:44.828 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:45.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.290+0000 7f4bea65d640 1 -- 172.21.15.33:0/1057715399 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4be41037d0 msgr2=0x7f4be410a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:45.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.290+0000 7f4bea65d640 1 --2- 172.21.15.33:0/1057715399 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4be41037d0 0x7f4be410a060 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc009ca0 tx=0x7f4bdc02a8c0 comp rx=0 tx=0).stop 2024-09-12T12:25:45.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.290+0000 7f4bea65d640 1 -- 172.21.15.33:0/1057715399 shutdown_connections 2024-09-12T12:25:45.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.290+0000 7f4bea65d640 1 --2- 172.21.15.33:0/1057715399 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4be41037d0 0x7f4be410a060 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:45.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.290+0000 7f4bea65d640 1 --2- 172.21.15.33:0/1057715399 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4be4102e10 0x7f4be4103290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:45.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.290+0000 7f4bea65d640 1 --2- 172.21.15.33:0/1057715399 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4be4101c10 0x7f4be4102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:45.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.290+0000 7f4bea65d640 1 -- 172.21.15.33:0/1057715399 >> 172.21.15.33:0/1057715399 conn(0x7f4be40fd3c0 msgr2=0x7f4be40ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:45.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.290+0000 7f4bea65d640 1 -- 172.21.15.33:0/1057715399 shutdown_connections 2024-09-12T12:25:45.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.290+0000 7f4bea65d640 1 -- 172.21.15.33:0/1057715399 wait complete. 2024-09-12T12:25:45.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.290+0000 7f4bea65d640 1 Processor -- start 2024-09-12T12:25:45.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.290+0000 7f4bea65d640 1 -- start start 2024-09-12T12:25:45.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.291+0000 7f4bea65d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4be4101c10 0x7f4be4197d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:45.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.291+0000 7f4bea65d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4be4102e10 0x7f4be41982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:45.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.291+0000 7f4bea65d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4be41037d0 0x7f4be419f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:45.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.291+0000 7f4bea65d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4be410d7a0 con 0x7f4be4102e10 2024-09-12T12:25:45.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.291+0000 7f4bea65d640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4be410d620 con 0x7f4be41037d0 2024-09-12T12:25:45.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.291+0000 7f4bea65d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4be410d920 con 0x7f4be4101c10 2024-09-12T12:25:45.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.291+0000 7f4be37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4be4102e10 0x7f4be41982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:45.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.291+0000 7f4be37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4be4102e10 0x7f4be41982d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60762/0 (socket says 172.21.15.33:60762) 2024-09-12T12:25:45.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.291+0000 7f4be37fe640 1 -- 172.21.15.33:0/2306432905 learned_addr learned my addr 172.21.15.33:0/2306432905 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:45.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.291+0000 7f4be3fff640 1 --2- 172.21.15.33:0/2306432905 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4be4101c10 0x7f4be4197d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:45.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.291+0000 7f4be8bfa640 1 --2- 172.21.15.33:0/2306432905 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4be41037d0 0x7f4be419f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:45.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.291+0000 7f4be37fe640 1 -- 172.21.15.33:0/2306432905 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4be4101c10 msgr2=0x7f4be4197d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:45.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.291+0000 7f4be37fe640 1 --2- 172.21.15.33:0/2306432905 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4be4101c10 0x7f4be4197d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:45.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.291+0000 7f4be37fe640 1 -- 172.21.15.33:0/2306432905 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4be41037d0 msgr2=0x7f4be419f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:45.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.291+0000 7f4be37fe640 1 --2- 172.21.15.33:0/2306432905 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4be41037d0 0x7f4be419f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:45.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.291+0000 7f4be37fe640 1 -- 172.21.15.33:0/2306432905 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4be419f9b0 con 0x7f4be4102e10 2024-09-12T12:25:45.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.291+0000 7f4be37fe640 1 --2- 172.21.15.33:0/2306432905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4be4102e10 0x7f4be41982d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4bd800b4a0 tx=0x7f4bd800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:45.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.292+0000 7f4be17fa640 1 -- 172.21.15.33:0/2306432905 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd8014070 con 0x7f4be4102e10 2024-09-12T12:25:45.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.292+0000 7f4be17fa640 1 -- 172.21.15.33:0/2306432905 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4bd8010ac0 con 0x7f4be4102e10 2024-09-12T12:25:45.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.292+0000 7f4be17fa640 1 -- 172.21.15.33:0/2306432905 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd8017c30 con 0x7f4be4102e10 2024-09-12T12:25:45.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.292+0000 7f4bea65d640 1 -- 172.21.15.33:0/2306432905 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4be419fca0 con 0x7f4be4102e10 2024-09-12T12:25:45.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.292+0000 7f4bea65d640 1 -- 172.21.15.33:0/2306432905 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4be41a0190 con 0x7f4be4102e10 2024-09-12T12:25:45.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.293+0000 7f4bea65d640 1 -- 172.21.15.33:0/2306432905 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4be4108fc0 con 0x7f4be4102e10 2024-09-12T12:25:45.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.294+0000 7f4be17fa640 1 -- 172.21.15.33:0/2306432905 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4bd8017070 con 0x7f4be4102e10 2024-09-12T12:25:45.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.295+0000 7f4be17fa640 1 --2- 172.21.15.33:0/2306432905 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f4bcc0a2c90 0x7f4bcc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:45.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.295+0000 7f4be17fa640 1 -- 172.21.15.33:0/2306432905 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7f4bd80ce690 con 0x7f4be4102e10 2024-09-12T12:25:45.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.295+0000 7f4be3fff640 1 --2- 172.21.15.33:0/2306432905 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f4bcc0a2c90 0x7f4bcc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:45.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.295+0000 7f4be3fff640 1 --2- 172.21.15.33:0/2306432905 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f4bcc0a2c90 0x7f4bcc0a5150 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4be4199270 tx=0x7f4bd4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:45.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.299+0000 7f4be17fa640 1 -- 172.21.15.33:0/2306432905 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4bd809abf0 con 0x7f4be4102e10 2024-09-12T12:25:45.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.479+0000 7f4bea65d640 1 -- 172.21.15.33:0/2306432905 --> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f4be4062630 con 0x7f4bcc0a2c90 2024-09-12T12:25:45.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:45 smithi033 ceph-mon[31246]: pgmap v340: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-12T12:25:45.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.481+0000 7f4be17fa640 1 -- 172.21.15.33:0/2306432905 <== mgr.14150 v2:172.21.15.33:6800/176202431 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f4be4062630 con 0x7f4bcc0a2c90 2024-09-12T12:25:45.481 INFO:teuthology.orchestra.run.smithi033.stdout:HOST ADDR LABELS STATUS 2024-09-12T12:25:45.481 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033 172.21.15.33 2024-09-12T12:25:45.481 INFO:teuthology.orchestra.run.smithi033.stdout:smithi043 172.21.15.43 2024-09-12T12:25:45.481 INFO:teuthology.orchestra.run.smithi033.stdout:smithi102 172.21.15.102 2024-09-12T12:25:45.481 INFO:teuthology.orchestra.run.smithi033.stdout:3 hosts in cluster 2024-09-12T12:25:45.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.483+0000 7f4bea65d640 1 -- 172.21.15.33:0/2306432905 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f4bcc0a2c90 msgr2=0x7f4bcc0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:45.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.483+0000 7f4bea65d640 1 --2- 172.21.15.33:0/2306432905 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f4bcc0a2c90 0x7f4bcc0a5150 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4be4199270 tx=0x7f4bd4005f90 comp rx=0 tx=0).stop 2024-09-12T12:25:45.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.483+0000 7f4bea65d640 1 -- 172.21.15.33:0/2306432905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4be4102e10 msgr2=0x7f4be41982d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:45.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.483+0000 7f4bea65d640 1 --2- 172.21.15.33:0/2306432905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4be4102e10 0x7f4be41982d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4bd800b4a0 tx=0x7f4bd800b960 comp rx=0 tx=0).stop 2024-09-12T12:25:45.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.483+0000 7f4bea65d640 1 -- 172.21.15.33:0/2306432905 shutdown_connections 2024-09-12T12:25:45.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.483+0000 7f4bea65d640 1 --2- 172.21.15.33:0/2306432905 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f4bcc0a2c90 0x7f4bcc0a5150 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:45.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.483+0000 7f4bea65d640 1 --2- 172.21.15.33:0/2306432905 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4be41037d0 0x7f4be419f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:45.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.483+0000 7f4bea65d640 1 --2- 172.21.15.33:0/2306432905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4be4102e10 0x7f4be41982d0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:45.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.483+0000 7f4bea65d640 1 --2- 172.21.15.33:0/2306432905 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4be4101c10 0x7f4be4197d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:45.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.483+0000 7f4bea65d640 1 -- 172.21.15.33:0/2306432905 >> 172.21.15.33:0/2306432905 conn(0x7f4be40fd3c0 msgr2=0x7f4be4106190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:45.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.483+0000 7f4bea65d640 1 -- 172.21.15.33:0/2306432905 shutdown_connections 2024-09-12T12:25:45.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:45.483+0000 7f4bea65d640 1 -- 172.21.15.33:0/2306432905 wait complete. 2024-09-12T12:25:45.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:45 smithi043 ceph-mon[34144]: pgmap v340: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-12T12:25:45.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:45 smithi102 ceph-mon[34799]: pgmap v340: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-12T12:25:46.172 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-12T12:25:46.433 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:46.578 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:46 smithi033 ceph-mon[31246]: from='client.15126 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:25:46.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:46 smithi043 ceph-mon[34144]: from='client.15126 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:25:46.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:46 smithi102 ceph-mon[34799]: from='client.15126 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:25:47.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:46.976+0000 7f720a62a640 1 -- 172.21.15.33:0/528609963 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72041026f0 msgr2=0x7f7204104ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:47.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:46.976+0000 7f720a62a640 1 --2- 172.21.15.33:0/528609963 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72041026f0 0x7f7204104ae0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f71f4009ca0 tx=0x7f71f402a8c0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:46.977+0000 7f720a62a640 1 -- 172.21.15.33:0/528609963 shutdown_connections 2024-09-12T12:25:47.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:46.977+0000 7f720a62a640 1 --2- 172.21.15.33:0/528609963 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7204107950 0x7f7204109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:46.977+0000 7f720a62a640 1 --2- 172.21.15.33:0/528609963 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7204105020 0x7f7204107410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:46.977+0000 7f720a62a640 1 --2- 172.21.15.33:0/528609963 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72041026f0 0x7f7204104ae0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:46.977+0000 7f720a62a640 1 -- 172.21.15.33:0/528609963 >> 172.21.15.33:0/528609963 conn(0x7f72040fc270 msgr2=0x7f72040fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:47.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:46.977+0000 7f720a62a640 1 -- 172.21.15.33:0/528609963 shutdown_connections 2024-09-12T12:25:47.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:46.977+0000 7f720a62a640 1 -- 172.21.15.33:0/528609963 wait complete. 2024-09-12T12:25:47.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:46.977+0000 7f720a62a640 1 Processor -- start 2024-09-12T12:25:47.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:46.977+0000 7f720a62a640 1 -- start start 2024-09-12T12:25:47.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:46.977+0000 7f720a62a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72041026f0 0x7f7204197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:47.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:46.978+0000 7f720a62a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7204105020 0x7f7204198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:47.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:46.978+0000 7f720a62a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7204107950 0x7f720419f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:47.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:46.978+0000 7f720a62a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f720410d740 con 0x7f7204105020 2024-09-12T12:25:47.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:46.978+0000 7f720a62a640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f720410d5c0 con 0x7f7204107950 2024-09-12T12:25:47.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:46.978+0000 7f720a62a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f720410d8c0 con 0x7f72041026f0 2024-09-12T12:25:47.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:46.978+0000 7f72037fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7204105020 0x7f7204198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:47.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:46.978+0000 7f7203fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72041026f0 0x7f7204197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:47.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:46.978+0000 7f72037fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7204105020 0x7f7204198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60778/0 (socket says 172.21.15.33:60778) 2024-09-12T12:25:47.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:46.978+0000 7f7203fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72041026f0 0x7f7204197f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:60862/0 (socket says 172.21.15.33:60862) 2024-09-12T12:25:47.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:46.978+0000 7f72037fe640 1 -- 172.21.15.33:0/3404299323 learned_addr learned my addr 172.21.15.33:0/3404299323 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:47.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:46.978+0000 7f7208bc7640 1 --2- 172.21.15.33:0/3404299323 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7204107950 0x7f720419f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:47.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:46.978+0000 7f72037fe640 1 -- 172.21.15.33:0/3404299323 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72041026f0 msgr2=0x7f7204197f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:47.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:46.978+0000 7f72037fe640 1 --2- 172.21.15.33:0/3404299323 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72041026f0 0x7f7204197f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:46.978+0000 7f72037fe640 1 -- 172.21.15.33:0/3404299323 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7204107950 msgr2=0x7f720419f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:47.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:46.978+0000 7f72037fe640 1 --2- 172.21.15.33:0/3404299323 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7204107950 0x7f720419f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:46.978+0000 7f72037fe640 1 -- 172.21.15.33:0/3404299323 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f720419fb40 con 0x7f7204105020 2024-09-12T12:25:47.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:46.978+0000 7f7203fff640 1 --2- 172.21.15.33:0/3404299323 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72041026f0 0x7f7204197f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:25:47.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:46.978+0000 7f72037fe640 1 --2- 172.21.15.33:0/3404299323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7204105020 0x7f7204198450 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f71fc005fd0 tx=0x7f71fc00dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:47.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:46.978+0000 7f72017fa640 1 -- 172.21.15.33:0/3404299323 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71fc017070 con 0x7f7204105020 2024-09-12T12:25:47.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:46.979+0000 7f720a62a640 1 -- 172.21.15.33:0/3404299323 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f720419fe30 con 0x7f7204105020 2024-09-12T12:25:47.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:46.979+0000 7f72017fa640 1 -- 172.21.15.33:0/3404299323 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f71fc009c30 con 0x7f7204105020 2024-09-12T12:25:47.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:46.979+0000 7f72017fa640 1 -- 172.21.15.33:0/3404299323 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71fc003d40 con 0x7f7204105020 2024-09-12T12:25:47.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:46.979+0000 7f720a62a640 1 -- 172.21.15.33:0/3404299323 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72041a0330 con 0x7f7204105020 2024-09-12T12:25:47.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:46.980+0000 7f720a62a640 1 -- 172.21.15.33:0/3404299323 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72040fdd60 con 0x7f7204105020 2024-09-12T12:25:47.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:46.981+0000 7f72017fa640 1 -- 172.21.15.33:0/3404299323 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f71fc003ee0 con 0x7f7204105020 2024-09-12T12:25:47.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:46.982+0000 7f72017fa640 1 --2- 172.21.15.33:0/3404299323 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f71f00a2c40 0x7f71f00a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:47.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:46.982+0000 7f7203fff640 1 --2- 172.21.15.33:0/3404299323 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f71f00a2c40 0x7f71f00a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:47.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:46.982+0000 7f72017fa640 1 -- 172.21.15.33:0/3404299323 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7f71fc0cf920 con 0x7f7204105020 2024-09-12T12:25:47.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:46.983+0000 7f7203fff640 1 --2- 172.21.15.33:0/3404299323 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f71f00a2c40 0x7f71f00a5100 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f71f4000f80 tx=0x7f71f4031000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:47.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:46.986+0000 7f72017fa640 1 -- 172.21.15.33:0/3404299323 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f71fc020030 con 0x7f7204105020 2024-09-12T12:25:47.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:47.179+0000 7f720a62a640 1 -- 172.21.15.33:0/3404299323 --> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f7204062630 con 0x7f71f00a2c40 2024-09-12T12:25:47.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:47.181+0000 7f72017fa640 1 -- 172.21.15.33:0/3404299323 <== mgr.14150 v2:172.21.15.33:6800/176202431 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f7204062630 con 0x7f71f00a2c40 2024-09-12T12:25:47.181 INFO:teuthology.orchestra.run.smithi033.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-12T12:25:47.181 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5330008Q400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-12T12:25:47.181 INFO:teuthology.orchestra.run.smithi033.stdout:smithi043 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB751300GH480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-12T12:25:47.181 INFO:teuthology.orchestra.run.smithi033.stdout:smithi102 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400VK400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-12T12:25:47.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:47.183+0000 7f720a62a640 1 -- 172.21.15.33:0/3404299323 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f71f00a2c40 msgr2=0x7f71f00a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:47.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:47.183+0000 7f720a62a640 1 --2- 172.21.15.33:0/3404299323 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f71f00a2c40 0x7f71f00a5100 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f71f4000f80 tx=0x7f71f4031000 comp rx=0 tx=0).stop 2024-09-12T12:25:47.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:47.183+0000 7f720a62a640 1 -- 172.21.15.33:0/3404299323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7204105020 msgr2=0x7f7204198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:47.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:47.183+0000 7f720a62a640 1 --2- 172.21.15.33:0/3404299323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7204105020 0x7f7204198450 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f71fc005fd0 tx=0x7f71fc00dde0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:47.183+0000 7f720a62a640 1 -- 172.21.15.33:0/3404299323 shutdown_connections 2024-09-12T12:25:47.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:47.183+0000 7f720a62a640 1 --2- 172.21.15.33:0/3404299323 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f71f00a2c40 0x7f71f00a5100 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:47.183+0000 7f720a62a640 1 --2- 172.21.15.33:0/3404299323 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7204107950 0x7f720419f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:47.183+0000 7f720a62a640 1 --2- 172.21.15.33:0/3404299323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7204105020 0x7f7204198450 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:47.183+0000 7f720a62a640 1 --2- 172.21.15.33:0/3404299323 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72041026f0 0x7f7204197f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:47.183+0000 7f720a62a640 1 -- 172.21.15.33:0/3404299323 >> 172.21.15.33:0/3404299323 conn(0x7f72040fc270 msgr2=0x7f7204103030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:47.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:47.183+0000 7f720a62a640 1 -- 172.21.15.33:0/3404299323 shutdown_connections 2024-09-12T12:25:47.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:47.183+0000 7f720a62a640 1 -- 172.21.15.33:0/3404299323 wait complete. 2024-09-12T12:25:47.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:47 smithi033 ceph-mon[31246]: pgmap v341: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T12:25:47.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:47 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:25:47.584 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:47 smithi043 ceph-mon[34144]: pgmap v341: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T12:25:47.584 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:47 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:25:47.605 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:47 smithi102 ceph-mon[34799]: pgmap v341: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T12:25:47.605 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:47 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:25:48.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:48 smithi033 ceph-mon[31246]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:25:48.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:48 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:25:48.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:48 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:25:48.607 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-12T12:25:49.320 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi033.front.sepia.ceph.com 2024-09-12T12:25:49.320 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-12T12:25:49.322 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:48 smithi102 ceph-mon[34799]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:25:49.322 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:48 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:25:49.322 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:48 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:25:49.322 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:48 smithi043 ceph-mon[34144]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:25:49.322 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:48 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:25:49.322 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:48 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:25:49.584 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:49.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:49 smithi043 ceph-mon[34144]: pgmap v342: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-12T12:25:49.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:49 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:25:49.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:49 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:25:49.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:49 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:25:49.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:49 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:25:49.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:49 smithi102 ceph-mon[34799]: pgmap v342: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-12T12:25:49.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:49 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:25:49.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:49 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:25:49.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:49 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:25:49.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:49 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:25:49.706 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:49 smithi033 ceph-mon[31246]: pgmap v342: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-12T12:25:49.706 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:49 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:25:49.706 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:49 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:25:49.706 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:49 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:25:49.706 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:49 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:25:50.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.062+0000 7fa999297640 1 -- 172.21.15.33:0/709364156 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa994102690 msgr2=0x7fa994104a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:50.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.062+0000 7fa999297640 1 --2- 172.21.15.33:0/709364156 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa994102690 0x7fa994104a80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa984009900 tx=0x7fa98402a3f0 comp rx=0 tx=0).stop 2024-09-12T12:25:50.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.062+0000 7fa999297640 1 -- 172.21.15.33:0/709364156 shutdown_connections 2024-09-12T12:25:50.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.062+0000 7fa999297640 1 --2- 172.21.15.33:0/709364156 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9941078f0 0x7fa994109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:50.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.063+0000 7fa999297640 1 --2- 172.21.15.33:0/709364156 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa994104fc0 0x7fa9941073b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:50.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.063+0000 7fa999297640 1 --2- 172.21.15.33:0/709364156 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa994102690 0x7fa994104a80 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:50.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.063+0000 7fa999297640 1 -- 172.21.15.33:0/709364156 >> 172.21.15.33:0/709364156 conn(0x7fa9940fc270 msgr2=0x7fa9940fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:50.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.063+0000 7fa999297640 1 -- 172.21.15.33:0/709364156 shutdown_connections 2024-09-12T12:25:50.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.063+0000 7fa999297640 1 -- 172.21.15.33:0/709364156 wait complete. 2024-09-12T12:25:50.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.063+0000 7fa999297640 1 Processor -- start 2024-09-12T12:25:50.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.063+0000 7fa999297640 1 -- start start 2024-09-12T12:25:50.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.063+0000 7fa999297640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa994102690 0x7fa994197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:50.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.063+0000 7fa999297640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa994104fc0 0x7fa994198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:50.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.063+0000 7fa999297640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa9941078f0 0x7fa99419f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:50.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.064+0000 7fa999297640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa99410d7c0 con 0x7fa994104fc0 2024-09-12T12:25:50.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.064+0000 7fa999297640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa99410d640 con 0x7fa994102690 2024-09-12T12:25:50.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.064+0000 7fa999297640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa99410d940 con 0x7fa9941078f0 2024-09-12T12:25:50.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.064+0000 7fa9927fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa994104fc0 0x7fa994198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:50.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.064+0000 7fa992ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa994102690 0x7fa994197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:50.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.064+0000 7fa9927fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa994104fc0 0x7fa994198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60794/0 (socket says 172.21.15.33:60794) 2024-09-12T12:25:50.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.064+0000 7fa9927fc640 1 -- 172.21.15.33:0/242737239 learned_addr learned my addr 172.21.15.33:0/242737239 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:50.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.064+0000 7fa9937fe640 1 --2- 172.21.15.33:0/242737239 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa9941078f0 0x7fa99419f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:50.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.064+0000 7fa9927fc640 1 -- 172.21.15.33:0/242737239 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa9941078f0 msgr2=0x7fa99419f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:50.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.064+0000 7fa9927fc640 1 --2- 172.21.15.33:0/242737239 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa9941078f0 0x7fa99419f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:50.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.064+0000 7fa9927fc640 1 -- 172.21.15.33:0/242737239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa994102690 msgr2=0x7fa994197ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:50.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.064+0000 7fa9927fc640 1 --2- 172.21.15.33:0/242737239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa994102690 0x7fa994197ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:50.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.064+0000 7fa9927fc640 1 -- 172.21.15.33:0/242737239 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa99419fb10 con 0x7fa994104fc0 2024-09-12T12:25:50.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.064+0000 7fa9927fc640 1 --2- 172.21.15.33:0/242737239 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa994104fc0 0x7fa994198420 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa98800b450 tx=0x7fa98800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:50.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.064+0000 7fa97bfff640 1 -- 172.21.15.33:0/242737239 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa988015020 con 0x7fa994104fc0 2024-09-12T12:25:50.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.064+0000 7fa97bfff640 1 -- 172.21.15.33:0/242737239 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa988011d40 con 0x7fa994104fc0 2024-09-12T12:25:50.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.064+0000 7fa999297640 1 -- 172.21.15.33:0/242737239 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa99419fe00 con 0x7fa994104fc0 2024-09-12T12:25:50.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.064+0000 7fa97bfff640 1 -- 172.21.15.33:0/242737239 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa98800f340 con 0x7fa994104fc0 2024-09-12T12:25:50.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.065+0000 7fa999297640 1 -- 172.21.15.33:0/242737239 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9941a02e0 con 0x7fa994104fc0 2024-09-12T12:25:50.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.066+0000 7fa999297640 1 -- 172.21.15.33:0/242737239 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9940fdd60 con 0x7fa994104fc0 2024-09-12T12:25:50.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.067+0000 7fa97bfff640 1 -- 172.21.15.33:0/242737239 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa988018020 con 0x7fa994104fc0 2024-09-12T12:25:50.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.068+0000 7fa97bfff640 1 --2- 172.21.15.33:0/242737239 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fa97c0a2c40 0x7fa97c0a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:50.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.068+0000 7fa992ffd640 1 --2- 172.21.15.33:0/242737239 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fa97c0a2c40 0x7fa97c0a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:50.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.068+0000 7fa97bfff640 1 -- 172.21.15.33:0/242737239 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7fa9880cee10 con 0x7fa994104fc0 2024-09-12T12:25:50.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.068+0000 7fa992ffd640 1 --2- 172.21.15.33:0/242737239 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fa97c0a2c40 0x7fa97c0a5100 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa9840314e0 tx=0x7fa984005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:50.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.072+0000 7fa97bfff640 1 -- 172.21.15.33:0/242737239 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa98801f020 con 0x7fa994104fc0 2024-09-12T12:25:50.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.284+0000 7fa999297640 1 -- 172.21.15.33:0/242737239 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fa99402d970 con 0x7fa994104fc0 2024-09-12T12:25:50.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.284+0000 7fa97bfff640 1 -- 172.21.15.33:0/242737239 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+3088 (secure 0 0 0) 0x7fa9880d0c20 con 0x7fa994104fc0 2024-09-12T12:25:50.285 INFO:teuthology.orchestra.run.smithi033.stdout:e24 2024-09-12T12:25:50.285 INFO:teuthology.orchestra.run.smithi033.stdout:btime 2024-09-12T12:24:30:808296+0000 2024-09-12T12:25:50.285 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T12:25:50.285 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T12:25:50.285 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2024-09-12T12:25:50.285 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:25:50.285 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2024-09-12T12:25:50.285 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2024-09-12T12:25:50.285 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 24 2024-09-12T12:25:50.285 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-12T12:25:50.285 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-09-12T12:23:46.400609+0000 2024-09-12T12:25:50.285 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2024-09-12T12:24:30.590211+0000 2024-09-12T12:25:50.286 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2024-09-12T12:25:50.286 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2024-09-12T12:25:50.286 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 300 2024-09-12T12:25:50.286 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2024-09-12T12:25:50.286 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2024-09-12T12:25:50.286 INFO:teuthology.orchestra.run.smithi033.stdout:max_xattr_size 65536 2024-09-12T12:25:50.286 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2024-09-12T12:25:50.286 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2024-09-12T12:25:50.286 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 0 2024-09-12T12:25:50.286 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T12:25:50.286 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 3 2024-09-12T12:25:50.286 INFO:teuthology.orchestra.run.smithi033.stdout:in 0,1,2 2024-09-12T12:25:50.286 INFO:teuthology.orchestra.run.smithi033.stdout:up {0=24499,1=24490,2=24478} 2024-09-12T12:25:50.286 INFO:teuthology.orchestra.run.smithi033.stdout:failed 2024-09-12T12:25:50.287 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2024-09-12T12:25:50.287 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2024-09-12T12:25:50.287 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3,4] 2024-09-12T12:25:50.287 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2024-09-12T12:25:50.287 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data disabled 2024-09-12T12:25:50.287 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2024-09-12T12:25:50.287 INFO:teuthology.orchestra.run.smithi033.stdout:bal_rank_mask -1 2024-09-12T12:25:50.287 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 0 2024-09-12T12:25:50.287 INFO:teuthology.orchestra.run.smithi033.stdout:qdb_cluster leader: 24499 members: 24478,24490,24499 2024-09-12T12:25:50.287 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.i{0:24499} state up:active seq 6 addr [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T12:25:50.287 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.b{0:24473} state up:standby-replay seq 1 addr [v2:172.21.15.43:6838/1987408860,v1:172.21.15.43:6839/1987408860] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T12:25:50.287 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.c{1:24490} state up:active seq 18 addr [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T12:25:50.287 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.h{1:24443} state up:standby-replay seq 1 addr [v2:172.21.15.43:6836/2472064883,v1:172.21.15.43:6837/2472064883] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T12:25:50.287 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.f{2:24478} state up:active seq 19 addr [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T12:25:50.288 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.l{2:24442} state up:standby-replay seq 1 addr [v2:172.21.15.102:6832/3051713000,v1:172.21.15.102:6833/3051713000] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T12:25:50.288 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:25:50.288 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:25:50.288 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2024-09-12T12:25:50.288 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:25:50.288 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.j{-1:14541} state up:standby seq 1 addr [v2:172.21.15.33:6834/3327066342,v1:172.21.15.33:6835/3327066342] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T12:25:50.288 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.d{-1:14553} state up:standby seq 1 addr [v2:172.21.15.33:6836/19516401,v1:172.21.15.33:6837/19516401] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T12:25:50.288 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.g{-1:14604} state up:standby seq 1 addr [v2:172.21.15.33:6838/1260196118,v1:172.21.15.33:6839/1260196118] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T12:25:50.288 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.a{-1:14610} state up:standby seq 1 addr [v2:172.21.15.33:6840/4288248356,v1:172.21.15.33:6841/4288248356] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T12:25:50.288 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.k{-1:24401} state up:standby seq 1 addr [v2:172.21.15.43:6832/3051073141,v1:172.21.15.43:6833/3051073141] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T12:25:50.288 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.e{-1:24425} state up:standby seq 1 addr [v2:172.21.15.43:6834/3282762800,v1:172.21.15.43:6835/3282762800] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T12:25:50.289 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 24 2024-09-12T12:25:50.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.286+0000 7fa999297640 1 -- 172.21.15.33:0/242737239 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fa97c0a2c40 msgr2=0x7fa97c0a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:50.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.286+0000 7fa999297640 1 --2- 172.21.15.33:0/242737239 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fa97c0a2c40 0x7fa97c0a5100 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa9840314e0 tx=0x7fa984005e80 comp rx=0 tx=0).stop 2024-09-12T12:25:50.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.286+0000 7fa999297640 1 -- 172.21.15.33:0/242737239 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa994104fc0 msgr2=0x7fa994198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:50.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.286+0000 7fa999297640 1 --2- 172.21.15.33:0/242737239 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa994104fc0 0x7fa994198420 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa98800b450 tx=0x7fa98800b910 comp rx=0 tx=0).stop 2024-09-12T12:25:50.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.286+0000 7fa999297640 1 -- 172.21.15.33:0/242737239 shutdown_connections 2024-09-12T12:25:50.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.286+0000 7fa999297640 1 --2- 172.21.15.33:0/242737239 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fa97c0a2c40 0x7fa97c0a5100 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:50.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.286+0000 7fa999297640 1 --2- 172.21.15.33:0/242737239 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa9941078f0 0x7fa99419f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:50.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.286+0000 7fa999297640 1 --2- 172.21.15.33:0/242737239 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa994104fc0 0x7fa994198420 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:50.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.286+0000 7fa999297640 1 --2- 172.21.15.33:0/242737239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa994102690 0x7fa994197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:50.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.286+0000 7fa999297640 1 -- 172.21.15.33:0/242737239 >> 172.21.15.33:0/242737239 conn(0x7fa9940fc270 msgr2=0x7fa994103030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:50.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.287+0000 7fa999297640 1 -- 172.21.15.33:0/242737239 shutdown_connections 2024-09-12T12:25:50.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:50.287+0000 7fa999297640 1 -- 172.21.15.33:0/242737239 wait complete. 2024-09-12T12:25:50.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:50 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:25:50.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:50 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:25:50.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:50 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:25:50.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:50 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/242737239' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T12:25:50.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:50 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:25:50.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:50 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:25:50.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:50 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:25:50.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:50 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/242737239' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T12:25:50.721 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:50 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:25:50.721 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:50 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:25:50.721 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:50 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:25:50.721 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:50 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/242737239' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T12:25:51.115 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-12T12:25:51.374 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:51.625 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:51 smithi033 ceph-mon[31246]: pgmap v343: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T12:25:51.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:51 smithi102 ceph-mon[34799]: pgmap v343: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T12:25:51.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:51 smithi043 ceph-mon[34144]: pgmap v343: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T12:25:51.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:51.872+0000 7f93b89e5640 1 -- 172.21.15.33:0/1180520193 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93b41026d0 msgr2=0x7f93b4108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:51.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:51.872+0000 7f93b89e5640 1 --2- 172.21.15.33:0/1180520193 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93b41026d0 0x7f93b4108f60 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f93ac009ca0 tx=0x7f93ac02a8c0 comp rx=0 tx=0).stop 2024-09-12T12:25:51.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:51.872+0000 7f93b89e5640 1 -- 172.21.15.33:0/1180520193 shutdown_connections 2024-09-12T12:25:51.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:51.872+0000 7f93b89e5640 1 --2- 172.21.15.33:0/1180520193 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93b41026d0 0x7f93b4108f60 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:51.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:51.872+0000 7f93b89e5640 1 --2- 172.21.15.33:0/1180520193 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f93b4101d10 0x7f93b4102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:51.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:51.872+0000 7f93b89e5640 1 --2- 172.21.15.33:0/1180520193 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93b4100b10 0x7f93b4100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:51.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:51.872+0000 7f93b89e5640 1 -- 172.21.15.33:0/1180520193 >> 172.21.15.33:0/1180520193 conn(0x7f93b40fc2a0 msgr2=0x7f93b40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:51.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:51.872+0000 7f93b89e5640 1 -- 172.21.15.33:0/1180520193 shutdown_connections 2024-09-12T12:25:51.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:51.872+0000 7f93b89e5640 1 -- 172.21.15.33:0/1180520193 wait complete. 2024-09-12T12:25:51.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:51.873+0000 7f93b89e5640 1 Processor -- start 2024-09-12T12:25:51.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:51.873+0000 7f93b89e5640 1 -- start start 2024-09-12T12:25:51.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:51.873+0000 7f93b89e5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93b4100b10 0x7f93b4197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:51.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:51.873+0000 7f93b89e5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f93b4101d10 0x7f93b4198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:51.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:51.873+0000 7f93b89e5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93b41026d0 0x7f93b419f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:51.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:51.873+0000 7f93b89e5640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f93b410c640 con 0x7f93b4100b10 2024-09-12T12:25:51.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:51.873+0000 7f93b89e5640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f93b410c4c0 con 0x7f93b41026d0 2024-09-12T12:25:51.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:51.873+0000 7f93b89e5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f93b410c7c0 con 0x7f93b4101d10 2024-09-12T12:25:51.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:51.873+0000 7f93b259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93b4100b10 0x7f93b4197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:51.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:51.873+0000 7f93b259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93b4100b10 0x7f93b4197e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56594/0 (socket says 172.21.15.33:56594) 2024-09-12T12:25:51.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:51.873+0000 7f93b259c640 1 -- 172.21.15.33:0/3125507781 learned_addr learned my addr 172.21.15.33:0/3125507781 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:51.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:51.873+0000 7f93a9d9b640 1 --2- 172.21.15.33:0/3125507781 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f93b4101d10 0x7f93b4198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:51.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:51.873+0000 7f93b2d9d640 1 --2- 172.21.15.33:0/3125507781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93b41026d0 0x7f93b419f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:51.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:51.874+0000 7f93b259c640 1 -- 172.21.15.33:0/3125507781 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f93b4101d10 msgr2=0x7f93b4198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:51.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:51.874+0000 7f93b259c640 1 --2- 172.21.15.33:0/3125507781 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f93b4101d10 0x7f93b4198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:51.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:51.874+0000 7f93b259c640 1 -- 172.21.15.33:0/3125507781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93b41026d0 msgr2=0x7f93b419f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:51.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:51.874+0000 7f93b259c640 1 --2- 172.21.15.33:0/3125507781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93b41026d0 0x7f93b419f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:51.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:51.874+0000 7f93b259c640 1 -- 172.21.15.33:0/3125507781 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93b419fa40 con 0x7f93b4100b10 2024-09-12T12:25:51.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:51.874+0000 7f93b259c640 1 --2- 172.21.15.33:0/3125507781 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93b4100b10 0x7f93b4197e10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f93a400d770 tx=0x7f93a400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:51.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:51.874+0000 7f93abfff640 1 -- 172.21.15.33:0/3125507781 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a4017070 con 0x7f93b4100b10 2024-09-12T12:25:51.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:51.874+0000 7f93b89e5640 1 -- 172.21.15.33:0/3125507781 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93b419fd30 con 0x7f93b4100b10 2024-09-12T12:25:51.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:51.874+0000 7f93abfff640 1 -- 172.21.15.33:0/3125507781 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f93a4009c30 con 0x7f93b4100b10 2024-09-12T12:25:51.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:51.874+0000 7f93abfff640 1 -- 172.21.15.33:0/3125507781 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a4003d00 con 0x7f93b4100b10 2024-09-12T12:25:51.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:51.874+0000 7f93b89e5640 1 -- 172.21.15.33:0/3125507781 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93b41a0200 con 0x7f93b4100b10 2024-09-12T12:25:51.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:51.875+0000 7f93b89e5640 1 -- 172.21.15.33:0/3125507781 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93b41a0430 con 0x7f93b4100b10 2024-09-12T12:25:51.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:51.876+0000 7f93abfff640 1 -- 172.21.15.33:0/3125507781 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f93a4003ea0 con 0x7f93b4100b10 2024-09-12T12:25:51.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:51.877+0000 7f93abfff640 1 --2- 172.21.15.33:0/3125507781 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f93a00a2c40 0x7f93a00a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:51.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:51.877+0000 7f93a9d9b640 1 --2- 172.21.15.33:0/3125507781 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f93a00a2c40 0x7f93a00a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:51.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:51.877+0000 7f93abfff640 1 -- 172.21.15.33:0/3125507781 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7f93a40cee80 con 0x7f93b4100b10 2024-09-12T12:25:51.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:51.878+0000 7f93a9d9b640 1 --2- 172.21.15.33:0/3125507781 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f93a00a2c40 0x7f93a00a5100 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f93b4199330 tx=0x7f939c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:51.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:51.881+0000 7f93abfff640 1 -- 172.21.15.33:0/3125507781 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f93a4009de0 con 0x7f93b4100b10 2024-09-12T12:25:52.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:52.059+0000 7f93b89e5640 1 -- 172.21.15.33:0/3125507781 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f93b41a0760 con 0x7f93b4100b10 2024-09-12T12:25:52.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:52.060+0000 7f93abfff640 1 -- 172.21.15.33:0/3125507781 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v87) ==== 56+0+5577 (secure 0 0 0) 0x7f93a409b270 con 0x7f93b4100b10 2024-09-12T12:25:52.060 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 87 2024-09-12T12:25:52.061 INFO:teuthology.orchestra.run.smithi033.stdout:fsid a66dfafc-7100-11ef-bcea-c7b262605968 2024-09-12T12:25:52.061 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-09-12T12:16:11.904815+0000 2024-09-12T12:25:52.061 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2024-09-12T12:24:59.115664+0000 2024-09-12T12:25:52.061 INFO:teuthology.orchestra.run.smithi033.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-12T12:25:52.061 INFO:teuthology.orchestra.run.smithi033.stdout:crush_version 27 2024-09-12T12:25:52.061 INFO:teuthology.orchestra.run.smithi033.stdout:full_ratio 0.95 2024-09-12T12:25:52.061 INFO:teuthology.orchestra.run.smithi033.stdout:backfillfull_ratio 0.9 2024-09-12T12:25:52.061 INFO:teuthology.orchestra.run.smithi033.stdout:nearfull_ratio 0.85 2024-09-12T12:25:52.061 INFO:teuthology.orchestra.run.smithi033.stdout:require_min_compat_client luminous 2024-09-12T12:25:52.061 INFO:teuthology.orchestra.run.smithi033.stdout:min_compat_client luminous 2024-09-12T12:25:52.062 INFO:teuthology.orchestra.run.smithi033.stdout:require_osd_release squid 2024-09-12T12:25:52.062 INFO:teuthology.orchestra.run.smithi033.stdout:stretch_mode_enabled false 2024-09-12T12:25:52.062 INFO:teuthology.orchestra.run.smithi033.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 20 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-12T12:25:52.062 INFO:teuthology.orchestra.run.smithi033.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 79 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-12T12:25:52.062 INFO:teuthology.orchestra.run.smithi033.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 79 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-09-12T12:25:52.062 INFO:teuthology.orchestra.run.smithi033.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 85 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-09-12T12:25:52.062 INFO:teuthology.orchestra.run.smithi033.stdout:max_osd 12 2024-09-12T12:25:52.062 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 up in weight 1 up_from 8 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.33:6802/963294466,v1:172.21.15.33:6803/963294466] [v2:172.21.15.33:6804/963294466,v1:172.21.15.33:6805/963294466] exists,up 74b68729-c97c-4da6-a659-75d6c147ad05 2024-09-12T12:25:52.062 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 up in weight 1 up_from 13 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.43:6800/2306025171,v1:172.21.15.43:6801/2306025171] [v2:172.21.15.43:6802/2306025171,v1:172.21.15.43:6803/2306025171] exists,up 2461a388-e110-420b-9404-eb54cd39119e 2024-09-12T12:25:52.062 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 up in weight 1 up_from 17 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.102:6800/4257223217,v1:172.21.15.102:6801/4257223217] [v2:172.21.15.102:6802/4257223217,v1:172.21.15.102:6803/4257223217] exists,up 4ba9dd02-977d-45fb-b366-ade15b52232b 2024-09-12T12:25:52.063 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 up in weight 1 up_from 23 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.33:6810/2483872739,v1:172.21.15.33:6811/2483872739] [v2:172.21.15.33:6812/2483872739,v1:172.21.15.33:6813/2483872739] exists,up 345aa854-9ea2-4103-a186-9794af34c237 2024-09-12T12:25:52.063 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 up in weight 1 up_from 30 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.43:6808/136043101,v1:172.21.15.43:6809/136043101] [v2:172.21.15.43:6810/136043101,v1:172.21.15.43:6811/136043101] exists,up 32acd6da-01d6-4a8e-9d05-3d394363d6f0 2024-09-12T12:25:52.063 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 up in weight 1 up_from 35 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.102:6808/2605625792,v1:172.21.15.102:6809/2605625792] [v2:172.21.15.102:6810/2605625792,v1:172.21.15.102:6811/2605625792] exists,up dced0037-2da2-48c2-a391-f871d6ceebb4 2024-09-12T12:25:52.063 INFO:teuthology.orchestra.run.smithi033.stdout:osd.6 up in weight 1 up_from 42 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.33:6818/805864618,v1:172.21.15.33:6819/805864618] [v2:172.21.15.33:6820/805864618,v1:172.21.15.33:6821/805864618] exists,up 46e5532e-026a-4bb2-8847-2a3216e5d7a0 2024-09-12T12:25:52.063 INFO:teuthology.orchestra.run.smithi033.stdout:osd.7 up in weight 1 up_from 47 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.43:6816/392537201,v1:172.21.15.43:6817/392537201] [v2:172.21.15.43:6818/392537201,v1:172.21.15.43:6819/392537201] exists,up c8474ab4-68cd-4475-9429-b54981247ee2 2024-09-12T12:25:52.063 INFO:teuthology.orchestra.run.smithi033.stdout:osd.8 up in weight 1 up_from 54 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.102:6816/1768219597,v1:172.21.15.102:6817/1768219597] [v2:172.21.15.102:6818/1768219597,v1:172.21.15.102:6819/1768219597] exists,up e7c2ef28-8c84-44d0-ba6d-7556ec1d02dd 2024-09-12T12:25:52.063 INFO:teuthology.orchestra.run.smithi033.stdout:osd.9 up in weight 1 up_from 61 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.33:6826/973136168,v1:172.21.15.33:6827/973136168] [v2:172.21.15.33:6828/973136168,v1:172.21.15.33:6829/973136168] exists,up f2500273-8b21-4984-bc41-cec5cc0c883b 2024-09-12T12:25:52.063 INFO:teuthology.orchestra.run.smithi033.stdout:osd.10 up in weight 1 up_from 66 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.43:6824/248515585,v1:172.21.15.43:6825/248515585] [v2:172.21.15.43:6826/248515585,v1:172.21.15.43:6827/248515585] exists,up 954343c5-5d5b-4c30-acde-82aa695f7b04 2024-09-12T12:25:52.063 INFO:teuthology.orchestra.run.smithi033.stdout:osd.11 up in weight 1 up_from 73 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.102:6824/2463068013,v1:172.21.15.102:6825/2463068013] [v2:172.21.15.102:6826/2463068013,v1:172.21.15.102:6827/2463068013] exists,up 22b4147b-02ad-4514-be17-5bb395099eef 2024-09-12T12:25:52.063 INFO:teuthology.orchestra.run.smithi033.stdout:pg_upmap_items 2.10 [2,1] 2024-09-12T12:25:52.063 INFO:teuthology.orchestra.run.smithi033.stdout:pg_upmap_items 2.1b [2,4] 2024-09-12T12:25:52.064 INFO:teuthology.orchestra.run.smithi033.stdout:pg_upmap_items 2.1c [8,11] 2024-09-12T12:25:52.064 INFO:teuthology.orchestra.run.smithi033.stdout:pg_upmap_items 2.1d [8,11] 2024-09-12T12:25:52.064 INFO:teuthology.orchestra.run.smithi033.stdout:pg_upmap_items 3.24 [4,9] 2024-09-12T12:25:52.064 INFO:teuthology.orchestra.run.smithi033.stdout:pg_upmap_items 3.27 [4,8] 2024-09-12T12:25:52.064 INFO:teuthology.orchestra.run.smithi033.stdout:pg_upmap_items 4.2 [9,1] 2024-09-12T12:25:52.064 INFO:teuthology.orchestra.run.smithi033.stdout:pg_upmap_items 4.5 [5,10] 2024-09-12T12:25:52.064 INFO:teuthology.orchestra.run.smithi033.stdout:pg_upmap_items 4.13 [9,8] 2024-09-12T12:25:52.064 INFO:teuthology.orchestra.run.smithi033.stdout:pg_upmap_items 4.19 [9,8] 2024-09-12T12:25:52.064 INFO:teuthology.orchestra.run.smithi033.stdout:blocklist 172.21.15.33:0/3187741548 expires 2024-09-13T12:16:57.792813+0000 2024-09-12T12:25:52.064 INFO:teuthology.orchestra.run.smithi033.stdout:blocklist 172.21.15.33:6800/1381479235 expires 2024-09-13T12:16:57.792813+0000 2024-09-12T12:25:52.064 INFO:teuthology.orchestra.run.smithi033.stdout:blocklist 172.21.15.33:6801/1156183797 expires 2024-09-13T12:16:33.559150+0000 2024-09-12T12:25:52.064 INFO:teuthology.orchestra.run.smithi033.stdout:blocklist 172.21.15.33:0/2222991013 expires 2024-09-13T12:16:57.792813+0000 2024-09-12T12:25:52.064 INFO:teuthology.orchestra.run.smithi033.stdout:blocklist 172.21.15.33:6801/1381479235 expires 2024-09-13T12:16:57.792813+0000 2024-09-12T12:25:52.065 INFO:teuthology.orchestra.run.smithi033.stdout:blocklist 172.21.15.33:6800/1156183797 expires 2024-09-13T12:16:33.559150+0000 2024-09-12T12:25:52.065 INFO:teuthology.orchestra.run.smithi033.stdout:blocklist 172.21.15.33:0/3450458842 expires 2024-09-13T12:16:33.559150+0000 2024-09-12T12:25:52.065 INFO:teuthology.orchestra.run.smithi033.stdout:blocklist 172.21.15.33:0/202580320 expires 2024-09-13T12:16:33.559150+0000 2024-09-12T12:25:52.065 INFO:teuthology.orchestra.run.smithi033.stdout:blocklist 172.21.15.33:0/2441151017 expires 2024-09-13T12:16:57.792813+0000 2024-09-12T12:25:52.065 INFO:teuthology.orchestra.run.smithi033.stdout:blocklist 172.21.15.33:0/1001176884 expires 2024-09-13T12:16:33.559150+0000 2024-09-12T12:25:52.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:52.062+0000 7f93b89e5640 1 -- 172.21.15.33:0/3125507781 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f93a00a2c40 msgr2=0x7f93a00a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:52.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:52.062+0000 7f93b89e5640 1 --2- 172.21.15.33:0/3125507781 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f93a00a2c40 0x7f93a00a5100 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f93b4199330 tx=0x7f939c00b390 comp rx=0 tx=0).stop 2024-09-12T12:25:52.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:52.062+0000 7f93b89e5640 1 -- 172.21.15.33:0/3125507781 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93b4100b10 msgr2=0x7f93b4197e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:52.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:52.062+0000 7f93b89e5640 1 --2- 172.21.15.33:0/3125507781 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93b4100b10 0x7f93b4197e10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f93a400d770 tx=0x7f93a400dc30 comp rx=0 tx=0).stop 2024-09-12T12:25:52.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:52.063+0000 7f93b89e5640 1 -- 172.21.15.33:0/3125507781 shutdown_connections 2024-09-12T12:25:52.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:52.063+0000 7f93b89e5640 1 --2- 172.21.15.33:0/3125507781 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f93a00a2c40 0x7f93a00a5100 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:52.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:52.063+0000 7f93b89e5640 1 --2- 172.21.15.33:0/3125507781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93b41026d0 0x7f93b419f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:52.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:52.063+0000 7f93b89e5640 1 --2- 172.21.15.33:0/3125507781 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f93b4101d10 0x7f93b4198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:52.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:52.063+0000 7f93b89e5640 1 --2- 172.21.15.33:0/3125507781 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93b4100b10 0x7f93b4197e10 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:52.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:52.063+0000 7f93b89e5640 1 -- 172.21.15.33:0/3125507781 >> 172.21.15.33:0/3125507781 conn(0x7f93b40fc2a0 msgr2=0x7f93b406a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:52.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:52.063+0000 7f93b89e5640 1 -- 172.21.15.33:0/3125507781 shutdown_connections 2024-09-12T12:25:52.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:52.063+0000 7f93b89e5640 1 -- 172.21.15.33:0/3125507781 wait complete. 2024-09-12T12:25:52.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:52 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/3125507781' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-12T12:25:52.719 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:52 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/3125507781' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-12T12:25:52.753 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-12T12:25:52.765 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:25:52.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:52 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/3125507781' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-12T12:25:53.031 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:53.439 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:53 smithi033 ceph-mon[31246]: pgmap v344: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T12:25:53.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.521+0000 7efc47d56640 1 -- 172.21.15.33:0/1576898357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc40101420 msgr2=0x7efc4010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:53.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.521+0000 7efc47d56640 1 --2- 172.21.15.33:0/1576898357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc40101420 0x7efc4010d950 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7efc38009cd0 tx=0x7efc3802a8e0 comp rx=0 tx=0).stop 2024-09-12T12:25:53.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.521+0000 7efc47d56640 1 -- 172.21.15.33:0/1576898357 shutdown_connections 2024-09-12T12:25:53.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.521+0000 7efc47d56640 1 --2- 172.21.15.33:0/1576898357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc40101420 0x7efc4010d950 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:53.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.521+0000 7efc47d56640 1 --2- 172.21.15.33:0/1576898357 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc40100a80 0x7efc40100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:53.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.521+0000 7efc47d56640 1 --2- 172.21.15.33:0/1576898357 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc40106a80 0x7efc40106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:53.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.521+0000 7efc47d56640 1 -- 172.21.15.33:0/1576898357 >> 172.21.15.33:0/1576898357 conn(0x7efc400fc7a0 msgr2=0x7efc400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:53.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.521+0000 7efc47d56640 1 -- 172.21.15.33:0/1576898357 shutdown_connections 2024-09-12T12:25:53.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.521+0000 7efc47d56640 1 -- 172.21.15.33:0/1576898357 wait complete. 2024-09-12T12:25:53.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.522+0000 7efc47d56640 1 Processor -- start 2024-09-12T12:25:53.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.522+0000 7efc47d56640 1 -- start start 2024-09-12T12:25:53.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.522+0000 7efc47d56640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc40100a80 0x7efc40198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:53.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.522+0000 7efc47d56640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc40101420 0x7efc40198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:53.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.522+0000 7efc47d56640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc40106a80 0x7efc4019cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:53.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.522+0000 7efc47d56640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7efc40110d30 con 0x7efc40101420 2024-09-12T12:25:53.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.522+0000 7efc47d56640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7efc40110bb0 con 0x7efc40100a80 2024-09-12T12:25:53.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.522+0000 7efc47d56640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7efc40110eb0 con 0x7efc40106a80 2024-09-12T12:25:53.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.522+0000 7efc452f1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc40101420 0x7efc40198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:53.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.522+0000 7efc452f1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc40101420 0x7efc40198860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56608/0 (socket says 172.21.15.33:56608) 2024-09-12T12:25:53.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.522+0000 7efc452f1640 1 -- 172.21.15.33:0/1189169743 learned_addr learned my addr 172.21.15.33:0/1189169743 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:53.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.522+0000 7efc45af2640 1 --2- 172.21.15.33:0/1189169743 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc40100a80 0x7efc40198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:53.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.522+0000 7efc462f3640 1 --2- 172.21.15.33:0/1189169743 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc40106a80 0x7efc4019cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:53.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.523+0000 7efc452f1640 1 -- 172.21.15.33:0/1189169743 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc40106a80 msgr2=0x7efc4019cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:53.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.523+0000 7efc452f1640 1 --2- 172.21.15.33:0/1189169743 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc40106a80 0x7efc4019cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:53.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.523+0000 7efc452f1640 1 -- 172.21.15.33:0/1189169743 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc40100a80 msgr2=0x7efc40198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:53.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.523+0000 7efc452f1640 1 --2- 172.21.15.33:0/1189169743 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc40100a80 0x7efc40198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:53.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.523+0000 7efc452f1640 1 -- 172.21.15.33:0/1189169743 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc4019d2d0 con 0x7efc40101420 2024-09-12T12:25:53.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.523+0000 7efc462f3640 1 --2- 172.21.15.33:0/1189169743 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc40106a80 0x7efc4019cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:53.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.523+0000 7efc452f1640 1 --2- 172.21.15.33:0/1189169743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc40101420 0x7efc40198860 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7efc3000c890 tx=0x7efc3000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:53.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.523+0000 7efc36ffd640 1 -- 172.21.15.33:0/1189169743 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc30004220 con 0x7efc40101420 2024-09-12T12:25:53.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.523+0000 7efc36ffd640 1 -- 172.21.15.33:0/1189169743 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efc300043c0 con 0x7efc40101420 2024-09-12T12:25:53.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.523+0000 7efc47d56640 1 -- 172.21.15.33:0/1189169743 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc4019d5c0 con 0x7efc40101420 2024-09-12T12:25:53.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.523+0000 7efc36ffd640 1 -- 172.21.15.33:0/1189169743 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc30004a00 con 0x7efc40101420 2024-09-12T12:25:53.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.523+0000 7efc47d56640 1 -- 172.21.15.33:0/1189169743 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc401a4ea0 con 0x7efc40101420 2024-09-12T12:25:53.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.524+0000 7efc47d56640 1 -- 172.21.15.33:0/1189169743 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc40100ee0 con 0x7efc40101420 2024-09-12T12:25:53.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.525+0000 7efc36ffd640 1 -- 172.21.15.33:0/1189169743 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7efc300079b0 con 0x7efc40101420 2024-09-12T12:25:53.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.526+0000 7efc36ffd640 1 --2- 172.21.15.33:0/1189169743 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7efc2c0a2c90 0x7efc2c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:53.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.526+0000 7efc36ffd640 1 -- 172.21.15.33:0/1189169743 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7efc300cf180 con 0x7efc40101420 2024-09-12T12:25:53.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.526+0000 7efc45af2640 1 --2- 172.21.15.33:0/1189169743 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7efc2c0a2c90 0x7efc2c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:53.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.526+0000 7efc45af2640 1 --2- 172.21.15.33:0/1189169743 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7efc2c0a2c90 0x7efc2c0a5150 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7efc3c00ab60 tx=0x7efc3c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:53.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.530+0000 7efc36ffd640 1 -- 172.21.15.33:0/1189169743 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efc30014030 con 0x7efc40101420 2024-09-12T12:25:53.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:53 smithi102 ceph-mon[34799]: pgmap v344: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T12:25:53.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.740+0000 7efc47d56640 1 -- 172.21.15.33:0/1189169743 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efc401a5160 con 0x7efc40101420 2024-09-12T12:25:53.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.740+0000 7efc36ffd640 1 -- 172.21.15.33:0/1189169743 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11912 (secure 0 0 0) 0x7efc3009bc20 con 0x7efc40101420 2024-09-12T12:25:53.741 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:25:53.741 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":24,"btime":"2024-09-12T12:24:30:808296+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3327066342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3327066342},{"type":"v1","addr":"172.21.15.33:6835","nonce":3327066342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/19516401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":19516401},{"type":"v1","addr":"172.21.15.33:6837","nonce":19516401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1260196118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1260196118},{"type":"v1","addr":"172.21.15.33:6839","nonce":1260196118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/4288248356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4288248356},{"type":"v1","addr":"172.21.15.33:6841","nonce":4288248356}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/3051073141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3051073141},{"type":"v1","addr":"172.21.15.43:6833","nonce":3051073141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3282762800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3282762800},{"type":"v1","addr":"172.21.15.43:6835","nonce":3282762800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:23:46.400609+0000","modified":"2024-09-12T12:24:30.590211+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24490,"mds_2":24478},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3051713000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3051713000},{"type":"v1","addr":"172.21.15.102:6833","nonce":3051713000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6837/2472064883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2472064883},{"type":"v1","addr":"172.21.15.43:6837","nonce":2472064883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/1987408860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":1987408860},{"type":"v1","addr":"172.21.15.43:6839","nonce":1987408860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/4179527539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":4179527539},{"type":"v1","addr":"172.21.15.102:6835","nonce":4179527539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/2409953270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2409953270},{"type":"v1","addr":"172.21.15.102:6837","nonce":2409953270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.102:6839/1553271340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":1553271340},{"type":"v1","addr":"172.21.15.102:6839","nonce":1553271340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24499,"qdb_cluster":[24478,24490,24499]},"id":1}]} 2024-09-12T12:25:53.742 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 24 2024-09-12T12:25:53.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.742+0000 7efc47d56640 1 -- 172.21.15.33:0/1189169743 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7efc2c0a2c90 msgr2=0x7efc2c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:53.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.742+0000 7efc47d56640 1 --2- 172.21.15.33:0/1189169743 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7efc2c0a2c90 0x7efc2c0a5150 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7efc3c00ab60 tx=0x7efc3c00a2d0 comp rx=0 tx=0).stop 2024-09-12T12:25:53.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.742+0000 7efc47d56640 1 -- 172.21.15.33:0/1189169743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc40101420 msgr2=0x7efc40198860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:53.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.742+0000 7efc47d56640 1 --2- 172.21.15.33:0/1189169743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc40101420 0x7efc40198860 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7efc3000c890 tx=0x7efc3000cc90 comp rx=0 tx=0).stop 2024-09-12T12:25:53.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.742+0000 7efc47d56640 1 -- 172.21.15.33:0/1189169743 shutdown_connections 2024-09-12T12:25:53.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.742+0000 7efc47d56640 1 --2- 172.21.15.33:0/1189169743 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7efc2c0a2c90 0x7efc2c0a5150 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:53.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.742+0000 7efc47d56640 1 --2- 172.21.15.33:0/1189169743 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc40106a80 0x7efc4019cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:53.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.742+0000 7efc47d56640 1 --2- 172.21.15.33:0/1189169743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc40101420 0x7efc40198860 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:53.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.742+0000 7efc47d56640 1 --2- 172.21.15.33:0/1189169743 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc40100a80 0x7efc40198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:53.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.743+0000 7efc47d56640 1 -- 172.21.15.33:0/1189169743 >> 172.21.15.33:0/1189169743 conn(0x7efc400fc7a0 msgr2=0x7efc4006a870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:53.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.743+0000 7efc47d56640 1 -- 172.21.15.33:0/1189169743 shutdown_connections 2024-09-12T12:25:53.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:53.743+0000 7efc47d56640 1 -- 172.21.15.33:0/1189169743 wait complete. 2024-09-12T12:25:53.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:53 smithi043 ceph-mon[34144]: pgmap v344: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T12:25:54.366 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:25:54.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:54 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/1189169743' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:25:54.625 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:54.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:54 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/1189169743' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:25:54.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:54 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/1189169743' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:25:55.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.082+0000 7f35cb0bc640 1 -- 172.21.15.33:0/601915265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35c410c170 msgr2=0x7f35c410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:55.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.082+0000 7f35cb0bc640 1 --2- 172.21.15.33:0/601915265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35c410c170 0x7f35c410e610 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f35bc009ca0 tx=0x7f35bc02a950 comp rx=0 tx=0).stop 2024-09-12T12:25:55.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.082+0000 7f35cb0bc640 1 -- 172.21.15.33:0/601915265 shutdown_connections 2024-09-12T12:25:55.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.082+0000 7f35cb0bc640 1 --2- 172.21.15.33:0/601915265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35c410c170 0x7f35c410e610 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:55.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.082+0000 7f35cb0bc640 1 --2- 172.21.15.33:0/601915265 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35c4103660 0x7f35c410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:55.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.082+0000 7f35cb0bc640 1 --2- 172.21.15.33:0/601915265 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f35c4102d40 0x7f35c4103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:55.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.082+0000 7f35cb0bc640 1 -- 172.21.15.33:0/601915265 >> 172.21.15.33:0/601915265 conn(0x7f35c40fc7a0 msgr2=0x7f35c40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:55.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.082+0000 7f35cb0bc640 1 -- 172.21.15.33:0/601915265 shutdown_connections 2024-09-12T12:25:55.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.082+0000 7f35cb0bc640 1 -- 172.21.15.33:0/601915265 wait complete. 2024-09-12T12:25:55.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.083+0000 7f35cb0bc640 1 Processor -- start 2024-09-12T12:25:55.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.083+0000 7f35cb0bc640 1 -- start start 2024-09-12T12:25:55.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.083+0000 7f35cb0bc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35c4102d40 0x7f35c4198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:55.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.083+0000 7f35cb0bc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35c4103660 0x7f35c4198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:55.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.083+0000 7f35cb0bc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f35c410c170 0x7f35c419cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:55.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.083+0000 7f35cb0bc640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f35c4111e00 con 0x7f35c4103660 2024-09-12T12:25:55.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.083+0000 7f35cb0bc640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f35c4111c80 con 0x7f35c410c170 2024-09-12T12:25:55.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.083+0000 7f35cb0bc640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f35c4111f80 con 0x7f35c4102d40 2024-09-12T12:25:55.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.083+0000 7f35c3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35c4103660 0x7f35c4198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:55.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.083+0000 7f35c3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35c4103660 0x7f35c4198880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56628/0 (socket says 172.21.15.33:56628) 2024-09-12T12:25:55.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.083+0000 7f35c3fff640 1 -- 172.21.15.33:0/2075343651 learned_addr learned my addr 172.21.15.33:0/2075343651 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:55.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.083+0000 7f35c9659640 1 --2- 172.21.15.33:0/2075343651 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f35c410c170 0x7f35c419cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:55.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.084+0000 7f35c8e58640 1 --2- 172.21.15.33:0/2075343651 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35c4102d40 0x7f35c4198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:55.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.084+0000 7f35c3fff640 1 -- 172.21.15.33:0/2075343651 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35c4102d40 msgr2=0x7f35c4198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:55.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.084+0000 7f35c3fff640 1 --2- 172.21.15.33:0/2075343651 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35c4102d40 0x7f35c4198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:55.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.084+0000 7f35c3fff640 1 -- 172.21.15.33:0/2075343651 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f35c410c170 msgr2=0x7f35c419cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:55.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.084+0000 7f35c3fff640 1 --2- 172.21.15.33:0/2075343651 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f35c410c170 0x7f35c419cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:55.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.084+0000 7f35c3fff640 1 -- 172.21.15.33:0/2075343651 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35c419d2f0 con 0x7f35c4103660 2024-09-12T12:25:55.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.084+0000 7f35c9659640 1 --2- 172.21.15.33:0/2075343651 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f35c410c170 0x7f35c419cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:55.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.084+0000 7f35c3fff640 1 --2- 172.21.15.33:0/2075343651 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35c4103660 0x7f35c4198880 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f35b000e9f0 tx=0x7f35b000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:55.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.084+0000 7f35c1ffb640 1 -- 172.21.15.33:0/2075343651 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b000ccc0 con 0x7f35c4103660 2024-09-12T12:25:55.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.084+0000 7f35cb0bc640 1 -- 172.21.15.33:0/2075343651 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35c419d5e0 con 0x7f35c4103660 2024-09-12T12:25:55.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.084+0000 7f35c1ffb640 1 -- 172.21.15.33:0/2075343651 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f35b000ce60 con 0x7f35c4103660 2024-09-12T12:25:55.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.084+0000 7f35c1ffb640 1 -- 172.21.15.33:0/2075343651 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b0010430 con 0x7f35c4103660 2024-09-12T12:25:55.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.084+0000 7f35cb0bc640 1 -- 172.21.15.33:0/2075343651 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35c41a4ec0 con 0x7f35c4103660 2024-09-12T12:25:55.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.085+0000 7f35cb0bc640 1 -- 172.21.15.33:0/2075343651 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35c4103120 con 0x7f35c4103660 2024-09-12T12:25:55.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.086+0000 7f35c1ffb640 1 -- 172.21.15.33:0/2075343651 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f35b0005020 con 0x7f35c4103660 2024-09-12T12:25:55.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.087+0000 7f35c1ffb640 1 --2- 172.21.15.33:0/2075343651 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f35b40a2c10 0x7f35b40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:55.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.087+0000 7f35c8e58640 1 --2- 172.21.15.33:0/2075343651 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f35b40a2c10 0x7f35b40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:55.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.087+0000 7f35c1ffb640 1 -- 172.21.15.33:0/2075343651 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7f35b00cfaf0 con 0x7f35c4103660 2024-09-12T12:25:55.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.088+0000 7f35c8e58640 1 --2- 172.21.15.33:0/2075343651 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f35b40a2c10 0x7f35b40a50d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f35b80058c0 tx=0x7f35b800a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:55.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.091+0000 7f35c1ffb640 1 -- 172.21.15.33:0/2075343651 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f35b009c590 con 0x7f35c4103660 2024-09-12T12:25:55.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.302+0000 7f35cb0bc640 1 -- 172.21.15.33:0/2075343651 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f35c4107240 con 0x7f35c4103660 2024-09-12T12:25:55.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.303+0000 7f35c1ffb640 1 -- 172.21.15.33:0/2075343651 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11912 (secure 0 0 0) 0x7f35b009be90 con 0x7f35c4103660 2024-09-12T12:25:55.303 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:25:55.303 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":24,"btime":"2024-09-12T12:24:30:808296+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3327066342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3327066342},{"type":"v1","addr":"172.21.15.33:6835","nonce":3327066342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/19516401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":19516401},{"type":"v1","addr":"172.21.15.33:6837","nonce":19516401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1260196118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1260196118},{"type":"v1","addr":"172.21.15.33:6839","nonce":1260196118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/4288248356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4288248356},{"type":"v1","addr":"172.21.15.33:6841","nonce":4288248356}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/3051073141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3051073141},{"type":"v1","addr":"172.21.15.43:6833","nonce":3051073141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3282762800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3282762800},{"type":"v1","addr":"172.21.15.43:6835","nonce":3282762800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:23:46.400609+0000","modified":"2024-09-12T12:24:30.590211+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24490,"mds_2":24478},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3051713000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3051713000},{"type":"v1","addr":"172.21.15.102:6833","nonce":3051713000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6837/2472064883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2472064883},{"type":"v1","addr":"172.21.15.43:6837","nonce":2472064883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/1987408860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":1987408860},{"type":"v1","addr":"172.21.15.43:6839","nonce":1987408860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/4179527539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":4179527539},{"type":"v1","addr":"172.21.15.102:6835","nonce":4179527539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/2409953270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2409953270},{"type":"v1","addr":"172.21.15.102:6837","nonce":2409953270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.102:6839/1553271340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":1553271340},{"type":"v1","addr":"172.21.15.102:6839","nonce":1553271340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24499,"qdb_cluster":[24478,24490,24499]},"id":1}]} 2024-09-12T12:25:55.304 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 24 2024-09-12T12:25:55.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.305+0000 7f35cb0bc640 1 -- 172.21.15.33:0/2075343651 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f35b40a2c10 msgr2=0x7f35b40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:55.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.305+0000 7f35cb0bc640 1 --2- 172.21.15.33:0/2075343651 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f35b40a2c10 0x7f35b40a50d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f35b80058c0 tx=0x7f35b800a4c0 comp rx=0 tx=0).stop 2024-09-12T12:25:55.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.305+0000 7f35cb0bc640 1 -- 172.21.15.33:0/2075343651 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35c4103660 msgr2=0x7f35c4198880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:55.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.305+0000 7f35cb0bc640 1 --2- 172.21.15.33:0/2075343651 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35c4103660 0x7f35c4198880 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f35b000e9f0 tx=0x7f35b000eeb0 comp rx=0 tx=0).stop 2024-09-12T12:25:55.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.306+0000 7f35cb0bc640 1 -- 172.21.15.33:0/2075343651 shutdown_connections 2024-09-12T12:25:55.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.306+0000 7f35cb0bc640 1 --2- 172.21.15.33:0/2075343651 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f35b40a2c10 0x7f35b40a50d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:55.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.306+0000 7f35cb0bc640 1 --2- 172.21.15.33:0/2075343651 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f35c410c170 0x7f35c419cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:55.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.306+0000 7f35cb0bc640 1 --2- 172.21.15.33:0/2075343651 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35c4103660 0x7f35c4198880 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:55.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.306+0000 7f35cb0bc640 1 --2- 172.21.15.33:0/2075343651 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35c4102d40 0x7f35c4198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:55.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.306+0000 7f35cb0bc640 1 -- 172.21.15.33:0/2075343651 >> 172.21.15.33:0/2075343651 conn(0x7f35c40fc7a0 msgr2=0x7f35c40fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:55.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.306+0000 7f35cb0bc640 1 -- 172.21.15.33:0/2075343651 shutdown_connections 2024-09-12T12:25:55.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:55.306+0000 7f35cb0bc640 1 -- 172.21.15.33:0/2075343651 wait complete. 2024-09-12T12:25:55.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:55 smithi102 ceph-mon[34799]: pgmap v345: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-12T12:25:55.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:55 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/2075343651' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:25:55.677 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:55 smithi033 ceph-mon[31246]: pgmap v345: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-12T12:25:55.677 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:55 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/2075343651' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:25:55.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:55 smithi043 ceph-mon[34144]: pgmap v345: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-12T12:25:55.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:55 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/2075343651' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:25:56.000 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T12:25:56.258 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:56.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.757+0000 7f83cb376640 1 -- 172.21.15.33:0/4066848401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83c4103780 msgr2=0x7f83c4107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:56.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.757+0000 7f83cb376640 1 --2- 172.21.15.33:0/4066848401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83c4103780 0x7f83c4107bc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f83c0009930 tx=0x7f83c002a420 comp rx=0 tx=0).stop 2024-09-12T12:25:56.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.757+0000 7f83cb376640 1 -- 172.21.15.33:0/4066848401 shutdown_connections 2024-09-12T12:25:56.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.757+0000 7f83cb376640 1 --2- 172.21.15.33:0/4066848401 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83c4108300 0x7f83c410ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:56.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.757+0000 7f83cb376640 1 --2- 172.21.15.33:0/4066848401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83c4103780 0x7f83c4107bc0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:56.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.757+0000 7f83cb376640 1 --2- 172.21.15.33:0/4066848401 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83c4102dd0 0x7f83c41031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:56.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.757+0000 7f83cb376640 1 -- 172.21.15.33:0/4066848401 >> 172.21.15.33:0/4066848401 conn(0x7f83c40fc7d0 msgr2=0x7f83c40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:56.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.757+0000 7f83cb376640 1 -- 172.21.15.33:0/4066848401 shutdown_connections 2024-09-12T12:25:56.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.757+0000 7f83cb376640 1 -- 172.21.15.33:0/4066848401 wait complete. 2024-09-12T12:25:56.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.757+0000 7f83cb376640 1 Processor -- start 2024-09-12T12:25:56.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.758+0000 7f83cb376640 1 -- start start 2024-09-12T12:25:56.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.758+0000 7f83cb376640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83c4102dd0 0x7f83c4100a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:56.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.758+0000 7f83cb376640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83c4103780 0x7f83c4100f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:56.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.758+0000 7f83cb376640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83c4108300 0x7f83c41014b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:56.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.758+0000 7f83cb376640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f83c4111f20 con 0x7f83c4103780 2024-09-12T12:25:56.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.758+0000 7f83cb376640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f83c4111da0 con 0x7f83c4108300 2024-09-12T12:25:56.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.758+0000 7f83cb376640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f83c41120a0 con 0x7f83c4102dd0 2024-09-12T12:25:56.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.758+0000 7f83c8911640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83c4103780 0x7f83c4100f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:56.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.758+0000 7f83c8911640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83c4103780 0x7f83c4100f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56642/0 (socket says 172.21.15.33:56642) 2024-09-12T12:25:56.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.758+0000 7f83c8911640 1 -- 172.21.15.33:0/2194472433 learned_addr learned my addr 172.21.15.33:0/2194472433 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:56.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.758+0000 7f83c9913640 1 --2- 172.21.15.33:0/2194472433 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83c4108300 0x7f83c41014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:56.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.758+0000 7f83c9112640 1 --2- 172.21.15.33:0/2194472433 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83c4102dd0 0x7f83c4100a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:56.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.758+0000 7f83c8911640 1 -- 172.21.15.33:0/2194472433 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83c4102dd0 msgr2=0x7f83c4100a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:56.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.758+0000 7f83c8911640 1 --2- 172.21.15.33:0/2194472433 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83c4102dd0 0x7f83c4100a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:56.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.758+0000 7f83c8911640 1 -- 172.21.15.33:0/2194472433 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83c4108300 msgr2=0x7f83c41014b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:56.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.758+0000 7f83c8911640 1 --2- 172.21.15.33:0/2194472433 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83c4108300 0x7f83c41014b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:56.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.758+0000 7f83c8911640 1 -- 172.21.15.33:0/2194472433 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83c41a69e0 con 0x7f83c4103780 2024-09-12T12:25:56.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.758+0000 7f83c8911640 1 --2- 172.21.15.33:0/2194472433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83c4103780 0x7f83c4100f70 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f83c0009230 tx=0x7f83c0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:56.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.759+0000 7f83b67fc640 1 -- 172.21.15.33:0/2194472433 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c003f030 con 0x7f83c4103780 2024-09-12T12:25:56.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.759+0000 7f83b67fc640 1 -- 172.21.15.33:0/2194472433 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f83c00035f0 con 0x7f83c4103780 2024-09-12T12:25:56.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.759+0000 7f83b67fc640 1 -- 172.21.15.33:0/2194472433 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c0035070 con 0x7f83c4103780 2024-09-12T12:25:56.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.759+0000 7f83cb376640 1 -- 172.21.15.33:0/2194472433 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83c41a6c70 con 0x7f83c4103780 2024-09-12T12:25:56.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.759+0000 7f83cb376640 1 -- 172.21.15.33:0/2194472433 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83c41a7150 con 0x7f83c4103780 2024-09-12T12:25:56.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.760+0000 7f83cb376640 1 -- 172.21.15.33:0/2194472433 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83c41031b0 con 0x7f83c4103780 2024-09-12T12:25:56.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.761+0000 7f83b67fc640 1 -- 172.21.15.33:0/2194472433 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f83c0003aa0 con 0x7f83c4103780 2024-09-12T12:25:56.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.762+0000 7f83b67fc640 1 --2- 172.21.15.33:0/2194472433 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f83b00a2c10 0x7f83b00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:56.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.762+0000 7f83c9112640 1 --2- 172.21.15.33:0/2194472433 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f83b00a2c10 0x7f83b00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:56.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.762+0000 7f83b67fc640 1 -- 172.21.15.33:0/2194472433 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7f83c00f0570 con 0x7f83c4103780 2024-09-12T12:25:56.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.762+0000 7f83c9112640 1 --2- 172.21.15.33:0/2194472433 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f83b00a2c10 0x7f83b00a50d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f83b80058c0 tx=0x7f83b8005c60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:56.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.765+0000 7f83b67fc640 1 -- 172.21.15.33:0/2194472433 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f83c00bd010 con 0x7f83c4103780 2024-09-12T12:25:56.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.942+0000 7f83cb376640 1 -- 172.21.15.33:0/2194472433 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f83c410a290 con 0x7f83c4103780 2024-09-12T12:25:56.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.943+0000 7f83b67fc640 1 -- 172.21.15.33:0/2194472433 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24670 (secure 0 0 0) 0x7f83c00bc910 con 0x7f83c4103780 2024-09-12T12:25:56.944 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:25:56.944 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":87,"fsid":"a66dfafc-7100-11ef-bcea-c7b262605968","created":"2024-09-12T12:16:11.904815+0000","modified":"2024-09-12T12:24:59.115664+0000","last_up_change":"2024-09-12T12:22:57.476185+0000","last_in_change":"2024-09-12T12:22:35.192556+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:19:12.296305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:23:42.509774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:23:44.842852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T12:23:51.308720+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"74b68729-c97c-4da6-a659-75d6c147ad05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6803","nonce":963294466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6805","nonce":963294466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6809","nonce":963294466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6807","nonce":963294466}]},"public_addr":"172.21.15.33:6803/963294466","cluster_addr":"172.21.15.33:6805/963294466","heartbeat_back_addr":"172.21.15.33:6809/963294466","heartbeat_front_addr":"172.21.15.33:6807/963294466","state":["exists","up"]},{"osd":1,"uuid":"2461a388-e110-420b-9404-eb54cd39119e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6801","nonce":2306025171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6803","nonce":2306025171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6807","nonce":2306025171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6805","nonce":2306025171}]},"public_addr":"172.21.15.43:6801/2306025171","cluster_addr":"172.21.15.43:6803/2306025171","heartbeat_back_addr":"172.21.15.43:6807/2306025171","heartbeat_front_addr":"172.21.15.43:6805/2306025171","state":["exists","up"]},{"osd":2,"uuid":"4ba9dd02-977d-45fb-b366-ade15b52232b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6801","nonce":4257223217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6803","nonce":4257223217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6807","nonce":4257223217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6805","nonce":4257223217}]},"public_addr":"172.21.15.102:6801/4257223217","cluster_addr":"172.21.15.102:6803/4257223217","heartbeat_back_addr":"172.21.15.102:6807/4257223217","heartbeat_front_addr":"172.21.15.102:6805/4257223217","state":["exists","up"]},{"osd":3,"uuid":"345aa854-9ea2-4103-a186-9794af34c237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6811","nonce":2483872739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6813","nonce":2483872739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6817","nonce":2483872739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6815","nonce":2483872739}]},"public_addr":"172.21.15.33:6811/2483872739","cluster_addr":"172.21.15.33:6813/2483872739","heartbeat_back_addr":"172.21.15.33:6817/2483872739","heartbeat_front_addr":"172.21.15.33:6815/2483872739","state":["exists","up"]},{"osd":4,"uuid":"32acd6da-01d6-4a8e-9d05-3d394363d6f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6809","nonce":136043101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6811","nonce":136043101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6815","nonce":136043101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6813","nonce":136043101}]},"public_addr":"172.21.15.43:6809/136043101","cluster_addr":"172.21.15.43:6811/136043101","heartbeat_back_addr":"172.21.15.43:6815/136043101","heartbeat_front_addr":"172.21.15.43:6813/136043101","state":["exists","up"]},{"osd":5,"uuid":"dced0037-2da2-48c2-a391-f871d6ceebb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6809","nonce":2605625792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6811","nonce":2605625792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6815","nonce":2605625792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6813","nonce":2605625792}]},"public_addr":"172.21.15.102:6809/2605625792","cluster_addr":"172.21.15.102:6811/2605625792","heartbeat_back_addr":"172.21.15.102:6815/2605625792","heartbeat_front_addr":"172.21.15.102:6813/2605625792","state":["exists","up"]},{"osd":6,"uuid":"46e5532e-026a-4bb2-8847-2a3216e5d7a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6819","nonce":805864618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6821","nonce":805864618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6825","nonce":805864618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6823","nonce":805864618}]},"public_addr":"172.21.15.33:6819/805864618","cluster_addr":"172.21.15.33:6821/805864618","heartbeat_back_addr":"172.21.15.33:6825/805864618","heartbeat_front_addr":"172.21.15.33:6823/805864618","state":["exists","up"]},{"osd":7,"uuid":"c8474ab4-68cd-4475-9429-b54981247ee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6817","nonce":392537201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6819","nonce":392537201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6823","nonce":392537201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6821","nonce":392537201}]},"public_addr":"172.21.15.43:6817/392537201","cluster_addr":"172.21.15.43:6819/392537201","heartbeat_back_addr":"172.21.15.43:6823/392537201","heartbeat_front_addr":"172.21.15.43:6821/392537201","state":["exists","up"]},{"osd":8,"uuid":"e7c2ef28-8c84-44d0-ba6d-7556ec1d02dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6817","nonce":1768219597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6819","nonce":1768219597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6823","nonce":1768219597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6821","nonce":1768219597}]},"public_addr":"172.21.15.102:6817/1768219597","cluster_addr":"172.21.15.102:6819/1768219597","heartbeat_back_addr":"172.21.15.102:6823/1768219597","heartbeat_front_addr":"172.21.15.102:6821/1768219597","state":["exists","up"]},{"osd":9,"uuid":"f2500273-8b21-4984-bc41-cec5cc0c883b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6827","nonce":973136168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6829","nonce":973136168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6833","nonce":973136168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6831","nonce":973136168}]},"public_addr":"172.21.15.33:6827/973136168","cluster_addr":"172.21.15.33:6829/973136168","heartbeat_back_addr":"172.21.15.33:6833/973136168","heartbeat_front_addr":"172.21.15.33:6831/973136168","state":["exists","up"]},{"osd":10,"uuid":"954343c5-5d5b-4c30-acde-82aa695f7b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6825","nonce":248515585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6827","nonce":248515585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6831","nonce":248515585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6829","nonce":248515585}]},"public_addr":"172.21.15.43:6825/248515585","cluster_addr":"172.21.15.43:6827/248515585","heartbeat_back_addr":"172.21.15.43:6831/248515585","heartbeat_front_addr":"172.21.15.43:6829/248515585","state":["exists","up"]},{"osd":11,"uuid":"22b4147b-02ad-4514-be17-5bb395099eef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6825","nonce":2463068013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6827","nonce":2463068013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6831","nonce":2463068013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6829","nonce":2463068013}]},"public_addr":"172.21.15.102:6825/2463068013","cluster_addr":"172.21.15.102:6827/2463068013","heartbeat_back_addr":"172.21.15.102:6831/2463068013","heartbeat_front_addr":"172.21.15.102:6829/2463068013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:19.274804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:44.900294+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:08.885404+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:34.382089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:59.978538+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:25.275179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:49.429847+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:14.974792+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:40.268629+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:22:06.458679+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:22:31.813019+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:22:56.264078+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/3187741548":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6800/1381479235":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6801/1156183797":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/2222991013":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6801/1381479235":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6800/1156183797":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/3450458842":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/202580320":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/2441151017":"2024-09-13T12:16:57.792813+0000","172.21.15.33:0/1001176884":"2024-09-13T12:16:33.559150+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:25:56.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.946+0000 7f83cb376640 1 -- 172.21.15.33:0/2194472433 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f83b00a2c10 msgr2=0x7f83b00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:56.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.946+0000 7f83cb376640 1 --2- 172.21.15.33:0/2194472433 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f83b00a2c10 0x7f83b00a50d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f83b80058c0 tx=0x7f83b8005c60 comp rx=0 tx=0).stop 2024-09-12T12:25:56.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.946+0000 7f83cb376640 1 -- 172.21.15.33:0/2194472433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83c4103780 msgr2=0x7f83c4100f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:56.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.946+0000 7f83cb376640 1 --2- 172.21.15.33:0/2194472433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83c4103780 0x7f83c4100f70 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f83c0009230 tx=0x7f83c0004270 comp rx=0 tx=0).stop 2024-09-12T12:25:56.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.946+0000 7f83cb376640 1 -- 172.21.15.33:0/2194472433 shutdown_connections 2024-09-12T12:25:56.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.946+0000 7f83cb376640 1 --2- 172.21.15.33:0/2194472433 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f83b00a2c10 0x7f83b00a50d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:56.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.946+0000 7f83cb376640 1 --2- 172.21.15.33:0/2194472433 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83c4108300 0x7f83c41014b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:56.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.946+0000 7f83cb376640 1 --2- 172.21.15.33:0/2194472433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83c4103780 0x7f83c4100f70 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:56.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.946+0000 7f83cb376640 1 --2- 172.21.15.33:0/2194472433 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83c4102dd0 0x7f83c4100a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:56.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.946+0000 7f83cb376640 1 -- 172.21.15.33:0/2194472433 >> 172.21.15.33:0/2194472433 conn(0x7f83c40fc7d0 msgr2=0x7f83c4105ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:56.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.946+0000 7f83cb376640 1 -- 172.21.15.33:0/2194472433 shutdown_connections 2024-09-12T12:25:56.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:56.946+0000 7f83cb376640 1 -- 172.21.15.33:0/2194472433 wait complete. 2024-09-12T12:25:57.640 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-12T12:23:46.400609+0000', 'modified': '2024-09-12T12:24:30.590211+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24499, 'mds_1': 24490, 'mds_2': 24478}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24442': {'gid': 24442, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.102:6833/3051713000', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6832', 'nonce': 3051713000}, {'type': 'v1', 'addr': '172.21.15.102:6833', 'nonce': 3051713000}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24443': {'gid': 24443, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.43:6837/2472064883', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6836', 'nonce': 2472064883}, {'type': 'v1', 'addr': '172.21.15.43:6837', 'nonce': 2472064883}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24473': {'gid': 24473, 'name': 'b', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.43:6839/1987408860', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6838', 'nonce': 1987408860}, {'type': 'v1', 'addr': '172.21.15.43:6839', 'nonce': 1987408860}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24478': {'gid': 24478, 'name': 'f', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 19, 'addr': '172.21.15.102:6835/4179527539', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6834', 'nonce': 4179527539}, {'type': 'v1', 'addr': '172.21.15.102:6835', 'nonce': 4179527539}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24490': {'gid': 24490, 'name': 'c', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.102:6837/2409953270', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6836', 'nonce': 2409953270}, {'type': 'v1', 'addr': '172.21.15.102:6837', 'nonce': 2409953270}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24499': {'gid': 24499, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.102:6839/1553271340', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6838', 'nonce': 1553271340}, {'type': 'v1', 'addr': '172.21.15.102:6839', 'nonce': 1553271340}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24499, 'qdb_cluster': [24478, 24490, 24499]} 2024-09-12T12:25:57.640 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-12T12:25:57.640 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.f status 2024-09-12T12:25:57.935 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:57.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:57 smithi033 ceph-mon[31246]: pgmap v346: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T12:25:57.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:57 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/2194472433' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:25:58.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:57 smithi043 ceph-mon[34144]: pgmap v346: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T12:25:58.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:57 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/2194472433' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:25:58.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:57 smithi102 ceph-mon[34799]: pgmap v346: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T12:25:58.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:57 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/2194472433' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:25:58.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.416+0000 7f606935c640 1 -- 172.21.15.33:0/2044234861 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6064103670 msgr2=0x7f606410bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:58.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.416+0000 7f606935c640 1 --2- 172.21.15.33:0/2044234861 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6064103670 0x7f606410bb60 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f604c009900 tx=0x7f604c02a480 comp rx=0 tx=0).stop 2024-09-12T12:25:58.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.416+0000 7f606935c640 1 -- 172.21.15.33:0/2044234861 shutdown_connections 2024-09-12T12:25:58.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.416+0000 7f606935c640 1 --2- 172.21.15.33:0/2044234861 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f606410c180 0x7f606410e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.416+0000 7f606935c640 1 --2- 172.21.15.33:0/2044234861 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6064103670 0x7f606410bb60 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.416+0000 7f606935c640 1 --2- 172.21.15.33:0/2044234861 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6064102d50 0x7f6064103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.416+0000 7f606935c640 1 -- 172.21.15.33:0/2044234861 >> 172.21.15.33:0/2044234861 conn(0x7f60640fc7d0 msgr2=0x7f60640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:58.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.416+0000 7f606935c640 1 -- 172.21.15.33:0/2044234861 shutdown_connections 2024-09-12T12:25:58.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.416+0000 7f606935c640 1 -- 172.21.15.33:0/2044234861 wait complete. 2024-09-12T12:25:58.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.417+0000 7f606935c640 1 Processor -- start 2024-09-12T12:25:58.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.417+0000 7f606935c640 1 -- start start 2024-09-12T12:25:58.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.417+0000 7f606935c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6064102d50 0x7f60641009b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:58.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.417+0000 7f606935c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6064103670 0x7f6064100ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:58.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.417+0000 7f606935c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f606410c180 0x7f6064101430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:58.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.417+0000 7f606935c640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6064111e80 con 0x7f6064103670 2024-09-12T12:25:58.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.417+0000 7f606935c640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6064111d00 con 0x7f606410c180 2024-09-12T12:25:58.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.417+0000 7f606935c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6064112000 con 0x7f6064102d50 2024-09-12T12:25:58.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.417+0000 7f605bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6064103670 0x7f6064100ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:58.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.418+0000 7f605bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6064103670 0x7f6064100ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56654/0 (socket says 172.21.15.33:56654) 2024-09-12T12:25:58.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.418+0000 7f605bfff640 1 -- 172.21.15.33:0/405761401 learned_addr learned my addr 172.21.15.33:0/405761401 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:58.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.418+0000 7f6062ffd640 1 --2- 172.21.15.33:0/405761401 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6064102d50 0x7f60641009b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:58.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.418+0000 7f60637fe640 1 --2- 172.21.15.33:0/405761401 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f606410c180 0x7f6064101430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:58.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.418+0000 7f605bfff640 1 -- 172.21.15.33:0/405761401 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6064102d50 msgr2=0x7f60641009b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:58.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.418+0000 7f605bfff640 1 --2- 172.21.15.33:0/405761401 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6064102d50 0x7f60641009b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.418+0000 7f605bfff640 1 -- 172.21.15.33:0/405761401 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f606410c180 msgr2=0x7f6064101430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:58.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.418+0000 7f605bfff640 1 --2- 172.21.15.33:0/405761401 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f606410c180 0x7f6064101430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.418+0000 7f605bfff640 1 -- 172.21.15.33:0/405761401 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60641a67c0 con 0x7f6064103670 2024-09-12T12:25:58.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.418+0000 7f60637fe640 1 --2- 172.21.15.33:0/405761401 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f606410c180 0x7f6064101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:58.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.418+0000 7f605bfff640 1 --2- 172.21.15.33:0/405761401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6064103670 0x7f6064100ef0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f604c005ab0 tx=0x7f604c003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:58.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.418+0000 7f6060ff9640 1 -- 172.21.15.33:0/405761401 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f604c03f070 con 0x7f6064103670 2024-09-12T12:25:58.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.418+0000 7f6060ff9640 1 -- 172.21.15.33:0/405761401 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f604c031d60 con 0x7f6064103670 2024-09-12T12:25:58.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.418+0000 7f606935c640 1 -- 172.21.15.33:0/405761401 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60641a6a50 con 0x7f6064103670 2024-09-12T12:25:58.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.418+0000 7f6060ff9640 1 -- 172.21.15.33:0/405761401 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f604c035030 con 0x7f6064103670 2024-09-12T12:25:58.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.418+0000 7f606935c640 1 -- 172.21.15.33:0/405761401 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60641a6f80 con 0x7f6064103670 2024-09-12T12:25:58.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.421+0000 7f6060ff9640 1 -- 172.21.15.33:0/405761401 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f604c042070 con 0x7f6064103670 2024-09-12T12:25:58.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.421+0000 7f606b735740 1 Processor -- start 2024-09-12T12:25:58.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.421+0000 7f606b735740 1 -- start start 2024-09-12T12:25:58.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.422+0000 7f606b735740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564d33ff69d0 0x564d33ff6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:58.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.422+0000 7f606b735740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564d33ff72f0 0x564d34001670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:58.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.422+0000 7f606b735740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564d34001bb0 0x564d34003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:58.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.422+0000 7f606b735740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x564d33f5d090 con 0x564d33ff72f0 2024-09-12T12:25:58.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.422+0000 7f606b735740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x564d33f04a70 con 0x564d34001bb0 2024-09-12T12:25:58.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.422+0000 7f606b735740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564d33f59050 con 0x564d33ff69d0 2024-09-12T12:25:58.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.422+0000 7f6062ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564d33ff72f0 0x564d34001670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:58.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.422+0000 7f6062ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564d33ff72f0 0x564d34001670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56662/0 (socket says 172.21.15.33:56662) 2024-09-12T12:25:58.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.422+0000 7f6062ffd640 1 -- 172.21.15.33:0/4185200042 learned_addr learned my addr 172.21.15.33:0/4185200042 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:58.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.422+0000 7f60637fe640 1 --2- 172.21.15.33:0/4185200042 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564d33ff69d0 0x564d33ff6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:58.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.422+0000 7f605bfff640 1 --2- 172.21.15.33:0/4185200042 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564d34001bb0 0x564d34003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:58.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.422+0000 7f6062ffd640 1 -- 172.21.15.33:0/4185200042 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564d33ff69d0 msgr2=0x564d33ff6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:58.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.422+0000 7f6062ffd640 1 --2- 172.21.15.33:0/4185200042 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564d33ff69d0 0x564d33ff6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.422+0000 7f6062ffd640 1 -- 172.21.15.33:0/4185200042 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564d34001bb0 msgr2=0x564d34003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:58.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.422+0000 7f6062ffd640 1 --2- 172.21.15.33:0/4185200042 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564d34001bb0 0x564d34003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.422+0000 7f6062ffd640 1 -- 172.21.15.33:0/4185200042 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d33f11130 con 0x564d33ff72f0 2024-09-12T12:25:58.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.422+0000 7f60637fe640 1 --2- 172.21.15.33:0/4185200042 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564d33ff69d0 0x564d33ff6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:58.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.422+0000 7f605bfff640 1 --2- 172.21.15.33:0/4185200042 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564d34001bb0 0x564d34003fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:58.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.422+0000 7f6060ff9640 1 --2- 172.21.15.33:0/405761401 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f60500a2c90 0x7f60500a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:58.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.422+0000 7f60637fe640 1 --2- 172.21.15.33:0/405761401 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f60500a2c90 0x7f60500a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:58.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.422+0000 7f6062ffd640 1 --2- 172.21.15.33:0/4185200042 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564d33ff72f0 0x564d34001670 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f605400bcb0 tx=0x7f605400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feac4b75c86f097a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:58.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.422+0000 7f6060ff9640 1 -- 172.21.15.33:0/405761401 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7f604c0efda0 con 0x7f6064103670 2024-09-12T12:25:58.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.423+0000 7f60597fa640 1 -- 172.21.15.33:0/4185200042 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6054015070 con 0x564d33ff72f0 2024-09-12T12:25:58.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.423+0000 7f60597fa640 1 -- 172.21.15.33:0/4185200042 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f60540118f0 con 0x564d33ff72f0 2024-09-12T12:25:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.423+0000 7f60597fa640 1 -- 172.21.15.33:0/4185200042 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60540108b0 con 0x564d33ff72f0 2024-09-12T12:25:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.423+0000 7f606b735740 1 -- 172.21.15.33:0/4185200042 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564d33ff72f0 msgr2=0x564d34001670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.423+0000 7f60637fe640 1 --2- 172.21.15.33:0/405761401 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f60500a2c90 0x7f60500a5150 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f605c007f30 tx=0x7f605c007910 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.423+0000 7f606b735740 1 --2- 172.21.15.33:0/4185200042 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564d33ff72f0 0x564d34001670 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f605400bcb0 tx=0x7f605400f730 comp rx=0 tx=0).stop 2024-09-12T12:25:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.424+0000 7f606b735740 1 -- 172.21.15.33:0/4185200042 shutdown_connections 2024-09-12T12:25:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.424+0000 7f606b735740 1 --2- 172.21.15.33:0/4185200042 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564d34001bb0 0x564d34003fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.424+0000 7f606b735740 1 --2- 172.21.15.33:0/4185200042 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564d33ff72f0 0x564d34001670 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.424+0000 7f606b735740 1 --2- 172.21.15.33:0/4185200042 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564d33ff69d0 0x564d33ff6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.424+0000 7f606b735740 1 -- 172.21.15.33:0/4185200042 >> 172.21.15.33:0/4185200042 conn(0x564d33ff2f60 msgr2=0x564d33ff3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.424+0000 7f606b735740 1 -- 172.21.15.33:0/4185200042 shutdown_connections 2024-09-12T12:25:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.424+0000 7f606b735740 1 -- 172.21.15.33:0/4185200042 wait complete. 2024-09-12T12:25:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.424+0000 7f606b735740 1 -- start start 2024-09-12T12:25:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.424+0000 7f606b735740 1 Processor -- start 2024-09-12T12:25:58.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.424+0000 7f606b735740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564d33ff69d0 0x564d34001440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:58.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.424+0000 7f606b735740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564d33ff72f0 0x564d33ffe790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:58.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.424+0000 7f606b735740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564d34001bb0 0x564d33ffecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:58.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.424+0000 7f606b735740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x564d34004780 con 0x564d33ff72f0 2024-09-12T12:25:58.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.424+0000 7f606b735740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x564d33f17f20 con 0x564d33ff69d0 2024-09-12T12:25:58.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.424+0000 7f606b735740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564d34004900 con 0x564d34001bb0 2024-09-12T12:25:58.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.424+0000 7f606b735740 10 client.0 _ll_register_callbacks cb 0x564d33ee1030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:58.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.425+0000 7f605bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564d33ff72f0 0x564d33ffe790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:58.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.425+0000 7f605bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564d33ff72f0 0x564d33ffe790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56674/0 (socket says 172.21.15.33:56674) 2024-09-12T12:25:58.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.425+0000 7f605bfff640 1 -- 172.21.15.33:0/2570604871 learned_addr learned my addr 172.21.15.33:0/2570604871 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:58.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.425+0000 7f60637fe640 1 --2- 172.21.15.33:0/2570604871 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564d34001bb0 0x564d33ffecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:58.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.425+0000 7f6062ffd640 1 --2- 172.21.15.33:0/2570604871 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564d33ff69d0 0x564d34001440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:58.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.425+0000 7f605bfff640 1 -- 172.21.15.33:0/2570604871 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564d34001bb0 msgr2=0x564d33ffecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:58.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.425+0000 7f605bfff640 1 --2- 172.21.15.33:0/2570604871 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564d34001bb0 0x564d33ffecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.425+0000 7f605bfff640 1 -- 172.21.15.33:0/2570604871 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564d33ff69d0 msgr2=0x564d34001440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:58.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.425+0000 7f605bfff640 1 --2- 172.21.15.33:0/2570604871 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564d33ff69d0 0x564d34001440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.425+0000 7f605bfff640 1 -- 172.21.15.33:0/2570604871 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d33cce2b0 con 0x564d33ff72f0 2024-09-12T12:25:58.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.425+0000 7f60637fe640 1 --2- 172.21.15.33:0/2570604871 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564d34001bb0 0x564d33ffecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:58.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.425+0000 7f6062ffd640 1 --2- 172.21.15.33:0/2570604871 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564d33ff69d0 0x564d34001440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:25:58.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.425+0000 7f605bfff640 1 --2- 172.21.15.33:0/2570604871 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564d33ff72f0 0x564d33ffe790 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f604c000c00 tx=0x7f604c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e722c5fc9b612fb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:58.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.425+0000 7f604a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:25:58.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.425+0000 7f604a7fc640 1 -- 172.21.15.33:0/2570604871 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f604c049070 con 0x564d33ff72f0 2024-09-12T12:25:58.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.425+0000 7f604a7fc640 1 -- 172.21.15.33:0/2570604871 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7f604c0b87b0 con 0x564d33ff72f0 2024-09-12T12:25:58.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.425+0000 7f606b735740 1 -- 172.21.15.33:0/2570604871 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60540118f0 con 0x564d33ff72f0 2024-09-12T12:25:58.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.425+0000 7f604a7fc640 1 -- 172.21.15.33:0/2570604871 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f604c0bbc80 con 0x564d33ff72f0 2024-09-12T12:25:58.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.425+0000 7f606b735740 10 client.15174 fetch_fsmap learned FSMap version 24 2024-09-12T12:25:58.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.425+0000 7f606b735740 1 -- 172.21.15.33:0/2570604871 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564d34010090 con 0x564d33ff72f0 2024-09-12T12:25:58.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.426+0000 7f604a7fc640 1 -- 172.21.15.33:0/2570604871 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f60540118f0 con 0x564d33ff72f0 2024-09-12T12:25:58.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.426+0000 7f604a7fc640 1 -- 172.21.15.33:0/2570604871 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f604c03b560 con 0x564d33ff72f0 2024-09-12T12:25:58.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.426+0000 7f606b735740 10 client.15174 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T12:25:58.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.426+0000 7f606b735740 10 client.15174 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-12T12:25:58.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.426+0000 7f606b735740 20 client.15174 populate_metadata read hostname 'smithi033' 2024-09-12T12:25:58.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.426+0000 7f606b735740 1 --2- 172.21.15.33:0/2570604871 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x564d340126d0 0x564d34013b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:58.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.426+0000 7f606b735740 4 client.15174 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:25:58.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.426+0000 7f606b735740 1 -- 172.21.15.33:0/2570604871 --> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d33f6a600 con 0x564d340126d0 2024-09-12T12:25:58.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.426+0000 7f6062ffd640 1 --2- 172.21.15.33:0/2570604871 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x564d340126d0 0x564d34013b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:58.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.427+0000 7f604a7fc640 10 client.15174 ms_handle_connect on v2:172.21.15.102:6834/4179527539 2024-09-12T12:25:58.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.427+0000 7f6062ffd640 1 --2- 172.21.15.33:0/2570604871 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x564d340126d0 0x564d34013b40 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c5c5905d43fead3c server_cookie=ae473a53d372983d in_seq=0 out_seq=0 2024-09-12T12:25:58.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.428+0000 7f604a7fc640 1 -- 172.21.15.33:0/2570604871 <== mds.2 v2:172.21.15.102:6834/4179527539 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564d33f6a600 con 0x564d340126d0 2024-09-12T12:25:58.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.428+0000 7f604a7fc640 10 client.15174 handle_command_reply: tid=0 2024-09-12T12:25:58.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.428+0000 7f606b735740 1 client.15174 shutdown 2024-09-12T12:25:58.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.428+0000 7f606b735740 1 -- 172.21.15.33:0/2570604871 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564d33ff72f0 msgr2=0x564d33ffe790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:58.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.428+0000 7f606b735740 1 --2- 172.21.15.33:0/2570604871 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564d33ff72f0 0x564d33ffe790 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f604c000c00 tx=0x7f604c009260 comp rx=0 tx=0).stop 2024-09-12T12:25:58.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.428+0000 7f606b735740 1 -- 172.21.15.33:0/2570604871 shutdown_connections 2024-09-12T12:25:58.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.428+0000 7f606b735740 1 --2- 172.21.15.33:0/2570604871 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564d34001bb0 0x564d33ffecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.428+0000 7f606b735740 1 --2- 172.21.15.33:0/2570604871 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564d33ff72f0 0x564d33ffe790 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.428+0000 7f606b735740 1 --2- 172.21.15.33:0/2570604871 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x564d340126d0 0x564d34013b40 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.428+0000 7f604a7fc640 0 client.15174 ms_handle_reset on v2:172.21.15.102:6834/4179527539 2024-09-12T12:25:58.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.428+0000 7f606b735740 1 --2- 172.21.15.33:0/2570604871 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564d33ff69d0 0x564d34001440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.428+0000 7f606b735740 1 -- 172.21.15.33:0/2570604871 >> 172.21.15.33:0/2570604871 conn(0x564d33ff2f60 msgr2=0x564d33ff8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:58.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.428+0000 7f606b735740 1 -- 172.21.15.33:0/2570604871 shutdown_connections 2024-09-12T12:25:58.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.428+0000 7f606b735740 1 -- 172.21.15.33:0/2570604871 wait complete. 2024-09-12T12:25:58.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.428+0000 7f606b735740 20 client.15174 trim_cache size 0 max 16384 2024-09-12T12:25:58.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.446+0000 7f606b735740 1 Processor -- start 2024-09-12T12:25:58.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.446+0000 7f606b735740 1 -- start start 2024-09-12T12:25:58.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.446+0000 7f606b735740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564d33ff69d0 0x564d34013b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:58.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.446+0000 7f606b735740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564d33ff72f0 0x564d33ffe050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:58.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.446+0000 7f606b735740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564d34001bb0 0x564d33ffd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:58.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.446+0000 7f606b735740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x564d34011e80 con 0x564d33ff72f0 2024-09-12T12:25:58.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.446+0000 7f606b735740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x564d34012550 con 0x564d34001bb0 2024-09-12T12:25:58.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.446+0000 7f606b735740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564d34012c20 con 0x564d33ff69d0 2024-09-12T12:25:58.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.447+0000 7f605bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564d33ff72f0 0x564d33ffe050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:58.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.447+0000 7f605bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564d33ff72f0 0x564d33ffe050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56682/0 (socket says 172.21.15.33:56682) 2024-09-12T12:25:58.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.447+0000 7f605bfff640 1 -- 172.21.15.33:0/1023100479 learned_addr learned my addr 172.21.15.33:0/1023100479 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:58.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.447+0000 7f6062ffd640 1 --2- 172.21.15.33:0/1023100479 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564d33ff69d0 0x564d34013b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:58.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.447+0000 7f60637fe640 1 --2- 172.21.15.33:0/1023100479 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564d34001bb0 0x564d33ffd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:58.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.447+0000 7f605bfff640 1 -- 172.21.15.33:0/1023100479 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564d33ff69d0 msgr2=0x564d34013b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:58.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.447+0000 7f605bfff640 1 --2- 172.21.15.33:0/1023100479 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564d33ff69d0 0x564d34013b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.447+0000 7f605bfff640 1 -- 172.21.15.33:0/1023100479 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564d34001bb0 msgr2=0x564d33ffd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:58.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.447+0000 7f605bfff640 1 --2- 172.21.15.33:0/1023100479 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564d34001bb0 0x564d33ffd060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.447+0000 7f605bfff640 1 -- 172.21.15.33:0/1023100479 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d33fff550 con 0x564d33ff72f0 2024-09-12T12:25:58.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.447+0000 7f6062ffd640 1 --2- 172.21.15.33:0/1023100479 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564d33ff69d0 0x564d34013b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:25:58.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.447+0000 7f60637fe640 1 --2- 172.21.15.33:0/1023100479 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564d34001bb0 0x564d33ffd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:25:58.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.447+0000 7f605bfff640 1 --2- 172.21.15.33:0/1023100479 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564d33ff72f0 0x564d33ffe050 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f604c0bbe40 tx=0x7f604c0d51d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36297b46621370bc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:58.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.447+0000 7f6058ff9640 1 -- 172.21.15.33:0/1023100479 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f604c049070 con 0x564d33ff72f0 2024-09-12T12:25:58.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.447+0000 7f6058ff9640 1 -- 172.21.15.33:0/1023100479 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f604c0bc840 con 0x564d33ff72f0 2024-09-12T12:25:58.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.447+0000 7f6058ff9640 1 -- 172.21.15.33:0/1023100479 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f604c0bbaa0 con 0x564d33ff72f0 2024-09-12T12:25:58.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.448+0000 7f606b735740 1 -- 172.21.15.33:0/1023100479 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564d33ff72f0 msgr2=0x564d33ffe050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:58.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.448+0000 7f606b735740 1 --2- 172.21.15.33:0/1023100479 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564d33ff72f0 0x564d33ffe050 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f604c0bbe40 tx=0x7f604c0d51d0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.448+0000 7f606b735740 1 -- 172.21.15.33:0/1023100479 shutdown_connections 2024-09-12T12:25:58.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.448+0000 7f606b735740 1 --2- 172.21.15.33:0/1023100479 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564d34001bb0 0x564d33ffd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.448+0000 7f606b735740 1 --2- 172.21.15.33:0/1023100479 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564d33ff72f0 0x564d33ffe050 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.448+0000 7f606b735740 1 --2- 172.21.15.33:0/1023100479 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564d33ff69d0 0x564d34013b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.448+0000 7f606b735740 1 -- 172.21.15.33:0/1023100479 >> 172.21.15.33:0/1023100479 conn(0x564d33ff2f60 msgr2=0x564d33ff3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:58.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.448+0000 7f606b735740 1 -- 172.21.15.33:0/1023100479 shutdown_connections 2024-09-12T12:25:58.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.448+0000 7f606b735740 1 -- 172.21.15.33:0/1023100479 wait complete. 2024-09-12T12:25:58.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.448+0000 7f606b735740 1 -- start start 2024-09-12T12:25:58.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.449+0000 7f606b735740 1 Processor -- start 2024-09-12T12:25:58.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.449+0000 7f606b735740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564d33ff69d0 0x564d34019b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:58.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.449+0000 7f606b735740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564d33ff72f0 0x564d3401a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:58.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.449+0000 7f606b735740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564d34001bb0 0x564d34015170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:58.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.449+0000 7f606b735740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x564d340139c0 con 0x564d33ff72f0 2024-09-12T12:25:58.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.449+0000 7f606b735740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x564d340132f0 con 0x564d34001bb0 2024-09-12T12:25:58.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.449+0000 7f606b735740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564d34014090 con 0x564d33ff69d0 2024-09-12T12:25:58.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.449+0000 7f606b735740 10 client.0 _ll_register_callbacks cb 0x7f604c03b460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:58.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.449+0000 7f605bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564d33ff72f0 0x564d3401a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:58.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.449+0000 7f605bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564d33ff72f0 0x564d3401a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56684/0 (socket says 172.21.15.33:56684) 2024-09-12T12:25:58.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.449+0000 7f605bfff640 1 -- 172.21.15.33:0/3256948017 learned_addr learned my addr 172.21.15.33:0/3256948017 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:58.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.449+0000 7f6062ffd640 1 --2- 172.21.15.33:0/3256948017 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564d33ff69d0 0x564d34019b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:58.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.449+0000 7f60637fe640 1 --2- 172.21.15.33:0/3256948017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564d34001bb0 0x564d34015170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:58.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.450+0000 7f605bfff640 1 -- 172.21.15.33:0/3256948017 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564d33ff69d0 msgr2=0x564d34019b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:58.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.450+0000 7f605bfff640 1 --2- 172.21.15.33:0/3256948017 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564d33ff69d0 0x564d34019b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.450+0000 7f605bfff640 1 -- 172.21.15.33:0/3256948017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564d34001bb0 msgr2=0x564d34015170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:58.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.450+0000 7f605bfff640 1 --2- 172.21.15.33:0/3256948017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564d34001bb0 0x564d34015170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.450+0000 7f605bfff640 1 -- 172.21.15.33:0/3256948017 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d34015760 con 0x564d33ff72f0 2024-09-12T12:25:58.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.450+0000 7f605bfff640 1 --2- 172.21.15.33:0/3256948017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564d33ff72f0 0x564d3401a0d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f604c0c4f70 tx=0x7f604c0b84c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4ec2c5386f640ff server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:58.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.450+0000 7f604a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:25:58.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.450+0000 7f604a7fc640 1 -- 172.21.15.33:0/3256948017 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f604c049030 con 0x564d33ff72f0 2024-09-12T12:25:58.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.450+0000 7f604a7fc640 1 -- 172.21.15.33:0/3256948017 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7f604c0c00f0 con 0x564d33ff72f0 2024-09-12T12:25:58.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.450+0000 7f606b735740 1 -- 172.21.15.33:0/3256948017 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f604c0bc840 con 0x564d33ff72f0 2024-09-12T12:25:58.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.451+0000 7f604a7fc640 1 -- 172.21.15.33:0/3256948017 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f604c0c02f0 con 0x564d33ff72f0 2024-09-12T12:25:58.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.451+0000 7f606b735740 10 client.15180 fetch_fsmap learned FSMap version 24 2024-09-12T12:25:58.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.451+0000 7f606b735740 1 -- 172.21.15.33:0/3256948017 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564d34019120 con 0x564d33ff72f0 2024-09-12T12:25:58.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.451+0000 7f604a7fc640 1 -- 172.21.15.33:0/3256948017 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f604c0bc840 con 0x564d33ff72f0 2024-09-12T12:25:58.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.451+0000 7f604a7fc640 1 -- 172.21.15.33:0/3256948017 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f604c0bb620 con 0x564d33ff72f0 2024-09-12T12:25:58.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.451+0000 7f606b735740 10 client.15180 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T12:25:58.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.451+0000 7f606b735740 10 client.15180 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-12T12:25:58.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.451+0000 7f606b735740 20 client.15180 populate_metadata read hostname 'smithi033' 2024-09-12T12:25:58.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.451+0000 7f606b735740 1 --2- 172.21.15.33:0/3256948017 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x564d34080d80 0x564d3407fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:58.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.451+0000 7f606b735740 4 client.15180 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:25:58.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.451+0000 7f606b735740 1 -- 172.21.15.33:0/3256948017 --> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] -- command(tid 0: {"prefix": "status"}) -- 0x564d33f64b10 con 0x564d34080d80 2024-09-12T12:25:58.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.452+0000 7f6062ffd640 1 --2- 172.21.15.33:0/3256948017 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x564d34080d80 0x564d3407fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:58.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.452+0000 7f604a7fc640 10 client.15180 ms_handle_connect on v2:172.21.15.102:6834/4179527539 2024-09-12T12:25:58.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.452+0000 7f6062ffd640 1 --2- 172.21.15.33:0/3256948017 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x564d34080d80 0x564d3407fa90 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8605531ef71538fa server_cookie=4e2b158524789e39 in_seq=0 out_seq=0 2024-09-12T12:25:58.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.452+0000 7f604a7fc640 1 -- 172.21.15.33:0/3256948017 <== mds.2 v2:172.21.15.102:6834/4179527539 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x564d33f64b10 con 0x564d34080d80 2024-09-12T12:25:58.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.452+0000 7f604a7fc640 10 client.15180 handle_command_reply: tid=0 2024-09-12T12:25:58.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.452+0000 7f606b735740 1 client.15180 shutdown 2024-09-12T12:25:58.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.452+0000 7f606b735740 1 -- 172.21.15.33:0/3256948017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564d33ff72f0 msgr2=0x564d3401a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:58.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.452+0000 7f606b735740 1 --2- 172.21.15.33:0/3256948017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564d33ff72f0 0x564d3401a0d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f604c0c4f70 tx=0x7f604c0b84c0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.452+0000 7f606b735740 1 -- 172.21.15.33:0/3256948017 shutdown_connections 2024-09-12T12:25:58.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.452+0000 7f606b735740 1 --2- 172.21.15.33:0/3256948017 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x564d34080d80 0x564d3407fa90 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.452+0000 7f606b735740 1 --2- 172.21.15.33:0/3256948017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564d34001bb0 0x564d34015170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.452+0000 7f604a7fc640 0 client.15180 ms_handle_reset on v2:172.21.15.102:6834/4179527539 2024-09-12T12:25:58.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.453+0000 7f606b735740 1 --2- 172.21.15.33:0/3256948017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564d33ff72f0 0x564d3401a0d0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.453+0000 7f606b735740 1 --2- 172.21.15.33:0/3256948017 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564d33ff69d0 0x564d34019b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.453+0000 7f606b735740 1 -- 172.21.15.33:0/3256948017 >> 172.21.15.33:0/3256948017 conn(0x564d33ff2f60 msgr2=0x564d33ffcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:58.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.453+0000 7f606b735740 1 -- 172.21.15.33:0/3256948017 shutdown_connections 2024-09-12T12:25:58.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.453+0000 7f606b735740 1 -- 172.21.15.33:0/3256948017 wait complete. 2024-09-12T12:25:58.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.453+0000 7f606b735740 20 client.15180 trim_cache size 0 max 16384 2024-09-12T12:25:58.470 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:25:58.470 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "a66dfafc-7100-11ef-bcea-c7b262605968", 2024-09-12T12:25:58.470 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 2, 2024-09-12T12:25:58.471 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 24478, 2024-09-12T12:25:58.471 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-09-12T12:25:58.471 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-09-12T12:25:58.471 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-09-12T12:25:58.471 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 90.676238726999998, 2024-09-12T12:25:58.471 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 24, 2024-09-12T12:25:58.471 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 87, 2024-09-12T12:25:58.471 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 85, 2024-09-12T12:25:58.471 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 158.84540294000001 2024-09-12T12:25:58.471 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:25:58.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.453+0000 7f606935c640 1 -- 172.21.15.33:0/405761401 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f60500a2c90 msgr2=0x7f60500a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:58.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.453+0000 7f606935c640 1 --2- 172.21.15.33:0/405761401 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f60500a2c90 0x7f60500a5150 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f605c007f30 tx=0x7f605c007910 comp rx=0 tx=0).stop 2024-09-12T12:25:58.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.453+0000 7f606935c640 1 -- 172.21.15.33:0/405761401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6064103670 msgr2=0x7f6064100ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:58.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.453+0000 7f606935c640 1 --2- 172.21.15.33:0/405761401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6064103670 0x7f6064100ef0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f604c005ab0 tx=0x7f604c003c80 comp rx=0 tx=0).stop 2024-09-12T12:25:58.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.454+0000 7f606935c640 1 -- 172.21.15.33:0/405761401 shutdown_connections 2024-09-12T12:25:58.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.454+0000 7f606935c640 1 --2- 172.21.15.33:0/405761401 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f60500a2c90 0x7f60500a5150 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.454+0000 7f606935c640 1 --2- 172.21.15.33:0/405761401 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f606410c180 0x7f6064101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.454+0000 7f606935c640 1 --2- 172.21.15.33:0/405761401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6064103670 0x7f6064100ef0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.454+0000 7f606935c640 1 --2- 172.21.15.33:0/405761401 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6064102d50 0x7f60641009b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.454+0000 7f606935c640 1 -- 172.21.15.33:0/405761401 >> 172.21.15.33:0/405761401 conn(0x7f60640fc7d0 msgr2=0x7f60640fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:58.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.454+0000 7f606935c640 1 -- 172.21.15.33:0/405761401 shutdown_connections 2024-09-12T12:25:58.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:58.454+0000 7f606935c640 1 -- 172.21.15.33:0/405761401 wait complete. 2024-09-12T12:25:59.089 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:58 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-09-12T12:25:59.089 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:58 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]: dispatch 2024-09-12T12:25:59.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:58 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-09-12T12:25:59.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:58 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]: dispatch 2024-09-12T12:25:59.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:58 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-09-12T12:25:59.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:58 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]: dispatch 2024-09-12T12:25:59.169 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-12T12:25:59.430 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:25:59.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.897+0000 7f47d9a76640 1 -- 172.21.15.33:0/3573488964 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47d4101de0 msgr2=0x7f47d41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:59.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.897+0000 7f47d9a76640 1 --2- 172.21.15.33:0/3573488964 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47d4101de0 0x7f47d41021c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f47c4009900 tx=0x7f47c402a410 comp rx=0 tx=0).stop 2024-09-12T12:25:59.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.897+0000 7f47d9a76640 1 -- 172.21.15.33:0/3573488964 shutdown_connections 2024-09-12T12:25:59.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.897+0000 7f47d9a76640 1 --2- 172.21.15.33:0/3573488964 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f47d4106f10 0x7f47d410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.897+0000 7f47d9a76640 1 --2- 172.21.15.33:0/3573488964 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47d4102790 0x7f47d41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.897+0000 7f47d9a76640 1 --2- 172.21.15.33:0/3573488964 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47d4101de0 0x7f47d41021c0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.897+0000 7f47d9a76640 1 -- 172.21.15.33:0/3573488964 >> 172.21.15.33:0/3573488964 conn(0x7f47d40fd8c0 msgr2=0x7f47d40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:59.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.897+0000 7f47d9a76640 1 -- 172.21.15.33:0/3573488964 shutdown_connections 2024-09-12T12:25:59.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.897+0000 7f47d9a76640 1 -- 172.21.15.33:0/3573488964 wait complete. 2024-09-12T12:25:59.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.898+0000 7f47d9a76640 1 Processor -- start 2024-09-12T12:25:59.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.898+0000 7f47d9a76640 1 -- start start 2024-09-12T12:25:59.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.898+0000 7f47d9a76640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47d4101de0 0x7f47d4198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:59.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.898+0000 7f47d9a76640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47d4102790 0x7f47d41988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:59.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.898+0000 7f47d9a76640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f47d4106f10 0x7f47d419cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:59.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.898+0000 7f47d9a76640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f47d4111e20 con 0x7f47d4102790 2024-09-12T12:25:59.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.898+0000 7f47d9a76640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f47d4111ca0 con 0x7f47d4101de0 2024-09-12T12:25:59.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.898+0000 7f47d9a76640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f47d4111fa0 con 0x7f47d4106f10 2024-09-12T12:25:59.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.898+0000 7f47d2ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47d4102790 0x7f47d41988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:59.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.898+0000 7f47d2ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47d4102790 0x7f47d41988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56702/0 (socket says 172.21.15.33:56702) 2024-09-12T12:25:59.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.898+0000 7f47d2ffd640 1 -- 172.21.15.33:0/3230050733 learned_addr learned my addr 172.21.15.33:0/3230050733 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:59.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.898+0000 7f47d3fff640 1 --2- 172.21.15.33:0/3230050733 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f47d4106f10 0x7f47d419cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:59.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.899+0000 7f47d37fe640 1 --2- 172.21.15.33:0/3230050733 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47d4101de0 0x7f47d4198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:59.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.899+0000 7f47d2ffd640 1 -- 172.21.15.33:0/3230050733 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f47d4106f10 msgr2=0x7f47d419cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:59.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.899+0000 7f47d2ffd640 1 --2- 172.21.15.33:0/3230050733 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f47d4106f10 0x7f47d419cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.899+0000 7f47d2ffd640 1 -- 172.21.15.33:0/3230050733 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47d4101de0 msgr2=0x7f47d4198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:59.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.899+0000 7f47d2ffd640 1 --2- 172.21.15.33:0/3230050733 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47d4101de0 0x7f47d4198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.899+0000 7f47d2ffd640 1 -- 172.21.15.33:0/3230050733 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d419d320 con 0x7f47d4102790 2024-09-12T12:25:59.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.899+0000 7f47d37fe640 1 --2- 172.21.15.33:0/3230050733 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47d4101de0 0x7f47d4198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:59.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.899+0000 7f47d2ffd640 1 --2- 172.21.15.33:0/3230050733 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47d4102790 0x7f47d41988b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f47c800c890 tx=0x7f47c800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:59.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.899+0000 7f47d0ff9640 1 -- 172.21.15.33:0/3230050733 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c8004220 con 0x7f47d4102790 2024-09-12T12:25:59.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.899+0000 7f47d9a76640 1 -- 172.21.15.33:0/3230050733 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47d419d610 con 0x7f47d4102790 2024-09-12T12:25:59.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.899+0000 7f47d0ff9640 1 -- 172.21.15.33:0/3230050733 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f47c80043c0 con 0x7f47d4102790 2024-09-12T12:25:59.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.899+0000 7f47d0ff9640 1 -- 172.21.15.33:0/3230050733 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c8004a00 con 0x7f47d4102790 2024-09-12T12:25:59.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.899+0000 7f47d9a76640 1 -- 172.21.15.33:0/3230050733 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47d41a4ef0 con 0x7f47d4102790 2024-09-12T12:25:59.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.902+0000 7f47d0ff9640 1 -- 172.21.15.33:0/3230050733 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f47c8004ba0 con 0x7f47d4102790 2024-09-12T12:25:59.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.902+0000 7f47dbe4f740 1 Processor -- start 2024-09-12T12:25:59.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.902+0000 7f47dbe4f740 1 -- start start 2024-09-12T12:25:59.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.902+0000 7f47dbe4f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556acaafc9d0 0x556acaafcdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:59.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.902+0000 7f47dbe4f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556acaafd2f0 0x556acab07670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:59.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.902+0000 7f47dbe4f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556acab07bb0 0x556acab09fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:59.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.903+0000 7f47dbe4f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x556acaa63090 con 0x556acaafd2f0 2024-09-12T12:25:59.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.903+0000 7f47dbe4f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556acaa0aa70 con 0x556acaafc9d0 2024-09-12T12:25:59.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.903+0000 7f47dbe4f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556acaa5f050 con 0x556acab07bb0 2024-09-12T12:25:59.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.903+0000 7f47d37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556acaafd2f0 0x556acab07670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:59.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.903+0000 7f47d37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556acaafd2f0 0x556acab07670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56716/0 (socket says 172.21.15.33:56716) 2024-09-12T12:25:59.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.903+0000 7f47d37fe640 1 -- 172.21.15.33:0/21418773 learned_addr learned my addr 172.21.15.33:0/21418773 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:59.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.903+0000 7f47d0ff9640 1 --2- 172.21.15.33:0/3230050733 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f47bc0a2b80 0x7f47bc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:59.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.903+0000 7f47d3fff640 1 --2- 172.21.15.33:0/21418773 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556acaafc9d0 0x556acaafcdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:59.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.903+0000 7f47d37fe640 1 -- 172.21.15.33:0/21418773 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556acab07bb0 msgr2=0x556acab09fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:59.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.903+0000 7f47d37fe640 1 --2- 172.21.15.33:0/21418773 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556acab07bb0 0x556acab09fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.903+0000 7f47d37fe640 1 -- 172.21.15.33:0/21418773 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556acaafc9d0 msgr2=0x556acaafcdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:59.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.903+0000 7f47d37fe640 1 --2- 172.21.15.33:0/21418773 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556acaafc9d0 0x556acaafcdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.903+0000 7f47d37fe640 1 -- 172.21.15.33:0/21418773 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556acaa17130 con 0x556acaafd2f0 2024-09-12T12:25:59.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.903+0000 7f47d3fff640 1 --2- 172.21.15.33:0/21418773 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556acaafc9d0 0x556acaafcdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:25:59.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.903+0000 7f47d0ff9640 1 -- 172.21.15.33:0/3230050733 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f47c80cf090 con 0x7f47d4102790 2024-09-12T12:25:59.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.903+0000 7f47d3fff640 1 --2- 172.21.15.33:0/3230050733 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f47bc0a2b80 0x7f47bc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:59.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.903+0000 7f47d37fe640 1 --2- 172.21.15.33:0/21418773 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556acaafd2f0 0x556acab07670 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f47c402a930 tx=0x7f47c4032e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca82c56374d217e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:59.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.904+0000 7f47b9ffb640 1 -- 172.21.15.33:0/21418773 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c403f070 con 0x556acaafd2f0 2024-09-12T12:25:59.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.904+0000 7f47d3fff640 1 --2- 172.21.15.33:0/3230050733 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f47bc0a2b80 0x7f47bc0a5040 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f47cc005fd0 tx=0x7f47cc004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:59.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.904+0000 7f47b9ffb640 1 -- 172.21.15.33:0/21418773 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f47c4031760 con 0x556acaafd2f0 2024-09-12T12:25:59.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.904+0000 7f47b9ffb640 1 -- 172.21.15.33:0/21418773 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c4035070 con 0x556acaafd2f0 2024-09-12T12:25:59.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.904+0000 7f47dbe4f740 1 -- 172.21.15.33:0/21418773 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556acaafd2f0 msgr2=0x556acab07670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:59.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.904+0000 7f47dbe4f740 1 --2- 172.21.15.33:0/21418773 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556acaafd2f0 0x556acab07670 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f47c402a930 tx=0x7f47c4032e50 comp rx=0 tx=0).stop 2024-09-12T12:25:59.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.904+0000 7f47dbe4f740 1 -- 172.21.15.33:0/21418773 shutdown_connections 2024-09-12T12:25:59.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.904+0000 7f47dbe4f740 1 --2- 172.21.15.33:0/21418773 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556acab07bb0 0x556acab09fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.904+0000 7f47dbe4f740 1 --2- 172.21.15.33:0/21418773 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556acaafd2f0 0x556acab07670 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.904+0000 7f47dbe4f740 1 --2- 172.21.15.33:0/21418773 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556acaafc9d0 0x556acaafcdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.904+0000 7f47dbe4f740 1 -- 172.21.15.33:0/21418773 >> 172.21.15.33:0/21418773 conn(0x556acaaf8f60 msgr2=0x556acaaf9340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:59.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.904+0000 7f47dbe4f740 1 -- 172.21.15.33:0/21418773 shutdown_connections 2024-09-12T12:25:59.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.904+0000 7f47dbe4f740 1 -- 172.21.15.33:0/21418773 wait complete. 2024-09-12T12:25:59.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.905+0000 7f47dbe4f740 1 -- start start 2024-09-12T12:25:59.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.905+0000 7f47dbe4f740 1 Processor -- start 2024-09-12T12:25:59.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.905+0000 7f47dbe4f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556acaafc9d0 0x556acab07500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:59.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.905+0000 7f47dbe4f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556acaafd2f0 0x556acab04850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:59.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.905+0000 7f47dbe4f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556acab07bb0 0x556acab04db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:59.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.905+0000 7f47dbe4f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x556acab0a780 con 0x556acaafc9d0 2024-09-12T12:25:59.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.905+0000 7f47dbe4f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556acaa1df20 con 0x556acaafd2f0 2024-09-12T12:25:59.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.905+0000 7f47dbe4f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556acab0a900 con 0x556acab07bb0 2024-09-12T12:25:59.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.905+0000 7f47dbe4f740 10 client.0 _ll_register_callbacks cb 0x556aca9e7030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:59.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.905+0000 7f47d37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556acaafc9d0 0x556acab07500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:59.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.905+0000 7f47d37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556acaafc9d0 0x556acab07500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56718/0 (socket says 172.21.15.33:56718) 2024-09-12T12:25:59.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.905+0000 7f47d37fe640 1 -- 172.21.15.33:0/682113952 learned_addr learned my addr 172.21.15.33:0/682113952 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:59.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.905+0000 7f47d3fff640 1 --2- 172.21.15.33:0/682113952 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556acab07bb0 0x556acab04db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:59.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.906+0000 7f47d2ffd640 1 --2- 172.21.15.33:0/682113952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556acaafd2f0 0x556acab04850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:59.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.906+0000 7f47d37fe640 1 -- 172.21.15.33:0/682113952 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556acab07bb0 msgr2=0x556acab04db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:59.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.906+0000 7f47d37fe640 1 --2- 172.21.15.33:0/682113952 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556acab07bb0 0x556acab04db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.906+0000 7f47d37fe640 1 -- 172.21.15.33:0/682113952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556acaafd2f0 msgr2=0x556acab04850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:59.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.906+0000 7f47d37fe640 1 --2- 172.21.15.33:0/682113952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556acaafd2f0 0x556acab04850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.906+0000 7f47d37fe640 1 -- 172.21.15.33:0/682113952 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556aca7d42b0 con 0x556acaafc9d0 2024-09-12T12:25:59.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.906+0000 7f47d2ffd640 1 --2- 172.21.15.33:0/682113952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556acaafd2f0 0x556acab04850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:25:59.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.906+0000 7f47d37fe640 1 --2- 172.21.15.33:0/682113952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556acaafc9d0 0x556acab07500 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f47c4005480 tx=0x7f47c402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9632bf3d62b5be2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:59.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.906+0000 7f47b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:25:59.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.906+0000 7f47b2ffd640 1 -- 172.21.15.33:0/682113952 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c403f070 con 0x556acaafc9d0 2024-09-12T12:25:59.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.906+0000 7f47b2ffd640 1 -- 172.21.15.33:0/682113952 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f47c403cca0 con 0x556acaafc9d0 2024-09-12T12:25:59.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.906+0000 7f47dbe4f740 1 -- 172.21.15.33:0/682113952 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47c4031760 con 0x556acaafc9d0 2024-09-12T12:25:59.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.906+0000 7f47b2ffd640 1 -- 172.21.15.33:0/682113952 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f47c4054050 con 0x556acaafc9d0 2024-09-12T12:25:59.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.906+0000 7f47dbe4f740 10 client.15192 fetch_fsmap learned FSMap version 24 2024-09-12T12:25:59.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.906+0000 7f47dbe4f740 1 -- 172.21.15.33:0/682113952 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x556acab160c0 con 0x556acaafc9d0 2024-09-12T12:25:59.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.906+0000 7f47b2ffd640 1 -- 172.21.15.33:0/682113952 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f47c4031760 con 0x556acaafc9d0 2024-09-12T12:25:59.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.907+0000 7f47b2ffd640 1 -- 172.21.15.33:0/682113952 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f47c4003710 con 0x556acaafc9d0 2024-09-12T12:25:59.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.907+0000 7f47dbe4f740 10 client.15192 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T12:25:59.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.907+0000 7f47dbe4f740 10 client.15192 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T12:25:59.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.907+0000 7f47dbe4f740 20 client.15192 populate_metadata read hostname 'smithi033' 2024-09-12T12:25:59.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.907+0000 7f47dbe4f740 1 --2- 172.21.15.33:0/682113952 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x556acab181e0 0x556acab19650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:59.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.907+0000 7f47dbe4f740 4 client.15192 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:25:59.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.907+0000 7f47dbe4f740 1 -- 172.21.15.33:0/682113952 --> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556acaa70600 con 0x556acab181e0 2024-09-12T12:25:59.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.907+0000 7f47d2ffd640 1 --2- 172.21.15.33:0/682113952 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x556acab181e0 0x556acab19650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:59.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.907+0000 7f47d2ffd640 1 --2- 172.21.15.33:0/682113952 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x556acab181e0 0x556acab19650 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6f01fdf21b87f810 server_cookie=77b44b965ccda009 in_seq=0 out_seq=0 2024-09-12T12:25:59.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.907+0000 7f47b2ffd640 10 client.15192 ms_handle_connect on v2:172.21.15.102:6836/2409953270 2024-09-12T12:25:59.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.908+0000 7f47b2ffd640 1 -- 172.21.15.33:0/682113952 <== mds.1 v2:172.21.15.102:6836/2409953270 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556acaa70600 con 0x556acab181e0 2024-09-12T12:25:59.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.908+0000 7f47b2ffd640 10 client.15192 handle_command_reply: tid=0 2024-09-12T12:25:59.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.908+0000 7f47dbe4f740 1 client.15192 shutdown 2024-09-12T12:25:59.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.908+0000 7f47dbe4f740 1 -- 172.21.15.33:0/682113952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556acaafc9d0 msgr2=0x556acab07500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:59.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.908+0000 7f47dbe4f740 1 --2- 172.21.15.33:0/682113952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556acaafc9d0 0x556acab07500 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f47c4005480 tx=0x7f47c402a410 comp rx=0 tx=0).stop 2024-09-12T12:25:59.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.908+0000 7f47dbe4f740 1 -- 172.21.15.33:0/682113952 shutdown_connections 2024-09-12T12:25:59.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.908+0000 7f47dbe4f740 1 --2- 172.21.15.33:0/682113952 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x556acab181e0 0x556acab19650 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.908+0000 7f47b2ffd640 0 client.15192 ms_handle_reset on v2:172.21.15.102:6836/2409953270 2024-09-12T12:25:59.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.908+0000 7f47dbe4f740 1 --2- 172.21.15.33:0/682113952 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556acab07bb0 0x556acab04db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.909+0000 7f47dbe4f740 1 --2- 172.21.15.33:0/682113952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556acaafd2f0 0x556acab04850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.909+0000 7f47dbe4f740 1 --2- 172.21.15.33:0/682113952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556acaafc9d0 0x556acab07500 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.909+0000 7f47dbe4f740 1 -- 172.21.15.33:0/682113952 >> 172.21.15.33:0/682113952 conn(0x556acaaf8f60 msgr2=0x556acaafec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:59.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.909+0000 7f47dbe4f740 1 -- 172.21.15.33:0/682113952 shutdown_connections 2024-09-12T12:25:59.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.909+0000 7f47dbe4f740 1 -- 172.21.15.33:0/682113952 wait complete. 2024-09-12T12:25:59.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.909+0000 7f47dbe4f740 20 client.15192 trim_cache size 0 max 16384 2024-09-12T12:25:59.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.927+0000 7f47dbe4f740 1 Processor -- start 2024-09-12T12:25:59.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.927+0000 7f47dbe4f740 1 -- start start 2024-09-12T12:25:59.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.927+0000 7f47dbe4f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556acaafc9d0 0x556acab17b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:59.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.927+0000 7f47dbe4f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556acaafd2f0 0x556acab188b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:59.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.927+0000 7f47dbe4f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556acab07bb0 0x556acaafdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:59.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.927+0000 7f47dbe4f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x556acab17990 con 0x556acab07bb0 2024-09-12T12:25:59.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.927+0000 7f47dbe4f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556acab18060 con 0x556acaafc9d0 2024-09-12T12:25:59.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.927+0000 7f47dbe4f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556acab18730 con 0x556acaafd2f0 2024-09-12T12:25:59.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.927+0000 7f47d3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556acab07bb0 0x556acaafdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:59.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.927+0000 7f47d3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556acab07bb0 0x556acaafdb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56730/0 (socket says 172.21.15.33:56730) 2024-09-12T12:25:59.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.927+0000 7f47d3fff640 1 -- 172.21.15.33:0/1972751945 learned_addr learned my addr 172.21.15.33:0/1972751945 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:59.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.927+0000 7f47d37fe640 1 --2- 172.21.15.33:0/1972751945 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556acaafc9d0 0x556acab17b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:59.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.927+0000 7f47d3fff640 1 -- 172.21.15.33:0/1972751945 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556acaafd2f0 msgr2=0x556acab188b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:59.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.927+0000 7f47d3fff640 1 --2- 172.21.15.33:0/1972751945 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556acaafd2f0 0x556acab188b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.927+0000 7f47d3fff640 1 -- 172.21.15.33:0/1972751945 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556acaafc9d0 msgr2=0x556acab17b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:59.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.927+0000 7f47d3fff640 1 --2- 172.21.15.33:0/1972751945 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556acaafc9d0 0x556acab17b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.927+0000 7f47d3fff640 1 -- 172.21.15.33:0/1972751945 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556acaafd120 con 0x556acab07bb0 2024-09-12T12:25:59.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.927+0000 7f47d37fe640 1 --2- 172.21.15.33:0/1972751945 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556acaafc9d0 0x556acab17b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:59.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.928+0000 7f47d3fff640 1 --2- 172.21.15.33:0/1972751945 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556acab07bb0 0x556acaafdb70 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f47cc0138e0 tx=0x7f47cc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2369da9367a75f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:59.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.928+0000 7f47b97fa640 1 -- 172.21.15.33:0/1972751945 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47cc013e60 con 0x556acab07bb0 2024-09-12T12:25:59.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.928+0000 7f47b97fa640 1 -- 172.21.15.33:0/1972751945 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f47cc016070 con 0x556acab07bb0 2024-09-12T12:25:59.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.928+0000 7f47b97fa640 1 -- 172.21.15.33:0/1972751945 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47cc0056f0 con 0x556acab07bb0 2024-09-12T12:25:59.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.928+0000 7f47dbe4f740 1 -- 172.21.15.33:0/1972751945 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556acab07bb0 msgr2=0x556acaafdb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:59.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.928+0000 7f47dbe4f740 1 --2- 172.21.15.33:0/1972751945 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556acab07bb0 0x556acaafdb70 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f47cc0138e0 tx=0x7f47cc014000 comp rx=0 tx=0).stop 2024-09-12T12:25:59.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.928+0000 7f47dbe4f740 1 -- 172.21.15.33:0/1972751945 shutdown_connections 2024-09-12T12:25:59.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.928+0000 7f47dbe4f740 1 --2- 172.21.15.33:0/1972751945 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556acab07bb0 0x556acaafdb70 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.928+0000 7f47dbe4f740 1 --2- 172.21.15.33:0/1972751945 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556acaafd2f0 0x556acab188b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.928+0000 7f47dbe4f740 1 --2- 172.21.15.33:0/1972751945 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556acaafc9d0 0x556acab17b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.928+0000 7f47dbe4f740 1 -- 172.21.15.33:0/1972751945 >> 172.21.15.33:0/1972751945 conn(0x556acaaf8f60 msgr2=0x556acab03d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:59.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.929+0000 7f47dbe4f740 1 -- 172.21.15.33:0/1972751945 shutdown_connections 2024-09-12T12:25:59.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.929+0000 7f47dbe4f740 1 -- 172.21.15.33:0/1972751945 wait complete. 2024-09-12T12:25:59.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.929+0000 7f47dbe4f740 1 -- start start 2024-09-12T12:25:59.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.929+0000 7f47dbe4f740 1 Processor -- start 2024-09-12T12:25:59.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.929+0000 7f47dbe4f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556acaafc9d0 0x556acab21c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:59.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.929+0000 7f47dbe4f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556acaafd2f0 0x556acab22150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:59.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.929+0000 7f47dbe4f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556acab07bb0 0x556acab1f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:59.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.929+0000 7f47dbe4f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x556acab194d0 con 0x556acaafd2f0 2024-09-12T12:25:59.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.929+0000 7f47dbe4f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556acab18e00 con 0x556acaafc9d0 2024-09-12T12:25:59.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.929+0000 7f47dbe4f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556acab19ba0 con 0x556acab07bb0 2024-09-12T12:25:59.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.930+0000 7f47dbe4f740 10 client.0 _ll_register_callbacks cb 0x7f47c4032d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:59.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.930+0000 7f47d2ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556acaafd2f0 0x556acab22150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:59.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.930+0000 7f47d2ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556acaafd2f0 0x556acab22150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56744/0 (socket says 172.21.15.33:56744) 2024-09-12T12:25:59.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.930+0000 7f47d2ffd640 1 -- 172.21.15.33:0/3700900771 learned_addr learned my addr 172.21.15.33:0/3700900771 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:25:59.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.930+0000 7f47d3fff640 1 --2- 172.21.15.33:0/3700900771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556acab07bb0 0x556acab1f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:59.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.930+0000 7f47d37fe640 1 --2- 172.21.15.33:0/3700900771 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556acaafc9d0 0x556acab21c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:59.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.930+0000 7f47d2ffd640 1 -- 172.21.15.33:0/3700900771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556acab07bb0 msgr2=0x556acab1f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:59.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.930+0000 7f47d2ffd640 1 --2- 172.21.15.33:0/3700900771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556acab07bb0 0x556acab1f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.930+0000 7f47d2ffd640 1 -- 172.21.15.33:0/3700900771 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556acaafc9d0 msgr2=0x556acab21c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:59.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.930+0000 7f47d2ffd640 1 --2- 172.21.15.33:0/3700900771 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556acaafc9d0 0x556acab21c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.930+0000 7f47d2ffd640 1 -- 172.21.15.33:0/3700900771 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556acab1f990 con 0x556acaafd2f0 2024-09-12T12:25:59.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.930+0000 7f47d2ffd640 1 --2- 172.21.15.33:0/3700900771 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556acaafd2f0 0x556acab22150 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f47c809b260 tx=0x7f47c809af80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75d9fd631daea8bf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:59.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.930+0000 7f47b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:25:59.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.930+0000 7f47b2ffd640 1 -- 172.21.15.33:0/3700900771 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c801d040 con 0x556acaafd2f0 2024-09-12T12:25:59.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.930+0000 7f47b2ffd640 1 -- 172.21.15.33:0/3700900771 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f47c8099860 con 0x556acaafd2f0 2024-09-12T12:25:59.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.930+0000 7f47dbe4f740 1 -- 172.21.15.33:0/3700900771 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47cc016070 con 0x556acaafd2f0 2024-09-12T12:25:59.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.931+0000 7f47b2ffd640 1 -- 172.21.15.33:0/3700900771 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f47c809b560 con 0x556acaafd2f0 2024-09-12T12:25:59.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.931+0000 7f47dbe4f740 10 client.15198 fetch_fsmap learned FSMap version 24 2024-09-12T12:25:59.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.931+0000 7f47dbe4f740 1 -- 172.21.15.33:0/3700900771 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x556acab864e0 con 0x556acaafd2f0 2024-09-12T12:25:59.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.931+0000 7f47b2ffd640 1 -- 172.21.15.33:0/3700900771 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f47cc016070 con 0x556acaafd2f0 2024-09-12T12:25:59.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.931+0000 7f47b2ffd640 1 -- 172.21.15.33:0/3700900771 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f47c80d1110 con 0x556acaafd2f0 2024-09-12T12:25:59.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.931+0000 7f47dbe4f740 10 client.15198 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T12:25:59.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.931+0000 7f47dbe4f740 10 client.15198 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T12:25:59.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.931+0000 7f47dbe4f740 20 client.15198 populate_metadata read hostname 'smithi033' 2024-09-12T12:25:59.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.931+0000 7f47dbe4f740 1 --2- 172.21.15.33:0/3700900771 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x556acab181e0 0x556acab89d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:59.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.931+0000 7f47dbe4f740 4 client.15198 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:25:59.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.931+0000 7f47dbe4f740 1 -- 172.21.15.33:0/3700900771 --> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] -- command(tid 0: {"prefix": "status"}) -- 0x556acaa6ab10 con 0x556acab181e0 2024-09-12T12:25:59.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.931+0000 7f47d37fe640 1 --2- 172.21.15.33:0/3700900771 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x556acab181e0 0x556acab89d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:59.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.932+0000 7f47d37fe640 1 --2- 172.21.15.33:0/3700900771 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x556acab181e0 0x556acab89d40 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8fa3b37c4a2cf65f server_cookie=9f70dec8d8a3b031 in_seq=0 out_seq=0 2024-09-12T12:25:59.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.932+0000 7f47b2ffd640 10 client.15198 ms_handle_connect on v2:172.21.15.102:6836/2409953270 2024-09-12T12:25:59.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.932+0000 7f47b2ffd640 1 -- 172.21.15.33:0/3700900771 <== mds.1 v2:172.21.15.102:6836/2409953270 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x556acaa6ab10 con 0x556acab181e0 2024-09-12T12:25:59.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.932+0000 7f47b2ffd640 10 client.15198 handle_command_reply: tid=0 2024-09-12T12:25:59.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.932+0000 7f47dbe4f740 1 client.15198 shutdown 2024-09-12T12:25:59.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.932+0000 7f47dbe4f740 1 -- 172.21.15.33:0/3700900771 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556acaafd2f0 msgr2=0x556acab22150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:59.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.932+0000 7f47dbe4f740 1 --2- 172.21.15.33:0/3700900771 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556acaafd2f0 0x556acab22150 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f47c809b260 tx=0x7f47c809af80 comp rx=0 tx=0).stop 2024-09-12T12:25:59.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.932+0000 7f47dbe4f740 1 -- 172.21.15.33:0/3700900771 shutdown_connections 2024-09-12T12:25:59.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.932+0000 7f47dbe4f740 1 --2- 172.21.15.33:0/3700900771 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x556acab181e0 0x556acab89d40 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.932+0000 7f47dbe4f740 1 --2- 172.21.15.33:0/3700900771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556acab07bb0 0x556acab1f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.932+0000 7f47dbe4f740 1 --2- 172.21.15.33:0/3700900771 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556acaafd2f0 0x556acab22150 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.932+0000 7f47dbe4f740 1 --2- 172.21.15.33:0/3700900771 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556acaafc9d0 0x556acab21c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.932+0000 7f47b2ffd640 0 client.15198 ms_handle_reset on v2:172.21.15.102:6836/2409953270 2024-09-12T12:25:59.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.932+0000 7f47dbe4f740 1 -- 172.21.15.33:0/3700900771 >> 172.21.15.33:0/3700900771 conn(0x556acaaf8f60 msgr2=0x556acab045b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:59.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.932+0000 7f47dbe4f740 1 -- 172.21.15.33:0/3700900771 shutdown_connections 2024-09-12T12:25:59.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.932+0000 7f47dbe4f740 1 -- 172.21.15.33:0/3700900771 wait complete. 2024-09-12T12:25:59.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.932+0000 7f47dbe4f740 20 client.15198 trim_cache size 0 max 16384 2024-09-12T12:25:59.949 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:25:59.949 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "a66dfafc-7100-11ef-bcea-c7b262605968", 2024-09-12T12:25:59.949 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 1, 2024-09-12T12:25:59.949 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 24490, 2024-09-12T12:25:59.949 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-09-12T12:25:59.949 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-09-12T12:25:59.949 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-09-12T12:25:59.949 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 93.162271211000004, 2024-09-12T12:25:59.949 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 24, 2024-09-12T12:25:59.949 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 89, 2024-09-12T12:25:59.949 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 85, 2024-09-12T12:25:59.950 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 157.694185877 2024-09-12T12:25:59.950 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:25:59.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.933+0000 7f47d9a76640 1 -- 172.21.15.33:0/3230050733 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f47bc0a2b80 msgr2=0x7f47bc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:59.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.933+0000 7f47d9a76640 1 --2- 172.21.15.33:0/3230050733 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f47bc0a2b80 0x7f47bc0a5040 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f47cc005fd0 tx=0x7f47cc004a40 comp rx=0 tx=0).stop 2024-09-12T12:25:59.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.933+0000 7f47d9a76640 1 -- 172.21.15.33:0/3230050733 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47d4102790 msgr2=0x7f47d41988b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:59.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.933+0000 7f47d9a76640 1 --2- 172.21.15.33:0/3230050733 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47d4102790 0x7f47d41988b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f47c800c890 tx=0x7f47c800cd50 comp rx=0 tx=0).stop 2024-09-12T12:25:59.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.933+0000 7f47d9a76640 1 -- 172.21.15.33:0/3230050733 shutdown_connections 2024-09-12T12:25:59.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.933+0000 7f47d9a76640 1 --2- 172.21.15.33:0/3230050733 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f47bc0a2b80 0x7f47bc0a5040 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.933+0000 7f47d9a76640 1 --2- 172.21.15.33:0/3230050733 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f47d4106f10 0x7f47d419cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.933+0000 7f47d9a76640 1 --2- 172.21.15.33:0/3230050733 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47d4102790 0x7f47d41988b0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.933+0000 7f47d9a76640 1 --2- 172.21.15.33:0/3230050733 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47d4101de0 0x7f47d4198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.933+0000 7f47d9a76640 1 -- 172.21.15.33:0/3230050733 >> 172.21.15.33:0/3230050733 conn(0x7f47d40fd8c0 msgr2=0x7f47d40feda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:59.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.933+0000 7f47d9a76640 1 -- 172.21.15.33:0/3230050733 shutdown_connections 2024-09-12T12:25:59.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:25:59.933+0000 7f47d9a76640 1 -- 172.21.15.33:0/3230050733 wait complete. 2024-09-12T12:26:00.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:59 smithi043 ceph-mon[34144]: pgmap v347: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-12T12:26:00.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:59 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-12T12:26:00.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:59 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]': finished 2024-09-12T12:26:00.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:59 smithi043 ceph-mon[34144]: osdmap e88: 12 total, 12 up, 12 in 2024-09-12T12:26:00.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:25:59 smithi043 ceph-mon[34144]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-12T12:26:00.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:59 smithi102 ceph-mon[34799]: pgmap v347: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-12T12:26:00.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:59 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-12T12:26:00.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:59 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]': finished 2024-09-12T12:26:00.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:59 smithi102 ceph-mon[34799]: osdmap e88: 12 total, 12 up, 12 in 2024-09-12T12:26:00.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:25:59 smithi102 ceph-mon[34799]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-12T12:26:00.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:59 smithi033 ceph-mon[31246]: pgmap v347: 129 pgs: 129 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-12T12:26:00.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:59 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-12T12:26:00.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:59 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]': finished 2024-09-12T12:26:00.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:59 smithi033 ceph-mon[31246]: osdmap e88: 12 total, 12 up, 12 in 2024-09-12T12:26:00.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:25:59 smithi033 ceph-mon[31246]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-12T12:26:00.762 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-12T12:26:01.025 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:26:01.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:00 smithi043 ceph-mon[34144]: osdmap e89: 12 total, 12 up, 12 in 2024-09-12T12:26:01.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:00 smithi102 ceph-mon[34799]: osdmap e89: 12 total, 12 up, 12 in 2024-09-12T12:26:01.147 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:00 smithi033 ceph-mon[31246]: osdmap e89: 12 total, 12 up, 12 in 2024-09-12T12:26:01.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.547+0000 7f28c13f2640 1 -- 172.21.15.33:0/1623592167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28bc10c170 msgr2=0x7f28bc10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:01.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.547+0000 7f28c13f2640 1 --2- 172.21.15.33:0/1623592167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28bc10c170 0x7f28bc10e610 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f28b4009ca0 tx=0x7f28b402a950 comp rx=0 tx=0).stop 2024-09-12T12:26:01.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.547+0000 7f28c13f2640 1 -- 172.21.15.33:0/1623592167 shutdown_connections 2024-09-12T12:26:01.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.547+0000 7f28c13f2640 1 --2- 172.21.15.33:0/1623592167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28bc10c170 0x7f28bc10e610 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:01.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.547+0000 7f28c13f2640 1 --2- 172.21.15.33:0/1623592167 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28bc103660 0x7f28bc10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:01.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.547+0000 7f28c13f2640 1 --2- 172.21.15.33:0/1623592167 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28bc102d40 0x7f28bc103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:01.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.547+0000 7f28c13f2640 1 -- 172.21.15.33:0/1623592167 >> 172.21.15.33:0/1623592167 conn(0x7f28bc0fc7a0 msgr2=0x7f28bc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:01.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.547+0000 7f28c13f2640 1 -- 172.21.15.33:0/1623592167 shutdown_connections 2024-09-12T12:26:01.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.547+0000 7f28c13f2640 1 -- 172.21.15.33:0/1623592167 wait complete. 2024-09-12T12:26:01.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.547+0000 7f28c13f2640 1 Processor -- start 2024-09-12T12:26:01.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.547+0000 7f28c13f2640 1 -- start start 2024-09-12T12:26:01.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.547+0000 7f28c13f2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28bc102d40 0x7f28bc198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:01.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.547+0000 7f28c13f2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28bc103660 0x7f28bc198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:01.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.547+0000 7f28c13f2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28bc10c170 0x7f28bc19cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:01.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.547+0000 7f28c13f2640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f28bc111e20 con 0x7f28bc103660 2024-09-12T12:26:01.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.548+0000 7f28c13f2640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f28bc111ca0 con 0x7f28bc102d40 2024-09-12T12:26:01.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.548+0000 7f28c13f2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f28bc111fa0 con 0x7f28bc10c170 2024-09-12T12:26:01.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.548+0000 7f28b3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28bc103660 0x7f28bc198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:01.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.548+0000 7f28b3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28bc103660 0x7f28bc198880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60386/0 (socket says 172.21.15.33:60386) 2024-09-12T12:26:01.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.548+0000 7f28b3fff640 1 -- 172.21.15.33:0/1891702645 learned_addr learned my addr 172.21.15.33:0/1891702645 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:01.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.548+0000 7f28baffd640 1 --2- 172.21.15.33:0/1891702645 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28bc102d40 0x7f28bc198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:01.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.548+0000 7f28bb7fe640 1 --2- 172.21.15.33:0/1891702645 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28bc10c170 0x7f28bc19cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:01.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.548+0000 7f28b3fff640 1 -- 172.21.15.33:0/1891702645 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28bc10c170 msgr2=0x7f28bc19cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:01.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.548+0000 7f28b3fff640 1 --2- 172.21.15.33:0/1891702645 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28bc10c170 0x7f28bc19cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:01.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.548+0000 7f28b3fff640 1 -- 172.21.15.33:0/1891702645 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28bc102d40 msgr2=0x7f28bc198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:01.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.548+0000 7f28b3fff640 1 --2- 172.21.15.33:0/1891702645 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28bc102d40 0x7f28bc198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:01.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.548+0000 7f28b3fff640 1 -- 172.21.15.33:0/1891702645 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28bc19d2f0 con 0x7f28bc103660 2024-09-12T12:26:01.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.548+0000 7f28baffd640 1 --2- 172.21.15.33:0/1891702645 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28bc102d40 0x7f28bc198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:01.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.548+0000 7f28bb7fe640 1 --2- 172.21.15.33:0/1891702645 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28bc10c170 0x7f28bc19cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:01.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.548+0000 7f28b3fff640 1 --2- 172.21.15.33:0/1891702645 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28bc103660 0x7f28bc198880 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f28a400d740 tx=0x7f28a400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:01.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.548+0000 7f28b8ff9640 1 -- 172.21.15.33:0/1891702645 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a4017070 con 0x7f28bc103660 2024-09-12T12:26:01.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.548+0000 7f28b8ff9640 1 -- 172.21.15.33:0/1891702645 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f28a400de50 con 0x7f28bc103660 2024-09-12T12:26:01.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.548+0000 7f28c13f2640 1 -- 172.21.15.33:0/1891702645 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28bc19d5e0 con 0x7f28bc103660 2024-09-12T12:26:01.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.548+0000 7f28b8ff9640 1 -- 172.21.15.33:0/1891702645 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a400f620 con 0x7f28bc103660 2024-09-12T12:26:01.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.548+0000 7f28c13f2640 1 -- 172.21.15.33:0/1891702645 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28bc1a4ec0 con 0x7f28bc103660 2024-09-12T12:26:01.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.551+0000 7f28b8ff9640 1 -- 172.21.15.33:0/1891702645 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f28a4009c30 con 0x7f28bc103660 2024-09-12T12:26:01.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.551+0000 7f28b8ff9640 1 --2- 172.21.15.33:0/1891702645 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f28a80a2b80 0x7f28a80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:01.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.551+0000 7f28c37cb740 1 Processor -- start 2024-09-12T12:26:01.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.551+0000 7f28c37cb740 1 -- start start 2024-09-12T12:26:01.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.551+0000 7f28baffd640 1 --2- 172.21.15.33:0/1891702645 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f28a80a2b80 0x7f28a80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:01.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.551+0000 7f28b8ff9640 1 -- 172.21.15.33:0/1891702645 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f28a40cefe0 con 0x7f28bc103660 2024-09-12T12:26:01.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.552+0000 7f28c37cb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa3d8eb9d0 0x55fa3d8ebdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:01.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.552+0000 7f28c37cb740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa3d8ec2f0 0x55fa3d8f6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:01.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.552+0000 7f28c37cb740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa3d8f6bb0 0x55fa3d8f8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:01.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.552+0000 7f28c37cb740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55fa3d852090 con 0x55fa3d8f6bb0 2024-09-12T12:26:01.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.552+0000 7f28c37cb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55fa3d7f9a70 con 0x55fa3d8eb9d0 2024-09-12T12:26:01.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.552+0000 7f28c37cb740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55fa3d84e050 con 0x55fa3d8ec2f0 2024-09-12T12:26:01.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.552+0000 7f28baffd640 1 --2- 172.21.15.33:0/1891702645 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f28a80a2b80 0x7f28a80a5040 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f28ac009c20 tx=0x7f28ac005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:01.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.552+0000 7f28baffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa3d8eb9d0 0x55fa3d8ebdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:01.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.552+0000 7f28baffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa3d8eb9d0 0x55fa3d8ebdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:54368/0 (socket says 172.21.15.33:54368) 2024-09-12T12:26:01.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.552+0000 7f28baffd640 1 -- 172.21.15.33:0/778413519 learned_addr learned my addr 172.21.15.33:0/778413519 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:01.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.552+0000 7f28bb7fe640 1 --2- 172.21.15.33:0/778413519 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa3d8f6bb0 0x55fa3d8f8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:01.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.552+0000 7f28b3fff640 1 --2- 172.21.15.33:0/778413519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa3d8ec2f0 0x55fa3d8f6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:01.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.552+0000 7f28baffd640 1 -- 172.21.15.33:0/778413519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa3d8ec2f0 msgr2=0x55fa3d8f6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:01.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.552+0000 7f28baffd640 1 --2- 172.21.15.33:0/778413519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa3d8ec2f0 0x55fa3d8f6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:01.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.552+0000 7f28baffd640 1 -- 172.21.15.33:0/778413519 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa3d8f6bb0 msgr2=0x55fa3d8f8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:01.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.552+0000 7f28baffd640 1 --2- 172.21.15.33:0/778413519 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa3d8f6bb0 0x55fa3d8f8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:01.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.552+0000 7f28baffd640 1 -- 172.21.15.33:0/778413519 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa3d806130 con 0x55fa3d8eb9d0 2024-09-12T12:26:01.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.552+0000 7f28bb7fe640 1 --2- 172.21.15.33:0/778413519 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa3d8f6bb0 0x55fa3d8f8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:01.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.553+0000 7f28baffd640 1 --2- 172.21.15.33:0/778413519 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa3d8eb9d0 0x55fa3d8ebdb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f28ac012480 tx=0x7f28ac014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d857a4fa62c54e50 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:01.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.553+0000 7f28b17fa640 1 -- 172.21.15.33:0/778413519 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28ac01f620 con 0x55fa3d8eb9d0 2024-09-12T12:26:01.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.553+0000 7f28b17fa640 1 -- 172.21.15.33:0/778413519 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f28ac01fc70 con 0x55fa3d8eb9d0 2024-09-12T12:26:01.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.553+0000 7f28b17fa640 1 -- 172.21.15.33:0/778413519 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28ac01eca0 con 0x55fa3d8eb9d0 2024-09-12T12:26:01.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.553+0000 7f28c37cb740 1 -- 172.21.15.33:0/778413519 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa3d8eb9d0 msgr2=0x55fa3d8ebdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:01.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.553+0000 7f28c37cb740 1 --2- 172.21.15.33:0/778413519 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa3d8eb9d0 0x55fa3d8ebdb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f28ac012480 tx=0x7f28ac014000 comp rx=0 tx=0).stop 2024-09-12T12:26:01.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.554+0000 7f28c37cb740 1 -- 172.21.15.33:0/778413519 shutdown_connections 2024-09-12T12:26:01.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.554+0000 7f28c37cb740 1 --2- 172.21.15.33:0/778413519 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa3d8f6bb0 0x55fa3d8f8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:01.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.554+0000 7f28c37cb740 1 --2- 172.21.15.33:0/778413519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa3d8ec2f0 0x55fa3d8f6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:01.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.554+0000 7f28c37cb740 1 --2- 172.21.15.33:0/778413519 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa3d8eb9d0 0x55fa3d8ebdb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:01.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.554+0000 7f28c37cb740 1 -- 172.21.15.33:0/778413519 >> 172.21.15.33:0/778413519 conn(0x55fa3d8e7f60 msgr2=0x55fa3d8e8340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:01.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.554+0000 7f28c37cb740 1 -- 172.21.15.33:0/778413519 shutdown_connections 2024-09-12T12:26:01.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.554+0000 7f28c37cb740 1 -- 172.21.15.33:0/778413519 wait complete. 2024-09-12T12:26:01.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.554+0000 7f28c37cb740 1 -- start start 2024-09-12T12:26:01.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.554+0000 7f28c37cb740 1 Processor -- start 2024-09-12T12:26:01.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.554+0000 7f28c37cb740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa3d8eb9d0 0x55fa3d8f6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:01.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.554+0000 7f28c37cb740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa3d8ec2f0 0x55fa3d8f3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:01.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.554+0000 7f28c37cb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa3d8f6bb0 0x55fa3d8f3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:01.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.554+0000 7f28c37cb740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55fa3d8f9780 con 0x55fa3d8eb9d0 2024-09-12T12:26:01.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.554+0000 7f28c37cb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55fa3d80cf20 con 0x55fa3d8f6bb0 2024-09-12T12:26:01.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.554+0000 7f28c37cb740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55fa3d8f9900 con 0x55fa3d8ec2f0 2024-09-12T12:26:01.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.554+0000 7f28c37cb740 10 client.0 _ll_register_callbacks cb 0x55fa3d7d6030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:26:01.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.554+0000 7f28baffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa3d8eb9d0 0x55fa3d8f6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:01.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.555+0000 7f28baffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa3d8eb9d0 0x55fa3d8f6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60404/0 (socket says 172.21.15.33:60404) 2024-09-12T12:26:01.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.555+0000 7f28baffd640 1 -- 172.21.15.33:0/3767207563 learned_addr learned my addr 172.21.15.33:0/3767207563 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:01.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.555+0000 7f28b3fff640 1 --2- 172.21.15.33:0/3767207563 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa3d8ec2f0 0x55fa3d8f3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:01.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.555+0000 7f28bb7fe640 1 --2- 172.21.15.33:0/3767207563 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa3d8f6bb0 0x55fa3d8f3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:01.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.555+0000 7f28baffd640 1 -- 172.21.15.33:0/3767207563 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa3d8ec2f0 msgr2=0x55fa3d8f3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:01.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.555+0000 7f28baffd640 1 --2- 172.21.15.33:0/3767207563 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa3d8ec2f0 0x55fa3d8f3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:01.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.555+0000 7f28baffd640 1 -- 172.21.15.33:0/3767207563 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa3d8f6bb0 msgr2=0x55fa3d8f3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:01.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.555+0000 7f28baffd640 1 --2- 172.21.15.33:0/3767207563 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa3d8f6bb0 0x55fa3d8f3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:01.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.555+0000 7f28baffd640 1 -- 172.21.15.33:0/3767207563 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3d5c32b0 con 0x55fa3d8eb9d0 2024-09-12T12:26:01.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.555+0000 7f28bb7fe640 1 --2- 172.21.15.33:0/3767207563 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa3d8f6bb0 0x55fa3d8f3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:26:01.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.555+0000 7f28baffd640 1 --2- 172.21.15.33:0/3767207563 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa3d8eb9d0 0x55fa3d8f6410 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f28ac012450 tx=0x7f28ac0056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6563c9035eef007 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:01.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.555+0000 7f28a27fc640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:26:01.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.555+0000 7f28a27fc640 1 -- 172.21.15.33:0/3767207563 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28ac037060 con 0x55fa3d8eb9d0 2024-09-12T12:26:01.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.555+0000 7f28a27fc640 1 -- 172.21.15.33:0/3767207563 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f28ac01f630 con 0x55fa3d8eb9d0 2024-09-12T12:26:01.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.555+0000 7f28c37cb740 1 -- 172.21.15.33:0/3767207563 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28ac01fc70 con 0x55fa3d8eb9d0 2024-09-12T12:26:01.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.555+0000 7f28a27fc640 1 -- 172.21.15.33:0/3767207563 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f28ac03e050 con 0x55fa3d8eb9d0 2024-09-12T12:26:01.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.555+0000 7f28c37cb740 10 client.15210 fetch_fsmap learned FSMap version 24 2024-09-12T12:26:01.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.555+0000 7f28c37cb740 1 -- 172.21.15.33:0/3767207563 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55fa3d905070 con 0x55fa3d8eb9d0 2024-09-12T12:26:01.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.556+0000 7f28a27fc640 1 -- 172.21.15.33:0/3767207563 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f28ac01fc70 con 0x55fa3d8eb9d0 2024-09-12T12:26:01.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.556+0000 7f28a27fc640 1 -- 172.21.15.33:0/3767207563 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f28ac0278a0 con 0x55fa3d8eb9d0 2024-09-12T12:26:01.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.556+0000 7f28c37cb740 10 client.15210 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T12:26:01.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.556+0000 7f28c37cb740 10 client.15210 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T12:26:01.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.556+0000 7f28c37cb740 20 client.15210 populate_metadata read hostname 'smithi033' 2024-09-12T12:26:01.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.556+0000 7f28c37cb740 1 --2- 172.21.15.33:0/3767207563 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55fa3d907320 0x55fa3d908790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:01.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.556+0000 7f28c37cb740 4 client.15210 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:26:01.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.556+0000 7f28c37cb740 1 -- 172.21.15.33:0/3767207563 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fa3d85f600 con 0x55fa3d907320 2024-09-12T12:26:01.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.556+0000 7f28b3fff640 1 --2- 172.21.15.33:0/3767207563 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55fa3d907320 0x55fa3d908790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:01.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.557+0000 7f28a27fc640 10 client.15210 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:26:01.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.557+0000 7f28b3fff640 1 --2- 172.21.15.33:0/3767207563 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55fa3d907320 0x55fa3d908790 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a09945d6db117e3 server_cookie=c74f0a970f47b194 in_seq=0 out_seq=0 2024-09-12T12:26:01.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.557+0000 7f28a27fc640 1 -- 172.21.15.33:0/3767207563 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fa3d85f600 con 0x55fa3d907320 2024-09-12T12:26:01.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.557+0000 7f28a27fc640 10 client.15210 handle_command_reply: tid=0 2024-09-12T12:26:01.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.557+0000 7f28c37cb740 1 client.15210 shutdown 2024-09-12T12:26:01.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.557+0000 7f28c37cb740 1 -- 172.21.15.33:0/3767207563 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa3d8eb9d0 msgr2=0x55fa3d8f6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:01.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.557+0000 7f28c37cb740 1 --2- 172.21.15.33:0/3767207563 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa3d8eb9d0 0x55fa3d8f6410 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f28ac012450 tx=0x7f28ac0056d0 comp rx=0 tx=0).stop 2024-09-12T12:26:01.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.557+0000 7f28c37cb740 1 -- 172.21.15.33:0/3767207563 shutdown_connections 2024-09-12T12:26:01.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.557+0000 7f28c37cb740 1 --2- 172.21.15.33:0/3767207563 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55fa3d907320 0x55fa3d908790 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:01.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.557+0000 7f28c37cb740 1 --2- 172.21.15.33:0/3767207563 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa3d8f6bb0 0x55fa3d8f3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:01.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.557+0000 7f28c37cb740 1 --2- 172.21.15.33:0/3767207563 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa3d8ec2f0 0x55fa3d8f3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:01.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.557+0000 7f28c37cb740 1 --2- 172.21.15.33:0/3767207563 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa3d8eb9d0 0x55fa3d8f6410 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:01.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.557+0000 7f28a27fc640 0 client.15210 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:26:01.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.557+0000 7f28c37cb740 1 -- 172.21.15.33:0/3767207563 >> 172.21.15.33:0/3767207563 conn(0x55fa3d8e7f60 msgr2=0x55fa3d8edc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:01.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.558+0000 7f28c37cb740 1 -- 172.21.15.33:0/3767207563 shutdown_connections 2024-09-12T12:26:01.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.558+0000 7f28c37cb740 1 -- 172.21.15.33:0/3767207563 wait complete. 2024-09-12T12:26:01.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.558+0000 7f28c37cb740 20 client.15210 trim_cache size 0 max 16384 2024-09-12T12:26:01.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.575+0000 7f28c37cb740 1 Processor -- start 2024-09-12T12:26:01.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.575+0000 7f28c37cb740 1 -- start start 2024-09-12T12:26:01.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.576+0000 7f28c37cb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa3d8eb9d0 0x55fa3d908790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:01.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.576+0000 7f28c37cb740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa3d8ec2f0 0x55fa3d8f3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:01.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.576+0000 7f28c37cb740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa3d8f6bb0 0x55fa3d8f55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:01.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.576+0000 7f28c37cb740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55fa3d906ad0 con 0x55fa3d8f6bb0 2024-09-12T12:26:01.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.576+0000 7f28c37cb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55fa3d9071a0 con 0x55fa3d8eb9d0 2024-09-12T12:26:01.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.576+0000 7f28c37cb740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55fa3d907870 con 0x55fa3d8ec2f0 2024-09-12T12:26:01.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.576+0000 7f28bb7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa3d8f6bb0 0x55fa3d8f55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:01.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.576+0000 7f28bb7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa3d8f6bb0 0x55fa3d8f55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60412/0 (socket says 172.21.15.33:60412) 2024-09-12T12:26:01.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.576+0000 7f28bb7fe640 1 -- 172.21.15.33:0/2993076061 learned_addr learned my addr 172.21.15.33:0/2993076061 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:01.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.576+0000 7f28baffd640 1 --2- 172.21.15.33:0/2993076061 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa3d8eb9d0 0x55fa3d908790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:01.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.576+0000 7f28b3fff640 1 --2- 172.21.15.33:0/2993076061 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa3d8ec2f0 0x55fa3d8f3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:01.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.576+0000 7f28bb7fe640 1 -- 172.21.15.33:0/2993076061 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa3d8ec2f0 msgr2=0x55fa3d8f3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:01.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.576+0000 7f28bb7fe640 1 --2- 172.21.15.33:0/2993076061 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa3d8ec2f0 0x55fa3d8f3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:01.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.576+0000 7f28bb7fe640 1 -- 172.21.15.33:0/2993076061 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa3d8eb9d0 msgr2=0x55fa3d908790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:01.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.576+0000 7f28bb7fe640 1 --2- 172.21.15.33:0/2993076061 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa3d8eb9d0 0x55fa3d908790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:01.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.576+0000 7f28bb7fe640 1 -- 172.21.15.33:0/2993076061 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa3d8ec940 con 0x55fa3d8f6bb0 2024-09-12T12:26:01.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.576+0000 7f28b3fff640 1 --2- 172.21.15.33:0/2993076061 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa3d8ec2f0 0x55fa3d8f3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:26:01.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.577+0000 7f28bb7fe640 1 --2- 172.21.15.33:0/2993076061 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa3d8f6bb0 0x55fa3d8f55c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f28b4009ca0 tx=0x7f28b402fdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61748dabd0316248 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:01.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.577+0000 7f28b0ff9640 1 -- 172.21.15.33:0/2993076061 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b4034040 con 0x55fa3d8f6bb0 2024-09-12T12:26:01.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.577+0000 7f28b0ff9640 1 -- 172.21.15.33:0/2993076061 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f28b4003e20 con 0x55fa3d8f6bb0 2024-09-12T12:26:01.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.577+0000 7f28b0ff9640 1 -- 172.21.15.33:0/2993076061 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b40042a0 con 0x55fa3d8f6bb0 2024-09-12T12:26:01.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.577+0000 7f28c37cb740 1 -- 172.21.15.33:0/2993076061 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa3d8f6bb0 msgr2=0x55fa3d8f55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:01.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.577+0000 7f28c37cb740 1 --2- 172.21.15.33:0/2993076061 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa3d8f6bb0 0x55fa3d8f55c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f28b4009ca0 tx=0x7f28b402fdf0 comp rx=0 tx=0).stop 2024-09-12T12:26:01.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.578+0000 7f28c37cb740 1 -- 172.21.15.33:0/2993076061 shutdown_connections 2024-09-12T12:26:01.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.578+0000 7f28c37cb740 1 --2- 172.21.15.33:0/2993076061 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa3d8f6bb0 0x55fa3d8f55c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:01.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.578+0000 7f28c37cb740 1 --2- 172.21.15.33:0/2993076061 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa3d8ec2f0 0x55fa3d8f3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:01.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.578+0000 7f28c37cb740 1 --2- 172.21.15.33:0/2993076061 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa3d8eb9d0 0x55fa3d908790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:01.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.578+0000 7f28c37cb740 1 -- 172.21.15.33:0/2993076061 >> 172.21.15.33:0/2993076061 conn(0x55fa3d8e7f60 msgr2=0x55fa3d8f4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:01.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.578+0000 7f28c37cb740 1 -- 172.21.15.33:0/2993076061 shutdown_connections 2024-09-12T12:26:01.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.578+0000 7f28c37cb740 1 -- 172.21.15.33:0/2993076061 wait complete. 2024-09-12T12:26:01.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.578+0000 7f28c37cb740 1 -- start start 2024-09-12T12:26:01.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.578+0000 7f28c37cb740 1 Processor -- start 2024-09-12T12:26:01.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.578+0000 7f28c37cb740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa3d8eb9d0 0x55fa3d969bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:01.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.578+0000 7f28c37cb740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa3d8ec2f0 0x55fa3d96a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:01.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.578+0000 7f28c37cb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa3d8f6bb0 0x55fa3d9106e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:01.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.578+0000 7f28c37cb740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55fa3d908610 con 0x55fa3d8eb9d0 2024-09-12T12:26:01.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.578+0000 7f28c37cb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55fa3d907f40 con 0x55fa3d8f6bb0 2024-09-12T12:26:01.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.578+0000 7f28c37cb740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55fa3d908ce0 con 0x55fa3d8ec2f0 2024-09-12T12:26:01.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.578+0000 7f28c37cb740 10 client.0 _ll_register_callbacks cb 0x7f28ac005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:26:01.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.578+0000 7f28baffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa3d8eb9d0 0x55fa3d969bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:01.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.578+0000 7f28baffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa3d8eb9d0 0x55fa3d969bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60426/0 (socket says 172.21.15.33:60426) 2024-09-12T12:26:01.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.578+0000 7f28baffd640 1 -- 172.21.15.33:0/4133317540 learned_addr learned my addr 172.21.15.33:0/4133317540 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:01.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.579+0000 7f28b3fff640 1 --2- 172.21.15.33:0/4133317540 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa3d8ec2f0 0x55fa3d96a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:01.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.579+0000 7f28bb7fe640 1 --2- 172.21.15.33:0/4133317540 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa3d8f6bb0 0x55fa3d9106e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:01.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.579+0000 7f28baffd640 1 -- 172.21.15.33:0/4133317540 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa3d8ec2f0 msgr2=0x55fa3d96a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:01.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.579+0000 7f28baffd640 1 --2- 172.21.15.33:0/4133317540 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa3d8ec2f0 0x55fa3d96a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:01.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.579+0000 7f28baffd640 1 -- 172.21.15.33:0/4133317540 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa3d8f6bb0 msgr2=0x55fa3d9106e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:01.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.579+0000 7f28baffd640 1 --2- 172.21.15.33:0/4133317540 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa3d8f6bb0 0x55fa3d9106e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:01.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.579+0000 7f28baffd640 1 -- 172.21.15.33:0/4133317540 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3d910dd0 con 0x55fa3d8eb9d0 2024-09-12T12:26:01.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.579+0000 7f28bb7fe640 1 --2- 172.21.15.33:0/4133317540 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa3d8f6bb0 0x55fa3d9106e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:26:01.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.579+0000 7f28baffd640 1 --2- 172.21.15.33:0/4133317540 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa3d8eb9d0 0x55fa3d969bd0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f28ac009800 tx=0x7f28ac005ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=275718f8f0f54ea1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:01.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.579+0000 7f28a27fc640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:26:01.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.579+0000 7f28a27fc640 1 -- 172.21.15.33:0/4133317540 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28ac01ee50 con 0x55fa3d8eb9d0 2024-09-12T12:26:01.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.579+0000 7f28c37cb740 1 -- 172.21.15.33:0/4133317540 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28b4003e20 con 0x55fa3d8eb9d0 2024-09-12T12:26:01.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.579+0000 7f28a27fc640 1 -- 172.21.15.33:0/4133317540 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f28ac01e7d0 con 0x55fa3d8eb9d0 2024-09-12T12:26:01.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.579+0000 7f28a27fc640 1 -- 172.21.15.33:0/4133317540 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f28ac04b050 con 0x55fa3d8eb9d0 2024-09-12T12:26:01.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.579+0000 7f28c37cb740 10 client.15216 fetch_fsmap learned FSMap version 24 2024-09-12T12:26:01.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.579+0000 7f28c37cb740 1 -- 172.21.15.33:0/4133317540 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55fa3d9713f0 con 0x55fa3d8eb9d0 2024-09-12T12:26:01.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.580+0000 7f28a27fc640 1 -- 172.21.15.33:0/4133317540 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f28b4003e20 con 0x55fa3d8eb9d0 2024-09-12T12:26:01.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.580+0000 7f28a27fc640 1 -- 172.21.15.33:0/4133317540 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f28ac01f910 con 0x55fa3d8eb9d0 2024-09-12T12:26:01.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.580+0000 7f28c37cb740 10 client.15216 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T12:26:01.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.580+0000 7f28c37cb740 10 client.15216 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T12:26:01.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.580+0000 7f28c37cb740 20 client.15216 populate_metadata read hostname 'smithi033' 2024-09-12T12:26:01.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.580+0000 7f28c37cb740 1 --2- 172.21.15.33:0/4133317540 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55fa3d975f90 0x55fa3d974ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:01.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.580+0000 7f28c37cb740 4 client.15216 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:26:01.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.580+0000 7f28c37cb740 1 -- 172.21.15.33:0/4133317540 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "status"}) -- 0x55fa3d859b10 con 0x55fa3d975f90 2024-09-12T12:26:01.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.580+0000 7f28b3fff640 1 --2- 172.21.15.33:0/4133317540 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55fa3d975f90 0x55fa3d974ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:01.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.580+0000 7f28a27fc640 10 client.15216 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:26:01.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.580+0000 7f28b3fff640 1 --2- 172.21.15.33:0/4133317540 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55fa3d975f90 0x55fa3d974ca0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=897b8a1a7563d3ba server_cookie=393e1655d16134e0 in_seq=0 out_seq=0 2024-09-12T12:26:01.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.581+0000 7f28a27fc640 1 -- 172.21.15.33:0/4133317540 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55fa3d859b10 con 0x55fa3d975f90 2024-09-12T12:26:01.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.581+0000 7f28a27fc640 10 client.15216 handle_command_reply: tid=0 2024-09-12T12:26:01.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.581+0000 7f28c37cb740 1 client.15216 shutdown 2024-09-12T12:26:01.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.581+0000 7f28c37cb740 1 -- 172.21.15.33:0/4133317540 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa3d8eb9d0 msgr2=0x55fa3d969bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:01.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.581+0000 7f28c37cb740 1 --2- 172.21.15.33:0/4133317540 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa3d8eb9d0 0x55fa3d969bd0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f28ac009800 tx=0x7f28ac005ae0 comp rx=0 tx=0).stop 2024-09-12T12:26:01.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.581+0000 7f28c37cb740 1 -- 172.21.15.33:0/4133317540 shutdown_connections 2024-09-12T12:26:01.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.581+0000 7f28c37cb740 1 --2- 172.21.15.33:0/4133317540 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55fa3d975f90 0x55fa3d974ca0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:01.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.581+0000 7f28c37cb740 1 --2- 172.21.15.33:0/4133317540 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa3d8f6bb0 0x55fa3d9106e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:01.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.581+0000 7f28c37cb740 1 --2- 172.21.15.33:0/4133317540 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa3d8ec2f0 0x55fa3d96a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:01.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.581+0000 7f28c37cb740 1 --2- 172.21.15.33:0/4133317540 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa3d8eb9d0 0x55fa3d969bd0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:01.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.581+0000 7f28c37cb740 1 -- 172.21.15.33:0/4133317540 >> 172.21.15.33:0/4133317540 conn(0x55fa3d8e7f60 msgr2=0x55fa3d8e6de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:01.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.581+0000 7f28a27fc640 0 client.15216 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:26:01.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.581+0000 7f28c37cb740 1 -- 172.21.15.33:0/4133317540 shutdown_connections 2024-09-12T12:26:01.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.581+0000 7f28c37cb740 1 -- 172.21.15.33:0/4133317540 wait complete. 2024-09-12T12:26:01.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.581+0000 7f28c37cb740 20 client.15216 trim_cache size 0 max 16384 2024-09-12T12:26:01.588 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:26:01.589 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "a66dfafc-7100-11ef-bcea-c7b262605968", 2024-09-12T12:26:01.589 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 0, 2024-09-12T12:26:01.589 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 24499, 2024-09-12T12:26:01.589 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-09-12T12:26:01.589 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-09-12T12:26:01.589 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-09-12T12:26:01.589 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 134.71258405899999, 2024-09-12T12:26:01.589 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 24, 2024-09-12T12:26:01.589 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 89, 2024-09-12T12:26:01.589 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 85, 2024-09-12T12:26:01.589 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 154.036056616 2024-09-12T12:26:01.589 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:26:01.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.582+0000 7f28c13f2640 1 -- 172.21.15.33:0/1891702645 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f28a80a2b80 msgr2=0x7f28a80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:01.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.582+0000 7f28c13f2640 1 --2- 172.21.15.33:0/1891702645 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f28a80a2b80 0x7f28a80a5040 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f28ac009c20 tx=0x7f28ac005f90 comp rx=0 tx=0).stop 2024-09-12T12:26:01.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.582+0000 7f28c13f2640 1 -- 172.21.15.33:0/1891702645 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28bc103660 msgr2=0x7f28bc198880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:01.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.582+0000 7f28c13f2640 1 --2- 172.21.15.33:0/1891702645 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28bc103660 0x7f28bc198880 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f28a400d740 tx=0x7f28a400dc00 comp rx=0 tx=0).stop 2024-09-12T12:26:01.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.582+0000 7f28c13f2640 1 -- 172.21.15.33:0/1891702645 shutdown_connections 2024-09-12T12:26:01.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.582+0000 7f28c13f2640 1 --2- 172.21.15.33:0/1891702645 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f28a80a2b80 0x7f28a80a5040 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:01.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.582+0000 7f28c13f2640 1 --2- 172.21.15.33:0/1891702645 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28bc10c170 0x7f28bc19cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:01.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.582+0000 7f28c13f2640 1 --2- 172.21.15.33:0/1891702645 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28bc103660 0x7f28bc198880 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:01.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.582+0000 7f28c13f2640 1 --2- 172.21.15.33:0/1891702645 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28bc102d40 0x7f28bc198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:01.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.582+0000 7f28c13f2640 1 -- 172.21.15.33:0/1891702645 >> 172.21.15.33:0/1891702645 conn(0x7f28bc0fc7a0 msgr2=0x7f28bc0fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:01.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.582+0000 7f28c13f2640 1 -- 172.21.15.33:0/1891702645 shutdown_connections 2024-09-12T12:26:01.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:01.582+0000 7f28c13f2640 1 -- 172.21.15.33:0/1891702645 wait complete. 2024-09-12T12:26:02.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:01 smithi043 ceph-mon[34144]: pgmap v350: 129 pgs: 129 active+clean; 644 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-12T12:26:02.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:01 smithi102 ceph-mon[34799]: pgmap v350: 129 pgs: 129 active+clean; 644 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-12T12:26:02.201 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:01 smithi033 ceph-mon[31246]: pgmap v350: 129 pgs: 129 active+clean; 644 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-12T12:26:02.228 INFO:teuthology.run_tasks:Running task sequential... 2024-09-12T12:26:02.238 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-12T12:26:02.238 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-12T12:26:02.239 INFO:teuthology.task.print:Enabling mgr modules 2024-09-12T12:26:02.239 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-12T12:26:02.248 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-12T12:26:02.248 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-09-12T12:26:02.248 INFO:tasks.ceph_fuse:client.0 config is {'mount_subvol_num': 0} 2024-09-12T12:26:02.248 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T12:26:02.248 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T12:26:02.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:26:02.249 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-09-12T12:26:02.265 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-12T12:26:02.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:26:02.266 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T12:26:02.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:26:02.333 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link delete ceph-brx 2024-09-12T12:26:02.434 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-12T12:26:02.434 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-12T12:26:02.435 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-12T12:26:02.693 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:26:03.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.190+0000 7fd7a7f7d640 1 -- 172.21.15.33:0/3676077498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7a01027a0 msgr2=0x7fd7a01067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:03.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.190+0000 7fd7a7f7d640 1 --2- 172.21.15.33:0/3676077498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7a01027a0 0x7fd7a01067f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd794009900 tx=0x7fd79402a410 comp rx=0 tx=0).stop 2024-09-12T12:26:03.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.190+0000 7fd7a7f7d640 1 -- 172.21.15.33:0/3676077498 shutdown_connections 2024-09-12T12:26:03.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.190+0000 7fd7a7f7d640 1 --2- 172.21.15.33:0/3676077498 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7a0106f20 0x7fd7a010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:03.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.190+0000 7fd7a7f7d640 1 --2- 172.21.15.33:0/3676077498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7a01027a0 0x7fd7a01067f0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:03.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.190+0000 7fd7a7f7d640 1 --2- 172.21.15.33:0/3676077498 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd7a0101df0 0x7fd7a01021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:03.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.190+0000 7fd7a7f7d640 1 -- 172.21.15.33:0/3676077498 >> 172.21.15.33:0/3676077498 conn(0x7fd7a00fd8f0 msgr2=0x7fd7a00ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:03.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.190+0000 7fd7a7f7d640 1 -- 172.21.15.33:0/3676077498 shutdown_connections 2024-09-12T12:26:03.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.190+0000 7fd7a7f7d640 1 -- 172.21.15.33:0/3676077498 wait complete. 2024-09-12T12:26:03.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.191+0000 7fd7a7f7d640 1 Processor -- start 2024-09-12T12:26:03.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.191+0000 7fd7a7f7d640 1 -- start start 2024-09-12T12:26:03.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.191+0000 7fd7a7f7d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd7a0101df0 0x7fd7a00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:03.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.191+0000 7fd7a7f7d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7a01027a0 0x7fd7a0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:03.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.191+0000 7fd7a7f7d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7a0106f20 0x7fd7a0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:03.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.191+0000 7fd7a7f7d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a0111e30 con 0x7fd7a0106f20 2024-09-12T12:26:03.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.191+0000 7fd7a7f7d640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a0111cb0 con 0x7fd7a01027a0 2024-09-12T12:26:03.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.191+0000 7fd7a7f7d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a0111fb0 con 0x7fd7a0101df0 2024-09-12T12:26:03.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.191+0000 7fd7a651a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7a0106f20 0x7fd7a0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:03.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.191+0000 7fd7a651a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7a0106f20 0x7fd7a0074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60440/0 (socket says 172.21.15.33:60440) 2024-09-12T12:26:03.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.191+0000 7fd7a651a640 1 -- 172.21.15.33:0/3273188802 learned_addr learned my addr 172.21.15.33:0/3273188802 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:03.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.191+0000 7fd7a5518640 1 --2- 172.21.15.33:0/3273188802 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7a01027a0 0x7fd7a0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:03.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.191+0000 7fd7a5d19640 1 --2- 172.21.15.33:0/3273188802 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd7a0101df0 0x7fd7a00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:03.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.191+0000 7fd7a651a640 1 -- 172.21.15.33:0/3273188802 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd7a0101df0 msgr2=0x7fd7a00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:03.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.191+0000 7fd7a651a640 1 --2- 172.21.15.33:0/3273188802 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd7a0101df0 0x7fd7a00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:03.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.191+0000 7fd7a651a640 1 -- 172.21.15.33:0/3273188802 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7a01027a0 msgr2=0x7fd7a0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:03.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.191+0000 7fd7a651a640 1 --2- 172.21.15.33:0/3273188802 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7a01027a0 0x7fd7a0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:03.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.191+0000 7fd7a651a640 1 -- 172.21.15.33:0/3273188802 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7a01a6850 con 0x7fd7a0106f20 2024-09-12T12:26:03.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.192+0000 7fd7a5d19640 1 --2- 172.21.15.33:0/3273188802 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd7a0101df0 0x7fd7a00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:03.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.192+0000 7fd7a651a640 1 --2- 172.21.15.33:0/3273188802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7a0106f20 0x7fd7a0074f70 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd79800cad0 tx=0x7fd79800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:03.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.192+0000 7fd792ffd640 1 -- 172.21.15.33:0/3273188802 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79800ae20 con 0x7fd7a0106f20 2024-09-12T12:26:03.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.192+0000 7fd792ffd640 1 -- 172.21.15.33:0/3273188802 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd798005020 con 0x7fd7a0106f20 2024-09-12T12:26:03.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.192+0000 7fd7a7f7d640 1 -- 172.21.15.33:0/3273188802 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7a01a6b40 con 0x7fd7a0106f20 2024-09-12T12:26:03.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.192+0000 7fd792ffd640 1 -- 172.21.15.33:0/3273188802 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79800f6b0 con 0x7fd7a0106f20 2024-09-12T12:26:03.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.192+0000 7fd7a7f7d640 1 -- 172.21.15.33:0/3273188802 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7a01a7000 con 0x7fd7a0106f20 2024-09-12T12:26:03.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.193+0000 7fd7a7f7d640 1 -- 172.21.15.33:0/3273188802 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7a01021d0 con 0x7fd7a0106f20 2024-09-12T12:26:03.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.194+0000 7fd792ffd640 1 -- 172.21.15.33:0/3273188802 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd7980051d0 con 0x7fd7a0106f20 2024-09-12T12:26:03.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.195+0000 7fd792ffd640 1 --2- 172.21.15.33:0/3273188802 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd78c0a2b80 0x7fd78c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:03.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.195+0000 7fd7a5d19640 1 --2- 172.21.15.33:0/3273188802 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd78c0a2b80 0x7fd78c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:03.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.195+0000 7fd792ffd640 1 -- 172.21.15.33:0/3273188802 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fd7980cf3c0 con 0x7fd7a0106f20 2024-09-12T12:26:03.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.195+0000 7fd7a5d19640 1 --2- 172.21.15.33:0/3273188802 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd78c0a2b80 0x7fd78c0a5040 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd79c009c20 tx=0x7fd79c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:03.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.199+0000 7fd792ffd640 1 -- 172.21.15.33:0/3273188802 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd798014030 con 0x7fd7a0106f20 2024-09-12T12:26:03.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.411+0000 7fd7a7f7d640 1 -- 172.21.15.33:0/3273188802 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd7a010a160 con 0x7fd7a0106f20 2024-09-12T12:26:03.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.411+0000 7fd792ffd640 1 -- 172.21.15.33:0/3273188802 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) ==== 53+0+88 (secure 0 0 0) 0x7fd798084e20 con 0x7fd7a0106f20 2024-09-12T12:26:03.411 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-12T12:26:03.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.413+0000 7fd7a7f7d640 1 -- 172.21.15.33:0/3273188802 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd78c0a2b80 msgr2=0x7fd78c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:03.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.413+0000 7fd7a7f7d640 1 --2- 172.21.15.33:0/3273188802 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd78c0a2b80 0x7fd78c0a5040 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd79c009c20 tx=0x7fd79c005f90 comp rx=0 tx=0).stop 2024-09-12T12:26:03.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.413+0000 7fd7a7f7d640 1 -- 172.21.15.33:0/3273188802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7a0106f20 msgr2=0x7fd7a0074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:03.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.413+0000 7fd7a7f7d640 1 --2- 172.21.15.33:0/3273188802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7a0106f20 0x7fd7a0074f70 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd79800cad0 tx=0x7fd79800cf90 comp rx=0 tx=0).stop 2024-09-12T12:26:03.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.413+0000 7fd7a7f7d640 1 -- 172.21.15.33:0/3273188802 shutdown_connections 2024-09-12T12:26:03.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.413+0000 7fd7a7f7d640 1 --2- 172.21.15.33:0/3273188802 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd78c0a2b80 0x7fd78c0a5040 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:03.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.413+0000 7fd7a7f7d640 1 --2- 172.21.15.33:0/3273188802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7a0106f20 0x7fd7a0074f70 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:03.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.413+0000 7fd7a7f7d640 1 --2- 172.21.15.33:0/3273188802 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7a01027a0 0x7fd7a0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:03.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.413+0000 7fd7a7f7d640 1 --2- 172.21.15.33:0/3273188802 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd7a0101df0 0x7fd7a00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:03.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.414+0000 7fd7a7f7d640 1 -- 172.21.15.33:0/3273188802 >> 172.21.15.33:0/3273188802 conn(0x7fd7a00fd8f0 msgr2=0x7fd7a00fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:03.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.414+0000 7fd7a7f7d640 1 -- 172.21.15.33:0/3273188802 shutdown_connections 2024-09-12T12:26:03.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:03.414+0000 7fd7a7f7d640 1 -- 172.21.15.33:0/3273188802 wait complete. 2024-09-12T12:26:04.112 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:03 smithi033 ceph-mon[31246]: pgmap v351: 129 pgs: 129 active+clean; 644 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-12T12:26:04.112 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:03 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/3273188802' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T12:26:04.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:03 smithi043 ceph-mon[34144]: pgmap v351: 129 pgs: 129 active+clean; 644 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-12T12:26:04.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:03 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/3273188802' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T12:26:04.144 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T12:26:04.144 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T12:26:04.144 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi033.front.sepia.ceph.com 2024-09-12T12:26:04.144 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T12:26:04.144 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T12:26:04.144 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T12:26:04.144 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T12:26:04.144 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T12:26:04.144 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:26:04.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:26:04.145 DEBUG:teuthology.orchestra.run.smithi033:> ip addr 2024-09-12T12:26:04.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:03 smithi102 ceph-mon[34799]: pgmap v351: 129 pgs: 129 active+clean; 644 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-12T12:26:04.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:03 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/3273188802' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T12:26:04.163 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T12:26:04.163 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T12:26:04.163 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T12:26:04.163 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:26:04.163 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2024-09-12T12:26:04.163 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:26:04.164 INFO:teuthology.orchestra.run.smithi033.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T12:26:04.164 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:14 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:26:04.164 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f0 2024-09-12T12:26:04.164 INFO:teuthology.orchestra.run.smithi033.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T12:26:04.164 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:15 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:26:04.164 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f1 2024-09-12T12:26:04.164 INFO:teuthology.orchestra.run.smithi033.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T12:26:04.164 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:94 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:26:04.164 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f0 2024-09-12T12:26:04.165 INFO:teuthology.orchestra.run.smithi033.stdout: inet 172.21.15.33/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T12:26:04.165 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft 42145sec preferred_lft 42145sec 2024-09-12T12:26:04.165 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::ae1f:6bff:fea5:d294/64 scope link 2024-09-12T12:26:04.165 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:26:04.165 INFO:teuthology.orchestra.run.smithi033.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T12:26:04.165 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:95 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:26:04.165 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f1 2024-09-12T12:26:04.165 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T12:26:04.166 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:26:04.166 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-09-12T12:26:04.166 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link add name ceph-brx type bridge 2024-09-12T12:26:04.166 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip addr flush dev ceph-brx 2024-09-12T12:26:04.166 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set ceph-brx up 2024-09-12T12:26:04.166 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T12:26:04.166 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-09-12T12:26:04.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:26:04.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:26:04.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:26:04.311 DEBUG:teuthology.orchestra.run.smithi033:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T12:26:04.335 INFO:teuthology.orchestra.run.smithi033.stdout:1 2024-09-12T12:26:04.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:26:04.337 DEBUG:teuthology.orchestra.run.smithi033:> route 2024-09-12T12:26:04.395 INFO:teuthology.orchestra.run.smithi033.stdout:Kernel IP routing table 2024-09-12T12:26:04.395 INFO:teuthology.orchestra.run.smithi033.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T12:26:04.395 INFO:teuthology.orchestra.run.smithi033.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T12:26:04.395 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T12:26:04.395 INFO:teuthology.orchestra.run.smithi033.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T12:26:04.396 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:26:04.396 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-09-12T12:26:04.396 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T12:26:04.396 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T12:26:04.396 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T12:26:04.396 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-09-12T12:26:04.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:26:04.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:26:04.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:26:04.526 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-09-12T12:26:04.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:26:04.542 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list-id 2024-09-12T12:26:04.599 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:26:04.599 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-09-12T12:26:04.599 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T12:26:04.599 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-12T12:26:04.599 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-09-12T12:26:04.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:26:04.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:26:04.718 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-12T12:26:04.718 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:26:04.718 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-09-12T12:26:04.719 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-12T12:26:04.719 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T12:26:04.719 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-12T12:26:04.719 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-12T12:26:04.719 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-12T12:26:04.719 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-09-12T12:26:04.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:26:04.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:26:04.837 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:26:04.837 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-09-12T12:26:04.837 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set brx.0 up 2024-09-12T12:26:04.838 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T12:26:04.838 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-09-12T12:26:04.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:26:04.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:26:04.923 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mount_subvol_num': 0} 2024-09-12T12:26:04.923 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:26:04.923 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T12:26:04.939 INFO:teuthology.orchestra.run.smithi033.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:26:04.939 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:26:04.939 DEBUG:teuthology.orchestra.run.smithi033:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T12:26:04.995 DEBUG:teuthology.orchestra.run.smithi033:> sudo modprobe fuse 2024-09-12T12:26:05.058 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:04 smithi033 ceph-mon[31246]: pgmap v352: 129 pgs: 129 active+clean; 644 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 639 B/s wr, 8 op/s 2024-09-12T12:26:05.063 DEBUG:teuthology.orchestra.run.smithi033:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T12:26:05.119 INFO:teuthology.orchestra.run.smithi033.stdout:/proc 2024-09-12T12:26:05.119 INFO:teuthology.orchestra.run.smithi033.stdout:/sys 2024-09-12T12:26:05.119 INFO:teuthology.orchestra.run.smithi033.stdout:/dev 2024-09-12T12:26:05.120 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/kernel/security 2024-09-12T12:26:05.120 INFO:teuthology.orchestra.run.smithi033.stdout:/dev/shm 2024-09-12T12:26:05.120 INFO:teuthology.orchestra.run.smithi033.stdout:/dev/pts 2024-09-12T12:26:05.120 INFO:teuthology.orchestra.run.smithi033.stdout:/run 2024-09-12T12:26:05.120 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/cgroup 2024-09-12T12:26:05.120 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/pstore 2024-09-12T12:26:05.120 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/bpf 2024-09-12T12:26:05.120 INFO:teuthology.orchestra.run.smithi033.stdout:/ 2024-09-12T12:26:05.120 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/selinux 2024-09-12T12:26:05.120 INFO:teuthology.orchestra.run.smithi033.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T12:26:05.120 INFO:teuthology.orchestra.run.smithi033.stdout:/dev/hugepages 2024-09-12T12:26:05.120 INFO:teuthology.orchestra.run.smithi033.stdout:/dev/mqueue 2024-09-12T12:26:05.121 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/kernel/debug 2024-09-12T12:26:05.121 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/kernel/tracing 2024-09-12T12:26:05.121 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/fuse/connections 2024-09-12T12:26:05.121 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/kernel/config 2024-09-12T12:26:05.121 INFO:teuthology.orchestra.run.smithi033.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T12:26:05.121 INFO:teuthology.orchestra.run.smithi033.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T12:26:05.121 INFO:teuthology.orchestra.run.smithi033.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T12:26:05.121 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T12:26:05.121 INFO:teuthology.orchestra.run.smithi033.stdout:/run/user/1000 2024-09-12T12:26:05.121 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/ceph 2024-09-12T12:26:05.121 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay 2024-09-12T12:26:05.121 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/ee80439439c45bbd70e749e4424b97d228d5f9ba418e775fd242ab76c07ed138/merged 2024-09-12T12:26:05.121 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/c170c298076ba730b646470b0bb4b7812a553d4de051ad1daa5b0a7c258babde/merged 2024-09-12T12:26:05.121 INFO:teuthology.orchestra.run.smithi033.stdout:/run/user/0 2024-09-12T12:26:05.122 INFO:teuthology.orchestra.run.smithi033.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T12:26:05.122 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/b6ef5035f596b267e1c999884681c274b78fddc18c5aecd5ef29a0df83d12fc8/merged 2024-09-12T12:26:05.122 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/5a9adec0f3f3fe749f2411e749d1db42e4a43b300f7194edf1d66e5d0f7ba96f/merged 2024-09-12T12:26:05.122 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/d70cc9fb7e4bdf2458cbdefb633790a65e2fc3af271a9627052c29331d178435/merged 2024-09-12T12:26:05.122 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/f90205c1b6494802b97699d2aa2ba541c2f5f2e2aabf2a13b290527d992c03d0/merged 2024-09-12T12:26:05.122 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/bca91607499a3ef272b96cf28b398108702c8a738e4f632b88fd8d254186e81b/merged 2024-09-12T12:26:05.122 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/f1728d7a2e3ac8941a5bee48837c10fc1b359af4fa976d312dc5af85c36d60a8/merged 2024-09-12T12:26:05.122 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/f273e778d1fd2f3896ff716f2bf13da7d1f3a1c2f704dbe81c85e2da288c47ce/merged 2024-09-12T12:26:05.122 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/bc89fe647ab425f8afc56013ef9dbc384eff5ecc2ceacc679d9562df82bd4b6f/merged 2024-09-12T12:26:05.122 INFO:teuthology.orchestra.run.smithi033.stdout:/run/netns 2024-09-12T12:26:05.122 INFO:teuthology.orchestra.run.smithi033.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T12:26:05.122 INFO:teuthology.orchestra.run.smithi033.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T12:26:05.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:26:05.123 DEBUG:teuthology.orchestra.run.smithi033:> ls /sys/fs/fuse/connections 2024-09-12T12:26:05.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:04 smithi102 ceph-mon[34799]: pgmap v352: 129 pgs: 129 active+clean; 644 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 639 B/s wr, 8 op/s 2024-09-12T12:26:05.175 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-12T12:26:05.175 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/volumes/qa/sv_0/8c00d832-14fd-4a19-874b-c5c3dfe6ba93 --client_fs=cephfs) 2024-09-12T12:26:05.218 DEBUG:teuthology.orchestra.run.smithi033:> sudo modprobe fuse 2024-09-12T12:26:05.245 DEBUG:teuthology.orchestra.run.smithi033:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T12:26:05.302 INFO:teuthology.orchestra.run.smithi033.stdout:/proc 2024-09-12T12:26:05.302 INFO:teuthology.orchestra.run.smithi033.stdout:/sys 2024-09-12T12:26:05.302 INFO:teuthology.orchestra.run.smithi033.stdout:/dev 2024-09-12T12:26:05.302 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/kernel/security 2024-09-12T12:26:05.302 INFO:teuthology.orchestra.run.smithi033.stdout:/dev/shm 2024-09-12T12:26:05.302 INFO:teuthology.orchestra.run.smithi033.stdout:/dev/pts 2024-09-12T12:26:05.303 INFO:teuthology.orchestra.run.smithi033.stdout:/run 2024-09-12T12:26:05.303 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/cgroup 2024-09-12T12:26:05.303 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/pstore 2024-09-12T12:26:05.303 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/bpf 2024-09-12T12:26:05.303 INFO:teuthology.orchestra.run.smithi033.stdout:/ 2024-09-12T12:26:05.303 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/selinux 2024-09-12T12:26:05.303 INFO:teuthology.orchestra.run.smithi033.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T12:26:05.303 INFO:teuthology.orchestra.run.smithi033.stdout:/dev/hugepages 2024-09-12T12:26:05.303 INFO:teuthology.orchestra.run.smithi033.stdout:/dev/mqueue 2024-09-12T12:26:05.303 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/kernel/debug 2024-09-12T12:26:05.303 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/kernel/tracing 2024-09-12T12:26:05.303 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/fuse/connections 2024-09-12T12:26:05.304 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/kernel/config 2024-09-12T12:26:05.304 INFO:teuthology.orchestra.run.smithi033.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T12:26:05.304 INFO:teuthology.orchestra.run.smithi033.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T12:26:05.304 INFO:teuthology.orchestra.run.smithi033.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T12:26:05.304 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T12:26:05.304 INFO:teuthology.orchestra.run.smithi033.stdout:/run/user/1000 2024-09-12T12:26:05.304 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/ceph 2024-09-12T12:26:05.304 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay 2024-09-12T12:26:05.304 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/ee80439439c45bbd70e749e4424b97d228d5f9ba418e775fd242ab76c07ed138/merged 2024-09-12T12:26:05.304 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/c170c298076ba730b646470b0bb4b7812a553d4de051ad1daa5b0a7c258babde/merged 2024-09-12T12:26:05.304 INFO:teuthology.orchestra.run.smithi033.stdout:/run/user/0 2024-09-12T12:26:05.304 INFO:teuthology.orchestra.run.smithi033.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T12:26:05.304 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/b6ef5035f596b267e1c999884681c274b78fddc18c5aecd5ef29a0df83d12fc8/merged 2024-09-12T12:26:05.305 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/5a9adec0f3f3fe749f2411e749d1db42e4a43b300f7194edf1d66e5d0f7ba96f/merged 2024-09-12T12:26:05.305 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/d70cc9fb7e4bdf2458cbdefb633790a65e2fc3af271a9627052c29331d178435/merged 2024-09-12T12:26:05.305 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/f90205c1b6494802b97699d2aa2ba541c2f5f2e2aabf2a13b290527d992c03d0/merged 2024-09-12T12:26:05.305 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/bca91607499a3ef272b96cf28b398108702c8a738e4f632b88fd8d254186e81b/merged 2024-09-12T12:26:05.305 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/f1728d7a2e3ac8941a5bee48837c10fc1b359af4fa976d312dc5af85c36d60a8/merged 2024-09-12T12:26:05.305 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/f273e778d1fd2f3896ff716f2bf13da7d1f3a1c2f704dbe81c85e2da288c47ce/merged 2024-09-12T12:26:05.305 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/bc89fe647ab425f8afc56013ef9dbc384eff5ecc2ceacc679d9562df82bd4b6f/merged 2024-09-12T12:26:05.305 INFO:teuthology.orchestra.run.smithi033.stdout:/run/netns 2024-09-12T12:26:05.305 INFO:teuthology.orchestra.run.smithi033.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T12:26:05.305 INFO:teuthology.orchestra.run.smithi033.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T12:26:05.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:26:05.306 DEBUG:teuthology.orchestra.run.smithi033:> ls /sys/fs/fuse/connections 2024-09-12T12:26:05.307 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi033.stderr:2024-09-12T12:26:05.303+0000 7fc308800480 -1 init, newargv = 0x560850fb7a20 newargc=15 2024-09-12T12:26:05.307 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi033.stderr:ceph-fuse[85480]: starting ceph client 2024-09-12T12:26:05.318 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi033.stderr:ceph-fuse[85480]: starting fuse 2024-09-12T12:26:05.334 INFO:teuthology.orchestra.run.smithi033.stdout:120 2024-09-12T12:26:05.334 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-12T12:26:05.334 DEBUG:teuthology.orchestra.run.smithi033:> sudo stdin-killer -- python3 -c ' 2024-09-12T12:26:05.334 DEBUG:teuthology.orchestra.run.smithi033:> import glob 2024-09-12T12:26:05.334 DEBUG:teuthology.orchestra.run.smithi033:> import re 2024-09-12T12:26:05.334 DEBUG:teuthology.orchestra.run.smithi033:> import os 2024-09-12T12:26:05.335 DEBUG:teuthology.orchestra.run.smithi033:> import subprocess 2024-09-12T12:26:05.335 DEBUG:teuthology.orchestra.run.smithi033:> 2024-09-12T12:26:05.335 DEBUG:teuthology.orchestra.run.smithi033:> def _find_admin_socket(client_name): 2024-09-12T12:26:05.335 DEBUG:teuthology.orchestra.run.smithi033:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-12T12:26:05.335 DEBUG:teuthology.orchestra.run.smithi033:> files = glob.glob(asok_path) 2024-09-12T12:26:05.335 DEBUG:teuthology.orchestra.run.smithi033:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-12T12:26:05.335 DEBUG:teuthology.orchestra.run.smithi033:> 2024-09-12T12:26:05.335 DEBUG:teuthology.orchestra.run.smithi033:> # Given a non-glob path, it better be there 2024-09-12T12:26:05.335 DEBUG:teuthology.orchestra.run.smithi033:> if "*" not in asok_path: 2024-09-12T12:26:05.335 DEBUG:teuthology.orchestra.run.smithi033:> assert(len(files) == 1) 2024-09-12T12:26:05.335 DEBUG:teuthology.orchestra.run.smithi033:> return files[0] 2024-09-12T12:26:05.335 DEBUG:teuthology.orchestra.run.smithi033:> 2024-09-12T12:26:05.335 DEBUG:teuthology.orchestra.run.smithi033:> for f in files: 2024-09-12T12:26:05.335 DEBUG:teuthology.orchestra.run.smithi033:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T12:26:05.336 DEBUG:teuthology.orchestra.run.smithi033:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T12:26:05.336 DEBUG:teuthology.orchestra.run.smithi033:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T12:26:05.336 DEBUG:teuthology.orchestra.run.smithi033:> contents = proc_f.read() 2024-09-12T12:26:05.336 DEBUG:teuthology.orchestra.run.smithi033:> if mountpoint in contents: 2024-09-12T12:26:05.336 DEBUG:teuthology.orchestra.run.smithi033:> return f 2024-09-12T12:26:05.336 DEBUG:teuthology.orchestra.run.smithi033:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T12:26:05.336 DEBUG:teuthology.orchestra.run.smithi033:> 2024-09-12T12:26:05.336 DEBUG:teuthology.orchestra.run.smithi033:> print(_find_admin_socket("client.0")) 2024-09-12T12:26:05.336 DEBUG:teuthology.orchestra.run.smithi033:> ' 2024-09-12T12:26:05.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:04 smithi043 ceph-mon[34144]: pgmap v352: 129 pgs: 129 active+clean; 644 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 639 B/s wr, 8 op/s 2024-09-12T12:26:05.453 INFO:teuthology.orchestra.run.smithi033.stdout:/var/run/ceph/ceph-client.0.85480.asok 2024-09-12T12:26:05.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:26:05.465 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.85480.asok 2024-09-12T12:26:05.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:26:05.465 DEBUG:teuthology.orchestra.run.smithi033:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.85480.asok status 2024-09-12T12:26:05.603 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:26:05.603 INFO:teuthology.orchestra.run.smithi033.stdout: "metadata": { 2024-09-12T12:26:05.603 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T12:26:05.603 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T12:26:05.603 INFO:teuthology.orchestra.run.smithi033.stdout: "entity_id": "0", 2024-09-12T12:26:05.603 INFO:teuthology.orchestra.run.smithi033.stdout: "hostname": "smithi033", 2024-09-12T12:26:05.603 INFO:teuthology.orchestra.run.smithi033.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-12T12:26:05.604 INFO:teuthology.orchestra.run.smithi033.stdout: "pid": "85480", 2024-09-12T12:26:05.604 INFO:teuthology.orchestra.run.smithi033.stdout: "root": "/volumes/qa/sv_0/8c00d832-14fd-4a19-874b-c5c3dfe6ba93" 2024-09-12T12:26:05.604 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:26:05.604 INFO:teuthology.orchestra.run.smithi033.stdout: "dentry_count": 0, 2024-09-12T12:26:05.604 INFO:teuthology.orchestra.run.smithi033.stdout: "dentry_pinned_count": 0, 2024-09-12T12:26:05.604 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 15228, 2024-09-12T12:26:05.604 INFO:teuthology.orchestra.run.smithi033.stdout: "inst": { 2024-09-12T12:26:05.604 INFO:teuthology.orchestra.run.smithi033.stdout: "name": { 2024-09-12T12:26:05.604 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "client", 2024-09-12T12:26:05.604 INFO:teuthology.orchestra.run.smithi033.stdout: "num": 15228 2024-09-12T12:26:05.604 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:26:05.604 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": { 2024-09-12T12:26:05.605 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v1", 2024-09-12T12:26:05.605 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "192.168.0.1:0", 2024-09-12T12:26:05.605 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 614442843 2024-09-12T12:26:05.605 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:26:05.605 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:26:05.605 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": { 2024-09-12T12:26:05.605 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v1", 2024-09-12T12:26:05.605 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "192.168.0.1:0", 2024-09-12T12:26:05.605 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 614442843 2024-09-12T12:26:05.605 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:26:05.605 INFO:teuthology.orchestra.run.smithi033.stdout: "inst_str": "client.15228 192.168.0.1:0/614442843", 2024-09-12T12:26:05.605 INFO:teuthology.orchestra.run.smithi033.stdout: "addr_str": "192.168.0.1:0/614442843", 2024-09-12T12:26:05.605 INFO:teuthology.orchestra.run.smithi033.stdout: "inode_count": 5, 2024-09-12T12:26:05.605 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_epoch": 24, 2024-09-12T12:26:05.606 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_epoch": 89, 2024-09-12T12:26:05.606 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_epoch_barrier": 0, 2024-09-12T12:26:05.606 INFO:teuthology.orchestra.run.smithi033.stdout: "blocklisted": false, 2024-09-12T12:26:05.606 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs" 2024-09-12T12:26:05.606 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:26:05.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:26:05.611 DEBUG:teuthology.orchestra.run.smithi033:> stat --file-system '--printf=%T 2024-09-12T12:26:05.612 DEBUG:teuthology.orchestra.run.smithi033:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-12T12:26:05.628 INFO:teuthology.orchestra.run.smithi033.stdout:fuseblk 2024-09-12T12:26:05.628 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-12T12:26:05.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:26:05.628 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T12:26:05.695 INFO:teuthology.run_tasks:Running task exec... 2024-09-12T12:26:05.705 INFO:teuthology.task.exec:Executing custom commands... 2024-09-12T12:26:05.706 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi033.front.sepia.ceph.com 2024-09-12T12:26:05.706 DEBUG:teuthology.orchestra.run.smithi033:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-12T12:26:05.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:05.839+0000 7fbe8e178640 1 -- 172.21.15.33:0/3854995429 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe881025f0 msgr2=0x7fbe88108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:05.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:05.839+0000 7fbe8e178640 1 --2- 172.21.15.33:0/3854995429 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe881025f0 0x7fbe88108e80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fbe80009ca0 tx=0x7fbe8002a8c0 comp rx=0 tx=0).stop 2024-09-12T12:26:05.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:05.839+0000 7fbe8e178640 1 -- 172.21.15.33:0/3854995429 shutdown_connections 2024-09-12T12:26:05.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:05.839+0000 7fbe8e178640 1 --2- 172.21.15.33:0/3854995429 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe881025f0 0x7fbe88108e80 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:05.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:05.839+0000 7fbe8e178640 1 --2- 172.21.15.33:0/3854995429 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe88101c30 0x7fbe881020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:05.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:05.839+0000 7fbe8e178640 1 --2- 172.21.15.33:0/3854995429 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe88100a40 0x7fbe88100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:05.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:05.839+0000 7fbe8e178640 1 -- 172.21.15.33:0/3854995429 >> 172.21.15.33:0/3854995429 conn(0x7fbe880fc1e0 msgr2=0x7fbe880fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:05.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:05.839+0000 7fbe8e178640 1 -- 172.21.15.33:0/3854995429 shutdown_connections 2024-09-12T12:26:05.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:05.839+0000 7fbe8e178640 1 -- 172.21.15.33:0/3854995429 wait complete. 2024-09-12T12:26:05.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:05.839+0000 7fbe8e178640 1 Processor -- start 2024-09-12T12:26:05.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:05.839+0000 7fbe8e178640 1 -- start start 2024-09-12T12:26:05.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:05.840+0000 7fbe8e178640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe88100a40 0x7fbe88197d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:05.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:05.840+0000 7fbe8e178640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe88101c30 0x7fbe88198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:05.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:05.840+0000 7fbe8e178640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe881025f0 0x7fbe8819f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:05.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:05.840+0000 7fbe8e178640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fbe8810c570 con 0x7fbe881025f0 2024-09-12T12:26:05.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:05.840+0000 7fbe8e178640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbe8810c3f0 con 0x7fbe88100a40 2024-09-12T12:26:05.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:05.840+0000 7fbe8e178640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbe8810c6f0 con 0x7fbe88101c30 2024-09-12T12:26:05.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:05.840+0000 7fbe87fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe881025f0 0x7fbe8819f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:05.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:05.840+0000 7fbe87fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe881025f0 0x7fbe8819f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60460/0 (socket says 172.21.15.33:60460) 2024-09-12T12:26:05.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:05.840+0000 7fbe87fff640 1 -- 172.21.15.33:0/311562860 learned_addr learned my addr 172.21.15.33:0/311562860 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:05.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:05.840+0000 7fbe877fe640 1 --2- 172.21.15.33:0/311562860 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe88100a40 0x7fbe88197d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:05.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:05.840+0000 7fbe7effd640 1 --2- 172.21.15.33:0/311562860 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe88101c30 0x7fbe88198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:05.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:05.840+0000 7fbe87fff640 1 -- 172.21.15.33:0/311562860 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe88101c30 msgr2=0x7fbe88198240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:05.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:05.840+0000 7fbe87fff640 1 --2- 172.21.15.33:0/311562860 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe88101c30 0x7fbe88198240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:05.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:05.840+0000 7fbe87fff640 1 -- 172.21.15.33:0/311562860 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe88100a40 msgr2=0x7fbe88197d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:05.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:05.840+0000 7fbe87fff640 1 --2- 172.21.15.33:0/311562860 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe88100a40 0x7fbe88197d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:05.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:05.840+0000 7fbe87fff640 1 -- 172.21.15.33:0/311562860 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe8819f910 con 0x7fbe881025f0 2024-09-12T12:26:05.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:05.840+0000 7fbe7effd640 1 --2- 172.21.15.33:0/311562860 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe88101c30 0x7fbe88198240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:26:05.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:05.840+0000 7fbe877fe640 1 --2- 172.21.15.33:0/311562860 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe88100a40 0x7fbe88197d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:05.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:05.840+0000 7fbe87fff640 1 --2- 172.21.15.33:0/311562860 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe881025f0 0x7fbe8819f270 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbe80009dc0 tx=0x7fbe80003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:05.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:05.841+0000 7fbe857fa640 1 -- 172.21.15.33:0/311562860 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe80032ec0 con 0x7fbe881025f0 2024-09-12T12:26:05.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:05.841+0000 7fbe8e178640 1 -- 172.21.15.33:0/311562860 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe8819fba0 con 0x7fbe881025f0 2024-09-12T12:26:05.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:05.841+0000 7fbe857fa640 1 -- 172.21.15.33:0/311562860 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbe800044f0 con 0x7fbe881025f0 2024-09-12T12:26:05.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:05.841+0000 7fbe857fa640 1 -- 172.21.15.33:0/311562860 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe80030d40 con 0x7fbe881025f0 2024-09-12T12:26:05.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:05.841+0000 7fbe8e178640 1 -- 172.21.15.33:0/311562860 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe881a00f0 con 0x7fbe881025f0 2024-09-12T12:26:05.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:05.842+0000 7fbe8e178640 1 -- 172.21.15.33:0/311562860 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe881a02c0 con 0x7fbe881025f0 2024-09-12T12:26:05.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:05.843+0000 7fbe857fa640 1 -- 172.21.15.33:0/311562860 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fbe80004040 con 0x7fbe881025f0 2024-09-12T12:26:05.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:05.844+0000 7fbe857fa640 1 --2- 172.21.15.33:0/311562860 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fbe740a2dd0 0x7fbe740a5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:05.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:05.844+0000 7fbe877fe640 1 --2- 172.21.15.33:0/311562860 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fbe740a2dd0 0x7fbe740a5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:05.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:05.844+0000 7fbe857fa640 1 -- 172.21.15.33:0/311562860 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fbe800f0b30 con 0x7fbe881025f0 2024-09-12T12:26:05.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:05.844+0000 7fbe877fe640 1 --2- 172.21.15.33:0/311562860 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fbe740a2dd0 0x7fbe740a5290 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbe78005fd0 tx=0x7fbe78005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:05.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:05.848+0000 7fbe857fa640 1 -- 172.21.15.33:0/311562860 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbe800bd700 con 0x7fbe881025f0 2024-09-12T12:26:06.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:06.065+0000 7fbe8e178640 1 -- 172.21.15.33:0/311562860 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7fbe881a0490 con 0x7fbe881025f0 2024-09-12T12:26:06.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:06.967+0000 7fbe857fa640 1 -- 172.21.15.33:0/311562860 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v25) ==== 117+0+0 (secure 0 0 0) 0x7fbe800dd0c0 con 0x7fbe881025f0 2024-09-12T12:26:06.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:06.971+0000 7fbe8e178640 1 -- 172.21.15.33:0/311562860 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fbe740a2dd0 msgr2=0x7fbe740a5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:06.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:06.971+0000 7fbe8e178640 1 --2- 172.21.15.33:0/311562860 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fbe740a2dd0 0x7fbe740a5290 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbe78005fd0 tx=0x7fbe78005ec0 comp rx=0 tx=0).stop 2024-09-12T12:26:06.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:06.971+0000 7fbe8e178640 1 -- 172.21.15.33:0/311562860 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe881025f0 msgr2=0x7fbe8819f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:06.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:06.971+0000 7fbe8e178640 1 --2- 172.21.15.33:0/311562860 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe881025f0 0x7fbe8819f270 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbe80009dc0 tx=0x7fbe80003ba0 comp rx=0 tx=0).stop 2024-09-12T12:26:06.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:06.971+0000 7fbe8e178640 1 -- 172.21.15.33:0/311562860 shutdown_connections 2024-09-12T12:26:06.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:06.971+0000 7fbe8e178640 1 --2- 172.21.15.33:0/311562860 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fbe740a2dd0 0x7fbe740a5290 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:06.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:06.971+0000 7fbe8e178640 1 --2- 172.21.15.33:0/311562860 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe881025f0 0x7fbe8819f270 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:06.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:06.971+0000 7fbe8e178640 1 --2- 172.21.15.33:0/311562860 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe88101c30 0x7fbe88198240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:06.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:06.971+0000 7fbe8e178640 1 --2- 172.21.15.33:0/311562860 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe88100a40 0x7fbe88197d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:06.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:06.971+0000 7fbe8e178640 1 -- 172.21.15.33:0/311562860 >> 172.21.15.33:0/311562860 conn(0x7fbe880fc1e0 msgr2=0x7fbe880fdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:06.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:06.971+0000 7fbe8e178640 1 -- 172.21.15.33:0/311562860 shutdown_connections 2024-09-12T12:26:06.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:06.971+0000 7fbe8e178640 1 -- 172.21.15.33:0/311562860 wait complete. 2024-09-12T12:26:06.985 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-12T12:26:06.996 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-12T12:26:07.122 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:26:07.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:06 smithi033 ceph-mon[31246]: pgmap v353: 129 pgs: 129 active+clean; 644 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 639 B/s wr, 6 op/s 2024-09-12T12:26:07.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:06 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/311562860' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-12T12:26:07.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.237+0000 7f59dcff1640 1 -- 172.21.15.33:0/1518276990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59d81025c0 msgr2=0x7f59d8108e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:07.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.237+0000 7f59dcff1640 1 --2- 172.21.15.33:0/1518276990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59d81025c0 0x7f59d8108e50 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f59d0009ca0 tx=0x7f59d002a8c0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.237+0000 7f59dcff1640 1 -- 172.21.15.33:0/1518276990 shutdown_connections 2024-09-12T12:26:07.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.237+0000 7f59dcff1640 1 --2- 172.21.15.33:0/1518276990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59d81025c0 0x7f59d8108e50 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.237+0000 7f59dcff1640 1 --2- 172.21.15.33:0/1518276990 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59d8101c00 0x7f59d8102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.237+0000 7f59dcff1640 1 --2- 172.21.15.33:0/1518276990 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59d8100a10 0x7f59d8100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.237+0000 7f59dcff1640 1 -- 172.21.15.33:0/1518276990 >> 172.21.15.33:0/1518276990 conn(0x7f59d80fc170 msgr2=0x7f59d80fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:07.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.237+0000 7f59dcff1640 1 -- 172.21.15.33:0/1518276990 shutdown_connections 2024-09-12T12:26:07.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.237+0000 7f59dcff1640 1 -- 172.21.15.33:0/1518276990 wait complete. 2024-09-12T12:26:07.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.238+0000 7f59dcff1640 1 Processor -- start 2024-09-12T12:26:07.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.238+0000 7f59dcff1640 1 -- start start 2024-09-12T12:26:07.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.238+0000 7f59dcff1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59d8100a10 0x7f59d8069f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:07.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.238+0000 7f59dcff1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59d8101c00 0x7f59d819ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:07.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.238+0000 7f59dcff1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59d81025c0 0x7f59d819f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:07.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.238+0000 7f59dcff1640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f59d810c520 con 0x7f59d81025c0 2024-09-12T12:26:07.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.238+0000 7f59dcff1640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f59d810c3a0 con 0x7f59d8100a10 2024-09-12T12:26:07.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.238+0000 7f59dcff1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f59d810c6a0 con 0x7f59d8101c00 2024-09-12T12:26:07.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.238+0000 7f59d6d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59d81025c0 0x7f59d819f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:07.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.238+0000 7f59d6d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59d81025c0 0x7f59d819f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60464/0 (socket says 172.21.15.33:60464) 2024-09-12T12:26:07.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.238+0000 7f59d6d9d640 1 -- 172.21.15.33:0/4173504076 learned_addr learned my addr 172.21.15.33:0/4173504076 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:07.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.238+0000 7f59d659c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59d8100a10 0x7f59d8069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:07.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.238+0000 7f59cffff640 1 --2- 172.21.15.33:0/4173504076 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59d8101c00 0x7f59d819ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:07.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.238+0000 7f59d6d9d640 1 -- 172.21.15.33:0/4173504076 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59d8101c00 msgr2=0x7f59d819ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:07.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.238+0000 7f59d6d9d640 1 --2- 172.21.15.33:0/4173504076 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59d8101c00 0x7f59d819ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.238+0000 7f59d6d9d640 1 -- 172.21.15.33:0/4173504076 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59d8100a10 msgr2=0x7f59d8069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:07.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.238+0000 7f59d6d9d640 1 --2- 172.21.15.33:0/4173504076 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59d8100a10 0x7f59d8069f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.238+0000 7f59d6d9d640 1 -- 172.21.15.33:0/4173504076 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59d819f920 con 0x7f59d81025c0 2024-09-12T12:26:07.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.238+0000 7f59cffff640 1 --2- 172.21.15.33:0/4173504076 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59d8101c00 0x7f59d819ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:07.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.238+0000 7f59d659c640 1 --2- 172.21.15.33:0/4173504076 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59d8100a10 0x7f59d8069f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:07.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.239+0000 7f59d6d9d640 1 --2- 172.21.15.33:0/4173504076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59d81025c0 0x7f59d819f060 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f59d0031970 tx=0x7f59d0003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:07.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.239+0000 7f59cf7fe640 1 -- 172.21.15.33:0/4173504076 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d0004040 con 0x7f59d81025c0 2024-09-12T12:26:07.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.239+0000 7f59dcff1640 1 -- 172.21.15.33:0/4173504076 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59d819fbb0 con 0x7f59d81025c0 2024-09-12T12:26:07.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.239+0000 7f59cf7fe640 1 -- 172.21.15.33:0/4173504076 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f59d0004690 con 0x7f59d81025c0 2024-09-12T12:26:07.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.239+0000 7f59dcff1640 1 -- 172.21.15.33:0/4173504076 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59d81a0150 con 0x7f59d81025c0 2024-09-12T12:26:07.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.239+0000 7f59cf7fe640 1 -- 172.21.15.33:0/4173504076 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d0030c40 con 0x7f59d81025c0 2024-09-12T12:26:07.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.240+0000 7f59dcff1640 1 -- 172.21.15.33:0/4173504076 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59d8107e50 con 0x7f59d81025c0 2024-09-12T12:26:07.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.241+0000 7f59cf7fe640 1 -- 172.21.15.33:0/4173504076 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f59d00041e0 con 0x7f59d81025c0 2024-09-12T12:26:07.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.242+0000 7f59cf7fe640 1 --2- 172.21.15.33:0/4173504076 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f59c40a2b90 0x7f59c40a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:07.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.242+0000 7f59cf7fe640 1 -- 172.21.15.33:0/4173504076 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f59d00f0970 con 0x7f59d81025c0 2024-09-12T12:26:07.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.242+0000 7f59d659c640 1 --2- 172.21.15.33:0/4173504076 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f59c40a2b90 0x7f59c40a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:07.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.243+0000 7f59d659c640 1 --2- 172.21.15.33:0/4173504076 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f59c40a2b90 0x7f59c40a5050 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f59d8101a60 tx=0x7f59c8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:07.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.246+0000 7f59cf7fe640 1 -- 172.21.15.33:0/4173504076 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f59d00bd540 con 0x7f59d81025c0 2024-09-12T12:26:07.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:06 smithi043 ceph-mon[34144]: pgmap v353: 129 pgs: 129 active+clean; 644 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 639 B/s wr, 6 op/s 2024-09-12T12:26:07.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:06 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/311562860' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-12T12:26:07.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:06 smithi102 ceph-mon[34799]: pgmap v353: 129 pgs: 129 active+clean; 644 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 639 B/s wr, 6 op/s 2024-09-12T12:26:07.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:06 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/311562860' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-12T12:26:07.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.423+0000 7f59dcff1640 1 -- 172.21.15.33:0/4173504076 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f59d8062df0 con 0x7f59d81025c0 2024-09-12T12:26:07.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.424+0000 7f59cf7fe640 1 -- 172.21.15.33:0/4173504076 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24763 (secure 0 0 0) 0x7f59d00bce40 con 0x7f59d81025c0 2024-09-12T12:26:07.426 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:26:07.426 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":89,"fsid":"a66dfafc-7100-11ef-bcea-c7b262605968","created":"2024-09-12T12:16:11.904815+0000","modified":"2024-09-12T12:25:59.801807+0000","last_up_change":"2024-09-12T12:22:57.476185+0000","last_in_change":"2024-09-12T12:22:35.192556+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:19:12.296305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:23:42.509774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:23:44.842852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T12:23:51.308720+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"74b68729-c97c-4da6-a659-75d6c147ad05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6803","nonce":963294466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6805","nonce":963294466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6809","nonce":963294466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6807","nonce":963294466}]},"public_addr":"172.21.15.33:6803/963294466","cluster_addr":"172.21.15.33:6805/963294466","heartbeat_back_addr":"172.21.15.33:6809/963294466","heartbeat_front_addr":"172.21.15.33:6807/963294466","state":["exists","up"]},{"osd":1,"uuid":"2461a388-e110-420b-9404-eb54cd39119e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6801","nonce":2306025171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6803","nonce":2306025171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6807","nonce":2306025171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6805","nonce":2306025171}]},"public_addr":"172.21.15.43:6801/2306025171","cluster_addr":"172.21.15.43:6803/2306025171","heartbeat_back_addr":"172.21.15.43:6807/2306025171","heartbeat_front_addr":"172.21.15.43:6805/2306025171","state":["exists","up"]},{"osd":2,"uuid":"4ba9dd02-977d-45fb-b366-ade15b52232b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6801","nonce":4257223217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6803","nonce":4257223217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6807","nonce":4257223217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6805","nonce":4257223217}]},"public_addr":"172.21.15.102:6801/4257223217","cluster_addr":"172.21.15.102:6803/4257223217","heartbeat_back_addr":"172.21.15.102:6807/4257223217","heartbeat_front_addr":"172.21.15.102:6805/4257223217","state":["exists","up"]},{"osd":3,"uuid":"345aa854-9ea2-4103-a186-9794af34c237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6811","nonce":2483872739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6813","nonce":2483872739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6817","nonce":2483872739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6815","nonce":2483872739}]},"public_addr":"172.21.15.33:6811/2483872739","cluster_addr":"172.21.15.33:6813/2483872739","heartbeat_back_addr":"172.21.15.33:6817/2483872739","heartbeat_front_addr":"172.21.15.33:6815/2483872739","state":["exists","up"]},{"osd":4,"uuid":"32acd6da-01d6-4a8e-9d05-3d394363d6f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6809","nonce":136043101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6811","nonce":136043101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6815","nonce":136043101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6813","nonce":136043101}]},"public_addr":"172.21.15.43:6809/136043101","cluster_addr":"172.21.15.43:6811/136043101","heartbeat_back_addr":"172.21.15.43:6815/136043101","heartbeat_front_addr":"172.21.15.43:6813/136043101","state":["exists","up"]},{"osd":5,"uuid":"dced0037-2da2-48c2-a391-f871d6ceebb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6809","nonce":2605625792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6811","nonce":2605625792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6815","nonce":2605625792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6813","nonce":2605625792}]},"public_addr":"172.21.15.102:6809/2605625792","cluster_addr":"172.21.15.102:6811/2605625792","heartbeat_back_addr":"172.21.15.102:6815/2605625792","heartbeat_front_addr":"172.21.15.102:6813/2605625792","state":["exists","up"]},{"osd":6,"uuid":"46e5532e-026a-4bb2-8847-2a3216e5d7a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6819","nonce":805864618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6821","nonce":805864618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6825","nonce":805864618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6823","nonce":805864618}]},"public_addr":"172.21.15.33:6819/805864618","cluster_addr":"172.21.15.33:6821/805864618","heartbeat_back_addr":"172.21.15.33:6825/805864618","heartbeat_front_addr":"172.21.15.33:6823/805864618","state":["exists","up"]},{"osd":7,"uuid":"c8474ab4-68cd-4475-9429-b54981247ee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6817","nonce":392537201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6819","nonce":392537201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6823","nonce":392537201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6821","nonce":392537201}]},"public_addr":"172.21.15.43:6817/392537201","cluster_addr":"172.21.15.43:6819/392537201","heartbeat_back_addr":"172.21.15.43:6823/392537201","heartbeat_front_addr":"172.21.15.43:6821/392537201","state":["exists","up"]},{"osd":8,"uuid":"e7c2ef28-8c84-44d0-ba6d-7556ec1d02dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6817","nonce":1768219597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6819","nonce":1768219597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6823","nonce":1768219597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6821","nonce":1768219597}]},"public_addr":"172.21.15.102:6817/1768219597","cluster_addr":"172.21.15.102:6819/1768219597","heartbeat_back_addr":"172.21.15.102:6823/1768219597","heartbeat_front_addr":"172.21.15.102:6821/1768219597","state":["exists","up"]},{"osd":9,"uuid":"f2500273-8b21-4984-bc41-cec5cc0c883b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6827","nonce":973136168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6829","nonce":973136168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6833","nonce":973136168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6831","nonce":973136168}]},"public_addr":"172.21.15.33:6827/973136168","cluster_addr":"172.21.15.33:6829/973136168","heartbeat_back_addr":"172.21.15.33:6833/973136168","heartbeat_front_addr":"172.21.15.33:6831/973136168","state":["exists","up"]},{"osd":10,"uuid":"954343c5-5d5b-4c30-acde-82aa695f7b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6825","nonce":248515585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6827","nonce":248515585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6831","nonce":248515585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6829","nonce":248515585}]},"public_addr":"172.21.15.43:6825/248515585","cluster_addr":"172.21.15.43:6827/248515585","heartbeat_back_addr":"172.21.15.43:6831/248515585","heartbeat_front_addr":"172.21.15.43:6829/248515585","state":["exists","up"]},{"osd":11,"uuid":"22b4147b-02ad-4514-be17-5bb395099eef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6825","nonce":2463068013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6827","nonce":2463068013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6831","nonce":2463068013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6829","nonce":2463068013}]},"public_addr":"172.21.15.102:6825/2463068013","cluster_addr":"172.21.15.102:6827/2463068013","heartbeat_back_addr":"172.21.15.102:6831/2463068013","heartbeat_front_addr":"172.21.15.102:6829/2463068013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:19.274804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:44.900294+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:08.885404+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:34.382089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:59.978538+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:25.275179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:49.429847+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:14.974792+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:40.268629+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:22:06.458679+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:22:31.813019+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:22:56.264078+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/3187741548":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6800/1381479235":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6801/1156183797":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/2222991013":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6801/1381479235":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6800/1156183797":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/3450458842":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/202580320":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/2441151017":"2024-09-13T12:16:57.792813+0000","172.21.15.33:0/1001176884":"2024-09-13T12:16:33.559150+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:26:07.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.426+0000 7f59dcff1640 1 -- 172.21.15.33:0/4173504076 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f59c40a2b90 msgr2=0x7f59c40a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:07.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.426+0000 7f59dcff1640 1 --2- 172.21.15.33:0/4173504076 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f59c40a2b90 0x7f59c40a5050 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f59d8101a60 tx=0x7f59c8005f90 comp rx=0 tx=0).stop 2024-09-12T12:26:07.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.426+0000 7f59dcff1640 1 -- 172.21.15.33:0/4173504076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59d81025c0 msgr2=0x7f59d819f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:07.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.426+0000 7f59dcff1640 1 --2- 172.21.15.33:0/4173504076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59d81025c0 0x7f59d819f060 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f59d0031970 tx=0x7f59d0003ba0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.427+0000 7f59dcff1640 1 -- 172.21.15.33:0/4173504076 shutdown_connections 2024-09-12T12:26:07.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.427+0000 7f59dcff1640 1 --2- 172.21.15.33:0/4173504076 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f59c40a2b90 0x7f59c40a5050 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.427+0000 7f59dcff1640 1 --2- 172.21.15.33:0/4173504076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59d81025c0 0x7f59d819f060 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.427+0000 7f59dcff1640 1 --2- 172.21.15.33:0/4173504076 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59d8101c00 0x7f59d819ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.427+0000 7f59dcff1640 1 --2- 172.21.15.33:0/4173504076 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59d8100a10 0x7f59d8069f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.427+0000 7f59dcff1640 1 -- 172.21.15.33:0/4173504076 >> 172.21.15.33:0/4173504076 conn(0x7f59d80fc170 msgr2=0x7f59d8105020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:07.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.427+0000 7f59dcff1640 1 -- 172.21.15.33:0/4173504076 shutdown_connections 2024-09-12T12:26:07.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.427+0000 7f59dcff1640 1 -- 172.21.15.33:0/4173504076 wait complete. 2024-09-12T12:26:07.439 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T12:19:12.296305+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T12:23:42.509774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T12:23:44.842852+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-12T12:23:51.308720+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-12T12:26:07.439 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T12:26:07.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.545+0000 7f2a9455b640 1 -- 172.21.15.33:0/82242886 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a8c1036d0 msgr2=0x7f2a8c109f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:07.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.545+0000 7f2a9455b640 1 --2- 172.21.15.33:0/82242886 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a8c1036d0 0x7f2a8c109f60 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2a84009ca0 tx=0x7f2a8402a8c0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.545+0000 7f2a9455b640 1 -- 172.21.15.33:0/82242886 shutdown_connections 2024-09-12T12:26:07.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.545+0000 7f2a9455b640 1 --2- 172.21.15.33:0/82242886 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a8c1036d0 0x7f2a8c109f60 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.545+0000 7f2a9455b640 1 --2- 172.21.15.33:0/82242886 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a8c102d10 0x7f2a8c103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.545+0000 7f2a9455b640 1 --2- 172.21.15.33:0/82242886 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a8c101b20 0x7f2a8c101f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.545+0000 7f2a9455b640 1 -- 172.21.15.33:0/82242886 >> 172.21.15.33:0/82242886 conn(0x7f2a8c0fd2a0 msgr2=0x7f2a8c0ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:07.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.545+0000 7f2a9455b640 1 -- 172.21.15.33:0/82242886 shutdown_connections 2024-09-12T12:26:07.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.545+0000 7f2a9455b640 1 -- 172.21.15.33:0/82242886 wait complete. 2024-09-12T12:26:07.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.546+0000 7f2a9455b640 1 Processor -- start 2024-09-12T12:26:07.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.546+0000 7f2a9455b640 1 -- start start 2024-09-12T12:26:07.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.546+0000 7f2a9455b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a8c101b20 0x7f2a8c197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:07.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.546+0000 7f2a9455b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a8c102d10 0x7f2a8c198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:07.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.546+0000 7f2a9455b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a8c1036d0 0x7f2a8c19f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:07.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.546+0000 7f2a9455b640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2a8c10d650 con 0x7f2a8c102d10 2024-09-12T12:26:07.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.546+0000 7f2a9455b640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2a8c10d4d0 con 0x7f2a8c1036d0 2024-09-12T12:26:07.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.546+0000 7f2a9455b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2a8c10d7d0 con 0x7f2a8c101b20 2024-09-12T12:26:07.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.546+0000 7f2a91af6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a8c102d10 0x7f2a8c198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:07.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.546+0000 7f2a91af6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a8c102d10 0x7f2a8c198280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60468/0 (socket says 172.21.15.33:60468) 2024-09-12T12:26:07.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.546+0000 7f2a91af6640 1 -- 172.21.15.33:0/3952760312 learned_addr learned my addr 172.21.15.33:0/3952760312 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:07.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.546+0000 7f2a92af8640 1 --2- 172.21.15.33:0/3952760312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a8c1036d0 0x7f2a8c19f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:07.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.546+0000 7f2a922f7640 1 --2- 172.21.15.33:0/3952760312 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a8c101b20 0x7f2a8c197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:07.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.546+0000 7f2a91af6640 1 -- 172.21.15.33:0/3952760312 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a8c101b20 msgr2=0x7f2a8c197d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:07.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.546+0000 7f2a91af6640 1 --2- 172.21.15.33:0/3952760312 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a8c101b20 0x7f2a8c197d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.546+0000 7f2a91af6640 1 -- 172.21.15.33:0/3952760312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a8c1036d0 msgr2=0x7f2a8c19f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:07.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.546+0000 7f2a91af6640 1 --2- 172.21.15.33:0/3952760312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a8c1036d0 0x7f2a8c19f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.546+0000 7f2a91af6640 1 -- 172.21.15.33:0/3952760312 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a8c19f960 con 0x7f2a8c102d10 2024-09-12T12:26:07.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.546+0000 7f2a92af8640 1 --2- 172.21.15.33:0/3952760312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a8c1036d0 0x7f2a8c19f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:07.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.546+0000 7f2a922f7640 1 --2- 172.21.15.33:0/3952760312 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a8c101b20 0x7f2a8c197d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:07.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.547+0000 7f2a91af6640 1 --2- 172.21.15.33:0/3952760312 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a8c102d10 0x7f2a8c198280 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c00d770 tx=0x7f2a7c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:07.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.547+0000 7f2a837fe640 1 -- 172.21.15.33:0/3952760312 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c017070 con 0x7f2a8c102d10 2024-09-12T12:26:07.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.547+0000 7f2a837fe640 1 -- 172.21.15.33:0/3952760312 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2a7c0054d0 con 0x7f2a8c102d10 2024-09-12T12:26:07.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.547+0000 7f2a837fe640 1 -- 172.21.15.33:0/3952760312 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c004cf0 con 0x7f2a8c102d10 2024-09-12T12:26:07.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.547+0000 7f2a9455b640 1 -- 172.21.15.33:0/3952760312 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a8c19fc50 con 0x7f2a8c102d10 2024-09-12T12:26:07.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.547+0000 7f2a9455b640 1 -- 172.21.15.33:0/3952760312 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a8c1a0150 con 0x7f2a8c102d10 2024-09-12T12:26:07.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.548+0000 7f2a9455b640 1 -- 172.21.15.33:0/3952760312 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a8c108f80 con 0x7f2a8c102d10 2024-09-12T12:26:07.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.550+0000 7f2a837fe640 1 -- 172.21.15.33:0/3952760312 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2a7c004e90 con 0x7f2a8c102d10 2024-09-12T12:26:07.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.551+0000 7f2a837fe640 1 --2- 172.21.15.33:0/3952760312 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2a780a2b90 0x7f2a780a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:07.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.551+0000 7f2a837fe640 1 -- 172.21.15.33:0/3952760312 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f2a7c0cf280 con 0x7f2a8c102d10 2024-09-12T12:26:07.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.551+0000 7f2a922f7640 1 --2- 172.21.15.33:0/3952760312 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2a780a2b90 0x7f2a780a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:07.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.551+0000 7f2a922f7640 1 --2- 172.21.15.33:0/3952760312 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2a780a2b90 0x7f2a780a5050 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c102b70 tx=0x7f2a88005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:07.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.554+0000 7f2a837fe640 1 -- 172.21.15.33:0/3952760312 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2a7c09bdf0 con 0x7f2a8c102d10 2024-09-12T12:26:07.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.729+0000 7f2a9455b640 1 -- 172.21.15.33:0/3952760312 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2a8c02d9c0 con 0x7f2a8c102d10 2024-09-12T12:26:07.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.730+0000 7f2a837fe640 1 -- 172.21.15.33:0/3952760312 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) ==== 93+0+10 (secure 0 0 0) 0x7f2a7c09b6f0 con 0x7f2a8c102d10 2024-09-12T12:26:07.731 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-12T12:26:07.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.731+0000 7f2a9455b640 1 -- 172.21.15.33:0/3952760312 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2a780a2b90 msgr2=0x7f2a780a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:07.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.731+0000 7f2a9455b640 1 --2- 172.21.15.33:0/3952760312 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2a780a2b90 0x7f2a780a5050 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c102b70 tx=0x7f2a88005f90 comp rx=0 tx=0).stop 2024-09-12T12:26:07.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.731+0000 7f2a9455b640 1 -- 172.21.15.33:0/3952760312 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a8c102d10 msgr2=0x7f2a8c198280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:07.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.732+0000 7f2a9455b640 1 --2- 172.21.15.33:0/3952760312 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a8c102d10 0x7f2a8c198280 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c00d770 tx=0x7f2a7c00dc30 comp rx=0 tx=0).stop 2024-09-12T12:26:07.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.732+0000 7f2a9455b640 1 -- 172.21.15.33:0/3952760312 shutdown_connections 2024-09-12T12:26:07.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.732+0000 7f2a9455b640 1 --2- 172.21.15.33:0/3952760312 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2a780a2b90 0x7f2a780a5050 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.732+0000 7f2a9455b640 1 --2- 172.21.15.33:0/3952760312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a8c1036d0 0x7f2a8c19f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.732+0000 7f2a9455b640 1 --2- 172.21.15.33:0/3952760312 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a8c102d10 0x7f2a8c198280 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.732+0000 7f2a9455b640 1 --2- 172.21.15.33:0/3952760312 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a8c101b20 0x7f2a8c197d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.732+0000 7f2a9455b640 1 -- 172.21.15.33:0/3952760312 >> 172.21.15.33:0/3952760312 conn(0x7f2a8c0fd2a0 msgr2=0x7f2a8c106150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:07.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.732+0000 7f2a9455b640 1 -- 172.21.15.33:0/3952760312 shutdown_connections 2024-09-12T12:26:07.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.732+0000 7f2a9455b640 1 -- 172.21.15.33:0/3952760312 wait complete. 2024-09-12T12:26:07.743 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-12T12:26:07.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.850+0000 7f29e1e27640 1 -- 172.21.15.33:0/325097687 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29dc102610 msgr2=0x7f29dc104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:07.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.850+0000 7f29e1e27640 1 --2- 172.21.15.33:0/325097687 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29dc102610 0x7f29dc104a00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f29cc009900 tx=0x7f29cc02a410 comp rx=0 tx=0).stop 2024-09-12T12:26:07.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.850+0000 7f29e1e27640 1 -- 172.21.15.33:0/325097687 shutdown_connections 2024-09-12T12:26:07.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.850+0000 7f29e1e27640 1 --2- 172.21.15.33:0/325097687 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29dc107870 0x7f29dc109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.850+0000 7f29e1e27640 1 --2- 172.21.15.33:0/325097687 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f29dc104f40 0x7f29dc107330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.850+0000 7f29e1e27640 1 --2- 172.21.15.33:0/325097687 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29dc102610 0x7f29dc104a00 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.850+0000 7f29e1e27640 1 -- 172.21.15.33:0/325097687 >> 172.21.15.33:0/325097687 conn(0x7f29dc0fc1b0 msgr2=0x7f29dc0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:07.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.850+0000 7f29e1e27640 1 -- 172.21.15.33:0/325097687 shutdown_connections 2024-09-12T12:26:07.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.850+0000 7f29e1e27640 1 -- 172.21.15.33:0/325097687 wait complete. 2024-09-12T12:26:07.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.851+0000 7f29e1e27640 1 Processor -- start 2024-09-12T12:26:07.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.851+0000 7f29e1e27640 1 -- start start 2024-09-12T12:26:07.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.851+0000 7f29e1e27640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29dc102610 0x7f29dc197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:07.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.851+0000 7f29e1e27640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f29dc104f40 0x7f29dc1983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:07.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.851+0000 7f29e1e27640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29dc107870 0x7f29dc19f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:07.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.851+0000 7f29e1e27640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc10d6b0 con 0x7f29dc107870 2024-09-12T12:26:07.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.851+0000 7f29e1e27640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc10d530 con 0x7f29dc102610 2024-09-12T12:26:07.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.851+0000 7f29e1e27640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc10d830 con 0x7f29dc104f40 2024-09-12T12:26:07.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.852+0000 7f29db7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29dc102610 0x7f29dc197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:07.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.852+0000 7f29dbfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29dc107870 0x7f29dc19f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:07.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.852+0000 7f29db7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29dc102610 0x7f29dc197ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:54476/0 (socket says 172.21.15.33:54476) 2024-09-12T12:26:07.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.852+0000 7f29db7fe640 1 -- 172.21.15.33:0/4240081578 learned_addr learned my addr 172.21.15.33:0/4240081578 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:07.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.852+0000 7f29daffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f29dc104f40 0x7f29dc1983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:07.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.852+0000 7f29db7fe640 1 -- 172.21.15.33:0/4240081578 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f29dc104f40 msgr2=0x7f29dc1983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:07.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.852+0000 7f29db7fe640 1 --2- 172.21.15.33:0/4240081578 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f29dc104f40 0x7f29dc1983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.852+0000 7f29db7fe640 1 -- 172.21.15.33:0/4240081578 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29dc107870 msgr2=0x7f29dc19f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:07.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.852+0000 7f29db7fe640 1 --2- 172.21.15.33:0/4240081578 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29dc107870 0x7f29dc19f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.852+0000 7f29db7fe640 1 -- 172.21.15.33:0/4240081578 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29dc19fac0 con 0x7f29dc102610 2024-09-12T12:26:07.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.852+0000 7f29dbfff640 1 --2- 172.21.15.33:0/4240081578 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29dc107870 0x7f29dc19f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:07.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.852+0000 7f29db7fe640 1 --2- 172.21.15.33:0/4240081578 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29dc102610 0x7f29dc197ea0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f29cc005940 tx=0x7f29cc031a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:07.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.852+0000 7f29d8ff9640 1 -- 172.21.15.33:0/4240081578 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29cc03f030 con 0x7f29dc102610 2024-09-12T12:26:07.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.852+0000 7f29e1e27640 1 -- 172.21.15.33:0/4240081578 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29dc100400 con 0x7f29dc102610 2024-09-12T12:26:07.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.852+0000 7f29d8ff9640 1 -- 172.21.15.33:0/4240081578 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f29cc003aa0 con 0x7f29dc102610 2024-09-12T12:26:07.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.852+0000 7f29e1e27640 1 -- 172.21.15.33:0/4240081578 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29dc100940 con 0x7f29dc102610 2024-09-12T12:26:07.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.852+0000 7f29d8ff9640 1 -- 172.21.15.33:0/4240081578 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29cc035070 con 0x7f29dc102610 2024-09-12T12:26:07.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.853+0000 7f29e1e27640 1 -- 172.21.15.33:0/4240081578 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29dc0fdca0 con 0x7f29dc102610 2024-09-12T12:26:07.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.855+0000 7f29d8ff9640 1 -- 172.21.15.33:0/4240081578 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f29cc042030 con 0x7f29dc102610 2024-09-12T12:26:07.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.855+0000 7f29d8ff9640 1 --2- 172.21.15.33:0/4240081578 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f29c40a2b90 0x7f29c40a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:07.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.856+0000 7f29daffd640 1 --2- 172.21.15.33:0/4240081578 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f29c40a2b90 0x7f29c40a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:07.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.856+0000 7f29d8ff9640 1 -- 172.21.15.33:0/4240081578 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f29cc0efbd0 con 0x7f29dc102610 2024-09-12T12:26:07.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.856+0000 7f29daffd640 1 --2- 172.21.15.33:0/4240081578 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f29c40a2b90 0x7f29c40a5050 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f29dc1993b0 tx=0x7f29d000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:07.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:07.863+0000 7f29d8ff9640 1 -- 172.21.15.33:0/4240081578 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f29cc0bc0f0 con 0x7f29dc102610 2024-09-12T12:26:08.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.039+0000 7f29e1e27640 1 -- 172.21.15.33:0/4240081578 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f29dc02da10 con 0x7f29dc102610 2024-09-12T12:26:08.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.040+0000 7f29d8ff9640 1 -- 172.21.15.33:0/4240081578 <== mon.2 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) ==== 104+0+11 (secure 0 0 0) 0x7f29cc0c03f0 con 0x7f29dc102610 2024-09-12T12:26:08.041 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-09-12T12:26:08.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.042+0000 7f29e1e27640 1 -- 172.21.15.33:0/4240081578 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f29c40a2b90 msgr2=0x7f29c40a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:08.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.042+0000 7f29e1e27640 1 --2- 172.21.15.33:0/4240081578 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f29c40a2b90 0x7f29c40a5050 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f29dc1993b0 tx=0x7f29d000b390 comp rx=0 tx=0).stop 2024-09-12T12:26:08.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.042+0000 7f29e1e27640 1 -- 172.21.15.33:0/4240081578 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29dc102610 msgr2=0x7f29dc197ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:08.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.042+0000 7f29e1e27640 1 --2- 172.21.15.33:0/4240081578 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29dc102610 0x7f29dc197ea0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f29cc005940 tx=0x7f29cc031a30 comp rx=0 tx=0).stop 2024-09-12T12:26:08.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.042+0000 7f29e1e27640 1 -- 172.21.15.33:0/4240081578 shutdown_connections 2024-09-12T12:26:08.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.042+0000 7f29e1e27640 1 --2- 172.21.15.33:0/4240081578 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f29c40a2b90 0x7f29c40a5050 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:08.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.042+0000 7f29e1e27640 1 --2- 172.21.15.33:0/4240081578 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29dc107870 0x7f29dc19f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:08.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.042+0000 7f29e1e27640 1 --2- 172.21.15.33:0/4240081578 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f29dc104f40 0x7f29dc1983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:08.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.042+0000 7f29e1e27640 1 --2- 172.21.15.33:0/4240081578 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29dc102610 0x7f29dc197ea0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:08.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.042+0000 7f29e1e27640 1 -- 172.21.15.33:0/4240081578 >> 172.21.15.33:0/4240081578 conn(0x7f29dc0fc1b0 msgr2=0x7f29dc102ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:08.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.043+0000 7f29e1e27640 1 -- 172.21.15.33:0/4240081578 shutdown_connections 2024-09-12T12:26:08.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.043+0000 7f29e1e27640 1 -- 172.21.15.33:0/4240081578 wait complete. 2024-09-12T12:26:08.053 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:07 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/311562860' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-12T12:26:08.053 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:07 smithi033 ceph-mon[31246]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T12:26:08.053 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:07 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/4173504076' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:26:08.054 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:07 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/3952760312' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T12:26:08.055 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-12T12:26:08.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.160+0000 7efee0c53640 1 -- 172.21.15.33:0/2446941217 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efedc100a00 msgr2=0x7efedc100e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:08.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.160+0000 7efee0c53640 1 --2- 172.21.15.33:0/2446941217 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efedc100a00 0x7efedc100e00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7efecc009900 tx=0x7efecc02a410 comp rx=0 tx=0).stop 2024-09-12T12:26:08.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.161+0000 7efee0c53640 1 -- 172.21.15.33:0/2446941217 shutdown_connections 2024-09-12T12:26:08.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.161+0000 7efee0c53640 1 --2- 172.21.15.33:0/2446941217 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efedc1025b0 0x7efedc108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:08.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.161+0000 7efee0c53640 1 --2- 172.21.15.33:0/2446941217 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efedc101bf0 0x7efedc102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:08.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.161+0000 7efee0c53640 1 --2- 172.21.15.33:0/2446941217 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efedc100a00 0x7efedc100e00 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:08.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.161+0000 7efee0c53640 1 -- 172.21.15.33:0/2446941217 >> 172.21.15.33:0/2446941217 conn(0x7efedc0fc140 msgr2=0x7efedc0fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:08.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.161+0000 7efee0c53640 1 -- 172.21.15.33:0/2446941217 shutdown_connections 2024-09-12T12:26:08.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.161+0000 7efee0c53640 1 -- 172.21.15.33:0/2446941217 wait complete. 2024-09-12T12:26:08.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.161+0000 7efee0c53640 1 Processor -- start 2024-09-12T12:26:08.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.161+0000 7efee0c53640 1 -- start start 2024-09-12T12:26:08.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.162+0000 7efee0c53640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efedc100a00 0x7efedc069f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:08.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.162+0000 7efee0c53640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efedc101bf0 0x7efedc19cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:08.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.162+0000 7efee0c53640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efedc1025b0 0x7efedc19f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:08.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.162+0000 7efee0c53640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7efedc10c530 con 0x7efedc1025b0 2024-09-12T12:26:08.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.162+0000 7efee0c53640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7efedc10c3b0 con 0x7efedc100a00 2024-09-12T12:26:08.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.162+0000 7efee0c53640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7efedc10c6b0 con 0x7efedc101bf0 2024-09-12T12:26:08.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.162+0000 7efedad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efedc1025b0 0x7efedc19f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:08.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.162+0000 7efeda59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efedc100a00 0x7efedc069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:08.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.162+0000 7efedad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efedc1025b0 0x7efedc19f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60506/0 (socket says 172.21.15.33:60506) 2024-09-12T12:26:08.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.162+0000 7efedad9d640 1 -- 172.21.15.33:0/2855105031 learned_addr learned my addr 172.21.15.33:0/2855105031 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:08.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.162+0000 7efed9d9b640 1 --2- 172.21.15.33:0/2855105031 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efedc101bf0 0x7efedc19cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:08.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.162+0000 7efeda59c640 1 -- 172.21.15.33:0/2855105031 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efedc101bf0 msgr2=0x7efedc19cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:08.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.162+0000 7efeda59c640 1 --2- 172.21.15.33:0/2855105031 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efedc101bf0 0x7efedc19cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:08.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.162+0000 7efeda59c640 1 -- 172.21.15.33:0/2855105031 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efedc1025b0 msgr2=0x7efedc19f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:08.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.162+0000 7efeda59c640 1 --2- 172.21.15.33:0/2855105031 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efedc1025b0 0x7efedc19f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:08.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.162+0000 7efeda59c640 1 -- 172.21.15.33:0/2855105031 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efedc19f9f0 con 0x7efedc100a00 2024-09-12T12:26:08.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.162+0000 7efedad9d640 1 --2- 172.21.15.33:0/2855105031 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efedc1025b0 0x7efedc19f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:08.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.162+0000 7efeda59c640 1 --2- 172.21.15.33:0/2855105031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efedc100a00 0x7efedc069f30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efecc009230 tx=0x7efecc031a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:08.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.162+0000 7efecb7fe640 1 -- 172.21.15.33:0/2855105031 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efecc03f030 con 0x7efedc100a00 2024-09-12T12:26:08.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.162+0000 7efecb7fe640 1 -- 172.21.15.33:0/2855105031 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efecc003aa0 con 0x7efedc100a00 2024-09-12T12:26:08.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.163+0000 7efee0c53640 1 -- 172.21.15.33:0/2855105031 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efedc19fc80 con 0x7efedc100a00 2024-09-12T12:26:08.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.163+0000 7efecb7fe640 1 -- 172.21.15.33:0/2855105031 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efecc035070 con 0x7efedc100a00 2024-09-12T12:26:08.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.163+0000 7efee0c53640 1 -- 172.21.15.33:0/2855105031 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efedc1a0140 con 0x7efedc100a00 2024-09-12T12:26:08.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.163+0000 7efee0c53640 1 -- 172.21.15.33:0/2855105031 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efedc107f80 con 0x7efedc100a00 2024-09-12T12:26:08.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.165+0000 7efecb7fe640 1 -- 172.21.15.33:0/2855105031 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7efecc042030 con 0x7efedc100a00 2024-09-12T12:26:08.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.165+0000 7efecb7fe640 1 --2- 172.21.15.33:0/2855105031 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7efec40a2b90 0x7efec40a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:08.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.166+0000 7efed9d9b640 1 --2- 172.21.15.33:0/2855105031 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7efec40a2b90 0x7efec40a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:08.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.166+0000 7efecb7fe640 1 -- 172.21.15.33:0/2855105031 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7efecc0efcc0 con 0x7efedc100a00 2024-09-12T12:26:08.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.166+0000 7efed9d9b640 1 --2- 172.21.15.33:0/2855105031 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7efec40a2b90 0x7efec40a5050 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7efedc069ca0 tx=0x7efed0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:08.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.173+0000 7efecb7fe640 1 -- 172.21.15.33:0/2855105031 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efecc0bc240 con 0x7efedc100a00 2024-09-12T12:26:08.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.350+0000 7efee0c53640 1 -- 172.21.15.33:0/2855105031 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7efedc02d7c0 con 0x7efedc100a00 2024-09-12T12:26:08.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.350+0000 7efecb7fe640 1 -- 172.21.15.33:0/2855105031 <== mon.2 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) ==== 100+0+11 (secure 0 0 0) 0x7efecc0c0540 con 0x7efedc100a00 2024-09-12T12:26:08.351 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-09-12T12:26:08.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.352+0000 7efee0c53640 1 -- 172.21.15.33:0/2855105031 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7efec40a2b90 msgr2=0x7efec40a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:08.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.352+0000 7efee0c53640 1 --2- 172.21.15.33:0/2855105031 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7efec40a2b90 0x7efec40a5050 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7efedc069ca0 tx=0x7efed0005f90 comp rx=0 tx=0).stop 2024-09-12T12:26:08.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.352+0000 7efee0c53640 1 -- 172.21.15.33:0/2855105031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efedc100a00 msgr2=0x7efedc069f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:08.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.352+0000 7efee0c53640 1 --2- 172.21.15.33:0/2855105031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efedc100a00 0x7efedc069f30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efecc009230 tx=0x7efecc031a30 comp rx=0 tx=0).stop 2024-09-12T12:26:08.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.352+0000 7efee0c53640 1 -- 172.21.15.33:0/2855105031 shutdown_connections 2024-09-12T12:26:08.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.352+0000 7efee0c53640 1 --2- 172.21.15.33:0/2855105031 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7efec40a2b90 0x7efec40a5050 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:08.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.352+0000 7efee0c53640 1 --2- 172.21.15.33:0/2855105031 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efedc1025b0 0x7efedc19f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:08.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.352+0000 7efee0c53640 1 --2- 172.21.15.33:0/2855105031 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efedc101bf0 0x7efedc19cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:08.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.352+0000 7efee0c53640 1 --2- 172.21.15.33:0/2855105031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efedc100a00 0x7efedc069f30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:08.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.352+0000 7efee0c53640 1 -- 172.21.15.33:0/2855105031 >> 172.21.15.33:0/2855105031 conn(0x7efedc0fc140 msgr2=0x7efedc105150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:08.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.352+0000 7efee0c53640 1 -- 172.21.15.33:0/2855105031 shutdown_connections 2024-09-12T12:26:08.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.352+0000 7efee0c53640 1 -- 172.21.15.33:0/2855105031 wait complete. 2024-09-12T12:26:08.364 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-12T12:26:08.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:07 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/311562860' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-12T12:26:08.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:07 smithi043 ceph-mon[34144]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T12:26:08.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:07 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/4173504076' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:26:08.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:07 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/3952760312' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T12:26:08.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:07 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/311562860' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-12T12:26:08.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:07 smithi102 ceph-mon[34799]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T12:26:08.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:07 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/4173504076' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:26:08.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:07 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/3952760312' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T12:26:08.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.472+0000 7f42a70fa640 1 -- 172.21.15.33:0/1325557750 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42a01025b0 msgr2=0x7f42a0108e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:08.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.472+0000 7f42a70fa640 1 --2- 172.21.15.33:0/1325557750 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42a01025b0 0x7f42a0108e40 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4298009ca0 tx=0x7f429802a8c0 comp rx=0 tx=0).stop 2024-09-12T12:26:08.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.472+0000 7f42a70fa640 1 -- 172.21.15.33:0/1325557750 shutdown_connections 2024-09-12T12:26:08.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.472+0000 7f42a70fa640 1 --2- 172.21.15.33:0/1325557750 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42a01025b0 0x7f42a0108e40 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:08.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.472+0000 7f42a70fa640 1 --2- 172.21.15.33:0/1325557750 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42a0101bf0 0x7f42a0102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:08.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.472+0000 7f42a70fa640 1 --2- 172.21.15.33:0/1325557750 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42a0100a00 0x7f42a0100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:08.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.472+0000 7f42a70fa640 1 -- 172.21.15.33:0/1325557750 >> 172.21.15.33:0/1325557750 conn(0x7f42a00fc140 msgr2=0x7f42a00fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:08.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.472+0000 7f42a70fa640 1 -- 172.21.15.33:0/1325557750 shutdown_connections 2024-09-12T12:26:08.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.472+0000 7f42a70fa640 1 -- 172.21.15.33:0/1325557750 wait complete. 2024-09-12T12:26:08.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.472+0000 7f42a70fa640 1 Processor -- start 2024-09-12T12:26:08.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.473+0000 7f42a70fa640 1 -- start start 2024-09-12T12:26:08.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.473+0000 7f42a70fa640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42a0100a00 0x7f42a0197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:08.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.473+0000 7f42a70fa640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42a0101bf0 0x7f42a01981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:08.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.473+0000 7f42a70fa640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42a01025b0 0x7f42a019f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:08.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.473+0000 7f42a70fa640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f42a010c530 con 0x7f42a0101bf0 2024-09-12T12:26:08.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.473+0000 7f42a70fa640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f42a010c3b0 con 0x7f42a01025b0 2024-09-12T12:26:08.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.473+0000 7f42a70fa640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f42a010c6b0 con 0x7f42a0100a00 2024-09-12T12:26:08.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.473+0000 7f429ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42a0101bf0 0x7f42a01981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:08.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.473+0000 7f429ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42a0101bf0 0x7f42a01981e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60520/0 (socket says 172.21.15.33:60520) 2024-09-12T12:26:08.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.473+0000 7f429ffff640 1 -- 172.21.15.33:0/999041099 learned_addr learned my addr 172.21.15.33:0/999041099 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:08.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.473+0000 7f42a4e96640 1 --2- 172.21.15.33:0/999041099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42a0100a00 0x7f42a0197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:08.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.473+0000 7f42a5697640 1 --2- 172.21.15.33:0/999041099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42a01025b0 0x7f42a019f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:08.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.473+0000 7f429ffff640 1 -- 172.21.15.33:0/999041099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42a0100a00 msgr2=0x7f42a0197ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:08.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.473+0000 7f429ffff640 1 --2- 172.21.15.33:0/999041099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42a0100a00 0x7f42a0197ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:08.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.473+0000 7f429ffff640 1 -- 172.21.15.33:0/999041099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42a01025b0 msgr2=0x7f42a019f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:08.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.473+0000 7f429ffff640 1 --2- 172.21.15.33:0/999041099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42a01025b0 0x7f42a019f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:08.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.473+0000 7f429ffff640 1 -- 172.21.15.33:0/999041099 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42a019f8e0 con 0x7f42a0101bf0 2024-09-12T12:26:08.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.473+0000 7f429ffff640 1 --2- 172.21.15.33:0/999041099 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42a0101bf0 0x7f42a01981e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f428c00e9f0 tx=0x7f428c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:08.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.474+0000 7f429dffb640 1 -- 172.21.15.33:0/999041099 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f428c00cd80 con 0x7f42a0101bf0 2024-09-12T12:26:08.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.474+0000 7f42a70fa640 1 -- 172.21.15.33:0/999041099 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42a019fbd0 con 0x7f42a0101bf0 2024-09-12T12:26:08.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.474+0000 7f429dffb640 1 -- 172.21.15.33:0/999041099 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f428c0054d0 con 0x7f42a0101bf0 2024-09-12T12:26:08.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.474+0000 7f429dffb640 1 -- 172.21.15.33:0/999041099 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f428c010490 con 0x7f42a0101bf0 2024-09-12T12:26:08.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.474+0000 7f42a70fa640 1 -- 172.21.15.33:0/999041099 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42a01a0120 con 0x7f42a0101bf0 2024-09-12T12:26:08.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.475+0000 7f42a70fa640 1 -- 172.21.15.33:0/999041099 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42a01a0350 con 0x7f42a0101bf0 2024-09-12T12:26:08.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.476+0000 7f429dffb640 1 -- 172.21.15.33:0/999041099 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f428c005020 con 0x7f42a0101bf0 2024-09-12T12:26:08.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.477+0000 7f429dffb640 1 --2- 172.21.15.33:0/999041099 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f42900a2b90 0x7f42900a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:08.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.477+0000 7f42a4e96640 1 --2- 172.21.15.33:0/999041099 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f42900a2b90 0x7f42900a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:08.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.477+0000 7f429dffb640 1 -- 172.21.15.33:0/999041099 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f428c0cf790 con 0x7f42a0101bf0 2024-09-12T12:26:08.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.477+0000 7f42a4e96640 1 --2- 172.21.15.33:0/999041099 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f42900a2b90 0x7f42900a5050 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f42a0198b70 tx=0x7f4294005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:08.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.481+0000 7f429dffb640 1 -- 172.21.15.33:0/999041099 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f428c09c300 con 0x7f42a0101bf0 2024-09-12T12:26:08.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.656+0000 7f42a70fa640 1 -- 172.21.15.33:0/999041099 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f42a01a0520 con 0x7f42a0101bf0 2024-09-12T12:26:08.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.657+0000 7f429dffb640 1 -- 172.21.15.33:0/999041099 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v89) ==== 103+0+11 (secure 0 0 0) 0x7f428c09bc00 con 0x7f42a0101bf0 2024-09-12T12:26:08.658 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-09-12T12:26:08.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.659+0000 7f42a70fa640 1 -- 172.21.15.33:0/999041099 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f42900a2b90 msgr2=0x7f42900a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:08.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.659+0000 7f42a70fa640 1 --2- 172.21.15.33:0/999041099 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f42900a2b90 0x7f42900a5050 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f42a0198b70 tx=0x7f4294005f90 comp rx=0 tx=0).stop 2024-09-12T12:26:08.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.659+0000 7f42a70fa640 1 -- 172.21.15.33:0/999041099 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42a0101bf0 msgr2=0x7f42a01981e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:08.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.659+0000 7f42a70fa640 1 --2- 172.21.15.33:0/999041099 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42a0101bf0 0x7f42a01981e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f428c00e9f0 tx=0x7f428c00edf0 comp rx=0 tx=0).stop 2024-09-12T12:26:08.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.659+0000 7f42a70fa640 1 -- 172.21.15.33:0/999041099 shutdown_connections 2024-09-12T12:26:08.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.659+0000 7f42a70fa640 1 --2- 172.21.15.33:0/999041099 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f42900a2b90 0x7f42900a5050 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:08.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.659+0000 7f42a70fa640 1 --2- 172.21.15.33:0/999041099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42a01025b0 0x7f42a019f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:08.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.659+0000 7f42a70fa640 1 --2- 172.21.15.33:0/999041099 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42a0101bf0 0x7f42a01981e0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:08.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.659+0000 7f42a70fa640 1 --2- 172.21.15.33:0/999041099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42a0100a00 0x7f42a0197ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:08.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.659+0000 7f42a70fa640 1 -- 172.21.15.33:0/999041099 >> 172.21.15.33:0/999041099 conn(0x7f42a00fc140 msgr2=0x7f42a00fdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:08.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.659+0000 7f42a70fa640 1 -- 172.21.15.33:0/999041099 shutdown_connections 2024-09-12T12:26:08.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:08.659+0000 7f42a70fa640 1 -- 172.21.15.33:0/999041099 wait complete. 2024-09-12T12:26:08.671 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-12T12:26:08.671 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:26:08.930 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:26:09.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:08 smithi033 ceph-mon[31246]: pgmap v354: 129 pgs: 129 active+clean; 645 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 562 B/s wr, 6 op/s 2024-09-12T12:26:09.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:08 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/4240081578' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T12:26:09.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:08 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/2855105031' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T12:26:09.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:08 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/999041099' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-12T12:26:09.297 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:08 smithi102 ceph-mon[34799]: pgmap v354: 129 pgs: 129 active+clean; 645 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 562 B/s wr, 6 op/s 2024-09-12T12:26:09.298 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:08 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/4240081578' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T12:26:09.298 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:08 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/2855105031' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T12:26:09.298 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:08 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/999041099' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-12T12:26:09.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:08 smithi043 ceph-mon[34144]: pgmap v354: 129 pgs: 129 active+clean; 645 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 562 B/s wr, 6 op/s 2024-09-12T12:26:09.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:08 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/4240081578' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T12:26:09.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:08 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/2855105031' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T12:26:09.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:08 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/999041099' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-12T12:26:09.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.444+0000 7fd56db3c640 1 -- 172.21.15.33:0/75874035 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd568100e20 msgr2=0x7fd568101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:09.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.444+0000 7fd56db3c640 1 --2- 172.21.15.33:0/75874035 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd568100e20 0x7fd568101200 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd558009900 tx=0x7fd55802a480 comp rx=0 tx=0).stop 2024-09-12T12:26:09.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.444+0000 7fd56db3c640 1 -- 172.21.15.33:0/75874035 shutdown_connections 2024-09-12T12:26:09.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.444+0000 7fd56db3c640 1 --2- 172.21.15.33:0/75874035 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd568102ef0 0x7fd56810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:09.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.444+0000 7fd56db3c640 1 --2- 172.21.15.33:0/75874035 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd568102570 0x7fd5681029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:09.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.444+0000 7fd56db3c640 1 --2- 172.21.15.33:0/75874035 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd568100e20 0x7fd568101200 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:09.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.444+0000 7fd56db3c640 1 -- 172.21.15.33:0/75874035 >> 172.21.15.33:0/75874035 conn(0x7fd5680fc7d0 msgr2=0x7fd5680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:09.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.444+0000 7fd56db3c640 1 -- 172.21.15.33:0/75874035 shutdown_connections 2024-09-12T12:26:09.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.444+0000 7fd56db3c640 1 -- 172.21.15.33:0/75874035 wait complete. 2024-09-12T12:26:09.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.445+0000 7fd56db3c640 1 Processor -- start 2024-09-12T12:26:09.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.445+0000 7fd56db3c640 1 -- start start 2024-09-12T12:26:09.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.445+0000 7fd56db3c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd568100e20 0x7fd5680fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:09.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.445+0000 7fd56db3c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd568102570 0x7fd5680fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:09.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.445+0000 7fd56db3c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd568102ef0 0x7fd5680fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:09.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.445+0000 7fd56db3c640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd568110e30 con 0x7fd568102570 2024-09-12T12:26:09.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.445+0000 7fd56db3c640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd568110cb0 con 0x7fd568102ef0 2024-09-12T12:26:09.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.445+0000 7fd56db3c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd568110fb0 con 0x7fd568100e20 2024-09-12T12:26:09.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.445+0000 7fd55effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd568102570 0x7fd5680fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:09.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.445+0000 7fd55effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd568102570 0x7fd5680fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60524/0 (socket says 172.21.15.33:60524) 2024-09-12T12:26:09.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.445+0000 7fd55effd640 1 -- 172.21.15.33:0/276553591 learned_addr learned my addr 172.21.15.33:0/276553591 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:09.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.445+0000 7fd5677fe640 1 --2- 172.21.15.33:0/276553591 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd568100e20 0x7fd5680fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:09.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.446+0000 7fd567fff640 1 --2- 172.21.15.33:0/276553591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd568102ef0 0x7fd5680fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:09.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.446+0000 7fd55effd640 1 -- 172.21.15.33:0/276553591 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd568100e20 msgr2=0x7fd5680fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:09.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.446+0000 7fd55effd640 1 --2- 172.21.15.33:0/276553591 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd568100e20 0x7fd5680fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:09.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.446+0000 7fd55effd640 1 -- 172.21.15.33:0/276553591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd568102ef0 msgr2=0x7fd5680fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:09.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.446+0000 7fd55effd640 1 --2- 172.21.15.33:0/276553591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd568102ef0 0x7fd5680fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:09.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.446+0000 7fd55effd640 1 -- 172.21.15.33:0/276553591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5681a68e0 con 0x7fd568102570 2024-09-12T12:26:09.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.446+0000 7fd567fff640 1 --2- 172.21.15.33:0/276553591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd568102ef0 0x7fd5680fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:09.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.446+0000 7fd55effd640 1 --2- 172.21.15.33:0/276553591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd568102570 0x7fd5680fd1c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd55000d950 tx=0x7fd55000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:09.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.446+0000 7fd5657fa640 1 -- 172.21.15.33:0/276553591 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd550017030 con 0x7fd568102570 2024-09-12T12:26:09.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.446+0000 7fd56db3c640 1 -- 172.21.15.33:0/276553591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5681a6bd0 con 0x7fd568102570 2024-09-12T12:26:09.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.446+0000 7fd5657fa640 1 -- 172.21.15.33:0/276553591 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd550004020 con 0x7fd568102570 2024-09-12T12:26:09.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.446+0000 7fd5657fa640 1 -- 172.21.15.33:0/276553591 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5500047a0 con 0x7fd568102570 2024-09-12T12:26:09.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.446+0000 7fd56db3c640 1 -- 172.21.15.33:0/276553591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5681a7160 con 0x7fd568102570 2024-09-12T12:26:09.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.447+0000 7fd56db3c640 1 -- 172.21.15.33:0/276553591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd568101200 con 0x7fd568102570 2024-09-12T12:26:09.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.449+0000 7fd5657fa640 1 -- 172.21.15.33:0/276553591 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd5500041d0 con 0x7fd568102570 2024-09-12T12:26:09.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.449+0000 7fd5657fa640 1 --2- 172.21.15.33:0/276553591 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd5540a2b80 0x7fd5540a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:09.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.450+0000 7fd5657fa640 1 -- 172.21.15.33:0/276553591 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fd5500cf4d0 con 0x7fd568102570 2024-09-12T12:26:09.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.450+0000 7fd5677fe640 1 --2- 172.21.15.33:0/276553591 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd5540a2b80 0x7fd5540a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:09.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.450+0000 7fd5677fe640 1 --2- 172.21.15.33:0/276553591 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd5540a2b80 0x7fd5540a5040 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd558009230 tx=0x7fd5580058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:09.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.452+0000 7fd5657fa640 1 -- 172.21.15.33:0/276553591 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd55009c0a0 con 0x7fd568102570 2024-09-12T12:26:09.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.666+0000 7fd56db3c640 1 -- 172.21.15.33:0/276553591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd56810a0a0 con 0x7fd568102570 2024-09-12T12:26:09.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.667+0000 7fd5657fa640 1 -- 172.21.15.33:0/276553591 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11912 (secure 0 0 0) 0x7fd55009b9a0 con 0x7fd568102570 2024-09-12T12:26:09.668 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:26:09.668 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":25,"btime":"2024-09-12T12:26:06:963800+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3327066342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3327066342},{"type":"v1","addr":"172.21.15.33:6835","nonce":3327066342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/19516401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":19516401},{"type":"v1","addr":"172.21.15.33:6837","nonce":19516401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1260196118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1260196118},{"type":"v1","addr":"172.21.15.33:6839","nonce":1260196118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/4288248356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4288248356},{"type":"v1","addr":"172.21.15.33:6841","nonce":4288248356}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/3051073141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3051073141},{"type":"v1","addr":"172.21.15.43:6833","nonce":3051073141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3282762800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3282762800},{"type":"v1","addr":"172.21.15.43:6835","nonce":3282762800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:23:46.400609+0000","modified":"2024-09-12T12:26:06.067532+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24490,"mds_2":24478},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3051713000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3051713000},{"type":"v1","addr":"172.21.15.102:6833","nonce":3051713000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6837/2472064883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2472064883},{"type":"v1","addr":"172.21.15.43:6837","nonce":2472064883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/1987408860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":1987408860},{"type":"v1","addr":"172.21.15.43:6839","nonce":1987408860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/4179527539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":4179527539},{"type":"v1","addr":"172.21.15.102:6835","nonce":4179527539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/2409953270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2409953270},{"type":"v1","addr":"172.21.15.102:6837","nonce":2409953270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.102:6839/1553271340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":1553271340},{"type":"v1","addr":"172.21.15.102:6839","nonce":1553271340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24499,"qdb_cluster":[24499,24490,24478]},"id":1}]} 2024-09-12T12:26:09.669 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 25 2024-09-12T12:26:09.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.669+0000 7fd56db3c640 1 -- 172.21.15.33:0/276553591 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd5540a2b80 msgr2=0x7fd5540a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:09.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.669+0000 7fd56db3c640 1 --2- 172.21.15.33:0/276553591 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd5540a2b80 0x7fd5540a5040 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd558009230 tx=0x7fd5580058d0 comp rx=0 tx=0).stop 2024-09-12T12:26:09.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.669+0000 7fd56db3c640 1 -- 172.21.15.33:0/276553591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd568102570 msgr2=0x7fd5680fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:09.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.669+0000 7fd56db3c640 1 --2- 172.21.15.33:0/276553591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd568102570 0x7fd5680fd1c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd55000d950 tx=0x7fd55000de10 comp rx=0 tx=0).stop 2024-09-12T12:26:09.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.669+0000 7fd56db3c640 1 -- 172.21.15.33:0/276553591 shutdown_connections 2024-09-12T12:26:09.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.669+0000 7fd56db3c640 1 --2- 172.21.15.33:0/276553591 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd5540a2b80 0x7fd5540a5040 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:09.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.669+0000 7fd56db3c640 1 --2- 172.21.15.33:0/276553591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd568102ef0 0x7fd5680fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:09.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.669+0000 7fd56db3c640 1 --2- 172.21.15.33:0/276553591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd568102570 0x7fd5680fd1c0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:09.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.669+0000 7fd56db3c640 1 --2- 172.21.15.33:0/276553591 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd568100e20 0x7fd5680fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:09.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.669+0000 7fd56db3c640 1 -- 172.21.15.33:0/276553591 >> 172.21.15.33:0/276553591 conn(0x7fd5680fc7d0 msgr2=0x7fd56806a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:09.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.670+0000 7fd56db3c640 1 -- 172.21.15.33:0/276553591 shutdown_connections 2024-09-12T12:26:09.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:09.670+0000 7fd56db3c640 1 -- 172.21.15.33:0/276553591 wait complete. 2024-09-12T12:26:10.256 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:09 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/276553591' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:26:10.285 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-12T12:26:10.286 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-12T12:26:10.286 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:26:10.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:09 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/276553591' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:26:10.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.393+0000 7ffb4c265640 1 -- 172.21.15.33:0/3812762003 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb441025c0 msgr2=0x7ffb44108e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:10.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.393+0000 7ffb4c265640 1 --2- 172.21.15.33:0/3812762003 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb441025c0 0x7ffb44108e50 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c009ca0 tx=0x7ffb3c02a8c0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.393+0000 7ffb4c265640 1 -- 172.21.15.33:0/3812762003 shutdown_connections 2024-09-12T12:26:10.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.393+0000 7ffb4c265640 1 --2- 172.21.15.33:0/3812762003 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb441025c0 0x7ffb44108e50 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.393+0000 7ffb4c265640 1 --2- 172.21.15.33:0/3812762003 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb44101c00 0x7ffb44102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.393+0000 7ffb4c265640 1 --2- 172.21.15.33:0/3812762003 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb44100a10 0x7ffb44100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.393+0000 7ffb4c265640 1 -- 172.21.15.33:0/3812762003 >> 172.21.15.33:0/3812762003 conn(0x7ffb440fc170 msgr2=0x7ffb440fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:10.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.393+0000 7ffb4c265640 1 -- 172.21.15.33:0/3812762003 shutdown_connections 2024-09-12T12:26:10.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.393+0000 7ffb4c265640 1 -- 172.21.15.33:0/3812762003 wait complete. 2024-09-12T12:26:10.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.394+0000 7ffb4c265640 1 Processor -- start 2024-09-12T12:26:10.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.394+0000 7ffb4c265640 1 -- start start 2024-09-12T12:26:10.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.394+0000 7ffb4c265640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb44100a10 0x7ffb44197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.394+0000 7ffb4c265640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb44101c00 0x7ffb44198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.394+0000 7ffb4c265640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb441025c0 0x7ffb4419f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.394+0000 7ffb4c265640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ffb4410c570 con 0x7ffb44100a10 2024-09-12T12:26:10.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.394+0000 7ffb4c265640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ffb4410c3f0 con 0x7ffb44101c00 2024-09-12T12:26:10.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.394+0000 7ffb4c265640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ffb4410c6f0 con 0x7ffb441025c0 2024-09-12T12:26:10.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.394+0000 7ffb4a001640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb44100a10 0x7ffb44197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.394+0000 7ffb4a001640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb44100a10 0x7ffb44197d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60538/0 (socket says 172.21.15.33:60538) 2024-09-12T12:26:10.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.394+0000 7ffb4a001640 1 -- 172.21.15.33:0/3502158473 learned_addr learned my addr 172.21.15.33:0/3502158473 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:10.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.395+0000 7ffb49800640 1 --2- 172.21.15.33:0/3502158473 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb44101c00 0x7ffb44198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.395+0000 7ffb4a802640 1 --2- 172.21.15.33:0/3502158473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb441025c0 0x7ffb4419f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.395+0000 7ffb4a001640 1 -- 172.21.15.33:0/3502158473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb441025c0 msgr2=0x7ffb4419f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:10.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.395+0000 7ffb4a001640 1 --2- 172.21.15.33:0/3502158473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb441025c0 0x7ffb4419f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.395+0000 7ffb4a001640 1 -- 172.21.15.33:0/3502158473 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb44101c00 msgr2=0x7ffb44198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:10.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.395+0000 7ffb4a001640 1 --2- 172.21.15.33:0/3502158473 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb44101c00 0x7ffb44198280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.395+0000 7ffb4a001640 1 -- 172.21.15.33:0/3502158473 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb4419f950 con 0x7ffb44100a10 2024-09-12T12:26:10.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.395+0000 7ffb49800640 1 --2- 172.21.15.33:0/3502158473 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb44101c00 0x7ffb44198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:10.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.395+0000 7ffb4a001640 1 --2- 172.21.15.33:0/3502158473 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb44100a10 0x7ffb44197d40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ffb4000d770 tx=0x7ffb4000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:10.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.395+0000 7ffb3affd640 1 -- 172.21.15.33:0/3502158473 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb40017070 con 0x7ffb44100a10 2024-09-12T12:26:10.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.395+0000 7ffb3affd640 1 -- 172.21.15.33:0/3502158473 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffb40009c30 con 0x7ffb44100a10 2024-09-12T12:26:10.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.395+0000 7ffb4c265640 1 -- 172.21.15.33:0/3502158473 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb4419fc40 con 0x7ffb44100a10 2024-09-12T12:26:10.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.395+0000 7ffb3affd640 1 -- 172.21.15.33:0/3502158473 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb40003d00 con 0x7ffb44100a10 2024-09-12T12:26:10.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.395+0000 7ffb4c265640 1 -- 172.21.15.33:0/3502158473 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb441a0190 con 0x7ffb44100a10 2024-09-12T12:26:10.400 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:09 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/276553591' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:26:10.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.396+0000 7ffb4c265640 1 -- 172.21.15.33:0/3502158473 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb441a0360 con 0x7ffb44100a10 2024-09-12T12:26:10.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.397+0000 7ffb3affd640 1 -- 172.21.15.33:0/3502158473 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ffb40003ea0 con 0x7ffb44100a10 2024-09-12T12:26:10.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.398+0000 7ffb3affd640 1 --2- 172.21.15.33:0/3502158473 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ffb300a2b90 0x7ffb300a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.398+0000 7ffb3affd640 1 -- 172.21.15.33:0/3502158473 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7ffb400cf280 con 0x7ffb44100a10 2024-09-12T12:26:10.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.398+0000 7ffb49800640 1 --2- 172.21.15.33:0/3502158473 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ffb300a2b90 0x7ffb300a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.399+0000 7ffb49800640 1 --2- 172.21.15.33:0/3502158473 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ffb300a2b90 0x7ffb300a5050 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ffb34009c20 tx=0x7ffb34005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:10.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.402+0000 7ffb3affd640 1 -- 172.21.15.33:0/3502158473 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffb4009be50 con 0x7ffb44100a10 2024-09-12T12:26:10.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.602+0000 7ffb4c265640 1 -- 172.21.15.33:0/3502158473 --> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffb44069b00 con 0x7ffb300a2b90 2024-09-12T12:26:10.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.610+0000 7ffb3affd640 1 -- 172.21.15.33:0/3502158473 <== mgr.14150 v2:172.21.15.33:6800/176202431 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340763 (secure 0 0 0) 0x7ffb44069b00 con 0x7ffb300a2b90 2024-09-12T12:26:10.615 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:26:10.617 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-12T12:26:10.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.614+0000 7ffb4c265640 1 -- 172.21.15.33:0/3502158473 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ffb300a2b90 msgr2=0x7ffb300a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:10.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.614+0000 7ffb4c265640 1 --2- 172.21.15.33:0/3502158473 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ffb300a2b90 0x7ffb300a5050 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ffb34009c20 tx=0x7ffb34005f90 comp rx=0 tx=0).stop 2024-09-12T12:26:10.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.614+0000 7ffb4c265640 1 -- 172.21.15.33:0/3502158473 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb44100a10 msgr2=0x7ffb44197d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:10.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.614+0000 7ffb4c265640 1 --2- 172.21.15.33:0/3502158473 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb44100a10 0x7ffb44197d40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ffb4000d770 tx=0x7ffb4000dc30 comp rx=0 tx=0).stop 2024-09-12T12:26:10.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.614+0000 7ffb4c265640 1 -- 172.21.15.33:0/3502158473 shutdown_connections 2024-09-12T12:26:10.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.614+0000 7ffb4c265640 1 --2- 172.21.15.33:0/3502158473 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ffb300a2b90 0x7ffb300a5050 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.614+0000 7ffb4c265640 1 --2- 172.21.15.33:0/3502158473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb441025c0 0x7ffb4419f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.614+0000 7ffb4c265640 1 --2- 172.21.15.33:0/3502158473 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb44101c00 0x7ffb44198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.614+0000 7ffb4c265640 1 --2- 172.21.15.33:0/3502158473 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb44100a10 0x7ffb44197d40 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.614+0000 7ffb4c265640 1 -- 172.21.15.33:0/3502158473 >> 172.21.15.33:0/3502158473 conn(0x7ffb440fc170 msgr2=0x7ffb440693f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:10.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.614+0000 7ffb4c265640 1 -- 172.21.15.33:0/3502158473 shutdown_connections 2024-09-12T12:26:10.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.614+0000 7ffb4c265640 1 -- 172.21.15.33:0/3502158473 wait complete. 2024-09-12T12:26:10.626 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":355,"stamp":"2024-09-12T12:26:09.912063+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":664934,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":753,"num_read_kb":502,"num_write":369,"num_write_kb":3074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":1181980,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":797,"ondisk_log_size":797,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":386280,"kb_used_data":12024,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124555544,"statfs":{"total":1151940427776,"available":1151544877056,"internally_reserved":0,"allocated":12312576,"data_stored":8101064,"data_compressed":463602,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19141,"internal_metadata":382973243},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5940,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":39,"num_write":10,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.104443"},"pg_stats":[{"pgid":"2.1f","version":"85'9","reported_seq":48,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.809152+0000","last_change":"2024-09-12T12:23:43.779951+0000","last_active":"2024-09-12T12:25:59.809152+0000","last_peered":"2024-09-12T12:25:59.809152+0000","last_clean":"2024-09-12T12:25:59.809152+0000","last_became_active":"2024-09-12T12:23:43.779641+0000","last_became_peered":"2024-09-12T12:23:43.779641+0000","last_unstale":"2024-09-12T12:25:59.809152+0000","last_undegraded":"2024-09-12T12:25:59.809152+0000","last_fullsized":"2024-09-12T12:25:59.809152+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:49.594196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321799+0000","last_change":"2024-09-12T12:23:45.873591+0000","last_active":"2024-09-12T12:26:00.321799+0000","last_peered":"2024-09-12T12:26:00.321799+0000","last_clean":"2024-09-12T12:26:00.321799+0000","last_became_active":"2024-09-12T12:23:45.873295+0000","last_became_peered":"2024-09-12T12:23:45.873295+0000","last_unstale":"2024-09-12T12:26:00.321799+0000","last_undegraded":"2024-09-12T12:26:00.321799+0000","last_fullsized":"2024-09-12T12:26:00.321799+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:49.907824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.811834+0000","last_change":"2024-09-12T12:24:59.128750+0000","last_active":"2024-09-12T12:25:59.811834+0000","last_peered":"2024-09-12T12:25:59.811834+0000","last_clean":"2024-09-12T12:25:59.811834+0000","last_became_active":"2024-09-12T12:24:59.128296+0000","last_became_peered":"2024-09-12T12:24:59.128296+0000","last_unstale":"2024-09-12T12:25:59.811834+0000","last_undegraded":"2024-09-12T12:25:59.811834+0000","last_fullsized":"2024-09-12T12:25:59.811834+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:12:57.582164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321314+0000","last_change":"2024-09-12T12:23:43.835297+0000","last_active":"2024-09-12T12:26:00.321314+0000","last_peered":"2024-09-12T12:26:00.321314+0000","last_clean":"2024-09-12T12:26:00.321314+0000","last_became_active":"2024-09-12T12:23:43.834971+0000","last_became_peered":"2024-09-12T12:23:43.834971+0000","last_unstale":"2024-09-12T12:26:00.321314+0000","last_undegraded":"2024-09-12T12:26:00.321314+0000","last_fullsized":"2024-09-12T12:26:00.321314+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:00:07.128092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.815257+0000","last_change":"2024-09-12T12:23:45.876388+0000","last_active":"2024-09-12T12:25:59.815257+0000","last_peered":"2024-09-12T12:25:59.815257+0000","last_clean":"2024-09-12T12:25:59.815257+0000","last_became_active":"2024-09-12T12:23:45.876090+0000","last_became_peered":"2024-09-12T12:23:45.876090+0000","last_unstale":"2024-09-12T12:25:59.815257+0000","last_undegraded":"2024-09-12T12:25:59.815257+0000","last_fullsized":"2024-09-12T12:25:59.815257+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:02.576991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814026+0000","last_change":"2024-09-12T12:23:52.904665+0000","last_active":"2024-09-12T12:25:59.814026+0000","last_peered":"2024-09-12T12:25:59.814026+0000","last_clean":"2024-09-12T12:25:59.814026+0000","last_became_active":"2024-09-12T12:23:52.903758+0000","last_became_peered":"2024-09-12T12:23:52.903758+0000","last_unstale":"2024-09-12T12:25:59.814026+0000","last_undegraded":"2024-09-12T12:25:59.814026+0000","last_fullsized":"2024-09-12T12:25:59.814026+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:48.510180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"85'4","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322074+0000","last_change":"2024-09-12T12:24:59.134194+0000","last_active":"2024-09-12T12:26:00.322074+0000","last_peered":"2024-09-12T12:26:00.322074+0000","last_clean":"2024-09-12T12:26:00.322074+0000","last_became_active":"2024-09-12T12:24:59.124651+0000","last_became_peered":"2024-09-12T12:24:59.124651+0000","last_unstale":"2024-09-12T12:26:00.322074+0000","last_undegraded":"2024-09-12T12:26:00.322074+0000","last_fullsized":"2024-09-12T12:26:00.322074+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:59:26.516659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322398+0000","last_change":"2024-09-12T12:23:45.863775+0000","last_active":"2024-09-12T12:26:00.322398+0000","last_peered":"2024-09-12T12:26:00.322398+0000","last_clean":"2024-09-12T12:26:00.322398+0000","last_became_active":"2024-09-12T12:23:45.863437+0000","last_became_peered":"2024-09-12T12:23:45.863437+0000","last_unstale":"2024-09-12T12:26:00.322398+0000","last_undegraded":"2024-09-12T12:26:00.322398+0000","last_fullsized":"2024-09-12T12:26:00.322398+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:33.539904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814227+0000","last_change":"2024-09-12T12:23:52.902674+0000","last_active":"2024-09-12T12:25:59.814227+0000","last_peered":"2024-09-12T12:25:59.814227+0000","last_clean":"2024-09-12T12:25:59.814227+0000","last_became_active":"2024-09-12T12:23:52.902130+0000","last_became_peered":"2024-09-12T12:23:52.902130+0000","last_unstale":"2024-09-12T12:25:59.814227+0000","last_undegraded":"2024-09-12T12:25:59.814227+0000","last_fullsized":"2024-09-12T12:25:59.814227+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:24.867630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321932+0000","last_change":"2024-09-12T12:24:59.144624+0000","last_active":"2024-09-12T12:26:00.321932+0000","last_peered":"2024-09-12T12:26:00.321932+0000","last_clean":"2024-09-12T12:26:00.321932+0000","last_became_active":"2024-09-12T12:24:59.129929+0000","last_became_peered":"2024-09-12T12:24:59.129929+0000","last_unstale":"2024-09-12T12:26:00.321932+0000","last_undegraded":"2024-09-12T12:26:00.321932+0000","last_fullsized":"2024-09-12T12:26:00.321932+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:05.959920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":48,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810614+0000","last_change":"2024-09-12T12:23:45.878131+0000","last_active":"2024-09-12T12:25:59.810614+0000","last_peered":"2024-09-12T12:25:59.810614+0000","last_clean":"2024-09-12T12:25:59.810614+0000","last_became_active":"2024-09-12T12:23:45.877838+0000","last_became_peered":"2024-09-12T12:23:45.877838+0000","last_unstale":"2024-09-12T12:25:59.810614+0000","last_undegraded":"2024-09-12T12:25:59.810614+0000","last_fullsized":"2024-09-12T12:25:59.810614+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:31.029515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814081+0000","last_change":"2024-09-12T12:23:52.900871+0000","last_active":"2024-09-12T12:25:59.814081+0000","last_peered":"2024-09-12T12:25:59.814081+0000","last_clean":"2024-09-12T12:25:59.814081+0000","last_became_active":"2024-09-12T12:23:52.900339+0000","last_became_peered":"2024-09-12T12:23:52.900339+0000","last_unstale":"2024-09-12T12:25:59.814081+0000","last_undegraded":"2024-09-12T12:25:59.814081+0000","last_fullsized":"2024-09-12T12:25:59.814081+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:24.778852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.809887+0000","last_change":"2024-09-12T12:23:45.879124+0000","last_active":"2024-09-12T12:25:59.809887+0000","last_peered":"2024-09-12T12:25:59.809887+0000","last_clean":"2024-09-12T12:25:59.809887+0000","last_became_active":"2024-09-12T12:23:45.878770+0000","last_became_peered":"2024-09-12T12:23:45.878770+0000","last_unstale":"2024-09-12T12:25:59.809887+0000","last_undegraded":"2024-09-12T12:25:59.809887+0000","last_fullsized":"2024-09-12T12:25:59.809887+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:58.767155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322839+0000","last_change":"2024-09-12T12:23:43.782666+0000","last_active":"2024-09-12T12:26:00.322839+0000","last_peered":"2024-09-12T12:26:00.322839+0000","last_clean":"2024-09-12T12:26:00.322839+0000","last_became_active":"2024-09-12T12:23:43.782235+0000","last_became_peered":"2024-09-12T12:23:43.782235+0000","last_unstale":"2024-09-12T12:26:00.322839+0000","last_undegraded":"2024-09-12T12:26:00.322839+0000","last_fullsized":"2024-09-12T12:26:00.322839+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:28.499038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814599+0000","last_change":"2024-09-12T12:23:52.933933+0000","last_active":"2024-09-12T12:25:59.814599+0000","last_peered":"2024-09-12T12:25:59.814599+0000","last_clean":"2024-09-12T12:25:59.814599+0000","last_became_active":"2024-09-12T12:23:52.933500+0000","last_became_peered":"2024-09-12T12:23:52.933500+0000","last_unstale":"2024-09-12T12:25:59.814599+0000","last_undegraded":"2024-09-12T12:25:59.814599+0000","last_fullsized":"2024-09-12T12:25:59.814599+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:28.598435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321671+0000","last_change":"2024-09-12T12:23:45.868518+0000","last_active":"2024-09-12T12:26:00.321671+0000","last_peered":"2024-09-12T12:26:00.321671+0000","last_clean":"2024-09-12T12:26:00.321671+0000","last_became_active":"2024-09-12T12:23:45.868198+0000","last_became_peered":"2024-09-12T12:23:45.868198+0000","last_unstale":"2024-09-12T12:26:00.321671+0000","last_undegraded":"2024-09-12T12:26:00.321671+0000","last_fullsized":"2024-09-12T12:26:00.321671+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:53.815362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"89'2","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.812077+0000","last_change":"2024-09-12T12:23:43.785481+0000","last_active":"2024-09-12T12:25:59.812077+0000","last_peered":"2024-09-12T12:25:59.812077+0000","last_clean":"2024-09-12T12:25:59.812077+0000","last_became_active":"2024-09-12T12:23:43.783842+0000","last_became_peered":"2024-09-12T12:23:43.783842+0000","last_unstale":"2024-09-12T12:25:59.812077+0000","last_undegraded":"2024-09-12T12:25:59.812077+0000","last_fullsized":"2024-09-12T12:25:59.812077+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:45:30.080456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"85'1","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814384+0000","last_change":"2024-09-12T12:23:52.898648+0000","last_active":"2024-09-12T12:25:59.814384+0000","last_peered":"2024-09-12T12:25:59.814384+0000","last_clean":"2024-09-12T12:25:59.814384+0000","last_became_active":"2024-09-12T12:23:52.898242+0000","last_became_peered":"2024-09-12T12:23:52.898242+0000","last_unstale":"2024-09-12T12:25:59.814384+0000","last_undegraded":"2024-09-12T12:25:59.814384+0000","last_fullsized":"2024-09-12T12:25:59.814384+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:49:30.598747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322181+0000","last_change":"2024-09-12T12:23:45.873067+0000","last_active":"2024-09-12T12:26:00.322181+0000","last_peered":"2024-09-12T12:26:00.322181+0000","last_clean":"2024-09-12T12:26:00.322181+0000","last_became_active":"2024-09-12T12:23:45.872616+0000","last_became_peered":"2024-09-12T12:23:45.872616+0000","last_unstale":"2024-09-12T12:26:00.322181+0000","last_undegraded":"2024-09-12T12:26:00.322181+0000","last_fullsized":"2024-09-12T12:26:00.322181+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:10.960252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"85'3","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321830+0000","last_change":"2024-09-12T12:23:43.780706+0000","last_active":"2024-09-12T12:26:00.321830+0000","last_peered":"2024-09-12T12:26:00.321830+0000","last_clean":"2024-09-12T12:26:00.321830+0000","last_became_active":"2024-09-12T12:23:43.780387+0000","last_became_peered":"2024-09-12T12:23:43.780387+0000","last_unstale":"2024-09-12T12:26:00.321830+0000","last_undegraded":"2024-09-12T12:26:00.321830+0000","last_fullsized":"2024-09-12T12:26:00.321830+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:54.748461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.809046+0000","last_change":"2024-09-12T12:23:52.902225+0000","last_active":"2024-09-12T12:25:59.809046+0000","last_peered":"2024-09-12T12:25:59.809046+0000","last_clean":"2024-09-12T12:25:59.809046+0000","last_became_active":"2024-09-12T12:23:52.901865+0000","last_became_peered":"2024-09-12T12:23:52.901865+0000","last_unstale":"2024-09-12T12:25:59.809046+0000","last_undegraded":"2024-09-12T12:25:59.809046+0000","last_fullsized":"2024-09-12T12:25:59.809046+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:38.020994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322291+0000","last_change":"2024-09-12T12:23:45.875816+0000","last_active":"2024-09-12T12:26:00.322291+0000","last_peered":"2024-09-12T12:26:00.322291+0000","last_clean":"2024-09-12T12:26:00.322291+0000","last_became_active":"2024-09-12T12:23:45.875419+0000","last_became_peered":"2024-09-12T12:23:45.875419+0000","last_unstale":"2024-09-12T12:26:00.322291+0000","last_undegraded":"2024-09-12T12:26:00.322291+0000","last_fullsized":"2024-09-12T12:26:00.322291+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:14:04.616759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321856+0000","last_change":"2024-09-12T12:23:43.836699+0000","last_active":"2024-09-12T12:26:00.321856+0000","last_peered":"2024-09-12T12:26:00.321856+0000","last_clean":"2024-09-12T12:26:00.321856+0000","last_became_active":"2024-09-12T12:23:43.836341+0000","last_became_peered":"2024-09-12T12:23:43.836341+0000","last_unstale":"2024-09-12T12:26:00.321856+0000","last_undegraded":"2024-09-12T12:26:00.321856+0000","last_fullsized":"2024-09-12T12:26:00.321856+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:40:02.767132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814522+0000","last_change":"2024-09-12T12:23:52.933594+0000","last_active":"2024-09-12T12:25:59.814522+0000","last_peered":"2024-09-12T12:25:59.814522+0000","last_clean":"2024-09-12T12:25:59.814522+0000","last_became_active":"2024-09-12T12:23:52.933197+0000","last_became_peered":"2024-09-12T12:23:52.933197+0000","last_unstale":"2024-09-12T12:25:59.814522+0000","last_undegraded":"2024-09-12T12:25:59.814522+0000","last_fullsized":"2024-09-12T12:25:59.814522+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:34.990674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.815013+0000","last_change":"2024-09-12T12:23:45.881962+0000","last_active":"2024-09-12T12:25:59.815013+0000","last_peered":"2024-09-12T12:25:59.815013+0000","last_clean":"2024-09-12T12:25:59.815013+0000","last_became_active":"2024-09-12T12:23:45.881697+0000","last_became_peered":"2024-09-12T12:23:45.881697+0000","last_unstale":"2024-09-12T12:25:59.815013+0000","last_undegraded":"2024-09-12T12:25:59.815013+0000","last_fullsized":"2024-09-12T12:25:59.815013+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:35:49.369852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814697+0000","last_change":"2024-09-12T12:23:44.235206+0000","last_active":"2024-09-12T12:25:59.814697+0000","last_peered":"2024-09-12T12:25:59.814697+0000","last_clean":"2024-09-12T12:25:59.814697+0000","last_became_active":"2024-09-12T12:23:44.234797+0000","last_became_peered":"2024-09-12T12:23:44.234797+0000","last_unstale":"2024-09-12T12:25:59.814697+0000","last_undegraded":"2024-09-12T12:25:59.814697+0000","last_fullsized":"2024-09-12T12:25:59.814697+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:51.130077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.812112+0000","last_change":"2024-09-12T12:23:52.902763+0000","last_active":"2024-09-12T12:25:59.812112+0000","last_peered":"2024-09-12T12:25:59.812112+0000","last_clean":"2024-09-12T12:25:59.812112+0000","last_became_active":"2024-09-12T12:23:52.902362+0000","last_became_peered":"2024-09-12T12:23:52.902362+0000","last_unstale":"2024-09-12T12:25:59.812112+0000","last_undegraded":"2024-09-12T12:25:59.812112+0000","last_fullsized":"2024-09-12T12:25:59.812112+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:39.481290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321863+0000","last_change":"2024-09-12T12:23:45.875014+0000","last_active":"2024-09-12T12:26:00.321863+0000","last_peered":"2024-09-12T12:26:00.321863+0000","last_clean":"2024-09-12T12:26:00.321863+0000","last_became_active":"2024-09-12T12:23:45.874673+0000","last_became_peered":"2024-09-12T12:23:45.874673+0000","last_unstale":"2024-09-12T12:26:00.321863+0000","last_undegraded":"2024-09-12T12:26:00.321863+0000","last_fullsized":"2024-09-12T12:26:00.321863+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:21.035185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'14","reported_seq":52,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.809082+0000","last_change":"2024-09-12T12:23:43.778558+0000","last_active":"2024-09-12T12:25:59.809082+0000","last_peered":"2024-09-12T12:25:59.809082+0000","last_clean":"2024-09-12T12:25:59.809082+0000","last_became_active":"2024-09-12T12:23:43.778194+0000","last_became_peered":"2024-09-12T12:23:43.778194+0000","last_unstale":"2024-09-12T12:25:59.809082+0000","last_undegraded":"2024-09-12T12:25:59.809082+0000","last_fullsized":"2024-09-12T12:25:59.809082+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:11.625462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321376+0000","last_change":"2024-09-12T12:23:52.933833+0000","last_active":"2024-09-12T12:26:00.321376+0000","last_peered":"2024-09-12T12:26:00.321376+0000","last_clean":"2024-09-12T12:26:00.321376+0000","last_became_active":"2024-09-12T12:23:52.933330+0000","last_became_peered":"2024-09-12T12:23:52.933330+0000","last_unstale":"2024-09-12T12:26:00.321376+0000","last_undegraded":"2024-09-12T12:26:00.321376+0000","last_fullsized":"2024-09-12T12:26:00.321376+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:31.129088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.951968+0000","last_change":"2024-09-12T12:23:45.872527+0000","last_active":"2024-09-12T12:25:59.951968+0000","last_peered":"2024-09-12T12:25:59.951968+0000","last_clean":"2024-09-12T12:25:59.951968+0000","last_became_active":"2024-09-12T12:23:45.872220+0000","last_became_peered":"2024-09-12T12:23:45.872220+0000","last_unstale":"2024-09-12T12:25:59.951968+0000","last_undegraded":"2024-09-12T12:25:59.951968+0000","last_fullsized":"2024-09-12T12:25:59.951968+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:38:08.734145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"85'1","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321937+0000","last_change":"2024-09-12T12:23:43.835824+0000","last_active":"2024-09-12T12:26:00.321937+0000","last_peered":"2024-09-12T12:26:00.321937+0000","last_clean":"2024-09-12T12:26:00.321937+0000","last_became_active":"2024-09-12T12:23:43.835375+0000","last_became_peered":"2024-09-12T12:23:43.835375+0000","last_unstale":"2024-09-12T12:26:00.321937+0000","last_undegraded":"2024-09-12T12:26:00.321937+0000","last_fullsized":"2024-09-12T12:26:00.321937+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:58:57.547060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321968+0000","last_change":"2024-09-12T12:23:52.901739+0000","last_active":"2024-09-12T12:26:00.321968+0000","last_peered":"2024-09-12T12:26:00.321968+0000","last_clean":"2024-09-12T12:26:00.321968+0000","last_became_active":"2024-09-12T12:23:52.901370+0000","last_became_peered":"2024-09-12T12:23:52.901370+0000","last_unstale":"2024-09-12T12:26:00.321968+0000","last_undegraded":"2024-09-12T12:26:00.321968+0000","last_fullsized":"2024-09-12T12:26:00.321968+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:56:44.430446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"87'4","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.812122+0000","last_change":"2024-09-12T12:23:45.870491+0000","last_active":"2024-09-12T12:25:59.812122+0000","last_peered":"2024-09-12T12:25:59.812122+0000","last_clean":"2024-09-12T12:25:59.812122+0000","last_became_active":"2024-09-12T12:23:45.870182+0000","last_became_peered":"2024-09-12T12:23:45.870182+0000","last_unstale":"2024-09-12T12:25:59.812122+0000","last_undegraded":"2024-09-12T12:25:59.812122+0000","last_fullsized":"2024-09-12T12:25:59.812122+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:07.094287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.808939+0000","last_change":"2024-09-12T12:23:43.837430+0000","last_active":"2024-09-12T12:25:59.808939+0000","last_peered":"2024-09-12T12:25:59.808939+0000","last_clean":"2024-09-12T12:25:59.808939+0000","last_became_active":"2024-09-12T12:23:43.837091+0000","last_became_peered":"2024-09-12T12:23:43.837091+0000","last_unstale":"2024-09-12T12:25:59.808939+0000","last_undegraded":"2024-09-12T12:25:59.808939+0000","last_fullsized":"2024-09-12T12:25:59.808939+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:30.841341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322490+0000","last_change":"2024-09-12T12:24:59.175376+0000","last_active":"2024-09-12T12:26:00.322490+0000","last_peered":"2024-09-12T12:26:00.322490+0000","last_clean":"2024-09-12T12:26:00.322490+0000","last_became_active":"2024-09-12T12:24:59.174967+0000","last_became_peered":"2024-09-12T12:24:59.174967+0000","last_unstale":"2024-09-12T12:26:00.322490+0000","last_undegraded":"2024-09-12T12:26:00.322490+0000","last_fullsized":"2024-09-12T12:26:00.322490+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:40.039227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.815721+0000","last_change":"2024-09-12T12:25:59.815721+0000","last_active":"2024-09-12T12:25:59.815721+0000","last_peered":"2024-09-12T12:25:59.815721+0000","last_clean":"2024-09-12T12:25:59.815721+0000","last_became_active":"2024-09-12T12:25:59.815320+0000","last_became_peered":"2024-09-12T12:25:59.815320+0000","last_unstale":"2024-09-12T12:25:59.815721+0000","last_undegraded":"2024-09-12T12:25:59.815721+0000","last_fullsized":"2024-09-12T12:25:59.815721+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:05.327484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'1","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810114+0000","last_change":"2024-09-12T12:23:43.787082+0000","last_active":"2024-09-12T12:25:59.810114+0000","last_peered":"2024-09-12T12:25:59.810114+0000","last_clean":"2024-09-12T12:25:59.810114+0000","last_became_active":"2024-09-12T12:23:43.786619+0000","last_became_peered":"2024-09-12T12:23:43.786619+0000","last_unstale":"2024-09-12T12:25:59.810114+0000","last_undegraded":"2024-09-12T12:25:59.810114+0000","last_fullsized":"2024-09-12T12:25:59.810114+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:21.120020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.951781+0000","last_change":"2024-09-12T12:23:52.899659+0000","last_active":"2024-09-12T12:25:59.951781+0000","last_peered":"2024-09-12T12:25:59.951781+0000","last_clean":"2024-09-12T12:25:59.951781+0000","last_became_active":"2024-09-12T12:23:52.899226+0000","last_became_peered":"2024-09-12T12:23:52.899226+0000","last_unstale":"2024-09-12T12:25:59.951781+0000","last_undegraded":"2024-09-12T12:25:59.951781+0000","last_fullsized":"2024-09-12T12:25:59.951781+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:41.979174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.809913+0000","last_change":"2024-09-12T12:23:45.879112+0000","last_active":"2024-09-12T12:25:59.809913+0000","last_peered":"2024-09-12T12:25:59.809913+0000","last_clean":"2024-09-12T12:25:59.809913+0000","last_became_active":"2024-09-12T12:23:45.878684+0000","last_became_peered":"2024-09-12T12:23:45.878684+0000","last_unstale":"2024-09-12T12:25:59.809913+0000","last_undegraded":"2024-09-12T12:25:59.809913+0000","last_fullsized":"2024-09-12T12:25:59.809913+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:11:18.102437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'5","reported_seq":142,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:05.316480+0000","last_change":"2024-09-12T12:23:43.835282+0000","last_active":"2024-09-12T12:26:05.316480+0000","last_peered":"2024-09-12T12:26:05.316480+0000","last_clean":"2024-09-12T12:26:05.316480+0000","last_became_active":"2024-09-12T12:23:43.834929+0000","last_became_peered":"2024-09-12T12:23:43.834929+0000","last_unstale":"2024-09-12T12:26:05.316480+0000","last_undegraded":"2024-09-12T12:26:05.316480+0000","last_fullsized":"2024-09-12T12:26:05.316480+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:59:11.516387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.951956+0000","last_change":"2024-09-12T12:23:52.934077+0000","last_active":"2024-09-12T12:25:59.951956+0000","last_peered":"2024-09-12T12:25:59.951956+0000","last_clean":"2024-09-12T12:25:59.951956+0000","last_became_active":"2024-09-12T12:23:52.933583+0000","last_became_peered":"2024-09-12T12:23:52.933583+0000","last_unstale":"2024-09-12T12:25:59.951956+0000","last_undegraded":"2024-09-12T12:25:59.951956+0000","last_fullsized":"2024-09-12T12:25:59.951956+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:06.570624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.951541+0000","last_change":"2024-09-12T12:23:45.875735+0000","last_active":"2024-09-12T12:25:59.951541+0000","last_peered":"2024-09-12T12:25:59.951541+0000","last_clean":"2024-09-12T12:25:59.951541+0000","last_became_active":"2024-09-12T12:23:45.875072+0000","last_became_peered":"2024-09-12T12:23:45.875072+0000","last_unstale":"2024-09-12T12:25:59.951541+0000","last_undegraded":"2024-09-12T12:25:59.951541+0000","last_fullsized":"2024-09-12T12:25:59.951541+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:10.508123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'3","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.809765+0000","last_change":"2024-09-12T12:23:43.785226+0000","last_active":"2024-09-12T12:25:59.809765+0000","last_peered":"2024-09-12T12:25:59.809765+0000","last_clean":"2024-09-12T12:25:59.809765+0000","last_became_active":"2024-09-12T12:23:43.783705+0000","last_became_peered":"2024-09-12T12:23:43.783705+0000","last_unstale":"2024-09-12T12:25:59.809765+0000","last_undegraded":"2024-09-12T12:25:59.809765+0000","last_fullsized":"2024-09-12T12:25:59.809765+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:21.269569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810532+0000","last_change":"2024-09-12T12:23:52.934383+0000","last_active":"2024-09-12T12:25:59.810532+0000","last_peered":"2024-09-12T12:25:59.810532+0000","last_clean":"2024-09-12T12:25:59.810532+0000","last_became_active":"2024-09-12T12:23:52.933744+0000","last_became_peered":"2024-09-12T12:23:52.933744+0000","last_unstale":"2024-09-12T12:25:59.810532+0000","last_undegraded":"2024-09-12T12:25:59.810532+0000","last_fullsized":"2024-09-12T12:25:59.810532+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:44.656785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321624+0000","last_change":"2024-09-12T12:23:45.873460+0000","last_active":"2024-09-12T12:26:00.321624+0000","last_peered":"2024-09-12T12:26:00.321624+0000","last_clean":"2024-09-12T12:26:00.321624+0000","last_became_active":"2024-09-12T12:23:45.873188+0000","last_became_peered":"2024-09-12T12:23:45.873188+0000","last_unstale":"2024-09-12T12:26:00.321624+0000","last_undegraded":"2024-09-12T12:26:00.321624+0000","last_fullsized":"2024-09-12T12:26:00.321624+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:18:29.503856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'3","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814747+0000","last_change":"2024-09-12T12:23:43.781082+0000","last_active":"2024-09-12T12:25:59.814747+0000","last_peered":"2024-09-12T12:25:59.814747+0000","last_clean":"2024-09-12T12:25:59.814747+0000","last_became_active":"2024-09-12T12:23:43.780710+0000","last_became_peered":"2024-09-12T12:23:43.780710+0000","last_unstale":"2024-09-12T12:25:59.814747+0000","last_undegraded":"2024-09-12T12:25:59.814747+0000","last_fullsized":"2024-09-12T12:25:59.814747+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:13:23.748716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":352,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810076+0000","last_change":"2024-09-12T12:22:37.536326+0000","last_active":"2024-09-12T12:25:59.810076+0000","last_peered":"2024-09-12T12:25:59.810076+0000","last_clean":"2024-09-12T12:25:59.810076+0000","last_became_active":"2024-09-12T12:22:37.535831+0000","last_became_peered":"2024-09-12T12:22:37.535831+0000","last_unstale":"2024-09-12T12:25:59.810076+0000","last_undegraded":"2024-09-12T12:25:59.810076+0000","last_fullsized":"2024-09-12T12:25:59.810076+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:19:12.296434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:19:12.296434+0000","last_clean_scrub_stamp":"2024-09-12T12:19:12.296434+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:04:49.251883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"85'1","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810224+0000","last_change":"2024-09-12T12:24:59.179285+0000","last_active":"2024-09-12T12:25:59.810224+0000","last_peered":"2024-09-12T12:25:59.810224+0000","last_clean":"2024-09-12T12:25:59.810224+0000","last_became_active":"2024-09-12T12:24:59.175202+0000","last_became_peered":"2024-09-12T12:24:59.175202+0000","last_unstale":"2024-09-12T12:25:59.810224+0000","last_undegraded":"2024-09-12T12:25:59.810224+0000","last_fullsized":"2024-09-12T12:25:59.810224+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:44.993426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,10,11,9],"acting":[7,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810502+0000","last_change":"2024-09-12T12:23:45.883059+0000","last_active":"2024-09-12T12:25:59.810502+0000","last_peered":"2024-09-12T12:25:59.810502+0000","last_clean":"2024-09-12T12:25:59.810502+0000","last_became_active":"2024-09-12T12:23:45.882206+0000","last_became_peered":"2024-09-12T12:23:45.882206+0000","last_unstale":"2024-09-12T12:25:59.810502+0000","last_undegraded":"2024-09-12T12:25:59.810502+0000","last_fullsized":"2024-09-12T12:25:59.810502+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:43.068533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'3","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.812450+0000","last_change":"2024-09-12T12:23:44.235088+0000","last_active":"2024-09-12T12:25:59.812450+0000","last_peered":"2024-09-12T12:25:59.812450+0000","last_clean":"2024-09-12T12:25:59.812450+0000","last_became_active":"2024-09-12T12:23:44.234551+0000","last_became_peered":"2024-09-12T12:23:44.234551+0000","last_unstale":"2024-09-12T12:25:59.812450+0000","last_undegraded":"2024-09-12T12:25:59.812450+0000","last_fullsized":"2024-09-12T12:25:59.812450+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:47.474387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322097+0000","last_change":"2024-09-12T12:23:52.897807+0000","last_active":"2024-09-12T12:26:00.322097+0000","last_peered":"2024-09-12T12:26:00.322097+0000","last_clean":"2024-09-12T12:26:00.322097+0000","last_became_active":"2024-09-12T12:23:52.897405+0000","last_became_peered":"2024-09-12T12:23:52.897405+0000","last_unstale":"2024-09-12T12:26:00.322097+0000","last_undegraded":"2024-09-12T12:26:00.322097+0000","last_fullsized":"2024-09-12T12:26:00.322097+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:34.714177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"87'6","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810274+0000","last_change":"2024-09-12T12:23:45.873907+0000","last_active":"2024-09-12T12:25:59.810274+0000","last_peered":"2024-09-12T12:25:59.810274+0000","last_clean":"2024-09-12T12:25:59.810274+0000","last_became_active":"2024-09-12T12:23:45.873464+0000","last_became_peered":"2024-09-12T12:23:45.873464+0000","last_unstale":"2024-09-12T12:25:59.810274+0000","last_undegraded":"2024-09-12T12:25:59.810274+0000","last_fullsized":"2024-09-12T12:25:59.810274+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:38:18.151880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810870+0000","last_change":"2024-09-12T12:23:43.782649+0000","last_active":"2024-09-12T12:25:59.810870+0000","last_peered":"2024-09-12T12:25:59.810870+0000","last_clean":"2024-09-12T12:25:59.810870+0000","last_became_active":"2024-09-12T12:23:43.782290+0000","last_became_peered":"2024-09-12T12:23:43.782290+0000","last_unstale":"2024-09-12T12:25:59.810870+0000","last_undegraded":"2024-09-12T12:25:59.810870+0000","last_fullsized":"2024-09-12T12:25:59.810870+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:30:56.964121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814566+0000","last_change":"2024-09-12T12:23:52.905108+0000","last_active":"2024-09-12T12:25:59.814566+0000","last_peered":"2024-09-12T12:25:59.814566+0000","last_clean":"2024-09-12T12:25:59.814566+0000","last_became_active":"2024-09-12T12:23:52.904664+0000","last_became_peered":"2024-09-12T12:23:52.904664+0000","last_unstale":"2024-09-12T12:25:59.814566+0000","last_undegraded":"2024-09-12T12:25:59.814566+0000","last_fullsized":"2024-09-12T12:25:59.814566+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:11.177971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810479+0000","last_change":"2024-09-12T12:23:45.875244+0000","last_active":"2024-09-12T12:25:59.810479+0000","last_peered":"2024-09-12T12:25:59.810479+0000","last_clean":"2024-09-12T12:25:59.810479+0000","last_became_active":"2024-09-12T12:23:45.874889+0000","last_became_peered":"2024-09-12T12:23:45.874889+0000","last_unstale":"2024-09-12T12:25:59.810479+0000","last_undegraded":"2024-09-12T12:25:59.810479+0000","last_fullsized":"2024-09-12T12:25:59.810479+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:30:38.192162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.952053+0000","last_change":"2024-09-12T12:23:43.783232+0000","last_active":"2024-09-12T12:25:59.952053+0000","last_peered":"2024-09-12T12:25:59.952053+0000","last_clean":"2024-09-12T12:25:59.952053+0000","last_became_active":"2024-09-12T12:23:43.782975+0000","last_became_peered":"2024-09-12T12:23:43.782975+0000","last_unstale":"2024-09-12T12:25:59.952053+0000","last_undegraded":"2024-09-12T12:25:59.952053+0000","last_fullsized":"2024-09-12T12:25:59.952053+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:45.096636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.809684+0000","last_change":"2024-09-12T12:23:52.898356+0000","last_active":"2024-09-12T12:25:59.809684+0000","last_peered":"2024-09-12T12:25:59.809684+0000","last_clean":"2024-09-12T12:25:59.809684+0000","last_became_active":"2024-09-12T12:23:52.897868+0000","last_became_peered":"2024-09-12T12:23:52.897868+0000","last_unstale":"2024-09-12T12:25:59.809684+0000","last_undegraded":"2024-09-12T12:25:59.809684+0000","last_fullsized":"2024-09-12T12:25:59.809684+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:16:36.473730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322394+0000","last_change":"2024-09-12T12:23:45.881532+0000","last_active":"2024-09-12T12:26:00.322394+0000","last_peered":"2024-09-12T12:26:00.322394+0000","last_clean":"2024-09-12T12:26:00.322394+0000","last_became_active":"2024-09-12T12:23:45.880895+0000","last_became_peered":"2024-09-12T12:23:45.880895+0000","last_unstale":"2024-09-12T12:26:00.322394+0000","last_undegraded":"2024-09-12T12:26:00.322394+0000","last_fullsized":"2024-09-12T12:26:00.322394+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:09:05.249773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322868+0000","last_change":"2024-09-12T12:23:43.783436+0000","last_active":"2024-09-12T12:26:00.322868+0000","last_peered":"2024-09-12T12:26:00.322868+0000","last_clean":"2024-09-12T12:26:00.322868+0000","last_became_active":"2024-09-12T12:23:43.782975+0000","last_became_peered":"2024-09-12T12:23:43.782975+0000","last_unstale":"2024-09-12T12:26:00.322868+0000","last_undegraded":"2024-09-12T12:26:00.322868+0000","last_fullsized":"2024-09-12T12:26:00.322868+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:20.840189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.809773+0000","last_change":"2024-09-12T12:23:52.903210+0000","last_active":"2024-09-12T12:25:59.809773+0000","last_peered":"2024-09-12T12:25:59.809773+0000","last_clean":"2024-09-12T12:25:59.809773+0000","last_became_active":"2024-09-12T12:23:52.902832+0000","last_became_peered":"2024-09-12T12:23:52.902832+0000","last_unstale":"2024-09-12T12:25:59.809773+0000","last_undegraded":"2024-09-12T12:25:59.809773+0000","last_fullsized":"2024-09-12T12:25:59.809773+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:46:40.506581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810159+0000","last_change":"2024-09-12T12:23:45.880314+0000","last_active":"2024-09-12T12:25:59.810159+0000","last_peered":"2024-09-12T12:25:59.810159+0000","last_clean":"2024-09-12T12:25:59.810159+0000","last_became_active":"2024-09-12T12:23:45.879878+0000","last_became_peered":"2024-09-12T12:23:45.879878+0000","last_unstale":"2024-09-12T12:25:59.810159+0000","last_undegraded":"2024-09-12T12:25:59.810159+0000","last_fullsized":"2024-09-12T12:25:59.810159+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:47.197008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"85'15","reported_seq":78,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322487+0000","last_change":"2024-09-12T12:24:59.142463+0000","last_active":"2024-09-12T12:26:00.322487+0000","last_peered":"2024-09-12T12:26:00.322487+0000","last_clean":"2024-09-12T12:26:00.322487+0000","last_became_active":"2024-09-12T12:24:59.128657+0000","last_became_peered":"2024-09-12T12:24:59.128657+0000","last_unstale":"2024-09-12T12:26:00.322487+0000","last_undegraded":"2024-09-12T12:26:00.322487+0000","last_fullsized":"2024-09-12T12:26:00.322487+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:52.873457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,1],"acting":[8,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.952020+0000","last_change":"2024-09-12T12:23:52.901841+0000","last_active":"2024-09-12T12:25:59.952020+0000","last_peered":"2024-09-12T12:25:59.952020+0000","last_clean":"2024-09-12T12:25:59.952020+0000","last_became_active":"2024-09-12T12:23:52.901469+0000","last_became_peered":"2024-09-12T12:23:52.901469+0000","last_unstale":"2024-09-12T12:25:59.952020+0000","last_undegraded":"2024-09-12T12:25:59.952020+0000","last_fullsized":"2024-09-12T12:25:59.952020+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:40.472980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.809773+0000","last_change":"2024-09-12T12:23:45.874026+0000","last_active":"2024-09-12T12:25:59.809773+0000","last_peered":"2024-09-12T12:25:59.809773+0000","last_clean":"2024-09-12T12:25:59.809773+0000","last_became_active":"2024-09-12T12:23:45.873494+0000","last_became_peered":"2024-09-12T12:23:45.873494+0000","last_unstale":"2024-09-12T12:25:59.809773+0000","last_undegraded":"2024-09-12T12:25:59.809773+0000","last_fullsized":"2024-09-12T12:25:59.809773+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:28.870938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'4","reported_seq":144,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:06.966083+0000","last_change":"2024-09-12T12:23:43.781866+0000","last_active":"2024-09-12T12:26:06.966083+0000","last_peered":"2024-09-12T12:26:06.966083+0000","last_clean":"2024-09-12T12:26:06.966083+0000","last_became_active":"2024-09-12T12:23:43.781488+0000","last_became_peered":"2024-09-12T12:23:43.781488+0000","last_unstale":"2024-09-12T12:26:06.966083+0000","last_undegraded":"2024-09-12T12:26:06.966083+0000","last_fullsized":"2024-09-12T12:26:06.966083+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:13:28.729199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1083,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.809080+0000","last_change":"2024-09-12T12:23:52.903427+0000","last_active":"2024-09-12T12:25:59.809080+0000","last_peered":"2024-09-12T12:25:59.809080+0000","last_clean":"2024-09-12T12:25:59.809080+0000","last_became_active":"2024-09-12T12:23:52.903077+0000","last_became_peered":"2024-09-12T12:23:52.903077+0000","last_unstale":"2024-09-12T12:25:59.809080+0000","last_undegraded":"2024-09-12T12:25:59.809080+0000","last_fullsized":"2024-09-12T12:25:59.809080+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:26:03.409086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":48,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810650+0000","last_change":"2024-09-12T12:23:45.873628+0000","last_active":"2024-09-12T12:25:59.810650+0000","last_peered":"2024-09-12T12:25:59.810650+0000","last_clean":"2024-09-12T12:25:59.810650+0000","last_became_active":"2024-09-12T12:23:45.873264+0000","last_became_peered":"2024-09-12T12:23:45.873264+0000","last_unstale":"2024-09-12T12:25:59.810650+0000","last_undegraded":"2024-09-12T12:25:59.810650+0000","last_fullsized":"2024-09-12T12:25:59.810650+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:17:03.257858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"85'3","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810275+0000","last_change":"2024-09-12T12:23:43.787320+0000","last_active":"2024-09-12T12:25:59.810275+0000","last_peered":"2024-09-12T12:25:59.810275+0000","last_clean":"2024-09-12T12:25:59.810275+0000","last_became_active":"2024-09-12T12:23:43.786937+0000","last_became_peered":"2024-09-12T12:23:43.786937+0000","last_unstale":"2024-09-12T12:25:59.810275+0000","last_undegraded":"2024-09-12T12:25:59.810275+0000","last_fullsized":"2024-09-12T12:25:59.810275+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:19.539586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321974+0000","last_change":"2024-09-12T12:23:52.904582+0000","last_active":"2024-09-12T12:26:00.321974+0000","last_peered":"2024-09-12T12:26:00.321974+0000","last_clean":"2024-09-12T12:26:00.321974+0000","last_became_active":"2024-09-12T12:23:52.904172+0000","last_became_peered":"2024-09-12T12:23:52.904172+0000","last_unstale":"2024-09-12T12:26:00.321974+0000","last_undegraded":"2024-09-12T12:26:00.321974+0000","last_fullsized":"2024-09-12T12:26:00.321974+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:26:14.734098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.951725+0000","last_change":"2024-09-12T12:23:45.878128+0000","last_active":"2024-09-12T12:25:59.951725+0000","last_peered":"2024-09-12T12:25:59.951725+0000","last_clean":"2024-09-12T12:25:59.951725+0000","last_became_active":"2024-09-12T12:23:45.877154+0000","last_became_peered":"2024-09-12T12:23:45.877154+0000","last_unstale":"2024-09-12T12:25:59.951725+0000","last_undegraded":"2024-09-12T12:25:59.951725+0000","last_fullsized":"2024-09-12T12:25:59.951725+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:06.095805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"85'6","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.812155+0000","last_change":"2024-09-12T12:23:43.783586+0000","last_active":"2024-09-12T12:25:59.812155+0000","last_peered":"2024-09-12T12:25:59.812155+0000","last_clean":"2024-09-12T12:25:59.812155+0000","last_became_active":"2024-09-12T12:23:43.783255+0000","last_became_peered":"2024-09-12T12:23:43.783255+0000","last_unstale":"2024-09-12T12:25:59.812155+0000","last_undegraded":"2024-09-12T12:25:59.812155+0000","last_fullsized":"2024-09-12T12:25:59.812155+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:38.609805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810611+0000","last_change":"2024-09-12T12:23:52.901120+0000","last_active":"2024-09-12T12:25:59.810611+0000","last_peered":"2024-09-12T12:25:59.810611+0000","last_clean":"2024-09-12T12:25:59.810611+0000","last_became_active":"2024-09-12T12:23:52.900700+0000","last_became_peered":"2024-09-12T12:23:52.900700+0000","last_unstale":"2024-09-12T12:25:59.810611+0000","last_undegraded":"2024-09-12T12:25:59.810611+0000","last_fullsized":"2024-09-12T12:25:59.810611+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:18.225867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322993+0000","last_change":"2024-09-12T12:23:45.878074+0000","last_active":"2024-09-12T12:26:00.322993+0000","last_peered":"2024-09-12T12:26:00.322993+0000","last_clean":"2024-09-12T12:26:00.322993+0000","last_became_active":"2024-09-12T12:23:45.877753+0000","last_became_peered":"2024-09-12T12:23:45.877753+0000","last_unstale":"2024-09-12T12:26:00.322993+0000","last_undegraded":"2024-09-12T12:26:00.322993+0000","last_fullsized":"2024-09-12T12:26:00.322993+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:15.515609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"89'39","reported_seq":290,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:08.231007+0000","last_change":"2024-09-12T12:23:43.787476+0000","last_active":"2024-09-12T12:26:08.231007+0000","last_peered":"2024-09-12T12:26:08.231007+0000","last_clean":"2024-09-12T12:26:08.231007+0000","last_became_active":"2024-09-12T12:23:43.786808+0000","last_became_peered":"2024-09-12T12:23:43.786808+0000","last_unstale":"2024-09-12T12:26:08.231007+0000","last_undegraded":"2024-09-12T12:26:08.231007+0000","last_fullsized":"2024-09-12T12:26:08.231007+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:08:28.046702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69198,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":212,"num_read_kb":173,"num_write":40,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.808681+0000","last_change":"2024-09-12T12:23:52.900089+0000","last_active":"2024-09-12T12:25:59.808681+0000","last_peered":"2024-09-12T12:25:59.808681+0000","last_clean":"2024-09-12T12:25:59.808681+0000","last_became_active":"2024-09-12T12:23:52.899711+0000","last_became_peered":"2024-09-12T12:23:52.899711+0000","last_unstale":"2024-09-12T12:25:59.808681+0000","last_undegraded":"2024-09-12T12:25:59.808681+0000","last_fullsized":"2024-09-12T12:25:59.808681+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:58:38.850382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322405+0000","last_change":"2024-09-12T12:23:45.876773+0000","last_active":"2024-09-12T12:26:00.322405+0000","last_peered":"2024-09-12T12:26:00.322405+0000","last_clean":"2024-09-12T12:26:00.322405+0000","last_became_active":"2024-09-12T12:23:45.876394+0000","last_became_peered":"2024-09-12T12:23:45.876394+0000","last_unstale":"2024-09-12T12:26:00.322405+0000","last_undegraded":"2024-09-12T12:26:00.322405+0000","last_fullsized":"2024-09-12T12:26:00.322405+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:55.468779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"85'4","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810763+0000","last_change":"2024-09-12T12:23:43.835826+0000","last_active":"2024-09-12T12:25:59.810763+0000","last_peered":"2024-09-12T12:25:59.810763+0000","last_clean":"2024-09-12T12:25:59.810763+0000","last_became_active":"2024-09-12T12:23:43.835378+0000","last_became_peered":"2024-09-12T12:23:43.835378+0000","last_unstale":"2024-09-12T12:25:59.810763+0000","last_undegraded":"2024-09-12T12:25:59.810763+0000","last_fullsized":"2024-09-12T12:25:59.810763+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:23.429407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814384+0000","last_change":"2024-09-12T12:24:59.129183+0000","last_active":"2024-09-12T12:25:59.814384+0000","last_peered":"2024-09-12T12:25:59.814384+0000","last_clean":"2024-09-12T12:25:59.814384+0000","last_became_active":"2024-09-12T12:24:59.128649+0000","last_became_peered":"2024-09-12T12:24:59.128649+0000","last_unstale":"2024-09-12T12:25:59.814384+0000","last_undegraded":"2024-09-12T12:25:59.814384+0000","last_fullsized":"2024-09-12T12:25:59.814384+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:58.630436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.815306+0000","last_change":"2024-09-12T12:23:45.875222+0000","last_active":"2024-09-12T12:25:59.815306+0000","last_peered":"2024-09-12T12:25:59.815306+0000","last_clean":"2024-09-12T12:25:59.815306+0000","last_became_active":"2024-09-12T12:23:45.874859+0000","last_became_peered":"2024-09-12T12:23:45.874859+0000","last_unstale":"2024-09-12T12:25:59.815306+0000","last_undegraded":"2024-09-12T12:25:59.815306+0000","last_fullsized":"2024-09-12T12:25:59.815306+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:29:00.017470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"85'2","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810309+0000","last_change":"2024-09-12T12:23:43.788052+0000","last_active":"2024-09-12T12:25:59.810309+0000","last_peered":"2024-09-12T12:25:59.810309+0000","last_clean":"2024-09-12T12:25:59.810309+0000","last_became_active":"2024-09-12T12:23:43.787533+0000","last_became_peered":"2024-09-12T12:23:43.787533+0000","last_unstale":"2024-09-12T12:25:59.810309+0000","last_undegraded":"2024-09-12T12:25:59.810309+0000","last_fullsized":"2024-09-12T12:25:59.810309+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:32.042395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.808516+0000","last_change":"2024-09-12T12:23:52.900856+0000","last_active":"2024-09-12T12:25:59.808516+0000","last_peered":"2024-09-12T12:25:59.808516+0000","last_clean":"2024-09-12T12:25:59.808516+0000","last_became_active":"2024-09-12T12:23:52.900444+0000","last_became_peered":"2024-09-12T12:23:52.900444+0000","last_unstale":"2024-09-12T12:25:59.808516+0000","last_undegraded":"2024-09-12T12:25:59.808516+0000","last_fullsized":"2024-09-12T12:25:59.808516+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:52:22.443801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322576+0000","last_change":"2024-09-12T12:23:45.869666+0000","last_active":"2024-09-12T12:26:00.322576+0000","last_peered":"2024-09-12T12:26:00.322576+0000","last_clean":"2024-09-12T12:26:00.322576+0000","last_became_active":"2024-09-12T12:23:45.869308+0000","last_became_peered":"2024-09-12T12:23:45.869308+0000","last_unstale":"2024-09-12T12:26:00.322576+0000","last_undegraded":"2024-09-12T12:26:00.322576+0000","last_fullsized":"2024-09-12T12:26:00.322576+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:37:47.895807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"87'4","reported_seq":143,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:08.230706+0000","last_change":"2024-09-12T12:23:43.786124+0000","last_active":"2024-09-12T12:26:08.230706+0000","last_peered":"2024-09-12T12:26:08.230706+0000","last_clean":"2024-09-12T12:26:08.230706+0000","last_became_active":"2024-09-12T12:23:43.785772+0000","last_became_peered":"2024-09-12T12:23:43.785772+0000","last_unstale":"2024-09-12T12:26:08.230706+0000","last_undegraded":"2024-09-12T12:26:08.230706+0000","last_fullsized":"2024-09-12T12:26:08.230706+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:23.458792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321504+0000","last_change":"2024-09-12T12:23:52.905541+0000","last_active":"2024-09-12T12:26:00.321504+0000","last_peered":"2024-09-12T12:26:00.321504+0000","last_clean":"2024-09-12T12:26:00.321504+0000","last_became_active":"2024-09-12T12:23:52.905165+0000","last_became_peered":"2024-09-12T12:23:52.905165+0000","last_unstale":"2024-09-12T12:26:00.321504+0000","last_undegraded":"2024-09-12T12:26:00.321504+0000","last_fullsized":"2024-09-12T12:26:00.321504+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:40.831208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814914+0000","last_change":"2024-09-12T12:23:52.901738+0000","last_active":"2024-09-12T12:25:59.814914+0000","last_peered":"2024-09-12T12:25:59.814914+0000","last_clean":"2024-09-12T12:25:59.814914+0000","last_became_active":"2024-09-12T12:23:52.901348+0000","last_became_peered":"2024-09-12T12:23:52.901348+0000","last_unstale":"2024-09-12T12:25:59.814914+0000","last_undegraded":"2024-09-12T12:25:59.814914+0000","last_fullsized":"2024-09-12T12:25:59.814914+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:16:24.075130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.808552+0000","last_change":"2024-09-12T12:23:45.869431+0000","last_active":"2024-09-12T12:25:59.808552+0000","last_peered":"2024-09-12T12:25:59.808552+0000","last_clean":"2024-09-12T12:25:59.808552+0000","last_became_active":"2024-09-12T12:23:45.869078+0000","last_became_peered":"2024-09-12T12:23:45.869078+0000","last_unstale":"2024-09-12T12:25:59.808552+0000","last_undegraded":"2024-09-12T12:25:59.808552+0000","last_fullsized":"2024-09-12T12:25:59.808552+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:37:19.849489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"85'1","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.809976+0000","last_change":"2024-09-12T12:23:43.787852+0000","last_active":"2024-09-12T12:25:59.809976+0000","last_peered":"2024-09-12T12:25:59.809976+0000","last_clean":"2024-09-12T12:25:59.809976+0000","last_became_active":"2024-09-12T12:23:43.787531+0000","last_became_peered":"2024-09-12T12:23:43.787531+0000","last_unstale":"2024-09-12T12:25:59.809976+0000","last_undegraded":"2024-09-12T12:25:59.809976+0000","last_fullsized":"2024-09-12T12:25:59.809976+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:25.499020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322104+0000","last_change":"2024-09-12T12:23:52.904603+0000","last_active":"2024-09-12T12:26:00.322104+0000","last_peered":"2024-09-12T12:26:00.322104+0000","last_clean":"2024-09-12T12:26:00.322104+0000","last_became_active":"2024-09-12T12:23:52.904146+0000","last_became_peered":"2024-09-12T12:23:52.904146+0000","last_unstale":"2024-09-12T12:26:00.322104+0000","last_undegraded":"2024-09-12T12:26:00.322104+0000","last_fullsized":"2024-09-12T12:26:00.322104+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:01.847489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321536+0000","last_change":"2024-09-12T12:23:45.880381+0000","last_active":"2024-09-12T12:26:00.321536+0000","last_peered":"2024-09-12T12:26:00.321536+0000","last_clean":"2024-09-12T12:26:00.321536+0000","last_became_active":"2024-09-12T12:23:45.879865+0000","last_became_peered":"2024-09-12T12:23:45.879865+0000","last_unstale":"2024-09-12T12:26:00.321536+0000","last_undegraded":"2024-09-12T12:26:00.321536+0000","last_fullsized":"2024-09-12T12:26:00.321536+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:52.033891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"85'2","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.951716+0000","last_change":"2024-09-12T12:23:43.782166+0000","last_active":"2024-09-12T12:25:59.951716+0000","last_peered":"2024-09-12T12:25:59.951716+0000","last_clean":"2024-09-12T12:25:59.951716+0000","last_became_active":"2024-09-12T12:23:43.781808+0000","last_became_peered":"2024-09-12T12:23:43.781808+0000","last_unstale":"2024-09-12T12:25:59.951716+0000","last_undegraded":"2024-09-12T12:25:59.951716+0000","last_fullsized":"2024-09-12T12:25:59.951716+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:44:03.340842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"85'3","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.812050+0000","last_change":"2024-09-12T12:23:43.784869+0000","last_active":"2024-09-12T12:25:59.812050+0000","last_peered":"2024-09-12T12:25:59.812050+0000","last_clean":"2024-09-12T12:25:59.812050+0000","last_became_active":"2024-09-12T12:23:43.784458+0000","last_became_peered":"2024-09-12T12:23:43.784458+0000","last_unstale":"2024-09-12T12:25:59.812050+0000","last_undegraded":"2024-09-12T12:25:59.812050+0000","last_fullsized":"2024-09-12T12:25:59.812050+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:46.025169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810282+0000","last_change":"2024-09-12T12:23:45.879258+0000","last_active":"2024-09-12T12:25:59.810282+0000","last_peered":"2024-09-12T12:25:59.810282+0000","last_clean":"2024-09-12T12:25:59.810282+0000","last_became_active":"2024-09-12T12:23:45.878934+0000","last_became_peered":"2024-09-12T12:23:45.878934+0000","last_unstale":"2024-09-12T12:25:59.810282+0000","last_undegraded":"2024-09-12T12:25:59.810282+0000","last_fullsized":"2024-09-12T12:25:59.810282+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:46:06.617621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.812104+0000","last_change":"2024-09-12T12:23:52.906041+0000","last_active":"2024-09-12T12:25:59.812104+0000","last_peered":"2024-09-12T12:25:59.812104+0000","last_clean":"2024-09-12T12:25:59.812104+0000","last_became_active":"2024-09-12T12:23:52.905630+0000","last_became_peered":"2024-09-12T12:23:52.905630+0000","last_unstale":"2024-09-12T12:25:59.812104+0000","last_undegraded":"2024-09-12T12:25:59.812104+0000","last_fullsized":"2024-09-12T12:25:59.812104+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:15.691085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'8","reported_seq":162,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:06.228868+0000","last_change":"2024-09-12T12:24:59.136007+0000","last_active":"2024-09-12T12:26:06.228868+0000","last_peered":"2024-09-12T12:26:06.228868+0000","last_clean":"2024-09-12T12:26:06.228868+0000","last_became_active":"2024-09-12T12:24:59.128094+0000","last_became_peered":"2024-09-12T12:24:59.128094+0000","last_unstale":"2024-09-12T12:26:06.228868+0000","last_undegraded":"2024-09-12T12:26:06.228868+0000","last_fullsized":"2024-09-12T12:26:06.228868+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:37.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1651,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1015,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322631+0000","last_change":"2024-09-12T12:23:45.868002+0000","last_active":"2024-09-12T12:26:00.322631+0000","last_peered":"2024-09-12T12:26:00.322631+0000","last_clean":"2024-09-12T12:26:00.322631+0000","last_became_active":"2024-09-12T12:23:45.867448+0000","last_became_peered":"2024-09-12T12:23:45.867448+0000","last_unstale":"2024-09-12T12:26:00.322631+0000","last_undegraded":"2024-09-12T12:26:00.322631+0000","last_fullsized":"2024-09-12T12:26:00.322631+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:24:01.805345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.812224+0000","last_change":"2024-09-12T12:23:52.902119+0000","last_active":"2024-09-12T12:25:59.812224+0000","last_peered":"2024-09-12T12:25:59.812224+0000","last_clean":"2024-09-12T12:25:59.812224+0000","last_became_active":"2024-09-12T12:23:52.901681+0000","last_became_peered":"2024-09-12T12:23:52.901681+0000","last_unstale":"2024-09-12T12:25:59.812224+0000","last_undegraded":"2024-09-12T12:25:59.812224+0000","last_fullsized":"2024-09-12T12:25:59.812224+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:42.039729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322128+0000","last_change":"2024-09-12T12:23:45.879115+0000","last_active":"2024-09-12T12:26:00.322128+0000","last_peered":"2024-09-12T12:26:00.322128+0000","last_clean":"2024-09-12T12:26:00.322128+0000","last_became_active":"2024-09-12T12:23:45.878745+0000","last_became_peered":"2024-09-12T12:23:45.878745+0000","last_unstale":"2024-09-12T12:26:00.322128+0000","last_undegraded":"2024-09-12T12:26:00.322128+0000","last_fullsized":"2024-09-12T12:26:00.322128+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:53.152875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":51,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.815900+0000","last_change":"2024-09-12T12:25:59.815900+0000","last_active":"2024-09-12T12:25:59.815900+0000","last_peered":"2024-09-12T12:25:59.815900+0000","last_clean":"2024-09-12T12:25:59.815900+0000","last_became_active":"2024-09-12T12:25:59.815588+0000","last_became_peered":"2024-09-12T12:25:59.815588+0000","last_unstale":"2024-09-12T12:25:59.815900+0000","last_undegraded":"2024-09-12T12:25:59.815900+0000","last_fullsized":"2024-09-12T12:25:59.815900+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:35.793884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.811884+0000","last_change":"2024-09-12T12:23:45.873101+0000","last_active":"2024-09-12T12:25:59.811884+0000","last_peered":"2024-09-12T12:25:59.811884+0000","last_clean":"2024-09-12T12:25:59.811884+0000","last_became_active":"2024-09-12T12:23:45.872373+0000","last_became_peered":"2024-09-12T12:23:45.872373+0000","last_unstale":"2024-09-12T12:25:59.811884+0000","last_undegraded":"2024-09-12T12:25:59.811884+0000","last_fullsized":"2024-09-12T12:25:59.811884+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:47:14.747538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814667+0000","last_change":"2024-09-12T12:23:45.875315+0000","last_active":"2024-09-12T12:25:59.814667+0000","last_peered":"2024-09-12T12:25:59.814667+0000","last_clean":"2024-09-12T12:25:59.814667+0000","last_became_active":"2024-09-12T12:23:45.874904+0000","last_became_peered":"2024-09-12T12:23:45.874904+0000","last_unstale":"2024-09-12T12:25:59.814667+0000","last_undegraded":"2024-09-12T12:25:59.814667+0000","last_fullsized":"2024-09-12T12:25:59.814667+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:52:44.373937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.951895+0000","last_change":"2024-09-12T12:24:59.126419+0000","last_active":"2024-09-12T12:25:59.951895+0000","last_peered":"2024-09-12T12:25:59.951895+0000","last_clean":"2024-09-12T12:25:59.951895+0000","last_became_active":"2024-09-12T12:24:59.125996+0000","last_became_peered":"2024-09-12T12:24:59.125996+0000","last_unstale":"2024-09-12T12:25:59.951895+0000","last_undegraded":"2024-09-12T12:25:59.951895+0000","last_fullsized":"2024-09-12T12:25:59.951895+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:01.495467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322488+0000","last_change":"2024-09-12T12:23:45.872638+0000","last_active":"2024-09-12T12:26:00.322488+0000","last_peered":"2024-09-12T12:26:00.322488+0000","last_clean":"2024-09-12T12:26:00.322488+0000","last_became_active":"2024-09-12T12:23:45.872299+0000","last_became_peered":"2024-09-12T12:23:45.872299+0000","last_unstale":"2024-09-12T12:26:00.322488+0000","last_undegraded":"2024-09-12T12:26:00.322488+0000","last_fullsized":"2024-09-12T12:26:00.322488+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:27.758613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":48,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.812624+0000","last_change":"2024-09-12T12:23:45.877168+0000","last_active":"2024-09-12T12:25:59.812624+0000","last_peered":"2024-09-12T12:25:59.812624+0000","last_clean":"2024-09-12T12:25:59.812624+0000","last_became_active":"2024-09-12T12:23:45.876871+0000","last_became_peered":"2024-09-12T12:23:45.876871+0000","last_unstale":"2024-09-12T12:25:59.812624+0000","last_undegraded":"2024-09-12T12:25:59.812624+0000","last_fullsized":"2024-09-12T12:25:59.812624+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:24.567415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321818+0000","last_change":"2024-09-12T12:24:59.128436+0000","last_active":"2024-09-12T12:26:00.321818+0000","last_peered":"2024-09-12T12:26:00.321818+0000","last_clean":"2024-09-12T12:26:00.321818+0000","last_became_active":"2024-09-12T12:24:59.128125+0000","last_became_peered":"2024-09-12T12:24:59.128125+0000","last_unstale":"2024-09-12T12:26:00.321818+0000","last_undegraded":"2024-09-12T12:26:00.321818+0000","last_fullsized":"2024-09-12T12:26:00.321818+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:58.903559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.809780+0000","last_change":"2024-09-12T12:23:45.873728+0000","last_active":"2024-09-12T12:25:59.809780+0000","last_peered":"2024-09-12T12:25:59.809780+0000","last_clean":"2024-09-12T12:25:59.809780+0000","last_became_active":"2024-09-12T12:23:45.871831+0000","last_became_peered":"2024-09-12T12:23:45.871831+0000","last_unstale":"2024-09-12T12:25:59.809780+0000","last_undegraded":"2024-09-12T12:25:59.809780+0000","last_fullsized":"2024-09-12T12:25:59.809780+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:48.690705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321927+0000","last_change":"2024-09-12T12:23:45.873035+0000","last_active":"2024-09-12T12:26:00.321927+0000","last_peered":"2024-09-12T12:26:00.321927+0000","last_clean":"2024-09-12T12:26:00.321927+0000","last_became_active":"2024-09-12T12:23:45.872660+0000","last_became_peered":"2024-09-12T12:23:45.872660+0000","last_unstale":"2024-09-12T12:26:00.321927+0000","last_undegraded":"2024-09-12T12:26:00.321927+0000","last_fullsized":"2024-09-12T12:26:00.321927+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:31.376116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322279+0000","last_change":"2024-09-12T12:23:45.879754+0000","last_active":"2024-09-12T12:26:00.322279+0000","last_peered":"2024-09-12T12:26:00.322279+0000","last_clean":"2024-09-12T12:26:00.322279+0000","last_became_active":"2024-09-12T12:23:45.879362+0000","last_became_peered":"2024-09-12T12:23:45.879362+0000","last_unstale":"2024-09-12T12:26:00.322279+0000","last_undegraded":"2024-09-12T12:26:00.322279+0000","last_fullsized":"2024-09-12T12:26:00.322279+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:23.587083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.952255+0000","last_change":"2024-09-12T12:23:45.878297+0000","last_active":"2024-09-12T12:25:59.952255+0000","last_peered":"2024-09-12T12:25:59.952255+0000","last_clean":"2024-09-12T12:25:59.952255+0000","last_became_active":"2024-09-12T12:23:45.877127+0000","last_became_peered":"2024-09-12T12:23:45.877127+0000","last_unstale":"2024-09-12T12:25:59.952255+0000","last_undegraded":"2024-09-12T12:25:59.952255+0000","last_fullsized":"2024-09-12T12:25:59.952255+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:54.334325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322109+0000","last_change":"2024-09-12T12:23:45.879078+0000","last_active":"2024-09-12T12:26:00.322109+0000","last_peered":"2024-09-12T12:26:00.322109+0000","last_clean":"2024-09-12T12:26:00.322109+0000","last_became_active":"2024-09-12T12:23:45.878799+0000","last_became_peered":"2024-09-12T12:23:45.878799+0000","last_unstale":"2024-09-12T12:26:00.322109+0000","last_undegraded":"2024-09-12T12:26:00.322109+0000","last_fullsized":"2024-09-12T12:26:00.322109+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:45.680643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.812428+0000","last_change":"2024-09-12T12:23:45.872739+0000","last_active":"2024-09-12T12:25:59.812428+0000","last_peered":"2024-09-12T12:25:59.812428+0000","last_clean":"2024-09-12T12:25:59.812428+0000","last_became_active":"2024-09-12T12:23:45.871931+0000","last_became_peered":"2024-09-12T12:23:45.871931+0000","last_unstale":"2024-09-12T12:25:59.812428+0000","last_undegraded":"2024-09-12T12:25:59.812428+0000","last_fullsized":"2024-09-12T12:25:59.812428+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:36:30.451737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.809065+0000","last_change":"2024-09-12T12:23:45.876717+0000","last_active":"2024-09-12T12:25:59.809065+0000","last_peered":"2024-09-12T12:25:59.809065+0000","last_clean":"2024-09-12T12:25:59.809065+0000","last_became_active":"2024-09-12T12:23:45.876372+0000","last_became_peered":"2024-09-12T12:23:45.876372+0000","last_unstale":"2024-09-12T12:25:59.809065+0000","last_undegraded":"2024-09-12T12:25:59.809065+0000","last_fullsized":"2024-09-12T12:25:59.809065+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:40:26.905442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322842+0000","last_change":"2024-09-12T12:23:45.877286+0000","last_active":"2024-09-12T12:26:00.322842+0000","last_peered":"2024-09-12T12:26:00.322842+0000","last_clean":"2024-09-12T12:26:00.322842+0000","last_became_active":"2024-09-12T12:23:45.876619+0000","last_became_peered":"2024-09-12T12:23:45.876619+0000","last_unstale":"2024-09-12T12:26:00.322842+0000","last_undegraded":"2024-09-12T12:26:00.322842+0000","last_fullsized":"2024-09-12T12:26:00.322842+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:05.637917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322331+0000","last_change":"2024-09-12T12:23:45.875244+0000","last_active":"2024-09-12T12:26:00.322331+0000","last_peered":"2024-09-12T12:26:00.322331+0000","last_clean":"2024-09-12T12:26:00.322331+0000","last_became_active":"2024-09-12T12:23:45.874908+0000","last_became_peered":"2024-09-12T12:23:45.874908+0000","last_unstale":"2024-09-12T12:26:00.322331+0000","last_undegraded":"2024-09-12T12:26:00.322331+0000","last_fullsized":"2024-09-12T12:26:00.322331+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:14.314124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814499+0000","last_change":"2024-09-12T12:23:45.875253+0000","last_active":"2024-09-12T12:25:59.814499+0000","last_peered":"2024-09-12T12:25:59.814499+0000","last_clean":"2024-09-12T12:25:59.814499+0000","last_became_active":"2024-09-12T12:23:45.874936+0000","last_became_peered":"2024-09-12T12:23:45.874936+0000","last_unstale":"2024-09-12T12:25:59.814499+0000","last_undegraded":"2024-09-12T12:25:59.814499+0000","last_fullsized":"2024-09-12T12:25:59.814499+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:28.790546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814629+0000","last_change":"2024-09-12T12:23:45.880503+0000","last_active":"2024-09-12T12:25:59.814629+0000","last_peered":"2024-09-12T12:25:59.814629+0000","last_clean":"2024-09-12T12:25:59.814629+0000","last_became_active":"2024-09-12T12:23:45.880184+0000","last_became_peered":"2024-09-12T12:23:45.880184+0000","last_unstale":"2024-09-12T12:25:59.814629+0000","last_undegraded":"2024-09-12T12:25:59.814629+0000","last_fullsized":"2024-09-12T12:25:59.814629+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:12.370667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.952111+0000","last_change":"2024-09-12T12:23:45.869762+0000","last_active":"2024-09-12T12:25:59.952111+0000","last_peered":"2024-09-12T12:25:59.952111+0000","last_clean":"2024-09-12T12:25:59.952111+0000","last_became_active":"2024-09-12T12:23:45.867595+0000","last_became_peered":"2024-09-12T12:23:45.867595+0000","last_unstale":"2024-09-12T12:25:59.952111+0000","last_undegraded":"2024-09-12T12:25:59.952111+0000","last_fullsized":"2024-09-12T12:25:59.952111+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:25:19.855969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814699+0000","last_change":"2024-09-12T12:23:45.874097+0000","last_active":"2024-09-12T12:25:59.814699+0000","last_peered":"2024-09-12T12:25:59.814699+0000","last_clean":"2024-09-12T12:25:59.814699+0000","last_became_active":"2024-09-12T12:23:45.873275+0000","last_became_peered":"2024-09-12T12:23:45.873275+0000","last_unstale":"2024-09-12T12:25:59.814699+0000","last_undegraded":"2024-09-12T12:25:59.814699+0000","last_fullsized":"2024-09-12T12:25:59.814699+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:21.303339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810374+0000","last_change":"2024-09-12T12:23:45.883354+0000","last_active":"2024-09-12T12:25:59.810374+0000","last_peered":"2024-09-12T12:25:59.810374+0000","last_clean":"2024-09-12T12:25:59.810374+0000","last_became_active":"2024-09-12T12:23:45.882673+0000","last_became_peered":"2024-09-12T12:23:45.882673+0000","last_unstale":"2024-09-12T12:25:59.810374+0000","last_undegraded":"2024-09-12T12:25:59.810374+0000","last_fullsized":"2024-09-12T12:25:59.810374+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:42.034857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":49,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.812510+0000","last_change":"2024-09-12T12:23:45.876955+0000","last_active":"2024-09-12T12:25:59.812510+0000","last_peered":"2024-09-12T12:25:59.812510+0000","last_clean":"2024-09-12T12:25:59.812510+0000","last_became_active":"2024-09-12T12:23:45.876632+0000","last_became_peered":"2024-09-12T12:23:45.876632+0000","last_unstale":"2024-09-12T12:25:59.812510+0000","last_undegraded":"2024-09-12T12:25:59.812510+0000","last_fullsized":"2024-09-12T12:25:59.812510+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:25.155739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322622+0000","last_change":"2024-09-12T12:23:45.875166+0000","last_active":"2024-09-12T12:26:00.322622+0000","last_peered":"2024-09-12T12:26:00.322622+0000","last_clean":"2024-09-12T12:26:00.322622+0000","last_became_active":"2024-09-12T12:23:45.874835+0000","last_became_peered":"2024-09-12T12:23:45.874835+0000","last_unstale":"2024-09-12T12:26:00.322622+0000","last_undegraded":"2024-09-12T12:26:00.322622+0000","last_fullsized":"2024-09-12T12:26:00.322622+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:50.014484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321494+0000","last_change":"2024-09-12T12:23:45.874161+0000","last_active":"2024-09-12T12:26:00.321494+0000","last_peered":"2024-09-12T12:26:00.321494+0000","last_clean":"2024-09-12T12:26:00.321494+0000","last_became_active":"2024-09-12T12:23:45.873846+0000","last_became_peered":"2024-09-12T12:23:45.873846+0000","last_unstale":"2024-09-12T12:26:00.321494+0000","last_undegraded":"2024-09-12T12:26:00.321494+0000","last_fullsized":"2024-09-12T12:26:00.321494+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:09:17.525956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.809776+0000","last_change":"2024-09-12T12:23:45.870642+0000","last_active":"2024-09-12T12:25:59.809776+0000","last_peered":"2024-09-12T12:25:59.809776+0000","last_clean":"2024-09-12T12:25:59.809776+0000","last_became_active":"2024-09-12T12:23:45.870006+0000","last_became_peered":"2024-09-12T12:23:45.870006+0000","last_unstale":"2024-09-12T12:25:59.809776+0000","last_undegraded":"2024-09-12T12:25:59.809776+0000","last_fullsized":"2024-09-12T12:25:59.809776+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:43:35.133650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.812057+0000","last_change":"2024-09-12T12:23:45.875174+0000","last_active":"2024-09-12T12:25:59.812057+0000","last_peered":"2024-09-12T12:25:59.812057+0000","last_clean":"2024-09-12T12:25:59.812057+0000","last_became_active":"2024-09-12T12:23:45.874851+0000","last_became_peered":"2024-09-12T12:23:45.874851+0000","last_unstale":"2024-09-12T12:25:59.812057+0000","last_undegraded":"2024-09-12T12:25:59.812057+0000","last_fullsized":"2024-09-12T12:25:59.812057+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:42.565644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322506+0000","last_change":"2024-09-12T12:23:45.873170+0000","last_active":"2024-09-12T12:26:00.322506+0000","last_peered":"2024-09-12T12:26:00.322506+0000","last_clean":"2024-09-12T12:26:00.322506+0000","last_became_active":"2024-09-12T12:23:45.872814+0000","last_became_peered":"2024-09-12T12:23:45.872814+0000","last_unstale":"2024-09-12T12:26:00.322506+0000","last_undegraded":"2024-09-12T12:26:00.322506+0000","last_fullsized":"2024-09-12T12:26:00.322506+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:36.143107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814443+0000","last_change":"2024-09-12T12:23:45.874271+0000","last_active":"2024-09-12T12:25:59.814443+0000","last_peered":"2024-09-12T12:25:59.814443+0000","last_clean":"2024-09-12T12:25:59.814443+0000","last_became_active":"2024-09-12T12:23:45.873789+0000","last_became_peered":"2024-09-12T12:23:45.873789+0000","last_unstale":"2024-09-12T12:25:59.814443+0000","last_undegraded":"2024-09-12T12:25:59.814443+0000","last_fullsized":"2024-09-12T12:25:59.814443+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:58.252706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814639+0000","last_change":"2024-09-12T12:23:45.877236+0000","last_active":"2024-09-12T12:25:59.814639+0000","last_peered":"2024-09-12T12:25:59.814639+0000","last_clean":"2024-09-12T12:25:59.814639+0000","last_became_active":"2024-09-12T12:23:45.876920+0000","last_became_peered":"2024-09-12T12:23:45.876920+0000","last_unstale":"2024-09-12T12:25:59.814639+0000","last_undegraded":"2024-09-12T12:25:59.814639+0000","last_fullsized":"2024-09-12T12:25:59.814639+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:19:19.749103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814948+0000","last_change":"2024-09-12T12:23:45.880480+0000","last_active":"2024-09-12T12:25:59.814948+0000","last_peered":"2024-09-12T12:25:59.814948+0000","last_clean":"2024-09-12T12:25:59.814948+0000","last_became_active":"2024-09-12T12:23:45.880163+0000","last_became_peered":"2024-09-12T12:23:45.880163+0000","last_unstale":"2024-09-12T12:25:59.814948+0000","last_undegraded":"2024-09-12T12:25:59.814948+0000","last_fullsized":"2024-09-12T12:25:59.814948+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:35.496705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322687+0000","last_change":"2024-09-12T12:23:45.876975+0000","last_active":"2024-09-12T12:26:00.322687+0000","last_peered":"2024-09-12T12:26:00.322687+0000","last_clean":"2024-09-12T12:26:00.322687+0000","last_became_active":"2024-09-12T12:23:45.876501+0000","last_became_peered":"2024-09-12T12:23:45.876501+0000","last_unstale":"2024-09-12T12:26:00.322687+0000","last_undegraded":"2024-09-12T12:26:00.322687+0000","last_fullsized":"2024-09-12T12:26:00.322687+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:15.029566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74332,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":627,"num_read_kb":393,"num_write":186,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1127,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":438272,"data_stored":218682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":286267,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612650,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":983040,"data_stored":511580,"data_compressed":29534,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841582,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28136,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717016,"statfs":{"total":95995035648,"available":95966224384,"internally_reserved":0,"allocated":1138688,"data_stored":1172637,"data_compressed":65932,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005108,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1003520,"data_stored":515912,"data_compressed":29534,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234040,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":511736,"data_compressed":29534,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462973,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36368,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708784,"statfs":{"total":95995035648,"available":95957794816,"internally_reserved":0,"allocated":1048576,"data_stored":1108778,"data_compressed":65932,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626499,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":978944,"data_stored":506992,"data_compressed":29534,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855432,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1052672,"data_stored":1099775,"data_compressed":65932,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018957,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36320,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708832,"statfs":{"total":95995035648,"available":95957843968,"internally_reserved":0,"allocated":999424,"data_stored":513788,"data_compressed":29534,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247890,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":507186,"data_compressed":29534,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444119,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36376,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708776,"statfs":{"total":95995035648,"available":95957786624,"internally_reserved":0,"allocated":1056768,"data_stored":572402,"data_compressed":29534,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36384,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708768,"statfs":{"total":95995035648,"available":95957778432,"internally_reserved":0,"allocated":1056768,"data_stored":571898,"data_compressed":29534,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738464,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1003520,"data_stored":508380,"data_compressed":29534,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34759,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34759,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34759,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36398,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36398,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36398,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36398,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36398,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":69310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":65500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":71271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:26:10.632 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:26:10.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.768+0000 7f7c85978640 1 -- 172.21.15.33:0/3673170798 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c80101c20 msgr2=0x7f7c801020a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:10.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.768+0000 7f7c85978640 1 --2- 172.21.15.33:0/3673170798 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c80101c20 0x7f7c801020a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7c74009900 tx=0x7f7c7402a410 comp rx=0 tx=0).stop 2024-09-12T12:26:10.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.768+0000 7f7c85978640 1 -- 172.21.15.33:0/3673170798 shutdown_connections 2024-09-12T12:26:10.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.768+0000 7f7c85978640 1 --2- 172.21.15.33:0/3673170798 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c801025e0 0x7f7c80108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.768+0000 7f7c85978640 1 --2- 172.21.15.33:0/3673170798 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c80101c20 0x7f7c801020a0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.768+0000 7f7c85978640 1 --2- 172.21.15.33:0/3673170798 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c80100a30 0x7f7c80100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.768+0000 7f7c85978640 1 -- 172.21.15.33:0/3673170798 >> 172.21.15.33:0/3673170798 conn(0x7f7c800fc1b0 msgr2=0x7f7c800fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:10.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.768+0000 7f7c85978640 1 -- 172.21.15.33:0/3673170798 shutdown_connections 2024-09-12T12:26:10.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.768+0000 7f7c85978640 1 -- 172.21.15.33:0/3673170798 wait complete. 2024-09-12T12:26:10.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.769+0000 7f7c85978640 1 Processor -- start 2024-09-12T12:26:10.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.769+0000 7f7c85978640 1 -- start start 2024-09-12T12:26:10.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.769+0000 7f7c85978640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c80100a30 0x7f7c80199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.769+0000 7f7c85978640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c80101c20 0x7f7c8019a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.769+0000 7f7c85978640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c801025e0 0x7f7c801a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.769+0000 7f7c85978640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7c8010d6b0 con 0x7f7c801025e0 2024-09-12T12:26:10.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.769+0000 7f7c85978640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7c8010d530 con 0x7f7c80100a30 2024-09-12T12:26:10.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.769+0000 7f7c85978640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7c8010d830 con 0x7f7c80101c20 2024-09-12T12:26:10.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.769+0000 7f7c7f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c801025e0 0x7f7c801a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.769+0000 7f7c7effd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c80100a30 0x7f7c80199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.769+0000 7f7c7f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c801025e0 0x7f7c801a1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52560/0 (socket says 172.21.15.33:52560) 2024-09-12T12:26:10.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.769+0000 7f7c7f7fe640 1 -- 172.21.15.33:0/2137200124 learned_addr learned my addr 172.21.15.33:0/2137200124 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:10.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.769+0000 7f7c7e7fc640 1 --2- 172.21.15.33:0/2137200124 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c80101c20 0x7f7c8019a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.769+0000 7f7c7f7fe640 1 -- 172.21.15.33:0/2137200124 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c80101c20 msgr2=0x7f7c8019a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:10.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.769+0000 7f7c7f7fe640 1 --2- 172.21.15.33:0/2137200124 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c80101c20 0x7f7c8019a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.769+0000 7f7c7f7fe640 1 -- 172.21.15.33:0/2137200124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c80100a30 msgr2=0x7f7c80199fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:10.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.769+0000 7f7c7f7fe640 1 --2- 172.21.15.33:0/2137200124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c80100a30 0x7f7c80199fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.769+0000 7f7c7f7fe640 1 -- 172.21.15.33:0/2137200124 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c801a1bd0 con 0x7f7c801025e0 2024-09-12T12:26:10.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.769+0000 7f7c7effd640 1 --2- 172.21.15.33:0/2137200124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c80100a30 0x7f7c80199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:10.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.770+0000 7f7c7f7fe640 1 --2- 172.21.15.33:0/2137200124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c801025e0 0x7f7c801a1560 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f7c7800cad0 tx=0x7f7c7800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:10.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.770+0000 7f7c84976640 1 -- 172.21.15.33:0/2137200124 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c7800ae20 con 0x7f7c801025e0 2024-09-12T12:26:10.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.770+0000 7f7c84976640 1 -- 172.21.15.33:0/2137200124 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7c78005020 con 0x7f7c801025e0 2024-09-12T12:26:10.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.770+0000 7f7c85978640 1 -- 172.21.15.33:0/2137200124 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c801a1ec0 con 0x7f7c801025e0 2024-09-12T12:26:10.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.770+0000 7f7c84976640 1 -- 172.21.15.33:0/2137200124 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c7800f6b0 con 0x7f7c801025e0 2024-09-12T12:26:10.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.770+0000 7f7c85978640 1 -- 172.21.15.33:0/2137200124 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c801a2330 con 0x7f7c801025e0 2024-09-12T12:26:10.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.771+0000 7f7c85978640 1 -- 172.21.15.33:0/2137200124 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c801a25c0 con 0x7f7c801025e0 2024-09-12T12:26:10.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.772+0000 7f7c84976640 1 -- 172.21.15.33:0/2137200124 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7c780051d0 con 0x7f7c801025e0 2024-09-12T12:26:10.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.773+0000 7f7c84976640 1 --2- 172.21.15.33:0/2137200124 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f7c680a2b90 0x7f7c680a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.773+0000 7f7c7effd640 1 --2- 172.21.15.33:0/2137200124 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f7c680a2b90 0x7f7c680a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.773+0000 7f7c84976640 1 -- 172.21.15.33:0/2137200124 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f7c780cf770 con 0x7f7c801025e0 2024-09-12T12:26:10.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.773+0000 7f7c7effd640 1 --2- 172.21.15.33:0/2137200124 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f7c680a2b90 0x7f7c680a5050 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7c70005fd0 tx=0x7f7c7000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:10.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.776+0000 7f7c84976640 1 -- 172.21.15.33:0/2137200124 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7c78014030 con 0x7f7c801025e0 2024-09-12T12:26:10.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.948+0000 7f7c85978640 1 -- 172.21.15.33:0/2137200124 --> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7c801a2790 con 0x7f7c680a2b90 2024-09-12T12:26:10.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.956+0000 7f7c84976640 1 -- 172.21.15.33:0/2137200124 <== mgr.14150 v2:172.21.15.33:6800/176202431 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340763 (secure 0 0 0) 0x7f7c801a2790 con 0x7f7c680a2b90 2024-09-12T12:26:10.961 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:26:10.963 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-12T12:26:10.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.960+0000 7f7c85978640 1 -- 172.21.15.33:0/2137200124 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f7c680a2b90 msgr2=0x7f7c680a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:10.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.960+0000 7f7c85978640 1 --2- 172.21.15.33:0/2137200124 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f7c680a2b90 0x7f7c680a5050 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7c70005fd0 tx=0x7f7c7000b390 comp rx=0 tx=0).stop 2024-09-12T12:26:10.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.960+0000 7f7c85978640 1 -- 172.21.15.33:0/2137200124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c801025e0 msgr2=0x7f7c801a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:10.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.960+0000 7f7c85978640 1 --2- 172.21.15.33:0/2137200124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c801025e0 0x7f7c801a1560 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f7c7800cad0 tx=0x7f7c7800cf90 comp rx=0 tx=0).stop 2024-09-12T12:26:10.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.960+0000 7f7c85978640 1 -- 172.21.15.33:0/2137200124 shutdown_connections 2024-09-12T12:26:10.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.960+0000 7f7c85978640 1 --2- 172.21.15.33:0/2137200124 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f7c680a2b90 0x7f7c680a5050 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.960+0000 7f7c85978640 1 --2- 172.21.15.33:0/2137200124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c801025e0 0x7f7c801a1560 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.960+0000 7f7c85978640 1 --2- 172.21.15.33:0/2137200124 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c80101c20 0x7f7c8019a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.960+0000 7f7c85978640 1 --2- 172.21.15.33:0/2137200124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c80100a30 0x7f7c80199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.960+0000 7f7c85978640 1 -- 172.21.15.33:0/2137200124 >> 172.21.15.33:0/2137200124 conn(0x7f7c800fc1b0 msgr2=0x7f7c80107440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:10.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.960+0000 7f7c85978640 1 -- 172.21.15.33:0/2137200124 shutdown_connections 2024-09-12T12:26:10.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:10.960+0000 7f7c85978640 1 -- 172.21.15.33:0/2137200124 wait complete. 2024-09-12T12:26:10.972 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":355,"stamp":"2024-09-12T12:26:09.912063+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":664934,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":753,"num_read_kb":502,"num_write":369,"num_write_kb":3074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":1181980,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":797,"ondisk_log_size":797,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":386280,"kb_used_data":12024,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124555544,"statfs":{"total":1151940427776,"available":1151544877056,"internally_reserved":0,"allocated":12312576,"data_stored":8101064,"data_compressed":463602,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19141,"internal_metadata":382973243},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5940,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":39,"num_write":10,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.104443"},"pg_stats":[{"pgid":"2.1f","version":"85'9","reported_seq":48,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.809152+0000","last_change":"2024-09-12T12:23:43.779951+0000","last_active":"2024-09-12T12:25:59.809152+0000","last_peered":"2024-09-12T12:25:59.809152+0000","last_clean":"2024-09-12T12:25:59.809152+0000","last_became_active":"2024-09-12T12:23:43.779641+0000","last_became_peered":"2024-09-12T12:23:43.779641+0000","last_unstale":"2024-09-12T12:25:59.809152+0000","last_undegraded":"2024-09-12T12:25:59.809152+0000","last_fullsized":"2024-09-12T12:25:59.809152+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:49.594196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321799+0000","last_change":"2024-09-12T12:23:45.873591+0000","last_active":"2024-09-12T12:26:00.321799+0000","last_peered":"2024-09-12T12:26:00.321799+0000","last_clean":"2024-09-12T12:26:00.321799+0000","last_became_active":"2024-09-12T12:23:45.873295+0000","last_became_peered":"2024-09-12T12:23:45.873295+0000","last_unstale":"2024-09-12T12:26:00.321799+0000","last_undegraded":"2024-09-12T12:26:00.321799+0000","last_fullsized":"2024-09-12T12:26:00.321799+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:49.907824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.811834+0000","last_change":"2024-09-12T12:24:59.128750+0000","last_active":"2024-09-12T12:25:59.811834+0000","last_peered":"2024-09-12T12:25:59.811834+0000","last_clean":"2024-09-12T12:25:59.811834+0000","last_became_active":"2024-09-12T12:24:59.128296+0000","last_became_peered":"2024-09-12T12:24:59.128296+0000","last_unstale":"2024-09-12T12:25:59.811834+0000","last_undegraded":"2024-09-12T12:25:59.811834+0000","last_fullsized":"2024-09-12T12:25:59.811834+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:12:57.582164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321314+0000","last_change":"2024-09-12T12:23:43.835297+0000","last_active":"2024-09-12T12:26:00.321314+0000","last_peered":"2024-09-12T12:26:00.321314+0000","last_clean":"2024-09-12T12:26:00.321314+0000","last_became_active":"2024-09-12T12:23:43.834971+0000","last_became_peered":"2024-09-12T12:23:43.834971+0000","last_unstale":"2024-09-12T12:26:00.321314+0000","last_undegraded":"2024-09-12T12:26:00.321314+0000","last_fullsized":"2024-09-12T12:26:00.321314+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:00:07.128092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.815257+0000","last_change":"2024-09-12T12:23:45.876388+0000","last_active":"2024-09-12T12:25:59.815257+0000","last_peered":"2024-09-12T12:25:59.815257+0000","last_clean":"2024-09-12T12:25:59.815257+0000","last_became_active":"2024-09-12T12:23:45.876090+0000","last_became_peered":"2024-09-12T12:23:45.876090+0000","last_unstale":"2024-09-12T12:25:59.815257+0000","last_undegraded":"2024-09-12T12:25:59.815257+0000","last_fullsized":"2024-09-12T12:25:59.815257+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:02.576991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814026+0000","last_change":"2024-09-12T12:23:52.904665+0000","last_active":"2024-09-12T12:25:59.814026+0000","last_peered":"2024-09-12T12:25:59.814026+0000","last_clean":"2024-09-12T12:25:59.814026+0000","last_became_active":"2024-09-12T12:23:52.903758+0000","last_became_peered":"2024-09-12T12:23:52.903758+0000","last_unstale":"2024-09-12T12:25:59.814026+0000","last_undegraded":"2024-09-12T12:25:59.814026+0000","last_fullsized":"2024-09-12T12:25:59.814026+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:48.510180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"85'4","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322074+0000","last_change":"2024-09-12T12:24:59.134194+0000","last_active":"2024-09-12T12:26:00.322074+0000","last_peered":"2024-09-12T12:26:00.322074+0000","last_clean":"2024-09-12T12:26:00.322074+0000","last_became_active":"2024-09-12T12:24:59.124651+0000","last_became_peered":"2024-09-12T12:24:59.124651+0000","last_unstale":"2024-09-12T12:26:00.322074+0000","last_undegraded":"2024-09-12T12:26:00.322074+0000","last_fullsized":"2024-09-12T12:26:00.322074+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:59:26.516659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322398+0000","last_change":"2024-09-12T12:23:45.863775+0000","last_active":"2024-09-12T12:26:00.322398+0000","last_peered":"2024-09-12T12:26:00.322398+0000","last_clean":"2024-09-12T12:26:00.322398+0000","last_became_active":"2024-09-12T12:23:45.863437+0000","last_became_peered":"2024-09-12T12:23:45.863437+0000","last_unstale":"2024-09-12T12:26:00.322398+0000","last_undegraded":"2024-09-12T12:26:00.322398+0000","last_fullsized":"2024-09-12T12:26:00.322398+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:33.539904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814227+0000","last_change":"2024-09-12T12:23:52.902674+0000","last_active":"2024-09-12T12:25:59.814227+0000","last_peered":"2024-09-12T12:25:59.814227+0000","last_clean":"2024-09-12T12:25:59.814227+0000","last_became_active":"2024-09-12T12:23:52.902130+0000","last_became_peered":"2024-09-12T12:23:52.902130+0000","last_unstale":"2024-09-12T12:25:59.814227+0000","last_undegraded":"2024-09-12T12:25:59.814227+0000","last_fullsized":"2024-09-12T12:25:59.814227+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:24.867630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321932+0000","last_change":"2024-09-12T12:24:59.144624+0000","last_active":"2024-09-12T12:26:00.321932+0000","last_peered":"2024-09-12T12:26:00.321932+0000","last_clean":"2024-09-12T12:26:00.321932+0000","last_became_active":"2024-09-12T12:24:59.129929+0000","last_became_peered":"2024-09-12T12:24:59.129929+0000","last_unstale":"2024-09-12T12:26:00.321932+0000","last_undegraded":"2024-09-12T12:26:00.321932+0000","last_fullsized":"2024-09-12T12:26:00.321932+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:05.959920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":48,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810614+0000","last_change":"2024-09-12T12:23:45.878131+0000","last_active":"2024-09-12T12:25:59.810614+0000","last_peered":"2024-09-12T12:25:59.810614+0000","last_clean":"2024-09-12T12:25:59.810614+0000","last_became_active":"2024-09-12T12:23:45.877838+0000","last_became_peered":"2024-09-12T12:23:45.877838+0000","last_unstale":"2024-09-12T12:25:59.810614+0000","last_undegraded":"2024-09-12T12:25:59.810614+0000","last_fullsized":"2024-09-12T12:25:59.810614+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:31.029515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814081+0000","last_change":"2024-09-12T12:23:52.900871+0000","last_active":"2024-09-12T12:25:59.814081+0000","last_peered":"2024-09-12T12:25:59.814081+0000","last_clean":"2024-09-12T12:25:59.814081+0000","last_became_active":"2024-09-12T12:23:52.900339+0000","last_became_peered":"2024-09-12T12:23:52.900339+0000","last_unstale":"2024-09-12T12:25:59.814081+0000","last_undegraded":"2024-09-12T12:25:59.814081+0000","last_fullsized":"2024-09-12T12:25:59.814081+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:24.778852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.809887+0000","last_change":"2024-09-12T12:23:45.879124+0000","last_active":"2024-09-12T12:25:59.809887+0000","last_peered":"2024-09-12T12:25:59.809887+0000","last_clean":"2024-09-12T12:25:59.809887+0000","last_became_active":"2024-09-12T12:23:45.878770+0000","last_became_peered":"2024-09-12T12:23:45.878770+0000","last_unstale":"2024-09-12T12:25:59.809887+0000","last_undegraded":"2024-09-12T12:25:59.809887+0000","last_fullsized":"2024-09-12T12:25:59.809887+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:58.767155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322839+0000","last_change":"2024-09-12T12:23:43.782666+0000","last_active":"2024-09-12T12:26:00.322839+0000","last_peered":"2024-09-12T12:26:00.322839+0000","last_clean":"2024-09-12T12:26:00.322839+0000","last_became_active":"2024-09-12T12:23:43.782235+0000","last_became_peered":"2024-09-12T12:23:43.782235+0000","last_unstale":"2024-09-12T12:26:00.322839+0000","last_undegraded":"2024-09-12T12:26:00.322839+0000","last_fullsized":"2024-09-12T12:26:00.322839+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:28.499038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814599+0000","last_change":"2024-09-12T12:23:52.933933+0000","last_active":"2024-09-12T12:25:59.814599+0000","last_peered":"2024-09-12T12:25:59.814599+0000","last_clean":"2024-09-12T12:25:59.814599+0000","last_became_active":"2024-09-12T12:23:52.933500+0000","last_became_peered":"2024-09-12T12:23:52.933500+0000","last_unstale":"2024-09-12T12:25:59.814599+0000","last_undegraded":"2024-09-12T12:25:59.814599+0000","last_fullsized":"2024-09-12T12:25:59.814599+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:28.598435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321671+0000","last_change":"2024-09-12T12:23:45.868518+0000","last_active":"2024-09-12T12:26:00.321671+0000","last_peered":"2024-09-12T12:26:00.321671+0000","last_clean":"2024-09-12T12:26:00.321671+0000","last_became_active":"2024-09-12T12:23:45.868198+0000","last_became_peered":"2024-09-12T12:23:45.868198+0000","last_unstale":"2024-09-12T12:26:00.321671+0000","last_undegraded":"2024-09-12T12:26:00.321671+0000","last_fullsized":"2024-09-12T12:26:00.321671+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:53.815362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"89'2","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.812077+0000","last_change":"2024-09-12T12:23:43.785481+0000","last_active":"2024-09-12T12:25:59.812077+0000","last_peered":"2024-09-12T12:25:59.812077+0000","last_clean":"2024-09-12T12:25:59.812077+0000","last_became_active":"2024-09-12T12:23:43.783842+0000","last_became_peered":"2024-09-12T12:23:43.783842+0000","last_unstale":"2024-09-12T12:25:59.812077+0000","last_undegraded":"2024-09-12T12:25:59.812077+0000","last_fullsized":"2024-09-12T12:25:59.812077+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:45:30.080456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"85'1","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814384+0000","last_change":"2024-09-12T12:23:52.898648+0000","last_active":"2024-09-12T12:25:59.814384+0000","last_peered":"2024-09-12T12:25:59.814384+0000","last_clean":"2024-09-12T12:25:59.814384+0000","last_became_active":"2024-09-12T12:23:52.898242+0000","last_became_peered":"2024-09-12T12:23:52.898242+0000","last_unstale":"2024-09-12T12:25:59.814384+0000","last_undegraded":"2024-09-12T12:25:59.814384+0000","last_fullsized":"2024-09-12T12:25:59.814384+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:49:30.598747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322181+0000","last_change":"2024-09-12T12:23:45.873067+0000","last_active":"2024-09-12T12:26:00.322181+0000","last_peered":"2024-09-12T12:26:00.322181+0000","last_clean":"2024-09-12T12:26:00.322181+0000","last_became_active":"2024-09-12T12:23:45.872616+0000","last_became_peered":"2024-09-12T12:23:45.872616+0000","last_unstale":"2024-09-12T12:26:00.322181+0000","last_undegraded":"2024-09-12T12:26:00.322181+0000","last_fullsized":"2024-09-12T12:26:00.322181+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:10.960252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"85'3","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321830+0000","last_change":"2024-09-12T12:23:43.780706+0000","last_active":"2024-09-12T12:26:00.321830+0000","last_peered":"2024-09-12T12:26:00.321830+0000","last_clean":"2024-09-12T12:26:00.321830+0000","last_became_active":"2024-09-12T12:23:43.780387+0000","last_became_peered":"2024-09-12T12:23:43.780387+0000","last_unstale":"2024-09-12T12:26:00.321830+0000","last_undegraded":"2024-09-12T12:26:00.321830+0000","last_fullsized":"2024-09-12T12:26:00.321830+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:54.748461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.809046+0000","last_change":"2024-09-12T12:23:52.902225+0000","last_active":"2024-09-12T12:25:59.809046+0000","last_peered":"2024-09-12T12:25:59.809046+0000","last_clean":"2024-09-12T12:25:59.809046+0000","last_became_active":"2024-09-12T12:23:52.901865+0000","last_became_peered":"2024-09-12T12:23:52.901865+0000","last_unstale":"2024-09-12T12:25:59.809046+0000","last_undegraded":"2024-09-12T12:25:59.809046+0000","last_fullsized":"2024-09-12T12:25:59.809046+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:38.020994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322291+0000","last_change":"2024-09-12T12:23:45.875816+0000","last_active":"2024-09-12T12:26:00.322291+0000","last_peered":"2024-09-12T12:26:00.322291+0000","last_clean":"2024-09-12T12:26:00.322291+0000","last_became_active":"2024-09-12T12:23:45.875419+0000","last_became_peered":"2024-09-12T12:23:45.875419+0000","last_unstale":"2024-09-12T12:26:00.322291+0000","last_undegraded":"2024-09-12T12:26:00.322291+0000","last_fullsized":"2024-09-12T12:26:00.322291+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:14:04.616759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321856+0000","last_change":"2024-09-12T12:23:43.836699+0000","last_active":"2024-09-12T12:26:00.321856+0000","last_peered":"2024-09-12T12:26:00.321856+0000","last_clean":"2024-09-12T12:26:00.321856+0000","last_became_active":"2024-09-12T12:23:43.836341+0000","last_became_peered":"2024-09-12T12:23:43.836341+0000","last_unstale":"2024-09-12T12:26:00.321856+0000","last_undegraded":"2024-09-12T12:26:00.321856+0000","last_fullsized":"2024-09-12T12:26:00.321856+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:40:02.767132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814522+0000","last_change":"2024-09-12T12:23:52.933594+0000","last_active":"2024-09-12T12:25:59.814522+0000","last_peered":"2024-09-12T12:25:59.814522+0000","last_clean":"2024-09-12T12:25:59.814522+0000","last_became_active":"2024-09-12T12:23:52.933197+0000","last_became_peered":"2024-09-12T12:23:52.933197+0000","last_unstale":"2024-09-12T12:25:59.814522+0000","last_undegraded":"2024-09-12T12:25:59.814522+0000","last_fullsized":"2024-09-12T12:25:59.814522+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:34.990674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.815013+0000","last_change":"2024-09-12T12:23:45.881962+0000","last_active":"2024-09-12T12:25:59.815013+0000","last_peered":"2024-09-12T12:25:59.815013+0000","last_clean":"2024-09-12T12:25:59.815013+0000","last_became_active":"2024-09-12T12:23:45.881697+0000","last_became_peered":"2024-09-12T12:23:45.881697+0000","last_unstale":"2024-09-12T12:25:59.815013+0000","last_undegraded":"2024-09-12T12:25:59.815013+0000","last_fullsized":"2024-09-12T12:25:59.815013+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:35:49.369852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814697+0000","last_change":"2024-09-12T12:23:44.235206+0000","last_active":"2024-09-12T12:25:59.814697+0000","last_peered":"2024-09-12T12:25:59.814697+0000","last_clean":"2024-09-12T12:25:59.814697+0000","last_became_active":"2024-09-12T12:23:44.234797+0000","last_became_peered":"2024-09-12T12:23:44.234797+0000","last_unstale":"2024-09-12T12:25:59.814697+0000","last_undegraded":"2024-09-12T12:25:59.814697+0000","last_fullsized":"2024-09-12T12:25:59.814697+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:51.130077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.812112+0000","last_change":"2024-09-12T12:23:52.902763+0000","last_active":"2024-09-12T12:25:59.812112+0000","last_peered":"2024-09-12T12:25:59.812112+0000","last_clean":"2024-09-12T12:25:59.812112+0000","last_became_active":"2024-09-12T12:23:52.902362+0000","last_became_peered":"2024-09-12T12:23:52.902362+0000","last_unstale":"2024-09-12T12:25:59.812112+0000","last_undegraded":"2024-09-12T12:25:59.812112+0000","last_fullsized":"2024-09-12T12:25:59.812112+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:39.481290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321863+0000","last_change":"2024-09-12T12:23:45.875014+0000","last_active":"2024-09-12T12:26:00.321863+0000","last_peered":"2024-09-12T12:26:00.321863+0000","last_clean":"2024-09-12T12:26:00.321863+0000","last_became_active":"2024-09-12T12:23:45.874673+0000","last_became_peered":"2024-09-12T12:23:45.874673+0000","last_unstale":"2024-09-12T12:26:00.321863+0000","last_undegraded":"2024-09-12T12:26:00.321863+0000","last_fullsized":"2024-09-12T12:26:00.321863+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:21.035185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'14","reported_seq":52,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.809082+0000","last_change":"2024-09-12T12:23:43.778558+0000","last_active":"2024-09-12T12:25:59.809082+0000","last_peered":"2024-09-12T12:25:59.809082+0000","last_clean":"2024-09-12T12:25:59.809082+0000","last_became_active":"2024-09-12T12:23:43.778194+0000","last_became_peered":"2024-09-12T12:23:43.778194+0000","last_unstale":"2024-09-12T12:25:59.809082+0000","last_undegraded":"2024-09-12T12:25:59.809082+0000","last_fullsized":"2024-09-12T12:25:59.809082+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:11.625462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321376+0000","last_change":"2024-09-12T12:23:52.933833+0000","last_active":"2024-09-12T12:26:00.321376+0000","last_peered":"2024-09-12T12:26:00.321376+0000","last_clean":"2024-09-12T12:26:00.321376+0000","last_became_active":"2024-09-12T12:23:52.933330+0000","last_became_peered":"2024-09-12T12:23:52.933330+0000","last_unstale":"2024-09-12T12:26:00.321376+0000","last_undegraded":"2024-09-12T12:26:00.321376+0000","last_fullsized":"2024-09-12T12:26:00.321376+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:31.129088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.951968+0000","last_change":"2024-09-12T12:23:45.872527+0000","last_active":"2024-09-12T12:25:59.951968+0000","last_peered":"2024-09-12T12:25:59.951968+0000","last_clean":"2024-09-12T12:25:59.951968+0000","last_became_active":"2024-09-12T12:23:45.872220+0000","last_became_peered":"2024-09-12T12:23:45.872220+0000","last_unstale":"2024-09-12T12:25:59.951968+0000","last_undegraded":"2024-09-12T12:25:59.951968+0000","last_fullsized":"2024-09-12T12:25:59.951968+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:38:08.734145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"85'1","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321937+0000","last_change":"2024-09-12T12:23:43.835824+0000","last_active":"2024-09-12T12:26:00.321937+0000","last_peered":"2024-09-12T12:26:00.321937+0000","last_clean":"2024-09-12T12:26:00.321937+0000","last_became_active":"2024-09-12T12:23:43.835375+0000","last_became_peered":"2024-09-12T12:23:43.835375+0000","last_unstale":"2024-09-12T12:26:00.321937+0000","last_undegraded":"2024-09-12T12:26:00.321937+0000","last_fullsized":"2024-09-12T12:26:00.321937+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:58:57.547060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321968+0000","last_change":"2024-09-12T12:23:52.901739+0000","last_active":"2024-09-12T12:26:00.321968+0000","last_peered":"2024-09-12T12:26:00.321968+0000","last_clean":"2024-09-12T12:26:00.321968+0000","last_became_active":"2024-09-12T12:23:52.901370+0000","last_became_peered":"2024-09-12T12:23:52.901370+0000","last_unstale":"2024-09-12T12:26:00.321968+0000","last_undegraded":"2024-09-12T12:26:00.321968+0000","last_fullsized":"2024-09-12T12:26:00.321968+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:56:44.430446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"87'4","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.812122+0000","last_change":"2024-09-12T12:23:45.870491+0000","last_active":"2024-09-12T12:25:59.812122+0000","last_peered":"2024-09-12T12:25:59.812122+0000","last_clean":"2024-09-12T12:25:59.812122+0000","last_became_active":"2024-09-12T12:23:45.870182+0000","last_became_peered":"2024-09-12T12:23:45.870182+0000","last_unstale":"2024-09-12T12:25:59.812122+0000","last_undegraded":"2024-09-12T12:25:59.812122+0000","last_fullsized":"2024-09-12T12:25:59.812122+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:07.094287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.808939+0000","last_change":"2024-09-12T12:23:43.837430+0000","last_active":"2024-09-12T12:25:59.808939+0000","last_peered":"2024-09-12T12:25:59.808939+0000","last_clean":"2024-09-12T12:25:59.808939+0000","last_became_active":"2024-09-12T12:23:43.837091+0000","last_became_peered":"2024-09-12T12:23:43.837091+0000","last_unstale":"2024-09-12T12:25:59.808939+0000","last_undegraded":"2024-09-12T12:25:59.808939+0000","last_fullsized":"2024-09-12T12:25:59.808939+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:30.841341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322490+0000","last_change":"2024-09-12T12:24:59.175376+0000","last_active":"2024-09-12T12:26:00.322490+0000","last_peered":"2024-09-12T12:26:00.322490+0000","last_clean":"2024-09-12T12:26:00.322490+0000","last_became_active":"2024-09-12T12:24:59.174967+0000","last_became_peered":"2024-09-12T12:24:59.174967+0000","last_unstale":"2024-09-12T12:26:00.322490+0000","last_undegraded":"2024-09-12T12:26:00.322490+0000","last_fullsized":"2024-09-12T12:26:00.322490+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:40.039227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.815721+0000","last_change":"2024-09-12T12:25:59.815721+0000","last_active":"2024-09-12T12:25:59.815721+0000","last_peered":"2024-09-12T12:25:59.815721+0000","last_clean":"2024-09-12T12:25:59.815721+0000","last_became_active":"2024-09-12T12:25:59.815320+0000","last_became_peered":"2024-09-12T12:25:59.815320+0000","last_unstale":"2024-09-12T12:25:59.815721+0000","last_undegraded":"2024-09-12T12:25:59.815721+0000","last_fullsized":"2024-09-12T12:25:59.815721+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:05.327484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'1","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810114+0000","last_change":"2024-09-12T12:23:43.787082+0000","last_active":"2024-09-12T12:25:59.810114+0000","last_peered":"2024-09-12T12:25:59.810114+0000","last_clean":"2024-09-12T12:25:59.810114+0000","last_became_active":"2024-09-12T12:23:43.786619+0000","last_became_peered":"2024-09-12T12:23:43.786619+0000","last_unstale":"2024-09-12T12:25:59.810114+0000","last_undegraded":"2024-09-12T12:25:59.810114+0000","last_fullsized":"2024-09-12T12:25:59.810114+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:21.120020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.951781+0000","last_change":"2024-09-12T12:23:52.899659+0000","last_active":"2024-09-12T12:25:59.951781+0000","last_peered":"2024-09-12T12:25:59.951781+0000","last_clean":"2024-09-12T12:25:59.951781+0000","last_became_active":"2024-09-12T12:23:52.899226+0000","last_became_peered":"2024-09-12T12:23:52.899226+0000","last_unstale":"2024-09-12T12:25:59.951781+0000","last_undegraded":"2024-09-12T12:25:59.951781+0000","last_fullsized":"2024-09-12T12:25:59.951781+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:41.979174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.809913+0000","last_change":"2024-09-12T12:23:45.879112+0000","last_active":"2024-09-12T12:25:59.809913+0000","last_peered":"2024-09-12T12:25:59.809913+0000","last_clean":"2024-09-12T12:25:59.809913+0000","last_became_active":"2024-09-12T12:23:45.878684+0000","last_became_peered":"2024-09-12T12:23:45.878684+0000","last_unstale":"2024-09-12T12:25:59.809913+0000","last_undegraded":"2024-09-12T12:25:59.809913+0000","last_fullsized":"2024-09-12T12:25:59.809913+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:11:18.102437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'5","reported_seq":142,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:05.316480+0000","last_change":"2024-09-12T12:23:43.835282+0000","last_active":"2024-09-12T12:26:05.316480+0000","last_peered":"2024-09-12T12:26:05.316480+0000","last_clean":"2024-09-12T12:26:05.316480+0000","last_became_active":"2024-09-12T12:23:43.834929+0000","last_became_peered":"2024-09-12T12:23:43.834929+0000","last_unstale":"2024-09-12T12:26:05.316480+0000","last_undegraded":"2024-09-12T12:26:05.316480+0000","last_fullsized":"2024-09-12T12:26:05.316480+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:59:11.516387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.951956+0000","last_change":"2024-09-12T12:23:52.934077+0000","last_active":"2024-09-12T12:25:59.951956+0000","last_peered":"2024-09-12T12:25:59.951956+0000","last_clean":"2024-09-12T12:25:59.951956+0000","last_became_active":"2024-09-12T12:23:52.933583+0000","last_became_peered":"2024-09-12T12:23:52.933583+0000","last_unstale":"2024-09-12T12:25:59.951956+0000","last_undegraded":"2024-09-12T12:25:59.951956+0000","last_fullsized":"2024-09-12T12:25:59.951956+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:06.570624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.951541+0000","last_change":"2024-09-12T12:23:45.875735+0000","last_active":"2024-09-12T12:25:59.951541+0000","last_peered":"2024-09-12T12:25:59.951541+0000","last_clean":"2024-09-12T12:25:59.951541+0000","last_became_active":"2024-09-12T12:23:45.875072+0000","last_became_peered":"2024-09-12T12:23:45.875072+0000","last_unstale":"2024-09-12T12:25:59.951541+0000","last_undegraded":"2024-09-12T12:25:59.951541+0000","last_fullsized":"2024-09-12T12:25:59.951541+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:10.508123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'3","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.809765+0000","last_change":"2024-09-12T12:23:43.785226+0000","last_active":"2024-09-12T12:25:59.809765+0000","last_peered":"2024-09-12T12:25:59.809765+0000","last_clean":"2024-09-12T12:25:59.809765+0000","last_became_active":"2024-09-12T12:23:43.783705+0000","last_became_peered":"2024-09-12T12:23:43.783705+0000","last_unstale":"2024-09-12T12:25:59.809765+0000","last_undegraded":"2024-09-12T12:25:59.809765+0000","last_fullsized":"2024-09-12T12:25:59.809765+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:21.269569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810532+0000","last_change":"2024-09-12T12:23:52.934383+0000","last_active":"2024-09-12T12:25:59.810532+0000","last_peered":"2024-09-12T12:25:59.810532+0000","last_clean":"2024-09-12T12:25:59.810532+0000","last_became_active":"2024-09-12T12:23:52.933744+0000","last_became_peered":"2024-09-12T12:23:52.933744+0000","last_unstale":"2024-09-12T12:25:59.810532+0000","last_undegraded":"2024-09-12T12:25:59.810532+0000","last_fullsized":"2024-09-12T12:25:59.810532+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:44.656785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321624+0000","last_change":"2024-09-12T12:23:45.873460+0000","last_active":"2024-09-12T12:26:00.321624+0000","last_peered":"2024-09-12T12:26:00.321624+0000","last_clean":"2024-09-12T12:26:00.321624+0000","last_became_active":"2024-09-12T12:23:45.873188+0000","last_became_peered":"2024-09-12T12:23:45.873188+0000","last_unstale":"2024-09-12T12:26:00.321624+0000","last_undegraded":"2024-09-12T12:26:00.321624+0000","last_fullsized":"2024-09-12T12:26:00.321624+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:18:29.503856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'3","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814747+0000","last_change":"2024-09-12T12:23:43.781082+0000","last_active":"2024-09-12T12:25:59.814747+0000","last_peered":"2024-09-12T12:25:59.814747+0000","last_clean":"2024-09-12T12:25:59.814747+0000","last_became_active":"2024-09-12T12:23:43.780710+0000","last_became_peered":"2024-09-12T12:23:43.780710+0000","last_unstale":"2024-09-12T12:25:59.814747+0000","last_undegraded":"2024-09-12T12:25:59.814747+0000","last_fullsized":"2024-09-12T12:25:59.814747+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:13:23.748716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":352,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810076+0000","last_change":"2024-09-12T12:22:37.536326+0000","last_active":"2024-09-12T12:25:59.810076+0000","last_peered":"2024-09-12T12:25:59.810076+0000","last_clean":"2024-09-12T12:25:59.810076+0000","last_became_active":"2024-09-12T12:22:37.535831+0000","last_became_peered":"2024-09-12T12:22:37.535831+0000","last_unstale":"2024-09-12T12:25:59.810076+0000","last_undegraded":"2024-09-12T12:25:59.810076+0000","last_fullsized":"2024-09-12T12:25:59.810076+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:19:12.296434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:19:12.296434+0000","last_clean_scrub_stamp":"2024-09-12T12:19:12.296434+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:04:49.251883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"85'1","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810224+0000","last_change":"2024-09-12T12:24:59.179285+0000","last_active":"2024-09-12T12:25:59.810224+0000","last_peered":"2024-09-12T12:25:59.810224+0000","last_clean":"2024-09-12T12:25:59.810224+0000","last_became_active":"2024-09-12T12:24:59.175202+0000","last_became_peered":"2024-09-12T12:24:59.175202+0000","last_unstale":"2024-09-12T12:25:59.810224+0000","last_undegraded":"2024-09-12T12:25:59.810224+0000","last_fullsized":"2024-09-12T12:25:59.810224+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:44.993426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,10,11,9],"acting":[7,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810502+0000","last_change":"2024-09-12T12:23:45.883059+0000","last_active":"2024-09-12T12:25:59.810502+0000","last_peered":"2024-09-12T12:25:59.810502+0000","last_clean":"2024-09-12T12:25:59.810502+0000","last_became_active":"2024-09-12T12:23:45.882206+0000","last_became_peered":"2024-09-12T12:23:45.882206+0000","last_unstale":"2024-09-12T12:25:59.810502+0000","last_undegraded":"2024-09-12T12:25:59.810502+0000","last_fullsized":"2024-09-12T12:25:59.810502+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:43.068533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'3","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.812450+0000","last_change":"2024-09-12T12:23:44.235088+0000","last_active":"2024-09-12T12:25:59.812450+0000","last_peered":"2024-09-12T12:25:59.812450+0000","last_clean":"2024-09-12T12:25:59.812450+0000","last_became_active":"2024-09-12T12:23:44.234551+0000","last_became_peered":"2024-09-12T12:23:44.234551+0000","last_unstale":"2024-09-12T12:25:59.812450+0000","last_undegraded":"2024-09-12T12:25:59.812450+0000","last_fullsized":"2024-09-12T12:25:59.812450+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:47.474387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322097+0000","last_change":"2024-09-12T12:23:52.897807+0000","last_active":"2024-09-12T12:26:00.322097+0000","last_peered":"2024-09-12T12:26:00.322097+0000","last_clean":"2024-09-12T12:26:00.322097+0000","last_became_active":"2024-09-12T12:23:52.897405+0000","last_became_peered":"2024-09-12T12:23:52.897405+0000","last_unstale":"2024-09-12T12:26:00.322097+0000","last_undegraded":"2024-09-12T12:26:00.322097+0000","last_fullsized":"2024-09-12T12:26:00.322097+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:34.714177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"87'6","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810274+0000","last_change":"2024-09-12T12:23:45.873907+0000","last_active":"2024-09-12T12:25:59.810274+0000","last_peered":"2024-09-12T12:25:59.810274+0000","last_clean":"2024-09-12T12:25:59.810274+0000","last_became_active":"2024-09-12T12:23:45.873464+0000","last_became_peered":"2024-09-12T12:23:45.873464+0000","last_unstale":"2024-09-12T12:25:59.810274+0000","last_undegraded":"2024-09-12T12:25:59.810274+0000","last_fullsized":"2024-09-12T12:25:59.810274+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:38:18.151880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810870+0000","last_change":"2024-09-12T12:23:43.782649+0000","last_active":"2024-09-12T12:25:59.810870+0000","last_peered":"2024-09-12T12:25:59.810870+0000","last_clean":"2024-09-12T12:25:59.810870+0000","last_became_active":"2024-09-12T12:23:43.782290+0000","last_became_peered":"2024-09-12T12:23:43.782290+0000","last_unstale":"2024-09-12T12:25:59.810870+0000","last_undegraded":"2024-09-12T12:25:59.810870+0000","last_fullsized":"2024-09-12T12:25:59.810870+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:30:56.964121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814566+0000","last_change":"2024-09-12T12:23:52.905108+0000","last_active":"2024-09-12T12:25:59.814566+0000","last_peered":"2024-09-12T12:25:59.814566+0000","last_clean":"2024-09-12T12:25:59.814566+0000","last_became_active":"2024-09-12T12:23:52.904664+0000","last_became_peered":"2024-09-12T12:23:52.904664+0000","last_unstale":"2024-09-12T12:25:59.814566+0000","last_undegraded":"2024-09-12T12:25:59.814566+0000","last_fullsized":"2024-09-12T12:25:59.814566+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:11.177971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810479+0000","last_change":"2024-09-12T12:23:45.875244+0000","last_active":"2024-09-12T12:25:59.810479+0000","last_peered":"2024-09-12T12:25:59.810479+0000","last_clean":"2024-09-12T12:25:59.810479+0000","last_became_active":"2024-09-12T12:23:45.874889+0000","last_became_peered":"2024-09-12T12:23:45.874889+0000","last_unstale":"2024-09-12T12:25:59.810479+0000","last_undegraded":"2024-09-12T12:25:59.810479+0000","last_fullsized":"2024-09-12T12:25:59.810479+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:30:38.192162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.952053+0000","last_change":"2024-09-12T12:23:43.783232+0000","last_active":"2024-09-12T12:25:59.952053+0000","last_peered":"2024-09-12T12:25:59.952053+0000","last_clean":"2024-09-12T12:25:59.952053+0000","last_became_active":"2024-09-12T12:23:43.782975+0000","last_became_peered":"2024-09-12T12:23:43.782975+0000","last_unstale":"2024-09-12T12:25:59.952053+0000","last_undegraded":"2024-09-12T12:25:59.952053+0000","last_fullsized":"2024-09-12T12:25:59.952053+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:45.096636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.809684+0000","last_change":"2024-09-12T12:23:52.898356+0000","last_active":"2024-09-12T12:25:59.809684+0000","last_peered":"2024-09-12T12:25:59.809684+0000","last_clean":"2024-09-12T12:25:59.809684+0000","last_became_active":"2024-09-12T12:23:52.897868+0000","last_became_peered":"2024-09-12T12:23:52.897868+0000","last_unstale":"2024-09-12T12:25:59.809684+0000","last_undegraded":"2024-09-12T12:25:59.809684+0000","last_fullsized":"2024-09-12T12:25:59.809684+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:16:36.473730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322394+0000","last_change":"2024-09-12T12:23:45.881532+0000","last_active":"2024-09-12T12:26:00.322394+0000","last_peered":"2024-09-12T12:26:00.322394+0000","last_clean":"2024-09-12T12:26:00.322394+0000","last_became_active":"2024-09-12T12:23:45.880895+0000","last_became_peered":"2024-09-12T12:23:45.880895+0000","last_unstale":"2024-09-12T12:26:00.322394+0000","last_undegraded":"2024-09-12T12:26:00.322394+0000","last_fullsized":"2024-09-12T12:26:00.322394+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:09:05.249773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322868+0000","last_change":"2024-09-12T12:23:43.783436+0000","last_active":"2024-09-12T12:26:00.322868+0000","last_peered":"2024-09-12T12:26:00.322868+0000","last_clean":"2024-09-12T12:26:00.322868+0000","last_became_active":"2024-09-12T12:23:43.782975+0000","last_became_peered":"2024-09-12T12:23:43.782975+0000","last_unstale":"2024-09-12T12:26:00.322868+0000","last_undegraded":"2024-09-12T12:26:00.322868+0000","last_fullsized":"2024-09-12T12:26:00.322868+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:20.840189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.809773+0000","last_change":"2024-09-12T12:23:52.903210+0000","last_active":"2024-09-12T12:25:59.809773+0000","last_peered":"2024-09-12T12:25:59.809773+0000","last_clean":"2024-09-12T12:25:59.809773+0000","last_became_active":"2024-09-12T12:23:52.902832+0000","last_became_peered":"2024-09-12T12:23:52.902832+0000","last_unstale":"2024-09-12T12:25:59.809773+0000","last_undegraded":"2024-09-12T12:25:59.809773+0000","last_fullsized":"2024-09-12T12:25:59.809773+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:46:40.506581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810159+0000","last_change":"2024-09-12T12:23:45.880314+0000","last_active":"2024-09-12T12:25:59.810159+0000","last_peered":"2024-09-12T12:25:59.810159+0000","last_clean":"2024-09-12T12:25:59.810159+0000","last_became_active":"2024-09-12T12:23:45.879878+0000","last_became_peered":"2024-09-12T12:23:45.879878+0000","last_unstale":"2024-09-12T12:25:59.810159+0000","last_undegraded":"2024-09-12T12:25:59.810159+0000","last_fullsized":"2024-09-12T12:25:59.810159+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:47.197008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"85'15","reported_seq":78,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322487+0000","last_change":"2024-09-12T12:24:59.142463+0000","last_active":"2024-09-12T12:26:00.322487+0000","last_peered":"2024-09-12T12:26:00.322487+0000","last_clean":"2024-09-12T12:26:00.322487+0000","last_became_active":"2024-09-12T12:24:59.128657+0000","last_became_peered":"2024-09-12T12:24:59.128657+0000","last_unstale":"2024-09-12T12:26:00.322487+0000","last_undegraded":"2024-09-12T12:26:00.322487+0000","last_fullsized":"2024-09-12T12:26:00.322487+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:52.873457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,1],"acting":[8,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.952020+0000","last_change":"2024-09-12T12:23:52.901841+0000","last_active":"2024-09-12T12:25:59.952020+0000","last_peered":"2024-09-12T12:25:59.952020+0000","last_clean":"2024-09-12T12:25:59.952020+0000","last_became_active":"2024-09-12T12:23:52.901469+0000","last_became_peered":"2024-09-12T12:23:52.901469+0000","last_unstale":"2024-09-12T12:25:59.952020+0000","last_undegraded":"2024-09-12T12:25:59.952020+0000","last_fullsized":"2024-09-12T12:25:59.952020+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:40.472980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.809773+0000","last_change":"2024-09-12T12:23:45.874026+0000","last_active":"2024-09-12T12:25:59.809773+0000","last_peered":"2024-09-12T12:25:59.809773+0000","last_clean":"2024-09-12T12:25:59.809773+0000","last_became_active":"2024-09-12T12:23:45.873494+0000","last_became_peered":"2024-09-12T12:23:45.873494+0000","last_unstale":"2024-09-12T12:25:59.809773+0000","last_undegraded":"2024-09-12T12:25:59.809773+0000","last_fullsized":"2024-09-12T12:25:59.809773+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:28.870938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'4","reported_seq":144,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:06.966083+0000","last_change":"2024-09-12T12:23:43.781866+0000","last_active":"2024-09-12T12:26:06.966083+0000","last_peered":"2024-09-12T12:26:06.966083+0000","last_clean":"2024-09-12T12:26:06.966083+0000","last_became_active":"2024-09-12T12:23:43.781488+0000","last_became_peered":"2024-09-12T12:23:43.781488+0000","last_unstale":"2024-09-12T12:26:06.966083+0000","last_undegraded":"2024-09-12T12:26:06.966083+0000","last_fullsized":"2024-09-12T12:26:06.966083+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:13:28.729199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1083,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.809080+0000","last_change":"2024-09-12T12:23:52.903427+0000","last_active":"2024-09-12T12:25:59.809080+0000","last_peered":"2024-09-12T12:25:59.809080+0000","last_clean":"2024-09-12T12:25:59.809080+0000","last_became_active":"2024-09-12T12:23:52.903077+0000","last_became_peered":"2024-09-12T12:23:52.903077+0000","last_unstale":"2024-09-12T12:25:59.809080+0000","last_undegraded":"2024-09-12T12:25:59.809080+0000","last_fullsized":"2024-09-12T12:25:59.809080+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:26:03.409086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":48,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810650+0000","last_change":"2024-09-12T12:23:45.873628+0000","last_active":"2024-09-12T12:25:59.810650+0000","last_peered":"2024-09-12T12:25:59.810650+0000","last_clean":"2024-09-12T12:25:59.810650+0000","last_became_active":"2024-09-12T12:23:45.873264+0000","last_became_peered":"2024-09-12T12:23:45.873264+0000","last_unstale":"2024-09-12T12:25:59.810650+0000","last_undegraded":"2024-09-12T12:25:59.810650+0000","last_fullsized":"2024-09-12T12:25:59.810650+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:17:03.257858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"85'3","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810275+0000","last_change":"2024-09-12T12:23:43.787320+0000","last_active":"2024-09-12T12:25:59.810275+0000","last_peered":"2024-09-12T12:25:59.810275+0000","last_clean":"2024-09-12T12:25:59.810275+0000","last_became_active":"2024-09-12T12:23:43.786937+0000","last_became_peered":"2024-09-12T12:23:43.786937+0000","last_unstale":"2024-09-12T12:25:59.810275+0000","last_undegraded":"2024-09-12T12:25:59.810275+0000","last_fullsized":"2024-09-12T12:25:59.810275+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:19.539586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321974+0000","last_change":"2024-09-12T12:23:52.904582+0000","last_active":"2024-09-12T12:26:00.321974+0000","last_peered":"2024-09-12T12:26:00.321974+0000","last_clean":"2024-09-12T12:26:00.321974+0000","last_became_active":"2024-09-12T12:23:52.904172+0000","last_became_peered":"2024-09-12T12:23:52.904172+0000","last_unstale":"2024-09-12T12:26:00.321974+0000","last_undegraded":"2024-09-12T12:26:00.321974+0000","last_fullsized":"2024-09-12T12:26:00.321974+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:26:14.734098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.951725+0000","last_change":"2024-09-12T12:23:45.878128+0000","last_active":"2024-09-12T12:25:59.951725+0000","last_peered":"2024-09-12T12:25:59.951725+0000","last_clean":"2024-09-12T12:25:59.951725+0000","last_became_active":"2024-09-12T12:23:45.877154+0000","last_became_peered":"2024-09-12T12:23:45.877154+0000","last_unstale":"2024-09-12T12:25:59.951725+0000","last_undegraded":"2024-09-12T12:25:59.951725+0000","last_fullsized":"2024-09-12T12:25:59.951725+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:06.095805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"85'6","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.812155+0000","last_change":"2024-09-12T12:23:43.783586+0000","last_active":"2024-09-12T12:25:59.812155+0000","last_peered":"2024-09-12T12:25:59.812155+0000","last_clean":"2024-09-12T12:25:59.812155+0000","last_became_active":"2024-09-12T12:23:43.783255+0000","last_became_peered":"2024-09-12T12:23:43.783255+0000","last_unstale":"2024-09-12T12:25:59.812155+0000","last_undegraded":"2024-09-12T12:25:59.812155+0000","last_fullsized":"2024-09-12T12:25:59.812155+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:38.609805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810611+0000","last_change":"2024-09-12T12:23:52.901120+0000","last_active":"2024-09-12T12:25:59.810611+0000","last_peered":"2024-09-12T12:25:59.810611+0000","last_clean":"2024-09-12T12:25:59.810611+0000","last_became_active":"2024-09-12T12:23:52.900700+0000","last_became_peered":"2024-09-12T12:23:52.900700+0000","last_unstale":"2024-09-12T12:25:59.810611+0000","last_undegraded":"2024-09-12T12:25:59.810611+0000","last_fullsized":"2024-09-12T12:25:59.810611+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:18.225867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322993+0000","last_change":"2024-09-12T12:23:45.878074+0000","last_active":"2024-09-12T12:26:00.322993+0000","last_peered":"2024-09-12T12:26:00.322993+0000","last_clean":"2024-09-12T12:26:00.322993+0000","last_became_active":"2024-09-12T12:23:45.877753+0000","last_became_peered":"2024-09-12T12:23:45.877753+0000","last_unstale":"2024-09-12T12:26:00.322993+0000","last_undegraded":"2024-09-12T12:26:00.322993+0000","last_fullsized":"2024-09-12T12:26:00.322993+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:15.515609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"89'39","reported_seq":290,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:08.231007+0000","last_change":"2024-09-12T12:23:43.787476+0000","last_active":"2024-09-12T12:26:08.231007+0000","last_peered":"2024-09-12T12:26:08.231007+0000","last_clean":"2024-09-12T12:26:08.231007+0000","last_became_active":"2024-09-12T12:23:43.786808+0000","last_became_peered":"2024-09-12T12:23:43.786808+0000","last_unstale":"2024-09-12T12:26:08.231007+0000","last_undegraded":"2024-09-12T12:26:08.231007+0000","last_fullsized":"2024-09-12T12:26:08.231007+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:08:28.046702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69198,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":212,"num_read_kb":173,"num_write":40,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.808681+0000","last_change":"2024-09-12T12:23:52.900089+0000","last_active":"2024-09-12T12:25:59.808681+0000","last_peered":"2024-09-12T12:25:59.808681+0000","last_clean":"2024-09-12T12:25:59.808681+0000","last_became_active":"2024-09-12T12:23:52.899711+0000","last_became_peered":"2024-09-12T12:23:52.899711+0000","last_unstale":"2024-09-12T12:25:59.808681+0000","last_undegraded":"2024-09-12T12:25:59.808681+0000","last_fullsized":"2024-09-12T12:25:59.808681+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:58:38.850382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322405+0000","last_change":"2024-09-12T12:23:45.876773+0000","last_active":"2024-09-12T12:26:00.322405+0000","last_peered":"2024-09-12T12:26:00.322405+0000","last_clean":"2024-09-12T12:26:00.322405+0000","last_became_active":"2024-09-12T12:23:45.876394+0000","last_became_peered":"2024-09-12T12:23:45.876394+0000","last_unstale":"2024-09-12T12:26:00.322405+0000","last_undegraded":"2024-09-12T12:26:00.322405+0000","last_fullsized":"2024-09-12T12:26:00.322405+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:55.468779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"85'4","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810763+0000","last_change":"2024-09-12T12:23:43.835826+0000","last_active":"2024-09-12T12:25:59.810763+0000","last_peered":"2024-09-12T12:25:59.810763+0000","last_clean":"2024-09-12T12:25:59.810763+0000","last_became_active":"2024-09-12T12:23:43.835378+0000","last_became_peered":"2024-09-12T12:23:43.835378+0000","last_unstale":"2024-09-12T12:25:59.810763+0000","last_undegraded":"2024-09-12T12:25:59.810763+0000","last_fullsized":"2024-09-12T12:25:59.810763+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:23.429407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814384+0000","last_change":"2024-09-12T12:24:59.129183+0000","last_active":"2024-09-12T12:25:59.814384+0000","last_peered":"2024-09-12T12:25:59.814384+0000","last_clean":"2024-09-12T12:25:59.814384+0000","last_became_active":"2024-09-12T12:24:59.128649+0000","last_became_peered":"2024-09-12T12:24:59.128649+0000","last_unstale":"2024-09-12T12:25:59.814384+0000","last_undegraded":"2024-09-12T12:25:59.814384+0000","last_fullsized":"2024-09-12T12:25:59.814384+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:58.630436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.815306+0000","last_change":"2024-09-12T12:23:45.875222+0000","last_active":"2024-09-12T12:25:59.815306+0000","last_peered":"2024-09-12T12:25:59.815306+0000","last_clean":"2024-09-12T12:25:59.815306+0000","last_became_active":"2024-09-12T12:23:45.874859+0000","last_became_peered":"2024-09-12T12:23:45.874859+0000","last_unstale":"2024-09-12T12:25:59.815306+0000","last_undegraded":"2024-09-12T12:25:59.815306+0000","last_fullsized":"2024-09-12T12:25:59.815306+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:29:00.017470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"85'2","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810309+0000","last_change":"2024-09-12T12:23:43.788052+0000","last_active":"2024-09-12T12:25:59.810309+0000","last_peered":"2024-09-12T12:25:59.810309+0000","last_clean":"2024-09-12T12:25:59.810309+0000","last_became_active":"2024-09-12T12:23:43.787533+0000","last_became_peered":"2024-09-12T12:23:43.787533+0000","last_unstale":"2024-09-12T12:25:59.810309+0000","last_undegraded":"2024-09-12T12:25:59.810309+0000","last_fullsized":"2024-09-12T12:25:59.810309+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:32.042395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.808516+0000","last_change":"2024-09-12T12:23:52.900856+0000","last_active":"2024-09-12T12:25:59.808516+0000","last_peered":"2024-09-12T12:25:59.808516+0000","last_clean":"2024-09-12T12:25:59.808516+0000","last_became_active":"2024-09-12T12:23:52.900444+0000","last_became_peered":"2024-09-12T12:23:52.900444+0000","last_unstale":"2024-09-12T12:25:59.808516+0000","last_undegraded":"2024-09-12T12:25:59.808516+0000","last_fullsized":"2024-09-12T12:25:59.808516+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:52:22.443801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322576+0000","last_change":"2024-09-12T12:23:45.869666+0000","last_active":"2024-09-12T12:26:00.322576+0000","last_peered":"2024-09-12T12:26:00.322576+0000","last_clean":"2024-09-12T12:26:00.322576+0000","last_became_active":"2024-09-12T12:23:45.869308+0000","last_became_peered":"2024-09-12T12:23:45.869308+0000","last_unstale":"2024-09-12T12:26:00.322576+0000","last_undegraded":"2024-09-12T12:26:00.322576+0000","last_fullsized":"2024-09-12T12:26:00.322576+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:37:47.895807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"87'4","reported_seq":143,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:08.230706+0000","last_change":"2024-09-12T12:23:43.786124+0000","last_active":"2024-09-12T12:26:08.230706+0000","last_peered":"2024-09-12T12:26:08.230706+0000","last_clean":"2024-09-12T12:26:08.230706+0000","last_became_active":"2024-09-12T12:23:43.785772+0000","last_became_peered":"2024-09-12T12:23:43.785772+0000","last_unstale":"2024-09-12T12:26:08.230706+0000","last_undegraded":"2024-09-12T12:26:08.230706+0000","last_fullsized":"2024-09-12T12:26:08.230706+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:23.458792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321504+0000","last_change":"2024-09-12T12:23:52.905541+0000","last_active":"2024-09-12T12:26:00.321504+0000","last_peered":"2024-09-12T12:26:00.321504+0000","last_clean":"2024-09-12T12:26:00.321504+0000","last_became_active":"2024-09-12T12:23:52.905165+0000","last_became_peered":"2024-09-12T12:23:52.905165+0000","last_unstale":"2024-09-12T12:26:00.321504+0000","last_undegraded":"2024-09-12T12:26:00.321504+0000","last_fullsized":"2024-09-12T12:26:00.321504+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:40.831208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814914+0000","last_change":"2024-09-12T12:23:52.901738+0000","last_active":"2024-09-12T12:25:59.814914+0000","last_peered":"2024-09-12T12:25:59.814914+0000","last_clean":"2024-09-12T12:25:59.814914+0000","last_became_active":"2024-09-12T12:23:52.901348+0000","last_became_peered":"2024-09-12T12:23:52.901348+0000","last_unstale":"2024-09-12T12:25:59.814914+0000","last_undegraded":"2024-09-12T12:25:59.814914+0000","last_fullsized":"2024-09-12T12:25:59.814914+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:16:24.075130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.808552+0000","last_change":"2024-09-12T12:23:45.869431+0000","last_active":"2024-09-12T12:25:59.808552+0000","last_peered":"2024-09-12T12:25:59.808552+0000","last_clean":"2024-09-12T12:25:59.808552+0000","last_became_active":"2024-09-12T12:23:45.869078+0000","last_became_peered":"2024-09-12T12:23:45.869078+0000","last_unstale":"2024-09-12T12:25:59.808552+0000","last_undegraded":"2024-09-12T12:25:59.808552+0000","last_fullsized":"2024-09-12T12:25:59.808552+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:37:19.849489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"85'1","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.809976+0000","last_change":"2024-09-12T12:23:43.787852+0000","last_active":"2024-09-12T12:25:59.809976+0000","last_peered":"2024-09-12T12:25:59.809976+0000","last_clean":"2024-09-12T12:25:59.809976+0000","last_became_active":"2024-09-12T12:23:43.787531+0000","last_became_peered":"2024-09-12T12:23:43.787531+0000","last_unstale":"2024-09-12T12:25:59.809976+0000","last_undegraded":"2024-09-12T12:25:59.809976+0000","last_fullsized":"2024-09-12T12:25:59.809976+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:25.499020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322104+0000","last_change":"2024-09-12T12:23:52.904603+0000","last_active":"2024-09-12T12:26:00.322104+0000","last_peered":"2024-09-12T12:26:00.322104+0000","last_clean":"2024-09-12T12:26:00.322104+0000","last_became_active":"2024-09-12T12:23:52.904146+0000","last_became_peered":"2024-09-12T12:23:52.904146+0000","last_unstale":"2024-09-12T12:26:00.322104+0000","last_undegraded":"2024-09-12T12:26:00.322104+0000","last_fullsized":"2024-09-12T12:26:00.322104+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:01.847489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321536+0000","last_change":"2024-09-12T12:23:45.880381+0000","last_active":"2024-09-12T12:26:00.321536+0000","last_peered":"2024-09-12T12:26:00.321536+0000","last_clean":"2024-09-12T12:26:00.321536+0000","last_became_active":"2024-09-12T12:23:45.879865+0000","last_became_peered":"2024-09-12T12:23:45.879865+0000","last_unstale":"2024-09-12T12:26:00.321536+0000","last_undegraded":"2024-09-12T12:26:00.321536+0000","last_fullsized":"2024-09-12T12:26:00.321536+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:52.033891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"85'2","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.951716+0000","last_change":"2024-09-12T12:23:43.782166+0000","last_active":"2024-09-12T12:25:59.951716+0000","last_peered":"2024-09-12T12:25:59.951716+0000","last_clean":"2024-09-12T12:25:59.951716+0000","last_became_active":"2024-09-12T12:23:43.781808+0000","last_became_peered":"2024-09-12T12:23:43.781808+0000","last_unstale":"2024-09-12T12:25:59.951716+0000","last_undegraded":"2024-09-12T12:25:59.951716+0000","last_fullsized":"2024-09-12T12:25:59.951716+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:44:03.340842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"85'3","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.812050+0000","last_change":"2024-09-12T12:23:43.784869+0000","last_active":"2024-09-12T12:25:59.812050+0000","last_peered":"2024-09-12T12:25:59.812050+0000","last_clean":"2024-09-12T12:25:59.812050+0000","last_became_active":"2024-09-12T12:23:43.784458+0000","last_became_peered":"2024-09-12T12:23:43.784458+0000","last_unstale":"2024-09-12T12:25:59.812050+0000","last_undegraded":"2024-09-12T12:25:59.812050+0000","last_fullsized":"2024-09-12T12:25:59.812050+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:46.025169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810282+0000","last_change":"2024-09-12T12:23:45.879258+0000","last_active":"2024-09-12T12:25:59.810282+0000","last_peered":"2024-09-12T12:25:59.810282+0000","last_clean":"2024-09-12T12:25:59.810282+0000","last_became_active":"2024-09-12T12:23:45.878934+0000","last_became_peered":"2024-09-12T12:23:45.878934+0000","last_unstale":"2024-09-12T12:25:59.810282+0000","last_undegraded":"2024-09-12T12:25:59.810282+0000","last_fullsized":"2024-09-12T12:25:59.810282+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:46:06.617621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.812104+0000","last_change":"2024-09-12T12:23:52.906041+0000","last_active":"2024-09-12T12:25:59.812104+0000","last_peered":"2024-09-12T12:25:59.812104+0000","last_clean":"2024-09-12T12:25:59.812104+0000","last_became_active":"2024-09-12T12:23:52.905630+0000","last_became_peered":"2024-09-12T12:23:52.905630+0000","last_unstale":"2024-09-12T12:25:59.812104+0000","last_undegraded":"2024-09-12T12:25:59.812104+0000","last_fullsized":"2024-09-12T12:25:59.812104+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:15.691085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'8","reported_seq":162,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:06.228868+0000","last_change":"2024-09-12T12:24:59.136007+0000","last_active":"2024-09-12T12:26:06.228868+0000","last_peered":"2024-09-12T12:26:06.228868+0000","last_clean":"2024-09-12T12:26:06.228868+0000","last_became_active":"2024-09-12T12:24:59.128094+0000","last_became_peered":"2024-09-12T12:24:59.128094+0000","last_unstale":"2024-09-12T12:26:06.228868+0000","last_undegraded":"2024-09-12T12:26:06.228868+0000","last_fullsized":"2024-09-12T12:26:06.228868+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:37.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1651,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1015,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322631+0000","last_change":"2024-09-12T12:23:45.868002+0000","last_active":"2024-09-12T12:26:00.322631+0000","last_peered":"2024-09-12T12:26:00.322631+0000","last_clean":"2024-09-12T12:26:00.322631+0000","last_became_active":"2024-09-12T12:23:45.867448+0000","last_became_peered":"2024-09-12T12:23:45.867448+0000","last_unstale":"2024-09-12T12:26:00.322631+0000","last_undegraded":"2024-09-12T12:26:00.322631+0000","last_fullsized":"2024-09-12T12:26:00.322631+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:24:01.805345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.812224+0000","last_change":"2024-09-12T12:23:52.902119+0000","last_active":"2024-09-12T12:25:59.812224+0000","last_peered":"2024-09-12T12:25:59.812224+0000","last_clean":"2024-09-12T12:25:59.812224+0000","last_became_active":"2024-09-12T12:23:52.901681+0000","last_became_peered":"2024-09-12T12:23:52.901681+0000","last_unstale":"2024-09-12T12:25:59.812224+0000","last_undegraded":"2024-09-12T12:25:59.812224+0000","last_fullsized":"2024-09-12T12:25:59.812224+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:42.039729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322128+0000","last_change":"2024-09-12T12:23:45.879115+0000","last_active":"2024-09-12T12:26:00.322128+0000","last_peered":"2024-09-12T12:26:00.322128+0000","last_clean":"2024-09-12T12:26:00.322128+0000","last_became_active":"2024-09-12T12:23:45.878745+0000","last_became_peered":"2024-09-12T12:23:45.878745+0000","last_unstale":"2024-09-12T12:26:00.322128+0000","last_undegraded":"2024-09-12T12:26:00.322128+0000","last_fullsized":"2024-09-12T12:26:00.322128+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:53.152875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":51,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.815900+0000","last_change":"2024-09-12T12:25:59.815900+0000","last_active":"2024-09-12T12:25:59.815900+0000","last_peered":"2024-09-12T12:25:59.815900+0000","last_clean":"2024-09-12T12:25:59.815900+0000","last_became_active":"2024-09-12T12:25:59.815588+0000","last_became_peered":"2024-09-12T12:25:59.815588+0000","last_unstale":"2024-09-12T12:25:59.815900+0000","last_undegraded":"2024-09-12T12:25:59.815900+0000","last_fullsized":"2024-09-12T12:25:59.815900+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:35.793884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.811884+0000","last_change":"2024-09-12T12:23:45.873101+0000","last_active":"2024-09-12T12:25:59.811884+0000","last_peered":"2024-09-12T12:25:59.811884+0000","last_clean":"2024-09-12T12:25:59.811884+0000","last_became_active":"2024-09-12T12:23:45.872373+0000","last_became_peered":"2024-09-12T12:23:45.872373+0000","last_unstale":"2024-09-12T12:25:59.811884+0000","last_undegraded":"2024-09-12T12:25:59.811884+0000","last_fullsized":"2024-09-12T12:25:59.811884+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:47:14.747538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814667+0000","last_change":"2024-09-12T12:23:45.875315+0000","last_active":"2024-09-12T12:25:59.814667+0000","last_peered":"2024-09-12T12:25:59.814667+0000","last_clean":"2024-09-12T12:25:59.814667+0000","last_became_active":"2024-09-12T12:23:45.874904+0000","last_became_peered":"2024-09-12T12:23:45.874904+0000","last_unstale":"2024-09-12T12:25:59.814667+0000","last_undegraded":"2024-09-12T12:25:59.814667+0000","last_fullsized":"2024-09-12T12:25:59.814667+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:52:44.373937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.951895+0000","last_change":"2024-09-12T12:24:59.126419+0000","last_active":"2024-09-12T12:25:59.951895+0000","last_peered":"2024-09-12T12:25:59.951895+0000","last_clean":"2024-09-12T12:25:59.951895+0000","last_became_active":"2024-09-12T12:24:59.125996+0000","last_became_peered":"2024-09-12T12:24:59.125996+0000","last_unstale":"2024-09-12T12:25:59.951895+0000","last_undegraded":"2024-09-12T12:25:59.951895+0000","last_fullsized":"2024-09-12T12:25:59.951895+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:01.495467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322488+0000","last_change":"2024-09-12T12:23:45.872638+0000","last_active":"2024-09-12T12:26:00.322488+0000","last_peered":"2024-09-12T12:26:00.322488+0000","last_clean":"2024-09-12T12:26:00.322488+0000","last_became_active":"2024-09-12T12:23:45.872299+0000","last_became_peered":"2024-09-12T12:23:45.872299+0000","last_unstale":"2024-09-12T12:26:00.322488+0000","last_undegraded":"2024-09-12T12:26:00.322488+0000","last_fullsized":"2024-09-12T12:26:00.322488+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:27.758613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":48,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.812624+0000","last_change":"2024-09-12T12:23:45.877168+0000","last_active":"2024-09-12T12:25:59.812624+0000","last_peered":"2024-09-12T12:25:59.812624+0000","last_clean":"2024-09-12T12:25:59.812624+0000","last_became_active":"2024-09-12T12:23:45.876871+0000","last_became_peered":"2024-09-12T12:23:45.876871+0000","last_unstale":"2024-09-12T12:25:59.812624+0000","last_undegraded":"2024-09-12T12:25:59.812624+0000","last_fullsized":"2024-09-12T12:25:59.812624+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:24.567415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321818+0000","last_change":"2024-09-12T12:24:59.128436+0000","last_active":"2024-09-12T12:26:00.321818+0000","last_peered":"2024-09-12T12:26:00.321818+0000","last_clean":"2024-09-12T12:26:00.321818+0000","last_became_active":"2024-09-12T12:24:59.128125+0000","last_became_peered":"2024-09-12T12:24:59.128125+0000","last_unstale":"2024-09-12T12:26:00.321818+0000","last_undegraded":"2024-09-12T12:26:00.321818+0000","last_fullsized":"2024-09-12T12:26:00.321818+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:58.903559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.809780+0000","last_change":"2024-09-12T12:23:45.873728+0000","last_active":"2024-09-12T12:25:59.809780+0000","last_peered":"2024-09-12T12:25:59.809780+0000","last_clean":"2024-09-12T12:25:59.809780+0000","last_became_active":"2024-09-12T12:23:45.871831+0000","last_became_peered":"2024-09-12T12:23:45.871831+0000","last_unstale":"2024-09-12T12:25:59.809780+0000","last_undegraded":"2024-09-12T12:25:59.809780+0000","last_fullsized":"2024-09-12T12:25:59.809780+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:48.690705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321927+0000","last_change":"2024-09-12T12:23:45.873035+0000","last_active":"2024-09-12T12:26:00.321927+0000","last_peered":"2024-09-12T12:26:00.321927+0000","last_clean":"2024-09-12T12:26:00.321927+0000","last_became_active":"2024-09-12T12:23:45.872660+0000","last_became_peered":"2024-09-12T12:23:45.872660+0000","last_unstale":"2024-09-12T12:26:00.321927+0000","last_undegraded":"2024-09-12T12:26:00.321927+0000","last_fullsized":"2024-09-12T12:26:00.321927+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:31.376116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322279+0000","last_change":"2024-09-12T12:23:45.879754+0000","last_active":"2024-09-12T12:26:00.322279+0000","last_peered":"2024-09-12T12:26:00.322279+0000","last_clean":"2024-09-12T12:26:00.322279+0000","last_became_active":"2024-09-12T12:23:45.879362+0000","last_became_peered":"2024-09-12T12:23:45.879362+0000","last_unstale":"2024-09-12T12:26:00.322279+0000","last_undegraded":"2024-09-12T12:26:00.322279+0000","last_fullsized":"2024-09-12T12:26:00.322279+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:23.587083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.952255+0000","last_change":"2024-09-12T12:23:45.878297+0000","last_active":"2024-09-12T12:25:59.952255+0000","last_peered":"2024-09-12T12:25:59.952255+0000","last_clean":"2024-09-12T12:25:59.952255+0000","last_became_active":"2024-09-12T12:23:45.877127+0000","last_became_peered":"2024-09-12T12:23:45.877127+0000","last_unstale":"2024-09-12T12:25:59.952255+0000","last_undegraded":"2024-09-12T12:25:59.952255+0000","last_fullsized":"2024-09-12T12:25:59.952255+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:54.334325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322109+0000","last_change":"2024-09-12T12:23:45.879078+0000","last_active":"2024-09-12T12:26:00.322109+0000","last_peered":"2024-09-12T12:26:00.322109+0000","last_clean":"2024-09-12T12:26:00.322109+0000","last_became_active":"2024-09-12T12:23:45.878799+0000","last_became_peered":"2024-09-12T12:23:45.878799+0000","last_unstale":"2024-09-12T12:26:00.322109+0000","last_undegraded":"2024-09-12T12:26:00.322109+0000","last_fullsized":"2024-09-12T12:26:00.322109+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:45.680643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.812428+0000","last_change":"2024-09-12T12:23:45.872739+0000","last_active":"2024-09-12T12:25:59.812428+0000","last_peered":"2024-09-12T12:25:59.812428+0000","last_clean":"2024-09-12T12:25:59.812428+0000","last_became_active":"2024-09-12T12:23:45.871931+0000","last_became_peered":"2024-09-12T12:23:45.871931+0000","last_unstale":"2024-09-12T12:25:59.812428+0000","last_undegraded":"2024-09-12T12:25:59.812428+0000","last_fullsized":"2024-09-12T12:25:59.812428+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:36:30.451737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.809065+0000","last_change":"2024-09-12T12:23:45.876717+0000","last_active":"2024-09-12T12:25:59.809065+0000","last_peered":"2024-09-12T12:25:59.809065+0000","last_clean":"2024-09-12T12:25:59.809065+0000","last_became_active":"2024-09-12T12:23:45.876372+0000","last_became_peered":"2024-09-12T12:23:45.876372+0000","last_unstale":"2024-09-12T12:25:59.809065+0000","last_undegraded":"2024-09-12T12:25:59.809065+0000","last_fullsized":"2024-09-12T12:25:59.809065+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:40:26.905442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322842+0000","last_change":"2024-09-12T12:23:45.877286+0000","last_active":"2024-09-12T12:26:00.322842+0000","last_peered":"2024-09-12T12:26:00.322842+0000","last_clean":"2024-09-12T12:26:00.322842+0000","last_became_active":"2024-09-12T12:23:45.876619+0000","last_became_peered":"2024-09-12T12:23:45.876619+0000","last_unstale":"2024-09-12T12:26:00.322842+0000","last_undegraded":"2024-09-12T12:26:00.322842+0000","last_fullsized":"2024-09-12T12:26:00.322842+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:05.637917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322331+0000","last_change":"2024-09-12T12:23:45.875244+0000","last_active":"2024-09-12T12:26:00.322331+0000","last_peered":"2024-09-12T12:26:00.322331+0000","last_clean":"2024-09-12T12:26:00.322331+0000","last_became_active":"2024-09-12T12:23:45.874908+0000","last_became_peered":"2024-09-12T12:23:45.874908+0000","last_unstale":"2024-09-12T12:26:00.322331+0000","last_undegraded":"2024-09-12T12:26:00.322331+0000","last_fullsized":"2024-09-12T12:26:00.322331+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:14.314124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814499+0000","last_change":"2024-09-12T12:23:45.875253+0000","last_active":"2024-09-12T12:25:59.814499+0000","last_peered":"2024-09-12T12:25:59.814499+0000","last_clean":"2024-09-12T12:25:59.814499+0000","last_became_active":"2024-09-12T12:23:45.874936+0000","last_became_peered":"2024-09-12T12:23:45.874936+0000","last_unstale":"2024-09-12T12:25:59.814499+0000","last_undegraded":"2024-09-12T12:25:59.814499+0000","last_fullsized":"2024-09-12T12:25:59.814499+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:28.790546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814629+0000","last_change":"2024-09-12T12:23:45.880503+0000","last_active":"2024-09-12T12:25:59.814629+0000","last_peered":"2024-09-12T12:25:59.814629+0000","last_clean":"2024-09-12T12:25:59.814629+0000","last_became_active":"2024-09-12T12:23:45.880184+0000","last_became_peered":"2024-09-12T12:23:45.880184+0000","last_unstale":"2024-09-12T12:25:59.814629+0000","last_undegraded":"2024-09-12T12:25:59.814629+0000","last_fullsized":"2024-09-12T12:25:59.814629+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:12.370667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.952111+0000","last_change":"2024-09-12T12:23:45.869762+0000","last_active":"2024-09-12T12:25:59.952111+0000","last_peered":"2024-09-12T12:25:59.952111+0000","last_clean":"2024-09-12T12:25:59.952111+0000","last_became_active":"2024-09-12T12:23:45.867595+0000","last_became_peered":"2024-09-12T12:23:45.867595+0000","last_unstale":"2024-09-12T12:25:59.952111+0000","last_undegraded":"2024-09-12T12:25:59.952111+0000","last_fullsized":"2024-09-12T12:25:59.952111+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:25:19.855969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814699+0000","last_change":"2024-09-12T12:23:45.874097+0000","last_active":"2024-09-12T12:25:59.814699+0000","last_peered":"2024-09-12T12:25:59.814699+0000","last_clean":"2024-09-12T12:25:59.814699+0000","last_became_active":"2024-09-12T12:23:45.873275+0000","last_became_peered":"2024-09-12T12:23:45.873275+0000","last_unstale":"2024-09-12T12:25:59.814699+0000","last_undegraded":"2024-09-12T12:25:59.814699+0000","last_fullsized":"2024-09-12T12:25:59.814699+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:21.303339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810374+0000","last_change":"2024-09-12T12:23:45.883354+0000","last_active":"2024-09-12T12:25:59.810374+0000","last_peered":"2024-09-12T12:25:59.810374+0000","last_clean":"2024-09-12T12:25:59.810374+0000","last_became_active":"2024-09-12T12:23:45.882673+0000","last_became_peered":"2024-09-12T12:23:45.882673+0000","last_unstale":"2024-09-12T12:25:59.810374+0000","last_undegraded":"2024-09-12T12:25:59.810374+0000","last_fullsized":"2024-09-12T12:25:59.810374+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:42.034857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":49,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.812510+0000","last_change":"2024-09-12T12:23:45.876955+0000","last_active":"2024-09-12T12:25:59.812510+0000","last_peered":"2024-09-12T12:25:59.812510+0000","last_clean":"2024-09-12T12:25:59.812510+0000","last_became_active":"2024-09-12T12:23:45.876632+0000","last_became_peered":"2024-09-12T12:23:45.876632+0000","last_unstale":"2024-09-12T12:25:59.812510+0000","last_undegraded":"2024-09-12T12:25:59.812510+0000","last_fullsized":"2024-09-12T12:25:59.812510+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:25.155739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322622+0000","last_change":"2024-09-12T12:23:45.875166+0000","last_active":"2024-09-12T12:26:00.322622+0000","last_peered":"2024-09-12T12:26:00.322622+0000","last_clean":"2024-09-12T12:26:00.322622+0000","last_became_active":"2024-09-12T12:23:45.874835+0000","last_became_peered":"2024-09-12T12:23:45.874835+0000","last_unstale":"2024-09-12T12:26:00.322622+0000","last_undegraded":"2024-09-12T12:26:00.322622+0000","last_fullsized":"2024-09-12T12:26:00.322622+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:50.014484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321494+0000","last_change":"2024-09-12T12:23:45.874161+0000","last_active":"2024-09-12T12:26:00.321494+0000","last_peered":"2024-09-12T12:26:00.321494+0000","last_clean":"2024-09-12T12:26:00.321494+0000","last_became_active":"2024-09-12T12:23:45.873846+0000","last_became_peered":"2024-09-12T12:23:45.873846+0000","last_unstale":"2024-09-12T12:26:00.321494+0000","last_undegraded":"2024-09-12T12:26:00.321494+0000","last_fullsized":"2024-09-12T12:26:00.321494+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:09:17.525956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.809776+0000","last_change":"2024-09-12T12:23:45.870642+0000","last_active":"2024-09-12T12:25:59.809776+0000","last_peered":"2024-09-12T12:25:59.809776+0000","last_clean":"2024-09-12T12:25:59.809776+0000","last_became_active":"2024-09-12T12:23:45.870006+0000","last_became_peered":"2024-09-12T12:23:45.870006+0000","last_unstale":"2024-09-12T12:25:59.809776+0000","last_undegraded":"2024-09-12T12:25:59.809776+0000","last_fullsized":"2024-09-12T12:25:59.809776+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:43:35.133650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.812057+0000","last_change":"2024-09-12T12:23:45.875174+0000","last_active":"2024-09-12T12:25:59.812057+0000","last_peered":"2024-09-12T12:25:59.812057+0000","last_clean":"2024-09-12T12:25:59.812057+0000","last_became_active":"2024-09-12T12:23:45.874851+0000","last_became_peered":"2024-09-12T12:23:45.874851+0000","last_unstale":"2024-09-12T12:25:59.812057+0000","last_undegraded":"2024-09-12T12:25:59.812057+0000","last_fullsized":"2024-09-12T12:25:59.812057+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:42.565644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322506+0000","last_change":"2024-09-12T12:23:45.873170+0000","last_active":"2024-09-12T12:26:00.322506+0000","last_peered":"2024-09-12T12:26:00.322506+0000","last_clean":"2024-09-12T12:26:00.322506+0000","last_became_active":"2024-09-12T12:23:45.872814+0000","last_became_peered":"2024-09-12T12:23:45.872814+0000","last_unstale":"2024-09-12T12:26:00.322506+0000","last_undegraded":"2024-09-12T12:26:00.322506+0000","last_fullsized":"2024-09-12T12:26:00.322506+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:36.143107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814443+0000","last_change":"2024-09-12T12:23:45.874271+0000","last_active":"2024-09-12T12:25:59.814443+0000","last_peered":"2024-09-12T12:25:59.814443+0000","last_clean":"2024-09-12T12:25:59.814443+0000","last_became_active":"2024-09-12T12:23:45.873789+0000","last_became_peered":"2024-09-12T12:23:45.873789+0000","last_unstale":"2024-09-12T12:25:59.814443+0000","last_undegraded":"2024-09-12T12:25:59.814443+0000","last_fullsized":"2024-09-12T12:25:59.814443+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:58.252706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814639+0000","last_change":"2024-09-12T12:23:45.877236+0000","last_active":"2024-09-12T12:25:59.814639+0000","last_peered":"2024-09-12T12:25:59.814639+0000","last_clean":"2024-09-12T12:25:59.814639+0000","last_became_active":"2024-09-12T12:23:45.876920+0000","last_became_peered":"2024-09-12T12:23:45.876920+0000","last_unstale":"2024-09-12T12:25:59.814639+0000","last_undegraded":"2024-09-12T12:25:59.814639+0000","last_fullsized":"2024-09-12T12:25:59.814639+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:19:19.749103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814948+0000","last_change":"2024-09-12T12:23:45.880480+0000","last_active":"2024-09-12T12:25:59.814948+0000","last_peered":"2024-09-12T12:25:59.814948+0000","last_clean":"2024-09-12T12:25:59.814948+0000","last_became_active":"2024-09-12T12:23:45.880163+0000","last_became_peered":"2024-09-12T12:23:45.880163+0000","last_unstale":"2024-09-12T12:25:59.814948+0000","last_undegraded":"2024-09-12T12:25:59.814948+0000","last_fullsized":"2024-09-12T12:25:59.814948+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:35.496705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322687+0000","last_change":"2024-09-12T12:23:45.876975+0000","last_active":"2024-09-12T12:26:00.322687+0000","last_peered":"2024-09-12T12:26:00.322687+0000","last_clean":"2024-09-12T12:26:00.322687+0000","last_became_active":"2024-09-12T12:23:45.876501+0000","last_became_peered":"2024-09-12T12:23:45.876501+0000","last_unstale":"2024-09-12T12:26:00.322687+0000","last_undegraded":"2024-09-12T12:26:00.322687+0000","last_fullsized":"2024-09-12T12:26:00.322687+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:15.029566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74332,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":627,"num_read_kb":393,"num_write":186,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1127,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":438272,"data_stored":218682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":286267,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612650,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":983040,"data_stored":511580,"data_compressed":29534,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841582,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28136,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717016,"statfs":{"total":95995035648,"available":95966224384,"internally_reserved":0,"allocated":1138688,"data_stored":1172637,"data_compressed":65932,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005108,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1003520,"data_stored":515912,"data_compressed":29534,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234040,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":511736,"data_compressed":29534,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462973,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36368,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708784,"statfs":{"total":95995035648,"available":95957794816,"internally_reserved":0,"allocated":1048576,"data_stored":1108778,"data_compressed":65932,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626499,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":978944,"data_stored":506992,"data_compressed":29534,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855432,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1052672,"data_stored":1099775,"data_compressed":65932,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018957,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36320,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708832,"statfs":{"total":95995035648,"available":95957843968,"internally_reserved":0,"allocated":999424,"data_stored":513788,"data_compressed":29534,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247890,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":507186,"data_compressed":29534,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444119,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36376,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708776,"statfs":{"total":95995035648,"available":95957786624,"internally_reserved":0,"allocated":1056768,"data_stored":572402,"data_compressed":29534,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36384,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708768,"statfs":{"total":95995035648,"available":95957778432,"internally_reserved":0,"allocated":1056768,"data_stored":571898,"data_compressed":29534,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738464,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1003520,"data_stored":508380,"data_compressed":29534,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34759,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34759,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34759,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36398,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36398,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36398,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36398,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36398,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":69310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":65500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":71271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:26:11.032 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-12T12:26:11.033 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:26:11.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.135+0000 7fbe04ee6640 1 -- 172.21.15.33:0/3072150952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe001025e0 msgr2=0x7fbe00108e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:11.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.135+0000 7fbe04ee6640 1 --2- 172.21.15.33:0/3072150952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe001025e0 0x7fbe00108e70 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8009ca0 tx=0x7fbdf802a8c0 comp rx=0 tx=0).stop 2024-09-12T12:26:11.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.135+0000 7fbe04ee6640 1 -- 172.21.15.33:0/3072150952 shutdown_connections 2024-09-12T12:26:11.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.135+0000 7fbe04ee6640 1 --2- 172.21.15.33:0/3072150952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe001025e0 0x7fbe00108e70 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:11.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.135+0000 7fbe04ee6640 1 --2- 172.21.15.33:0/3072150952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe00101c20 0x7fbe001020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:11.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.135+0000 7fbe04ee6640 1 --2- 172.21.15.33:0/3072150952 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe00100a30 0x7fbe00100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:11.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.135+0000 7fbe04ee6640 1 -- 172.21.15.33:0/3072150952 >> 172.21.15.33:0/3072150952 conn(0x7fbe000fc1b0 msgr2=0x7fbe000fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:11.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.135+0000 7fbe04ee6640 1 -- 172.21.15.33:0/3072150952 shutdown_connections 2024-09-12T12:26:11.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.135+0000 7fbe04ee6640 1 -- 172.21.15.33:0/3072150952 wait complete. 2024-09-12T12:26:11.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.136+0000 7fbe04ee6640 1 Processor -- start 2024-09-12T12:26:11.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.136+0000 7fbe04ee6640 1 -- start start 2024-09-12T12:26:11.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.136+0000 7fbe04ee6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe00100a30 0x7fbe00197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:11.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.136+0000 7fbe04ee6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe00101c20 0x7fbe00198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:11.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.136+0000 7fbe04ee6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe001025e0 0x7fbe0019f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:11.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.136+0000 7fbe04ee6640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0010d6b0 con 0x7fbe00101c20 2024-09-12T12:26:11.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.136+0000 7fbe04ee6640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0010d530 con 0x7fbe001025e0 2024-09-12T12:26:11.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.136+0000 7fbe04ee6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0010d830 con 0x7fbe00100a30 2024-09-12T12:26:11.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.136+0000 7fbdfdd9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe00101c20 0x7fbe00198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:11.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.136+0000 7fbdfdd9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe00101c20 0x7fbe00198280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52586/0 (socket says 172.21.15.33:52586) 2024-09-12T12:26:11.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.136+0000 7fbdfdd9b640 1 -- 172.21.15.33:0/25563598 learned_addr learned my addr 172.21.15.33:0/25563598 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:11.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.136+0000 7fbdfe59c640 1 --2- 172.21.15.33:0/25563598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe00100a30 0x7fbe00197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:11.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.136+0000 7fbdfed9d640 1 --2- 172.21.15.33:0/25563598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe001025e0 0x7fbe0019f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:11.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.136+0000 7fbdfdd9b640 1 -- 172.21.15.33:0/25563598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe00100a30 msgr2=0x7fbe00197d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:11.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.136+0000 7fbdfdd9b640 1 --2- 172.21.15.33:0/25563598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe00100a30 0x7fbe00197d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:11.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.136+0000 7fbdfdd9b640 1 -- 172.21.15.33:0/25563598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe001025e0 msgr2=0x7fbe0019f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:11.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.136+0000 7fbdfdd9b640 1 --2- 172.21.15.33:0/25563598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe001025e0 0x7fbe0019f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:11.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.136+0000 7fbdfdd9b640 1 -- 172.21.15.33:0/25563598 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe0019f950 con 0x7fbe00101c20 2024-09-12T12:26:11.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.137+0000 7fbdfdd9b640 1 --2- 172.21.15.33:0/25563598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe00101c20 0x7fbe00198280 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fbdf400c890 tx=0x7fbdf400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:11.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.137+0000 7fbdef7fe640 1 -- 172.21.15.33:0/25563598 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf4004220 con 0x7fbe00101c20 2024-09-12T12:26:11.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.137+0000 7fbdef7fe640 1 -- 172.21.15.33:0/25563598 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbdf40043c0 con 0x7fbe00101c20 2024-09-12T12:26:11.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.137+0000 7fbdef7fe640 1 -- 172.21.15.33:0/25563598 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf4004a00 con 0x7fbe00101c20 2024-09-12T12:26:11.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.137+0000 7fbe04ee6640 1 -- 172.21.15.33:0/25563598 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe0019fc40 con 0x7fbe00101c20 2024-09-12T12:26:11.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.137+0000 7fbe04ee6640 1 -- 172.21.15.33:0/25563598 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe001a0190 con 0x7fbe00101c20 2024-09-12T12:26:11.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.138+0000 7fbe04ee6640 1 -- 172.21.15.33:0/25563598 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe00107ec0 con 0x7fbe00101c20 2024-09-12T12:26:11.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.139+0000 7fbdef7fe640 1 -- 172.21.15.33:0/25563598 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fbdf4004ba0 con 0x7fbe00101c20 2024-09-12T12:26:11.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.140+0000 7fbdef7fe640 1 --2- 172.21.15.33:0/25563598 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fbde80a2b90 0x7fbde80a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:11.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.140+0000 7fbdef7fe640 1 -- 172.21.15.33:0/25563598 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fbdf40cf0a0 con 0x7fbe00101c20 2024-09-12T12:26:11.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.140+0000 7fbdfe59c640 1 --2- 172.21.15.33:0/25563598 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fbde80a2b90 0x7fbde80a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:11.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.140+0000 7fbdfe59c640 1 --2- 172.21.15.33:0/25563598 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fbde80a2b90 0x7fbde80a5050 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fbe00199210 tx=0x7fbdf0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:11.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.144+0000 7fbdef7fe640 1 -- 172.21.15.33:0/25563598 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbdf4014030 con 0x7fbe00101c20 2024-09-12T12:26:11.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:10 smithi033 ceph-mon[31246]: pgmap v355: 129 pgs: 129 active+clean; 649 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-12T12:26:11.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:10 smithi033 ceph-mon[31246]: from='client.15276 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:26:11.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.319+0000 7fbe04ee6640 1 -- 172.21.15.33:0/25563598 --> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbe00062630 con 0x7fbde80a2b90 2024-09-12T12:26:11.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.327+0000 7fbdef7fe640 1 -- 172.21.15.33:0/25563598 <== mgr.14150 v2:172.21.15.33:6800/176202431 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340763 (secure 0 0 0) 0x7fbe00062630 con 0x7fbde80a2b90 2024-09-12T12:26:11.332 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:26:11.334 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-12T12:26:11.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.330+0000 7fbe04ee6640 1 -- 172.21.15.33:0/25563598 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fbde80a2b90 msgr2=0x7fbde80a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:11.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.330+0000 7fbe04ee6640 1 --2- 172.21.15.33:0/25563598 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fbde80a2b90 0x7fbde80a5050 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fbe00199210 tx=0x7fbdf0005f90 comp rx=0 tx=0).stop 2024-09-12T12:26:11.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.330+0000 7fbe04ee6640 1 -- 172.21.15.33:0/25563598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe00101c20 msgr2=0x7fbe00198280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:11.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.330+0000 7fbe04ee6640 1 --2- 172.21.15.33:0/25563598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe00101c20 0x7fbe00198280 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fbdf400c890 tx=0x7fbdf400cd50 comp rx=0 tx=0).stop 2024-09-12T12:26:11.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.330+0000 7fbe04ee6640 1 -- 172.21.15.33:0/25563598 shutdown_connections 2024-09-12T12:26:11.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.330+0000 7fbe04ee6640 1 --2- 172.21.15.33:0/25563598 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fbde80a2b90 0x7fbde80a5050 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:11.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.330+0000 7fbe04ee6640 1 --2- 172.21.15.33:0/25563598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe001025e0 0x7fbe0019f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:11.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.330+0000 7fbe04ee6640 1 --2- 172.21.15.33:0/25563598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe00101c20 0x7fbe00198280 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:11.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.330+0000 7fbe04ee6640 1 --2- 172.21.15.33:0/25563598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe00100a30 0x7fbe00197d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:11.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.330+0000 7fbe04ee6640 1 -- 172.21.15.33:0/25563598 >> 172.21.15.33:0/25563598 conn(0x7fbe000fc1b0 msgr2=0x7fbe00105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:11.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.330+0000 7fbe04ee6640 1 -- 172.21.15.33:0/25563598 shutdown_connections 2024-09-12T12:26:11.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:11.330+0000 7fbe04ee6640 1 -- 172.21.15.33:0/25563598 wait complete. 2024-09-12T12:26:11.342 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":355,"stamp":"2024-09-12T12:26:09.912063+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":664934,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":753,"num_read_kb":502,"num_write":369,"num_write_kb":3074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":1181980,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":797,"ondisk_log_size":797,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":386280,"kb_used_data":12024,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124555544,"statfs":{"total":1151940427776,"available":1151544877056,"internally_reserved":0,"allocated":12312576,"data_stored":8101064,"data_compressed":463602,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19141,"internal_metadata":382973243},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5940,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":39,"num_write":10,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.104443"},"pg_stats":[{"pgid":"2.1f","version":"85'9","reported_seq":48,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.809152+0000","last_change":"2024-09-12T12:23:43.779951+0000","last_active":"2024-09-12T12:25:59.809152+0000","last_peered":"2024-09-12T12:25:59.809152+0000","last_clean":"2024-09-12T12:25:59.809152+0000","last_became_active":"2024-09-12T12:23:43.779641+0000","last_became_peered":"2024-09-12T12:23:43.779641+0000","last_unstale":"2024-09-12T12:25:59.809152+0000","last_undegraded":"2024-09-12T12:25:59.809152+0000","last_fullsized":"2024-09-12T12:25:59.809152+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:49.594196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321799+0000","last_change":"2024-09-12T12:23:45.873591+0000","last_active":"2024-09-12T12:26:00.321799+0000","last_peered":"2024-09-12T12:26:00.321799+0000","last_clean":"2024-09-12T12:26:00.321799+0000","last_became_active":"2024-09-12T12:23:45.873295+0000","last_became_peered":"2024-09-12T12:23:45.873295+0000","last_unstale":"2024-09-12T12:26:00.321799+0000","last_undegraded":"2024-09-12T12:26:00.321799+0000","last_fullsized":"2024-09-12T12:26:00.321799+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:49.907824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.811834+0000","last_change":"2024-09-12T12:24:59.128750+0000","last_active":"2024-09-12T12:25:59.811834+0000","last_peered":"2024-09-12T12:25:59.811834+0000","last_clean":"2024-09-12T12:25:59.811834+0000","last_became_active":"2024-09-12T12:24:59.128296+0000","last_became_peered":"2024-09-12T12:24:59.128296+0000","last_unstale":"2024-09-12T12:25:59.811834+0000","last_undegraded":"2024-09-12T12:25:59.811834+0000","last_fullsized":"2024-09-12T12:25:59.811834+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:12:57.582164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321314+0000","last_change":"2024-09-12T12:23:43.835297+0000","last_active":"2024-09-12T12:26:00.321314+0000","last_peered":"2024-09-12T12:26:00.321314+0000","last_clean":"2024-09-12T12:26:00.321314+0000","last_became_active":"2024-09-12T12:23:43.834971+0000","last_became_peered":"2024-09-12T12:23:43.834971+0000","last_unstale":"2024-09-12T12:26:00.321314+0000","last_undegraded":"2024-09-12T12:26:00.321314+0000","last_fullsized":"2024-09-12T12:26:00.321314+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:00:07.128092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.815257+0000","last_change":"2024-09-12T12:23:45.876388+0000","last_active":"2024-09-12T12:25:59.815257+0000","last_peered":"2024-09-12T12:25:59.815257+0000","last_clean":"2024-09-12T12:25:59.815257+0000","last_became_active":"2024-09-12T12:23:45.876090+0000","last_became_peered":"2024-09-12T12:23:45.876090+0000","last_unstale":"2024-09-12T12:25:59.815257+0000","last_undegraded":"2024-09-12T12:25:59.815257+0000","last_fullsized":"2024-09-12T12:25:59.815257+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:02.576991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814026+0000","last_change":"2024-09-12T12:23:52.904665+0000","last_active":"2024-09-12T12:25:59.814026+0000","last_peered":"2024-09-12T12:25:59.814026+0000","last_clean":"2024-09-12T12:25:59.814026+0000","last_became_active":"2024-09-12T12:23:52.903758+0000","last_became_peered":"2024-09-12T12:23:52.903758+0000","last_unstale":"2024-09-12T12:25:59.814026+0000","last_undegraded":"2024-09-12T12:25:59.814026+0000","last_fullsized":"2024-09-12T12:25:59.814026+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:48.510180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"85'4","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322074+0000","last_change":"2024-09-12T12:24:59.134194+0000","last_active":"2024-09-12T12:26:00.322074+0000","last_peered":"2024-09-12T12:26:00.322074+0000","last_clean":"2024-09-12T12:26:00.322074+0000","last_became_active":"2024-09-12T12:24:59.124651+0000","last_became_peered":"2024-09-12T12:24:59.124651+0000","last_unstale":"2024-09-12T12:26:00.322074+0000","last_undegraded":"2024-09-12T12:26:00.322074+0000","last_fullsized":"2024-09-12T12:26:00.322074+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:59:26.516659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322398+0000","last_change":"2024-09-12T12:23:45.863775+0000","last_active":"2024-09-12T12:26:00.322398+0000","last_peered":"2024-09-12T12:26:00.322398+0000","last_clean":"2024-09-12T12:26:00.322398+0000","last_became_active":"2024-09-12T12:23:45.863437+0000","last_became_peered":"2024-09-12T12:23:45.863437+0000","last_unstale":"2024-09-12T12:26:00.322398+0000","last_undegraded":"2024-09-12T12:26:00.322398+0000","last_fullsized":"2024-09-12T12:26:00.322398+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:33.539904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814227+0000","last_change":"2024-09-12T12:23:52.902674+0000","last_active":"2024-09-12T12:25:59.814227+0000","last_peered":"2024-09-12T12:25:59.814227+0000","last_clean":"2024-09-12T12:25:59.814227+0000","last_became_active":"2024-09-12T12:23:52.902130+0000","last_became_peered":"2024-09-12T12:23:52.902130+0000","last_unstale":"2024-09-12T12:25:59.814227+0000","last_undegraded":"2024-09-12T12:25:59.814227+0000","last_fullsized":"2024-09-12T12:25:59.814227+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:24.867630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321932+0000","last_change":"2024-09-12T12:24:59.144624+0000","last_active":"2024-09-12T12:26:00.321932+0000","last_peered":"2024-09-12T12:26:00.321932+0000","last_clean":"2024-09-12T12:26:00.321932+0000","last_became_active":"2024-09-12T12:24:59.129929+0000","last_became_peered":"2024-09-12T12:24:59.129929+0000","last_unstale":"2024-09-12T12:26:00.321932+0000","last_undegraded":"2024-09-12T12:26:00.321932+0000","last_fullsized":"2024-09-12T12:26:00.321932+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:05.959920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":48,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810614+0000","last_change":"2024-09-12T12:23:45.878131+0000","last_active":"2024-09-12T12:25:59.810614+0000","last_peered":"2024-09-12T12:25:59.810614+0000","last_clean":"2024-09-12T12:25:59.810614+0000","last_became_active":"2024-09-12T12:23:45.877838+0000","last_became_peered":"2024-09-12T12:23:45.877838+0000","last_unstale":"2024-09-12T12:25:59.810614+0000","last_undegraded":"2024-09-12T12:25:59.810614+0000","last_fullsized":"2024-09-12T12:25:59.810614+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:31.029515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814081+0000","last_change":"2024-09-12T12:23:52.900871+0000","last_active":"2024-09-12T12:25:59.814081+0000","last_peered":"2024-09-12T12:25:59.814081+0000","last_clean":"2024-09-12T12:25:59.814081+0000","last_became_active":"2024-09-12T12:23:52.900339+0000","last_became_peered":"2024-09-12T12:23:52.900339+0000","last_unstale":"2024-09-12T12:25:59.814081+0000","last_undegraded":"2024-09-12T12:25:59.814081+0000","last_fullsized":"2024-09-12T12:25:59.814081+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:24.778852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.809887+0000","last_change":"2024-09-12T12:23:45.879124+0000","last_active":"2024-09-12T12:25:59.809887+0000","last_peered":"2024-09-12T12:25:59.809887+0000","last_clean":"2024-09-12T12:25:59.809887+0000","last_became_active":"2024-09-12T12:23:45.878770+0000","last_became_peered":"2024-09-12T12:23:45.878770+0000","last_unstale":"2024-09-12T12:25:59.809887+0000","last_undegraded":"2024-09-12T12:25:59.809887+0000","last_fullsized":"2024-09-12T12:25:59.809887+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:58.767155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322839+0000","last_change":"2024-09-12T12:23:43.782666+0000","last_active":"2024-09-12T12:26:00.322839+0000","last_peered":"2024-09-12T12:26:00.322839+0000","last_clean":"2024-09-12T12:26:00.322839+0000","last_became_active":"2024-09-12T12:23:43.782235+0000","last_became_peered":"2024-09-12T12:23:43.782235+0000","last_unstale":"2024-09-12T12:26:00.322839+0000","last_undegraded":"2024-09-12T12:26:00.322839+0000","last_fullsized":"2024-09-12T12:26:00.322839+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:28.499038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814599+0000","last_change":"2024-09-12T12:23:52.933933+0000","last_active":"2024-09-12T12:25:59.814599+0000","last_peered":"2024-09-12T12:25:59.814599+0000","last_clean":"2024-09-12T12:25:59.814599+0000","last_became_active":"2024-09-12T12:23:52.933500+0000","last_became_peered":"2024-09-12T12:23:52.933500+0000","last_unstale":"2024-09-12T12:25:59.814599+0000","last_undegraded":"2024-09-12T12:25:59.814599+0000","last_fullsized":"2024-09-12T12:25:59.814599+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:28.598435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321671+0000","last_change":"2024-09-12T12:23:45.868518+0000","last_active":"2024-09-12T12:26:00.321671+0000","last_peered":"2024-09-12T12:26:00.321671+0000","last_clean":"2024-09-12T12:26:00.321671+0000","last_became_active":"2024-09-12T12:23:45.868198+0000","last_became_peered":"2024-09-12T12:23:45.868198+0000","last_unstale":"2024-09-12T12:26:00.321671+0000","last_undegraded":"2024-09-12T12:26:00.321671+0000","last_fullsized":"2024-09-12T12:26:00.321671+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:53.815362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"89'2","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.812077+0000","last_change":"2024-09-12T12:23:43.785481+0000","last_active":"2024-09-12T12:25:59.812077+0000","last_peered":"2024-09-12T12:25:59.812077+0000","last_clean":"2024-09-12T12:25:59.812077+0000","last_became_active":"2024-09-12T12:23:43.783842+0000","last_became_peered":"2024-09-12T12:23:43.783842+0000","last_unstale":"2024-09-12T12:25:59.812077+0000","last_undegraded":"2024-09-12T12:25:59.812077+0000","last_fullsized":"2024-09-12T12:25:59.812077+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:45:30.080456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"85'1","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814384+0000","last_change":"2024-09-12T12:23:52.898648+0000","last_active":"2024-09-12T12:25:59.814384+0000","last_peered":"2024-09-12T12:25:59.814384+0000","last_clean":"2024-09-12T12:25:59.814384+0000","last_became_active":"2024-09-12T12:23:52.898242+0000","last_became_peered":"2024-09-12T12:23:52.898242+0000","last_unstale":"2024-09-12T12:25:59.814384+0000","last_undegraded":"2024-09-12T12:25:59.814384+0000","last_fullsized":"2024-09-12T12:25:59.814384+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:49:30.598747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322181+0000","last_change":"2024-09-12T12:23:45.873067+0000","last_active":"2024-09-12T12:26:00.322181+0000","last_peered":"2024-09-12T12:26:00.322181+0000","last_clean":"2024-09-12T12:26:00.322181+0000","last_became_active":"2024-09-12T12:23:45.872616+0000","last_became_peered":"2024-09-12T12:23:45.872616+0000","last_unstale":"2024-09-12T12:26:00.322181+0000","last_undegraded":"2024-09-12T12:26:00.322181+0000","last_fullsized":"2024-09-12T12:26:00.322181+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:10.960252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"85'3","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321830+0000","last_change":"2024-09-12T12:23:43.780706+0000","last_active":"2024-09-12T12:26:00.321830+0000","last_peered":"2024-09-12T12:26:00.321830+0000","last_clean":"2024-09-12T12:26:00.321830+0000","last_became_active":"2024-09-12T12:23:43.780387+0000","last_became_peered":"2024-09-12T12:23:43.780387+0000","last_unstale":"2024-09-12T12:26:00.321830+0000","last_undegraded":"2024-09-12T12:26:00.321830+0000","last_fullsized":"2024-09-12T12:26:00.321830+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:54.748461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.809046+0000","last_change":"2024-09-12T12:23:52.902225+0000","last_active":"2024-09-12T12:25:59.809046+0000","last_peered":"2024-09-12T12:25:59.809046+0000","last_clean":"2024-09-12T12:25:59.809046+0000","last_became_active":"2024-09-12T12:23:52.901865+0000","last_became_peered":"2024-09-12T12:23:52.901865+0000","last_unstale":"2024-09-12T12:25:59.809046+0000","last_undegraded":"2024-09-12T12:25:59.809046+0000","last_fullsized":"2024-09-12T12:25:59.809046+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:38.020994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322291+0000","last_change":"2024-09-12T12:23:45.875816+0000","last_active":"2024-09-12T12:26:00.322291+0000","last_peered":"2024-09-12T12:26:00.322291+0000","last_clean":"2024-09-12T12:26:00.322291+0000","last_became_active":"2024-09-12T12:23:45.875419+0000","last_became_peered":"2024-09-12T12:23:45.875419+0000","last_unstale":"2024-09-12T12:26:00.322291+0000","last_undegraded":"2024-09-12T12:26:00.322291+0000","last_fullsized":"2024-09-12T12:26:00.322291+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:14:04.616759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321856+0000","last_change":"2024-09-12T12:23:43.836699+0000","last_active":"2024-09-12T12:26:00.321856+0000","last_peered":"2024-09-12T12:26:00.321856+0000","last_clean":"2024-09-12T12:26:00.321856+0000","last_became_active":"2024-09-12T12:23:43.836341+0000","last_became_peered":"2024-09-12T12:23:43.836341+0000","last_unstale":"2024-09-12T12:26:00.321856+0000","last_undegraded":"2024-09-12T12:26:00.321856+0000","last_fullsized":"2024-09-12T12:26:00.321856+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:40:02.767132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814522+0000","last_change":"2024-09-12T12:23:52.933594+0000","last_active":"2024-09-12T12:25:59.814522+0000","last_peered":"2024-09-12T12:25:59.814522+0000","last_clean":"2024-09-12T12:25:59.814522+0000","last_became_active":"2024-09-12T12:23:52.933197+0000","last_became_peered":"2024-09-12T12:23:52.933197+0000","last_unstale":"2024-09-12T12:25:59.814522+0000","last_undegraded":"2024-09-12T12:25:59.814522+0000","last_fullsized":"2024-09-12T12:25:59.814522+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:34.990674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.815013+0000","last_change":"2024-09-12T12:23:45.881962+0000","last_active":"2024-09-12T12:25:59.815013+0000","last_peered":"2024-09-12T12:25:59.815013+0000","last_clean":"2024-09-12T12:25:59.815013+0000","last_became_active":"2024-09-12T12:23:45.881697+0000","last_became_peered":"2024-09-12T12:23:45.881697+0000","last_unstale":"2024-09-12T12:25:59.815013+0000","last_undegraded":"2024-09-12T12:25:59.815013+0000","last_fullsized":"2024-09-12T12:25:59.815013+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:35:49.369852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814697+0000","last_change":"2024-09-12T12:23:44.235206+0000","last_active":"2024-09-12T12:25:59.814697+0000","last_peered":"2024-09-12T12:25:59.814697+0000","last_clean":"2024-09-12T12:25:59.814697+0000","last_became_active":"2024-09-12T12:23:44.234797+0000","last_became_peered":"2024-09-12T12:23:44.234797+0000","last_unstale":"2024-09-12T12:25:59.814697+0000","last_undegraded":"2024-09-12T12:25:59.814697+0000","last_fullsized":"2024-09-12T12:25:59.814697+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:51.130077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.812112+0000","last_change":"2024-09-12T12:23:52.902763+0000","last_active":"2024-09-12T12:25:59.812112+0000","last_peered":"2024-09-12T12:25:59.812112+0000","last_clean":"2024-09-12T12:25:59.812112+0000","last_became_active":"2024-09-12T12:23:52.902362+0000","last_became_peered":"2024-09-12T12:23:52.902362+0000","last_unstale":"2024-09-12T12:25:59.812112+0000","last_undegraded":"2024-09-12T12:25:59.812112+0000","last_fullsized":"2024-09-12T12:25:59.812112+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:39.481290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321863+0000","last_change":"2024-09-12T12:23:45.875014+0000","last_active":"2024-09-12T12:26:00.321863+0000","last_peered":"2024-09-12T12:26:00.321863+0000","last_clean":"2024-09-12T12:26:00.321863+0000","last_became_active":"2024-09-12T12:23:45.874673+0000","last_became_peered":"2024-09-12T12:23:45.874673+0000","last_unstale":"2024-09-12T12:26:00.321863+0000","last_undegraded":"2024-09-12T12:26:00.321863+0000","last_fullsized":"2024-09-12T12:26:00.321863+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:21.035185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'14","reported_seq":52,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.809082+0000","last_change":"2024-09-12T12:23:43.778558+0000","last_active":"2024-09-12T12:25:59.809082+0000","last_peered":"2024-09-12T12:25:59.809082+0000","last_clean":"2024-09-12T12:25:59.809082+0000","last_became_active":"2024-09-12T12:23:43.778194+0000","last_became_peered":"2024-09-12T12:23:43.778194+0000","last_unstale":"2024-09-12T12:25:59.809082+0000","last_undegraded":"2024-09-12T12:25:59.809082+0000","last_fullsized":"2024-09-12T12:25:59.809082+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:11.625462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321376+0000","last_change":"2024-09-12T12:23:52.933833+0000","last_active":"2024-09-12T12:26:00.321376+0000","last_peered":"2024-09-12T12:26:00.321376+0000","last_clean":"2024-09-12T12:26:00.321376+0000","last_became_active":"2024-09-12T12:23:52.933330+0000","last_became_peered":"2024-09-12T12:23:52.933330+0000","last_unstale":"2024-09-12T12:26:00.321376+0000","last_undegraded":"2024-09-12T12:26:00.321376+0000","last_fullsized":"2024-09-12T12:26:00.321376+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:31.129088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.951968+0000","last_change":"2024-09-12T12:23:45.872527+0000","last_active":"2024-09-12T12:25:59.951968+0000","last_peered":"2024-09-12T12:25:59.951968+0000","last_clean":"2024-09-12T12:25:59.951968+0000","last_became_active":"2024-09-12T12:23:45.872220+0000","last_became_peered":"2024-09-12T12:23:45.872220+0000","last_unstale":"2024-09-12T12:25:59.951968+0000","last_undegraded":"2024-09-12T12:25:59.951968+0000","last_fullsized":"2024-09-12T12:25:59.951968+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:38:08.734145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"85'1","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321937+0000","last_change":"2024-09-12T12:23:43.835824+0000","last_active":"2024-09-12T12:26:00.321937+0000","last_peered":"2024-09-12T12:26:00.321937+0000","last_clean":"2024-09-12T12:26:00.321937+0000","last_became_active":"2024-09-12T12:23:43.835375+0000","last_became_peered":"2024-09-12T12:23:43.835375+0000","last_unstale":"2024-09-12T12:26:00.321937+0000","last_undegraded":"2024-09-12T12:26:00.321937+0000","last_fullsized":"2024-09-12T12:26:00.321937+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:58:57.547060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321968+0000","last_change":"2024-09-12T12:23:52.901739+0000","last_active":"2024-09-12T12:26:00.321968+0000","last_peered":"2024-09-12T12:26:00.321968+0000","last_clean":"2024-09-12T12:26:00.321968+0000","last_became_active":"2024-09-12T12:23:52.901370+0000","last_became_peered":"2024-09-12T12:23:52.901370+0000","last_unstale":"2024-09-12T12:26:00.321968+0000","last_undegraded":"2024-09-12T12:26:00.321968+0000","last_fullsized":"2024-09-12T12:26:00.321968+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:56:44.430446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"87'4","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.812122+0000","last_change":"2024-09-12T12:23:45.870491+0000","last_active":"2024-09-12T12:25:59.812122+0000","last_peered":"2024-09-12T12:25:59.812122+0000","last_clean":"2024-09-12T12:25:59.812122+0000","last_became_active":"2024-09-12T12:23:45.870182+0000","last_became_peered":"2024-09-12T12:23:45.870182+0000","last_unstale":"2024-09-12T12:25:59.812122+0000","last_undegraded":"2024-09-12T12:25:59.812122+0000","last_fullsized":"2024-09-12T12:25:59.812122+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:07.094287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.808939+0000","last_change":"2024-09-12T12:23:43.837430+0000","last_active":"2024-09-12T12:25:59.808939+0000","last_peered":"2024-09-12T12:25:59.808939+0000","last_clean":"2024-09-12T12:25:59.808939+0000","last_became_active":"2024-09-12T12:23:43.837091+0000","last_became_peered":"2024-09-12T12:23:43.837091+0000","last_unstale":"2024-09-12T12:25:59.808939+0000","last_undegraded":"2024-09-12T12:25:59.808939+0000","last_fullsized":"2024-09-12T12:25:59.808939+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:30.841341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322490+0000","last_change":"2024-09-12T12:24:59.175376+0000","last_active":"2024-09-12T12:26:00.322490+0000","last_peered":"2024-09-12T12:26:00.322490+0000","last_clean":"2024-09-12T12:26:00.322490+0000","last_became_active":"2024-09-12T12:24:59.174967+0000","last_became_peered":"2024-09-12T12:24:59.174967+0000","last_unstale":"2024-09-12T12:26:00.322490+0000","last_undegraded":"2024-09-12T12:26:00.322490+0000","last_fullsized":"2024-09-12T12:26:00.322490+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:40.039227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.815721+0000","last_change":"2024-09-12T12:25:59.815721+0000","last_active":"2024-09-12T12:25:59.815721+0000","last_peered":"2024-09-12T12:25:59.815721+0000","last_clean":"2024-09-12T12:25:59.815721+0000","last_became_active":"2024-09-12T12:25:59.815320+0000","last_became_peered":"2024-09-12T12:25:59.815320+0000","last_unstale":"2024-09-12T12:25:59.815721+0000","last_undegraded":"2024-09-12T12:25:59.815721+0000","last_fullsized":"2024-09-12T12:25:59.815721+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:05.327484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'1","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810114+0000","last_change":"2024-09-12T12:23:43.787082+0000","last_active":"2024-09-12T12:25:59.810114+0000","last_peered":"2024-09-12T12:25:59.810114+0000","last_clean":"2024-09-12T12:25:59.810114+0000","last_became_active":"2024-09-12T12:23:43.786619+0000","last_became_peered":"2024-09-12T12:23:43.786619+0000","last_unstale":"2024-09-12T12:25:59.810114+0000","last_undegraded":"2024-09-12T12:25:59.810114+0000","last_fullsized":"2024-09-12T12:25:59.810114+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:21.120020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.951781+0000","last_change":"2024-09-12T12:23:52.899659+0000","last_active":"2024-09-12T12:25:59.951781+0000","last_peered":"2024-09-12T12:25:59.951781+0000","last_clean":"2024-09-12T12:25:59.951781+0000","last_became_active":"2024-09-12T12:23:52.899226+0000","last_became_peered":"2024-09-12T12:23:52.899226+0000","last_unstale":"2024-09-12T12:25:59.951781+0000","last_undegraded":"2024-09-12T12:25:59.951781+0000","last_fullsized":"2024-09-12T12:25:59.951781+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:41.979174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.809913+0000","last_change":"2024-09-12T12:23:45.879112+0000","last_active":"2024-09-12T12:25:59.809913+0000","last_peered":"2024-09-12T12:25:59.809913+0000","last_clean":"2024-09-12T12:25:59.809913+0000","last_became_active":"2024-09-12T12:23:45.878684+0000","last_became_peered":"2024-09-12T12:23:45.878684+0000","last_unstale":"2024-09-12T12:25:59.809913+0000","last_undegraded":"2024-09-12T12:25:59.809913+0000","last_fullsized":"2024-09-12T12:25:59.809913+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:11:18.102437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'5","reported_seq":142,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:05.316480+0000","last_change":"2024-09-12T12:23:43.835282+0000","last_active":"2024-09-12T12:26:05.316480+0000","last_peered":"2024-09-12T12:26:05.316480+0000","last_clean":"2024-09-12T12:26:05.316480+0000","last_became_active":"2024-09-12T12:23:43.834929+0000","last_became_peered":"2024-09-12T12:23:43.834929+0000","last_unstale":"2024-09-12T12:26:05.316480+0000","last_undegraded":"2024-09-12T12:26:05.316480+0000","last_fullsized":"2024-09-12T12:26:05.316480+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:59:11.516387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.951956+0000","last_change":"2024-09-12T12:23:52.934077+0000","last_active":"2024-09-12T12:25:59.951956+0000","last_peered":"2024-09-12T12:25:59.951956+0000","last_clean":"2024-09-12T12:25:59.951956+0000","last_became_active":"2024-09-12T12:23:52.933583+0000","last_became_peered":"2024-09-12T12:23:52.933583+0000","last_unstale":"2024-09-12T12:25:59.951956+0000","last_undegraded":"2024-09-12T12:25:59.951956+0000","last_fullsized":"2024-09-12T12:25:59.951956+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:06.570624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.951541+0000","last_change":"2024-09-12T12:23:45.875735+0000","last_active":"2024-09-12T12:25:59.951541+0000","last_peered":"2024-09-12T12:25:59.951541+0000","last_clean":"2024-09-12T12:25:59.951541+0000","last_became_active":"2024-09-12T12:23:45.875072+0000","last_became_peered":"2024-09-12T12:23:45.875072+0000","last_unstale":"2024-09-12T12:25:59.951541+0000","last_undegraded":"2024-09-12T12:25:59.951541+0000","last_fullsized":"2024-09-12T12:25:59.951541+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:10.508123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'3","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.809765+0000","last_change":"2024-09-12T12:23:43.785226+0000","last_active":"2024-09-12T12:25:59.809765+0000","last_peered":"2024-09-12T12:25:59.809765+0000","last_clean":"2024-09-12T12:25:59.809765+0000","last_became_active":"2024-09-12T12:23:43.783705+0000","last_became_peered":"2024-09-12T12:23:43.783705+0000","last_unstale":"2024-09-12T12:25:59.809765+0000","last_undegraded":"2024-09-12T12:25:59.809765+0000","last_fullsized":"2024-09-12T12:25:59.809765+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:21.269569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810532+0000","last_change":"2024-09-12T12:23:52.934383+0000","last_active":"2024-09-12T12:25:59.810532+0000","last_peered":"2024-09-12T12:25:59.810532+0000","last_clean":"2024-09-12T12:25:59.810532+0000","last_became_active":"2024-09-12T12:23:52.933744+0000","last_became_peered":"2024-09-12T12:23:52.933744+0000","last_unstale":"2024-09-12T12:25:59.810532+0000","last_undegraded":"2024-09-12T12:25:59.810532+0000","last_fullsized":"2024-09-12T12:25:59.810532+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:44.656785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321624+0000","last_change":"2024-09-12T12:23:45.873460+0000","last_active":"2024-09-12T12:26:00.321624+0000","last_peered":"2024-09-12T12:26:00.321624+0000","last_clean":"2024-09-12T12:26:00.321624+0000","last_became_active":"2024-09-12T12:23:45.873188+0000","last_became_peered":"2024-09-12T12:23:45.873188+0000","last_unstale":"2024-09-12T12:26:00.321624+0000","last_undegraded":"2024-09-12T12:26:00.321624+0000","last_fullsized":"2024-09-12T12:26:00.321624+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:18:29.503856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'3","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814747+0000","last_change":"2024-09-12T12:23:43.781082+0000","last_active":"2024-09-12T12:25:59.814747+0000","last_peered":"2024-09-12T12:25:59.814747+0000","last_clean":"2024-09-12T12:25:59.814747+0000","last_became_active":"2024-09-12T12:23:43.780710+0000","last_became_peered":"2024-09-12T12:23:43.780710+0000","last_unstale":"2024-09-12T12:25:59.814747+0000","last_undegraded":"2024-09-12T12:25:59.814747+0000","last_fullsized":"2024-09-12T12:25:59.814747+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:13:23.748716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":352,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810076+0000","last_change":"2024-09-12T12:22:37.536326+0000","last_active":"2024-09-12T12:25:59.810076+0000","last_peered":"2024-09-12T12:25:59.810076+0000","last_clean":"2024-09-12T12:25:59.810076+0000","last_became_active":"2024-09-12T12:22:37.535831+0000","last_became_peered":"2024-09-12T12:22:37.535831+0000","last_unstale":"2024-09-12T12:25:59.810076+0000","last_undegraded":"2024-09-12T12:25:59.810076+0000","last_fullsized":"2024-09-12T12:25:59.810076+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:19:12.296434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:19:12.296434+0000","last_clean_scrub_stamp":"2024-09-12T12:19:12.296434+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:04:49.251883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"85'1","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810224+0000","last_change":"2024-09-12T12:24:59.179285+0000","last_active":"2024-09-12T12:25:59.810224+0000","last_peered":"2024-09-12T12:25:59.810224+0000","last_clean":"2024-09-12T12:25:59.810224+0000","last_became_active":"2024-09-12T12:24:59.175202+0000","last_became_peered":"2024-09-12T12:24:59.175202+0000","last_unstale":"2024-09-12T12:25:59.810224+0000","last_undegraded":"2024-09-12T12:25:59.810224+0000","last_fullsized":"2024-09-12T12:25:59.810224+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:44.993426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,10,11,9],"acting":[7,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810502+0000","last_change":"2024-09-12T12:23:45.883059+0000","last_active":"2024-09-12T12:25:59.810502+0000","last_peered":"2024-09-12T12:25:59.810502+0000","last_clean":"2024-09-12T12:25:59.810502+0000","last_became_active":"2024-09-12T12:23:45.882206+0000","last_became_peered":"2024-09-12T12:23:45.882206+0000","last_unstale":"2024-09-12T12:25:59.810502+0000","last_undegraded":"2024-09-12T12:25:59.810502+0000","last_fullsized":"2024-09-12T12:25:59.810502+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:43.068533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'3","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.812450+0000","last_change":"2024-09-12T12:23:44.235088+0000","last_active":"2024-09-12T12:25:59.812450+0000","last_peered":"2024-09-12T12:25:59.812450+0000","last_clean":"2024-09-12T12:25:59.812450+0000","last_became_active":"2024-09-12T12:23:44.234551+0000","last_became_peered":"2024-09-12T12:23:44.234551+0000","last_unstale":"2024-09-12T12:25:59.812450+0000","last_undegraded":"2024-09-12T12:25:59.812450+0000","last_fullsized":"2024-09-12T12:25:59.812450+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:47.474387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322097+0000","last_change":"2024-09-12T12:23:52.897807+0000","last_active":"2024-09-12T12:26:00.322097+0000","last_peered":"2024-09-12T12:26:00.322097+0000","last_clean":"2024-09-12T12:26:00.322097+0000","last_became_active":"2024-09-12T12:23:52.897405+0000","last_became_peered":"2024-09-12T12:23:52.897405+0000","last_unstale":"2024-09-12T12:26:00.322097+0000","last_undegraded":"2024-09-12T12:26:00.322097+0000","last_fullsized":"2024-09-12T12:26:00.322097+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:34.714177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"87'6","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810274+0000","last_change":"2024-09-12T12:23:45.873907+0000","last_active":"2024-09-12T12:25:59.810274+0000","last_peered":"2024-09-12T12:25:59.810274+0000","last_clean":"2024-09-12T12:25:59.810274+0000","last_became_active":"2024-09-12T12:23:45.873464+0000","last_became_peered":"2024-09-12T12:23:45.873464+0000","last_unstale":"2024-09-12T12:25:59.810274+0000","last_undegraded":"2024-09-12T12:25:59.810274+0000","last_fullsized":"2024-09-12T12:25:59.810274+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:38:18.151880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810870+0000","last_change":"2024-09-12T12:23:43.782649+0000","last_active":"2024-09-12T12:25:59.810870+0000","last_peered":"2024-09-12T12:25:59.810870+0000","last_clean":"2024-09-12T12:25:59.810870+0000","last_became_active":"2024-09-12T12:23:43.782290+0000","last_became_peered":"2024-09-12T12:23:43.782290+0000","last_unstale":"2024-09-12T12:25:59.810870+0000","last_undegraded":"2024-09-12T12:25:59.810870+0000","last_fullsized":"2024-09-12T12:25:59.810870+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:30:56.964121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814566+0000","last_change":"2024-09-12T12:23:52.905108+0000","last_active":"2024-09-12T12:25:59.814566+0000","last_peered":"2024-09-12T12:25:59.814566+0000","last_clean":"2024-09-12T12:25:59.814566+0000","last_became_active":"2024-09-12T12:23:52.904664+0000","last_became_peered":"2024-09-12T12:23:52.904664+0000","last_unstale":"2024-09-12T12:25:59.814566+0000","last_undegraded":"2024-09-12T12:25:59.814566+0000","last_fullsized":"2024-09-12T12:25:59.814566+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:11.177971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810479+0000","last_change":"2024-09-12T12:23:45.875244+0000","last_active":"2024-09-12T12:25:59.810479+0000","last_peered":"2024-09-12T12:25:59.810479+0000","last_clean":"2024-09-12T12:25:59.810479+0000","last_became_active":"2024-09-12T12:23:45.874889+0000","last_became_peered":"2024-09-12T12:23:45.874889+0000","last_unstale":"2024-09-12T12:25:59.810479+0000","last_undegraded":"2024-09-12T12:25:59.810479+0000","last_fullsized":"2024-09-12T12:25:59.810479+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:30:38.192162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.952053+0000","last_change":"2024-09-12T12:23:43.783232+0000","last_active":"2024-09-12T12:25:59.952053+0000","last_peered":"2024-09-12T12:25:59.952053+0000","last_clean":"2024-09-12T12:25:59.952053+0000","last_became_active":"2024-09-12T12:23:43.782975+0000","last_became_peered":"2024-09-12T12:23:43.782975+0000","last_unstale":"2024-09-12T12:25:59.952053+0000","last_undegraded":"2024-09-12T12:25:59.952053+0000","last_fullsized":"2024-09-12T12:25:59.952053+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:45.096636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.809684+0000","last_change":"2024-09-12T12:23:52.898356+0000","last_active":"2024-09-12T12:25:59.809684+0000","last_peered":"2024-09-12T12:25:59.809684+0000","last_clean":"2024-09-12T12:25:59.809684+0000","last_became_active":"2024-09-12T12:23:52.897868+0000","last_became_peered":"2024-09-12T12:23:52.897868+0000","last_unstale":"2024-09-12T12:25:59.809684+0000","last_undegraded":"2024-09-12T12:25:59.809684+0000","last_fullsized":"2024-09-12T12:25:59.809684+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:16:36.473730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322394+0000","last_change":"2024-09-12T12:23:45.881532+0000","last_active":"2024-09-12T12:26:00.322394+0000","last_peered":"2024-09-12T12:26:00.322394+0000","last_clean":"2024-09-12T12:26:00.322394+0000","last_became_active":"2024-09-12T12:23:45.880895+0000","last_became_peered":"2024-09-12T12:23:45.880895+0000","last_unstale":"2024-09-12T12:26:00.322394+0000","last_undegraded":"2024-09-12T12:26:00.322394+0000","last_fullsized":"2024-09-12T12:26:00.322394+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:09:05.249773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322868+0000","last_change":"2024-09-12T12:23:43.783436+0000","last_active":"2024-09-12T12:26:00.322868+0000","last_peered":"2024-09-12T12:26:00.322868+0000","last_clean":"2024-09-12T12:26:00.322868+0000","last_became_active":"2024-09-12T12:23:43.782975+0000","last_became_peered":"2024-09-12T12:23:43.782975+0000","last_unstale":"2024-09-12T12:26:00.322868+0000","last_undegraded":"2024-09-12T12:26:00.322868+0000","last_fullsized":"2024-09-12T12:26:00.322868+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:20.840189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.809773+0000","last_change":"2024-09-12T12:23:52.903210+0000","last_active":"2024-09-12T12:25:59.809773+0000","last_peered":"2024-09-12T12:25:59.809773+0000","last_clean":"2024-09-12T12:25:59.809773+0000","last_became_active":"2024-09-12T12:23:52.902832+0000","last_became_peered":"2024-09-12T12:23:52.902832+0000","last_unstale":"2024-09-12T12:25:59.809773+0000","last_undegraded":"2024-09-12T12:25:59.809773+0000","last_fullsized":"2024-09-12T12:25:59.809773+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:46:40.506581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810159+0000","last_change":"2024-09-12T12:23:45.880314+0000","last_active":"2024-09-12T12:25:59.810159+0000","last_peered":"2024-09-12T12:25:59.810159+0000","last_clean":"2024-09-12T12:25:59.810159+0000","last_became_active":"2024-09-12T12:23:45.879878+0000","last_became_peered":"2024-09-12T12:23:45.879878+0000","last_unstale":"2024-09-12T12:25:59.810159+0000","last_undegraded":"2024-09-12T12:25:59.810159+0000","last_fullsized":"2024-09-12T12:25:59.810159+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:47.197008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"85'15","reported_seq":78,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322487+0000","last_change":"2024-09-12T12:24:59.142463+0000","last_active":"2024-09-12T12:26:00.322487+0000","last_peered":"2024-09-12T12:26:00.322487+0000","last_clean":"2024-09-12T12:26:00.322487+0000","last_became_active":"2024-09-12T12:24:59.128657+0000","last_became_peered":"2024-09-12T12:24:59.128657+0000","last_unstale":"2024-09-12T12:26:00.322487+0000","last_undegraded":"2024-09-12T12:26:00.322487+0000","last_fullsized":"2024-09-12T12:26:00.322487+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:52.873457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,1],"acting":[8,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.952020+0000","last_change":"2024-09-12T12:23:52.901841+0000","last_active":"2024-09-12T12:25:59.952020+0000","last_peered":"2024-09-12T12:25:59.952020+0000","last_clean":"2024-09-12T12:25:59.952020+0000","last_became_active":"2024-09-12T12:23:52.901469+0000","last_became_peered":"2024-09-12T12:23:52.901469+0000","last_unstale":"2024-09-12T12:25:59.952020+0000","last_undegraded":"2024-09-12T12:25:59.952020+0000","last_fullsized":"2024-09-12T12:25:59.952020+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:40.472980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.809773+0000","last_change":"2024-09-12T12:23:45.874026+0000","last_active":"2024-09-12T12:25:59.809773+0000","last_peered":"2024-09-12T12:25:59.809773+0000","last_clean":"2024-09-12T12:25:59.809773+0000","last_became_active":"2024-09-12T12:23:45.873494+0000","last_became_peered":"2024-09-12T12:23:45.873494+0000","last_unstale":"2024-09-12T12:25:59.809773+0000","last_undegraded":"2024-09-12T12:25:59.809773+0000","last_fullsized":"2024-09-12T12:25:59.809773+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:28.870938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'4","reported_seq":144,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:06.966083+0000","last_change":"2024-09-12T12:23:43.781866+0000","last_active":"2024-09-12T12:26:06.966083+0000","last_peered":"2024-09-12T12:26:06.966083+0000","last_clean":"2024-09-12T12:26:06.966083+0000","last_became_active":"2024-09-12T12:23:43.781488+0000","last_became_peered":"2024-09-12T12:23:43.781488+0000","last_unstale":"2024-09-12T12:26:06.966083+0000","last_undegraded":"2024-09-12T12:26:06.966083+0000","last_fullsized":"2024-09-12T12:26:06.966083+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:13:28.729199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1083,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.809080+0000","last_change":"2024-09-12T12:23:52.903427+0000","last_active":"2024-09-12T12:25:59.809080+0000","last_peered":"2024-09-12T12:25:59.809080+0000","last_clean":"2024-09-12T12:25:59.809080+0000","last_became_active":"2024-09-12T12:23:52.903077+0000","last_became_peered":"2024-09-12T12:23:52.903077+0000","last_unstale":"2024-09-12T12:25:59.809080+0000","last_undegraded":"2024-09-12T12:25:59.809080+0000","last_fullsized":"2024-09-12T12:25:59.809080+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:26:03.409086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":48,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810650+0000","last_change":"2024-09-12T12:23:45.873628+0000","last_active":"2024-09-12T12:25:59.810650+0000","last_peered":"2024-09-12T12:25:59.810650+0000","last_clean":"2024-09-12T12:25:59.810650+0000","last_became_active":"2024-09-12T12:23:45.873264+0000","last_became_peered":"2024-09-12T12:23:45.873264+0000","last_unstale":"2024-09-12T12:25:59.810650+0000","last_undegraded":"2024-09-12T12:25:59.810650+0000","last_fullsized":"2024-09-12T12:25:59.810650+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:17:03.257858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"85'3","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810275+0000","last_change":"2024-09-12T12:23:43.787320+0000","last_active":"2024-09-12T12:25:59.810275+0000","last_peered":"2024-09-12T12:25:59.810275+0000","last_clean":"2024-09-12T12:25:59.810275+0000","last_became_active":"2024-09-12T12:23:43.786937+0000","last_became_peered":"2024-09-12T12:23:43.786937+0000","last_unstale":"2024-09-12T12:25:59.810275+0000","last_undegraded":"2024-09-12T12:25:59.810275+0000","last_fullsized":"2024-09-12T12:25:59.810275+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:19.539586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321974+0000","last_change":"2024-09-12T12:23:52.904582+0000","last_active":"2024-09-12T12:26:00.321974+0000","last_peered":"2024-09-12T12:26:00.321974+0000","last_clean":"2024-09-12T12:26:00.321974+0000","last_became_active":"2024-09-12T12:23:52.904172+0000","last_became_peered":"2024-09-12T12:23:52.904172+0000","last_unstale":"2024-09-12T12:26:00.321974+0000","last_undegraded":"2024-09-12T12:26:00.321974+0000","last_fullsized":"2024-09-12T12:26:00.321974+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:26:14.734098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.951725+0000","last_change":"2024-09-12T12:23:45.878128+0000","last_active":"2024-09-12T12:25:59.951725+0000","last_peered":"2024-09-12T12:25:59.951725+0000","last_clean":"2024-09-12T12:25:59.951725+0000","last_became_active":"2024-09-12T12:23:45.877154+0000","last_became_peered":"2024-09-12T12:23:45.877154+0000","last_unstale":"2024-09-12T12:25:59.951725+0000","last_undegraded":"2024-09-12T12:25:59.951725+0000","last_fullsized":"2024-09-12T12:25:59.951725+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:06.095805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"85'6","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.812155+0000","last_change":"2024-09-12T12:23:43.783586+0000","last_active":"2024-09-12T12:25:59.812155+0000","last_peered":"2024-09-12T12:25:59.812155+0000","last_clean":"2024-09-12T12:25:59.812155+0000","last_became_active":"2024-09-12T12:23:43.783255+0000","last_became_peered":"2024-09-12T12:23:43.783255+0000","last_unstale":"2024-09-12T12:25:59.812155+0000","last_undegraded":"2024-09-12T12:25:59.812155+0000","last_fullsized":"2024-09-12T12:25:59.812155+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:38.609805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810611+0000","last_change":"2024-09-12T12:23:52.901120+0000","last_active":"2024-09-12T12:25:59.810611+0000","last_peered":"2024-09-12T12:25:59.810611+0000","last_clean":"2024-09-12T12:25:59.810611+0000","last_became_active":"2024-09-12T12:23:52.900700+0000","last_became_peered":"2024-09-12T12:23:52.900700+0000","last_unstale":"2024-09-12T12:25:59.810611+0000","last_undegraded":"2024-09-12T12:25:59.810611+0000","last_fullsized":"2024-09-12T12:25:59.810611+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:18.225867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322993+0000","last_change":"2024-09-12T12:23:45.878074+0000","last_active":"2024-09-12T12:26:00.322993+0000","last_peered":"2024-09-12T12:26:00.322993+0000","last_clean":"2024-09-12T12:26:00.322993+0000","last_became_active":"2024-09-12T12:23:45.877753+0000","last_became_peered":"2024-09-12T12:23:45.877753+0000","last_unstale":"2024-09-12T12:26:00.322993+0000","last_undegraded":"2024-09-12T12:26:00.322993+0000","last_fullsized":"2024-09-12T12:26:00.322993+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:15.515609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"89'39","reported_seq":290,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:08.231007+0000","last_change":"2024-09-12T12:23:43.787476+0000","last_active":"2024-09-12T12:26:08.231007+0000","last_peered":"2024-09-12T12:26:08.231007+0000","last_clean":"2024-09-12T12:26:08.231007+0000","last_became_active":"2024-09-12T12:23:43.786808+0000","last_became_peered":"2024-09-12T12:23:43.786808+0000","last_unstale":"2024-09-12T12:26:08.231007+0000","last_undegraded":"2024-09-12T12:26:08.231007+0000","last_fullsized":"2024-09-12T12:26:08.231007+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:08:28.046702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69198,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":212,"num_read_kb":173,"num_write":40,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.808681+0000","last_change":"2024-09-12T12:23:52.900089+0000","last_active":"2024-09-12T12:25:59.808681+0000","last_peered":"2024-09-12T12:25:59.808681+0000","last_clean":"2024-09-12T12:25:59.808681+0000","last_became_active":"2024-09-12T12:23:52.899711+0000","last_became_peered":"2024-09-12T12:23:52.899711+0000","last_unstale":"2024-09-12T12:25:59.808681+0000","last_undegraded":"2024-09-12T12:25:59.808681+0000","last_fullsized":"2024-09-12T12:25:59.808681+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:58:38.850382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322405+0000","last_change":"2024-09-12T12:23:45.876773+0000","last_active":"2024-09-12T12:26:00.322405+0000","last_peered":"2024-09-12T12:26:00.322405+0000","last_clean":"2024-09-12T12:26:00.322405+0000","last_became_active":"2024-09-12T12:23:45.876394+0000","last_became_peered":"2024-09-12T12:23:45.876394+0000","last_unstale":"2024-09-12T12:26:00.322405+0000","last_undegraded":"2024-09-12T12:26:00.322405+0000","last_fullsized":"2024-09-12T12:26:00.322405+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:55.468779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"85'4","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810763+0000","last_change":"2024-09-12T12:23:43.835826+0000","last_active":"2024-09-12T12:25:59.810763+0000","last_peered":"2024-09-12T12:25:59.810763+0000","last_clean":"2024-09-12T12:25:59.810763+0000","last_became_active":"2024-09-12T12:23:43.835378+0000","last_became_peered":"2024-09-12T12:23:43.835378+0000","last_unstale":"2024-09-12T12:25:59.810763+0000","last_undegraded":"2024-09-12T12:25:59.810763+0000","last_fullsized":"2024-09-12T12:25:59.810763+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:23.429407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814384+0000","last_change":"2024-09-12T12:24:59.129183+0000","last_active":"2024-09-12T12:25:59.814384+0000","last_peered":"2024-09-12T12:25:59.814384+0000","last_clean":"2024-09-12T12:25:59.814384+0000","last_became_active":"2024-09-12T12:24:59.128649+0000","last_became_peered":"2024-09-12T12:24:59.128649+0000","last_unstale":"2024-09-12T12:25:59.814384+0000","last_undegraded":"2024-09-12T12:25:59.814384+0000","last_fullsized":"2024-09-12T12:25:59.814384+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:58.630436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.815306+0000","last_change":"2024-09-12T12:23:45.875222+0000","last_active":"2024-09-12T12:25:59.815306+0000","last_peered":"2024-09-12T12:25:59.815306+0000","last_clean":"2024-09-12T12:25:59.815306+0000","last_became_active":"2024-09-12T12:23:45.874859+0000","last_became_peered":"2024-09-12T12:23:45.874859+0000","last_unstale":"2024-09-12T12:25:59.815306+0000","last_undegraded":"2024-09-12T12:25:59.815306+0000","last_fullsized":"2024-09-12T12:25:59.815306+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:29:00.017470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"85'2","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810309+0000","last_change":"2024-09-12T12:23:43.788052+0000","last_active":"2024-09-12T12:25:59.810309+0000","last_peered":"2024-09-12T12:25:59.810309+0000","last_clean":"2024-09-12T12:25:59.810309+0000","last_became_active":"2024-09-12T12:23:43.787533+0000","last_became_peered":"2024-09-12T12:23:43.787533+0000","last_unstale":"2024-09-12T12:25:59.810309+0000","last_undegraded":"2024-09-12T12:25:59.810309+0000","last_fullsized":"2024-09-12T12:25:59.810309+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:32.042395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.808516+0000","last_change":"2024-09-12T12:23:52.900856+0000","last_active":"2024-09-12T12:25:59.808516+0000","last_peered":"2024-09-12T12:25:59.808516+0000","last_clean":"2024-09-12T12:25:59.808516+0000","last_became_active":"2024-09-12T12:23:52.900444+0000","last_became_peered":"2024-09-12T12:23:52.900444+0000","last_unstale":"2024-09-12T12:25:59.808516+0000","last_undegraded":"2024-09-12T12:25:59.808516+0000","last_fullsized":"2024-09-12T12:25:59.808516+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:52:22.443801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322576+0000","last_change":"2024-09-12T12:23:45.869666+0000","last_active":"2024-09-12T12:26:00.322576+0000","last_peered":"2024-09-12T12:26:00.322576+0000","last_clean":"2024-09-12T12:26:00.322576+0000","last_became_active":"2024-09-12T12:23:45.869308+0000","last_became_peered":"2024-09-12T12:23:45.869308+0000","last_unstale":"2024-09-12T12:26:00.322576+0000","last_undegraded":"2024-09-12T12:26:00.322576+0000","last_fullsized":"2024-09-12T12:26:00.322576+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:37:47.895807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"87'4","reported_seq":143,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:08.230706+0000","last_change":"2024-09-12T12:23:43.786124+0000","last_active":"2024-09-12T12:26:08.230706+0000","last_peered":"2024-09-12T12:26:08.230706+0000","last_clean":"2024-09-12T12:26:08.230706+0000","last_became_active":"2024-09-12T12:23:43.785772+0000","last_became_peered":"2024-09-12T12:23:43.785772+0000","last_unstale":"2024-09-12T12:26:08.230706+0000","last_undegraded":"2024-09-12T12:26:08.230706+0000","last_fullsized":"2024-09-12T12:26:08.230706+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:23.458792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321504+0000","last_change":"2024-09-12T12:23:52.905541+0000","last_active":"2024-09-12T12:26:00.321504+0000","last_peered":"2024-09-12T12:26:00.321504+0000","last_clean":"2024-09-12T12:26:00.321504+0000","last_became_active":"2024-09-12T12:23:52.905165+0000","last_became_peered":"2024-09-12T12:23:52.905165+0000","last_unstale":"2024-09-12T12:26:00.321504+0000","last_undegraded":"2024-09-12T12:26:00.321504+0000","last_fullsized":"2024-09-12T12:26:00.321504+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:40.831208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814914+0000","last_change":"2024-09-12T12:23:52.901738+0000","last_active":"2024-09-12T12:25:59.814914+0000","last_peered":"2024-09-12T12:25:59.814914+0000","last_clean":"2024-09-12T12:25:59.814914+0000","last_became_active":"2024-09-12T12:23:52.901348+0000","last_became_peered":"2024-09-12T12:23:52.901348+0000","last_unstale":"2024-09-12T12:25:59.814914+0000","last_undegraded":"2024-09-12T12:25:59.814914+0000","last_fullsized":"2024-09-12T12:25:59.814914+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:16:24.075130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.808552+0000","last_change":"2024-09-12T12:23:45.869431+0000","last_active":"2024-09-12T12:25:59.808552+0000","last_peered":"2024-09-12T12:25:59.808552+0000","last_clean":"2024-09-12T12:25:59.808552+0000","last_became_active":"2024-09-12T12:23:45.869078+0000","last_became_peered":"2024-09-12T12:23:45.869078+0000","last_unstale":"2024-09-12T12:25:59.808552+0000","last_undegraded":"2024-09-12T12:25:59.808552+0000","last_fullsized":"2024-09-12T12:25:59.808552+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:37:19.849489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"85'1","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.809976+0000","last_change":"2024-09-12T12:23:43.787852+0000","last_active":"2024-09-12T12:25:59.809976+0000","last_peered":"2024-09-12T12:25:59.809976+0000","last_clean":"2024-09-12T12:25:59.809976+0000","last_became_active":"2024-09-12T12:23:43.787531+0000","last_became_peered":"2024-09-12T12:23:43.787531+0000","last_unstale":"2024-09-12T12:25:59.809976+0000","last_undegraded":"2024-09-12T12:25:59.809976+0000","last_fullsized":"2024-09-12T12:25:59.809976+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:25.499020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322104+0000","last_change":"2024-09-12T12:23:52.904603+0000","last_active":"2024-09-12T12:26:00.322104+0000","last_peered":"2024-09-12T12:26:00.322104+0000","last_clean":"2024-09-12T12:26:00.322104+0000","last_became_active":"2024-09-12T12:23:52.904146+0000","last_became_peered":"2024-09-12T12:23:52.904146+0000","last_unstale":"2024-09-12T12:26:00.322104+0000","last_undegraded":"2024-09-12T12:26:00.322104+0000","last_fullsized":"2024-09-12T12:26:00.322104+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:01.847489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321536+0000","last_change":"2024-09-12T12:23:45.880381+0000","last_active":"2024-09-12T12:26:00.321536+0000","last_peered":"2024-09-12T12:26:00.321536+0000","last_clean":"2024-09-12T12:26:00.321536+0000","last_became_active":"2024-09-12T12:23:45.879865+0000","last_became_peered":"2024-09-12T12:23:45.879865+0000","last_unstale":"2024-09-12T12:26:00.321536+0000","last_undegraded":"2024-09-12T12:26:00.321536+0000","last_fullsized":"2024-09-12T12:26:00.321536+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:52.033891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"85'2","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.951716+0000","last_change":"2024-09-12T12:23:43.782166+0000","last_active":"2024-09-12T12:25:59.951716+0000","last_peered":"2024-09-12T12:25:59.951716+0000","last_clean":"2024-09-12T12:25:59.951716+0000","last_became_active":"2024-09-12T12:23:43.781808+0000","last_became_peered":"2024-09-12T12:23:43.781808+0000","last_unstale":"2024-09-12T12:25:59.951716+0000","last_undegraded":"2024-09-12T12:25:59.951716+0000","last_fullsized":"2024-09-12T12:25:59.951716+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:44:03.340842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"85'3","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.812050+0000","last_change":"2024-09-12T12:23:43.784869+0000","last_active":"2024-09-12T12:25:59.812050+0000","last_peered":"2024-09-12T12:25:59.812050+0000","last_clean":"2024-09-12T12:25:59.812050+0000","last_became_active":"2024-09-12T12:23:43.784458+0000","last_became_peered":"2024-09-12T12:23:43.784458+0000","last_unstale":"2024-09-12T12:25:59.812050+0000","last_undegraded":"2024-09-12T12:25:59.812050+0000","last_fullsized":"2024-09-12T12:25:59.812050+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:46.025169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810282+0000","last_change":"2024-09-12T12:23:45.879258+0000","last_active":"2024-09-12T12:25:59.810282+0000","last_peered":"2024-09-12T12:25:59.810282+0000","last_clean":"2024-09-12T12:25:59.810282+0000","last_became_active":"2024-09-12T12:23:45.878934+0000","last_became_peered":"2024-09-12T12:23:45.878934+0000","last_unstale":"2024-09-12T12:25:59.810282+0000","last_undegraded":"2024-09-12T12:25:59.810282+0000","last_fullsized":"2024-09-12T12:25:59.810282+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:46:06.617621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.812104+0000","last_change":"2024-09-12T12:23:52.906041+0000","last_active":"2024-09-12T12:25:59.812104+0000","last_peered":"2024-09-12T12:25:59.812104+0000","last_clean":"2024-09-12T12:25:59.812104+0000","last_became_active":"2024-09-12T12:23:52.905630+0000","last_became_peered":"2024-09-12T12:23:52.905630+0000","last_unstale":"2024-09-12T12:25:59.812104+0000","last_undegraded":"2024-09-12T12:25:59.812104+0000","last_fullsized":"2024-09-12T12:25:59.812104+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:15.691085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'8","reported_seq":162,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:06.228868+0000","last_change":"2024-09-12T12:24:59.136007+0000","last_active":"2024-09-12T12:26:06.228868+0000","last_peered":"2024-09-12T12:26:06.228868+0000","last_clean":"2024-09-12T12:26:06.228868+0000","last_became_active":"2024-09-12T12:24:59.128094+0000","last_became_peered":"2024-09-12T12:24:59.128094+0000","last_unstale":"2024-09-12T12:26:06.228868+0000","last_undegraded":"2024-09-12T12:26:06.228868+0000","last_fullsized":"2024-09-12T12:26:06.228868+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:42.763864+0000","last_clean_scrub_stamp":"2024-09-12T12:23:42.763864+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:37.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1651,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1015,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322631+0000","last_change":"2024-09-12T12:23:45.868002+0000","last_active":"2024-09-12T12:26:00.322631+0000","last_peered":"2024-09-12T12:26:00.322631+0000","last_clean":"2024-09-12T12:26:00.322631+0000","last_became_active":"2024-09-12T12:23:45.867448+0000","last_became_peered":"2024-09-12T12:23:45.867448+0000","last_unstale":"2024-09-12T12:26:00.322631+0000","last_undegraded":"2024-09-12T12:26:00.322631+0000","last_fullsized":"2024-09-12T12:26:00.322631+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:24:01.805345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.812224+0000","last_change":"2024-09-12T12:23:52.902119+0000","last_active":"2024-09-12T12:25:59.812224+0000","last_peered":"2024-09-12T12:25:59.812224+0000","last_clean":"2024-09-12T12:25:59.812224+0000","last_became_active":"2024-09-12T12:23:52.901681+0000","last_became_peered":"2024-09-12T12:23:52.901681+0000","last_unstale":"2024-09-12T12:25:59.812224+0000","last_undegraded":"2024-09-12T12:25:59.812224+0000","last_fullsized":"2024-09-12T12:25:59.812224+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:51.877024+0000","last_clean_scrub_stamp":"2024-09-12T12:23:51.877024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:42.039729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322128+0000","last_change":"2024-09-12T12:23:45.879115+0000","last_active":"2024-09-12T12:26:00.322128+0000","last_peered":"2024-09-12T12:26:00.322128+0000","last_clean":"2024-09-12T12:26:00.322128+0000","last_became_active":"2024-09-12T12:23:45.878745+0000","last_became_peered":"2024-09-12T12:23:45.878745+0000","last_unstale":"2024-09-12T12:26:00.322128+0000","last_undegraded":"2024-09-12T12:26:00.322128+0000","last_fullsized":"2024-09-12T12:26:00.322128+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:53.152875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":51,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.815900+0000","last_change":"2024-09-12T12:25:59.815900+0000","last_active":"2024-09-12T12:25:59.815900+0000","last_peered":"2024-09-12T12:25:59.815900+0000","last_clean":"2024-09-12T12:25:59.815900+0000","last_became_active":"2024-09-12T12:25:59.815588+0000","last_became_peered":"2024-09-12T12:25:59.815588+0000","last_unstale":"2024-09-12T12:25:59.815900+0000","last_undegraded":"2024-09-12T12:25:59.815900+0000","last_fullsized":"2024-09-12T12:25:59.815900+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:35.793884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.811884+0000","last_change":"2024-09-12T12:23:45.873101+0000","last_active":"2024-09-12T12:25:59.811884+0000","last_peered":"2024-09-12T12:25:59.811884+0000","last_clean":"2024-09-12T12:25:59.811884+0000","last_became_active":"2024-09-12T12:23:45.872373+0000","last_became_peered":"2024-09-12T12:23:45.872373+0000","last_unstale":"2024-09-12T12:25:59.811884+0000","last_undegraded":"2024-09-12T12:25:59.811884+0000","last_fullsized":"2024-09-12T12:25:59.811884+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:47:14.747538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814667+0000","last_change":"2024-09-12T12:23:45.875315+0000","last_active":"2024-09-12T12:25:59.814667+0000","last_peered":"2024-09-12T12:25:59.814667+0000","last_clean":"2024-09-12T12:25:59.814667+0000","last_became_active":"2024-09-12T12:23:45.874904+0000","last_became_peered":"2024-09-12T12:23:45.874904+0000","last_unstale":"2024-09-12T12:25:59.814667+0000","last_undegraded":"2024-09-12T12:25:59.814667+0000","last_fullsized":"2024-09-12T12:25:59.814667+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:52:44.373937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.951895+0000","last_change":"2024-09-12T12:24:59.126419+0000","last_active":"2024-09-12T12:25:59.951895+0000","last_peered":"2024-09-12T12:25:59.951895+0000","last_clean":"2024-09-12T12:25:59.951895+0000","last_became_active":"2024-09-12T12:24:59.125996+0000","last_became_peered":"2024-09-12T12:24:59.125996+0000","last_unstale":"2024-09-12T12:25:59.951895+0000","last_undegraded":"2024-09-12T12:25:59.951895+0000","last_fullsized":"2024-09-12T12:25:59.951895+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:01.495467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322488+0000","last_change":"2024-09-12T12:23:45.872638+0000","last_active":"2024-09-12T12:26:00.322488+0000","last_peered":"2024-09-12T12:26:00.322488+0000","last_clean":"2024-09-12T12:26:00.322488+0000","last_became_active":"2024-09-12T12:23:45.872299+0000","last_became_peered":"2024-09-12T12:23:45.872299+0000","last_unstale":"2024-09-12T12:26:00.322488+0000","last_undegraded":"2024-09-12T12:26:00.322488+0000","last_fullsized":"2024-09-12T12:26:00.322488+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:27.758613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":48,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.812624+0000","last_change":"2024-09-12T12:23:45.877168+0000","last_active":"2024-09-12T12:25:59.812624+0000","last_peered":"2024-09-12T12:25:59.812624+0000","last_clean":"2024-09-12T12:25:59.812624+0000","last_became_active":"2024-09-12T12:23:45.876871+0000","last_became_peered":"2024-09-12T12:23:45.876871+0000","last_unstale":"2024-09-12T12:25:59.812624+0000","last_undegraded":"2024-09-12T12:25:59.812624+0000","last_fullsized":"2024-09-12T12:25:59.812624+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:24.567415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321818+0000","last_change":"2024-09-12T12:24:59.128436+0000","last_active":"2024-09-12T12:26:00.321818+0000","last_peered":"2024-09-12T12:26:00.321818+0000","last_clean":"2024-09-12T12:26:00.321818+0000","last_became_active":"2024-09-12T12:24:59.128125+0000","last_became_peered":"2024-09-12T12:24:59.128125+0000","last_unstale":"2024-09-12T12:26:00.321818+0000","last_undegraded":"2024-09-12T12:26:00.321818+0000","last_fullsized":"2024-09-12T12:26:00.321818+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:58.903559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.809780+0000","last_change":"2024-09-12T12:23:45.873728+0000","last_active":"2024-09-12T12:25:59.809780+0000","last_peered":"2024-09-12T12:25:59.809780+0000","last_clean":"2024-09-12T12:25:59.809780+0000","last_became_active":"2024-09-12T12:23:45.871831+0000","last_became_peered":"2024-09-12T12:23:45.871831+0000","last_unstale":"2024-09-12T12:25:59.809780+0000","last_undegraded":"2024-09-12T12:25:59.809780+0000","last_fullsized":"2024-09-12T12:25:59.809780+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:48.690705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321927+0000","last_change":"2024-09-12T12:23:45.873035+0000","last_active":"2024-09-12T12:26:00.321927+0000","last_peered":"2024-09-12T12:26:00.321927+0000","last_clean":"2024-09-12T12:26:00.321927+0000","last_became_active":"2024-09-12T12:23:45.872660+0000","last_became_peered":"2024-09-12T12:23:45.872660+0000","last_unstale":"2024-09-12T12:26:00.321927+0000","last_undegraded":"2024-09-12T12:26:00.321927+0000","last_fullsized":"2024-09-12T12:26:00.321927+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:31.376116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322279+0000","last_change":"2024-09-12T12:23:45.879754+0000","last_active":"2024-09-12T12:26:00.322279+0000","last_peered":"2024-09-12T12:26:00.322279+0000","last_clean":"2024-09-12T12:26:00.322279+0000","last_became_active":"2024-09-12T12:23:45.879362+0000","last_became_peered":"2024-09-12T12:23:45.879362+0000","last_unstale":"2024-09-12T12:26:00.322279+0000","last_undegraded":"2024-09-12T12:26:00.322279+0000","last_fullsized":"2024-09-12T12:26:00.322279+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:23.587083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.952255+0000","last_change":"2024-09-12T12:23:45.878297+0000","last_active":"2024-09-12T12:25:59.952255+0000","last_peered":"2024-09-12T12:25:59.952255+0000","last_clean":"2024-09-12T12:25:59.952255+0000","last_became_active":"2024-09-12T12:23:45.877127+0000","last_became_peered":"2024-09-12T12:23:45.877127+0000","last_unstale":"2024-09-12T12:25:59.952255+0000","last_undegraded":"2024-09-12T12:25:59.952255+0000","last_fullsized":"2024-09-12T12:25:59.952255+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:54.334325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322109+0000","last_change":"2024-09-12T12:23:45.879078+0000","last_active":"2024-09-12T12:26:00.322109+0000","last_peered":"2024-09-12T12:26:00.322109+0000","last_clean":"2024-09-12T12:26:00.322109+0000","last_became_active":"2024-09-12T12:23:45.878799+0000","last_became_peered":"2024-09-12T12:23:45.878799+0000","last_unstale":"2024-09-12T12:26:00.322109+0000","last_undegraded":"2024-09-12T12:26:00.322109+0000","last_fullsized":"2024-09-12T12:26:00.322109+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:45.680643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.812428+0000","last_change":"2024-09-12T12:23:45.872739+0000","last_active":"2024-09-12T12:25:59.812428+0000","last_peered":"2024-09-12T12:25:59.812428+0000","last_clean":"2024-09-12T12:25:59.812428+0000","last_became_active":"2024-09-12T12:23:45.871931+0000","last_became_peered":"2024-09-12T12:23:45.871931+0000","last_unstale":"2024-09-12T12:25:59.812428+0000","last_undegraded":"2024-09-12T12:25:59.812428+0000","last_fullsized":"2024-09-12T12:25:59.812428+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:36:30.451737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.809065+0000","last_change":"2024-09-12T12:23:45.876717+0000","last_active":"2024-09-12T12:25:59.809065+0000","last_peered":"2024-09-12T12:25:59.809065+0000","last_clean":"2024-09-12T12:25:59.809065+0000","last_became_active":"2024-09-12T12:23:45.876372+0000","last_became_peered":"2024-09-12T12:23:45.876372+0000","last_unstale":"2024-09-12T12:25:59.809065+0000","last_undegraded":"2024-09-12T12:25:59.809065+0000","last_fullsized":"2024-09-12T12:25:59.809065+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:40:26.905442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322842+0000","last_change":"2024-09-12T12:23:45.877286+0000","last_active":"2024-09-12T12:26:00.322842+0000","last_peered":"2024-09-12T12:26:00.322842+0000","last_clean":"2024-09-12T12:26:00.322842+0000","last_became_active":"2024-09-12T12:23:45.876619+0000","last_became_peered":"2024-09-12T12:23:45.876619+0000","last_unstale":"2024-09-12T12:26:00.322842+0000","last_undegraded":"2024-09-12T12:26:00.322842+0000","last_fullsized":"2024-09-12T12:26:00.322842+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:05.637917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322331+0000","last_change":"2024-09-12T12:23:45.875244+0000","last_active":"2024-09-12T12:26:00.322331+0000","last_peered":"2024-09-12T12:26:00.322331+0000","last_clean":"2024-09-12T12:26:00.322331+0000","last_became_active":"2024-09-12T12:23:45.874908+0000","last_became_peered":"2024-09-12T12:23:45.874908+0000","last_unstale":"2024-09-12T12:26:00.322331+0000","last_undegraded":"2024-09-12T12:26:00.322331+0000","last_fullsized":"2024-09-12T12:26:00.322331+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:14.314124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814499+0000","last_change":"2024-09-12T12:23:45.875253+0000","last_active":"2024-09-12T12:25:59.814499+0000","last_peered":"2024-09-12T12:25:59.814499+0000","last_clean":"2024-09-12T12:25:59.814499+0000","last_became_active":"2024-09-12T12:23:45.874936+0000","last_became_peered":"2024-09-12T12:23:45.874936+0000","last_unstale":"2024-09-12T12:25:59.814499+0000","last_undegraded":"2024-09-12T12:25:59.814499+0000","last_fullsized":"2024-09-12T12:25:59.814499+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:28.790546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814629+0000","last_change":"2024-09-12T12:23:45.880503+0000","last_active":"2024-09-12T12:25:59.814629+0000","last_peered":"2024-09-12T12:25:59.814629+0000","last_clean":"2024-09-12T12:25:59.814629+0000","last_became_active":"2024-09-12T12:23:45.880184+0000","last_became_peered":"2024-09-12T12:23:45.880184+0000","last_unstale":"2024-09-12T12:25:59.814629+0000","last_undegraded":"2024-09-12T12:25:59.814629+0000","last_fullsized":"2024-09-12T12:25:59.814629+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:12.370667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.952111+0000","last_change":"2024-09-12T12:23:45.869762+0000","last_active":"2024-09-12T12:25:59.952111+0000","last_peered":"2024-09-12T12:25:59.952111+0000","last_clean":"2024-09-12T12:25:59.952111+0000","last_became_active":"2024-09-12T12:23:45.867595+0000","last_became_peered":"2024-09-12T12:23:45.867595+0000","last_unstale":"2024-09-12T12:25:59.952111+0000","last_undegraded":"2024-09-12T12:25:59.952111+0000","last_fullsized":"2024-09-12T12:25:59.952111+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:25:19.855969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814699+0000","last_change":"2024-09-12T12:23:45.874097+0000","last_active":"2024-09-12T12:25:59.814699+0000","last_peered":"2024-09-12T12:25:59.814699+0000","last_clean":"2024-09-12T12:25:59.814699+0000","last_became_active":"2024-09-12T12:23:45.873275+0000","last_became_peered":"2024-09-12T12:23:45.873275+0000","last_unstale":"2024-09-12T12:25:59.814699+0000","last_undegraded":"2024-09-12T12:25:59.814699+0000","last_fullsized":"2024-09-12T12:25:59.814699+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:21.303339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.810374+0000","last_change":"2024-09-12T12:23:45.883354+0000","last_active":"2024-09-12T12:25:59.810374+0000","last_peered":"2024-09-12T12:25:59.810374+0000","last_clean":"2024-09-12T12:25:59.810374+0000","last_became_active":"2024-09-12T12:23:45.882673+0000","last_became_peered":"2024-09-12T12:23:45.882673+0000","last_unstale":"2024-09-12T12:25:59.810374+0000","last_undegraded":"2024-09-12T12:25:59.810374+0000","last_fullsized":"2024-09-12T12:25:59.810374+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:42.034857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":49,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.812510+0000","last_change":"2024-09-12T12:23:45.876955+0000","last_active":"2024-09-12T12:25:59.812510+0000","last_peered":"2024-09-12T12:25:59.812510+0000","last_clean":"2024-09-12T12:25:59.812510+0000","last_became_active":"2024-09-12T12:23:45.876632+0000","last_became_peered":"2024-09-12T12:23:45.876632+0000","last_unstale":"2024-09-12T12:25:59.812510+0000","last_undegraded":"2024-09-12T12:25:59.812510+0000","last_fullsized":"2024-09-12T12:25:59.812510+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:25.155739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322622+0000","last_change":"2024-09-12T12:23:45.875166+0000","last_active":"2024-09-12T12:26:00.322622+0000","last_peered":"2024-09-12T12:26:00.322622+0000","last_clean":"2024-09-12T12:26:00.322622+0000","last_became_active":"2024-09-12T12:23:45.874835+0000","last_became_peered":"2024-09-12T12:23:45.874835+0000","last_unstale":"2024-09-12T12:26:00.322622+0000","last_undegraded":"2024-09-12T12:26:00.322622+0000","last_fullsized":"2024-09-12T12:26:00.322622+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:50.014484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.321494+0000","last_change":"2024-09-12T12:23:45.874161+0000","last_active":"2024-09-12T12:26:00.321494+0000","last_peered":"2024-09-12T12:26:00.321494+0000","last_clean":"2024-09-12T12:26:00.321494+0000","last_became_active":"2024-09-12T12:23:45.873846+0000","last_became_peered":"2024-09-12T12:23:45.873846+0000","last_unstale":"2024-09-12T12:26:00.321494+0000","last_undegraded":"2024-09-12T12:26:00.321494+0000","last_fullsized":"2024-09-12T12:26:00.321494+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:09:17.525956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.809776+0000","last_change":"2024-09-12T12:23:45.870642+0000","last_active":"2024-09-12T12:25:59.809776+0000","last_peered":"2024-09-12T12:25:59.809776+0000","last_clean":"2024-09-12T12:25:59.809776+0000","last_became_active":"2024-09-12T12:23:45.870006+0000","last_became_peered":"2024-09-12T12:23:45.870006+0000","last_unstale":"2024-09-12T12:25:59.809776+0000","last_undegraded":"2024-09-12T12:25:59.809776+0000","last_fullsized":"2024-09-12T12:25:59.809776+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:43:35.133650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.812057+0000","last_change":"2024-09-12T12:23:45.875174+0000","last_active":"2024-09-12T12:25:59.812057+0000","last_peered":"2024-09-12T12:25:59.812057+0000","last_clean":"2024-09-12T12:25:59.812057+0000","last_became_active":"2024-09-12T12:23:45.874851+0000","last_became_peered":"2024-09-12T12:23:45.874851+0000","last_unstale":"2024-09-12T12:25:59.812057+0000","last_undegraded":"2024-09-12T12:25:59.812057+0000","last_fullsized":"2024-09-12T12:25:59.812057+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:42.565644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322506+0000","last_change":"2024-09-12T12:23:45.873170+0000","last_active":"2024-09-12T12:26:00.322506+0000","last_peered":"2024-09-12T12:26:00.322506+0000","last_clean":"2024-09-12T12:26:00.322506+0000","last_became_active":"2024-09-12T12:23:45.872814+0000","last_became_peered":"2024-09-12T12:23:45.872814+0000","last_unstale":"2024-09-12T12:26:00.322506+0000","last_undegraded":"2024-09-12T12:26:00.322506+0000","last_fullsized":"2024-09-12T12:26:00.322506+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:36.143107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814443+0000","last_change":"2024-09-12T12:23:45.874271+0000","last_active":"2024-09-12T12:25:59.814443+0000","last_peered":"2024-09-12T12:25:59.814443+0000","last_clean":"2024-09-12T12:25:59.814443+0000","last_became_active":"2024-09-12T12:23:45.873789+0000","last_became_peered":"2024-09-12T12:23:45.873789+0000","last_unstale":"2024-09-12T12:25:59.814443+0000","last_undegraded":"2024-09-12T12:25:59.814443+0000","last_fullsized":"2024-09-12T12:25:59.814443+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:58.252706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814639+0000","last_change":"2024-09-12T12:23:45.877236+0000","last_active":"2024-09-12T12:25:59.814639+0000","last_peered":"2024-09-12T12:25:59.814639+0000","last_clean":"2024-09-12T12:25:59.814639+0000","last_became_active":"2024-09-12T12:23:45.876920+0000","last_became_peered":"2024-09-12T12:23:45.876920+0000","last_unstale":"2024-09-12T12:25:59.814639+0000","last_undegraded":"2024-09-12T12:25:59.814639+0000","last_fullsized":"2024-09-12T12:25:59.814639+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:19:19.749103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:25:59.814948+0000","last_change":"2024-09-12T12:23:45.880480+0000","last_active":"2024-09-12T12:25:59.814948+0000","last_peered":"2024-09-12T12:25:59.814948+0000","last_clean":"2024-09-12T12:25:59.814948+0000","last_became_active":"2024-09-12T12:23:45.880163+0000","last_became_peered":"2024-09-12T12:23:45.880163+0000","last_unstale":"2024-09-12T12:25:59.814948+0000","last_undegraded":"2024-09-12T12:25:59.814948+0000","last_fullsized":"2024-09-12T12:25:59.814948+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:35.496705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-12T12:26:00.322687+0000","last_change":"2024-09-12T12:23:45.876975+0000","last_active":"2024-09-12T12:26:00.322687+0000","last_peered":"2024-09-12T12:26:00.322687+0000","last_clean":"2024-09-12T12:26:00.322687+0000","last_became_active":"2024-09-12T12:23:45.876501+0000","last_became_peered":"2024-09-12T12:23:45.876501+0000","last_unstale":"2024-09-12T12:26:00.322687+0000","last_undegraded":"2024-09-12T12:26:00.322687+0000","last_fullsized":"2024-09-12T12:26:00.322687+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:44.843363+0000","last_clean_scrub_stamp":"2024-09-12T12:23:44.843363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:15.029566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74332,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":627,"num_read_kb":393,"num_write":186,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1127,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":438272,"data_stored":218682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":286267,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612650,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":983040,"data_stored":511580,"data_compressed":29534,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841582,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28136,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717016,"statfs":{"total":95995035648,"available":95966224384,"internally_reserved":0,"allocated":1138688,"data_stored":1172637,"data_compressed":65932,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005108,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1003520,"data_stored":515912,"data_compressed":29534,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234040,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":511736,"data_compressed":29534,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462973,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36368,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708784,"statfs":{"total":95995035648,"available":95957794816,"internally_reserved":0,"allocated":1048576,"data_stored":1108778,"data_compressed":65932,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626499,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":978944,"data_stored":506992,"data_compressed":29534,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855432,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1052672,"data_stored":1099775,"data_compressed":65932,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018957,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36320,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708832,"statfs":{"total":95995035648,"available":95957843968,"internally_reserved":0,"allocated":999424,"data_stored":513788,"data_compressed":29534,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247890,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":507186,"data_compressed":29534,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444119,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36376,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708776,"statfs":{"total":95995035648,"available":95957786624,"internally_reserved":0,"allocated":1056768,"data_stored":572402,"data_compressed":29534,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36384,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708768,"statfs":{"total":95995035648,"available":95957778432,"internally_reserved":0,"allocated":1056768,"data_stored":571898,"data_compressed":29534,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738464,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1003520,"data_stored":508380,"data_compressed":29534,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34759,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34759,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34759,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36398,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36398,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36398,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36398,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36398,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":69310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":65500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":71271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:26:11.347 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:26:11.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:10 smithi043 ceph-mon[34144]: pgmap v355: 129 pgs: 129 active+clean; 649 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-12T12:26:11.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:10 smithi043 ceph-mon[34144]: from='client.15276 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:26:11.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:10 smithi102 ceph-mon[34799]: pgmap v355: 129 pgs: 129 active+clean; 649 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-12T12:26:11.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:10 smithi102 ceph-mon[34799]: from='client.15276 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:26:11.638 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:26:12.028 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:11 smithi033 ceph-mon[31246]: from='client.15282 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:26:12.028 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:11 smithi033 ceph-mon[31246]: from='client.15288 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:26:12.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.110+0000 7fd13cad9640 1 -- 172.21.15.33:0/2994374390 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd138102d30 msgr2=0x7fd138103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:12.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.110+0000 7fd13cad9640 1 --2- 172.21.15.33:0/2994374390 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd138102d30 0x7fd138103110 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd128009cd0 tx=0x7fd12802a8e0 comp rx=0 tx=0).stop 2024-09-12T12:26:12.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.110+0000 7fd13cad9640 1 -- 172.21.15.33:0/2994374390 shutdown_connections 2024-09-12T12:26:12.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.110+0000 7fd13cad9640 1 --2- 172.21.15.33:0/2994374390 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd1381082a0 0x7fd13810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:12.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.110+0000 7fd13cad9640 1 --2- 172.21.15.33:0/2994374390 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1381036e0 0x7fd138107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:12.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.110+0000 7fd13cad9640 1 --2- 172.21.15.33:0/2994374390 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd138102d30 0x7fd138103110 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:12.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.110+0000 7fd13cad9640 1 -- 172.21.15.33:0/2994374390 >> 172.21.15.33:0/2994374390 conn(0x7fd1380fc7d0 msgr2=0x7fd1380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:12.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.110+0000 7fd13cad9640 1 -- 172.21.15.33:0/2994374390 shutdown_connections 2024-09-12T12:26:12.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.110+0000 7fd13cad9640 1 -- 172.21.15.33:0/2994374390 wait complete. 2024-09-12T12:26:12.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.111+0000 7fd13cad9640 1 Processor -- start 2024-09-12T12:26:12.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.111+0000 7fd13cad9640 1 -- start start 2024-09-12T12:26:12.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.111+0000 7fd13cad9640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd138102d30 0x7fd138198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:12.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.111+0000 7fd13cad9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1381036e0 0x7fd138198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:12.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.111+0000 7fd13cad9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1381082a0 0x7fd13819cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:12.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.111+0000 7fd13cad9640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd138111f90 con 0x7fd1381082a0 2024-09-12T12:26:12.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.111+0000 7fd13cad9640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd138111e10 con 0x7fd138102d30 2024-09-12T12:26:12.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.111+0000 7fd13cad9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd138112110 con 0x7fd1381036e0 2024-09-12T12:26:12.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.111+0000 7fd136d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1381082a0 0x7fd13819cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:12.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.111+0000 7fd136d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1381082a0 0x7fd13819cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52600/0 (socket says 172.21.15.33:52600) 2024-09-12T12:26:12.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.111+0000 7fd136d9d640 1 -- 172.21.15.33:0/2517823352 learned_addr learned my addr 172.21.15.33:0/2517823352 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:12.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.111+0000 7fd135d9b640 1 --2- 172.21.15.33:0/2517823352 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1381036e0 0x7fd138198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:12.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.112+0000 7fd13659c640 1 --2- 172.21.15.33:0/2517823352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd138102d30 0x7fd138198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:12.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.112+0000 7fd136d9d640 1 -- 172.21.15.33:0/2517823352 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1381036e0 msgr2=0x7fd138198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:12.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.112+0000 7fd136d9d640 1 --2- 172.21.15.33:0/2517823352 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1381036e0 0x7fd138198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:12.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.112+0000 7fd136d9d640 1 -- 172.21.15.33:0/2517823352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd138102d30 msgr2=0x7fd138198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:12.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.112+0000 7fd136d9d640 1 --2- 172.21.15.33:0/2517823352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd138102d30 0x7fd138198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:12.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.112+0000 7fd136d9d640 1 -- 172.21.15.33:0/2517823352 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd13819d4b0 con 0x7fd1381082a0 2024-09-12T12:26:12.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.112+0000 7fd13659c640 1 --2- 172.21.15.33:0/2517823352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd138102d30 0x7fd138198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:12.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.112+0000 7fd136d9d640 1 --2- 172.21.15.33:0/2517823352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1381082a0 0x7fd13819cdd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd13000d750 tx=0x7fd13000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:12.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.112+0000 7fd12f7fe640 1 -- 172.21.15.33:0/2517823352 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd130017070 con 0x7fd1381082a0 2024-09-12T12:26:12.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.112+0000 7fd13cad9640 1 -- 172.21.15.33:0/2517823352 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd13819d7a0 con 0x7fd1381082a0 2024-09-12T12:26:12.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.112+0000 7fd12f7fe640 1 -- 172.21.15.33:0/2517823352 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd1300054d0 con 0x7fd1381082a0 2024-09-12T12:26:12.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.112+0000 7fd12f7fe640 1 -- 172.21.15.33:0/2517823352 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd130004c60 con 0x7fd1381082a0 2024-09-12T12:26:12.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.112+0000 7fd13cad9640 1 -- 172.21.15.33:0/2517823352 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1381a5080 con 0x7fd1381082a0 2024-09-12T12:26:12.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.113+0000 7fd13cad9640 1 -- 172.21.15.33:0/2517823352 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd13806a850 con 0x7fd1381082a0 2024-09-12T12:26:12.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.114+0000 7fd12f7fe640 1 -- 172.21.15.33:0/2517823352 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd130004e00 con 0x7fd1381082a0 2024-09-12T12:26:12.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.115+0000 7fd12f7fe640 1 --2- 172.21.15.33:0/2517823352 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd1240a2b80 0x7fd1240a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:12.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.115+0000 7fd13659c640 1 --2- 172.21.15.33:0/2517823352 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd1240a2b80 0x7fd1240a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:12.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.115+0000 7fd12f7fe640 1 -- 172.21.15.33:0/2517823352 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fd1300ced70 con 0x7fd1381082a0 2024-09-12T12:26:12.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.116+0000 7fd13659c640 1 --2- 172.21.15.33:0/2517823352 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd1240a2b80 0x7fd1240a5040 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd128006010 tx=0x7fd128005f80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:12.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.119+0000 7fd12f7fe640 1 -- 172.21.15.33:0/2517823352 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd13009b8e0 con 0x7fd1381082a0 2024-09-12T12:26:12.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.330+0000 7fd13cad9640 1 -- 172.21.15.33:0/2517823352 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd13810a2b0 con 0x7fd1381082a0 2024-09-12T12:26:12.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.331+0000 7fd12f7fe640 1 -- 172.21.15.33:0/2517823352 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11912 (secure 0 0 0) 0x7fd1300b9e20 con 0x7fd1381082a0 2024-09-12T12:26:12.332 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:26:12.333 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":25,"btime":"2024-09-12T12:26:06:963800+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3327066342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3327066342},{"type":"v1","addr":"172.21.15.33:6835","nonce":3327066342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/19516401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":19516401},{"type":"v1","addr":"172.21.15.33:6837","nonce":19516401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1260196118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1260196118},{"type":"v1","addr":"172.21.15.33:6839","nonce":1260196118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/4288248356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4288248356},{"type":"v1","addr":"172.21.15.33:6841","nonce":4288248356}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/3051073141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3051073141},{"type":"v1","addr":"172.21.15.43:6833","nonce":3051073141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3282762800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3282762800},{"type":"v1","addr":"172.21.15.43:6835","nonce":3282762800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:23:46.400609+0000","modified":"2024-09-12T12:26:06.067532+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24490,"mds_2":24478},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3051713000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3051713000},{"type":"v1","addr":"172.21.15.102:6833","nonce":3051713000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6837/2472064883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2472064883},{"type":"v1","addr":"172.21.15.43:6837","nonce":2472064883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/1987408860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":1987408860},{"type":"v1","addr":"172.21.15.43:6839","nonce":1987408860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/4179527539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":4179527539},{"type":"v1","addr":"172.21.15.102:6835","nonce":4179527539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/2409953270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2409953270},{"type":"v1","addr":"172.21.15.102:6837","nonce":2409953270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.102:6839/1553271340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":1553271340},{"type":"v1","addr":"172.21.15.102:6839","nonce":1553271340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24499,"qdb_cluster":[24499,24490,24478]},"id":1}]} 2024-09-12T12:26:12.333 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 25 2024-09-12T12:26:12.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.333+0000 7fd13cad9640 1 -- 172.21.15.33:0/2517823352 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd1240a2b80 msgr2=0x7fd1240a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:12.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.333+0000 7fd13cad9640 1 --2- 172.21.15.33:0/2517823352 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd1240a2b80 0x7fd1240a5040 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd128006010 tx=0x7fd128005f80 comp rx=0 tx=0).stop 2024-09-12T12:26:12.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.333+0000 7fd13cad9640 1 -- 172.21.15.33:0/2517823352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1381082a0 msgr2=0x7fd13819cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:12.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.333+0000 7fd13cad9640 1 --2- 172.21.15.33:0/2517823352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1381082a0 0x7fd13819cdd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd13000d750 tx=0x7fd13000dc10 comp rx=0 tx=0).stop 2024-09-12T12:26:12.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.334+0000 7fd13cad9640 1 -- 172.21.15.33:0/2517823352 shutdown_connections 2024-09-12T12:26:12.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.334+0000 7fd13cad9640 1 --2- 172.21.15.33:0/2517823352 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd1240a2b80 0x7fd1240a5040 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:12.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.334+0000 7fd13cad9640 1 --2- 172.21.15.33:0/2517823352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1381082a0 0x7fd13819cdd0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:12.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.334+0000 7fd13cad9640 1 --2- 172.21.15.33:0/2517823352 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1381036e0 0x7fd138198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:12.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.334+0000 7fd13cad9640 1 --2- 172.21.15.33:0/2517823352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd138102d30 0x7fd138198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:12.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.334+0000 7fd13cad9640 1 -- 172.21.15.33:0/2517823352 >> 172.21.15.33:0/2517823352 conn(0x7fd1380fc7d0 msgr2=0x7fd138105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:12.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.334+0000 7fd13cad9640 1 -- 172.21.15.33:0/2517823352 shutdown_connections 2024-09-12T12:26:12.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:12.334+0000 7fd13cad9640 1 -- 172.21.15.33:0/2517823352 wait complete. 2024-09-12T12:26:12.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:11 smithi043 ceph-mon[34144]: from='client.15282 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:26:12.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:11 smithi043 ceph-mon[34144]: from='client.15288 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:26:12.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:11 smithi102 ceph-mon[34799]: from='client.15282 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:26:12.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:11 smithi102 ceph-mon[34799]: from='client.15288 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:26:13.032 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T12:26:13.293 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:26:13.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:12 smithi043 ceph-mon[34144]: pgmap v356: 129 pgs: 129 active+clean; 649 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-12T12:26:13.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:12 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/2517823352' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:26:13.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:12 smithi102 ceph-mon[34799]: pgmap v356: 129 pgs: 129 active+clean; 649 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-12T12:26:13.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:12 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/2517823352' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:26:13.415 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:12 smithi033 ceph-mon[31246]: pgmap v356: 129 pgs: 129 active+clean; 649 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-12T12:26:13.416 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:12 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/2517823352' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:26:13.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.794+0000 7fae695d8640 1 -- 172.21.15.33:0/3066248945 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae64102790 msgr2=0x7fae641067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:13.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.794+0000 7fae695d8640 1 --2- 172.21.15.33:0/3066248945 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae64102790 0x7fae641067e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fae58009900 tx=0x7fae5802a410 comp rx=0 tx=0).stop 2024-09-12T12:26:13.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.794+0000 7fae695d8640 1 -- 172.21.15.33:0/3066248945 shutdown_connections 2024-09-12T12:26:13.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.794+0000 7fae695d8640 1 --2- 172.21.15.33:0/3066248945 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae64106f10 0x7fae6410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:13.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.794+0000 7fae695d8640 1 --2- 172.21.15.33:0/3066248945 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae64102790 0x7fae641067e0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:13.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.794+0000 7fae695d8640 1 --2- 172.21.15.33:0/3066248945 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fae64101de0 0x7fae641021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:13.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.794+0000 7fae695d8640 1 -- 172.21.15.33:0/3066248945 >> 172.21.15.33:0/3066248945 conn(0x7fae640fd8c0 msgr2=0x7fae640ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:13.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.794+0000 7fae695d8640 1 -- 172.21.15.33:0/3066248945 shutdown_connections 2024-09-12T12:26:13.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.794+0000 7fae695d8640 1 -- 172.21.15.33:0/3066248945 wait complete. 2024-09-12T12:26:13.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.795+0000 7fae695d8640 1 Processor -- start 2024-09-12T12:26:13.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.795+0000 7fae695d8640 1 -- start start 2024-09-12T12:26:13.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.795+0000 7fae695d8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae64101de0 0x7fae641983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:13.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.795+0000 7fae695d8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fae64102790 0x7fae641988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:13.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.795+0000 7fae695d8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae64106f10 0x7fae6419cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:13.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.795+0000 7fae695d8640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fae64111e20 con 0x7fae64101de0 2024-09-12T12:26:13.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.795+0000 7fae695d8640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fae64111ca0 con 0x7fae64106f10 2024-09-12T12:26:13.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.795+0000 7fae695d8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fae64111fa0 con 0x7fae64102790 2024-09-12T12:26:13.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.795+0000 7fae62ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae64101de0 0x7fae641983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:13.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.795+0000 7fae62ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae64101de0 0x7fae641983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52614/0 (socket says 172.21.15.33:52614) 2024-09-12T12:26:13.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.795+0000 7fae62ffd640 1 -- 172.21.15.33:0/3833663751 learned_addr learned my addr 172.21.15.33:0/3833663751 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:13.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.796+0000 7fae627fc640 1 --2- 172.21.15.33:0/3833663751 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fae64102790 0x7fae641988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:13.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.796+0000 7fae62ffd640 1 -- 172.21.15.33:0/3833663751 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fae64102790 msgr2=0x7fae641988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:13.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.796+0000 7fae62ffd640 1 --2- 172.21.15.33:0/3833663751 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fae64102790 0x7fae641988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:13.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.796+0000 7fae62ffd640 1 -- 172.21.15.33:0/3833663751 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae64106f10 msgr2=0x7fae6419cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:13.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.796+0000 7fae62ffd640 1 --2- 172.21.15.33:0/3833663751 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae64106f10 0x7fae6419cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:13.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.796+0000 7fae62ffd640 1 -- 172.21.15.33:0/3833663751 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae6419d350 con 0x7fae64101de0 2024-09-12T12:26:13.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.796+0000 7fae62ffd640 1 --2- 172.21.15.33:0/3833663751 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae64101de0 0x7fae641983a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fae5400e9f0 tx=0x7fae5400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:13.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.796+0000 7fae4bfff640 1 -- 172.21.15.33:0/3833663751 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae5400cd80 con 0x7fae64101de0 2024-09-12T12:26:13.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.796+0000 7fae4bfff640 1 -- 172.21.15.33:0/3833663751 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fae540108e0 con 0x7fae64101de0 2024-09-12T12:26:13.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.796+0000 7fae695d8640 1 -- 172.21.15.33:0/3833663751 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae6419d640 con 0x7fae64101de0 2024-09-12T12:26:13.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.796+0000 7fae4bfff640 1 -- 172.21.15.33:0/3833663751 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae54018920 con 0x7fae64101de0 2024-09-12T12:26:13.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.796+0000 7fae695d8640 1 -- 172.21.15.33:0/3833663751 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae641a4f20 con 0x7fae64101de0 2024-09-12T12:26:13.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.797+0000 7fae695d8640 1 -- 172.21.15.33:0/3833663751 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae641021c0 con 0x7fae64101de0 2024-09-12T12:26:13.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.798+0000 7fae4bfff640 1 -- 172.21.15.33:0/3833663751 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fae54010a90 con 0x7fae64101de0 2024-09-12T12:26:13.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.799+0000 7fae4bfff640 1 --2- 172.21.15.33:0/3833663751 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fae4c0a2c00 0x7fae4c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:13.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.800+0000 7fae627fc640 1 --2- 172.21.15.33:0/3833663751 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fae4c0a2c00 0x7fae4c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:13.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.800+0000 7fae4bfff640 1 -- 172.21.15.33:0/3833663751 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fae540cf7b0 con 0x7fae64101de0 2024-09-12T12:26:13.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.800+0000 7fae627fc640 1 --2- 172.21.15.33:0/3833663751 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fae4c0a2c00 0x7fae4c0a50c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fae58031440 tx=0x7fae580095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:13.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.804+0000 7fae4bfff640 1 -- 172.21.15.33:0/3833663751 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fae5409c380 con 0x7fae64101de0 2024-09-12T12:26:13.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.981+0000 7fae695d8640 1 -- 172.21.15.33:0/3833663751 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fae64109bc0 con 0x7fae64101de0 2024-09-12T12:26:13.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.983+0000 7fae4bfff640 1 -- 172.21.15.33:0/3833663751 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24763 (secure 0 0 0) 0x7fae5409bc80 con 0x7fae64101de0 2024-09-12T12:26:13.984 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:26:13.985 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":89,"fsid":"a66dfafc-7100-11ef-bcea-c7b262605968","created":"2024-09-12T12:16:11.904815+0000","modified":"2024-09-12T12:25:59.801807+0000","last_up_change":"2024-09-12T12:22:57.476185+0000","last_in_change":"2024-09-12T12:22:35.192556+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:19:12.296305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:23:42.509774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:23:44.842852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T12:23:51.308720+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"74b68729-c97c-4da6-a659-75d6c147ad05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6803","nonce":963294466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6805","nonce":963294466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6809","nonce":963294466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6807","nonce":963294466}]},"public_addr":"172.21.15.33:6803/963294466","cluster_addr":"172.21.15.33:6805/963294466","heartbeat_back_addr":"172.21.15.33:6809/963294466","heartbeat_front_addr":"172.21.15.33:6807/963294466","state":["exists","up"]},{"osd":1,"uuid":"2461a388-e110-420b-9404-eb54cd39119e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6801","nonce":2306025171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6803","nonce":2306025171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6807","nonce":2306025171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6805","nonce":2306025171}]},"public_addr":"172.21.15.43:6801/2306025171","cluster_addr":"172.21.15.43:6803/2306025171","heartbeat_back_addr":"172.21.15.43:6807/2306025171","heartbeat_front_addr":"172.21.15.43:6805/2306025171","state":["exists","up"]},{"osd":2,"uuid":"4ba9dd02-977d-45fb-b366-ade15b52232b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6801","nonce":4257223217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6803","nonce":4257223217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6807","nonce":4257223217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6805","nonce":4257223217}]},"public_addr":"172.21.15.102:6801/4257223217","cluster_addr":"172.21.15.102:6803/4257223217","heartbeat_back_addr":"172.21.15.102:6807/4257223217","heartbeat_front_addr":"172.21.15.102:6805/4257223217","state":["exists","up"]},{"osd":3,"uuid":"345aa854-9ea2-4103-a186-9794af34c237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6811","nonce":2483872739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6813","nonce":2483872739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6817","nonce":2483872739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6815","nonce":2483872739}]},"public_addr":"172.21.15.33:6811/2483872739","cluster_addr":"172.21.15.33:6813/2483872739","heartbeat_back_addr":"172.21.15.33:6817/2483872739","heartbeat_front_addr":"172.21.15.33:6815/2483872739","state":["exists","up"]},{"osd":4,"uuid":"32acd6da-01d6-4a8e-9d05-3d394363d6f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6809","nonce":136043101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6811","nonce":136043101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6815","nonce":136043101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6813","nonce":136043101}]},"public_addr":"172.21.15.43:6809/136043101","cluster_addr":"172.21.15.43:6811/136043101","heartbeat_back_addr":"172.21.15.43:6815/136043101","heartbeat_front_addr":"172.21.15.43:6813/136043101","state":["exists","up"]},{"osd":5,"uuid":"dced0037-2da2-48c2-a391-f871d6ceebb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6809","nonce":2605625792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6811","nonce":2605625792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6815","nonce":2605625792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6813","nonce":2605625792}]},"public_addr":"172.21.15.102:6809/2605625792","cluster_addr":"172.21.15.102:6811/2605625792","heartbeat_back_addr":"172.21.15.102:6815/2605625792","heartbeat_front_addr":"172.21.15.102:6813/2605625792","state":["exists","up"]},{"osd":6,"uuid":"46e5532e-026a-4bb2-8847-2a3216e5d7a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6819","nonce":805864618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6821","nonce":805864618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6825","nonce":805864618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6823","nonce":805864618}]},"public_addr":"172.21.15.33:6819/805864618","cluster_addr":"172.21.15.33:6821/805864618","heartbeat_back_addr":"172.21.15.33:6825/805864618","heartbeat_front_addr":"172.21.15.33:6823/805864618","state":["exists","up"]},{"osd":7,"uuid":"c8474ab4-68cd-4475-9429-b54981247ee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6817","nonce":392537201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6819","nonce":392537201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6823","nonce":392537201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6821","nonce":392537201}]},"public_addr":"172.21.15.43:6817/392537201","cluster_addr":"172.21.15.43:6819/392537201","heartbeat_back_addr":"172.21.15.43:6823/392537201","heartbeat_front_addr":"172.21.15.43:6821/392537201","state":["exists","up"]},{"osd":8,"uuid":"e7c2ef28-8c84-44d0-ba6d-7556ec1d02dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6817","nonce":1768219597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6819","nonce":1768219597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6823","nonce":1768219597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6821","nonce":1768219597}]},"public_addr":"172.21.15.102:6817/1768219597","cluster_addr":"172.21.15.102:6819/1768219597","heartbeat_back_addr":"172.21.15.102:6823/1768219597","heartbeat_front_addr":"172.21.15.102:6821/1768219597","state":["exists","up"]},{"osd":9,"uuid":"f2500273-8b21-4984-bc41-cec5cc0c883b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6827","nonce":973136168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6829","nonce":973136168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6833","nonce":973136168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6831","nonce":973136168}]},"public_addr":"172.21.15.33:6827/973136168","cluster_addr":"172.21.15.33:6829/973136168","heartbeat_back_addr":"172.21.15.33:6833/973136168","heartbeat_front_addr":"172.21.15.33:6831/973136168","state":["exists","up"]},{"osd":10,"uuid":"954343c5-5d5b-4c30-acde-82aa695f7b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6825","nonce":248515585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6827","nonce":248515585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6831","nonce":248515585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6829","nonce":248515585}]},"public_addr":"172.21.15.43:6825/248515585","cluster_addr":"172.21.15.43:6827/248515585","heartbeat_back_addr":"172.21.15.43:6831/248515585","heartbeat_front_addr":"172.21.15.43:6829/248515585","state":["exists","up"]},{"osd":11,"uuid":"22b4147b-02ad-4514-be17-5bb395099eef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6825","nonce":2463068013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6827","nonce":2463068013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6831","nonce":2463068013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6829","nonce":2463068013}]},"public_addr":"172.21.15.102:6825/2463068013","cluster_addr":"172.21.15.102:6827/2463068013","heartbeat_back_addr":"172.21.15.102:6831/2463068013","heartbeat_front_addr":"172.21.15.102:6829/2463068013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:19.274804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:44.900294+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:08.885404+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:34.382089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:59.978538+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:25.275179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:49.429847+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:14.974792+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:40.268629+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:22:06.458679+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:22:31.813019+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:22:56.264078+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/3187741548":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6800/1381479235":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6801/1156183797":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/2222991013":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6801/1381479235":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6800/1156183797":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/3450458842":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/202580320":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/2441151017":"2024-09-13T12:16:57.792813+0000","172.21.15.33:0/1001176884":"2024-09-13T12:16:33.559150+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:26:13.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.985+0000 7fae695d8640 1 -- 172.21.15.33:0/3833663751 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fae4c0a2c00 msgr2=0x7fae4c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:13.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.985+0000 7fae695d8640 1 --2- 172.21.15.33:0/3833663751 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fae4c0a2c00 0x7fae4c0a50c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fae58031440 tx=0x7fae580095f0 comp rx=0 tx=0).stop 2024-09-12T12:26:13.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.985+0000 7fae695d8640 1 -- 172.21.15.33:0/3833663751 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae64101de0 msgr2=0x7fae641983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:13.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.985+0000 7fae695d8640 1 --2- 172.21.15.33:0/3833663751 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae64101de0 0x7fae641983a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fae5400e9f0 tx=0x7fae5400eeb0 comp rx=0 tx=0).stop 2024-09-12T12:26:13.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.985+0000 7fae695d8640 1 -- 172.21.15.33:0/3833663751 shutdown_connections 2024-09-12T12:26:13.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.985+0000 7fae695d8640 1 --2- 172.21.15.33:0/3833663751 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fae4c0a2c00 0x7fae4c0a50c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:13.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.985+0000 7fae695d8640 1 --2- 172.21.15.33:0/3833663751 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae64106f10 0x7fae6419cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:13.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.985+0000 7fae695d8640 1 --2- 172.21.15.33:0/3833663751 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fae64102790 0x7fae641988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:13.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.985+0000 7fae695d8640 1 --2- 172.21.15.33:0/3833663751 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae64101de0 0x7fae641983a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:13.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.985+0000 7fae695d8640 1 -- 172.21.15.33:0/3833663751 >> 172.21.15.33:0/3833663751 conn(0x7fae640fd8c0 msgr2=0x7fae640fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:13.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.986+0000 7fae695d8640 1 -- 172.21.15.33:0/3833663751 shutdown_connections 2024-09-12T12:26:13.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:13.986+0000 7fae695d8640 1 -- 172.21.15.33:0/3833663751 wait complete. 2024-09-12T12:26:14.330 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:13 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/3833663751' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:26:14.367 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:13 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/3833663751' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:26:14.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:13 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/3833663751' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:26:14.666 DEBUG:tasks.fwd_scrub:Yielding 2024-09-12T12:26:14.666 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T12:26:14.949 INFO:tasks.workunit:Pulling workunits from ref 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T12:26:14.950 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T12:26:14.950 INFO:tasks.workunit:timeout=3h 2024-09-12T12:26:14.950 INFO:tasks.workunit:cleanup=True 2024-09-12T12:26:14.950 DEBUG:teuthology.orchestra.run.smithi033:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T12:26:14.950 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-12T12:26:14.951 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T12:26:14.951 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T12:26:14.971 INFO:teuthology.orchestra.run.smithi033.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-12T12:26:14.971 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-12T12:26:14.971 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 78h/120d Inode: 1 Links: 2 2024-09-12T12:26:14.971 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:26:14.971 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-12T12:26:14.971 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-09-12 12:24:34.370111060 +0000 2024-09-12T12:26:14.971 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-09-12 12:24:34.370111060 +0000 2024-09-12T12:26:14.971 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-09-12 12:26:05.693256696 +0000 2024-09-12T12:26:14.971 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: - 2024-09-12T12:26:14.972 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-12T12:26:14.972 DEBUG:teuthology.orchestra.run.smithi033:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-12T12:26:15.046 DEBUG:teuthology.orchestra.run.smithi033:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T12:26:15.102 INFO:tasks.workunit.client.0.smithi033.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T12:26:15.222 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:26:15.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:14 smithi033 ceph-mon[31246]: pgmap v357: 129 pgs: 129 active+clean; 649 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1023 B/s wr, 8 op/s 2024-09-12T12:26:15.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:14 smithi043 ceph-mon[34144]: pgmap v357: 129 pgs: 129 active+clean; 649 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1023 B/s wr, 8 op/s 2024-09-12T12:26:15.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:14 smithi102 ceph-mon[34799]: pgmap v357: 129 pgs: 129 active+clean; 649 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1023 B/s wr, 8 op/s 2024-09-12T12:26:15.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.767+0000 7f6a5c034640 1 -- 172.21.15.33:0/1756243549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a54108290 msgr2=0x7f6a5410ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:15.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.767+0000 7f6a5c034640 1 --2- 172.21.15.33:0/1756243549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a54108290 0x7f6a5410ec30 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c009cd0 tx=0x7f6a4c02a8e0 comp rx=0 tx=0).stop 2024-09-12T12:26:15.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.767+0000 7f6a5c034640 1 -- 172.21.15.33:0/1756243549 shutdown_connections 2024-09-12T12:26:15.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.767+0000 7f6a5c034640 1 --2- 172.21.15.33:0/1756243549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a54108290 0x7f6a5410ec30 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:15.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.767+0000 7f6a5c034640 1 --2- 172.21.15.33:0/1756243549 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6a54103740 0x7f6a54107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:15.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.767+0000 7f6a5c034640 1 --2- 172.21.15.33:0/1756243549 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a54102d90 0x7f6a54103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:15.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.767+0000 7f6a5c034640 1 -- 172.21.15.33:0/1756243549 >> 172.21.15.33:0/1756243549 conn(0x7f6a540fc7d0 msgr2=0x7f6a540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:15.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.767+0000 7f6a5c034640 1 -- 172.21.15.33:0/1756243549 shutdown_connections 2024-09-12T12:26:15.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.767+0000 7f6a5c034640 1 -- 172.21.15.33:0/1756243549 wait complete. 2024-09-12T12:26:15.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.767+0000 7f6a5c034640 1 Processor -- start 2024-09-12T12:26:15.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.767+0000 7f6a5c034640 1 -- start start 2024-09-12T12:26:15.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.768+0000 7f6a5c034640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6a54102d90 0x7f6a5419a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:15.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.768+0000 7f6a5c034640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a54103740 0x7f6a5419ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:15.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.768+0000 7f6a5c034640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a54108290 0x7f6a5419ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:15.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.768+0000 7f6a5c034640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6a54111f00 con 0x7f6a54103740 2024-09-12T12:26:15.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.768+0000 7f6a5c034640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6a54111d80 con 0x7f6a54102d90 2024-09-12T12:26:15.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.768+0000 7f6a5c034640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6a54112080 con 0x7f6a54108290 2024-09-12T12:26:15.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.768+0000 7f6a595cf640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a54103740 0x7f6a5419ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:15.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.768+0000 7f6a59dd0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6a54102d90 0x7f6a5419a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:15.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.768+0000 7f6a595cf640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a54103740 0x7f6a5419ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52640/0 (socket says 172.21.15.33:52640) 2024-09-12T12:26:15.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.768+0000 7f6a595cf640 1 -- 172.21.15.33:0/2922754874 learned_addr learned my addr 172.21.15.33:0/2922754874 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:15.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.768+0000 7f6a5a5d1640 1 --2- 172.21.15.33:0/2922754874 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a54108290 0x7f6a5419ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:15.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.768+0000 7f6a595cf640 1 -- 172.21.15.33:0/2922754874 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a54108290 msgr2=0x7f6a5419ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:15.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.768+0000 7f6a595cf640 1 --2- 172.21.15.33:0/2922754874 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a54108290 0x7f6a5419ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:15.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.768+0000 7f6a595cf640 1 -- 172.21.15.33:0/2922754874 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6a54102d90 msgr2=0x7f6a5419a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:15.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.768+0000 7f6a595cf640 1 --2- 172.21.15.33:0/2922754874 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6a54102d90 0x7f6a5419a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:15.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.768+0000 7f6a595cf640 1 -- 172.21.15.33:0/2922754874 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a5419f670 con 0x7f6a54103740 2024-09-12T12:26:15.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.768+0000 7f6a59dd0640 1 --2- 172.21.15.33:0/2922754874 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6a54102d90 0x7f6a5419a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:15.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.769+0000 7f6a595cf640 1 --2- 172.21.15.33:0/2922754874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a54103740 0x7f6a5419ac00 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6a4400d770 tx=0x7f6a4400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:15.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.769+0000 7f6a4affd640 1 -- 172.21.15.33:0/2922754874 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a44017070 con 0x7f6a54103740 2024-09-12T12:26:15.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.769+0000 7f6a5c034640 1 -- 172.21.15.33:0/2922754874 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a5419f960 con 0x7f6a54103740 2024-09-12T12:26:15.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.769+0000 7f6a5c034640 1 -- 172.21.15.33:0/2922754874 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a541a7240 con 0x7f6a54103740 2024-09-12T12:26:15.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.769+0000 7f6a4affd640 1 -- 172.21.15.33:0/2922754874 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6a44009c30 con 0x7f6a54103740 2024-09-12T12:26:15.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.769+0000 7f6a4affd640 1 -- 172.21.15.33:0/2922754874 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4400f620 con 0x7f6a54103740 2024-09-12T12:26:15.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.771+0000 7f6a4affd640 1 -- 172.21.15.33:0/2922754874 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6a4401a070 con 0x7f6a54103740 2024-09-12T12:26:15.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.771+0000 7f6a5e40d740 1 Processor -- start 2024-09-12T12:26:15.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.772+0000 7f6a5e40d740 1 -- start start 2024-09-12T12:26:15.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.772+0000 7f6a5e40d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638d17b7b60 0x5638d17b7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:15.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.772+0000 7f6a5e40d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5638d17b8480 0x5638d17c2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:15.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.772+0000 7f6a5e40d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638d17c2d40 0x5638d17c5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:15.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.772+0000 7f6a5e40d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5638d171d280 con 0x5638d17c2d40 2024-09-12T12:26:15.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.772+0000 7f6a5e40d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5638d16c4b10 con 0x5638d17b7b60 2024-09-12T12:26:15.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.772+0000 7f6a5e40d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5638d1719240 con 0x5638d17b8480 2024-09-12T12:26:15.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.772+0000 7f6a595cf640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638d17c2d40 0x5638d17c5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:15.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.772+0000 7f6a5a5d1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638d17b7b60 0x5638d17b7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:15.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.772+0000 7f6a5a5d1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638d17b7b60 0x5638d17b7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:51590/0 (socket says 172.21.15.33:51590) 2024-09-12T12:26:15.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.772+0000 7f6a5a5d1640 1 -- 172.21.15.33:0/3579274484 learned_addr learned my addr 172.21.15.33:0/3579274484 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:15.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.772+0000 7f6a595cf640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638d17c2d40 0x5638d17c5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52642/0 (socket says 172.21.15.33:52642) 2024-09-12T12:26:15.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.772+0000 7f6a59dd0640 1 --2- 172.21.15.33:0/3579274484 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5638d17b8480 0x5638d17c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:15.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.772+0000 7f6a4affd640 1 --2- 172.21.15.33:0/2922754874 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f6a400a2c00 0x7f6a400a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:15.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.773+0000 7f6a5a5d1640 1 --2- 172.21.15.33:0/2922754874 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f6a400a2c00 0x7f6a400a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:15.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.773+0000 7f6a4affd640 1 -- 172.21.15.33:0/2922754874 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f6a440ced40 con 0x7f6a54103740 2024-09-12T12:26:15.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.773+0000 7f6a5a5d1640 1 -- 172.21.15.33:0/3579274484 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5638d17b8480 msgr2=0x5638d17c2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:15.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.773+0000 7f6a5a5d1640 1 --2- 172.21.15.33:0/3579274484 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5638d17b8480 0x5638d17c2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:15.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.773+0000 7f6a5a5d1640 1 -- 172.21.15.33:0/3579274484 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638d17c2d40 msgr2=0x5638d17c5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:15.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.773+0000 7f6a5a5d1640 1 --2- 172.21.15.33:0/3579274484 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638d17c2d40 0x5638d17c5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:15.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.773+0000 7f6a5a5d1640 1 -- 172.21.15.33:0/3579274484 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638d16d11f0 con 0x5638d17b7b60 2024-09-12T12:26:15.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.773+0000 7f6a59dd0640 1 --2- 172.21.15.33:0/3579274484 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5638d17b8480 0x5638d17c2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:15.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.773+0000 7f6a5a5d1640 1 --2- 172.21.15.33:0/3579274484 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638d17b7b60 0x5638d17b7f40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c005e10 tx=0x7f6a4c031a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d36eb59ac4f860c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:15.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.773+0000 7f6a5a5d1640 1 --2- 172.21.15.33:0/2922754874 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f6a400a2c00 0x7f6a400a50c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c048000 tx=0x7f6a4c04b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:15.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.774+0000 7f6a3ffff640 1 -- 172.21.15.33:0/3579274484 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c050070 con 0x5638d17b7b60 2024-09-12T12:26:15.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.774+0000 7f6a3ffff640 1 -- 172.21.15.33:0/3579274484 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6a4c036040 con 0x5638d17b7b60 2024-09-12T12:26:15.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.774+0000 7f6a3ffff640 1 -- 172.21.15.33:0/3579274484 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c030cb0 con 0x5638d17b7b60 2024-09-12T12:26:15.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.774+0000 7f6a5e40d740 1 -- 172.21.15.33:0/3579274484 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638d17b7b60 msgr2=0x5638d17b7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:15.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.774+0000 7f6a5e40d740 1 --2- 172.21.15.33:0/3579274484 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638d17b7b60 0x5638d17b7f40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c005e10 tx=0x7f6a4c031a00 comp rx=0 tx=0).stop 2024-09-12T12:26:15.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.774+0000 7f6a5e40d740 1 -- 172.21.15.33:0/3579274484 shutdown_connections 2024-09-12T12:26:15.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.774+0000 7f6a5e40d740 1 --2- 172.21.15.33:0/3579274484 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638d17c2d40 0x5638d17c5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:15.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.774+0000 7f6a5e40d740 1 --2- 172.21.15.33:0/3579274484 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5638d17b8480 0x5638d17c2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:15.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.774+0000 7f6a5e40d740 1 --2- 172.21.15.33:0/3579274484 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638d17b7b60 0x5638d17b7f40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:15.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.774+0000 7f6a5e40d740 1 -- 172.21.15.33:0/3579274484 >> 172.21.15.33:0/3579274484 conn(0x5638d17b40f0 msgr2=0x5638d17b44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:15.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.775+0000 7f6a5e40d740 1 -- 172.21.15.33:0/3579274484 shutdown_connections 2024-09-12T12:26:15.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.775+0000 7f6a5e40d740 1 -- 172.21.15.33:0/3579274484 wait complete. 2024-09-12T12:26:15.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.775+0000 7f6a5e40d740 1 -- start start 2024-09-12T12:26:15.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.775+0000 7f6a5e40d740 1 Processor -- start 2024-09-12T12:26:15.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.776+0000 7f6a5e40d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638d17b7b60 0x5638d17bfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:15.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.776+0000 7f6a5e40d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638d17b8480 0x5638d17c0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:15.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.776+0000 7f6a5e40d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5638d17c2d40 0x5638d17c0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:15.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.776+0000 7f6a5e40d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5638d17c5910 con 0x5638d17b7b60 2024-09-12T12:26:15.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.776+0000 7f6a5e40d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5638d16d7f10 con 0x5638d17b8480 2024-09-12T12:26:15.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.776+0000 7f6a5e40d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5638d17c5a90 con 0x5638d17c2d40 2024-09-12T12:26:15.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.776+0000 7f6a5e40d740 10 client.0 _ll_register_callbacks cb 0x5638d16a0a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:26:15.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.776+0000 7f6a59dd0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638d17b7b60 0x5638d17bfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:15.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.776+0000 7f6a59dd0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638d17b7b60 0x5638d17bfbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52646/0 (socket says 172.21.15.33:52646) 2024-09-12T12:26:15.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.776+0000 7f6a59dd0640 1 -- 172.21.15.33:0/4123400269 learned_addr learned my addr 172.21.15.33:0/4123400269 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:15.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.776+0000 7f6a595cf640 1 --2- 172.21.15.33:0/4123400269 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638d17b8480 0x5638d17c0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:15.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.776+0000 7f6a5a5d1640 1 --2- 172.21.15.33:0/4123400269 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5638d17c2d40 0x5638d17c0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:15.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.776+0000 7f6a59dd0640 1 -- 172.21.15.33:0/4123400269 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5638d17c2d40 msgr2=0x5638d17c0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:15.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.776+0000 7f6a59dd0640 1 --2- 172.21.15.33:0/4123400269 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5638d17c2d40 0x5638d17c0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:15.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.776+0000 7f6a59dd0640 1 -- 172.21.15.33:0/4123400269 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638d17b8480 msgr2=0x5638d17c0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:15.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.776+0000 7f6a59dd0640 1 --2- 172.21.15.33:0/4123400269 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638d17b8480 0x5638d17c0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:15.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.776+0000 7f6a59dd0640 1 -- 172.21.15.33:0/4123400269 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638d148e6a0 con 0x5638d17b7b60 2024-09-12T12:26:15.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.776+0000 7f6a5a5d1640 1 --2- 172.21.15.33:0/4123400269 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5638d17c2d40 0x5638d17c0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:26:15.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.776+0000 7f6a59dd0640 1 --2- 172.21.15.33:0/4123400269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638d17b7b60 0x5638d17bfbe0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6a500117b0 tx=0x7f6a50011c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1ec3e5eb2371619 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:15.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.776+0000 7f6a3d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:26:15.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.777+0000 7f6a3d7fa640 1 -- 172.21.15.33:0/4123400269 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a50010ba0 con 0x5638d17b7b60 2024-09-12T12:26:15.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.777+0000 7f6a5e40d740 1 -- 172.21.15.33:0/4123400269 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a4c036040 con 0x5638d17b7b60 2024-09-12T12:26:15.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.777+0000 7f6a3d7fa640 1 -- 172.21.15.33:0/4123400269 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f6a50010d40 con 0x5638d17b7b60 2024-09-12T12:26:15.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.777+0000 7f6a3d7fa640 1 -- 172.21.15.33:0/4123400269 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6a50025050 con 0x5638d17b7b60 2024-09-12T12:26:15.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.777+0000 7f6a5e40d740 10 client.15312 fetch_fsmap learned FSMap version 25 2024-09-12T12:26:15.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.777+0000 7f6a5e40d740 1 -- 172.21.15.33:0/4123400269 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5638d17d1530 con 0x5638d17b7b60 2024-09-12T12:26:15.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.777+0000 7f6a3d7fa640 1 -- 172.21.15.33:0/4123400269 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6a4c036040 con 0x5638d17b7b60 2024-09-12T12:26:15.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.777+0000 7f6a3d7fa640 1 -- 172.21.15.33:0/4123400269 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f6a5000f4e0 con 0x5638d17b7b60 2024-09-12T12:26:15.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.777+0000 7f6a5e40d740 10 client.15312 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T12:26:15.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.777+0000 7f6a5e40d740 10 client.15312 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:26:15.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.777+0000 7f6a5e40d740 20 client.15312 populate_metadata read hostname 'smithi033' 2024-09-12T12:26:15.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.777+0000 7f6a5e40d740 1 --2- 172.21.15.33:0/4123400269 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5638d17d29f0 0x5638d17d4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:15.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.777+0000 7f6a5e40d740 4 client.15312 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:26:15.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.777+0000 7f6a5e40d740 1 -- 172.21.15.33:0/4123400269 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5638d172a7f0 con 0x5638d17d29f0 2024-09-12T12:26:15.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.778+0000 7f6a595cf640 1 --2- 172.21.15.33:0/4123400269 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5638d17d29f0 0x5638d17d4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:15.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.778+0000 7f6a595cf640 1 --2- 172.21.15.33:0/4123400269 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5638d17d29f0 0x5638d17d4e70 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=513f1d3dc83687dc server_cookie=584dc20050c1b6d2 in_seq=0 out_seq=0 2024-09-12T12:26:15.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.778+0000 7f6a3d7fa640 10 client.15312 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:26:15.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.779+0000 7f6a3d7fa640 1 -- 172.21.15.33:0/4123400269 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5638d172a7f0 con 0x5638d17d29f0 2024-09-12T12:26:15.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.779+0000 7f6a3d7fa640 10 client.15312 handle_command_reply: tid=0 2024-09-12T12:26:15.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.779+0000 7f6a5e40d740 1 client.15312 shutdown 2024-09-12T12:26:15.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.779+0000 7f6a5e40d740 1 -- 172.21.15.33:0/4123400269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638d17b7b60 msgr2=0x5638d17bfbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:15.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.779+0000 7f6a5e40d740 1 --2- 172.21.15.33:0/4123400269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638d17b7b60 0x5638d17bfbe0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6a500117b0 tx=0x7f6a50011c70 comp rx=0 tx=0).stop 2024-09-12T12:26:15.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.779+0000 7f6a5e40d740 1 -- 172.21.15.33:0/4123400269 shutdown_connections 2024-09-12T12:26:15.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.779+0000 7f6a5e40d740 1 --2- 172.21.15.33:0/4123400269 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5638d17d29f0 0x5638d17d4e70 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:15.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.779+0000 7f6a5e40d740 1 --2- 172.21.15.33:0/4123400269 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5638d17c2d40 0x5638d17c0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:15.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.779+0000 7f6a5e40d740 1 --2- 172.21.15.33:0/4123400269 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638d17b8480 0x5638d17c0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:15.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.779+0000 7f6a5e40d740 1 --2- 172.21.15.33:0/4123400269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638d17b7b60 0x5638d17bfbe0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:15.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.779+0000 7f6a3d7fa640 0 client.15312 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:26:15.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.779+0000 7f6a5e40d740 1 -- 172.21.15.33:0/4123400269 >> 172.21.15.33:0/4123400269 conn(0x5638d17b40f0 msgr2=0x5638d17b9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:15.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.779+0000 7f6a5e40d740 1 -- 172.21.15.33:0/4123400269 shutdown_connections 2024-09-12T12:26:15.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.779+0000 7f6a5e40d740 1 -- 172.21.15.33:0/4123400269 wait complete. 2024-09-12T12:26:15.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.779+0000 7f6a5e40d740 20 client.15312 trim_cache size 0 max 16384 2024-09-12T12:26:15.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.798+0000 7f6a5e40d740 1 Processor -- start 2024-09-12T12:26:15.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.798+0000 7f6a5e40d740 1 -- start start 2024-09-12T12:26:15.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.798+0000 7f6a5e40d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638d17b7b60 0x5638d17ba610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:15.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.798+0000 7f6a5e40d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5638d17b8480 0x5638d17c1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:15.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.798+0000 7f6a5e40d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638d17c2d40 0x5638d17da790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:15.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.798+0000 7f6a5e40d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6a541b36d0 con 0x5638d17b7b60 2024-09-12T12:26:15.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.798+0000 7f6a5e40d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6a541b0fa0 con 0x5638d17c2d40 2024-09-12T12:26:15.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.798+0000 7f6a5e40d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6a541aedf0 con 0x5638d17b8480 2024-09-12T12:26:15.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.798+0000 7f6a59dd0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638d17b7b60 0x5638d17ba610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:15.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.798+0000 7f6a59dd0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638d17b7b60 0x5638d17ba610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52654/0 (socket says 172.21.15.33:52654) 2024-09-12T12:26:15.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.798+0000 7f6a59dd0640 1 -- 172.21.15.33:0/1518585606 learned_addr learned my addr 172.21.15.33:0/1518585606 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:15.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.798+0000 7f6a595cf640 1 --2- 172.21.15.33:0/1518585606 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5638d17b8480 0x5638d17c1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:15.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.798+0000 7f6a59dd0640 1 -- 172.21.15.33:0/1518585606 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5638d17b8480 msgr2=0x5638d17c1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:15.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.798+0000 7f6a59dd0640 1 --2- 172.21.15.33:0/1518585606 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5638d17b8480 0x5638d17c1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:15.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.798+0000 7f6a59dd0640 1 -- 172.21.15.33:0/1518585606 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638d17c2d40 msgr2=0x5638d17da790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:15.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.798+0000 7f6a59dd0640 1 --2- 172.21.15.33:0/1518585606 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638d17c2d40 0x5638d17da790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:15.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.798+0000 7f6a59dd0640 1 -- 172.21.15.33:0/1518585606 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638d17b3b90 con 0x5638d17b7b60 2024-09-12T12:26:15.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.799+0000 7f6a59dd0640 1 --2- 172.21.15.33:0/1518585606 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638d17b7b60 0x5638d17ba610 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6a5000fd50 tx=0x7f6a5000fd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d73f76fbb23e42e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:15.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.799+0000 7f6a3f7fe640 1 -- 172.21.15.33:0/1518585606 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5000fea0 con 0x5638d17b7b60 2024-09-12T12:26:15.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.799+0000 7f6a3f7fe640 1 -- 172.21.15.33:0/1518585606 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6a5002e070 con 0x5638d17b7b60 2024-09-12T12:26:15.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.799+0000 7f6a3f7fe640 1 -- 172.21.15.33:0/1518585606 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a500055e0 con 0x5638d17b7b60 2024-09-12T12:26:15.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.800+0000 7f6a5e40d740 1 -- 172.21.15.33:0/1518585606 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638d17b7b60 msgr2=0x5638d17ba610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:15.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.800+0000 7f6a5e40d740 1 --2- 172.21.15.33:0/1518585606 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638d17b7b60 0x5638d17ba610 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6a5000fd50 tx=0x7f6a5000fd80 comp rx=0 tx=0).stop 2024-09-12T12:26:15.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.800+0000 7f6a5e40d740 1 -- 172.21.15.33:0/1518585606 shutdown_connections 2024-09-12T12:26:15.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.800+0000 7f6a5e40d740 1 --2- 172.21.15.33:0/1518585606 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638d17c2d40 0x5638d17da790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:15.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.800+0000 7f6a5e40d740 1 --2- 172.21.15.33:0/1518585606 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5638d17b8480 0x5638d17c1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:15.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.800+0000 7f6a5e40d740 1 --2- 172.21.15.33:0/1518585606 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638d17b7b60 0x5638d17ba610 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:15.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.800+0000 7f6a5e40d740 1 -- 172.21.15.33:0/1518585606 >> 172.21.15.33:0/1518585606 conn(0x5638d17b40f0 msgr2=0x5638d17c1330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:15.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.800+0000 7f6a5e40d740 1 -- 172.21.15.33:0/1518585606 shutdown_connections 2024-09-12T12:26:15.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.800+0000 7f6a5e40d740 1 -- 172.21.15.33:0/1518585606 wait complete. 2024-09-12T12:26:15.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.801+0000 7f6a5e40d740 1 -- start start 2024-09-12T12:26:15.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.801+0000 7f6a5e40d740 1 Processor -- start 2024-09-12T12:26:15.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.801+0000 7f6a5e40d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638d17b7b60 0x5638d17cb220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:15.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.801+0000 7f6a5e40d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5638d17b8480 0x5638d17c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:15.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.801+0000 7f6a5e40d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638d17c2d40 0x5638d17c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:15.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.801+0000 7f6a5e40d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6a541af460 con 0x5638d17b7b60 2024-09-12T12:26:15.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.801+0000 7f6a5e40d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6a541b08d0 con 0x5638d17c2d40 2024-09-12T12:26:15.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.801+0000 7f6a5e40d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6a541afb30 con 0x5638d17b8480 2024-09-12T12:26:15.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.801+0000 7f6a5e40d740 10 client.0 _ll_register_callbacks cb 0x5638d16a0a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:26:15.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.801+0000 7f6a59dd0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638d17b7b60 0x5638d17cb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:15.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.801+0000 7f6a595cf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5638d17b8480 0x5638d17c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:15.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.801+0000 7f6a59dd0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638d17b7b60 0x5638d17cb220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52656/0 (socket says 172.21.15.33:52656) 2024-09-12T12:26:15.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.801+0000 7f6a59dd0640 1 -- 172.21.15.33:0/648372318 learned_addr learned my addr 172.21.15.33:0/648372318 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:15.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.802+0000 7f6a5a5d1640 1 --2- 172.21.15.33:0/648372318 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638d17c2d40 0x5638d17c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:15.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.802+0000 7f6a59dd0640 1 -- 172.21.15.33:0/648372318 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5638d17b8480 msgr2=0x5638d17c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:15.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.802+0000 7f6a59dd0640 1 --2- 172.21.15.33:0/648372318 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5638d17b8480 0x5638d17c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:15.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.802+0000 7f6a59dd0640 1 -- 172.21.15.33:0/648372318 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638d17c2d40 msgr2=0x5638d17c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:15.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.802+0000 7f6a59dd0640 1 --2- 172.21.15.33:0/648372318 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638d17c2d40 0x5638d17c6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:15.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.802+0000 7f6a59dd0640 1 -- 172.21.15.33:0/648372318 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638d17c70d0 con 0x5638d17b7b60 2024-09-12T12:26:15.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.802+0000 7f6a595cf640 1 --2- 172.21.15.33:0/648372318 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5638d17b8480 0x5638d17c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:15.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.802+0000 7f6a59dd0640 1 --2- 172.21.15.33:0/648372318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638d17b7b60 0x5638d17cb220 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f6a500117b0 tx=0x7f6a50010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92e0c609fa52bf18 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:15.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.802+0000 7f6a3d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:26:15.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.802+0000 7f6a3d7fa640 1 -- 172.21.15.33:0/648372318 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a50010e10 con 0x5638d17b7b60 2024-09-12T12:26:15.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.802+0000 7f6a3d7fa640 1 -- 172.21.15.33:0/648372318 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f6a5000f3c0 con 0x5638d17b7b60 2024-09-12T12:26:15.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.802+0000 7f6a5e40d740 1 -- 172.21.15.33:0/648372318 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a5002e070 con 0x5638d17b7b60 2024-09-12T12:26:15.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.802+0000 7f6a3d7fa640 1 -- 172.21.15.33:0/648372318 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6a50043050 con 0x5638d17b7b60 2024-09-12T12:26:15.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.802+0000 7f6a5e40d740 10 client.15318 fetch_fsmap learned FSMap version 25 2024-09-12T12:26:15.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.802+0000 7f6a5e40d740 1 -- 172.21.15.33:0/648372318 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5638d183d5a0 con 0x5638d17b7b60 2024-09-12T12:26:15.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.803+0000 7f6a3d7fa640 1 -- 172.21.15.33:0/648372318 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6a5002e070 con 0x5638d17b7b60 2024-09-12T12:26:15.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.803+0000 7f6a3d7fa640 1 -- 172.21.15.33:0/648372318 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f6a50004d00 con 0x5638d17b7b60 2024-09-12T12:26:15.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.803+0000 7f6a5e40d740 10 client.15318 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T12:26:15.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.803+0000 7f6a5e40d740 10 client.15318 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:26:15.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.803+0000 7f6a5e40d740 20 client.15318 populate_metadata read hostname 'smithi033' 2024-09-12T12:26:15.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.803+0000 7f6a5e40d740 1 --2- 172.21.15.33:0/648372318 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5638d183dba0 0x5638d183ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:15.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.803+0000 7f6a5e40d740 4 client.15318 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T12:26:15.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.803+0000 7f6a5e40d740 1 -- 172.21.15.33:0/648372318 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5638d1724d00 con 0x5638d183dba0 2024-09-12T12:26:15.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.803+0000 7f6a595cf640 1 --2- 172.21.15.33:0/648372318 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5638d183dba0 0x5638d183ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:15.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.804+0000 7f6a3d7fa640 10 client.15318 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:26:15.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.804+0000 7f6a595cf640 1 --2- 172.21.15.33:0/648372318 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5638d183dba0 0x5638d183ff90 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b981823465134c26 server_cookie=bac5aa04a3268138 in_seq=0 out_seq=0 2024-09-12T12:26:15.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.805+0000 7f6a3d7fa640 1 -- 172.21.15.33:0/648372318 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5638d1724d00 con 0x5638d183dba0 2024-09-12T12:26:15.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.805+0000 7f6a3d7fa640 10 client.15318 handle_command_reply: tid=0 2024-09-12T12:26:15.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.805+0000 7f6a5e40d740 1 client.15318 shutdown 2024-09-12T12:26:15.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.805+0000 7f6a5e40d740 1 -- 172.21.15.33:0/648372318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638d17b7b60 msgr2=0x5638d17cb220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:15.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.805+0000 7f6a5e40d740 1 --2- 172.21.15.33:0/648372318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638d17b7b60 0x5638d17cb220 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f6a500117b0 tx=0x7f6a50010c20 comp rx=0 tx=0).stop 2024-09-12T12:26:15.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.805+0000 7f6a5e40d740 1 -- 172.21.15.33:0/648372318 shutdown_connections 2024-09-12T12:26:15.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.805+0000 7f6a5e40d740 1 --2- 172.21.15.33:0/648372318 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5638d183dba0 0x5638d183ff90 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:15.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.805+0000 7f6a5e40d740 1 --2- 172.21.15.33:0/648372318 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638d17c2d40 0x5638d17c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:15.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.805+0000 7f6a5e40d740 1 --2- 172.21.15.33:0/648372318 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5638d17b8480 0x5638d17c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:15.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.805+0000 7f6a5e40d740 1 --2- 172.21.15.33:0/648372318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638d17b7b60 0x5638d17cb220 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:15.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.805+0000 7f6a3d7fa640 0 client.15318 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:26:15.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.805+0000 7f6a5e40d740 1 -- 172.21.15.33:0/648372318 >> 172.21.15.33:0/648372318 conn(0x5638d17b40f0 msgr2=0x5638d17b3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:15.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.805+0000 7f6a5e40d740 1 -- 172.21.15.33:0/648372318 shutdown_connections 2024-09-12T12:26:15.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.805+0000 7f6a5e40d740 1 -- 172.21.15.33:0/648372318 wait complete. 2024-09-12T12:26:15.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.805+0000 7f6a5e40d740 20 client.15318 trim_cache size 0 max 16384 2024-09-12T12:26:15.810 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:26:15.810 INFO:teuthology.orchestra.run.smithi033.stdout: "return_code": 0, 2024-09-12T12:26:15.810 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_tag": "639c1129-4bee-4cc0-80e0-be728d4dd0be", 2024-09-12T12:26:15.810 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": "asynchronous" 2024-09-12T12:26:15.810 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:26:15.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.806+0000 7f6a5c034640 1 -- 172.21.15.33:0/2922754874 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f6a400a2c00 msgr2=0x7f6a400a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:15.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.806+0000 7f6a5c034640 1 --2- 172.21.15.33:0/2922754874 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f6a400a2c00 0x7f6a400a50c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c048000 tx=0x7f6a4c04b000 comp rx=0 tx=0).stop 2024-09-12T12:26:15.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.806+0000 7f6a5c034640 1 -- 172.21.15.33:0/2922754874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a54103740 msgr2=0x7f6a5419ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:15.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.806+0000 7f6a5c034640 1 --2- 172.21.15.33:0/2922754874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a54103740 0x7f6a5419ac00 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6a4400d770 tx=0x7f6a4400dc30 comp rx=0 tx=0).stop 2024-09-12T12:26:15.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.806+0000 7f6a5c034640 1 -- 172.21.15.33:0/2922754874 shutdown_connections 2024-09-12T12:26:15.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.806+0000 7f6a5c034640 1 --2- 172.21.15.33:0/2922754874 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f6a400a2c00 0x7f6a400a50c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:15.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.806+0000 7f6a5c034640 1 --2- 172.21.15.33:0/2922754874 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a54108290 0x7f6a5419ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:15.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.806+0000 7f6a5c034640 1 --2- 172.21.15.33:0/2922754874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a54103740 0x7f6a5419ac00 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:15.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.806+0000 7f6a5c034640 1 --2- 172.21.15.33:0/2922754874 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6a54102d90 0x7f6a5419a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:15.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.806+0000 7f6a5c034640 1 -- 172.21.15.33:0/2922754874 >> 172.21.15.33:0/2922754874 conn(0x7f6a540fc7d0 msgr2=0x7f6a54100d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:15.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.806+0000 7f6a5c034640 1 -- 172.21.15.33:0/2922754874 shutdown_connections 2024-09-12T12:26:15.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:15.806+0000 7f6a5c034640 1 -- 172.21.15.33:0/2922754874 wait complete. 2024-09-12T12:26:16.531 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T12:26:16.829 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:26:17.202 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:17 smithi033 ceph-mon[31246]: scrub queued for path: / 2024-09-12T12:26:17.202 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:17 smithi033 ceph-mon[31246]: scrub summary: idle+waiting paths [/] 2024-09-12T12:26:17.202 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:17 smithi033 ceph-mon[31246]: scrub summary: active paths [/] 2024-09-12T12:26:17.202 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:17 smithi033 ceph-mon[31246]: scrub summary: idle+waiting paths [/] 2024-09-12T12:26:17.202 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:17 smithi033 ceph-mon[31246]: pgmap v358: 129 pgs: 129 active+clean; 649 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-12T12:26:17.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.281+0000 7fe4457da640 1 -- 172.21.15.33:0/3890758498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe440100e20 msgr2=0x7fe440101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:17.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.281+0000 7fe4457da640 1 --2- 172.21.15.33:0/3890758498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe440100e20 0x7fe440101200 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe430009ca0 tx=0x7fe43002a950 comp rx=0 tx=0).stop 2024-09-12T12:26:17.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.281+0000 7fe4457da640 1 -- 172.21.15.33:0/3890758498 shutdown_connections 2024-09-12T12:26:17.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.281+0000 7fe4457da640 1 --2- 172.21.15.33:0/3890758498 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe440102ef0 0x7fe44010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:17.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.281+0000 7fe4457da640 1 --2- 172.21.15.33:0/3890758498 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe440102570 0x7fe4401029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:17.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.281+0000 7fe4457da640 1 --2- 172.21.15.33:0/3890758498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe440100e20 0x7fe440101200 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:17.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.281+0000 7fe4457da640 1 -- 172.21.15.33:0/3890758498 >> 172.21.15.33:0/3890758498 conn(0x7fe4400fc7d0 msgr2=0x7fe4400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:17.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.281+0000 7fe4457da640 1 -- 172.21.15.33:0/3890758498 shutdown_connections 2024-09-12T12:26:17.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.281+0000 7fe4457da640 1 -- 172.21.15.33:0/3890758498 wait complete. 2024-09-12T12:26:17.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.282+0000 7fe4457da640 1 Processor -- start 2024-09-12T12:26:17.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.282+0000 7fe4457da640 1 -- start start 2024-09-12T12:26:17.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.282+0000 7fe4457da640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe440100e20 0x7fe4401992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:17.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.282+0000 7fe4457da640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe440102570 0x7fe440199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:17.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.282+0000 7fe4457da640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe440102ef0 0x7fe4401a4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:17.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.282+0000 7fe4457da640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe440110e30 con 0x7fe440100e20 2024-09-12T12:26:17.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.282+0000 7fe4457da640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe440110cb0 con 0x7fe440102570 2024-09-12T12:26:17.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.282+0000 7fe4457da640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe440110fb0 con 0x7fe440102ef0 2024-09-12T12:26:17.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.282+0000 7fe43effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe440100e20 0x7fe4401992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:17.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.282+0000 7fe43effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe440100e20 0x7fe4401992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52674/0 (socket says 172.21.15.33:52674) 2024-09-12T12:26:17.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.282+0000 7fe43effd640 1 -- 172.21.15.33:0/2523543012 learned_addr learned my addr 172.21.15.33:0/2523543012 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:17.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.282+0000 7fe43e7fc640 1 --2- 172.21.15.33:0/2523543012 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe440102570 0x7fe440199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:17.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.282+0000 7fe43f7fe640 1 --2- 172.21.15.33:0/2523543012 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe440102ef0 0x7fe4401a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:17.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.283+0000 7fe43effd640 1 -- 172.21.15.33:0/2523543012 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe440102ef0 msgr2=0x7fe4401a4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:17.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.283+0000 7fe43effd640 1 --2- 172.21.15.33:0/2523543012 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe440102ef0 0x7fe4401a4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:17.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.283+0000 7fe43effd640 1 -- 172.21.15.33:0/2523543012 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe440102570 msgr2=0x7fe440199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:17.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.283+0000 7fe43effd640 1 --2- 172.21.15.33:0/2523543012 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe440102570 0x7fe440199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:17.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.283+0000 7fe43effd640 1 -- 172.21.15.33:0/2523543012 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4401a48a0 con 0x7fe440100e20 2024-09-12T12:26:17.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.283+0000 7fe43effd640 1 --2- 172.21.15.33:0/2523543012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe440100e20 0x7fe4401992e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe430005cc0 tx=0x7fe43002f650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:17.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.283+0000 7fe437fff640 1 -- 172.21.15.33:0/2523543012 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe430034040 con 0x7fe440100e20 2024-09-12T12:26:17.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.283+0000 7fe437fff640 1 -- 172.21.15.33:0/2523543012 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe4300308f0 con 0x7fe440100e20 2024-09-12T12:26:17.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.283+0000 7fe4457da640 1 -- 172.21.15.33:0/2523543012 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4401a4a70 con 0x7fe440100e20 2024-09-12T12:26:17.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.283+0000 7fe437fff640 1 -- 172.21.15.33:0/2523543012 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4300046b0 con 0x7fe440100e20 2024-09-12T12:26:17.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.283+0000 7fe4457da640 1 -- 172.21.15.33:0/2523543012 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4401a4ec0 con 0x7fe440100e20 2024-09-12T12:26:17.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.285+0000 7fe437fff640 1 -- 172.21.15.33:0/2523543012 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe430037020 con 0x7fe440100e20 2024-09-12T12:26:17.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.286+0000 7fe447bb3740 1 Processor -- start 2024-09-12T12:26:17.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.286+0000 7fe447bb3740 1 -- start start 2024-09-12T12:26:17.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.286+0000 7fe437fff640 1 --2- 172.21.15.33:0/2523543012 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe42c0a2b80 0x7fe42c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:17.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.286+0000 7fe447bb3740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1569b64a0 0x55b1569b6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:17.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.286+0000 7fe447bb3740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1569b6dc0 0x55b1569c1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:17.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.286+0000 7fe447bb3740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1569c1680 0x55b1569c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:17.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.286+0000 7fe447bb3740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55b15691c2e0 con 0x55b1569c1680 2024-09-12T12:26:17.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.286+0000 7fe447bb3740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b1568c3ce0 con 0x55b1569b64a0 2024-09-12T12:26:17.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.286+0000 7fe447bb3740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55b1569182a0 con 0x55b1569b6dc0 2024-09-12T12:26:17.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.286+0000 7fe43f7fe640 1 --2- 172.21.15.33:0/2523543012 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe42c0a2b80 0x7fe42c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:17.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.286+0000 7fe437fff640 1 -- 172.21.15.33:0/2523543012 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fe4300f0200 con 0x7fe440100e20 2024-09-12T12:26:17.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.286+0000 7fe43f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1569c1680 0x55b1569c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:17.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.286+0000 7fe43effd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1569b64a0 0x55b1569b6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:17.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.286+0000 7fe43f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1569c1680 0x55b1569c3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52682/0 (socket says 172.21.15.33:52682) 2024-09-12T12:26:17.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.286+0000 7fe43f7fe640 1 -- 172.21.15.33:0/3479962689 learned_addr learned my addr 172.21.15.33:0/3479962689 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:17.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.286+0000 7fe43effd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1569b64a0 0x55b1569b6880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:51636/0 (socket says 172.21.15.33:51636) 2024-09-12T12:26:17.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.287+0000 7fe43e7fc640 1 --2- 172.21.15.33:0/3479962689 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1569b6dc0 0x55b1569c1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:17.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.287+0000 7fe43effd640 1 -- 172.21.15.33:0/3479962689 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1569b6dc0 msgr2=0x55b1569c1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:17.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.287+0000 7fe43effd640 1 --2- 172.21.15.33:0/3479962689 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1569b6dc0 0x55b1569c1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:17.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.287+0000 7fe43effd640 1 -- 172.21.15.33:0/3479962689 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1569c1680 msgr2=0x55b1569c3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:17.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.287+0000 7fe43effd640 1 --2- 172.21.15.33:0/3479962689 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1569c1680 0x55b1569c3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:17.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.287+0000 7fe43effd640 1 -- 172.21.15.33:0/3479962689 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1568a8440 con 0x55b1569b64a0 2024-09-12T12:26:17.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.287+0000 7fe43f7fe640 1 --2- 172.21.15.33:0/3479962689 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1569c1680 0x55b1569c3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:17.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.287+0000 7fe43f7fe640 1 --2- 172.21.15.33:0/2523543012 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe42c0a2b80 0x7fe42c0a5040 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x55b1569b3db0 tx=0x7fe438005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:17.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.287+0000 7fe43effd640 1 --2- 172.21.15.33:0/3479962689 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1569b64a0 0x55b1569b6880 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe4300ed9c0 tx=0x7fe430003d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18abf24b9eb148ee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:17.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.287+0000 7fe4357fa640 1 -- 172.21.15.33:0/3479962689 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe430004850 con 0x55b1569b64a0 2024-09-12T12:26:17.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.287+0000 7fe4357fa640 1 -- 172.21.15.33:0/3479962689 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe430004040 con 0x55b1569b64a0 2024-09-12T12:26:17.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.287+0000 7fe4357fa640 1 -- 172.21.15.33:0/3479962689 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4300c0a80 con 0x55b1569b64a0 2024-09-12T12:26:17.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.288+0000 7fe447bb3740 1 -- 172.21.15.33:0/3479962689 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1569b64a0 msgr2=0x55b1569b6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:17.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.288+0000 7fe447bb3740 1 --2- 172.21.15.33:0/3479962689 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1569b64a0 0x55b1569b6880 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe4300ed9c0 tx=0x7fe430003d80 comp rx=0 tx=0).stop 2024-09-12T12:26:17.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.288+0000 7fe447bb3740 1 -- 172.21.15.33:0/3479962689 shutdown_connections 2024-09-12T12:26:17.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.288+0000 7fe447bb3740 1 --2- 172.21.15.33:0/3479962689 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1569c1680 0x55b1569c3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:17.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.288+0000 7fe447bb3740 1 --2- 172.21.15.33:0/3479962689 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1569b6dc0 0x55b1569c1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:17.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.288+0000 7fe447bb3740 1 --2- 172.21.15.33:0/3479962689 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1569b64a0 0x55b1569b6880 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:17.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.288+0000 7fe447bb3740 1 -- 172.21.15.33:0/3479962689 >> 172.21.15.33:0/3479962689 conn(0x55b1569b2a30 msgr2=0x55b1569b2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:17.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.288+0000 7fe447bb3740 1 -- 172.21.15.33:0/3479962689 shutdown_connections 2024-09-12T12:26:17.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.288+0000 7fe447bb3740 1 -- 172.21.15.33:0/3479962689 wait complete. 2024-09-12T12:26:17.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.288+0000 7fe447bb3740 1 -- start start 2024-09-12T12:26:17.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.289+0000 7fe447bb3740 1 Processor -- start 2024-09-12T12:26:17.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.289+0000 7fe447bb3740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1569b64a0 0x55b1569c0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:17.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.289+0000 7fe447bb3740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1569b6dc0 0x55b1569be250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:17.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.289+0000 7fe447bb3740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1569c1680 0x55b1569be790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:17.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.289+0000 7fe447bb3740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55b1568c3ce0 con 0x55b1569b64a0 2024-09-12T12:26:17.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.289+0000 7fe447bb3740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b1568d7050 con 0x55b1569c1680 2024-09-12T12:26:17.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.289+0000 7fe447bb3740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55b1569c4010 con 0x55b1569b6dc0 2024-09-12T12:26:17.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.289+0000 7fe447bb3740 10 client.0 _ll_register_callbacks cb 0x55b156917160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:26:17.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.289+0000 7fe43effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1569b64a0 0x55b1569c0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:17.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.289+0000 7fe43effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1569b64a0 0x55b1569c0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52690/0 (socket says 172.21.15.33:52690) 2024-09-12T12:26:17.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.289+0000 7fe43effd640 1 -- 172.21.15.33:0/2696196199 learned_addr learned my addr 172.21.15.33:0/2696196199 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:17.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.289+0000 7fe43f7fe640 1 --2- 172.21.15.33:0/2696196199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1569c1680 0x55b1569be790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:17.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.289+0000 7fe43e7fc640 1 --2- 172.21.15.33:0/2696196199 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1569b6dc0 0x55b1569be250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:17.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.289+0000 7fe43effd640 1 -- 172.21.15.33:0/2696196199 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1569b6dc0 msgr2=0x55b1569be250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:17.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.289+0000 7fe43effd640 1 --2- 172.21.15.33:0/2696196199 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1569b6dc0 0x55b1569be250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:17.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.289+0000 7fe43effd640 1 -- 172.21.15.33:0/2696196199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1569c1680 msgr2=0x55b1569be790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:17.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.289+0000 7fe43effd640 1 --2- 172.21.15.33:0/2696196199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1569c1680 0x55b1569be790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:17.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.289+0000 7fe43effd640 1 -- 172.21.15.33:0/2696196199 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b15668d3c0 con 0x55b1569b64a0 2024-09-12T12:26:17.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.289+0000 7fe43effd640 1 --2- 172.21.15.33:0/2696196199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1569b64a0 0x55b1569c0fa0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe4300edce0 tx=0x7fe4300bc740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3dc5ff962d3825e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:17.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.289+0000 7fe4267fc640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:26:17.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.290+0000 7fe4267fc640 1 -- 172.21.15.33:0/2696196199 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe430004850 con 0x55b1569b64a0 2024-09-12T12:26:17.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.290+0000 7fe4267fc640 1 -- 172.21.15.33:0/2696196199 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fe43008e0e0 con 0x55b1569b64a0 2024-09-12T12:26:17.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.290+0000 7fe447bb3740 1 -- 172.21.15.33:0/2696196199 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b156929850 con 0x55b1569b64a0 2024-09-12T12:26:17.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.290+0000 7fe4267fc640 1 -- 172.21.15.33:0/2696196199 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe4300da050 con 0x55b1569b64a0 2024-09-12T12:26:17.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.290+0000 7fe447bb3740 10 client.15330 fetch_fsmap learned FSMap version 25 2024-09-12T12:26:17.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.290+0000 7fe447bb3740 1 -- 172.21.15.33:0/2696196199 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b1569cf780 con 0x55b1569b64a0 2024-09-12T12:26:17.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.290+0000 7fe4267fc640 1 -- 172.21.15.33:0/2696196199 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55b156929850 con 0x55b1569b64a0 2024-09-12T12:26:17.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.290+0000 7fe4267fc640 1 -- 172.21.15.33:0/2696196199 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fe43004d030 con 0x55b1569b64a0 2024-09-12T12:26:17.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.290+0000 7fe447bb3740 10 client.15330 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T12:26:17.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.290+0000 7fe447bb3740 10 client.15330 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:26:17.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.290+0000 7fe447bb3740 20 client.15330 populate_metadata read hostname 'smithi033' 2024-09-12T12:26:17.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.290+0000 7fe447bb3740 1 --2- 172.21.15.33:0/2696196199 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55b1569d0970 0x55b1569d2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:17.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.290+0000 7fe447bb3740 4 client.15330 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:26:17.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.290+0000 7fe447bb3740 1 -- 172.21.15.33:0/2696196199 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b156923d60 con 0x55b1569d0970 2024-09-12T12:26:17.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.290+0000 7fe43e7fc640 1 --2- 172.21.15.33:0/2696196199 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55b1569d0970 0x55b1569d2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:17.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.291+0000 7fe4267fc640 10 client.15330 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:26:17.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.291+0000 7fe43e7fc640 1 --2- 172.21.15.33:0/2696196199 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55b1569d0970 0x55b1569d2dc0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d2ccaa19aa43ae1 server_cookie=d95a6ff11b705fc0 in_seq=0 out_seq=0 2024-09-12T12:26:17.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.291+0000 7fe4267fc640 1 -- 172.21.15.33:0/2696196199 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b156923d60 con 0x55b1569d0970 2024-09-12T12:26:17.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.291+0000 7fe4267fc640 10 client.15330 handle_command_reply: tid=0 2024-09-12T12:26:17.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.292+0000 7fe447bb3740 1 client.15330 shutdown 2024-09-12T12:26:17.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.292+0000 7fe447bb3740 1 -- 172.21.15.33:0/2696196199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1569b64a0 msgr2=0x55b1569c0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:17.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.292+0000 7fe447bb3740 1 --2- 172.21.15.33:0/2696196199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1569b64a0 0x55b1569c0fa0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe4300edce0 tx=0x7fe4300bc740 comp rx=0 tx=0).stop 2024-09-12T12:26:17.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.292+0000 7fe447bb3740 1 -- 172.21.15.33:0/2696196199 shutdown_connections 2024-09-12T12:26:17.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.292+0000 7fe447bb3740 1 --2- 172.21.15.33:0/2696196199 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55b1569d0970 0x55b1569d2dc0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:17.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.292+0000 7fe447bb3740 1 --2- 172.21.15.33:0/2696196199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1569c1680 0x55b1569be790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:17.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.292+0000 7fe447bb3740 1 --2- 172.21.15.33:0/2696196199 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1569b6dc0 0x55b1569be250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:17.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.292+0000 7fe4267fc640 0 client.15330 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:26:17.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.292+0000 7fe447bb3740 1 --2- 172.21.15.33:0/2696196199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1569b64a0 0x55b1569c0fa0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:17.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.292+0000 7fe447bb3740 1 -- 172.21.15.33:0/2696196199 >> 172.21.15.33:0/2696196199 conn(0x55b1569b2a30 msgr2=0x55b1569b8760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:17.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.292+0000 7fe447bb3740 1 -- 172.21.15.33:0/2696196199 shutdown_connections 2024-09-12T12:26:17.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.292+0000 7fe447bb3740 1 -- 172.21.15.33:0/2696196199 wait complete. 2024-09-12T12:26:17.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.292+0000 7fe447bb3740 20 client.15330 trim_cache size 0 max 16384 2024-09-12T12:26:17.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.309+0000 7fe447bb3740 1 Processor -- start 2024-09-12T12:26:17.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.309+0000 7fe447bb3740 1 -- start start 2024-09-12T12:26:17.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.310+0000 7fe447bb3740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1569b64a0 0x55b1569cd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:17.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.310+0000 7fe447bb3740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1569b6dc0 0x55b1569d86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:17.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.310+0000 7fe447bb3740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1569c1680 0x55b1569d8c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:17.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.310+0000 7fe447bb3740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe4401b1400 con 0x55b1569c1680 2024-09-12T12:26:17.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.310+0000 7fe447bb3740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe4401aecd0 con 0x55b1569b64a0 2024-09-12T12:26:17.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.310+0000 7fe447bb3740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe4401acb20 con 0x55b1569b6dc0 2024-09-12T12:26:17.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.310+0000 7fe43f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1569c1680 0x55b1569d8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:17.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.310+0000 7fe43f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1569c1680 0x55b1569d8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52692/0 (socket says 172.21.15.33:52692) 2024-09-12T12:26:17.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.310+0000 7fe43f7fe640 1 -- 172.21.15.33:0/570839434 learned_addr learned my addr 172.21.15.33:0/570839434 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:17.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.310+0000 7fe43effd640 1 --2- 172.21.15.33:0/570839434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1569b64a0 0x55b1569cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:17.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.310+0000 7fe43e7fc640 1 --2- 172.21.15.33:0/570839434 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1569b6dc0 0x55b1569d86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:17.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.310+0000 7fe43f7fe640 1 -- 172.21.15.33:0/570839434 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1569b6dc0 msgr2=0x55b1569d86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:17.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.310+0000 7fe43f7fe640 1 --2- 172.21.15.33:0/570839434 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1569b6dc0 0x55b1569d86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:17.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.310+0000 7fe43f7fe640 1 -- 172.21.15.33:0/570839434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1569b64a0 msgr2=0x55b1569cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:17.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.310+0000 7fe43f7fe640 1 --2- 172.21.15.33:0/570839434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1569b64a0 0x55b1569cd060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:17.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.310+0000 7fe43f7fe640 1 -- 172.21.15.33:0/570839434 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1569c3db0 con 0x55b1569c1680 2024-09-12T12:26:17.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.310+0000 7fe43effd640 1 --2- 172.21.15.33:0/570839434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1569b64a0 0x55b1569cd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:17.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.310+0000 7fe43f7fe640 1 --2- 172.21.15.33:0/570839434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1569c1680 0x55b1569d8c20 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe43800a5f0 tx=0x7fe438005f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d77187ed5f86e5d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:17.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.311+0000 7fe434ff9640 1 -- 172.21.15.33:0/570839434 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe438011e60 con 0x55b1569c1680 2024-09-12T12:26:17.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.311+0000 7fe434ff9640 1 -- 172.21.15.33:0/570839434 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe43801eb00 con 0x55b1569c1680 2024-09-12T12:26:17.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.311+0000 7fe434ff9640 1 -- 172.21.15.33:0/570839434 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4380108d0 con 0x55b1569c1680 2024-09-12T12:26:17.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.311+0000 7fe447bb3740 1 -- 172.21.15.33:0/570839434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1569c1680 msgr2=0x55b1569d8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:17.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.311+0000 7fe447bb3740 1 --2- 172.21.15.33:0/570839434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1569c1680 0x55b1569d8c20 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe43800a5f0 tx=0x7fe438005f60 comp rx=0 tx=0).stop 2024-09-12T12:26:17.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.311+0000 7fe447bb3740 1 -- 172.21.15.33:0/570839434 shutdown_connections 2024-09-12T12:26:17.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.311+0000 7fe447bb3740 1 --2- 172.21.15.33:0/570839434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1569c1680 0x55b1569d8c20 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:17.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.311+0000 7fe447bb3740 1 --2- 172.21.15.33:0/570839434 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1569b6dc0 0x55b1569d86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:17.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.311+0000 7fe447bb3740 1 --2- 172.21.15.33:0/570839434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1569b64a0 0x55b1569cd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:17.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.311+0000 7fe447bb3740 1 -- 172.21.15.33:0/570839434 >> 172.21.15.33:0/570839434 conn(0x55b1569b2a30 msgr2=0x55b1569b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:17.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.311+0000 7fe447bb3740 1 -- 172.21.15.33:0/570839434 shutdown_connections 2024-09-12T12:26:17.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.312+0000 7fe447bb3740 1 -- 172.21.15.33:0/570839434 wait complete. 2024-09-12T12:26:17.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.312+0000 7fe447bb3740 1 -- start start 2024-09-12T12:26:17.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.312+0000 7fe447bb3740 1 Processor -- start 2024-09-12T12:26:17.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.312+0000 7fe447bb3740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1569b64a0 0x55b1569c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:17.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.312+0000 7fe447bb3740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1569b6dc0 0x55b1569c69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:17.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.312+0000 7fe447bb3740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1569c1680 0x55b1569c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:17.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.312+0000 7fe447bb3740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe4401ad190 con 0x55b1569b6dc0 2024-09-12T12:26:17.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.312+0000 7fe447bb3740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe4401ae600 con 0x55b1569b64a0 2024-09-12T12:26:17.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.312+0000 7fe447bb3740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe4401ad860 con 0x55b1569c1680 2024-09-12T12:26:17.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.312+0000 7fe447bb3740 10 client.0 _ll_register_callbacks cb 0x7fe43800a9f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:26:17.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.312+0000 7fe43e7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1569b6dc0 0x55b1569c69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:17.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.312+0000 7fe43e7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1569b6dc0 0x55b1569c69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52708/0 (socket says 172.21.15.33:52708) 2024-09-12T12:26:17.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.312+0000 7fe43e7fc640 1 -- 172.21.15.33:0/391667613 learned_addr learned my addr 172.21.15.33:0/391667613 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:17.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.312+0000 7fe43effd640 1 --2- 172.21.15.33:0/391667613 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1569b64a0 0x55b1569c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:17.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.312+0000 7fe43f7fe640 1 --2- 172.21.15.33:0/391667613 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1569c1680 0x55b1569c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:17.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.313+0000 7fe43e7fc640 1 -- 172.21.15.33:0/391667613 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1569c1680 msgr2=0x55b1569c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:17.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.313+0000 7fe43e7fc640 1 --2- 172.21.15.33:0/391667613 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1569c1680 0x55b1569c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:17.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.313+0000 7fe43e7fc640 1 -- 172.21.15.33:0/391667613 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1569b64a0 msgr2=0x55b1569c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:17.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.313+0000 7fe43e7fc640 1 --2- 172.21.15.33:0/391667613 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1569b64a0 0x55b1569c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:17.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.313+0000 7fe43e7fc640 1 -- 172.21.15.33:0/391667613 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1569c7420 con 0x55b1569b6dc0 2024-09-12T12:26:17.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.313+0000 7fe43e7fc640 1 --2- 172.21.15.33:0/391667613 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1569b6dc0 0x55b1569c69a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x55b1569b3890 tx=0x7fe4280044d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10c430543d7188c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:17.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.313+0000 7fe4267fc640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:26:17.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.313+0000 7fe4267fc640 1 -- 172.21.15.33:0/391667613 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe428005230 con 0x55b1569b6dc0 2024-09-12T12:26:17.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.313+0000 7fe4267fc640 1 -- 172.21.15.33:0/391667613 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fe4280053d0 con 0x55b1569b6dc0 2024-09-12T12:26:17.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.313+0000 7fe447bb3740 1 -- 172.21.15.33:0/391667613 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe43801eb00 con 0x55b1569b6dc0 2024-09-12T12:26:17.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.313+0000 7fe4267fc640 1 -- 172.21.15.33:0/391667613 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe42802d050 con 0x55b1569b6dc0 2024-09-12T12:26:17.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.313+0000 7fe447bb3740 10 client.15336 fetch_fsmap learned FSMap version 25 2024-09-12T12:26:17.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.313+0000 7fe447bb3740 1 -- 172.21.15.33:0/391667613 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b156a3b490 con 0x55b1569b6dc0 2024-09-12T12:26:17.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.313+0000 7fe4267fc640 1 -- 172.21.15.33:0/391667613 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe43801eb00 con 0x55b1569b6dc0 2024-09-12T12:26:17.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.314+0000 7fe4267fc640 1 -- 172.21.15.33:0/391667613 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fe42801e5b0 con 0x55b1569b6dc0 2024-09-12T12:26:17.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.314+0000 7fe447bb3740 10 client.15336 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T12:26:17.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.314+0000 7fe447bb3740 10 client.15336 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:26:17.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.314+0000 7fe447bb3740 20 client.15336 populate_metadata read hostname 'smithi033' 2024-09-12T12:26:17.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.314+0000 7fe447bb3740 1 --2- 172.21.15.33:0/391667613 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55b156a3bc90 0x55b156a3e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:17.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.314+0000 7fe447bb3740 4 client.15336 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:26:17.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.314+0000 7fe447bb3740 1 -- 172.21.15.33:0/391667613 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b1569beb20 con 0x55b156a3bc90 2024-09-12T12:26:17.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.314+0000 7fe43effd640 1 --2- 172.21.15.33:0/391667613 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55b156a3bc90 0x55b156a3e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:17.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.314+0000 7fe43effd640 1 --2- 172.21.15.33:0/391667613 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55b156a3bc90 0x55b156a3e0b0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b33b40d32170d16 server_cookie=21f10862a6f77a16 in_seq=0 out_seq=0 2024-09-12T12:26:17.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.314+0000 7fe4267fc640 10 client.15336 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:26:17.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.315+0000 7fe4267fc640 1 -- 172.21.15.33:0/391667613 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55b1569beb20 con 0x55b156a3bc90 2024-09-12T12:26:17.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.315+0000 7fe4267fc640 10 client.15336 handle_command_reply: tid=0 2024-09-12T12:26:17.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.315+0000 7fe447bb3740 1 client.15336 shutdown 2024-09-12T12:26:17.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.315+0000 7fe447bb3740 1 -- 172.21.15.33:0/391667613 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1569b6dc0 msgr2=0x55b1569c69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:17.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.315+0000 7fe447bb3740 1 --2- 172.21.15.33:0/391667613 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1569b6dc0 0x55b1569c69a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x55b1569b3890 tx=0x7fe4280044d0 comp rx=0 tx=0).stop 2024-09-12T12:26:17.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.315+0000 7fe447bb3740 1 -- 172.21.15.33:0/391667613 shutdown_connections 2024-09-12T12:26:17.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.315+0000 7fe447bb3740 1 --2- 172.21.15.33:0/391667613 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55b156a3bc90 0x55b156a3e0b0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:17.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.315+0000 7fe447bb3740 1 --2- 172.21.15.33:0/391667613 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1569c1680 0x55b1569c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:17.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.315+0000 7fe4267fc640 0 client.15336 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:26:17.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.315+0000 7fe447bb3740 1 --2- 172.21.15.33:0/391667613 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1569b6dc0 0x55b1569c69a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:17.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.315+0000 7fe447bb3740 1 --2- 172.21.15.33:0/391667613 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1569b64a0 0x55b1569c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:17.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.315+0000 7fe447bb3740 1 -- 172.21.15.33:0/391667613 >> 172.21.15.33:0/391667613 conn(0x55b1569b2a30 msgr2=0x55b1569bfab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:17.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.315+0000 7fe447bb3740 1 -- 172.21.15.33:0/391667613 shutdown_connections 2024-09-12T12:26:17.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.315+0000 7fe447bb3740 1 -- 172.21.15.33:0/391667613 wait complete. 2024-09-12T12:26:17.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.315+0000 7fe447bb3740 20 client.15336 trim_cache size 0 max 16384 2024-09-12T12:26:17.322 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:26:17.322 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T12:26:17.322 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": { 2024-09-12T12:26:17.322 INFO:teuthology.orchestra.run.smithi033.stdout: "639c1129-4bee-4cc0-80e0-be728d4dd0be": { 2024-09-12T12:26:17.322 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-09-12T12:26:17.322 INFO:teuthology.orchestra.run.smithi033.stdout: "tag": "639c1129-4bee-4cc0-80e0-be728d4dd0be", 2024-09-12T12:26:17.322 INFO:teuthology.orchestra.run.smithi033.stdout: "options": "recursive,force" 2024-09-12T12:26:17.322 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:26:17.322 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:26:17.322 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:26:17.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.316+0000 7fe4457da640 1 -- 172.21.15.33:0/2523543012 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe42c0a2b80 msgr2=0x7fe42c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:17.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.316+0000 7fe4457da640 1 --2- 172.21.15.33:0/2523543012 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe42c0a2b80 0x7fe42c0a5040 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x55b1569b3db0 tx=0x7fe438005850 comp rx=0 tx=0).stop 2024-09-12T12:26:17.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.316+0000 7fe4457da640 1 -- 172.21.15.33:0/2523543012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe440100e20 msgr2=0x7fe4401992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:17.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.316+0000 7fe4457da640 1 --2- 172.21.15.33:0/2523543012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe440100e20 0x7fe4401992e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe430005cc0 tx=0x7fe43002f650 comp rx=0 tx=0).stop 2024-09-12T12:26:17.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.316+0000 7fe4457da640 1 -- 172.21.15.33:0/2523543012 shutdown_connections 2024-09-12T12:26:17.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.316+0000 7fe4457da640 1 --2- 172.21.15.33:0/2523543012 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe42c0a2b80 0x7fe42c0a5040 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:17.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.316+0000 7fe4457da640 1 --2- 172.21.15.33:0/2523543012 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe440102ef0 0x7fe4401a4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:17.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.316+0000 7fe4457da640 1 --2- 172.21.15.33:0/2523543012 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe440102570 0x7fe440199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:17.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.316+0000 7fe4457da640 1 --2- 172.21.15.33:0/2523543012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe440100e20 0x7fe4401992e0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:17.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.316+0000 7fe4457da640 1 -- 172.21.15.33:0/2523543012 >> 172.21.15.33:0/2523543012 conn(0x7fe4400fc7d0 msgr2=0x7fe4400fe270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:17.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.316+0000 7fe4457da640 1 -- 172.21.15.33:0/2523543012 shutdown_connections 2024-09-12T12:26:17.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:17.316+0000 7fe4457da640 1 -- 172.21.15.33:0/2523543012 wait complete. 2024-09-12T12:26:17.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:17 smithi043 ceph-mon[34144]: scrub queued for path: / 2024-09-12T12:26:17.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:17 smithi043 ceph-mon[34144]: scrub summary: idle+waiting paths [/] 2024-09-12T12:26:17.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:17 smithi043 ceph-mon[34144]: scrub summary: active paths [/] 2024-09-12T12:26:17.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:17 smithi043 ceph-mon[34144]: scrub summary: idle+waiting paths [/] 2024-09-12T12:26:17.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:17 smithi043 ceph-mon[34144]: pgmap v358: 129 pgs: 129 active+clean; 649 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-12T12:26:17.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:17 smithi102 ceph-mon[34799]: scrub queued for path: / 2024-09-12T12:26:17.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:17 smithi102 ceph-mon[34799]: scrub summary: idle+waiting paths [/] 2024-09-12T12:26:17.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:17 smithi102 ceph-mon[34799]: scrub summary: active paths [/] 2024-09-12T12:26:17.397 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:17 smithi102 ceph-mon[34799]: scrub summary: idle+waiting paths [/] 2024-09-12T12:26:17.397 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:17 smithi102 ceph-mon[34799]: pgmap v358: 129 pgs: 129 active+clean; 649 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-12T12:26:18.025 INFO:tasks.cephfs.filesystem:scrub status for tag:639c1129-4bee-4cc0-80e0-be728d4dd0be - {'path': '/', 'tag': '639c1129-4bee-4cc0-80e0-be728d4dd0be', 'options': 'recursive,force'} 2024-09-12T12:26:19.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:19 smithi043 ceph-mon[34144]: pgmap v359: 129 pgs: 129 active+clean; 649 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-12T12:26:19.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:19 smithi102 ceph-mon[34799]: pgmap v359: 129 pgs: 129 active+clean; 649 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-12T12:26:19.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:19 smithi033 ceph-mon[31246]: pgmap v359: 129 pgs: 129 active+clean; 649 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-12T12:26:21.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:21 smithi043 ceph-mon[34144]: pgmap v360: 129 pgs: 129 active+clean; 655 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-12T12:26:21.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:21 smithi102 ceph-mon[34799]: pgmap v360: 129 pgs: 129 active+clean; 655 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-12T12:26:21.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:21 smithi033 ceph-mon[31246]: pgmap v360: 129 pgs: 129 active+clean; 655 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-12T12:26:23.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:23 smithi043 ceph-mon[34144]: pgmap v361: 129 pgs: 129 active+clean; 655 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-12T12:26:23.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:23 smithi102 ceph-mon[34799]: pgmap v361: 129 pgs: 129 active+clean; 655 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-12T12:26:23.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:23 smithi033 ceph-mon[31246]: pgmap v361: 129 pgs: 129 active+clean; 655 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-12T12:26:25.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:25 smithi043 ceph-mon[34144]: pgmap v362: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-12T12:26:25.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:25 smithi102 ceph-mon[34799]: pgmap v362: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-12T12:26:25.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:25 smithi033 ceph-mon[31246]: pgmap v362: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-12T12:26:27.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:27 smithi043 ceph-mon[34144]: pgmap v363: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-12T12:26:27.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:27 smithi102 ceph-mon[34799]: pgmap v363: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-12T12:26:27.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:27 smithi033 ceph-mon[31246]: pgmap v363: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-12T12:26:28.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:28 smithi043 ceph-mon[34144]: scrub summary: idle 2024-09-12T12:26:28.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:28 smithi102 ceph-mon[34799]: scrub summary: idle 2024-09-12T12:26:28.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:28 smithi033 ceph-mon[31246]: scrub summary: idle 2024-09-12T12:26:29.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:29 smithi043 ceph-mon[34144]: pgmap v364: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-12T12:26:29.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:29 smithi102 ceph-mon[34799]: pgmap v364: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-12T12:26:29.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:29 smithi033 ceph-mon[31246]: pgmap v364: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-12T12:26:31.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:31 smithi043 ceph-mon[34144]: pgmap v365: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-12T12:26:31.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:31 smithi102 ceph-mon[34799]: pgmap v365: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-12T12:26:31.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:31 smithi033 ceph-mon[31246]: pgmap v365: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-12T12:26:33.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:33 smithi043 ceph-mon[34144]: pgmap v366: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-12T12:26:33.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:33 smithi102 ceph-mon[34799]: pgmap v366: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-12T12:26:33.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:33 smithi033 ceph-mon[31246]: pgmap v366: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-12T12:26:35.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:35 smithi043 ceph-mon[34144]: pgmap v367: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-12T12:26:35.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:35 smithi102 ceph-mon[34799]: pgmap v367: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-12T12:26:35.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:35 smithi033 ceph-mon[31246]: pgmap v367: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-12T12:26:37.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:37 smithi043 ceph-mon[34144]: pgmap v368: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T12:26:37.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:37 smithi102 ceph-mon[34799]: pgmap v368: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T12:26:37.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:37 smithi033 ceph-mon[31246]: pgmap v368: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T12:26:39.293 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:39 smithi033 ceph-mon[31246]: pgmap v369: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-12T12:26:39.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:39 smithi043 ceph-mon[34144]: pgmap v369: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-12T12:26:39.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:39 smithi102 ceph-mon[34799]: pgmap v369: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-12T12:26:41.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:41 smithi043 ceph-mon[34144]: pgmap v370: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T12:26:41.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:41 smithi102 ceph-mon[34799]: pgmap v370: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T12:26:41.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:41 smithi033 ceph-mon[31246]: pgmap v370: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T12:26:43.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:43 smithi043 ceph-mon[34144]: pgmap v371: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T12:26:43.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:43 smithi102 ceph-mon[34799]: pgmap v371: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T12:26:43.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:43 smithi033 ceph-mon[31246]: pgmap v371: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T12:26:45.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:45 smithi043 ceph-mon[34144]: pgmap v372: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-12T12:26:45.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:45 smithi102 ceph-mon[34799]: pgmap v372: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-12T12:26:45.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:45 smithi033 ceph-mon[31246]: pgmap v372: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-12T12:26:47.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:47 smithi043 ceph-mon[34144]: pgmap v373: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T12:26:47.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:47 smithi102 ceph-mon[34799]: pgmap v373: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T12:26:47.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:47 smithi033 ceph-mon[31246]: pgmap v373: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T12:26:48.026 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T12:26:48.320 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:26:48.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.845+0000 7fdc13bb6640 1 -- 172.21.15.33:0/3903791153 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc0c102570 msgr2=0x7fdc0c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:48.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.845+0000 7fdc13bb6640 1 --2- 172.21.15.33:0/3903791153 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc0c102570 0x7fdc0c1029b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fdc00009900 tx=0x7fdc0002a480 comp rx=0 tx=0).stop 2024-09-12T12:26:48.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.845+0000 7fdc13bb6640 1 -- 172.21.15.33:0/3903791153 shutdown_connections 2024-09-12T12:26:48.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.845+0000 7fdc13bb6640 1 --2- 172.21.15.33:0/3903791153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdc0c102ef0 0x7fdc0c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.845+0000 7fdc13bb6640 1 --2- 172.21.15.33:0/3903791153 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc0c102570 0x7fdc0c1029b0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.845+0000 7fdc13bb6640 1 --2- 172.21.15.33:0/3903791153 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc0c100e20 0x7fdc0c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.845+0000 7fdc13bb6640 1 -- 172.21.15.33:0/3903791153 >> 172.21.15.33:0/3903791153 conn(0x7fdc0c0fc7d0 msgr2=0x7fdc0c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:48.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.845+0000 7fdc13bb6640 1 -- 172.21.15.33:0/3903791153 shutdown_connections 2024-09-12T12:26:48.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.845+0000 7fdc13bb6640 1 -- 172.21.15.33:0/3903791153 wait complete. 2024-09-12T12:26:48.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.846+0000 7fdc13bb6640 1 Processor -- start 2024-09-12T12:26:48.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.846+0000 7fdc13bb6640 1 -- start start 2024-09-12T12:26:48.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.847+0000 7fdc13bb6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdc0c100e20 0x7fdc0c1131e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:48.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.847+0000 7fdc13bb6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc0c102570 0x7fdc0c1115b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:48.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.847+0000 7fdc13bb6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc0c102ef0 0x7fdc0c111c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:48.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.847+0000 7fdc13bb6640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0c110e30 con 0x7fdc0c102ef0 2024-09-12T12:26:48.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.847+0000 7fdc13bb6640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0c110cb0 con 0x7fdc0c100e20 2024-09-12T12:26:48.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.847+0000 7fdc13bb6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0c110fb0 con 0x7fdc0c102570 2024-09-12T12:26:48.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.847+0000 7fdc12153640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc0c102ef0 0x7fdc0c111c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:48.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.847+0000 7fdc12153640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc0c102ef0 0x7fdc0c111c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60860/0 (socket says 172.21.15.33:60860) 2024-09-12T12:26:48.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.847+0000 7fdc12153640 1 -- 172.21.15.33:0/3983582379 learned_addr learned my addr 172.21.15.33:0/3983582379 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:48.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.847+0000 7fdc11151640 1 --2- 172.21.15.33:0/3983582379 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc0c102570 0x7fdc0c1115b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:48.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.847+0000 7fdc11952640 1 --2- 172.21.15.33:0/3983582379 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdc0c100e20 0x7fdc0c1131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:48.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.847+0000 7fdc12153640 1 -- 172.21.15.33:0/3983582379 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc0c102570 msgr2=0x7fdc0c1115b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:48.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.847+0000 7fdc12153640 1 --2- 172.21.15.33:0/3983582379 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc0c102570 0x7fdc0c1115b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.847+0000 7fdc12153640 1 -- 172.21.15.33:0/3983582379 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdc0c100e20 msgr2=0x7fdc0c1131e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:48.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.847+0000 7fdc12153640 1 --2- 172.21.15.33:0/3983582379 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdc0c100e20 0x7fdc0c1131e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.847+0000 7fdc12153640 1 -- 172.21.15.33:0/3983582379 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc0c1a6950 con 0x7fdc0c102ef0 2024-09-12T12:26:48.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.847+0000 7fdc12153640 1 --2- 172.21.15.33:0/3983582379 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc0c102ef0 0x7fdc0c111c60 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fdc0400d750 tx=0x7fdc0400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:48.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.848+0000 7fdc0affd640 1 -- 172.21.15.33:0/3983582379 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc04017070 con 0x7fdc0c102ef0 2024-09-12T12:26:48.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.848+0000 7fdc13bb6640 1 -- 172.21.15.33:0/3983582379 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc0c1a6be0 con 0x7fdc0c102ef0 2024-09-12T12:26:48.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.848+0000 7fdc13bb6640 1 -- 172.21.15.33:0/3983582379 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc0c1a7140 con 0x7fdc0c102ef0 2024-09-12T12:26:48.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.848+0000 7fdc0affd640 1 -- 172.21.15.33:0/3983582379 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdc040054d0 con 0x7fdc0c102ef0 2024-09-12T12:26:48.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.848+0000 7fdc0affd640 1 -- 172.21.15.33:0/3983582379 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc04020060 con 0x7fdc0c102ef0 2024-09-12T12:26:48.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.851+0000 7fdc15f8f740 1 Processor -- start 2024-09-12T12:26:48.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.851+0000 7fdc0affd640 1 -- 172.21.15.33:0/3983582379 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fdc04009bd0 con 0x7fdc0c102ef0 2024-09-12T12:26:48.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.852+0000 7fdc15f8f740 1 -- start start 2024-09-12T12:26:48.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.852+0000 7fdc15f8f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d699ae3c0 0x562d699ae7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:48.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.852+0000 7fdc15f8f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562d699aece0 0x562d699c1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:48.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.852+0000 7fdc15f8f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562d699c1e90 0x562d699c4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:48.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.852+0000 7fdc15f8f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x562d699142e0 con 0x562d699aece0 2024-09-12T12:26:48.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.852+0000 7fdc15f8f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x562d698bbce0 con 0x562d699ae3c0 2024-09-12T12:26:48.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.852+0000 7fdc15f8f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x562d699102a0 con 0x562d699c1e90 2024-09-12T12:26:48.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.852+0000 7fdc11952640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562d699aece0 0x562d699c1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:48.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.852+0000 7fdc11952640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562d699aece0 0x562d699c1950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60868/0 (socket says 172.21.15.33:60868) 2024-09-12T12:26:48.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.852+0000 7fdc11952640 1 -- 172.21.15.33:0/3368706366 learned_addr learned my addr 172.21.15.33:0/3368706366 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:48.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.852+0000 7fdc11151640 1 --2- 172.21.15.33:0/3368706366 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d699ae3c0 0x562d699ae7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:48.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.853+0000 7fdc11952640 1 -- 172.21.15.33:0/3368706366 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562d699c1e90 msgr2=0x562d699c4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:48.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.853+0000 7fdc11952640 1 --2- 172.21.15.33:0/3368706366 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562d699c1e90 0x562d699c4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.853+0000 7fdc11952640 1 -- 172.21.15.33:0/3368706366 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d699ae3c0 msgr2=0x562d699ae7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:48.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.853+0000 7fdc11952640 1 --2- 172.21.15.33:0/3368706366 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d699ae3c0 0x562d699ae7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.853+0000 7fdc11952640 1 -- 172.21.15.33:0/3368706366 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d698a0440 con 0x562d699aece0 2024-09-12T12:26:48.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.853+0000 7fdc11952640 1 --2- 172.21.15.33:0/3368706366 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562d699aece0 0x562d699c1950 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc003a20 tx=0x7fdbfc003ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b605d50d99c1c35 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:48.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.853+0000 7fdc0affd640 1 --2- 172.21.15.33:0/3983582379 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fdbf40a2c80 0x7fdbf40a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:48.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.853+0000 7fdbf3fff640 1 -- 172.21.15.33:0/3368706366 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc004860 con 0x562d699aece0 2024-09-12T12:26:48.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.853+0000 7fdbf3fff640 1 -- 172.21.15.33:0/3368706366 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdbfc015030 con 0x562d699aece0 2024-09-12T12:26:48.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.853+0000 7fdbf3fff640 1 -- 172.21.15.33:0/3368706366 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc010990 con 0x562d699aece0 2024-09-12T12:26:48.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.853+0000 7fdc11151640 1 --2- 172.21.15.33:0/3983582379 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fdbf40a2c80 0x7fdbf40a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:48.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.853+0000 7fdc0affd640 1 -- 172.21.15.33:0/3983582379 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fdc040ceb40 con 0x7fdc0c102ef0 2024-09-12T12:26:48.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.854+0000 7fdc15f8f740 1 -- 172.21.15.33:0/3368706366 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562d699aece0 msgr2=0x562d699c1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:48.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.854+0000 7fdc15f8f740 1 --2- 172.21.15.33:0/3368706366 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562d699aece0 0x562d699c1950 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc003a20 tx=0x7fdbfc003ee0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.854+0000 7fdc15f8f740 1 -- 172.21.15.33:0/3368706366 shutdown_connections 2024-09-12T12:26:48.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.854+0000 7fdc15f8f740 1 --2- 172.21.15.33:0/3368706366 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562d699c1e90 0x562d699c4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.854+0000 7fdc15f8f740 1 --2- 172.21.15.33:0/3368706366 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562d699aece0 0x562d699c1950 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.854+0000 7fdc15f8f740 1 --2- 172.21.15.33:0/3368706366 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d699ae3c0 0x562d699ae7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.854+0000 7fdc15f8f740 1 -- 172.21.15.33:0/3368706366 >> 172.21.15.33:0/3368706366 conn(0x562d699aaa30 msgr2=0x562d699aae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:48.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.854+0000 7fdc11151640 1 --2- 172.21.15.33:0/3983582379 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fdbf40a2c80 0x7fdbf40a5140 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c0fec10 tx=0x7fdc00000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:48.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.854+0000 7fdc15f8f740 1 -- 172.21.15.33:0/3368706366 shutdown_connections 2024-09-12T12:26:48.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.855+0000 7fdc15f8f740 1 -- 172.21.15.33:0/3368706366 wait complete. 2024-09-12T12:26:48.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.855+0000 7fdc15f8f740 1 -- start start 2024-09-12T12:26:48.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.855+0000 7fdc15f8f740 1 Processor -- start 2024-09-12T12:26:48.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.856+0000 7fdc15f8f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562d699ae3c0 0x562d699c1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:48.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.856+0000 7fdc15f8f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562d699aece0 0x562d699bea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:48.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.856+0000 7fdc15f8f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d699c1e90 0x562d699bef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:48.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.856+0000 7fdc15f8f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x562d699c4a00 con 0x562d699ae3c0 2024-09-12T12:26:48.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.856+0000 7fdc15f8f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x562d698cf050 con 0x562d699c1e90 2024-09-12T12:26:48.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.856+0000 7fdc15f8f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x562d699c4b80 con 0x562d699aece0 2024-09-12T12:26:48.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.856+0000 7fdc11151640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562d699aece0 0x562d699bea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:48.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.856+0000 7fdc11151640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562d699aece0 0x562d699bea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:39330/0 (socket says 172.21.15.33:39330) 2024-09-12T12:26:48.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.856+0000 7fdc11151640 1 -- 172.21.15.33:0/4235276646 learned_addr learned my addr 172.21.15.33:0/4235276646 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:48.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.856+0000 7fdc12153640 1 --2- 172.21.15.33:0/4235276646 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d699c1e90 0x562d699bef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:48.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.856+0000 7fdc15f8f740 10 client.0 _ll_register_callbacks cb 0x562d6990f160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:26:48.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.856+0000 7fdc11952640 1 --2- 172.21.15.33:0/4235276646 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562d699ae3c0 0x562d699c1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:48.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.856+0000 7fdc12153640 1 -- 172.21.15.33:0/4235276646 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562d699aece0 msgr2=0x562d699bea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:48.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.857+0000 7fdc12153640 1 --2- 172.21.15.33:0/4235276646 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562d699aece0 0x562d699bea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.857+0000 7fdc12153640 1 -- 172.21.15.33:0/4235276646 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562d699ae3c0 msgr2=0x562d699c1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:48.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.857+0000 7fdc12153640 1 --2- 172.21.15.33:0/4235276646 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562d699ae3c0 0x562d699c1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.857+0000 7fdc12153640 1 -- 172.21.15.33:0/4235276646 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d696853c0 con 0x562d699c1e90 2024-09-12T12:26:48.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.857+0000 7fdc11952640 1 --2- 172.21.15.33:0/4235276646 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562d699ae3c0 0x562d699c1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:26:48.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.857+0000 7fdc11151640 1 --2- 172.21.15.33:0/4235276646 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562d699aece0 0x562d699bea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:48.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.857+0000 7fdc12153640 1 --2- 172.21.15.33:0/4235276646 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d699c1e90 0x562d699bef60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdc040cc250 tx=0x7fdc0409aab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e413a931fd473a8a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:48.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.857+0000 7fdbf17fa640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:26:48.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.857+0000 7fdbf17fa640 1 -- 172.21.15.33:0/4235276646 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc0409f360 con 0x562d699c1e90 2024-09-12T12:26:48.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.857+0000 7fdbf17fa640 1 -- 172.21.15.33:0/4235276646 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fdc040a3790 con 0x562d699c1e90 2024-09-12T12:26:48.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.857+0000 7fdc15f8f740 1 -- 172.21.15.33:0/4235276646 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbfc015030 con 0x562d699c1e90 2024-09-12T12:26:48.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.857+0000 7fdbf17fa640 1 -- 172.21.15.33:0/4235276646 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fdc040a3c20 con 0x562d699c1e90 2024-09-12T12:26:48.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.857+0000 7fdc15f8f740 10 client.24992 fetch_fsmap learned FSMap version 25 2024-09-12T12:26:48.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.857+0000 7fdc15f8f740 1 -- 172.21.15.33:0/4235276646 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562d699d0420 con 0x562d699c1e90 2024-09-12T12:26:48.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.858+0000 7fdbf17fa640 1 -- 172.21.15.33:0/4235276646 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdbfc015030 con 0x562d699c1e90 2024-09-12T12:26:48.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.858+0000 7fdbf17fa640 1 -- 172.21.15.33:0/4235276646 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fdc04099f20 con 0x562d699c1e90 2024-09-12T12:26:48.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.858+0000 7fdc15f8f740 10 client.24992 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T12:26:48.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.859+0000 7fdc15f8f740 10 client.24992 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:26:48.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.859+0000 7fdc15f8f740 20 client.24992 populate_metadata read hostname 'smithi033' 2024-09-12T12:26:48.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.859+0000 7fdc15f8f740 1 --2- 172.21.15.33:0/4235276646 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x562d699d1a00 0x562d699d3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:48.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.859+0000 7fdc15f8f740 4 client.24992 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:26:48.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.859+0000 7fdc15f8f740 1 -- 172.21.15.33:0/4235276646 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d69921850 con 0x562d699d1a00 2024-09-12T12:26:48.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.859+0000 7fdc11952640 1 --2- 172.21.15.33:0/4235276646 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x562d699d1a00 0x562d699d3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:48.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.860+0000 7fdbf17fa640 10 client.24992 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:26:48.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.860+0000 7fdc11952640 1 --2- 172.21.15.33:0/4235276646 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x562d699d1a00 0x562d699d3e80 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59c6b6d523017ce7 server_cookie=5fb8f10eced1c41f in_seq=0 out_seq=0 2024-09-12T12:26:48.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.860+0000 7fdbf17fa640 1 -- 172.21.15.33:0/4235276646 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562d69921850 con 0x562d699d1a00 2024-09-12T12:26:48.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.860+0000 7fdbf17fa640 10 client.24992 handle_command_reply: tid=0 2024-09-12T12:26:48.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.860+0000 7fdc15f8f740 1 client.24992 shutdown 2024-09-12T12:26:48.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.861+0000 7fdc15f8f740 1 -- 172.21.15.33:0/4235276646 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d699c1e90 msgr2=0x562d699bef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:48.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.861+0000 7fdc15f8f740 1 --2- 172.21.15.33:0/4235276646 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d699c1e90 0x562d699bef60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdc040cc250 tx=0x7fdc0409aab0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.861+0000 7fdc15f8f740 1 -- 172.21.15.33:0/4235276646 shutdown_connections 2024-09-12T12:26:48.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.861+0000 7fdc15f8f740 1 --2- 172.21.15.33:0/4235276646 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x562d699d1a00 0x562d699d3e80 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.861+0000 7fdc15f8f740 1 --2- 172.21.15.33:0/4235276646 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d699c1e90 0x562d699bef60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.861+0000 7fdbf17fa640 0 client.24992 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:26:48.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.861+0000 7fdc15f8f740 1 --2- 172.21.15.33:0/4235276646 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562d699aece0 0x562d699bea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.861+0000 7fdc15f8f740 1 --2- 172.21.15.33:0/4235276646 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562d699ae3c0 0x562d699c1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.861+0000 7fdc15f8f740 1 -- 172.21.15.33:0/4235276646 >> 172.21.15.33:0/4235276646 conn(0x562d699aaa30 msgr2=0x562d699b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:48.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.861+0000 7fdc15f8f740 1 -- 172.21.15.33:0/4235276646 shutdown_connections 2024-09-12T12:26:48.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.861+0000 7fdc15f8f740 1 -- 172.21.15.33:0/4235276646 wait complete. 2024-09-12T12:26:48.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.861+0000 7fdc15f8f740 20 client.24992 trim_cache size 0 max 16384 2024-09-12T12:26:48.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.879+0000 7fdc15f8f740 1 Processor -- start 2024-09-12T12:26:48.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.879+0000 7fdc15f8f740 1 -- start start 2024-09-12T12:26:48.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.879+0000 7fdc15f8f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562d699ae3c0 0x562d699cdd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:48.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.879+0000 7fdc15f8f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562d699aece0 0x562d699d9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:48.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.879+0000 7fdc15f8f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d699c1e90 0x562d699d9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:48.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.879+0000 7fdc15f8f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf8012370 con 0x562d699aece0 2024-09-12T12:26:48.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.879+0000 7fdc15f8f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf800fc40 con 0x562d699c1e90 2024-09-12T12:26:48.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.879+0000 7fdc15f8f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf800da90 con 0x562d699ae3c0 2024-09-12T12:26:48.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.880+0000 7fdc11151640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562d699aece0 0x562d699d9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:48.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.880+0000 7fdc11151640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562d699aece0 0x562d699d9790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60890/0 (socket says 172.21.15.33:60890) 2024-09-12T12:26:48.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.880+0000 7fdc11151640 1 -- 172.21.15.33:0/803741166 learned_addr learned my addr 172.21.15.33:0/803741166 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:48.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.880+0000 7fdc11952640 1 --2- 172.21.15.33:0/803741166 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562d699ae3c0 0x562d699cdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:48.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.880+0000 7fdc12153640 1 --2- 172.21.15.33:0/803741166 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d699c1e90 0x562d699d9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:48.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.880+0000 7fdc11151640 1 -- 172.21.15.33:0/803741166 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562d699ae3c0 msgr2=0x562d699cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:48.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.880+0000 7fdc11151640 1 --2- 172.21.15.33:0/803741166 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562d699ae3c0 0x562d699cdd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.880+0000 7fdc11151640 1 -- 172.21.15.33:0/803741166 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d699c1e90 msgr2=0x562d699d9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:48.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.880+0000 7fdc11151640 1 --2- 172.21.15.33:0/803741166 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d699c1e90 0x562d699d9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.880+0000 7fdc11151640 1 -- 172.21.15.33:0/803741166 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d699aa840 con 0x562d699aece0 2024-09-12T12:26:48.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.880+0000 7fdc11151640 1 --2- 172.21.15.33:0/803741166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562d699aece0 0x562d699d9790 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fdc00006010 tx=0x7fdc0003e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=422bffeba4aec70c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:48.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.881+0000 7fdbf37fe640 1 -- 172.21.15.33:0/803741166 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc00004240 con 0x562d699aece0 2024-09-12T12:26:48.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.881+0000 7fdbf37fe640 1 -- 172.21.15.33:0/803741166 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdc0004e030 con 0x562d699aece0 2024-09-12T12:26:48.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.881+0000 7fdbf37fe640 1 -- 172.21.15.33:0/803741166 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc00004bc0 con 0x562d699aece0 2024-09-12T12:26:48.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.881+0000 7fdc15f8f740 1 -- 172.21.15.33:0/803741166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562d699aece0 msgr2=0x562d699d9790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:48.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.881+0000 7fdc15f8f740 1 --2- 172.21.15.33:0/803741166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562d699aece0 0x562d699d9790 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fdc00006010 tx=0x7fdc0003e000 comp rx=0 tx=0).stop 2024-09-12T12:26:48.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.882+0000 7fdc15f8f740 1 -- 172.21.15.33:0/803741166 shutdown_connections 2024-09-12T12:26:48.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.882+0000 7fdc15f8f740 1 --2- 172.21.15.33:0/803741166 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d699c1e90 0x562d699d9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.882+0000 7fdc15f8f740 1 --2- 172.21.15.33:0/803741166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562d699aece0 0x562d699d9790 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.882+0000 7fdc15f8f740 1 --2- 172.21.15.33:0/803741166 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562d699ae3c0 0x562d699cdd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.882+0000 7fdc15f8f740 1 -- 172.21.15.33:0/803741166 >> 172.21.15.33:0/803741166 conn(0x562d699aaa30 msgr2=0x562d699bd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:48.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.882+0000 7fdc15f8f740 1 -- 172.21.15.33:0/803741166 shutdown_connections 2024-09-12T12:26:48.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.882+0000 7fdc15f8f740 1 -- 172.21.15.33:0/803741166 wait complete. 2024-09-12T12:26:48.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.882+0000 7fdc15f8f740 1 -- start start 2024-09-12T12:26:48.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.883+0000 7fdc15f8f740 1 Processor -- start 2024-09-12T12:26:48.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.883+0000 7fdc15f8f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d699ae3c0 0x562d699ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:48.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.883+0000 7fdc15f8f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562d699aece0 0x562d699c57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:48.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.883+0000 7fdc15f8f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562d699c1e90 0x562d699c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:48.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.884+0000 7fdc11952640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d699ae3c0 0x562d699ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:48.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.884+0000 7fdc11952640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d699ae3c0 0x562d699ca470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:45256/0 (socket says 172.21.15.33:45256) 2024-09-12T12:26:48.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.884+0000 7fdc11151640 1 --2- 172.21.15.33:0/3604082358 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562d699aece0 0x562d699c57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:48.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.884+0000 7fdc11952640 1 -- 172.21.15.33:0/3604082358 learned_addr learned my addr 172.21.15.33:0/3604082358 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:48.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.884+0000 7fdc15f8f740 1 -- 172.21.15.33:0/3604082358 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf800e100 con 0x562d699c1e90 2024-09-12T12:26:48.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.884+0000 7fdc15f8f740 1 -- 172.21.15.33:0/3604082358 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf800f570 con 0x562d699ae3c0 2024-09-12T12:26:48.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.884+0000 7fdc15f8f740 1 -- 172.21.15.33:0/3604082358 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf800e7d0 con 0x562d699aece0 2024-09-12T12:26:48.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.884+0000 7fdc15f8f740 10 client.0 _ll_register_callbacks cb 0x7fdc0400de60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:26:48.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.884+0000 7fdc11952640 1 -- 172.21.15.33:0/3604082358 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562d699aece0 msgr2=0x562d699c57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:48.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.884+0000 7fdc11952640 1 --2- 172.21.15.33:0/3604082358 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562d699aece0 0x562d699c57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.884+0000 7fdc11952640 1 -- 172.21.15.33:0/3604082358 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562d699c1e90 msgr2=0x562d699c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:48.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.884+0000 7fdc11952640 1 --2- 172.21.15.33:0/3604082358 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562d699c1e90 0x562d699c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.884+0000 7fdc11952640 1 -- 172.21.15.33:0/3604082358 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d699c6380 con 0x562d699ae3c0 2024-09-12T12:26:48.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.884+0000 7fdc11952640 1 --2- 172.21.15.33:0/3604082358 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d699ae3c0 0x562d699ca470 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc000f80 tx=0x7fdbfc0094b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b1dfe23cfb85049 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:48.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.885+0000 7fdbf17fa640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:26:48.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.885+0000 7fdbf17fa640 1 -- 172.21.15.33:0/3604082358 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc0108a0 con 0x562d699ae3c0 2024-09-12T12:26:48.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.885+0000 7fdbf17fa640 1 -- 172.21.15.33:0/3604082358 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fdbfc010a40 con 0x562d699ae3c0 2024-09-12T12:26:48.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.885+0000 7fdc15f8f740 1 -- 172.21.15.33:0/3604082358 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc0004e030 con 0x562d699ae3c0 2024-09-12T12:26:48.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.885+0000 7fdbf17fa640 1 -- 172.21.15.33:0/3604082358 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fdbfc010c40 con 0x562d699ae3c0 2024-09-12T12:26:48.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.885+0000 7fdc15f8f740 10 client.24995 fetch_fsmap learned FSMap version 25 2024-09-12T12:26:48.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.885+0000 7fdc15f8f740 1 -- 172.21.15.33:0/3604082358 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562d69a3c5a0 con 0x562d699ae3c0 2024-09-12T12:26:48.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.886+0000 7fdbf17fa640 1 -- 172.21.15.33:0/3604082358 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdc0004e030 con 0x562d699ae3c0 2024-09-12T12:26:48.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.886+0000 7fdbf17fa640 1 -- 172.21.15.33:0/3604082358 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fdbfc026480 con 0x562d699ae3c0 2024-09-12T12:26:48.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.886+0000 7fdc15f8f740 10 client.24995 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T12:26:48.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.886+0000 7fdc15f8f740 10 client.24995 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:26:48.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.886+0000 7fdc15f8f740 20 client.24995 populate_metadata read hostname 'smithi033' 2024-09-12T12:26:48.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.886+0000 7fdc15f8f740 1 --2- 172.21.15.33:0/3604082358 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x562d699d1a00 0x562d69a3eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:48.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.886+0000 7fdc15f8f740 4 client.24995 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:26:48.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.886+0000 7fdc15f8f740 1 -- 172.21.15.33:0/3604082358 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562d6991bd60 con 0x562d699d1a00 2024-09-12T12:26:48.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.886+0000 7fdc11151640 1 --2- 172.21.15.33:0/3604082358 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x562d699d1a00 0x562d69a3eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:48.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.887+0000 7fdc11151640 1 --2- 172.21.15.33:0/3604082358 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x562d699d1a00 0x562d69a3eb00 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=325e5bb0d832cb21 server_cookie=a136d3dca845c5cb in_seq=0 out_seq=0 2024-09-12T12:26:48.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.887+0000 7fdbf17fa640 10 client.24995 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:26:48.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.887+0000 7fdbf17fa640 1 -- 172.21.15.33:0/3604082358 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x562d6991bd60 con 0x562d699d1a00 2024-09-12T12:26:48.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.887+0000 7fdbf17fa640 10 client.24995 handle_command_reply: tid=0 2024-09-12T12:26:48.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.887+0000 7fdc15f8f740 1 client.24995 shutdown 2024-09-12T12:26:48.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.887+0000 7fdc15f8f740 1 -- 172.21.15.33:0/3604082358 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d699ae3c0 msgr2=0x562d699ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:48.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.887+0000 7fdc15f8f740 1 --2- 172.21.15.33:0/3604082358 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d699ae3c0 0x562d699ca470 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc000f80 tx=0x7fdbfc0094b0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.887+0000 7fdc15f8f740 1 -- 172.21.15.33:0/3604082358 shutdown_connections 2024-09-12T12:26:48.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.887+0000 7fdc15f8f740 1 --2- 172.21.15.33:0/3604082358 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x562d699d1a00 0x562d69a3eb00 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.887+0000 7fdbf17fa640 0 client.24995 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:26:48.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.887+0000 7fdc15f8f740 1 --2- 172.21.15.33:0/3604082358 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562d699c1e90 0x562d699c5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.887+0000 7fdc15f8f740 1 --2- 172.21.15.33:0/3604082358 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562d699aece0 0x562d699c57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.887+0000 7fdc15f8f740 1 --2- 172.21.15.33:0/3604082358 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d699ae3c0 0x562d699ca470 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.887+0000 7fdc15f8f740 1 -- 172.21.15.33:0/3604082358 >> 172.21.15.33:0/3604082358 conn(0x562d699aaa30 msgr2=0x562d699c0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:48.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.888+0000 7fdc15f8f740 1 -- 172.21.15.33:0/3604082358 shutdown_connections 2024-09-12T12:26:48.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.888+0000 7fdc15f8f740 1 -- 172.21.15.33:0/3604082358 wait complete. 2024-09-12T12:26:48.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.888+0000 7fdc15f8f740 20 client.24995 trim_cache size 0 max 16384 2024-09-12T12:26:48.890 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:26:48.891 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "no active scrubs running", 2024-09-12T12:26:48.891 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": {} 2024-09-12T12:26:48.891 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:26:48.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.888+0000 7fdc13bb6640 1 -- 172.21.15.33:0/3983582379 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fdbf40a2c80 msgr2=0x7fdbf40a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:48.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.888+0000 7fdc13bb6640 1 --2- 172.21.15.33:0/3983582379 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fdbf40a2c80 0x7fdbf40a5140 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c0fec10 tx=0x7fdc00000bc0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.888+0000 7fdc13bb6640 1 -- 172.21.15.33:0/3983582379 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc0c102ef0 msgr2=0x7fdc0c111c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:48.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.888+0000 7fdc13bb6640 1 --2- 172.21.15.33:0/3983582379 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc0c102ef0 0x7fdc0c111c60 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fdc0400d750 tx=0x7fdc0400dc10 comp rx=0 tx=0).stop 2024-09-12T12:26:48.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.888+0000 7fdc13bb6640 1 -- 172.21.15.33:0/3983582379 shutdown_connections 2024-09-12T12:26:48.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.888+0000 7fdc13bb6640 1 --2- 172.21.15.33:0/3983582379 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fdbf40a2c80 0x7fdbf40a5140 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.888+0000 7fdc13bb6640 1 --2- 172.21.15.33:0/3983582379 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc0c102ef0 0x7fdc0c111c60 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.888+0000 7fdc13bb6640 1 --2- 172.21.15.33:0/3983582379 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc0c102570 0x7fdc0c1115b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.888+0000 7fdc13bb6640 1 --2- 172.21.15.33:0/3983582379 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdc0c100e20 0x7fdc0c1131e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.888+0000 7fdc13bb6640 1 -- 172.21.15.33:0/3983582379 >> 172.21.15.33:0/3983582379 conn(0x7fdc0c0fc7d0 msgr2=0x7fdc0c103a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:48.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.889+0000 7fdc13bb6640 1 -- 172.21.15.33:0/3983582379 shutdown_connections 2024-09-12T12:26:48.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:48.889+0000 7fdc13bb6640 1 -- 172.21.15.33:0/3983582379 wait complete. 2024-09-12T12:26:49.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:49 smithi043 ceph-mon[34144]: pgmap v374: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-12T12:26:49.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:49 smithi102 ceph-mon[34799]: pgmap v374: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-12T12:26:49.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:49 smithi033 ceph-mon[31246]: pgmap v374: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-12T12:26:49.710 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T12:26:49.710 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:26:50.050 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:26:50.330 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:50 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:26:50.330 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:50 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:26:50.330 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:50 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:26:50.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:50 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:26:50.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:50 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:26:50.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:50 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:26:50.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:50 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:26:50.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:50 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:26:50.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:50 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:26:50.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.555+0000 7f19b88a4640 1 -- 172.21.15.33:0/598379134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19b4100e20 msgr2=0x7f19b4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:50.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.555+0000 7f19b88a4640 1 --2- 172.21.15.33:0/598379134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19b4100e20 0x7f19b4101200 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f19a4009930 tx=0x7f19a402a4d0 comp rx=0 tx=0).stop 2024-09-12T12:26:50.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.555+0000 7f19b88a4640 1 -- 172.21.15.33:0/598379134 shutdown_connections 2024-09-12T12:26:50.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.555+0000 7f19b88a4640 1 --2- 172.21.15.33:0/598379134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19b4102ef0 0x7f19b410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:50.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.555+0000 7f19b88a4640 1 --2- 172.21.15.33:0/598379134 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19b4102570 0x7f19b41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:50.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.555+0000 7f19b88a4640 1 --2- 172.21.15.33:0/598379134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19b4100e20 0x7f19b4101200 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:50.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.555+0000 7f19b88a4640 1 -- 172.21.15.33:0/598379134 >> 172.21.15.33:0/598379134 conn(0x7f19b40fc7d0 msgr2=0x7f19b40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:50.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.555+0000 7f19b88a4640 1 -- 172.21.15.33:0/598379134 shutdown_connections 2024-09-12T12:26:50.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.555+0000 7f19b88a4640 1 -- 172.21.15.33:0/598379134 wait complete. 2024-09-12T12:26:50.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.556+0000 7f19b88a4640 1 Processor -- start 2024-09-12T12:26:50.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.556+0000 7f19b88a4640 1 -- start start 2024-09-12T12:26:50.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.557+0000 7f19b88a4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19b4100e20 0x7f19b4196270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:50.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.557+0000 7f19b88a4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19b4102570 0x7f19b41967b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:50.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.557+0000 7f19b88a4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19b4102ef0 0x7f19b419ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:50.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.557+0000 7f19b88a4640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f19b410fd30 con 0x7f19b4102ef0 2024-09-12T12:26:50.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.557+0000 7f19b88a4640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f19b410fbb0 con 0x7f19b4100e20 2024-09-12T12:26:50.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.557+0000 7f19b88a4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f19b410feb0 con 0x7f19b4102570 2024-09-12T12:26:50.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.557+0000 7f19b2d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19b4102ef0 0x7f19b419ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:50.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.557+0000 7f19b2d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19b4102ef0 0x7f19b419ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42382/0 (socket says 172.21.15.33:42382) 2024-09-12T12:26:50.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.557+0000 7f19b2d9d640 1 -- 172.21.15.33:0/3404297691 learned_addr learned my addr 172.21.15.33:0/3404297691 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:50.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.557+0000 7f19b259c640 1 --2- 172.21.15.33:0/3404297691 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19b4100e20 0x7f19b4196270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:50.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.557+0000 7f19b1d9b640 1 --2- 172.21.15.33:0/3404297691 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19b4102570 0x7f19b41967b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:50.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.557+0000 7f19b2d9d640 1 -- 172.21.15.33:0/3404297691 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19b4102570 msgr2=0x7f19b41967b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:50.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.557+0000 7f19b2d9d640 1 --2- 172.21.15.33:0/3404297691 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19b4102570 0x7f19b41967b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:50.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.557+0000 7f19b2d9d640 1 -- 172.21.15.33:0/3404297691 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19b4100e20 msgr2=0x7f19b4196270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:50.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.557+0000 7f19b2d9d640 1 --2- 172.21.15.33:0/3404297691 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19b4100e20 0x7f19b4196270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:50.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.557+0000 7f19b2d9d640 1 -- 172.21.15.33:0/3404297691 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19b419b220 con 0x7f19b4102ef0 2024-09-12T12:26:50.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.558+0000 7f19b2d9d640 1 --2- 172.21.15.33:0/3404297691 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19b4102ef0 0x7f19b419ab40 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f19ac00efd0 tx=0x7f19ac00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:50.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.558+0000 7f19a37fe640 1 -- 172.21.15.33:0/3404297691 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ac003b70 con 0x7f19b4102ef0 2024-09-12T12:26:50.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.558+0000 7f19a37fe640 1 -- 172.21.15.33:0/3404297691 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f19ac003d10 con 0x7f19b4102ef0 2024-09-12T12:26:50.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.558+0000 7f19a37fe640 1 -- 172.21.15.33:0/3404297691 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ac010980 con 0x7f19b4102ef0 2024-09-12T12:26:50.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.558+0000 7f19b88a4640 1 -- 172.21.15.33:0/3404297691 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19b419b510 con 0x7f19b4102ef0 2024-09-12T12:26:50.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.559+0000 7f19b88a4640 1 -- 172.21.15.33:0/3404297691 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19b41a2df0 con 0x7f19b4102ef0 2024-09-12T12:26:50.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.561+0000 7f19b88a4640 1 -- 172.21.15.33:0/3404297691 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19b4101200 con 0x7f19b4102ef0 2024-09-12T12:26:50.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.562+0000 7f19a37fe640 1 -- 172.21.15.33:0/3404297691 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f19ac004000 con 0x7f19b4102ef0 2024-09-12T12:26:50.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.563+0000 7f19a37fe640 1 --2- 172.21.15.33:0/3404297691 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f199c0a2c00 0x7f199c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:50.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.563+0000 7f19b259c640 1 --2- 172.21.15.33:0/3404297691 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f199c0a2c00 0x7f199c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:50.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.563+0000 7f19a37fe640 1 -- 172.21.15.33:0/3404297691 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f19ac099450 con 0x7f19b4102ef0 2024-09-12T12:26:50.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.564+0000 7f19b259c640 1 --2- 172.21.15.33:0/3404297691 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f199c0a2c00 0x7f199c0a50c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f19a40096c0 tx=0x7f19a4031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:50.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.571+0000 7f19a37fe640 1 -- 172.21.15.33:0/3404297691 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f19ac09bab0 con 0x7f19b4102ef0 2024-09-12T12:26:50.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.852+0000 7f19b88a4640 1 -- 172.21.15.33:0/3404297691 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f19b41975d0 con 0x7f19b4102ef0 2024-09-12T12:26:50.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.853+0000 7f19a37fe640 1 -- 172.21.15.33:0/3404297691 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11912 (secure 0 0 0) 0x7f19ac09b3b0 con 0x7f19b4102ef0 2024-09-12T12:26:50.853 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:26:50.854 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":25,"btime":"2024-09-12T12:26:06:963800+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3327066342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3327066342},{"type":"v1","addr":"172.21.15.33:6835","nonce":3327066342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/19516401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":19516401},{"type":"v1","addr":"172.21.15.33:6837","nonce":19516401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1260196118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1260196118},{"type":"v1","addr":"172.21.15.33:6839","nonce":1260196118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/4288248356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4288248356},{"type":"v1","addr":"172.21.15.33:6841","nonce":4288248356}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/3051073141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3051073141},{"type":"v1","addr":"172.21.15.43:6833","nonce":3051073141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3282762800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3282762800},{"type":"v1","addr":"172.21.15.43:6835","nonce":3282762800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:23:46.400609+0000","modified":"2024-09-12T12:26:06.067532+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24490,"mds_2":24478},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3051713000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3051713000},{"type":"v1","addr":"172.21.15.102:6833","nonce":3051713000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6837/2472064883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2472064883},{"type":"v1","addr":"172.21.15.43:6837","nonce":2472064883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/1987408860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":1987408860},{"type":"v1","addr":"172.21.15.43:6839","nonce":1987408860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/4179527539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":4179527539},{"type":"v1","addr":"172.21.15.102:6835","nonce":4179527539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/2409953270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2409953270},{"type":"v1","addr":"172.21.15.102:6837","nonce":2409953270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.102:6839/1553271340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":1553271340},{"type":"v1","addr":"172.21.15.102:6839","nonce":1553271340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24499,"qdb_cluster":[24499,24490,24478]},"id":1}]} 2024-09-12T12:26:50.854 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 25 2024-09-12T12:26:50.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.855+0000 7f19b88a4640 1 -- 172.21.15.33:0/3404297691 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f199c0a2c00 msgr2=0x7f199c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:50.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.855+0000 7f19b88a4640 1 --2- 172.21.15.33:0/3404297691 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f199c0a2c00 0x7f199c0a50c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f19a40096c0 tx=0x7f19a4031400 comp rx=0 tx=0).stop 2024-09-12T12:26:50.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.856+0000 7f19b88a4640 1 -- 172.21.15.33:0/3404297691 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19b4102ef0 msgr2=0x7f19b419ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:50.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.856+0000 7f19b88a4640 1 --2- 172.21.15.33:0/3404297691 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19b4102ef0 0x7f19b419ab40 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f19ac00efd0 tx=0x7f19ac00c6a0 comp rx=0 tx=0).stop 2024-09-12T12:26:50.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.856+0000 7f19b88a4640 1 -- 172.21.15.33:0/3404297691 shutdown_connections 2024-09-12T12:26:50.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.856+0000 7f19b88a4640 1 --2- 172.21.15.33:0/3404297691 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f199c0a2c00 0x7f199c0a50c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:50.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.856+0000 7f19b88a4640 1 --2- 172.21.15.33:0/3404297691 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19b4102ef0 0x7f19b419ab40 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:50.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.856+0000 7f19b88a4640 1 --2- 172.21.15.33:0/3404297691 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19b4102570 0x7f19b41967b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:50.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.856+0000 7f19b88a4640 1 --2- 172.21.15.33:0/3404297691 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19b4100e20 0x7f19b4196270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:50.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.856+0000 7f19b88a4640 1 -- 172.21.15.33:0/3404297691 >> 172.21.15.33:0/3404297691 conn(0x7f19b40fc7d0 msgr2=0x7f19b40fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:50.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.856+0000 7f19b88a4640 1 -- 172.21.15.33:0/3404297691 shutdown_connections 2024-09-12T12:26:50.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:50.856+0000 7f19b88a4640 1 -- 172.21.15.33:0/3404297691 wait complete. 2024-09-12T12:26:51.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:51 smithi033 ceph-mon[31246]: pgmap v375: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T12:26:51.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:51 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:26:51.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:51 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:26:51.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:51 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:26:51.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:51 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/3404297691' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:26:51.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:51 smithi043 ceph-mon[34144]: pgmap v375: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T12:26:51.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:51 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:26:51.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:51 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:26:51.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:51 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:26:51.366 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:51 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/3404297691' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:26:51.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:51 smithi102 ceph-mon[34799]: pgmap v375: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T12:26:51.397 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:51 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:26:51.397 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:51 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:26:51.397 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:51 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:26:51.397 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:51 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/3404297691' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:26:51.667 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T12:26:51.944 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:26:52.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.507+0000 7f6813a56640 1 -- 172.21.15.33:0/1856695264 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f680c103640 msgr2=0x7f680c10bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:52.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.508+0000 7f6813a56640 1 --2- 172.21.15.33:0/1856695264 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f680c103640 0x7f680c10bb30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f67fc009900 tx=0x7f67fc02a480 comp rx=0 tx=0).stop 2024-09-12T12:26:52.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.508+0000 7f6813a56640 1 -- 172.21.15.33:0/1856695264 shutdown_connections 2024-09-12T12:26:52.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.508+0000 7f6813a56640 1 --2- 172.21.15.33:0/1856695264 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f680c10c150 0x7f680c10e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.508+0000 7f6813a56640 1 --2- 172.21.15.33:0/1856695264 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f680c103640 0x7f680c10bb30 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.508+0000 7f6813a56640 1 --2- 172.21.15.33:0/1856695264 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f680c102d20 0x7f680c103100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.508+0000 7f6813a56640 1 -- 172.21.15.33:0/1856695264 >> 172.21.15.33:0/1856695264 conn(0x7f680c0fc780 msgr2=0x7f680c0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:52.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.508+0000 7f6813a56640 1 -- 172.21.15.33:0/1856695264 shutdown_connections 2024-09-12T12:26:52.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.508+0000 7f6813a56640 1 -- 172.21.15.33:0/1856695264 wait complete. 2024-09-12T12:26:52.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.509+0000 7f6813a56640 1 Processor -- start 2024-09-12T12:26:52.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.509+0000 7f6813a56640 1 -- start start 2024-09-12T12:26:52.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.509+0000 7f6813a56640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f680c102d20 0x7f680c1a4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:52.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.509+0000 7f6813a56640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f680c103640 0x7f680c1a4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:52.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.509+0000 7f6813a56640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f680c10c150 0x7f680c19e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:52.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.509+0000 7f6813a56640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f680c10fc10 con 0x7f680c102d20 2024-09-12T12:26:52.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.509+0000 7f6813a56640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f680c10fa90 con 0x7f680c103640 2024-09-12T12:26:52.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.509+0000 7f6813a56640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f680c10fd90 con 0x7f680c10c150 2024-09-12T12:26:52.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.509+0000 7f68117f2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f680c102d20 0x7f680c1a4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:52.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.509+0000 7f6810ff1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f680c103640 0x7f680c1a4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:52.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.509+0000 7f68117f2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f680c102d20 0x7f680c1a4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42400/0 (socket says 172.21.15.33:42400) 2024-09-12T12:26:52.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.509+0000 7f68117f2640 1 -- 172.21.15.33:0/3996582473 learned_addr learned my addr 172.21.15.33:0/3996582473 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:52.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.510+0000 7f6810ff1640 1 -- 172.21.15.33:0/3996582473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f680c10c150 msgr2=0x7f680c19e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:52.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.510+0000 7f6810ff1640 1 --2- 172.21.15.33:0/3996582473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f680c10c150 0x7f680c19e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.510+0000 7f6810ff1640 1 -- 172.21.15.33:0/3996582473 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f680c102d20 msgr2=0x7f680c1a4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:52.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.510+0000 7f6810ff1640 1 --2- 172.21.15.33:0/3996582473 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f680c102d20 0x7f680c1a4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.510+0000 7f6810ff1640 1 -- 172.21.15.33:0/3996582473 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f680c19ef70 con 0x7f680c103640 2024-09-12T12:26:52.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.510+0000 7f68117f2640 1 --2- 172.21.15.33:0/3996582473 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f680c102d20 0x7f680c1a4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:52.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.510+0000 7f6810ff1640 1 --2- 172.21.15.33:0/3996582473 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f680c103640 0x7f680c1a4b90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f67fc02a9a0 tx=0x7f67fc031a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:52.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.510+0000 7f68027fc640 1 -- 172.21.15.33:0/3996582473 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67fc03f030 con 0x7f680c103640 2024-09-12T12:26:52.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.511+0000 7f68027fc640 1 -- 172.21.15.33:0/3996582473 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f67fc004490 con 0x7f680c103640 2024-09-12T12:26:52.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.511+0000 7f68027fc640 1 -- 172.21.15.33:0/3996582473 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67fc035070 con 0x7f680c103640 2024-09-12T12:26:52.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.511+0000 7f6813a56640 1 -- 172.21.15.33:0/3996582473 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f680c19f200 con 0x7f680c103640 2024-09-12T12:26:52.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.511+0000 7f6813a56640 1 -- 172.21.15.33:0/3996582473 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f680c19f620 con 0x7f680c103640 2024-09-12T12:26:52.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.514+0000 7f68027fc640 1 -- 172.21.15.33:0/3996582473 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f67fc042030 con 0x7f680c103640 2024-09-12T12:26:52.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.514+0000 7f6815e2f740 1 Processor -- start 2024-09-12T12:26:52.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.514+0000 7f6815e2f740 1 -- start start 2024-09-12T12:26:52.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.515+0000 7f6815e2f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5622893eab40 0x5622893e9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:52.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.515+0000 7f6815e2f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5622893e95d0 0x5622893e9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:52.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.515+0000 7f6815e2f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5622893f4370 0x5622893f6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:52.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.515+0000 7f6815e2f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56228934f2f0 con 0x5622893f4370 2024-09-12T12:26:52.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.515+0000 7f6815e2f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5622892f6cf0 con 0x5622893eab40 2024-09-12T12:26:52.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.515+0000 7f6815e2f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56228934b2b0 con 0x5622893e95d0 2024-09-12T12:26:52.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.515+0000 7f6811ff3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5622893eab40 0x5622893e9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:52.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.515+0000 7f6810ff1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5622893f4370 0x5622893f6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:52.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.515+0000 7f6811ff3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5622893eab40 0x5622893e9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:42322/0 (socket says 172.21.15.33:42322) 2024-09-12T12:26:52.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.515+0000 7f6811ff3640 1 -- 172.21.15.33:0/1309589749 learned_addr learned my addr 172.21.15.33:0/1309589749 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:52.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.515+0000 7f68117f2640 1 --2- 172.21.15.33:0/1309589749 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5622893e95d0 0x5622893e9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:52.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.515+0000 7f6811ff3640 1 -- 172.21.15.33:0/1309589749 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5622893e95d0 msgr2=0x5622893e9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:52.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.515+0000 7f6811ff3640 1 --2- 172.21.15.33:0/1309589749 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5622893e95d0 0x5622893e9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.515+0000 7f6811ff3640 1 -- 172.21.15.33:0/1309589749 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5622893f4370 msgr2=0x5622893f6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:52.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.515+0000 7f6811ff3640 1 --2- 172.21.15.33:0/1309589749 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5622893f4370 0x5622893f6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.515+0000 7f6811ff3640 1 -- 172.21.15.33:0/1309589749 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622892db3a0 con 0x5622893eab40 2024-09-12T12:26:52.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.515+0000 7f6810ff1640 1 --2- 172.21.15.33:0/1309589749 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5622893f4370 0x5622893f6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:52.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.515+0000 7f68027fc640 1 --2- 172.21.15.33:0/3996582473 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f67f80a2b80 0x7f67f80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:52.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.516+0000 7f68027fc640 1 -- 172.21.15.33:0/3996582473 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f67fc0ef6a0 con 0x7f680c103640 2024-09-12T12:26:52.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.516+0000 7f68117f2640 1 --2- 172.21.15.33:0/3996582473 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f67f80a2b80 0x7f67f80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:52.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.516+0000 7f6811ff3640 1 --2- 172.21.15.33:0/1309589749 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5622893eab40 0x5622893e9090 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6804009e80 tx=0x7f680400d6b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cfba0c9e4049a3e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:52.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.516+0000 7f67f77fe640 1 -- 172.21.15.33:0/1309589749 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6804004b20 con 0x5622893eab40 2024-09-12T12:26:52.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.516+0000 7f67f77fe640 1 -- 172.21.15.33:0/1309589749 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6804004cc0 con 0x5622893eab40 2024-09-12T12:26:52.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.516+0000 7f67f77fe640 1 -- 172.21.15.33:0/1309589749 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6804019710 con 0x5622893eab40 2024-09-12T12:26:52.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.517+0000 7f6815e2f740 1 -- 172.21.15.33:0/1309589749 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5622893eab40 msgr2=0x5622893e9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:52.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.517+0000 7f68117f2640 1 --2- 172.21.15.33:0/3996582473 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f67f80a2b80 0x7f67f80a5040 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x5622893e6ac0 tx=0x7f680800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:52.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.517+0000 7f6815e2f740 1 --2- 172.21.15.33:0/1309589749 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5622893eab40 0x5622893e9090 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6804009e80 tx=0x7f680400d6b0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.517+0000 7f6815e2f740 1 -- 172.21.15.33:0/1309589749 shutdown_connections 2024-09-12T12:26:52.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.517+0000 7f6815e2f740 1 --2- 172.21.15.33:0/1309589749 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5622893f4370 0x5622893f6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.517+0000 7f6815e2f740 1 --2- 172.21.15.33:0/1309589749 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5622893e95d0 0x5622893e9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.517+0000 7f6815e2f740 1 --2- 172.21.15.33:0/1309589749 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5622893eab40 0x5622893e9090 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.517+0000 7f6815e2f740 1 -- 172.21.15.33:0/1309589749 >> 172.21.15.33:0/1309589749 conn(0x5622893b2310 msgr2=0x5622893e5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:52.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.517+0000 7f6815e2f740 1 -- 172.21.15.33:0/1309589749 shutdown_connections 2024-09-12T12:26:52.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.517+0000 7f6815e2f740 1 -- 172.21.15.33:0/1309589749 wait complete. 2024-09-12T12:26:52.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.518+0000 7f6815e2f740 1 -- start start 2024-09-12T12:26:52.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.518+0000 7f6815e2f740 1 Processor -- start 2024-09-12T12:26:52.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.518+0000 7f6815e2f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5622893e95d0 0x5622893f3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:52.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.518+0000 7f6815e2f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5622893eab40 0x5622893f10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:52.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.519+0000 7f6815e2f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5622893f4370 0x5622893f1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:52.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.519+0000 7f6815e2f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5622893f7070 con 0x5622893eab40 2024-09-12T12:26:52.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.519+0000 7f6815e2f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56228930a060 con 0x5622893f4370 2024-09-12T12:26:52.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.519+0000 7f6815e2f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5622893f71f0 con 0x5622893e95d0 2024-09-12T12:26:52.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.519+0000 7f6815e2f740 10 client.0 _ll_register_callbacks cb 0x56228905d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:26:52.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.519+0000 7f68117f2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5622893e95d0 0x5622893f3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:52.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.519+0000 7f6810ff1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5622893eab40 0x5622893f10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:52.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.519+0000 7f6811ff3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5622893f4370 0x5622893f1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:52.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.519+0000 7f6811ff3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5622893f4370 0x5622893f1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:42332/0 (socket says 172.21.15.33:42332) 2024-09-12T12:26:52.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.519+0000 7f6811ff3640 1 -- 172.21.15.33:0/1937841709 learned_addr learned my addr 172.21.15.33:0/1937841709 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:52.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.519+0000 7f6811ff3640 1 -- 172.21.15.33:0/1937841709 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5622893e95d0 msgr2=0x5622893f3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:52.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.519+0000 7f6811ff3640 1 --2- 172.21.15.33:0/1937841709 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5622893e95d0 0x5622893f3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.519+0000 7f6811ff3640 1 -- 172.21.15.33:0/1937841709 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5622893eab40 msgr2=0x5622893f10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:52.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.519+0000 7f6811ff3640 1 --2- 172.21.15.33:0/1937841709 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5622893eab40 0x5622893f10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.519+0000 7f6811ff3640 1 -- 172.21.15.33:0/1937841709 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622890c03c0 con 0x5622893f4370 2024-09-12T12:26:52.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.519+0000 7f6810ff1640 1 --2- 172.21.15.33:0/1937841709 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5622893eab40 0x5622893f10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:52.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.519+0000 7f6811ff3640 1 --2- 172.21.15.33:0/1937841709 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5622893f4370 0x5622893f1850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6804005850 tx=0x7f6804005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f19ecbc49a303e47 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:52.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.519+0000 7f67f4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:26:52.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.520+0000 7f67f4ff9640 1 -- 172.21.15.33:0/1937841709 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6804028060 con 0x5622893f4370 2024-09-12T12:26:52.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.520+0000 7f67f4ff9640 1 -- 172.21.15.33:0/1937841709 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f6804003d80 con 0x5622893f4370 2024-09-12T12:26:52.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.520+0000 7f6815e2f740 1 -- 172.21.15.33:0/1937841709 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6804004cc0 con 0x5622893f4370 2024-09-12T12:26:52.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.520+0000 7f67f4ff9640 1 -- 172.21.15.33:0/1937841709 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f680402f050 con 0x5622893f4370 2024-09-12T12:26:52.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.520+0000 7f6815e2f740 10 client.25013 fetch_fsmap learned FSMap version 25 2024-09-12T12:26:52.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.520+0000 7f6815e2f740 1 -- 172.21.15.33:0/1937841709 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562289402bc0 con 0x5622893f4370 2024-09-12T12:26:52.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.521+0000 7f67f4ff9640 1 -- 172.21.15.33:0/1937841709 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f680401f070 con 0x5622893f4370 2024-09-12T12:26:52.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.521+0000 7f67f4ff9640 1 -- 172.21.15.33:0/1937841709 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f6804004480 con 0x5622893f4370 2024-09-12T12:26:52.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.521+0000 7f6815e2f740 10 client.25013 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T12:26:52.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.521+0000 7f6815e2f740 10 client.25013 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-12T12:26:52.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.521+0000 7f6815e2f740 20 client.25013 populate_metadata read hostname 'smithi033' 2024-09-12T12:26:52.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.521+0000 7f6815e2f740 1 --2- 172.21.15.33:0/1937841709 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x562289403f10 0x562289406300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:52.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.521+0000 7f6815e2f740 4 client.25013 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:26:52.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.521+0000 7f6815e2f740 1 -- 172.21.15.33:0/1937841709 --> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f6804004cc0 con 0x562289403f10 2024-09-12T12:26:52.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.522+0000 7f68117f2640 1 --2- 172.21.15.33:0/1937841709 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x562289403f10 0x562289406300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:52.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.522+0000 7f68117f2640 1 --2- 172.21.15.33:0/1937841709 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x562289403f10 0x562289406300 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bc25f616cfe9b5d5 server_cookie=984563c986215c7b in_seq=0 out_seq=0 2024-09-12T12:26:52.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.522+0000 7f67f4ff9640 10 client.25013 ms_handle_connect on v2:172.21.15.102:6834/4179527539 2024-09-12T12:26:52.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.523+0000 7f67f4ff9640 1 -- 172.21.15.33:0/1937841709 <== mds.2 v2:172.21.15.102:6834/4179527539 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f6804004cc0 con 0x562289403f10 2024-09-12T12:26:52.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.523+0000 7f67f4ff9640 10 client.25013 handle_command_reply: tid=0 2024-09-12T12:26:52.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.523+0000 7f6815e2f740 1 client.25013 shutdown 2024-09-12T12:26:52.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.523+0000 7f6815e2f740 1 -- 172.21.15.33:0/1937841709 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5622893f4370 msgr2=0x5622893f1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:52.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.523+0000 7f6815e2f740 1 --2- 172.21.15.33:0/1937841709 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5622893f4370 0x5622893f1850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6804005850 tx=0x7f6804005880 comp rx=0 tx=0).stop 2024-09-12T12:26:52.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.523+0000 7f6815e2f740 1 -- 172.21.15.33:0/1937841709 shutdown_connections 2024-09-12T12:26:52.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.523+0000 7f6815e2f740 1 --2- 172.21.15.33:0/1937841709 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x562289403f10 0x562289406300 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.523+0000 7f6815e2f740 1 --2- 172.21.15.33:0/1937841709 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5622893f4370 0x5622893f1850 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.523+0000 7f6815e2f740 1 --2- 172.21.15.33:0/1937841709 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5622893eab40 0x5622893f10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.523+0000 7f6815e2f740 1 --2- 172.21.15.33:0/1937841709 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5622893e95d0 0x5622893f3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.523+0000 7f6815e2f740 1 -- 172.21.15.33:0/1937841709 >> 172.21.15.33:0/1937841709 conn(0x5622893b2310 msgr2=0x5622893eb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:52.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.523+0000 7f67f4ff9640 0 client.25013 ms_handle_reset on v2:172.21.15.102:6834/4179527539 2024-09-12T12:26:52.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.524+0000 7f6815e2f740 1 -- 172.21.15.33:0/1937841709 shutdown_connections 2024-09-12T12:26:52.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.524+0000 7f6815e2f740 1 -- 172.21.15.33:0/1937841709 wait complete. 2024-09-12T12:26:52.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.524+0000 7f6815e2f740 20 client.25013 trim_cache size 0 max 16384 2024-09-12T12:26:52.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.549+0000 7f6815e2f740 1 Processor -- start 2024-09-12T12:26:52.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.550+0000 7f6815e2f740 1 -- start start 2024-09-12T12:26:52.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.550+0000 7f6815e2f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5622893e95d0 0x5622893f0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:52.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.550+0000 7f6815e2f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5622893eab40 0x5622893f0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:52.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.550+0000 7f6815e2f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5622893f4370 0x5622893ec0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:52.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.550+0000 7f6810ff1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5622893eab40 0x5622893f0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:52.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.550+0000 7f6815e2f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f680c1b7b30 con 0x5622893eab40 2024-09-12T12:26:52.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.550+0000 7f6815e2f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f680c1b5400 con 0x5622893f4370 2024-09-12T12:26:52.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.550+0000 7f6810ff1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5622893eab40 0x5622893f0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42426/0 (socket says 172.21.15.33:42426) 2024-09-12T12:26:52.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.550+0000 7f6815e2f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f680c1b3250 con 0x5622893e95d0 2024-09-12T12:26:52.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.550+0000 7f6810ff1640 1 -- 172.21.15.33:0/2076269073 learned_addr learned my addr 172.21.15.33:0/2076269073 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:52.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.550+0000 7f68117f2640 1 --2- 172.21.15.33:0/2076269073 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5622893e95d0 0x5622893f0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:52.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.550+0000 7f6811ff3640 1 --2- 172.21.15.33:0/2076269073 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5622893f4370 0x5622893ec0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:52.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.551+0000 7f6810ff1640 1 -- 172.21.15.33:0/2076269073 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5622893e95d0 msgr2=0x5622893f0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:52.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.551+0000 7f6810ff1640 1 --2- 172.21.15.33:0/2076269073 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5622893e95d0 0x5622893f0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.551+0000 7f6810ff1640 1 -- 172.21.15.33:0/2076269073 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5622893f4370 msgr2=0x5622893ec0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:52.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.551+0000 7f6810ff1640 1 --2- 172.21.15.33:0/2076269073 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5622893f4370 0x5622893ec0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.551+0000 7f6810ff1640 1 -- 172.21.15.33:0/2076269073 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622893ea760 con 0x5622893eab40 2024-09-12T12:26:52.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.551+0000 7f6810ff1640 1 --2- 172.21.15.33:0/2076269073 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5622893eab40 0x5622893f0db0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f67fc0bb870 tx=0x7f67fc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fa6230da9f8bb5a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:52.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.551+0000 7f67f6ffd640 1 -- 172.21.15.33:0/2076269073 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67fc049040 con 0x5622893eab40 2024-09-12T12:26:52.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.551+0000 7f67f6ffd640 1 -- 172.21.15.33:0/2076269073 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f67fc0bc270 con 0x5622893eab40 2024-09-12T12:26:52.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.552+0000 7f67f6ffd640 1 -- 172.21.15.33:0/2076269073 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67fc0ef3d0 con 0x5622893eab40 2024-09-12T12:26:52.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.552+0000 7f6815e2f740 1 -- 172.21.15.33:0/2076269073 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5622893eab40 msgr2=0x5622893f0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:52.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.552+0000 7f6815e2f740 1 --2- 172.21.15.33:0/2076269073 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5622893eab40 0x5622893f0db0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f67fc0bb870 tx=0x7f67fc000bc0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.553+0000 7f6815e2f740 1 -- 172.21.15.33:0/2076269073 shutdown_connections 2024-09-12T12:26:52.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.553+0000 7f6815e2f740 1 --2- 172.21.15.33:0/2076269073 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5622893f4370 0x5622893ec0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.553+0000 7f6815e2f740 1 --2- 172.21.15.33:0/2076269073 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5622893eab40 0x5622893f0db0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.553+0000 7f6815e2f740 1 --2- 172.21.15.33:0/2076269073 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5622893e95d0 0x5622893f0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.553+0000 7f6815e2f740 1 -- 172.21.15.33:0/2076269073 >> 172.21.15.33:0/2076269073 conn(0x5622893b2310 msgr2=0x5622893f3140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:52.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.553+0000 7f6815e2f740 1 -- 172.21.15.33:0/2076269073 shutdown_connections 2024-09-12T12:26:52.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.553+0000 7f6815e2f740 1 -- 172.21.15.33:0/2076269073 wait complete. 2024-09-12T12:26:52.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.553+0000 7f6815e2f740 1 -- start start 2024-09-12T12:26:52.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.553+0000 7f6815e2f740 1 Processor -- start 2024-09-12T12:26:52.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.554+0000 7f6815e2f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5622893e95d0 0x5622893fc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:52.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.554+0000 7f6815e2f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5622893eab40 0x5622893f7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:52.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.554+0000 7f6815e2f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5622893f4370 0x5622893f8280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:52.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.554+0000 7f6811ff3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5622893f4370 0x5622893f8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:52.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.554+0000 7f6811ff3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5622893f4370 0x5622893f8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42440/0 (socket says 172.21.15.33:42440) 2024-09-12T12:26:52.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.554+0000 7f6811ff3640 1 -- 172.21.15.33:0/1242342288 learned_addr learned my addr 172.21.15.33:0/1242342288 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:52.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.554+0000 7f6815e2f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f680c1b38c0 con 0x5622893f4370 2024-09-12T12:26:52.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.554+0000 7f6815e2f740 1 -- 172.21.15.33:0/1242342288 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f680c1b4d30 con 0x5622893eab40 2024-09-12T12:26:52.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.554+0000 7f6815e2f740 1 -- 172.21.15.33:0/1242342288 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f680c1b3f90 con 0x5622893e95d0 2024-09-12T12:26:52.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.554+0000 7f6810ff1640 1 --2- 172.21.15.33:0/1242342288 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5622893eab40 0x5622893f7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:52.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.554+0000 7f68117f2640 1 --2- 172.21.15.33:0/1242342288 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5622893e95d0 0x5622893fc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:52.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.554+0000 7f6811ff3640 1 -- 172.21.15.33:0/1242342288 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5622893e95d0 msgr2=0x5622893fc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:52.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.554+0000 7f6811ff3640 1 --2- 172.21.15.33:0/1242342288 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5622893e95d0 0x5622893fc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.554+0000 7f6811ff3640 1 -- 172.21.15.33:0/1242342288 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5622893eab40 msgr2=0x5622893f7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:52.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.554+0000 7f6811ff3640 1 --2- 172.21.15.33:0/1242342288 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5622893eab40 0x5622893f7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.554+0000 7f6811ff3640 1 -- 172.21.15.33:0/1242342288 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622893f8870 con 0x5622893f4370 2024-09-12T12:26:52.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.555+0000 7f6811ff3640 1 --2- 172.21.15.33:0/1242342288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5622893f4370 0x5622893f8280 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6804000f80 tx=0x7f6804009970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94d9297426febbc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:52.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.555+0000 7f67f4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:26:52.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.555+0000 7f6815e2f740 10 client.0 _ll_register_callbacks cb 0x7f6804009d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:26:52.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.555+0000 7f6815e2f740 1 -- 172.21.15.33:0/1242342288 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67fc0bc270 con 0x5622893f4370 2024-09-12T12:26:52.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.555+0000 7f67f4ff9640 1 -- 172.21.15.33:0/1242342288 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6804037070 con 0x5622893f4370 2024-09-12T12:26:52.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.555+0000 7f67f4ff9640 1 -- 172.21.15.33:0/1242342288 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f6804023aa0 con 0x5622893f4370 2024-09-12T12:26:52.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.555+0000 7f67f4ff9640 1 -- 172.21.15.33:0/1242342288 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6804044050 con 0x5622893f4370 2024-09-12T12:26:52.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.555+0000 7f6815e2f740 10 client.15372 fetch_fsmap learned FSMap version 25 2024-09-12T12:26:52.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.555+0000 7f6815e2f740 1 -- 172.21.15.33:0/1242342288 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({fsmap=25}) -- 0x56228946e320 con 0x5622893f4370 2024-09-12T12:26:52.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.556+0000 7f67f4ff9640 1 -- 172.21.15.33:0/1242342288 <== mon.0 v2:172.21.15.33:3300/0 4 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f6804023ca0 con 0x5622893f4370 2024-09-12T12:26:52.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.556+0000 7f6815e2f740 10 client.15372 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T12:26:52.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.556+0000 7f6815e2f740 10 client.15372 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-12T12:26:52.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.556+0000 7f6815e2f740 20 client.15372 populate_metadata read hostname 'smithi033' 2024-09-12T12:26:52.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.556+0000 7f6815e2f740 1 --2- 172.21.15.33:0/1242342288 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x56228946e9e0 0x562289470ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:52.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.556+0000 7f6815e2f740 4 client.15372 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:26:52.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.556+0000 7f6815e2f740 1 -- 172.21.15.33:0/1242342288 --> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56228935c860 con 0x56228946e9e0 2024-09-12T12:26:52.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.556+0000 7f68117f2640 1 --2- 172.21.15.33:0/1242342288 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x56228946e9e0 0x562289470ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:52.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.557+0000 7f68117f2640 1 --2- 172.21.15.33:0/1242342288 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x56228946e9e0 0x562289470ea0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5a23e70eed9eda65 server_cookie=9c78e06e95cc1922 in_seq=0 out_seq=0 2024-09-12T12:26:52.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.557+0000 7f67f4ff9640 10 client.15372 ms_handle_connect on v2:172.21.15.102:6834/4179527539 2024-09-12T12:26:52.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.557+0000 7f67f4ff9640 1 -- 172.21.15.33:0/1242342288 <== mds.2 v2:172.21.15.102:6834/4179527539 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56228935c860 con 0x56228946e9e0 2024-09-12T12:26:52.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.557+0000 7f67f4ff9640 10 client.15372 handle_command_reply: tid=0 2024-09-12T12:26:52.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.557+0000 7f6815e2f740 1 client.15372 shutdown 2024-09-12T12:26:52.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.557+0000 7f6815e2f740 1 -- 172.21.15.33:0/1242342288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5622893f4370 msgr2=0x5622893f8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:52.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.557+0000 7f6815e2f740 1 --2- 172.21.15.33:0/1242342288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5622893f4370 0x5622893f8280 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6804000f80 tx=0x7f6804009970 comp rx=0 tx=0).stop 2024-09-12T12:26:52.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.557+0000 7f6815e2f740 1 -- 172.21.15.33:0/1242342288 shutdown_connections 2024-09-12T12:26:52.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.557+0000 7f6815e2f740 1 --2- 172.21.15.33:0/1242342288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5622893f4370 0x5622893f8280 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.561 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-09-12T12:26:52.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.557+0000 7f6815e2f740 1 --2- 172.21.15.33:0/1242342288 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x56228946e9e0 0x562289470ea0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.557+0000 7f6815e2f740 1 --2- 172.21.15.33:0/1242342288 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5622893eab40 0x5622893f7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.557+0000 7f6815e2f740 1 --2- 172.21.15.33:0/1242342288 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5622893e95d0 0x5622893fc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.557+0000 7f6815e2f740 1 -- 172.21.15.33:0/1242342288 >> 172.21.15.33:0/1242342288 conn(0x5622893b2310 msgr2=0x5622893e44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:52.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.557+0000 7f67f4ff9640 0 client.15372 ms_handle_reset on v2:172.21.15.102:6834/4179527539 2024-09-12T12:26:52.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.557+0000 7f6815e2f740 1 -- 172.21.15.33:0/1242342288 shutdown_connections 2024-09-12T12:26:52.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.557+0000 7f6815e2f740 1 -- 172.21.15.33:0/1242342288 wait complete. 2024-09-12T12:26:52.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.558+0000 7f6815e2f740 20 client.15372 trim_cache size 0 max 16384 2024-09-12T12:26:52.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.558+0000 7f6813a56640 1 -- 172.21.15.33:0/3996582473 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f67f80a2b80 msgr2=0x7f67f80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:52.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.558+0000 7f6813a56640 1 --2- 172.21.15.33:0/3996582473 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f67f80a2b80 0x7f67f80a5040 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x5622893e6ac0 tx=0x7f680800b410 comp rx=0 tx=0).stop 2024-09-12T12:26:52.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.558+0000 7f6813a56640 1 -- 172.21.15.33:0/3996582473 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f680c103640 msgr2=0x7f680c1a4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:52.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.558+0000 7f6813a56640 1 --2- 172.21.15.33:0/3996582473 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f680c103640 0x7f680c1a4b90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f67fc02a9a0 tx=0x7f67fc031a20 comp rx=0 tx=0).stop 2024-09-12T12:26:52.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.559+0000 7f6813a56640 1 -- 172.21.15.33:0/3996582473 shutdown_connections 2024-09-12T12:26:52.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.559+0000 7f6813a56640 1 --2- 172.21.15.33:0/3996582473 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f67f80a2b80 0x7f67f80a5040 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.559+0000 7f6813a56640 1 --2- 172.21.15.33:0/3996582473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f680c10c150 0x7f680c19e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.559+0000 7f6813a56640 1 --2- 172.21.15.33:0/3996582473 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f680c103640 0x7f680c1a4b90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.559+0000 7f6813a56640 1 --2- 172.21.15.33:0/3996582473 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f680c102d20 0x7f680c1a4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.559+0000 7f6813a56640 1 -- 172.21.15.33:0/3996582473 >> 172.21.15.33:0/3996582473 conn(0x7f680c0fc780 msgr2=0x7f680c0fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:52.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.559+0000 7f6813a56640 1 -- 172.21.15.33:0/3996582473 shutdown_connections 2024-09-12T12:26:52.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:52.559+0000 7f6813a56640 1 -- 172.21.15.33:0/3996582473 wait complete. 2024-09-12T12:26:53.340 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:53 smithi033 ceph-mon[31246]: pgmap v376: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T12:26:53.341 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T12:26:53.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:53 smithi043 ceph-mon[34144]: pgmap v376: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T12:26:53.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:53 smithi102 ceph-mon[34799]: pgmap v376: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T12:26:53.640 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:26:54.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.188+0000 7f75b6ffd640 1 -- 172.21.15.33:0/1693533905 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b0031e40 con 0x7f75b810e4d0 2024-09-12T12:26:54.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.189+0000 7f75be8a4640 1 -- 172.21.15.33:0/1693533905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75b810e4d0 msgr2=0x7f75b81108e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:54.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.189+0000 7f75be8a4640 1 --2- 172.21.15.33:0/1693533905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75b810e4d0 0x7f75b81108e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f75b0009ca0 tx=0x7f75b002a8c0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.189+0000 7f75be8a4640 1 -- 172.21.15.33:0/1693533905 shutdown_connections 2024-09-12T12:26:54.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.189+0000 7f75be8a4640 1 --2- 172.21.15.33:0/1693533905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75b810e4d0 0x7f75b81108e0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.189+0000 7f75be8a4640 1 --2- 172.21.15.33:0/1693533905 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f75b8101360 0x7f75b810df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.189+0000 7f75be8a4640 1 --2- 172.21.15.33:0/1693533905 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75b81009b0 0x7f75b8100d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.190+0000 7f75be8a4640 1 -- 172.21.15.33:0/1693533905 >> 172.21.15.33:0/1693533905 conn(0x7f75b80fc7d0 msgr2=0x7f75b80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:54.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.190+0000 7f75be8a4640 1 -- 172.21.15.33:0/1693533905 shutdown_connections 2024-09-12T12:26:54.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.190+0000 7f75be8a4640 1 -- 172.21.15.33:0/1693533905 wait complete. 2024-09-12T12:26:54.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.191+0000 7f75be8a4640 1 Processor -- start 2024-09-12T12:26:54.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.191+0000 7f75be8a4640 1 -- start start 2024-09-12T12:26:54.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.192+0000 7f75be8a4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f75b81009b0 0x7f75b819a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:54.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.192+0000 7f75be8a4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75b8101360 0x7f75b819a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:54.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.192+0000 7f75be8a4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75b810e4d0 0x7f75b819ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:54.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.192+0000 7f75be8a4640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f75b81140d0 con 0x7f75b8101360 2024-09-12T12:26:54.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.192+0000 7f75be8a4640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f75b8113f50 con 0x7f75b810e4d0 2024-09-12T12:26:54.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.192+0000 7f75be8a4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f75b8114250 con 0x7f75b81009b0 2024-09-12T12:26:54.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.192+0000 7f75b77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75b8101360 0x7f75b819a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:54.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.193+0000 7f75b77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75b8101360 0x7f75b819a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42468/0 (socket says 172.21.15.33:42468) 2024-09-12T12:26:54.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.193+0000 7f75b77fe640 1 -- 172.21.15.33:0/3076036957 learned_addr learned my addr 172.21.15.33:0/3076036957 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:54.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.193+0000 7f75bce41640 1 --2- 172.21.15.33:0/3076036957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75b810e4d0 0x7f75b819ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:54.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.193+0000 7f75b77fe640 1 -- 172.21.15.33:0/3076036957 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f75b81009b0 msgr2=0x7f75b819a3f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T12:26:54.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.193+0000 7f75b77fe640 1 --2- 172.21.15.33:0/3076036957 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f75b81009b0 0x7f75b819a3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.193+0000 7f75b77fe640 1 -- 172.21.15.33:0/3076036957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75b810e4d0 msgr2=0x7f75b819ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:54.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.193+0000 7f75b77fe640 1 --2- 172.21.15.33:0/3076036957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75b810e4d0 0x7f75b819ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.193+0000 7f75b77fe640 1 -- 172.21.15.33:0/3076036957 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75b819f3a0 con 0x7f75b8101360 2024-09-12T12:26:54.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.193+0000 7f75bce41640 1 --2- 172.21.15.33:0/3076036957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75b810e4d0 0x7f75b819ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:54.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.193+0000 7f75b77fe640 1 --2- 172.21.15.33:0/3076036957 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75b8101360 0x7f75b819a930 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f75ac00d9d0 tx=0x7f75ac00de90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:54.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.194+0000 7f75b57fa640 1 -- 172.21.15.33:0/3076036957 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ac017070 con 0x7f75b8101360 2024-09-12T12:26:54.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.194+0000 7f75b57fa640 1 -- 172.21.15.33:0/3076036957 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f75ac005020 con 0x7f75b8101360 2024-09-12T12:26:54.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.194+0000 7f75b57fa640 1 -- 172.21.15.33:0/3076036957 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ac004d40 con 0x7f75b8101360 2024-09-12T12:26:54.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.194+0000 7f75be8a4640 1 -- 172.21.15.33:0/3076036957 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75b819f690 con 0x7f75b8101360 2024-09-12T12:26:54.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.194+0000 7f75be8a4640 1 -- 172.21.15.33:0/3076036957 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75b81a6f70 con 0x7f75b8101360 2024-09-12T12:26:54.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.198+0000 7f75c0c7d740 1 Processor -- start 2024-09-12T12:26:54.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.198+0000 7f75c0c7d740 1 -- start start 2024-09-12T12:26:54.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.198+0000 7f75c0c7d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646027b8b40 0x5646027b7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:54.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.198+0000 7f75c0c7d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5646027b75d0 0x5646027b7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:54.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.198+0000 7f75c0c7d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646027c2370 0x5646027c4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:54.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.198+0000 7f75c0c7d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56460271d2f0 con 0x5646027b75d0 2024-09-12T12:26:54.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.198+0000 7f75c0c7d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5646026c4cf0 con 0x5646027b8b40 2024-09-12T12:26:54.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.198+0000 7f75c0c7d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5646027192b0 con 0x5646027c2370 2024-09-12T12:26:54.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.198+0000 7f75b7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5646027b75d0 0x5646027b7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:54.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.198+0000 7f75bce41640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646027b8b40 0x5646027b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:54.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.198+0000 7f75b7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5646027b75d0 0x5646027b7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42482/0 (socket says 172.21.15.33:42482) 2024-09-12T12:26:54.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.198+0000 7f75b7fff640 1 -- 172.21.15.33:0/2356127603 learned_addr learned my addr 172.21.15.33:0/2356127603 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:54.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.199+0000 7f75b57fa640 1 -- 172.21.15.33:0/3076036957 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f75ac0051d0 con 0x7f75b8101360 2024-09-12T12:26:54.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.199+0000 7f75bce41640 1 -- 172.21.15.33:0/2356127603 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646027c2370 msgr2=0x5646027c4760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T12:26:54.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.199+0000 7f75bce41640 1 --2- 172.21.15.33:0/2356127603 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646027c2370 0x5646027c4760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.199+0000 7f75bce41640 1 -- 172.21.15.33:0/2356127603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5646027b75d0 msgr2=0x5646027b7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:54.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.199+0000 7f75bce41640 1 --2- 172.21.15.33:0/2356127603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5646027b75d0 0x5646027b7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.199+0000 7f75bce41640 1 -- 172.21.15.33:0/2356127603 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646026a93a0 con 0x5646027b8b40 2024-09-12T12:26:54.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.199+0000 7f75b7fff640 1 --2- 172.21.15.33:0/2356127603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5646027b75d0 0x5646027b7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:54.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.200+0000 7f75bce41640 1 --2- 172.21.15.33:0/2356127603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646027b8b40 0x5646027b7090 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f75b002ade0 tx=0x7f75b0009930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd7861051e754fc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:54.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.200+0000 7f759e7fc640 1 -- 172.21.15.33:0/2356127603 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b0031d40 con 0x5646027b8b40 2024-09-12T12:26:54.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.200+0000 7f75b57fa640 1 --2- 172.21.15.33:0/3076036957 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f75a00a2c00 0x7f75a00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:54.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.200+0000 7f75b7fff640 1 --2- 172.21.15.33:0/3076036957 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f75a00a2c00 0x7f75a00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:54.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.200+0000 7f759e7fc640 1 -- 172.21.15.33:0/2356127603 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f75b0036040 con 0x5646027b8b40 2024-09-12T12:26:54.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.200+0000 7f75b57fa640 1 -- 172.21.15.33:0/3076036957 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f75ac0cf010 con 0x7f75b8101360 2024-09-12T12:26:54.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.201+0000 7f75c0c7d740 1 -- 172.21.15.33:0/2356127603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646027b8b40 msgr2=0x5646027b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:54.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.201+0000 7f75c0c7d740 1 --2- 172.21.15.33:0/2356127603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646027b8b40 0x5646027b7090 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f75b002ade0 tx=0x7f75b0009930 comp rx=0 tx=0).stop 2024-09-12T12:26:54.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.201+0000 7f75c0c7d740 1 -- 172.21.15.33:0/2356127603 shutdown_connections 2024-09-12T12:26:54.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.201+0000 7f75c0c7d740 1 --2- 172.21.15.33:0/2356127603 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646027c2370 0x5646027c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.201+0000 7f75c0c7d740 1 --2- 172.21.15.33:0/2356127603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5646027b75d0 0x5646027b7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.201+0000 7f75c0c7d740 1 --2- 172.21.15.33:0/2356127603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646027b8b40 0x5646027b7090 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.201+0000 7f75c0c7d740 1 -- 172.21.15.33:0/2356127603 >> 172.21.15.33:0/2356127603 conn(0x564602780310 msgr2=0x5646027b3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:54.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.201+0000 7f75c0c7d740 1 -- 172.21.15.33:0/2356127603 shutdown_connections 2024-09-12T12:26:54.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.202+0000 7f75c0c7d740 1 -- 172.21.15.33:0/2356127603 wait complete. 2024-09-12T12:26:54.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.202+0000 7f75b7fff640 1 --2- 172.21.15.33:0/3076036957 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f75a00a2c00 0x7f75a00a50c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x5646027b4ac0 tx=0x7f75a8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:54.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.202+0000 7f75c0c7d740 1 -- start start 2024-09-12T12:26:54.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.202+0000 7f75c0c7d740 1 Processor -- start 2024-09-12T12:26:54.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.203+0000 7f75c0c7d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646027b75d0 0x5646027c1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:54.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.203+0000 7f75c0c7d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646027b8b40 0x5646027bef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:54.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.203+0000 7f75c0c7d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5646027c2370 0x5646027bf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:54.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.203+0000 7f75bce41640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5646027c2370 0x5646027bf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:54.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.203+0000 7f75b7fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646027b75d0 0x5646027c1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:54.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.203+0000 7f75b7fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646027b75d0 0x5646027c1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:42402/0 (socket says 172.21.15.33:42402) 2024-09-12T12:26:54.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.203+0000 7f75b7fff640 1 -- 172.21.15.33:0/2713015959 learned_addr learned my addr 172.21.15.33:0/2713015959 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:54.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.203+0000 7f75c0c7d740 1 -- 172.21.15.33:0/2713015959 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5646027c50b0 con 0x5646027c2370 2024-09-12T12:26:54.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.203+0000 7f75c0c7d740 1 -- 172.21.15.33:0/2713015959 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5646026d8060 con 0x5646027b75d0 2024-09-12T12:26:54.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.203+0000 7f75c0c7d740 1 -- 172.21.15.33:0/2713015959 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5646027c5230 con 0x5646027b8b40 2024-09-12T12:26:54.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.203+0000 7f75b77fe640 1 --2- 172.21.15.33:0/2713015959 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646027b8b40 0x5646027bef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:54.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.203+0000 7f75b7fff640 1 -- 172.21.15.33:0/2713015959 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646027b8b40 msgr2=0x5646027bef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:54.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.203+0000 7f75b7fff640 1 --2- 172.21.15.33:0/2713015959 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646027b8b40 0x5646027bef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.203+0000 7f75b7fff640 1 -- 172.21.15.33:0/2713015959 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5646027c2370 msgr2=0x5646027bf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:54.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.203+0000 7f75b7fff640 1 --2- 172.21.15.33:0/2713015959 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5646027c2370 0x5646027bf480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.203+0000 7f75b7fff640 1 -- 172.21.15.33:0/2713015959 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56460248e3c0 con 0x5646027b75d0 2024-09-12T12:26:54.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.203+0000 7f75bce41640 1 --2- 172.21.15.33:0/2713015959 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5646027c2370 0x5646027bf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:54.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.204+0000 7f75c0c7d740 10 client.0 _ll_register_callbacks cb 0x56460242b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:26:54.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.204+0000 7f75c0c7d740 1 -- 172.21.15.33:0/2713015959 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75b0036040 con 0x5646027b75d0 2024-09-12T12:26:54.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.204+0000 7f75b7fff640 1 --2- 172.21.15.33:0/2713015959 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646027b75d0 0x5646027c1c90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f75a8010a60 tx=0x7f75a8004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c2c3a8206ba3099 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:54.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.204+0000 7f75977fe640 10 client.25028 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:26:54.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.204+0000 7f75977fe640 1 -- 172.21.15.33:0/2713015959 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a8016070 con 0x5646027b75d0 2024-09-12T12:26:54.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.204+0000 7f75977fe640 1 -- 172.21.15.33:0/2713015959 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f75a801bd40 con 0x5646027b75d0 2024-09-12T12:26:54.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.204+0000 7f75977fe640 1 -- 172.21.15.33:0/2713015959 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f75a8004020 con 0x5646027b75d0 2024-09-12T12:26:54.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.204+0000 7f75c0c7d740 10 client.25028 fetch_fsmap learned FSMap version 25 2024-09-12T12:26:54.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.204+0000 7f75c0c7d740 1 -- 172.21.15.33:0/2713015959 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({fsmap=25}) -- 0x5646027d09f0 con 0x5646027b75d0 2024-09-12T12:26:54.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.205+0000 7f75977fe640 1 -- 172.21.15.33:0/2713015959 <== mon.2 v2:172.21.15.43:3300/0 4 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f75a80041c0 con 0x5646027b75d0 2024-09-12T12:26:54.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.205+0000 7f75c0c7d740 10 client.25028 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T12:26:54.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.205+0000 7f75c0c7d740 10 client.25028 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-12T12:26:54.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.205+0000 7f75c0c7d740 20 client.25028 populate_metadata read hostname 'smithi033' 2024-09-12T12:26:54.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.205+0000 7f75c0c7d740 1 --2- 172.21.15.33:0/2713015959 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x5646027d1df0 0x5646027d4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:54.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.205+0000 7f75c0c7d740 4 client.25028 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:26:54.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.205+0000 7f75c0c7d740 1 -- 172.21.15.33:0/2713015959 --> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56460272a860 con 0x5646027d1df0 2024-09-12T12:26:54.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.205+0000 7f75b77fe640 1 --2- 172.21.15.33:0/2713015959 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x5646027d1df0 0x5646027d4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:54.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.206+0000 7f75977fe640 10 client.25028 ms_handle_connect on v2:172.21.15.102:6836/2409953270 2024-09-12T12:26:54.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.206+0000 7f75b77fe640 1 --2- 172.21.15.33:0/2713015959 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x5646027d1df0 0x5646027d4260 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1228960b8483961a server_cookie=48e1a8408a54f580 in_seq=0 out_seq=0 2024-09-12T12:26:54.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.207+0000 7f75977fe640 1 -- 172.21.15.33:0/2713015959 <== mds.1 v2:172.21.15.102:6836/2409953270 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56460272a860 con 0x5646027d1df0 2024-09-12T12:26:54.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.207+0000 7f75977fe640 10 client.25028 handle_command_reply: tid=0 2024-09-12T12:26:54.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.207+0000 7f75c0c7d740 1 client.25028 shutdown 2024-09-12T12:26:54.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.207+0000 7f75c0c7d740 1 -- 172.21.15.33:0/2713015959 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646027b75d0 msgr2=0x5646027c1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:54.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.207+0000 7f75c0c7d740 1 --2- 172.21.15.33:0/2713015959 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646027b75d0 0x5646027c1c90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f75a8010a60 tx=0x7f75a8004730 comp rx=0 tx=0).stop 2024-09-12T12:26:54.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.207+0000 7f75c0c7d740 1 -- 172.21.15.33:0/2713015959 shutdown_connections 2024-09-12T12:26:54.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.207+0000 7f75c0c7d740 1 --2- 172.21.15.33:0/2713015959 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5646027c2370 0x5646027bf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.207+0000 7f75c0c7d740 1 --2- 172.21.15.33:0/2713015959 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x5646027d1df0 0x5646027d4260 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.207+0000 7f75c0c7d740 1 --2- 172.21.15.33:0/2713015959 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646027b8b40 0x5646027bef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.207+0000 7f75c0c7d740 1 --2- 172.21.15.33:0/2713015959 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646027b75d0 0x5646027c1c90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.207+0000 7f75977fe640 0 client.25028 ms_handle_reset on v2:172.21.15.102:6836/2409953270 2024-09-12T12:26:54.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.207+0000 7f75c0c7d740 1 -- 172.21.15.33:0/2713015959 >> 172.21.15.33:0/2713015959 conn(0x564602780310 msgr2=0x5646027b9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:54.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.207+0000 7f75c0c7d740 1 -- 172.21.15.33:0/2713015959 shutdown_connections 2024-09-12T12:26:54.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.207+0000 7f75c0c7d740 1 -- 172.21.15.33:0/2713015959 wait complete. 2024-09-12T12:26:54.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.207+0000 7f75c0c7d740 20 client.25028 trim_cache size 0 max 16384 2024-09-12T12:26:54.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.233+0000 7f75c0c7d740 1 Processor -- start 2024-09-12T12:26:54.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.233+0000 7f75c0c7d740 1 -- start start 2024-09-12T12:26:54.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.233+0000 7f75c0c7d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646027b75d0 0x5646027ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:54.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.233+0000 7f75c0c7d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646027b8b40 0x5646027ba120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:54.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.234+0000 7f75c0c7d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5646027c2370 0x5646027ba660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:54.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.234+0000 7f75c0c7d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f75b81b35e0 con 0x5646027c2370 2024-09-12T12:26:54.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.234+0000 7f75c0c7d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f75b81b0eb0 con 0x5646027b75d0 2024-09-12T12:26:54.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.234+0000 7f75c0c7d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f75b81aed00 con 0x5646027b8b40 2024-09-12T12:26:54.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.234+0000 7f75b7fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646027b75d0 0x5646027ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:54.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.234+0000 7f75b77fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646027b8b40 0x5646027ba120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:54.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.234+0000 7f75b77fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646027b8b40 0x5646027ba120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:49134/0 (socket says 172.21.15.33:49134) 2024-09-12T12:26:54.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.234+0000 7f75b7fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646027b75d0 0x5646027ce3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:42412/0 (socket says 172.21.15.33:42412) 2024-09-12T12:26:54.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.234+0000 7f75b77fe640 1 -- 172.21.15.33:0/3336429585 learned_addr learned my addr 172.21.15.33:0/3336429585 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:54.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.234+0000 7f75bce41640 1 --2- 172.21.15.33:0/3336429585 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5646027c2370 0x5646027ba660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:54.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.234+0000 7f75b7fff640 1 -- 172.21.15.33:0/3336429585 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646027b8b40 msgr2=0x5646027ba120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:54.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.234+0000 7f75b7fff640 1 --2- 172.21.15.33:0/3336429585 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646027b8b40 0x5646027ba120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.234+0000 7f75b7fff640 1 -- 172.21.15.33:0/3336429585 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5646027c2370 msgr2=0x5646027ba660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:54.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.235+0000 7f75b7fff640 1 --2- 172.21.15.33:0/3336429585 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5646027c2370 0x5646027ba660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.235+0000 7f75b7fff640 1 -- 172.21.15.33:0/3336429585 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646027c18b0 con 0x5646027b75d0 2024-09-12T12:26:54.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.235+0000 7f75bce41640 1 --2- 172.21.15.33:0/3336429585 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5646027c2370 0x5646027ba660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:54.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.235+0000 7f75b7fff640 1 --2- 172.21.15.33:0/3336429585 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646027b75d0 0x5646027ce3a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f75a800fc20 tx=0x7f75a801e070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ca02a0f5bd2c80e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:54.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.235+0000 7f759dffb640 1 -- 172.21.15.33:0/3336429585 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a801bb40 con 0x5646027b75d0 2024-09-12T12:26:54.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.235+0000 7f759dffb640 1 -- 172.21.15.33:0/3336429585 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f75b0036040 con 0x5646027b75d0 2024-09-12T12:26:54.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.235+0000 7f759dffb640 1 -- 172.21.15.33:0/3336429585 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a8039b20 con 0x5646027b75d0 2024-09-12T12:26:54.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.236+0000 7f75c0c7d740 1 -- 172.21.15.33:0/3336429585 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646027b75d0 msgr2=0x5646027ce3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:54.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.236+0000 7f75c0c7d740 1 --2- 172.21.15.33:0/3336429585 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646027b75d0 0x5646027ce3a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f75a800fc20 tx=0x7f75a801e070 comp rx=0 tx=0).stop 2024-09-12T12:26:54.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.236+0000 7f75c0c7d740 1 -- 172.21.15.33:0/3336429585 shutdown_connections 2024-09-12T12:26:54.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.236+0000 7f75c0c7d740 1 --2- 172.21.15.33:0/3336429585 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5646027c2370 0x5646027ba660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.236+0000 7f75c0c7d740 1 --2- 172.21.15.33:0/3336429585 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646027b8b40 0x5646027ba120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.236+0000 7f75c0c7d740 1 --2- 172.21.15.33:0/3336429585 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646027b75d0 0x5646027ce3a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.236+0000 7f75c0c7d740 1 -- 172.21.15.33:0/3336429585 >> 172.21.15.33:0/3336429585 conn(0x564602780310 msgr2=0x5646027c0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:54.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.236+0000 7f75c0c7d740 1 -- 172.21.15.33:0/3336429585 shutdown_connections 2024-09-12T12:26:54.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.237+0000 7f75c0c7d740 1 -- 172.21.15.33:0/3336429585 wait complete. 2024-09-12T12:26:54.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.237+0000 7f75c0c7d740 1 -- start start 2024-09-12T12:26:54.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.237+0000 7f75c0c7d740 1 Processor -- start 2024-09-12T12:26:54.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.237+0000 7f75c0c7d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5646027b75d0 0x5646027cab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:54.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.238+0000 7f75b7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5646027b75d0 0x5646027cab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:54.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.238+0000 7f75b7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5646027b75d0 0x5646027cab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42518/0 (socket says 172.21.15.33:42518) 2024-09-12T12:26:54.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.238+0000 7f75b7fff640 1 -- 172.21.15.33:0/474349439 learned_addr learned my addr 172.21.15.33:0/474349439 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:54.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.238+0000 7f75c0c7d740 1 --2- 172.21.15.33:0/474349439 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646027b8b40 0x5646027c5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:54.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.238+0000 7f75c0c7d740 1 --2- 172.21.15.33:0/474349439 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646027c2370 0x5646027c63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:54.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.238+0000 7f75c0c7d740 1 -- 172.21.15.33:0/474349439 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f75b81af370 con 0x5646027b75d0 2024-09-12T12:26:54.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.238+0000 7f75c0c7d740 1 -- 172.21.15.33:0/474349439 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f75b81b07e0 con 0x5646027b8b40 2024-09-12T12:26:54.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.238+0000 7f75c0c7d740 1 -- 172.21.15.33:0/474349439 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f75b81afa40 con 0x5646027c2370 2024-09-12T12:26:54.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.238+0000 7f75b77fe640 1 --2- 172.21.15.33:0/474349439 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646027b8b40 0x5646027c5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:54.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.239+0000 7f75bce41640 1 --2- 172.21.15.33:0/474349439 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646027c2370 0x5646027c63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:54.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.239+0000 7f75b7fff640 1 -- 172.21.15.33:0/474349439 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646027c2370 msgr2=0x5646027c63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:54.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.239+0000 7f75b7fff640 1 --2- 172.21.15.33:0/474349439 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646027c2370 0x5646027c63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.239+0000 7f75b7fff640 1 -- 172.21.15.33:0/474349439 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646027b8b40 msgr2=0x5646027c5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:54.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.239+0000 7f75b7fff640 1 --2- 172.21.15.33:0/474349439 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646027b8b40 0x5646027c5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.239+0000 7f75b7fff640 1 -- 172.21.15.33:0/474349439 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646027c6c20 con 0x5646027b75d0 2024-09-12T12:26:54.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.239+0000 7f75c0c7d740 10 client.0 _ll_register_callbacks cb 0x7f75a800fef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:26:54.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.239+0000 7f75b7fff640 1 --2- 172.21.15.33:0/474349439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5646027b75d0 0x5646027cab80 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f75a80044a0 tx=0x7f75a8005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d51b56d9975bd274 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:54.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.239+0000 7f75c0c7d740 1 -- 172.21.15.33:0/474349439 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75b0036040 con 0x5646027b75d0 2024-09-12T12:26:54.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.239+0000 7f75977fe640 10 client.15390 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:26:54.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.239+0000 7f75977fe640 1 -- 172.21.15.33:0/474349439 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a8051050 con 0x5646027b75d0 2024-09-12T12:26:54.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.239+0000 7f75977fe640 1 -- 172.21.15.33:0/474349439 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f75a8039a50 con 0x5646027b75d0 2024-09-12T12:26:54.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.240+0000 7f75977fe640 1 -- 172.21.15.33:0/474349439 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f75a8016040 con 0x5646027b75d0 2024-09-12T12:26:54.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.240+0000 7f75c0c7d740 10 client.15390 fetch_fsmap learned FSMap version 25 2024-09-12T12:26:54.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.240+0000 7f75c0c7d740 1 -- 172.21.15.33:0/474349439 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({fsmap=25}) -- 0x56460283c670 con 0x5646027b75d0 2024-09-12T12:26:54.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.240+0000 7f75977fe640 1 -- 172.21.15.33:0/474349439 <== mon.0 v2:172.21.15.33:3300/0 4 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f75a8054020 con 0x5646027b75d0 2024-09-12T12:26:54.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.240+0000 7f75c0c7d740 10 client.15390 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T12:26:54.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.240+0000 7f75c0c7d740 10 client.15390 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-12T12:26:54.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.240+0000 7f75c0c7d740 20 client.15390 populate_metadata read hostname 'smithi033' 2024-09-12T12:26:54.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.240+0000 7f75c0c7d740 1 --2- 172.21.15.33:0/474349439 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x56460283cd20 0x56460283f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:54.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.240+0000 7f75c0c7d740 4 client.15390 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:26:54.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.240+0000 7f75c0c7d740 1 -- 172.21.15.33:0/474349439 --> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564602724d70 con 0x56460283cd20 2024-09-12T12:26:54.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.240+0000 7f75b77fe640 1 --2- 172.21.15.33:0/474349439 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x56460283cd20 0x56460283f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:54.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.241+0000 7f75977fe640 10 client.15390 ms_handle_connect on v2:172.21.15.102:6836/2409953270 2024-09-12T12:26:54.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.241+0000 7f75b77fe640 1 --2- 172.21.15.33:0/474349439 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x56460283cd20 0x56460283f1e0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=59e32f37bcd6b0fd server_cookie=52efa19798f697f6 in_seq=0 out_seq=0 2024-09-12T12:26:54.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.241+0000 7f75977fe640 1 -- 172.21.15.33:0/474349439 <== mds.1 v2:172.21.15.102:6836/2409953270 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564602724d70 con 0x56460283cd20 2024-09-12T12:26:54.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.241+0000 7f75977fe640 10 client.15390 handle_command_reply: tid=0 2024-09-12T12:26:54.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.241+0000 7f75c0c7d740 1 client.15390 shutdown 2024-09-12T12:26:54.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.241+0000 7f75c0c7d740 1 -- 172.21.15.33:0/474349439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5646027b75d0 msgr2=0x5646027cab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:54.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.241+0000 7f75c0c7d740 1 --2- 172.21.15.33:0/474349439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5646027b75d0 0x5646027cab80 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f75a80044a0 tx=0x7f75a8005710 comp rx=0 tx=0).stop 2024-09-12T12:26:54.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.242+0000 7f75c0c7d740 1 -- 172.21.15.33:0/474349439 shutdown_connections 2024-09-12T12:26:54.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.242+0000 7f75c0c7d740 1 --2- 172.21.15.33:0/474349439 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x56460283cd20 0x56460283f1e0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.242+0000 7f75c0c7d740 1 --2- 172.21.15.33:0/474349439 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646027c2370 0x5646027c63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.242+0000 7f75c0c7d740 1 --2- 172.21.15.33:0/474349439 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646027b8b40 0x5646027c5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.242+0000 7f75977fe640 0 client.15390 ms_handle_reset on v2:172.21.15.102:6836/2409953270 2024-09-12T12:26:54.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.242+0000 7f75c0c7d740 1 --2- 172.21.15.33:0/474349439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5646027b75d0 0x5646027cab80 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.242+0000 7f75c0c7d740 1 -- 172.21.15.33:0/474349439 >> 172.21.15.33:0/474349439 conn(0x564602780310 msgr2=0x5646027be7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:54.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.242+0000 7f75c0c7d740 1 -- 172.21.15.33:0/474349439 shutdown_connections 2024-09-12T12:26:54.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.242+0000 7f75c0c7d740 1 -- 172.21.15.33:0/474349439 wait complete. 2024-09-12T12:26:54.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.242+0000 7f75c0c7d740 20 client.15390 trim_cache size 0 max 16384 2024-09-12T12:26:54.246 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-09-12T12:26:54.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.243+0000 7f75be8a4640 1 -- 172.21.15.33:0/3076036957 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f75a00a2c00 msgr2=0x7f75a00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:54.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.243+0000 7f75be8a4640 1 --2- 172.21.15.33:0/3076036957 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f75a00a2c00 0x7f75a00a50c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x5646027b4ac0 tx=0x7f75a8005f90 comp rx=0 tx=0).stop 2024-09-12T12:26:54.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.243+0000 7f75be8a4640 1 -- 172.21.15.33:0/3076036957 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75b8101360 msgr2=0x7f75b819a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:54.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.243+0000 7f75be8a4640 1 --2- 172.21.15.33:0/3076036957 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75b8101360 0x7f75b819a930 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f75ac00d9d0 tx=0x7f75ac00de90 comp rx=0 tx=0).stop 2024-09-12T12:26:54.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.243+0000 7f75be8a4640 1 -- 172.21.15.33:0/3076036957 shutdown_connections 2024-09-12T12:26:54.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.243+0000 7f75be8a4640 1 --2- 172.21.15.33:0/3076036957 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f75a00a2c00 0x7f75a00a50c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.243+0000 7f75be8a4640 1 --2- 172.21.15.33:0/3076036957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75b810e4d0 0x7f75b819ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.243+0000 7f75be8a4640 1 --2- 172.21.15.33:0/3076036957 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75b8101360 0x7f75b819a930 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.243+0000 7f75be8a4640 1 --2- 172.21.15.33:0/3076036957 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f75b81009b0 0x7f75b819a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.243+0000 7f75be8a4640 1 -- 172.21.15.33:0/3076036957 >> 172.21.15.33:0/3076036957 conn(0x7f75b80fc7d0 msgr2=0x7f75b8110650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:54.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.243+0000 7f75be8a4640 1 -- 172.21.15.33:0/3076036957 shutdown_connections 2024-09-12T12:26:54.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:54.243+0000 7f75be8a4640 1 -- 172.21.15.33:0/3076036957 wait complete. 2024-09-12T12:26:55.050 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T12:26:55.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:55 smithi043 ceph-mon[34144]: pgmap v377: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-12T12:26:55.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:55 smithi102 ceph-mon[34799]: pgmap v377: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-12T12:26:55.438 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:26:55.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:55 smithi033 ceph-mon[31246]: pgmap v377: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-12T12:26:55.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.989+0000 7fd65f33d640 1 -- 172.21.15.33:0/4167525888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6581036e0 msgr2=0x7fd658107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:55.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.989+0000 7fd65f33d640 1 --2- 172.21.15.33:0/4167525888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6581036e0 0x7fd658107b90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd648009930 tx=0x7fd64802a420 comp rx=0 tx=0).stop 2024-09-12T12:26:55.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.989+0000 7fd65f33d640 1 -- 172.21.15.33:0/4167525888 shutdown_connections 2024-09-12T12:26:55.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.989+0000 7fd65f33d640 1 --2- 172.21.15.33:0/4167525888 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6581082a0 0x7fd65810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:55.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.989+0000 7fd65f33d640 1 --2- 172.21.15.33:0/4167525888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6581036e0 0x7fd658107b90 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:55.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.989+0000 7fd65f33d640 1 --2- 172.21.15.33:0/4167525888 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd658102d30 0x7fd658103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:55.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.990+0000 7fd65f33d640 1 -- 172.21.15.33:0/4167525888 >> 172.21.15.33:0/4167525888 conn(0x7fd6580fc7d0 msgr2=0x7fd6580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:55.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.990+0000 7fd65f33d640 1 -- 172.21.15.33:0/4167525888 shutdown_connections 2024-09-12T12:26:55.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.990+0000 7fd65f33d640 1 -- 172.21.15.33:0/4167525888 wait complete. 2024-09-12T12:26:55.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.990+0000 7fd65f33d640 1 Processor -- start 2024-09-12T12:26:55.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.991+0000 7fd65f33d640 1 -- start start 2024-09-12T12:26:55.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.991+0000 7fd65f33d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd658102d30 0x7fd658198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:55.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.991+0000 7fd65f33d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6581036e0 0x7fd658198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:55.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.991+0000 7fd65c8d8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6581036e0 0x7fd658198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:55.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.991+0000 7fd65d0d9640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd658102d30 0x7fd658198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:55.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.991+0000 7fd65d0d9640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd658102d30 0x7fd658198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:42446/0 (socket says 172.21.15.33:42446) 2024-09-12T12:26:55.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.991+0000 7fd65c8d8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6581036e0 0x7fd658198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42532/0 (socket says 172.21.15.33:42532) 2024-09-12T12:26:55.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.991+0000 7fd65f33d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6581082a0 0x7fd65819cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:55.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.991+0000 7fd65c8d8640 1 -- 172.21.15.33:0/996618591 learned_addr learned my addr 172.21.15.33:0/996618591 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:55.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.991+0000 7fd65f33d640 1 -- 172.21.15.33:0/996618591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd658111f40 con 0x7fd6581036e0 2024-09-12T12:26:55.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.991+0000 7fd65f33d640 1 -- 172.21.15.33:0/996618591 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd658111dc0 con 0x7fd658102d30 2024-09-12T12:26:55.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.991+0000 7fd65f33d640 1 -- 172.21.15.33:0/996618591 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd6581120c0 con 0x7fd6581082a0 2024-09-12T12:26:55.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.992+0000 7fd65d8da640 1 --2- 172.21.15.33:0/996618591 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6581082a0 0x7fd65819cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:55.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.992+0000 7fd65d0d9640 1 -- 172.21.15.33:0/996618591 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6581082a0 msgr2=0x7fd65819cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:55.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.992+0000 7fd65d0d9640 1 --2- 172.21.15.33:0/996618591 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6581082a0 0x7fd65819cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:55.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.992+0000 7fd65d0d9640 1 -- 172.21.15.33:0/996618591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6581036e0 msgr2=0x7fd658198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:55.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.992+0000 7fd65d0d9640 1 --2- 172.21.15.33:0/996618591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6581036e0 0x7fd658198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:55.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.992+0000 7fd65d0d9640 1 -- 172.21.15.33:0/996618591 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd65819d4d0 con 0x7fd658102d30 2024-09-12T12:26:55.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.992+0000 7fd65c8d8640 1 --2- 172.21.15.33:0/996618591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6581036e0 0x7fd658198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:55.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.992+0000 7fd65d0d9640 1 --2- 172.21.15.33:0/996618591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd658102d30 0x7fd658198520 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd654009d20 tx=0x7fd65400c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:55.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.992+0000 7fd64e7fc640 1 -- 172.21.15.33:0/996618591 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd65401f070 con 0x7fd658102d30 2024-09-12T12:26:55.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.992+0000 7fd65f33d640 1 -- 172.21.15.33:0/996618591 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd65819d7c0 con 0x7fd658102d30 2024-09-12T12:26:55.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.992+0000 7fd64e7fc640 1 -- 172.21.15.33:0/996618591 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd654011750 con 0x7fd658102d30 2024-09-12T12:26:55.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.992+0000 7fd64e7fc640 1 -- 172.21.15.33:0/996618591 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd65401a690 con 0x7fd658102d30 2024-09-12T12:26:55.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.992+0000 7fd65f33d640 1 -- 172.21.15.33:0/996618591 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6581008c0 con 0x7fd658102d30 2024-09-12T12:26:55.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.996+0000 7fd661716740 1 Processor -- start 2024-09-12T12:26:55.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.996+0000 7fd661716740 1 -- start start 2024-09-12T12:26:56.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.997+0000 7fd661716740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5555cf634b40 0x5555cf633090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.997+0000 7fd661716740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5555cf6335d0 0x5555cf633a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.997+0000 7fd661716740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5555cf63e370 0x5555cf640760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.997+0000 7fd65d8da640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5555cf634b40 0x5555cf633090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.997+0000 7fd65d8da640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5555cf634b40 0x5555cf633090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42548/0 (socket says 172.21.15.33:42548) 2024-09-12T12:26:56.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.997+0000 7fd65d8da640 1 -- 172.21.15.33:0/2396608504 learned_addr learned my addr 172.21.15.33:0/2396608504 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:56.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.997+0000 7fd65c8d8640 1 --2- 172.21.15.33:0/2396608504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5555cf63e370 0x5555cf640760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.997+0000 7fd661716740 1 -- 172.21.15.33:0/2396608504 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5555cf5992f0 con 0x5555cf634b40 2024-09-12T12:26:56.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.997+0000 7fd661716740 1 -- 172.21.15.33:0/2396608504 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5555cf540cf0 con 0x5555cf63e370 2024-09-12T12:26:56.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.997+0000 7fd661716740 1 -- 172.21.15.33:0/2396608504 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5555cf5952b0 con 0x5555cf6335d0 2024-09-12T12:26:56.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.997+0000 7fd64e7fc640 1 -- 172.21.15.33:0/996618591 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd654022070 con 0x7fd658102d30 2024-09-12T12:26:56.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.998+0000 7fd65d0d9640 1 --2- 172.21.15.33:0/2396608504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5555cf6335d0 0x5555cf633a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.998+0000 7fd65d8da640 1 -- 172.21.15.33:0/2396608504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5555cf6335d0 msgr2=0x5555cf633a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:56.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.998+0000 7fd65d8da640 1 --2- 172.21.15.33:0/2396608504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5555cf6335d0 0x5555cf633a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.998+0000 7fd65d8da640 1 -- 172.21.15.33:0/2396608504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5555cf63e370 msgr2=0x5555cf640760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:56.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.998+0000 7fd65d8da640 1 --2- 172.21.15.33:0/2396608504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5555cf63e370 0x5555cf640760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.998+0000 7fd65d8da640 1 -- 172.21.15.33:0/2396608504 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555cf5253a0 con 0x5555cf634b40 2024-09-12T12:26:56.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.999+0000 7fd65d8da640 1 --2- 172.21.15.33:0/2396608504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5555cf634b40 0x5555cf633090 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd650009d70 tx=0x7fd65000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a72674a07ece908a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:56.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.999+0000 7fd64e7fc640 1 --2- 172.21.15.33:0/996618591 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd6440a2c00 0x7fd6440a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.999+0000 7fd6437fe640 1 -- 172.21.15.33:0/2396608504 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd650003970 con 0x5555cf634b40 2024-09-12T12:26:56.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.999+0000 7fd65d0d9640 1 --2- 172.21.15.33:0/996618591 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd6440a2c00 0x7fd6440a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.999+0000 7fd6437fe640 1 -- 172.21.15.33:0/2396608504 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd650004030 con 0x5555cf634b40 2024-09-12T12:26:56.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.999+0000 7fd6437fe640 1 -- 172.21.15.33:0/2396608504 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd650011770 con 0x5555cf634b40 2024-09-12T12:26:56.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:55.999+0000 7fd64e7fc640 1 -- 172.21.15.33:0/996618591 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fd6540d3050 con 0x7fd658102d30 2024-09-12T12:26:56.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.000+0000 7fd661716740 1 -- 172.21.15.33:0/2396608504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5555cf634b40 msgr2=0x5555cf633090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:56.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.000+0000 7fd65d0d9640 1 --2- 172.21.15.33:0/996618591 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd6440a2c00 0x7fd6440a50c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd6540d0b30 tx=0x7fd65400cf90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:56.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.000+0000 7fd661716740 1 --2- 172.21.15.33:0/2396608504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5555cf634b40 0x5555cf633090 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd650009d70 tx=0x7fd65000f730 comp rx=0 tx=0).stop 2024-09-12T12:26:56.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.001+0000 7fd661716740 1 -- 172.21.15.33:0/2396608504 shutdown_connections 2024-09-12T12:26:56.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.001+0000 7fd661716740 1 --2- 172.21.15.33:0/2396608504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5555cf63e370 0x5555cf640760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.001+0000 7fd661716740 1 --2- 172.21.15.33:0/2396608504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5555cf6335d0 0x5555cf633a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.001+0000 7fd661716740 1 --2- 172.21.15.33:0/2396608504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5555cf634b40 0x5555cf633090 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.001+0000 7fd661716740 1 -- 172.21.15.33:0/2396608504 >> 172.21.15.33:0/2396608504 conn(0x5555cf5fc310 msgr2=0x5555cf62fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:56.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.001+0000 7fd661716740 1 -- 172.21.15.33:0/2396608504 shutdown_connections 2024-09-12T12:26:56.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.001+0000 7fd661716740 1 -- 172.21.15.33:0/2396608504 wait complete. 2024-09-12T12:26:56.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.002+0000 7fd661716740 1 -- start start 2024-09-12T12:26:56.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.002+0000 7fd661716740 1 Processor -- start 2024-09-12T12:26:56.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.003+0000 7fd661716740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5555cf6335d0 0x5555cf63ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.003+0000 7fd661716740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5555cf634b40 0x5555cf63b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.003+0000 7fd661716740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5555cf63e370 0x5555cf63b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.003+0000 7fd661716740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5555cf641070 con 0x5555cf63e370 2024-09-12T12:26:56.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.003+0000 7fd661716740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5555cf554060 con 0x5555cf6335d0 2024-09-12T12:26:56.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.003+0000 7fd661716740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5555cf6411f0 con 0x5555cf634b40 2024-09-12T12:26:56.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.003+0000 7fd65d8da640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5555cf6335d0 0x5555cf63ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.003+0000 7fd65d8da640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5555cf6335d0 0x5555cf63ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:42458/0 (socket says 172.21.15.33:42458) 2024-09-12T12:26:56.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.003+0000 7fd65d8da640 1 -- 172.21.15.33:0/3282682239 learned_addr learned my addr 172.21.15.33:0/3282682239 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:56.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.003+0000 7fd661716740 10 client.0 _ll_register_callbacks cb 0x5555cf2a78c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:26:56.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.003+0000 7fd65d8da640 1 --2- 172.21.15.33:0/3282682239 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5555cf63e370 0x5555cf63b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.004+0000 7fd65d8da640 1 -- 172.21.15.33:0/3282682239 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5555cf634b40 msgr2=0x5555cf63b060 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T12:26:56.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.004+0000 7fd65d8da640 1 --2- 172.21.15.33:0/3282682239 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5555cf634b40 0x5555cf63b060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.004+0000 7fd65d8da640 1 -- 172.21.15.33:0/3282682239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5555cf6335d0 msgr2=0x5555cf63ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:56.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.004+0000 7fd65d8da640 1 --2- 172.21.15.33:0/3282682239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5555cf6335d0 0x5555cf63ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.004+0000 7fd65d8da640 1 -- 172.21.15.33:0/3282682239 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555cf30a3c0 con 0x5555cf63e370 2024-09-12T12:26:56.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.004+0000 7fd65d8da640 1 --2- 172.21.15.33:0/3282682239 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5555cf63e370 0x5555cf63b7f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fd6500047f0 tx=0x7fd650000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6d4282ca9e610dc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:56.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.004+0000 7fd640ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:26:56.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.004+0000 7fd640ff9640 1 -- 172.21.15.33:0/3282682239 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd650024040 con 0x5555cf63e370 2024-09-12T12:26:56.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.004+0000 7fd640ff9640 1 -- 172.21.15.33:0/3282682239 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fd650003da0 con 0x5555cf63e370 2024-09-12T12:26:56.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.004+0000 7fd661716740 1 -- 172.21.15.33:0/3282682239 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd650004030 con 0x5555cf63e370 2024-09-12T12:26:56.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.004+0000 7fd640ff9640 1 -- 172.21.15.33:0/3282682239 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd650011440 con 0x5555cf63e370 2024-09-12T12:26:56.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.005+0000 7fd661716740 10 client.15402 fetch_fsmap learned FSMap version 25 2024-09-12T12:26:56.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.005+0000 7fd661716740 1 -- 172.21.15.33:0/3282682239 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5555cf64cb60 con 0x5555cf63e370 2024-09-12T12:26:56.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.005+0000 7fd640ff9640 1 -- 172.21.15.33:0/3282682239 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd650011a90 con 0x5555cf63e370 2024-09-12T12:26:56.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.005+0000 7fd640ff9640 1 -- 172.21.15.33:0/3282682239 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fd65002b4a0 con 0x5555cf63e370 2024-09-12T12:26:56.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.005+0000 7fd661716740 10 client.15402 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T12:26:56.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.005+0000 7fd661716740 10 client.15402 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:26:56.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.005+0000 7fd661716740 20 client.15402 populate_metadata read hostname 'smithi033' 2024-09-12T12:26:56.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.005+0000 7fd661716740 1 --2- 172.21.15.33:0/3282682239 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5555cf64df60 0x5555cf650350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.005+0000 7fd661716740 4 client.15402 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:26:56.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.005+0000 7fd661716740 1 -- 172.21.15.33:0/3282682239 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fd650004030 con 0x5555cf64df60 2024-09-12T12:26:56.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.006+0000 7fd65c8d8640 1 --2- 172.21.15.33:0/3282682239 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5555cf64df60 0x5555cf650350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.007+0000 7fd640ff9640 10 client.15402 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:26:56.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.007+0000 7fd65c8d8640 1 --2- 172.21.15.33:0/3282682239 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5555cf64df60 0x5555cf650350 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8cb3673c79e98cf server_cookie=dd206444feafbe41 in_seq=0 out_seq=0 2024-09-12T12:26:56.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.008+0000 7fd640ff9640 1 -- 172.21.15.33:0/3282682239 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fd650004030 con 0x5555cf64df60 2024-09-12T12:26:56.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.008+0000 7fd640ff9640 10 client.15402 handle_command_reply: tid=0 2024-09-12T12:26:56.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.008+0000 7fd661716740 1 client.15402 shutdown 2024-09-12T12:26:56.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.008+0000 7fd661716740 1 -- 172.21.15.33:0/3282682239 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5555cf63e370 msgr2=0x5555cf63b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:56.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.008+0000 7fd661716740 1 --2- 172.21.15.33:0/3282682239 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5555cf63e370 0x5555cf63b7f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fd6500047f0 tx=0x7fd650000f40 comp rx=0 tx=0).stop 2024-09-12T12:26:56.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.008+0000 7fd661716740 1 -- 172.21.15.33:0/3282682239 shutdown_connections 2024-09-12T12:26:56.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.008+0000 7fd661716740 1 --2- 172.21.15.33:0/3282682239 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5555cf64df60 0x5555cf650350 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.008+0000 7fd640ff9640 0 client.15402 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:26:56.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.008+0000 7fd661716740 1 --2- 172.21.15.33:0/3282682239 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5555cf63e370 0x5555cf63b7f0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.008+0000 7fd661716740 1 --2- 172.21.15.33:0/3282682239 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5555cf634b40 0x5555cf63b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.008+0000 7fd661716740 1 --2- 172.21.15.33:0/3282682239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5555cf6335d0 0x5555cf63ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.008+0000 7fd661716740 1 -- 172.21.15.33:0/3282682239 >> 172.21.15.33:0/3282682239 conn(0x5555cf5fc310 msgr2=0x5555cf635960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:56.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.009+0000 7fd661716740 1 -- 172.21.15.33:0/3282682239 shutdown_connections 2024-09-12T12:26:56.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.009+0000 7fd661716740 1 -- 172.21.15.33:0/3282682239 wait complete. 2024-09-12T12:26:56.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.009+0000 7fd661716740 20 client.15402 trim_cache size 0 max 16384 2024-09-12T12:26:56.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.035+0000 7fd661716740 1 Processor -- start 2024-09-12T12:26:56.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.035+0000 7fd661716740 1 -- start start 2024-09-12T12:26:56.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.035+0000 7fd661716740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5555cf6335d0 0x5555cf655ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.035+0000 7fd661716740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5555cf634b40 0x5555cf656000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.035+0000 7fd661716740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5555cf63e370 0x5555cf646470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.035+0000 7fd661716740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd6581af420 con 0x5555cf6335d0 2024-09-12T12:26:56.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.035+0000 7fd661716740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd6581accf0 con 0x5555cf63e370 2024-09-12T12:26:56.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.035+0000 7fd661716740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd6581aab40 con 0x5555cf634b40 2024-09-12T12:26:56.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.036+0000 7fd65d8da640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5555cf6335d0 0x5555cf655ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.036+0000 7fd65d8da640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5555cf6335d0 0x5555cf655ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42570/0 (socket says 172.21.15.33:42570) 2024-09-12T12:26:56.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.036+0000 7fd65d8da640 1 -- 172.21.15.33:0/1233237187 learned_addr learned my addr 172.21.15.33:0/1233237187 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:56.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.036+0000 7fd65c8d8640 1 --2- 172.21.15.33:0/1233237187 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5555cf634b40 0x5555cf656000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.036+0000 7fd65d8da640 1 --2- 172.21.15.33:0/1233237187 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5555cf63e370 0x5555cf646470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.037+0000 7fd65c8d8640 1 -- 172.21.15.33:0/1233237187 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5555cf63e370 msgr2=0x5555cf646470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:56.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.037+0000 7fd65c8d8640 1 --2- 172.21.15.33:0/1233237187 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5555cf63e370 0x5555cf646470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.037+0000 7fd65c8d8640 1 -- 172.21.15.33:0/1233237187 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5555cf6335d0 msgr2=0x5555cf655ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:56.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.037+0000 7fd65c8d8640 1 --2- 172.21.15.33:0/1233237187 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5555cf6335d0 0x5555cf655ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.037+0000 7fd65c8d8640 1 -- 172.21.15.33:0/1233237187 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555cf63a010 con 0x5555cf634b40 2024-09-12T12:26:56.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.037+0000 7fd65d8da640 1 --2- 172.21.15.33:0/1233237187 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5555cf6335d0 0x5555cf655ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:56.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.037+0000 7fd65c8d8640 1 --2- 172.21.15.33:0/1233237187 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5555cf634b40 0x5555cf656000 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd648031440 tx=0x7fd648005a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20f483de26295d46 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:56.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.037+0000 7fd642ffd640 1 -- 172.21.15.33:0/1233237187 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd648049020 con 0x5555cf634b40 2024-09-12T12:26:56.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.037+0000 7fd642ffd640 1 -- 172.21.15.33:0/1233237187 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd648005590 con 0x5555cf634b40 2024-09-12T12:26:56.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.037+0000 7fd642ffd640 1 -- 172.21.15.33:0/1233237187 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd648035040 con 0x5555cf634b40 2024-09-12T12:26:56.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.038+0000 7fd661716740 1 -- 172.21.15.33:0/1233237187 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5555cf634b40 msgr2=0x5555cf656000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:56.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.038+0000 7fd661716740 1 --2- 172.21.15.33:0/1233237187 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5555cf634b40 0x5555cf656000 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd648031440 tx=0x7fd648005a20 comp rx=0 tx=0).stop 2024-09-12T12:26:56.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.038+0000 7fd661716740 1 -- 172.21.15.33:0/1233237187 shutdown_connections 2024-09-12T12:26:56.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.038+0000 7fd661716740 1 --2- 172.21.15.33:0/1233237187 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5555cf63e370 0x5555cf646470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.038+0000 7fd661716740 1 --2- 172.21.15.33:0/1233237187 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5555cf634b40 0x5555cf656000 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.038+0000 7fd661716740 1 --2- 172.21.15.33:0/1233237187 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5555cf6335d0 0x5555cf655ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.038+0000 7fd661716740 1 -- 172.21.15.33:0/1233237187 >> 172.21.15.33:0/1233237187 conn(0x5555cf5fc310 msgr2=0x5555cf63d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:56.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.039+0000 7fd661716740 1 -- 172.21.15.33:0/1233237187 shutdown_connections 2024-09-12T12:26:56.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.039+0000 7fd661716740 1 -- 172.21.15.33:0/1233237187 wait complete. 2024-09-12T12:26:56.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.039+0000 7fd661716740 1 -- start start 2024-09-12T12:26:56.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.040+0000 7fd661716740 1 Processor -- start 2024-09-12T12:26:56.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.040+0000 7fd661716740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5555cf6335d0 0x5555cf646480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.040+0000 7fd661716740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5555cf634b40 0x5555cf6469c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.040+0000 7fd661716740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5555cf63e370 0x5555cf643450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.040+0000 7fd661716740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd6581ab1b0 con 0x5555cf6335d0 2024-09-12T12:26:56.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.040+0000 7fd661716740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd6581ac620 con 0x5555cf634b40 2024-09-12T12:26:56.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.040+0000 7fd661716740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd6581ab880 con 0x5555cf63e370 2024-09-12T12:26:56.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.040+0000 7fd661716740 10 client.0 _ll_register_callbacks cb 0x7fd650009bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:26:56.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.040+0000 7fd65d8da640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5555cf6335d0 0x5555cf646480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.040+0000 7fd65d8da640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5555cf6335d0 0x5555cf646480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42576/0 (socket says 172.21.15.33:42576) 2024-09-12T12:26:56.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.040+0000 7fd65d8da640 1 -- 172.21.15.33:0/3204903543 learned_addr learned my addr 172.21.15.33:0/3204903543 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:56.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.040+0000 7fd65c8d8640 1 --2- 172.21.15.33:0/3204903543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5555cf634b40 0x5555cf6469c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.040+0000 7fd65d8da640 1 --2- 172.21.15.33:0/3204903543 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5555cf63e370 0x5555cf643450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.041+0000 7fd65c8d8640 1 -- 172.21.15.33:0/3204903543 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5555cf63e370 msgr2=0x5555cf643450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:56.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.041+0000 7fd65c8d8640 1 --2- 172.21.15.33:0/3204903543 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5555cf63e370 0x5555cf643450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.041+0000 7fd65c8d8640 1 -- 172.21.15.33:0/3204903543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5555cf6335d0 msgr2=0x5555cf646480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:56.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.041+0000 7fd65c8d8640 1 --2- 172.21.15.33:0/3204903543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5555cf6335d0 0x5555cf646480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.041+0000 7fd65c8d8640 1 -- 172.21.15.33:0/3204903543 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555cf643990 con 0x5555cf634b40 2024-09-12T12:26:56.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.041+0000 7fd65d8da640 1 --2- 172.21.15.33:0/3204903543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5555cf6335d0 0x5555cf646480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:56.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.041+0000 7fd65c8d8640 1 --2- 172.21.15.33:0/3204903543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5555cf634b40 0x5555cf6469c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x5555cf633c00 tx=0x7fd648009680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79c42cd795a901f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:56.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.041+0000 7fd640ff9640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:26:56.045 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-09-12T12:26:56.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.041+0000 7fd640ff9640 1 -- 172.21.15.33:0/3204903543 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd648035040 con 0x5555cf634b40 2024-09-12T12:26:56.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.041+0000 7fd640ff9640 1 -- 172.21.15.33:0/3204903543 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fd648004970 con 0x5555cf634b40 2024-09-12T12:26:56.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.041+0000 7fd661716740 1 -- 172.21.15.33:0/3204903543 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd648005590 con 0x5555cf634b40 2024-09-12T12:26:56.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.042+0000 7fd640ff9640 1 -- 172.21.15.33:0/3204903543 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd648004b70 con 0x5555cf634b40 2024-09-12T12:26:56.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.042+0000 7fd661716740 10 client.25052 fetch_fsmap learned FSMap version 25 2024-09-12T12:26:56.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.042+0000 7fd661716740 1 -- 172.21.15.33:0/3204903543 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5555cf6c18e0 con 0x5555cf634b40 2024-09-12T12:26:56.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.042+0000 7fd640ff9640 1 -- 172.21.15.33:0/3204903543 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd648005590 con 0x5555cf634b40 2024-09-12T12:26:56.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.042+0000 7fd640ff9640 1 -- 172.21.15.33:0/3204903543 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fd6480314a0 con 0x5555cf634b40 2024-09-12T12:26:56.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.042+0000 7fd661716740 10 client.25052 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T12:26:56.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.042+0000 7fd661716740 10 client.25052 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:26:56.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.042+0000 7fd661716740 20 client.25052 populate_metadata read hostname 'smithi033' 2024-09-12T12:26:56.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.042+0000 7fd661716740 1 --2- 172.21.15.33:0/3204903543 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5555cf6c1fb0 0x5555cf6c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.042+0000 7fd661716740 4 client.25052 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:26:56.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.042+0000 7fd661716740 1 -- 172.21.15.33:0/3204903543 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5555cf5a6860 con 0x5555cf6c1fb0 2024-09-12T12:26:56.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.042+0000 7fd65d8da640 1 --2- 172.21.15.33:0/3204903543 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5555cf6c1fb0 0x5555cf6c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.043+0000 7fd640ff9640 10 client.25052 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:26:56.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.043+0000 7fd65d8da640 1 --2- 172.21.15.33:0/3204903543 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5555cf6c1fb0 0x5555cf6c43d0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99aaf818e862eb65 server_cookie=4bd254da0c396963 in_seq=0 out_seq=0 2024-09-12T12:26:56.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.043+0000 7fd640ff9640 1 -- 172.21.15.33:0/3204903543 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5555cf5a6860 con 0x5555cf6c1fb0 2024-09-12T12:26:56.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.043+0000 7fd640ff9640 10 client.25052 handle_command_reply: tid=0 2024-09-12T12:26:56.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.043+0000 7fd661716740 1 client.25052 shutdown 2024-09-12T12:26:56.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.043+0000 7fd661716740 1 -- 172.21.15.33:0/3204903543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5555cf634b40 msgr2=0x5555cf6469c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:56.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.043+0000 7fd661716740 1 --2- 172.21.15.33:0/3204903543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5555cf634b40 0x5555cf6469c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x5555cf633c00 tx=0x7fd648009680 comp rx=0 tx=0).stop 2024-09-12T12:26:56.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.043+0000 7fd661716740 1 -- 172.21.15.33:0/3204903543 shutdown_connections 2024-09-12T12:26:56.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.043+0000 7fd661716740 1 --2- 172.21.15.33:0/3204903543 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5555cf6c1fb0 0x5555cf6c43d0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.043+0000 7fd661716740 1 --2- 172.21.15.33:0/3204903543 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5555cf63e370 0x5555cf643450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.043+0000 7fd661716740 1 --2- 172.21.15.33:0/3204903543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5555cf634b40 0x5555cf6469c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.043+0000 7fd640ff9640 0 client.25052 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:26:56.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.043+0000 7fd661716740 1 --2- 172.21.15.33:0/3204903543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5555cf6335d0 0x5555cf646480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.043+0000 7fd661716740 1 -- 172.21.15.33:0/3204903543 >> 172.21.15.33:0/3204903543 conn(0x5555cf5fc310 msgr2=0x5555cf649300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:56.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.043+0000 7fd661716740 1 -- 172.21.15.33:0/3204903543 shutdown_connections 2024-09-12T12:26:56.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.043+0000 7fd661716740 1 -- 172.21.15.33:0/3204903543 wait complete. 2024-09-12T12:26:56.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.044+0000 7fd661716740 20 client.25052 trim_cache size 0 max 16384 2024-09-12T12:26:56.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.044+0000 7fd65f33d640 1 -- 172.21.15.33:0/996618591 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd6440a2c00 msgr2=0x7fd6440a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:56.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.044+0000 7fd65f33d640 1 --2- 172.21.15.33:0/996618591 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd6440a2c00 0x7fd6440a50c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd6540d0b30 tx=0x7fd65400cf90 comp rx=0 tx=0).stop 2024-09-12T12:26:56.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.044+0000 7fd65f33d640 1 -- 172.21.15.33:0/996618591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd658102d30 msgr2=0x7fd658198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:56.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.044+0000 7fd65f33d640 1 --2- 172.21.15.33:0/996618591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd658102d30 0x7fd658198520 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd654009d20 tx=0x7fd65400c6a0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.044+0000 7fd65f33d640 1 -- 172.21.15.33:0/996618591 shutdown_connections 2024-09-12T12:26:56.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.044+0000 7fd65f33d640 1 --2- 172.21.15.33:0/996618591 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd6440a2c00 0x7fd6440a50c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.044+0000 7fd65f33d640 1 --2- 172.21.15.33:0/996618591 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6581082a0 0x7fd65819cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.044+0000 7fd65f33d640 1 --2- 172.21.15.33:0/996618591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6581036e0 0x7fd658198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.044+0000 7fd65f33d640 1 --2- 172.21.15.33:0/996618591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd658102d30 0x7fd658198520 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd654009d20 tx=0x7fd65400c6a0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.044+0000 7fd65f33d640 1 -- 172.21.15.33:0/996618591 >> 172.21.15.33:0/996618591 conn(0x7fd6580fc7d0 msgr2=0x7fd658105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:56.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.044+0000 7fd65f33d640 1 -- 172.21.15.33:0/996618591 shutdown_connections 2024-09-12T12:26:56.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:56.044+0000 7fd65f33d640 1 -- 172.21.15.33:0/996618591 wait complete. 2024-09-12T12:26:57.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:57 smithi033 ceph-mon[31246]: pgmap v378: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T12:26:57.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:57 smithi043 ceph-mon[34144]: pgmap v378: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T12:26:57.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:57 smithi102 ceph-mon[34799]: pgmap v378: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T12:26:57.856 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T12:26:57.857 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T12:26:58.151 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:26:58.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.707+0000 7f71256e6640 1 -- 172.21.15.33:0/3583435707 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7120103670 msgr2=0x7f712010bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:58.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.707+0000 7f71256e6640 1 --2- 172.21.15.33:0/3583435707 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7120103670 0x7f712010bb60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f7114009900 tx=0x7f711402a480 comp rx=0 tx=0).stop 2024-09-12T12:26:58.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.707+0000 7f71256e6640 1 -- 172.21.15.33:0/3583435707 shutdown_connections 2024-09-12T12:26:58.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.707+0000 7f71256e6640 1 --2- 172.21.15.33:0/3583435707 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f712010c180 0x7f712010e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.707+0000 7f71256e6640 1 --2- 172.21.15.33:0/3583435707 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7120103670 0x7f712010bb60 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.707+0000 7f71256e6640 1 --2- 172.21.15.33:0/3583435707 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7120102d50 0x7f7120103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.707+0000 7f71256e6640 1 -- 172.21.15.33:0/3583435707 >> 172.21.15.33:0/3583435707 conn(0x7f71200fc7d0 msgr2=0x7f71200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:58.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.707+0000 7f71256e6640 1 -- 172.21.15.33:0/3583435707 shutdown_connections 2024-09-12T12:26:58.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.707+0000 7f71256e6640 1 -- 172.21.15.33:0/3583435707 wait complete. 2024-09-12T12:26:58.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.708+0000 7f71256e6640 1 Processor -- start 2024-09-12T12:26:58.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.708+0000 7f71256e6640 1 -- start start 2024-09-12T12:26:58.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.708+0000 7f71256e6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7120102d50 0x7f71201009b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:58.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.708+0000 7f71256e6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7120103670 0x7f7120100ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:58.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.708+0000 7f71256e6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f712010c180 0x7f7120101430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:58.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.708+0000 7f71256e6640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7120111e80 con 0x7f7120102d50 2024-09-12T12:26:58.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.709+0000 7f71256e6640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7120111d00 con 0x7f7120103670 2024-09-12T12:26:58.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.709+0000 7f71256e6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7120112000 con 0x7f712010c180 2024-09-12T12:26:58.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.709+0000 7f711effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7120102d50 0x7f71201009b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:58.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.709+0000 7f711effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7120102d50 0x7f71201009b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42596/0 (socket says 172.21.15.33:42596) 2024-09-12T12:26:58.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.709+0000 7f711effd640 1 -- 172.21.15.33:0/4049419339 learned_addr learned my addr 172.21.15.33:0/4049419339 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:58.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.709+0000 7f711f7fe640 1 --2- 172.21.15.33:0/4049419339 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f712010c180 0x7f7120101430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:58.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.709+0000 7f711e7fc640 1 --2- 172.21.15.33:0/4049419339 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7120103670 0x7f7120100ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:58.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.709+0000 7f711effd640 1 -- 172.21.15.33:0/4049419339 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f712010c180 msgr2=0x7f7120101430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:58.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.709+0000 7f711effd640 1 --2- 172.21.15.33:0/4049419339 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f712010c180 0x7f7120101430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.709+0000 7f711effd640 1 -- 172.21.15.33:0/4049419339 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7120103670 msgr2=0x7f7120100ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:58.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.709+0000 7f711effd640 1 --2- 172.21.15.33:0/4049419339 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7120103670 0x7f7120100ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.709+0000 7f711effd640 1 -- 172.21.15.33:0/4049419339 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71201a68e0 con 0x7f7120102d50 2024-09-12T12:26:58.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.709+0000 7f711e7fc640 1 --2- 172.21.15.33:0/4049419339 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7120103670 0x7f7120100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:58.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.709+0000 7f711effd640 1 --2- 172.21.15.33:0/4049419339 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7120102d50 0x7f71201009b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f711000d950 tx=0x7f711000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:58.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.710+0000 7f7107fff640 1 -- 172.21.15.33:0/4049419339 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7110017070 con 0x7f7120102d50 2024-09-12T12:26:58.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.710+0000 7f7107fff640 1 -- 172.21.15.33:0/4049419339 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7110009c30 con 0x7f7120102d50 2024-09-12T12:26:58.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.710+0000 7f7107fff640 1 -- 172.21.15.33:0/4049419339 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7110017070 con 0x7f7120102d50 2024-09-12T12:26:58.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.710+0000 7f71256e6640 1 -- 172.21.15.33:0/4049419339 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71201a6bd0 con 0x7f7120102d50 2024-09-12T12:26:58.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.710+0000 7f71256e6640 1 -- 172.21.15.33:0/4049419339 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71201a7090 con 0x7f7120102d50 2024-09-12T12:26:58.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.713+0000 7f7127abf740 1 Processor -- start 2024-09-12T12:26:58.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.713+0000 7f7127abf740 1 -- start start 2024-09-12T12:26:58.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.714+0000 7f7127abf740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fafa35ea80 0x55fafa35ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:58.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.714+0000 7f7127abf740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fafa35f3a0 0x55fafa372010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:58.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.714+0000 7f7127abf740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fafa372550 0x55fafa374940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:58.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.714+0000 7f7127abf740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55fafa2c4280 con 0x55fafa35f3a0 2024-09-12T12:26:58.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.714+0000 7f7127abf740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55fafa26bb10 con 0x55fafa372550 2024-09-12T12:26:58.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.714+0000 7f7127abf740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55fafa2c0240 con 0x55fafa35ea80 2024-09-12T12:26:58.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.714+0000 7f711e7fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fafa372550 0x55fafa374940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:58.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.714+0000 7f711e7fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fafa372550 0x55fafa374940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:42498/0 (socket says 172.21.15.33:42498) 2024-09-12T12:26:58.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.714+0000 7f711e7fc640 1 -- 172.21.15.33:0/1920909677 learned_addr learned my addr 172.21.15.33:0/1920909677 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:58.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.714+0000 7f7107fff640 1 -- 172.21.15.33:0/4049419339 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f71100109a0 con 0x7f7120102d50 2024-09-12T12:26:58.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.714+0000 7f711e7fc640 1 -- 172.21.15.33:0/1920909677 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fafa35ea80 msgr2=0x55fafa35ee60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:26:58.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.714+0000 7f711e7fc640 1 --2- 172.21.15.33:0/1920909677 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fafa35ea80 0x55fafa35ee60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.714+0000 7f711e7fc640 1 -- 172.21.15.33:0/1920909677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fafa35f3a0 msgr2=0x55fafa372010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:58.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.714+0000 7f711e7fc640 1 --2- 172.21.15.33:0/1920909677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fafa35f3a0 0x55fafa372010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.714+0000 7f711e7fc640 1 -- 172.21.15.33:0/1920909677 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fafa2781f0 con 0x55fafa372550 2024-09-12T12:26:58.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.715+0000 7f711e7fc640 1 --2- 172.21.15.33:0/1920909677 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fafa372550 0x55fafa374940 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7114031440 tx=0x7f71140042e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb77590ae313bf60 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:58.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.715+0000 7f71057fa640 1 -- 172.21.15.33:0/1920909677 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7114035030 con 0x55fafa372550 2024-09-12T12:26:58.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.715+0000 7f71057fa640 1 -- 172.21.15.33:0/1920909677 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f71140044d0 con 0x55fafa372550 2024-09-12T12:26:58.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.715+0000 7f71057fa640 1 -- 172.21.15.33:0/1920909677 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71140035f0 con 0x55fafa372550 2024-09-12T12:26:58.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.715+0000 7f7107fff640 1 --2- 172.21.15.33:0/4049419339 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f71080a2d80 0x7f71080a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:58.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.716+0000 7f7107fff640 1 -- 172.21.15.33:0/4049419339 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f71100ce540 con 0x7f7120102d50 2024-09-12T12:26:58.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.716+0000 7f7127abf740 1 -- 172.21.15.33:0/1920909677 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fafa372550 msgr2=0x55fafa374940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:58.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.716+0000 7f711f7fe640 1 --2- 172.21.15.33:0/4049419339 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f71080a2d80 0x7f71080a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:58.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.716+0000 7f7127abf740 1 --2- 172.21.15.33:0/1920909677 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fafa372550 0x55fafa374940 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7114031440 tx=0x7f71140042e0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.717+0000 7f711f7fe640 1 --2- 172.21.15.33:0/4049419339 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f71080a2d80 0x7f71080a5240 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7118005fd0 tx=0x7f7118009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:58.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.717+0000 7f7127abf740 1 -- 172.21.15.33:0/1920909677 shutdown_connections 2024-09-12T12:26:58.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.717+0000 7f7127abf740 1 --2- 172.21.15.33:0/1920909677 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fafa372550 0x55fafa374940 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.717+0000 7f7127abf740 1 --2- 172.21.15.33:0/1920909677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fafa35f3a0 0x55fafa372010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.717+0000 7f7127abf740 1 --2- 172.21.15.33:0/1920909677 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fafa35ea80 0x55fafa35ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.717+0000 7f7127abf740 1 -- 172.21.15.33:0/1920909677 >> 172.21.15.33:0/1920909677 conn(0x55fafa35b0f0 msgr2=0x55fafa35b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:58.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.717+0000 7f7127abf740 1 -- 172.21.15.33:0/1920909677 shutdown_connections 2024-09-12T12:26:58.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.718+0000 7f7127abf740 1 -- 172.21.15.33:0/1920909677 wait complete. 2024-09-12T12:26:58.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.718+0000 7f7127abf740 1 -- start start 2024-09-12T12:26:58.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.718+0000 7f7127abf740 1 Processor -- start 2024-09-12T12:26:58.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.719+0000 7f7127abf740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fafa35ea80 0x55fafa36f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:58.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.719+0000 7f7127abf740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fafa35f3a0 0x55fafa36fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:58.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.719+0000 7f7127abf740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fafa372550 0x55fafa36fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:58.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.719+0000 7f711e7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fafa35f3a0 0x55fafa36fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:58.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.719+0000 7f7127abf740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55fafa375060 con 0x55fafa35f3a0 2024-09-12T12:26:58.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.719+0000 7f7127abf740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55fafa27ef10 con 0x55fafa35ea80 2024-09-12T12:26:58.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.719+0000 7f7127abf740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55fafa3751e0 con 0x55fafa372550 2024-09-12T12:26:58.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.719+0000 7f711e7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fafa35f3a0 0x55fafa36fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42620/0 (socket says 172.21.15.33:42620) 2024-09-12T12:26:58.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.719+0000 7f711e7fc640 1 -- 172.21.15.33:0/2586046264 learned_addr learned my addr 172.21.15.33:0/2586046264 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:58.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.719+0000 7f711effd640 1 --2- 172.21.15.33:0/2586046264 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fafa35ea80 0x55fafa36f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:58.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.719+0000 7f711f7fe640 1 --2- 172.21.15.33:0/2586046264 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fafa372550 0x55fafa36fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:58.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.720+0000 7f711e7fc640 1 -- 172.21.15.33:0/2586046264 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fafa372550 msgr2=0x55fafa36fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:58.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.720+0000 7f711e7fc640 1 --2- 172.21.15.33:0/2586046264 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fafa372550 0x55fafa36fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.720+0000 7f711e7fc640 1 -- 172.21.15.33:0/2586046264 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fafa35ea80 msgr2=0x55fafa36f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:58.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.720+0000 7f711e7fc640 1 --2- 172.21.15.33:0/2586046264 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fafa35ea80 0x55fafa36f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.720+0000 7f7127abf740 10 client.0 _ll_register_callbacks cb 0x55fafa247a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:26:58.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.720+0000 7f711e7fc640 1 -- 172.21.15.33:0/2586046264 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fafa0356a0 con 0x55fafa35f3a0 2024-09-12T12:26:58.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.720+0000 7f711e7fc640 1 --2- 172.21.15.33:0/2586046264 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fafa35f3a0 0x55fafa36fab0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7114000c00 tx=0x7f71140050b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a02355425f01172 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:58.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.720+0000 7f7102ff5640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:26:58.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.720+0000 7f7127abf740 1 -- 172.21.15.33:0/2586046264 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71140044d0 con 0x55fafa35f3a0 2024-09-12T12:26:58.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.720+0000 7f7102ff5640 1 -- 172.21.15.33:0/2586046264 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7114035070 con 0x55fafa35f3a0 2024-09-12T12:26:58.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.720+0000 7f7102ff5640 1 -- 172.21.15.33:0/2586046264 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f71140053b0 con 0x55fafa35f3a0 2024-09-12T12:26:58.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.720+0000 7f7102ff5640 1 -- 172.21.15.33:0/2586046264 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7114005d50 con 0x55fafa35f3a0 2024-09-12T12:26:58.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.720+0000 7f7127abf740 10 client.15417 fetch_fsmap learned FSMap version 25 2024-09-12T12:26:58.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.721+0000 7f7127abf740 1 -- 172.21.15.33:0/2586046264 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({fsmap=25}) -- 0x55fafa380ad0 con 0x55fafa35f3a0 2024-09-12T12:26:58.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.721+0000 7f7102ff5640 1 -- 172.21.15.33:0/2586046264 <== mon.0 v2:172.21.15.33:3300/0 4 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f71140314a0 con 0x55fafa35f3a0 2024-09-12T12:26:58.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.721+0000 7f7127abf740 10 client.15417 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T12:26:58.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.721+0000 7f7127abf740 10 client.15417 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:26:58.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.721+0000 7f7127abf740 20 client.15417 populate_metadata read hostname 'smithi033' 2024-09-12T12:26:58.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.721+0000 7f7127abf740 1 --2- 172.21.15.33:0/2586046264 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55fafa381e20 0x55fafa384210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:58.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.721+0000 7f7127abf740 4 client.15417 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:26:58.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.721+0000 7f7127abf740 1 -- 172.21.15.33:0/2586046264 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fafa2d17f0 con 0x55fafa381e20 2024-09-12T12:26:58.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.721+0000 7f711effd640 1 --2- 172.21.15.33:0/2586046264 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55fafa381e20 0x55fafa384210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:58.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.722+0000 7f7102ff5640 10 client.15417 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:26:58.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.722+0000 7f711effd640 1 --2- 172.21.15.33:0/2586046264 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55fafa381e20 0x55fafa384210 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86ab23218074a1dd server_cookie=38dc4b382a2c6575 in_seq=0 out_seq=0 2024-09-12T12:26:58.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.723+0000 7f7102ff5640 1 -- 172.21.15.33:0/2586046264 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fafa2d17f0 con 0x55fafa381e20 2024-09-12T12:26:58.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.723+0000 7f7102ff5640 10 client.15417 handle_command_reply: tid=0 2024-09-12T12:26:58.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.723+0000 7f7127abf740 1 client.15417 shutdown 2024-09-12T12:26:58.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.723+0000 7f7127abf740 1 -- 172.21.15.33:0/2586046264 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fafa35f3a0 msgr2=0x55fafa36fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:58.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.723+0000 7f7127abf740 1 --2- 172.21.15.33:0/2586046264 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fafa35f3a0 0x55fafa36fab0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7114000c00 tx=0x7f71140050b0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.723+0000 7f7127abf740 1 -- 172.21.15.33:0/2586046264 shutdown_connections 2024-09-12T12:26:58.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.723+0000 7f7127abf740 1 --2- 172.21.15.33:0/2586046264 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55fafa381e20 0x55fafa384210 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.723+0000 7f7102ff5640 0 client.15417 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:26:58.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.723+0000 7f7127abf740 1 --2- 172.21.15.33:0/2586046264 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fafa372550 0x55fafa36fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.723+0000 7f7127abf740 1 --2- 172.21.15.33:0/2586046264 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fafa35f3a0 0x55fafa36fab0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.723+0000 7f7127abf740 1 --2- 172.21.15.33:0/2586046264 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fafa35ea80 0x55fafa36f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.723+0000 7f7127abf740 1 -- 172.21.15.33:0/2586046264 >> 172.21.15.33:0/2586046264 conn(0x55fafa35b0f0 msgr2=0x55fafa35a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:58.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.724+0000 7f7127abf740 1 -- 172.21.15.33:0/2586046264 shutdown_connections 2024-09-12T12:26:58.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.724+0000 7f7127abf740 1 -- 172.21.15.33:0/2586046264 wait complete. 2024-09-12T12:26:58.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.724+0000 7f7127abf740 20 client.15417 trim_cache size 0 max 16384 2024-09-12T12:26:58.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.741+0000 7f7127abf740 1 Processor -- start 2024-09-12T12:26:58.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.741+0000 7f7127abf740 1 -- start start 2024-09-12T12:26:58.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.741+0000 7f7127abf740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fafa35ea80 0x55fafa387230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:58.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.742+0000 7f7127abf740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fafa372550 0x55fafa387770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:58.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.742+0000 7f7127abf740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fafa387cb0 0x55fafa36c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:58.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.742+0000 7f7127abf740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f71201af340 con 0x55fafa372550 2024-09-12T12:26:58.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.742+0000 7f7127abf740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f71201acc10 con 0x55fafa387cb0 2024-09-12T12:26:58.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.742+0000 7f7127abf740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f71201aaa80 con 0x55fafa35ea80 2024-09-12T12:26:58.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.742+0000 7f711effd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fafa35ea80 0x55fafa387230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:58.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.742+0000 7f711effd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fafa35ea80 0x55fafa387230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:49248/0 (socket says 172.21.15.33:49248) 2024-09-12T12:26:58.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.742+0000 7f711effd640 1 -- 172.21.15.33:0/545817316 learned_addr learned my addr 172.21.15.33:0/545817316 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:58.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.742+0000 7f711f7fe640 1 --2- 172.21.15.33:0/545817316 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fafa387cb0 0x55fafa36c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:58.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.742+0000 7f711effd640 1 -- 172.21.15.33:0/545817316 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fafa387cb0 msgr2=0x55fafa36c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:58.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.742+0000 7f711effd640 1 --2- 172.21.15.33:0/545817316 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fafa387cb0 0x55fafa36c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.742+0000 7f711effd640 1 -- 172.21.15.33:0/545817316 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fafa372550 msgr2=0x55fafa387770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:58.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.742+0000 7f711effd640 1 --2- 172.21.15.33:0/545817316 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fafa372550 0x55fafa387770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.742+0000 7f711effd640 1 -- 172.21.15.33:0/545817316 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fafa36e520 con 0x55fafa35ea80 2024-09-12T12:26:58.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.742+0000 7f711f7fe640 1 --2- 172.21.15.33:0/545817316 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fafa387cb0 0x55fafa36c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:58.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.742+0000 7f711effd640 1 --2- 172.21.15.33:0/545817316 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fafa35ea80 0x55fafa387230 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7110005c60 tx=0x7f7110085040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6dfb9cc88bf7a484 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:58.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.743+0000 7f7104ff9640 1 -- 172.21.15.33:0/545817316 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71100b3070 con 0x55fafa35ea80 2024-09-12T12:26:58.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.743+0000 7f7104ff9640 1 -- 172.21.15.33:0/545817316 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f71100a3680 con 0x55fafa35ea80 2024-09-12T12:26:58.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.743+0000 7f7104ff9640 1 -- 172.21.15.33:0/545817316 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71100cd040 con 0x55fafa35ea80 2024-09-12T12:26:58.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.744+0000 7f7127abf740 1 -- 172.21.15.33:0/545817316 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fafa35ea80 msgr2=0x55fafa387230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:58.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.744+0000 7f7127abf740 1 --2- 172.21.15.33:0/545817316 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fafa35ea80 0x55fafa387230 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7110005c60 tx=0x7f7110085040 comp rx=0 tx=0).stop 2024-09-12T12:26:58.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.744+0000 7f7127abf740 1 -- 172.21.15.33:0/545817316 shutdown_connections 2024-09-12T12:26:58.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.744+0000 7f7127abf740 1 --2- 172.21.15.33:0/545817316 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fafa387cb0 0x55fafa36c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.744+0000 7f7127abf740 1 --2- 172.21.15.33:0/545817316 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fafa372550 0x55fafa387770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.744+0000 7f7127abf740 1 --2- 172.21.15.33:0/545817316 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fafa35ea80 0x55fafa387230 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.744+0000 7f7127abf740 1 -- 172.21.15.33:0/545817316 >> 172.21.15.33:0/545817316 conn(0x55fafa35b0f0 msgr2=0x55fafa37dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:58.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.744+0000 7f7127abf740 1 -- 172.21.15.33:0/545817316 shutdown_connections 2024-09-12T12:26:58.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.744+0000 7f7127abf740 1 -- 172.21.15.33:0/545817316 wait complete. 2024-09-12T12:26:58.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.744+0000 7f7127abf740 1 -- start start 2024-09-12T12:26:58.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.744+0000 7f7127abf740 1 Processor -- start 2024-09-12T12:26:58.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.745+0000 7f7127abf740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fafa35ea80 0x55fafa385d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:58.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.745+0000 7f7127abf740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fafa372550 0x55fafa386240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:58.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.745+0000 7f7127abf740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fafa387cb0 0x55fafa386780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:58.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.745+0000 7f7127abf740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f71201ab0d0 con 0x55fafa372550 2024-09-12T12:26:58.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.745+0000 7f7127abf740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f71201ac540 con 0x55fafa387cb0 2024-09-12T12:26:58.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.745+0000 7f7127abf740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f71201ab7a0 con 0x55fafa35ea80 2024-09-12T12:26:58.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.745+0000 7f711e7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fafa372550 0x55fafa386240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:58.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.745+0000 7f711e7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fafa372550 0x55fafa386240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42644/0 (socket says 172.21.15.33:42644) 2024-09-12T12:26:58.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.745+0000 7f711e7fc640 1 -- 172.21.15.33:0/1679632550 learned_addr learned my addr 172.21.15.33:0/1679632550 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:26:58.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.745+0000 7f711effd640 1 --2- 172.21.15.33:0/1679632550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fafa35ea80 0x55fafa385d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:58.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.745+0000 7f7127abf740 10 client.0 _ll_register_callbacks cb 0x7f7114009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:26:58.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.745+0000 7f711f7fe640 1 --2- 172.21.15.33:0/1679632550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fafa387cb0 0x55fafa386780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:58.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.745+0000 7f711effd640 1 -- 172.21.15.33:0/1679632550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fafa387cb0 msgr2=0x55fafa386780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:58.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.745+0000 7f711effd640 1 --2- 172.21.15.33:0/1679632550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fafa387cb0 0x55fafa386780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.745+0000 7f711effd640 1 -- 172.21.15.33:0/1679632550 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fafa372550 msgr2=0x55fafa386240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:58.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.745+0000 7f711effd640 1 --2- 172.21.15.33:0/1679632550 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fafa372550 0x55fafa386240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.745+0000 7f711effd640 1 -- 172.21.15.33:0/1679632550 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fafa35f1d0 con 0x55fafa35ea80 2024-09-12T12:26:58.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.745+0000 7f711e7fc640 1 --2- 172.21.15.33:0/1679632550 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fafa372550 0x55fafa386240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:58.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.746+0000 7f711effd640 1 --2- 172.21.15.33:0/1679632550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fafa35ea80 0x55fafa385d00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f71100058c0 tx=0x7f7110010c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8ee4aa74517c3be server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:58.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.746+0000 7f7102ff5640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:26:58.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.746+0000 7f7102ff5640 1 -- 172.21.15.33:0/1679632550 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71100b3040 con 0x55fafa35ea80 2024-09-12T12:26:58.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.746+0000 7f7102ff5640 1 -- 172.21.15.33:0/1679632550 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f71100ce280 con 0x55fafa35ea80 2024-09-12T12:26:58.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.746+0000 7f7127abf740 1 -- 172.21.15.33:0/1679632550 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71100a3680 con 0x55fafa35ea80 2024-09-12T12:26:58.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.746+0000 7f7102ff5640 1 -- 172.21.15.33:0/1679632550 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7110020040 con 0x55fafa35ea80 2024-09-12T12:26:58.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.746+0000 7f7127abf740 10 client.25135 fetch_fsmap learned FSMap version 25 2024-09-12T12:26:58.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.746+0000 7f7127abf740 1 -- 172.21.15.33:0/1679632550 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fafa3ed9c0 con 0x55fafa35ea80 2024-09-12T12:26:58.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.746+0000 7f7102ff5640 1 -- 172.21.15.33:0/1679632550 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7110098d10 con 0x55fafa35ea80 2024-09-12T12:26:58.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.746+0000 7f7102ff5640 1 -- 172.21.15.33:0/1679632550 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f7110096920 con 0x55fafa35ea80 2024-09-12T12:26:58.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.747+0000 7f7127abf740 10 client.25135 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T12:26:58.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.747+0000 7f7127abf740 10 client.25135 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:26:58.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.747+0000 7f7127abf740 20 client.25135 populate_metadata read hostname 'smithi033' 2024-09-12T12:26:58.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.747+0000 7f7127abf740 1 --2- 172.21.15.33:0/1679632550 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55fafa3ee030 0x55fafa3f0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:58.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.747+0000 7f7127abf740 4 client.25135 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T12:26:58.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.747+0000 7f7127abf740 1 -- 172.21.15.33:0/1679632550 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f71100a3680 con 0x55fafa3ee030 2024-09-12T12:26:58.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.747+0000 7f711e7fc640 1 --2- 172.21.15.33:0/1679632550 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55fafa3ee030 0x55fafa3f0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:58.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.747+0000 7f7102ff5640 10 client.25135 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:26:58.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.747+0000 7f711e7fc640 1 --2- 172.21.15.33:0/1679632550 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55fafa3ee030 0x55fafa3f0420 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4ef57bac717da6f server_cookie=f657b5dd976eb959 in_seq=0 out_seq=0 2024-09-12T12:26:58.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.748+0000 7f7102ff5640 1 -- 172.21.15.33:0/1679632550 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f71100a3680 con 0x55fafa3ee030 2024-09-12T12:26:58.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.748+0000 7f7102ff5640 10 client.25135 handle_command_reply: tid=0 2024-09-12T12:26:58.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.748+0000 7f7127abf740 1 client.25135 shutdown 2024-09-12T12:26:58.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.749+0000 7f7127abf740 1 -- 172.21.15.33:0/1679632550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fafa35ea80 msgr2=0x55fafa385d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:58.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.749+0000 7f7127abf740 1 --2- 172.21.15.33:0/1679632550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fafa35ea80 0x55fafa385d00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f71100058c0 tx=0x7f7110010c90 comp rx=0 tx=0).stop 2024-09-12T12:26:58.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.749+0000 7f7127abf740 1 -- 172.21.15.33:0/1679632550 shutdown_connections 2024-09-12T12:26:58.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.749+0000 7f7127abf740 1 --2- 172.21.15.33:0/1679632550 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55fafa3ee030 0x55fafa3f0420 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.749+0000 7f7102ff5640 0 client.25135 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:26:58.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.749+0000 7f7127abf740 1 --2- 172.21.15.33:0/1679632550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fafa387cb0 0x55fafa386780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.749+0000 7f7127abf740 1 --2- 172.21.15.33:0/1679632550 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fafa372550 0x55fafa386240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.749+0000 7f7127abf740 1 --2- 172.21.15.33:0/1679632550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fafa35ea80 0x55fafa385d00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.749+0000 7f7127abf740 1 -- 172.21.15.33:0/1679632550 >> 172.21.15.33:0/1679632550 conn(0x55fafa35b0f0 msgr2=0x55fafa359a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:58.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.749+0000 7f7127abf740 1 -- 172.21.15.33:0/1679632550 shutdown_connections 2024-09-12T12:26:58.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.749+0000 7f7127abf740 1 -- 172.21.15.33:0/1679632550 wait complete. 2024-09-12T12:26:58.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.749+0000 7f7127abf740 20 client.25135 trim_cache size 0 max 16384 2024-09-12T12:26:58.752 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:26:58.753 INFO:teuthology.orchestra.run.smithi033.stdout: "return_code": 0, 2024-09-12T12:26:58.753 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_tag": "2b309fd6-79df-48bc-b2c1-d1b140e1a966", 2024-09-12T12:26:58.753 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": "asynchronous" 2024-09-12T12:26:58.753 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:26:58.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.750+0000 7f71256e6640 1 -- 172.21.15.33:0/4049419339 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f71080a2d80 msgr2=0x7f71080a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:58.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.750+0000 7f71256e6640 1 --2- 172.21.15.33:0/4049419339 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f71080a2d80 0x7f71080a5240 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7118005fd0 tx=0x7f7118009600 comp rx=0 tx=0).stop 2024-09-12T12:26:58.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.750+0000 7f71256e6640 1 -- 172.21.15.33:0/4049419339 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7120102d50 msgr2=0x7f71201009b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:58.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.750+0000 7f71256e6640 1 --2- 172.21.15.33:0/4049419339 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7120102d50 0x7f71201009b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f711000d950 tx=0x7f711000de10 comp rx=0 tx=0).stop 2024-09-12T12:26:58.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.750+0000 7f71256e6640 1 -- 172.21.15.33:0/4049419339 shutdown_connections 2024-09-12T12:26:58.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.750+0000 7f71256e6640 1 --2- 172.21.15.33:0/4049419339 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f71080a2d80 0x7f71080a5240 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.750+0000 7f71256e6640 1 --2- 172.21.15.33:0/4049419339 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f712010c180 0x7f7120101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.750+0000 7f71256e6640 1 --2- 172.21.15.33:0/4049419339 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7120103670 0x7f7120100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.750+0000 7f71256e6640 1 --2- 172.21.15.33:0/4049419339 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7120102d50 0x7f71201009b0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.750+0000 7f71256e6640 1 -- 172.21.15.33:0/4049419339 >> 172.21.15.33:0/4049419339 conn(0x7f71200fc7d0 msgr2=0x7f71200fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:58.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.751+0000 7f71256e6640 1 -- 172.21.15.33:0/4049419339 shutdown_connections 2024-09-12T12:26:58.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:26:58.751+0000 7f71256e6640 1 -- 172.21.15.33:0/4049419339 wait complete. 2024-09-12T12:26:59.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:26:59 smithi033 ceph-mon[31246]: pgmap v379: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-12T12:26:59.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:26:59 smithi043 ceph-mon[34144]: pgmap v379: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-12T12:26:59.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:26:59 smithi102 ceph-mon[34799]: pgmap v379: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-12T12:26:59.538 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T12:26:59.826 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:27:00.217 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:00 smithi033 ceph-mon[31246]: scrub queued for path: / 2024-09-12T12:27:00.217 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:00 smithi033 ceph-mon[31246]: scrub summary: idle+waiting paths [/] 2024-09-12T12:27:00.217 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:00 smithi033 ceph-mon[31246]: scrub summary: active paths [/] 2024-09-12T12:27:00.217 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:00 smithi033 ceph-mon[31246]: scrub summary: idle+waiting paths [/] 2024-09-12T12:27:00.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.347+0000 7f735f4ce640 1 -- 172.21.15.33:0/81647795 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73581027a0 msgr2=0x7f73581067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:00.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.347+0000 7f735f4ce640 1 --2- 172.21.15.33:0/81647795 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73581027a0 0x7f73581067f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7348009900 tx=0x7f734802a410 comp rx=0 tx=0).stop 2024-09-12T12:27:00.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.347+0000 7f735f4ce640 1 -- 172.21.15.33:0/81647795 shutdown_connections 2024-09-12T12:27:00.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.347+0000 7f735f4ce640 1 --2- 172.21.15.33:0/81647795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7358106f20 0x7f735810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:00.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.347+0000 7f735f4ce640 1 --2- 172.21.15.33:0/81647795 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73581027a0 0x7f73581067f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:00.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.347+0000 7f735f4ce640 1 --2- 172.21.15.33:0/81647795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7358101df0 0x7f73581021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:00.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.347+0000 7f735f4ce640 1 -- 172.21.15.33:0/81647795 >> 172.21.15.33:0/81647795 conn(0x7f73580fd8f0 msgr2=0x7f73580ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:00.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.347+0000 7f735f4ce640 1 -- 172.21.15.33:0/81647795 shutdown_connections 2024-09-12T12:27:00.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.347+0000 7f735f4ce640 1 -- 172.21.15.33:0/81647795 wait complete. 2024-09-12T12:27:00.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.348+0000 7f735f4ce640 1 Processor -- start 2024-09-12T12:27:00.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.348+0000 7f735f4ce640 1 -- start start 2024-09-12T12:27:00.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.349+0000 7f735f4ce640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7358101df0 0x7f7358198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:00.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.349+0000 7f735f4ce640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73581027a0 0x7f7358198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:00.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.349+0000 7f735f4ce640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7358106f20 0x7f735819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:00.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.349+0000 7f735d26a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7358101df0 0x7f7358198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:00.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.349+0000 7f735d26a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7358101df0 0x7f7358198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:42544/0 (socket says 172.21.15.33:42544) 2024-09-12T12:27:00.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.350+0000 7f735ca69640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73581027a0 0x7f7358198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:00.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.350+0000 7f735ca69640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73581027a0 0x7f7358198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:49280/0 (socket says 172.21.15.33:49280) 2024-09-12T12:27:00.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.350+0000 7f735da6b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7358106f20 0x7f735819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:00.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.350+0000 7f735da6b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7358106f20 0x7f735819cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42654/0 (socket says 172.21.15.33:42654) 2024-09-12T12:27:00.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.350+0000 7f735d26a640 1 -- 172.21.15.33:0/1485808935 learned_addr learned my addr 172.21.15.33:0/1485808935 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:27:00.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.350+0000 7f735f4ce640 1 -- 172.21.15.33:0/1485808935 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7358111e30 con 0x7f7358106f20 2024-09-12T12:27:00.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.350+0000 7f735f4ce640 1 -- 172.21.15.33:0/1485808935 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7358111cb0 con 0x7f7358101df0 2024-09-12T12:27:00.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.350+0000 7f735f4ce640 1 -- 172.21.15.33:0/1485808935 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7358111fb0 con 0x7f73581027a0 2024-09-12T12:27:00.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.350+0000 7f735ca69640 1 -- 172.21.15.33:0/1485808935 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7358101df0 msgr2=0x7f7358198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:00.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.350+0000 7f735ca69640 1 --2- 172.21.15.33:0/1485808935 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7358101df0 0x7f7358198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:00.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.350+0000 7f735ca69640 1 -- 172.21.15.33:0/1485808935 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7358106f20 msgr2=0x7f735819cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:00.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.351+0000 7f735ca69640 1 --2- 172.21.15.33:0/1485808935 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7358106f20 0x7f735819cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:00.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.351+0000 7f735ca69640 1 -- 172.21.15.33:0/1485808935 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f735819d400 con 0x7f73581027a0 2024-09-12T12:27:00.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.351+0000 7f735da6b640 1 --2- 172.21.15.33:0/1485808935 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7358106f20 0x7f735819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:27:00.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.351+0000 7f735ca69640 1 --2- 172.21.15.33:0/1485808935 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73581027a0 0x7f7358198990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f734802a930 tx=0x7f7348004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:00.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.351+0000 7f734e7fc640 1 -- 172.21.15.33:0/1485808935 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f734803f030 con 0x7f73581027a0 2024-09-12T12:27:00.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.351+0000 7f735f4ce640 1 -- 172.21.15.33:0/1485808935 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f735819d690 con 0x7f73581027a0 2024-09-12T12:27:00.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.351+0000 7f734e7fc640 1 -- 172.21.15.33:0/1485808935 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7348003aa0 con 0x7f73581027a0 2024-09-12T12:27:00.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.352+0000 7f734e7fc640 1 -- 172.21.15.33:0/1485808935 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7348035070 con 0x7f73581027a0 2024-09-12T12:27:00.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.352+0000 7f735f4ce640 1 -- 172.21.15.33:0/1485808935 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f735819db00 con 0x7f73581027a0 2024-09-12T12:27:00.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.355+0000 7f734e7fc640 1 -- 172.21.15.33:0/1485808935 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7348042030 con 0x7f73581027a0 2024-09-12T12:27:00.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.356+0000 7f73618a7740 1 Processor -- start 2024-09-12T12:27:00.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.356+0000 7f73618a7740 1 -- start start 2024-09-12T12:27:00.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.356+0000 7f734e7fc640 1 --2- 172.21.15.33:0/1485808935 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f73440a2c00 0x7f73440a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:00.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.356+0000 7f73618a7740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d80dc744a0 0x55d80dc74880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:00.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.356+0000 7f73618a7740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d80dc74dc0 0x55d80dc7f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:00.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.356+0000 7f734e7fc640 1 -- 172.21.15.33:0/1485808935 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f73480ef1d0 con 0x7f73581027a0 2024-09-12T12:27:00.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.356+0000 7f73618a7740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d80dc7f680 0x55d80dc81a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:00.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.356+0000 7f73618a7740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55d80dbda2e0 con 0x55d80dc7f680 2024-09-12T12:27:00.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.356+0000 7f73618a7740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d80db81ce0 con 0x55d80dc744a0 2024-09-12T12:27:00.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.356+0000 7f73618a7740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d80dbd62a0 con 0x55d80dc74dc0 2024-09-12T12:27:00.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.356+0000 7f735ca69640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d80dc74dc0 0x55d80dc7f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:00.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.356+0000 7f735d26a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d80dc744a0 0x55d80dc74880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:00.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.356+0000 7f735ca69640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d80dc74dc0 0x55d80dc7f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:49288/0 (socket says 172.21.15.33:49288) 2024-09-12T12:27:00.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.356+0000 7f735ca69640 1 -- 172.21.15.33:0/1596519545 learned_addr learned my addr 172.21.15.33:0/1596519545 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:27:00.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.357+0000 7f735da6b640 1 --2- 172.21.15.33:0/1485808935 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f73440a2c00 0x7f73440a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:00.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.357+0000 7f735d26a640 1 -- 172.21.15.33:0/1596519545 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d80dc74dc0 msgr2=0x55d80dc7f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:00.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.357+0000 7f735d26a640 1 --2- 172.21.15.33:0/1596519545 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d80dc74dc0 0x55d80dc7f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:00.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.357+0000 7f735d26a640 1 -- 172.21.15.33:0/1596519545 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d80dc7f680 msgr2=0x55d80dc81a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:00.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.357+0000 7f735d26a640 1 --2- 172.21.15.33:0/1596519545 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d80dc7f680 0x55d80dc81a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:00.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.357+0000 7f735d26a640 1 -- 172.21.15.33:0/1596519545 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d80db66440 con 0x55d80dc744a0 2024-09-12T12:27:00.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.357+0000 7f735ca69640 1 --2- 172.21.15.33:0/1596519545 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d80dc74dc0 0x55d80dc7f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:27:00.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.357+0000 7f735d26a640 1 --2- 172.21.15.33:0/1596519545 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d80dc744a0 0x55d80dc74880 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7354009c80 tx=0x7f7354011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de24490a47e0f0e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:00.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.357+0000 7f73437fe640 1 -- 172.21.15.33:0/1596519545 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7354004230 con 0x55d80dc744a0 2024-09-12T12:27:00.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.357+0000 7f73437fe640 1 -- 172.21.15.33:0/1596519545 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f73540043d0 con 0x55d80dc744a0 2024-09-12T12:27:00.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.357+0000 7f73437fe640 1 -- 172.21.15.33:0/1596519545 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7354004c70 con 0x55d80dc744a0 2024-09-12T12:27:00.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.357+0000 7f735da6b640 1 --2- 172.21.15.33:0/1485808935 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f73440a2c00 0x7f73440a50c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55d80dc71db0 tx=0x7f7350009240 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:00.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.358+0000 7f73618a7740 1 -- 172.21.15.33:0/1596519545 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d80dc744a0 msgr2=0x55d80dc74880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:00.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.358+0000 7f73618a7740 1 --2- 172.21.15.33:0/1596519545 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d80dc744a0 0x55d80dc74880 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7354009c80 tx=0x7f7354011810 comp rx=0 tx=0).stop 2024-09-12T12:27:00.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.358+0000 7f73618a7740 1 -- 172.21.15.33:0/1596519545 shutdown_connections 2024-09-12T12:27:00.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.358+0000 7f73618a7740 1 --2- 172.21.15.33:0/1596519545 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d80dc7f680 0x55d80dc81a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:00.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.358+0000 7f73618a7740 1 --2- 172.21.15.33:0/1596519545 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d80dc74dc0 0x55d80dc7f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:00.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.358+0000 7f73618a7740 1 --2- 172.21.15.33:0/1596519545 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d80dc744a0 0x55d80dc74880 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:00.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.358+0000 7f73618a7740 1 -- 172.21.15.33:0/1596519545 >> 172.21.15.33:0/1596519545 conn(0x55d80dc70a30 msgr2=0x55d80dc70e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:00.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.358+0000 7f73618a7740 1 -- 172.21.15.33:0/1596519545 shutdown_connections 2024-09-12T12:27:00.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.358+0000 7f73618a7740 1 -- 172.21.15.33:0/1596519545 wait complete. 2024-09-12T12:27:00.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.359+0000 7f73618a7740 1 -- start start 2024-09-12T12:27:00.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.359+0000 7f73618a7740 1 Processor -- start 2024-09-12T12:27:00.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.359+0000 7f73618a7740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d80dc744a0 0x55d80dc7eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:00.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.359+0000 7f73618a7740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d80dc74dc0 0x55d80dc7c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:00.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.360+0000 7f73618a7740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d80dc7f680 0x55d80dc7c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:00.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.360+0000 7f735ca69640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d80dc74dc0 0x55d80dc7c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:00.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.360+0000 7f735ca69640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d80dc74dc0 0x55d80dc7c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42658/0 (socket says 172.21.15.33:42658) 2024-09-12T12:27:00.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.360+0000 7f735ca69640 1 -- 172.21.15.33:0/1437264099 learned_addr learned my addr 172.21.15.33:0/1437264099 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:27:00.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.360+0000 7f73618a7740 1 -- 172.21.15.33:0/1437264099 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55d80dc86660 con 0x55d80dc74dc0 2024-09-12T12:27:00.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.360+0000 7f73618a7740 1 -- 172.21.15.33:0/1437264099 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d80db95050 con 0x55d80dc7f680 2024-09-12T12:27:00.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.360+0000 7f73618a7740 1 -- 172.21.15.33:0/1437264099 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d80dc867e0 con 0x55d80dc744a0 2024-09-12T12:27:00.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.360+0000 7f735d26a640 1 --2- 172.21.15.33:0/1437264099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d80dc744a0 0x55d80dc7eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:00.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.360+0000 7f735da6b640 1 --2- 172.21.15.33:0/1437264099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d80dc7f680 0x55d80dc7c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:00.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.360+0000 7f735ca69640 1 -- 172.21.15.33:0/1437264099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d80dc744a0 msgr2=0x55d80dc7eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:00.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.360+0000 7f735ca69640 1 --2- 172.21.15.33:0/1437264099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d80dc744a0 0x55d80dc7eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:00.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.360+0000 7f735ca69640 1 -- 172.21.15.33:0/1437264099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d80dc7f680 msgr2=0x55d80dc7c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:00.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.360+0000 7f735ca69640 1 --2- 172.21.15.33:0/1437264099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d80dc7f680 0x55d80dc7c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:00.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.360+0000 7f735ca69640 1 -- 172.21.15.33:0/1437264099 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d80d94b3c0 con 0x55d80dc74dc0 2024-09-12T12:27:00.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.360+0000 7f73618a7740 10 client.0 _ll_register_callbacks cb 0x55d80dbd5160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:27:00.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.360+0000 7f735ca69640 1 --2- 172.21.15.33:0/1437264099 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d80dc74dc0 0x55d80dc7c160 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f73480096c0 tx=0x7f73480bb0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ced41cd8541efb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:00.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.361+0000 7f7340ff9640 10 client.15429 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:27:00.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.361+0000 7f73618a7740 1 -- 172.21.15.33:0/1437264099 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73540043d0 con 0x55d80dc74dc0 2024-09-12T12:27:00.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.361+0000 7f7340ff9640 1 -- 172.21.15.33:0/1437264099 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7348049040 con 0x55d80dc74dc0 2024-09-12T12:27:00.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.361+0000 7f7340ff9640 1 -- 172.21.15.33:0/1437264099 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f73480a60b0 con 0x55d80dc74dc0 2024-09-12T12:27:00.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.361+0000 7f7340ff9640 1 -- 172.21.15.33:0/1437264099 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f73480bfa50 con 0x55d80dc74dc0 2024-09-12T12:27:00.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.361+0000 7f73618a7740 10 client.15429 fetch_fsmap learned FSMap version 25 2024-09-12T12:27:00.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.361+0000 7f73618a7740 1 -- 172.21.15.33:0/1437264099 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({fsmap=25}) -- 0x55d80dc83870 con 0x55d80dc74dc0 2024-09-12T12:27:00.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.361+0000 7f7340ff9640 1 -- 172.21.15.33:0/1437264099 <== mon.0 v2:172.21.15.33:3300/0 4 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f73480a4ce0 con 0x55d80dc74dc0 2024-09-12T12:27:00.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:00 smithi043 ceph-mon[34144]: scrub queued for path: / 2024-09-12T12:27:00.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:00 smithi043 ceph-mon[34144]: scrub summary: idle+waiting paths [/] 2024-09-12T12:27:00.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:00 smithi043 ceph-mon[34144]: scrub summary: active paths [/] 2024-09-12T12:27:00.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:00 smithi043 ceph-mon[34144]: scrub summary: idle+waiting paths [/] 2024-09-12T12:27:00.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.366+0000 7f73618a7740 10 client.15429 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T12:27:00.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.366+0000 7f73618a7740 10 client.15429 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:27:00.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.366+0000 7f73618a7740 20 client.15429 populate_metadata read hostname 'smithi033' 2024-09-12T12:27:00.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.366+0000 7f73618a7740 1 --2- 172.21.15.33:0/1437264099 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55d80dc84cc0 0x55d80dc85140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:00.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.366+0000 7f73618a7740 4 client.15429 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:27:00.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.366+0000 7f73618a7740 1 -- 172.21.15.33:0/1437264099 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d80dbe7850 con 0x55d80dc84cc0 2024-09-12T12:27:00.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.366+0000 7f735d26a640 1 --2- 172.21.15.33:0/1437264099 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55d80dc84cc0 0x55d80dc85140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:00.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.366+0000 7f7340ff9640 10 client.15429 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:27:00.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.366+0000 7f735d26a640 1 --2- 172.21.15.33:0/1437264099 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55d80dc84cc0 0x55d80dc85140 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b911c799985bbbb server_cookie=9df5f7df86f372ad in_seq=0 out_seq=0 2024-09-12T12:27:00.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.367+0000 7f7340ff9640 1 -- 172.21.15.33:0/1437264099 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d80dbe7850 con 0x55d80dc84cc0 2024-09-12T12:27:00.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.367+0000 7f7340ff9640 10 client.15429 handle_command_reply: tid=0 2024-09-12T12:27:00.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.367+0000 7f73618a7740 1 client.15429 shutdown 2024-09-12T12:27:00.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.367+0000 7f73618a7740 1 -- 172.21.15.33:0/1437264099 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d80dc74dc0 msgr2=0x55d80dc7c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:00.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.367+0000 7f73618a7740 1 --2- 172.21.15.33:0/1437264099 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d80dc74dc0 0x55d80dc7c160 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f73480096c0 tx=0x7f73480bb0b0 comp rx=0 tx=0).stop 2024-09-12T12:27:00.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.368+0000 7f73618a7740 1 -- 172.21.15.33:0/1437264099 shutdown_connections 2024-09-12T12:27:00.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.368+0000 7f73618a7740 1 --2- 172.21.15.33:0/1437264099 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55d80dc84cc0 0x55d80dc85140 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:00.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.368+0000 7f73618a7740 1 --2- 172.21.15.33:0/1437264099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d80dc7f680 0x55d80dc7c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:00.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.368+0000 7f7340ff9640 0 client.15429 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:27:00.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.368+0000 7f73618a7740 1 --2- 172.21.15.33:0/1437264099 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d80dc74dc0 0x55d80dc7c160 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:00.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.368+0000 7f73618a7740 1 --2- 172.21.15.33:0/1437264099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d80dc744a0 0x55d80dc7eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:00.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.368+0000 7f73618a7740 1 -- 172.21.15.33:0/1437264099 >> 172.21.15.33:0/1437264099 conn(0x55d80dc70a30 msgr2=0x55d80dc76710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:00.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.368+0000 7f73618a7740 1 -- 172.21.15.33:0/1437264099 shutdown_connections 2024-09-12T12:27:00.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.368+0000 7f73618a7740 1 -- 172.21.15.33:0/1437264099 wait complete. 2024-09-12T12:27:00.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.368+0000 7f73618a7740 20 client.15429 trim_cache size 0 max 16384 2024-09-12T12:27:00.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.385+0000 7f73618a7740 1 Processor -- start 2024-09-12T12:27:00.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.386+0000 7f73618a7740 1 -- start start 2024-09-12T12:27:00.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.386+0000 7f73618a7740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d80dc744a0 0x55d80dc77900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:00.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.386+0000 7f73618a7740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d80dc74dc0 0x55d80dc7e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:00.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.386+0000 7f73618a7740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d80dc7f680 0x55d80dc793c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:00.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.386+0000 7f73618a7740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f73581af410 con 0x55d80dc7f680 2024-09-12T12:27:00.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.386+0000 7f73618a7740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f73581acce0 con 0x55d80dc744a0 2024-09-12T12:27:00.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.386+0000 7f73618a7740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f73581aab30 con 0x55d80dc74dc0 2024-09-12T12:27:00.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.386+0000 7f735da6b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d80dc7f680 0x55d80dc793c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:00.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.386+0000 7f735ca69640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d80dc74dc0 0x55d80dc7e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:00.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.386+0000 7f735da6b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d80dc7f680 0x55d80dc793c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42666/0 (socket says 172.21.15.33:42666) 2024-09-12T12:27:00.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.386+0000 7f735da6b640 1 -- 172.21.15.33:0/3825484305 learned_addr learned my addr 172.21.15.33:0/3825484305 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:27:00.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.386+0000 7f735d26a640 1 --2- 172.21.15.33:0/3825484305 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d80dc744a0 0x55d80dc77900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:00.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.387+0000 7f735ca69640 1 -- 172.21.15.33:0/3825484305 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d80dc744a0 msgr2=0x55d80dc77900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:00.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.387+0000 7f735ca69640 1 --2- 172.21.15.33:0/3825484305 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d80dc744a0 0x55d80dc77900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:00.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.387+0000 7f735ca69640 1 -- 172.21.15.33:0/3825484305 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d80dc7f680 msgr2=0x55d80dc793c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:00.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.387+0000 7f735ca69640 1 --2- 172.21.15.33:0/3825484305 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d80dc7f680 0x55d80dc793c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:00.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.387+0000 7f735ca69640 1 -- 172.21.15.33:0/3825484305 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d80dc70860 con 0x55d80dc74dc0 2024-09-12T12:27:00.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.387+0000 7f735d26a640 1 --2- 172.21.15.33:0/3825484305 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d80dc744a0 0x55d80dc77900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:27:00.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.387+0000 7f735ca69640 1 --2- 172.21.15.33:0/3825484305 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d80dc74dc0 0x55d80dc7e0d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7348005ab0 tx=0x7f73480a4000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91936bf704defb44 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:00.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.387+0000 7f7342ffd640 1 -- 172.21.15.33:0/3825484305 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7348049070 con 0x55d80dc74dc0 2024-09-12T12:27:00.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.387+0000 7f7342ffd640 1 -- 172.21.15.33:0/3825484305 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f73540043d0 con 0x55d80dc74dc0 2024-09-12T12:27:00.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.387+0000 7f7342ffd640 1 -- 172.21.15.33:0/3825484305 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7348003c50 con 0x55d80dc74dc0 2024-09-12T12:27:00.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.388+0000 7f73618a7740 1 -- 172.21.15.33:0/3825484305 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d80dc74dc0 msgr2=0x55d80dc7e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:00.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.388+0000 7f73618a7740 1 --2- 172.21.15.33:0/3825484305 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d80dc74dc0 0x55d80dc7e0d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7348005ab0 tx=0x7f73480a4000 comp rx=0 tx=0).stop 2024-09-12T12:27:00.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.388+0000 7f73618a7740 1 -- 172.21.15.33:0/3825484305 shutdown_connections 2024-09-12T12:27:00.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.388+0000 7f73618a7740 1 --2- 172.21.15.33:0/3825484305 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d80dc7f680 0x55d80dc793c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:00.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.388+0000 7f73618a7740 1 --2- 172.21.15.33:0/3825484305 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d80dc74dc0 0x55d80dc7e0d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:00.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.388+0000 7f73618a7740 1 --2- 172.21.15.33:0/3825484305 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d80dc744a0 0x55d80dc77900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:00.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.388+0000 7f73618a7740 1 -- 172.21.15.33:0/3825484305 >> 172.21.15.33:0/3825484305 conn(0x55d80dc70a30 msgr2=0x55d80dc7d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:00.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.388+0000 7f73618a7740 1 -- 172.21.15.33:0/3825484305 shutdown_connections 2024-09-12T12:27:00.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.388+0000 7f73618a7740 1 -- 172.21.15.33:0/3825484305 wait complete. 2024-09-12T12:27:00.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.389+0000 7f73618a7740 1 -- start start 2024-09-12T12:27:00.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.389+0000 7f73618a7740 1 Processor -- start 2024-09-12T12:27:00.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.389+0000 7f73618a7740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d80dc744a0 0x55d80dc90820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:00.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.390+0000 7f73618a7740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d80dc74dc0 0x55d80dc90d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:00.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.390+0000 7f73618a7740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d80dc7f680 0x55d80dcf8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:00.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.390+0000 7f73618a7740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f73581ab1a0 con 0x55d80dc74dc0 2024-09-12T12:27:00.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.390+0000 7f73618a7740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f73581ac610 con 0x55d80dc744a0 2024-09-12T12:27:00.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.390+0000 7f73618a7740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f73581ab870 con 0x55d80dc7f680 2024-09-12T12:27:00.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.390+0000 7f735ca69640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d80dc74dc0 0x55d80dc90d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:00.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.390+0000 7f735ca69640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d80dc74dc0 0x55d80dc90d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42672/0 (socket says 172.21.15.33:42672) 2024-09-12T12:27:00.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.390+0000 7f735ca69640 1 -- 172.21.15.33:0/1737628829 learned_addr learned my addr 172.21.15.33:0/1737628829 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:27:00.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.390+0000 7f735da6b640 1 --2- 172.21.15.33:0/1737628829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d80dc7f680 0x55d80dcf8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:00.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.390+0000 7f735d26a640 1 --2- 172.21.15.33:0/1737628829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d80dc744a0 0x55d80dc90820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:00.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.390+0000 7f73618a7740 10 client.0 _ll_register_callbacks cb 0x7f73480bb5f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:27:00.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.390+0000 7f735ca69640 1 -- 172.21.15.33:0/1737628829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d80dc7f680 msgr2=0x55d80dcf8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:00.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.390+0000 7f735ca69640 1 --2- 172.21.15.33:0/1737628829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d80dc7f680 0x55d80dcf8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:00.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.390+0000 7f735ca69640 1 -- 172.21.15.33:0/1737628829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d80dc744a0 msgr2=0x55d80dc90820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:00.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.390+0000 7f735ca69640 1 --2- 172.21.15.33:0/1737628829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d80dc744a0 0x55d80dc90820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:00.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.390+0000 7f735ca69640 1 -- 172.21.15.33:0/1737628829 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d80dcf88d0 con 0x55d80dc74dc0 2024-09-12T12:27:00.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.390+0000 7f735da6b640 1 --2- 172.21.15.33:0/1737628829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d80dc7f680 0x55d80dcf8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:27:00.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.390+0000 7f735d26a640 1 --2- 172.21.15.33:0/1737628829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d80dc744a0 0x55d80dc90820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:27:00.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.390+0000 7f73618a7740 1 -- 172.21.15.33:0/1737628829 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73540043d0 con 0x55d80dc74dc0 2024-09-12T12:27:00.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.391+0000 7f735ca69640 1 --2- 172.21.15.33:0/1737628829 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d80dc74dc0 0x55d80dc90d60 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f73480bb6e0 tx=0x7f73480c4310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52deb80bec90b312 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:00.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.391+0000 7f7340ff9640 10 client.15435 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:27:00.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.391+0000 7f7340ff9640 1 -- 172.21.15.33:0/1737628829 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7348049030 con 0x55d80dc74dc0 2024-09-12T12:27:00.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.391+0000 7f7340ff9640 1 -- 172.21.15.33:0/1737628829 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f73480ece00 con 0x55d80dc74dc0 2024-09-12T12:27:00.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.391+0000 7f7340ff9640 1 -- 172.21.15.33:0/1737628829 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f73480a4ce0 con 0x55d80dc74dc0 2024-09-12T12:27:00.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.391+0000 7f73618a7740 10 client.15435 fetch_fsmap learned FSMap version 25 2024-09-12T12:27:00.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.391+0000 7f73618a7740 1 -- 172.21.15.33:0/1737628829 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({fsmap=25}) -- 0x55d80dcf88d0 con 0x55d80dc74dc0 2024-09-12T12:27:00.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.392+0000 7f7340ff9640 1 -- 172.21.15.33:0/1737628829 <== mon.0 v2:172.21.15.33:3300/0 4 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f7348003c50 con 0x55d80dc74dc0 2024-09-12T12:27:00.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.392+0000 7f73618a7740 10 client.15435 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T12:27:00.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.392+0000 7f73618a7740 10 client.15435 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:27:00.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.392+0000 7f73618a7740 20 client.15435 populate_metadata read hostname 'smithi033' 2024-09-12T12:27:00.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.392+0000 7f73618a7740 1 --2- 172.21.15.33:0/1737628829 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55d80dc84cc0 0x55d80dcfbc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:00.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.392+0000 7f73618a7740 4 client.15435 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:27:00.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.392+0000 7f73618a7740 1 -- 172.21.15.33:0/1737628829 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d80dbe1d60 con 0x55d80dc84cc0 2024-09-12T12:27:00.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.392+0000 7f735d26a640 1 --2- 172.21.15.33:0/1737628829 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55d80dc84cc0 0x55d80dcfbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:00.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.392+0000 7f7340ff9640 10 client.15435 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:27:00.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.392+0000 7f735d26a640 1 --2- 172.21.15.33:0/1737628829 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55d80dc84cc0 0x55d80dcfbc90 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa2a213adf329ecc server_cookie=f2abc8458d273fa5 in_seq=0 out_seq=0 2024-09-12T12:27:00.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.393+0000 7f7340ff9640 1 -- 172.21.15.33:0/1737628829 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55d80dbe1d60 con 0x55d80dc84cc0 2024-09-12T12:27:00.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.393+0000 7f7340ff9640 10 client.15435 handle_command_reply: tid=0 2024-09-12T12:27:00.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.393+0000 7f73618a7740 1 client.15435 shutdown 2024-09-12T12:27:00.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.393+0000 7f73618a7740 1 -- 172.21.15.33:0/1737628829 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d80dc74dc0 msgr2=0x55d80dc90d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:00.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.393+0000 7f73618a7740 1 --2- 172.21.15.33:0/1737628829 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d80dc74dc0 0x55d80dc90d60 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f73480bb6e0 tx=0x7f73480c4310 comp rx=0 tx=0).stop 2024-09-12T12:27:00.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.393+0000 7f73618a7740 1 -- 172.21.15.33:0/1737628829 shutdown_connections 2024-09-12T12:27:00.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.393+0000 7f73618a7740 1 --2- 172.21.15.33:0/1737628829 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55d80dc84cc0 0x55d80dcfbc90 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:00.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.393+0000 7f73618a7740 1 --2- 172.21.15.33:0/1737628829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d80dc7f680 0x55d80dcf8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:00.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.393+0000 7f73618a7740 1 --2- 172.21.15.33:0/1737628829 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d80dc74dc0 0x55d80dc90d60 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:00.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.393+0000 7f7340ff9640 0 client.15435 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:27:00.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.393+0000 7f73618a7740 1 --2- 172.21.15.33:0/1737628829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d80dc744a0 0x55d80dc90820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:00.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.393+0000 7f73618a7740 1 -- 172.21.15.33:0/1737628829 >> 172.21.15.33:0/1737628829 conn(0x55d80dc70a30 msgr2=0x55d80dc7ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:00.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.393+0000 7f73618a7740 1 -- 172.21.15.33:0/1737628829 shutdown_connections 2024-09-12T12:27:00.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.393+0000 7f73618a7740 1 -- 172.21.15.33:0/1737628829 wait complete. 2024-09-12T12:27:00.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.393+0000 7f73618a7740 20 client.15435 trim_cache size 0 max 16384 2024-09-12T12:27:00.397 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:27:00.397 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T12:27:00.397 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": { 2024-09-12T12:27:00.397 INFO:teuthology.orchestra.run.smithi033.stdout: "2b309fd6-79df-48bc-b2c1-d1b140e1a966": { 2024-09-12T12:27:00.398 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-09-12T12:27:00.398 INFO:teuthology.orchestra.run.smithi033.stdout: "tag": "2b309fd6-79df-48bc-b2c1-d1b140e1a966", 2024-09-12T12:27:00.398 INFO:teuthology.orchestra.run.smithi033.stdout: "options": "recursive,force" 2024-09-12T12:27:00.398 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:27:00.398 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:27:00.398 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:27:00.399 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:00 smithi102 ceph-mon[34799]: scrub queued for path: / 2024-09-12T12:27:00.399 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:00 smithi102 ceph-mon[34799]: scrub summary: idle+waiting paths [/] 2024-09-12T12:27:00.399 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:00 smithi102 ceph-mon[34799]: scrub summary: active paths [/] 2024-09-12T12:27:00.399 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:00 smithi102 ceph-mon[34799]: scrub summary: idle+waiting paths [/] 2024-09-12T12:27:00.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.394+0000 7f735f4ce640 1 -- 172.21.15.33:0/1485808935 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f73440a2c00 msgr2=0x7f73440a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:00.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.394+0000 7f735f4ce640 1 --2- 172.21.15.33:0/1485808935 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f73440a2c00 0x7f73440a50c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55d80dc71db0 tx=0x7f7350009240 comp rx=0 tx=0).stop 2024-09-12T12:27:00.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.394+0000 7f735f4ce640 1 -- 172.21.15.33:0/1485808935 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73581027a0 msgr2=0x7f7358198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:00.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.394+0000 7f735f4ce640 1 --2- 172.21.15.33:0/1485808935 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73581027a0 0x7f7358198990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f734802a930 tx=0x7f7348004040 comp rx=0 tx=0).stop 2024-09-12T12:27:00.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.394+0000 7f735f4ce640 1 -- 172.21.15.33:0/1485808935 shutdown_connections 2024-09-12T12:27:00.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.394+0000 7f735f4ce640 1 --2- 172.21.15.33:0/1485808935 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f73440a2c00 0x7f73440a50c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:00.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.394+0000 7f735f4ce640 1 --2- 172.21.15.33:0/1485808935 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7358106f20 0x7f735819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:00.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.394+0000 7f735f4ce640 1 --2- 172.21.15.33:0/1485808935 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73581027a0 0x7f7358198990 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:00.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.394+0000 7f735f4ce640 1 --2- 172.21.15.33:0/1485808935 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7358101df0 0x7f7358198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:00.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.394+0000 7f735f4ce640 1 -- 172.21.15.33:0/1485808935 >> 172.21.15.33:0/1485808935 conn(0x7f73580fd8f0 msgr2=0x7f73580fee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:00.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.394+0000 7f735f4ce640 1 -- 172.21.15.33:0/1485808935 shutdown_connections 2024-09-12T12:27:00.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:00.395+0000 7f735f4ce640 1 -- 172.21.15.33:0/1485808935 wait complete. 2024-09-12T12:27:01.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:01 smithi033 ceph-mon[31246]: pgmap v380: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-09-12T12:27:01.310 INFO:tasks.cephfs.filesystem:scrub status for tag:2b309fd6-79df-48bc-b2c1-d1b140e1a966 - {'path': '/', 'tag': '2b309fd6-79df-48bc-b2c1-d1b140e1a966', 'options': 'recursive,force'} 2024-09-12T12:27:01.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:01 smithi043 ceph-mon[34144]: pgmap v380: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-09-12T12:27:01.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:01 smithi102 ceph-mon[34799]: pgmap v380: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-09-12T12:27:03.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:03 smithi043 ceph-mon[34144]: pgmap v381: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-12T12:27:03.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:03 smithi043 ceph-mon[34144]: scrub summary: idle 2024-09-12T12:27:03.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:03 smithi102 ceph-mon[34799]: pgmap v381: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-12T12:27:03.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:03 smithi102 ceph-mon[34799]: scrub summary: idle 2024-09-12T12:27:03.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:03 smithi033 ceph-mon[31246]: pgmap v381: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-12T12:27:03.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:03 smithi033 ceph-mon[31246]: scrub summary: idle 2024-09-12T12:27:05.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:05 smithi043 ceph-mon[34144]: pgmap v382: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-12T12:27:05.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:05 smithi102 ceph-mon[34799]: pgmap v382: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-12T12:27:05.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:05 smithi033 ceph-mon[31246]: pgmap v382: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-12T12:27:07.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:07 smithi043 ceph-mon[34144]: pgmap v383: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T12:27:07.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:07 smithi102 ceph-mon[34799]: pgmap v383: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T12:27:07.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:07 smithi033 ceph-mon[31246]: pgmap v383: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T12:27:09.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:09 smithi043 ceph-mon[34144]: pgmap v384: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-12T12:27:09.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:09 smithi102 ceph-mon[34799]: pgmap v384: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-12T12:27:09.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:09 smithi033 ceph-mon[31246]: pgmap v384: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-12T12:27:11.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:11 smithi033 ceph-mon[31246]: pgmap v385: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-12T12:27:11.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:11 smithi043 ceph-mon[34144]: pgmap v385: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-12T12:27:11.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:11 smithi102 ceph-mon[34799]: pgmap v385: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-12T12:27:13.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:13 smithi043 ceph-mon[34144]: pgmap v386: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-12T12:27:13.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:13 smithi102 ceph-mon[34799]: pgmap v386: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-12T12:27:13.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:13 smithi033 ceph-mon[31246]: pgmap v386: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-12T12:27:13.699 INFO:tasks.workunit.client.0.smithi033.stderr:Updating files: 93% (12020/12903) Updating files: 94% (12129/12903) Updating files: 95% (12258/12903) Updating files: 96% (12387/12903) Updating files: 97% (12516/12903) Updating files: 98% (12645/12903) Updating files: 99% (12774/12903) Updating files: 100% (12903/12903) Updating files: 100% (12903/12903), done. 2024-09-12T12:27:14.551 INFO:tasks.workunit.client.0.smithi033.stderr:Note: switching to '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'. 2024-09-12T12:27:14.551 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T12:27:14.551 INFO:tasks.workunit.client.0.smithi033.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T12:27:14.552 INFO:tasks.workunit.client.0.smithi033.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T12:27:14.552 INFO:tasks.workunit.client.0.smithi033.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T12:27:14.552 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T12:27:14.552 INFO:tasks.workunit.client.0.smithi033.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T12:27:14.552 INFO:tasks.workunit.client.0.smithi033.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T12:27:14.552 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T12:27:14.552 INFO:tasks.workunit.client.0.smithi033.stderr: git switch -c 2024-09-12T12:27:14.552 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T12:27:14.552 INFO:tasks.workunit.client.0.smithi033.stderr:Or undo this operation with: 2024-09-12T12:27:14.552 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T12:27:14.552 INFO:tasks.workunit.client.0.smithi033.stderr: git switch - 2024-09-12T12:27:14.552 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T12:27:14.553 INFO:tasks.workunit.client.0.smithi033.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T12:27:14.553 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T12:27:14.553 INFO:tasks.workunit.client.0.smithi033.stderr:HEAD is now at 086c737fa75 Merge pull request #59733 from zdover23/wip-doc-2024-09-11-backport-59635-to-squid 2024-09-12T12:27:14.557 DEBUG:teuthology.orchestra.run.smithi033:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T12:27:14.583 INFO:tasks.workunit.client.0.smithi033.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T12:27:14.585 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T12:27:14.586 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T12:27:15.266 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T12:27:15.337 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T12:27:15.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:15 smithi043 ceph-mon[34144]: pgmap v387: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 7 op/s 2024-09-12T12:27:15.378 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T12:27:15.379 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T12:27:15.379 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T12:27:15.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:15 smithi102 ceph-mon[34799]: pgmap v387: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 7 op/s 2024-09-12T12:27:15.420 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T12:27:15.424 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T12:27:15.424 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T12:27:15.481 INFO:tasks.workunit:Running workunits matching suites/iogen.sh on client.0... 2024-09-12T12:27:15.482 INFO:tasks.workunit:Running workunit suites/iogen.sh... 2024-09-12T12:27:15.482 DEBUG:teuthology.orchestra.run.smithi033:workunit test suites/iogen.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iogen.sh 2024-09-12T12:27:15.483 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:15 smithi033 ceph-mon[31246]: pgmap v387: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 7 op/s 2024-09-12T12:27:15.547 INFO:tasks.workunit.client.0.smithi033.stdout:getting iogen 2024-09-12T12:27:15.547 INFO:tasks.workunit.client.0.smithi033.stderr:+ echo 'getting iogen' 2024-09-12T12:27:15.547 INFO:tasks.workunit.client.0.smithi033.stderr:+ wget http://download.ceph.com/qa/iogen_3.1p0.tar 2024-09-12T12:27:15.570 INFO:tasks.workunit.client.0.smithi033.stderr:--2024-09-12 12:27:15-- http://download.ceph.com/qa/iogen_3.1p0.tar 2024-09-12T12:27:15.571 INFO:tasks.workunit.client.0.smithi033.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-09-12T12:27:15.634 INFO:tasks.workunit.client.0.smithi033.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-09-12T12:27:15.698 INFO:tasks.workunit.client.0.smithi033.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-12T12:27:15.699 INFO:tasks.workunit.client.0.smithi033.stderr:Length: 8071 (7.9K) [application/octet-stream] 2024-09-12T12:27:15.700 INFO:tasks.workunit.client.0.smithi033.stderr:Saving to: ‘iogen_3.1p0.tar’ 2024-09-12T12:27:15.703 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T12:27:15.703 INFO:tasks.workunit.client.0.smithi033.stderr: 0K ....... 100% 1.42G=0s 2024-09-12T12:27:15.704 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T12:27:15.704 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12 12:27:15 (1.42 GB/s) - ‘iogen_3.1p0.tar’ saved [8071/8071] 2024-09-12T12:27:15.704 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T12:27:15.704 INFO:tasks.workunit.client.0.smithi033.stderr:+ tar -xvzf iogen_3.1p0.tar 2024-09-12T12:27:15.719 INFO:tasks.workunit.client.0.smithi033.stdout:iogen_3.1p0 2024-09-12T12:27:15.720 INFO:tasks.workunit.client.0.smithi033.stdout:iogen_3.1p0/src 2024-09-12T12:27:15.722 INFO:tasks.workunit.client.0.smithi033.stdout:iogen_3.1p0/src/iogen.8 2024-09-12T12:27:15.724 INFO:tasks.workunit.client.0.smithi033.stdout:iogen_3.1p0/src/iogen.c 2024-09-12T12:27:15.727 INFO:tasks.workunit.client.0.smithi033.stdout:iogen_3.1p0/README 2024-09-12T12:27:15.729 INFO:tasks.workunit.client.0.smithi033.stdout:iogen_3.1p0/Makefile.bsd 2024-09-12T12:27:15.731 INFO:tasks.workunit.client.0.smithi033.stdout:iogen_3.1p0/Makefile 2024-09-12T12:27:15.734 INFO:tasks.workunit.client.0.smithi033.stderr:+ cd iogen_3.1p0 2024-09-12T12:27:15.736 INFO:tasks.workunit.client.0.smithi033.stdout:making iogen 2024-09-12T12:27:15.736 INFO:tasks.workunit.client.0.smithi033.stderr:+ echo 'making iogen' 2024-09-12T12:27:15.736 INFO:tasks.workunit.client.0.smithi033.stderr:+ make 2024-09-12T12:27:15.748 INFO:tasks.workunit.client.0.smithi033.stdout:gcc -D_FILE_OFFSET_BITS=64 -DVERSION=\"3.1p0\" -Dstrlcpy=strncpy -Darc4random=rand -O2 src/iogen.c -o iogen 2024-09-12T12:27:15.995 INFO:tasks.workunit.client.0.smithi033.stdout:nroff -mandoc -Tascii src/iogen.8 > iogen.cat8 2024-09-12T12:27:16.099 INFO:tasks.workunit.client.0.smithi033.stdout:running iogen 2024-09-12T12:27:16.099 INFO:tasks.workunit.client.0.smithi033.stderr:+ echo 'running iogen' 2024-09-12T12:27:16.099 INFO:tasks.workunit.client.0.smithi033.stderr:+ ./iogen -n 5 -s 2g 2024-09-12T12:27:16.100 INFO:tasks.workunit.client.0.smithi033.stderr:child spawned 87937 2024-09-12T12:27:16.101 INFO:tasks.workunit.client.0.smithi033.stderr:child spawned 87938 2024-09-12T12:27:16.101 INFO:tasks.workunit.client.0.smithi033.stderr:child spawned 87939 2024-09-12T12:27:16.101 INFO:tasks.workunit.client.0.smithi033.stderr:child spawned 87940 2024-09-12T12:27:16.101 INFO:tasks.workunit.client.0.smithi033.stderr:child spawned 87941 2024-09-12T12:27:16.101 INFO:tasks.workunit.client.0.smithi033.stderr:+ echo 'sleep for 10 min' 2024-09-12T12:27:16.101 INFO:tasks.workunit.client.0.smithi033.stdout:sleep for 10 min 2024-09-12T12:27:16.101 INFO:tasks.workunit.client.0.smithi033.stderr:+ sleep 600 2024-09-12T12:27:17.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:17 smithi043 ceph-mon[34144]: pgmap v388: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T12:27:17.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:17 smithi102 ceph-mon[34799]: pgmap v388: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T12:27:17.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:17 smithi033 ceph-mon[31246]: pgmap v388: 129 pgs: 129 active+clean; 660 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T12:27:19.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:19 smithi043 ceph-mon[34144]: pgmap v389: 129 pgs: 129 active+clean; 131 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 11 MiB/s wr, 13 op/s 2024-09-12T12:27:19.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:19 smithi102 ceph-mon[34799]: pgmap v389: 129 pgs: 129 active+clean; 131 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 11 MiB/s wr, 13 op/s 2024-09-12T12:27:19.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:19 smithi033 ceph-mon[31246]: pgmap v389: 129 pgs: 129 active+clean; 131 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 11 MiB/s wr, 13 op/s 2024-09-12T12:27:21.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:21 smithi043 ceph-mon[34144]: pgmap v390: 129 pgs: 129 active+clean; 198 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 20 op/s 2024-09-12T12:27:21.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:21 smithi102 ceph-mon[34799]: pgmap v390: 129 pgs: 129 active+clean; 198 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 20 op/s 2024-09-12T12:27:21.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:21 smithi033 ceph-mon[31246]: pgmap v390: 129 pgs: 129 active+clean; 198 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 20 op/s 2024-09-12T12:27:23.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:23 smithi043 ceph-mon[34144]: pgmap v391: 129 pgs: 129 active+clean; 488 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 41 MiB/s wr, 31 op/s 2024-09-12T12:27:23.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:23 smithi102 ceph-mon[34799]: pgmap v391: 129 pgs: 129 active+clean; 488 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 41 MiB/s wr, 31 op/s 2024-09-12T12:27:23.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:23 smithi033 ceph-mon[31246]: pgmap v391: 129 pgs: 129 active+clean; 488 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 41 MiB/s wr, 31 op/s 2024-09-12T12:27:25.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:25 smithi043 ceph-mon[34144]: pgmap v392: 129 pgs: 129 active+clean; 1002 MiB data, 510 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 83 MiB/s wr, 56 op/s 2024-09-12T12:27:25.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:25 smithi102 ceph-mon[34799]: pgmap v392: 129 pgs: 129 active+clean; 1002 MiB data, 510 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 83 MiB/s wr, 56 op/s 2024-09-12T12:27:25.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:25 smithi033 ceph-mon[31246]: pgmap v392: 129 pgs: 129 active+clean; 1002 MiB data, 510 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 83 MiB/s wr, 56 op/s 2024-09-12T12:27:27.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:27 smithi043 ceph-mon[34144]: pgmap v393: 129 pgs: 129 active+clean; 1002 MiB data, 510 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 83 MiB/s wr, 54 op/s 2024-09-12T12:27:27.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:27 smithi102 ceph-mon[34799]: pgmap v393: 129 pgs: 129 active+clean; 1002 MiB data, 510 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 83 MiB/s wr, 54 op/s 2024-09-12T12:27:27.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:27 smithi033 ceph-mon[31246]: pgmap v393: 129 pgs: 129 active+clean; 1002 MiB data, 510 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 83 MiB/s wr, 54 op/s 2024-09-12T12:27:29.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:29 smithi043 ceph-mon[34144]: pgmap v394: 129 pgs: 129 active+clean; 1.6 GiB data, 602 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 139 MiB/s wr, 83 op/s 2024-09-12T12:27:29.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:29 smithi102 ceph-mon[34799]: pgmap v394: 129 pgs: 129 active+clean; 1.6 GiB data, 602 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 139 MiB/s wr, 83 op/s 2024-09-12T12:27:29.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:29 smithi033 ceph-mon[31246]: pgmap v394: 129 pgs: 129 active+clean; 1.6 GiB data, 602 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 139 MiB/s wr, 83 op/s 2024-09-12T12:27:31.311 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T12:27:31.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:31 smithi102 ceph-mon[34799]: pgmap v395: 129 pgs: 129 active+clean; 1.8 GiB data, 621 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 143 MiB/s wr, 84 op/s 2024-09-12T12:27:31.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:31 smithi033 ceph-mon[31246]: pgmap v395: 129 pgs: 129 active+clean; 1.8 GiB data, 621 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 143 MiB/s wr, 84 op/s 2024-09-12T12:27:31.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:31 smithi043 ceph-mon[34144]: pgmap v395: 129 pgs: 129 active+clean; 1.8 GiB data, 621 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 143 MiB/s wr, 84 op/s 2024-09-12T12:27:31.700 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:27:32.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.647+0000 7f3e167fc640 1 -- 172.21.15.33:0/732475309 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e08036070 con 0x7f3e18105ec0 2024-09-12T12:27:32.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.648+0000 7f3e1da81640 1 -- 172.21.15.33:0/732475309 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e18105ec0 msgr2=0x7f3e18106340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:32.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.648+0000 7f3e1da81640 1 --2- 172.21.15.33:0/732475309 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e18105ec0 0x7f3e18106340 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3e08009c10 tx=0x7f3e0802a6f0 comp rx=0 tx=0).stop 2024-09-12T12:27:32.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.648+0000 7f3e1da81640 1 -- 172.21.15.33:0/732475309 shutdown_connections 2024-09-12T12:27:32.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.648+0000 7f3e1da81640 1 --2- 172.21.15.33:0/732475309 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e18105ec0 0x7f3e18106340 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:32.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.648+0000 7f3e1da81640 1 --2- 172.21.15.33:0/732475309 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e181011e0 0x7f3e18105980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:32.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.648+0000 7f3e1da81640 1 --2- 172.21.15.33:0/732475309 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e181008c0 0x7f3e18100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:32.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.648+0000 7f3e1da81640 1 -- 172.21.15.33:0/732475309 >> 172.21.15.33:0/732475309 conn(0x7f3e180fc7d0 msgr2=0x7f3e180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:32.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.648+0000 7f3e1da81640 1 -- 172.21.15.33:0/732475309 shutdown_connections 2024-09-12T12:27:32.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.648+0000 7f3e1da81640 1 -- 172.21.15.33:0/732475309 wait complete. 2024-09-12T12:27:32.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.649+0000 7f3e1da81640 1 Processor -- start 2024-09-12T12:27:32.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.649+0000 7f3e1da81640 1 -- start start 2024-09-12T12:27:32.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.650+0000 7f3e1da81640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e181008c0 0x7f3e1819eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:32.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.650+0000 7f3e1da81640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e181011e0 0x7f3e1819f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:32.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.650+0000 7f3e1da81640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e18105ec0 0x7f3e181a33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:32.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.650+0000 7f3e1da81640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3e18118510 con 0x7f3e181008c0 2024-09-12T12:27:32.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.650+0000 7f3e1da81640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3e18118390 con 0x7f3e181011e0 2024-09-12T12:27:32.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.650+0000 7f3e1da81640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3e18118690 con 0x7f3e18105ec0 2024-09-12T12:27:32.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.650+0000 7f3e177fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e181008c0 0x7f3e1819eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:32.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.650+0000 7f3e16ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e181011e0 0x7f3e1819f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:32.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.650+0000 7f3e177fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e181008c0 0x7f3e1819eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58534/0 (socket says 172.21.15.33:58534) 2024-09-12T12:27:32.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.650+0000 7f3e177fe640 1 -- 172.21.15.33:0/645959435 learned_addr learned my addr 172.21.15.33:0/645959435 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:27:32.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.650+0000 7f3e17fff640 1 --2- 172.21.15.33:0/645959435 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e18105ec0 0x7f3e181a33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:32.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.650+0000 7f3e16ffd640 1 -- 172.21.15.33:0/645959435 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e18105ec0 msgr2=0x7f3e181a33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:32.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.650+0000 7f3e16ffd640 1 --2- 172.21.15.33:0/645959435 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e18105ec0 0x7f3e181a33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:32.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.650+0000 7f3e16ffd640 1 -- 172.21.15.33:0/645959435 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e181008c0 msgr2=0x7f3e1819eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:32.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.650+0000 7f3e16ffd640 1 --2- 172.21.15.33:0/645959435 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e181008c0 0x7f3e1819eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:32.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.651+0000 7f3e16ffd640 1 -- 172.21.15.33:0/645959435 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e181a3b10 con 0x7f3e181011e0 2024-09-12T12:27:32.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.651+0000 7f3e16ffd640 1 --2- 172.21.15.33:0/645959435 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e181011e0 0x7f3e1819f020 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3e10005fd0 tx=0x7f3e1000ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:32.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.651+0000 7f3e14ff9640 1 -- 172.21.15.33:0/645959435 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1000cd00 con 0x7f3e181011e0 2024-09-12T12:27:32.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.651+0000 7f3e1da81640 1 -- 172.21.15.33:0/645959435 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e181a3e00 con 0x7f3e181011e0 2024-09-12T12:27:32.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.651+0000 7f3e1da81640 1 -- 172.21.15.33:0/645959435 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e181ab690 con 0x7f3e181011e0 2024-09-12T12:27:32.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.651+0000 7f3e14ff9640 1 -- 172.21.15.33:0/645959435 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3e100035f0 con 0x7f3e181011e0 2024-09-12T12:27:32.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.651+0000 7f3e14ff9640 1 -- 172.21.15.33:0/645959435 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e10010690 con 0x7f3e181011e0 2024-09-12T12:27:32.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.654+0000 7f3e14ff9640 1 -- 172.21.15.33:0/645959435 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3e10004020 con 0x7f3e181011e0 2024-09-12T12:27:32.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.655+0000 7f3e1fe5a740 1 Processor -- start 2024-09-12T12:27:32.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.655+0000 7f3e14ff9640 1 --2- 172.21.15.33:0/645959435 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f3e040a2c00 0x7f3e040a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:32.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.655+0000 7f3e1fe5a740 1 -- start start 2024-09-12T12:27:32.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.655+0000 7f3e1fe5a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f587144a0 0x563f58714880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:32.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.655+0000 7f3e1fe5a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563f58714dc0 0x563f5871f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:32.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.655+0000 7f3e1fe5a740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563f5871f680 0x563f58721a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:32.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.655+0000 7f3e1fe5a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x563f5867a2e0 con 0x563f587144a0 2024-09-12T12:27:32.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.655+0000 7f3e1fe5a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x563f58621ce0 con 0x563f58714dc0 2024-09-12T12:27:32.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.655+0000 7f3e1fe5a740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x563f586762a0 con 0x563f5871f680 2024-09-12T12:27:32.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.655+0000 7f3e14ff9640 1 -- 172.21.15.33:0/645959435 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f3e100cf490 con 0x7f3e181011e0 2024-09-12T12:27:32.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.655+0000 7f3e177fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f587144a0 0x563f58714880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:32.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.655+0000 7f3e17fff640 1 --2- 172.21.15.33:0/645959435 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f3e040a2c00 0x7f3e040a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:32.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.655+0000 7f3e177fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f587144a0 0x563f58714880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58544/0 (socket says 172.21.15.33:58544) 2024-09-12T12:27:32.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.655+0000 7f3e177fe640 1 -- 172.21.15.33:0/2942726230 learned_addr learned my addr 172.21.15.33:0/2942726230 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:27:32.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.655+0000 7f3e16ffd640 1 --2- 172.21.15.33:0/2942726230 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563f58714dc0 0x563f5871f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:32.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.656+0000 7f3e17fff640 1 --2- 172.21.15.33:0/2942726230 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563f5871f680 0x563f58721a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:32.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.656+0000 7f3e16ffd640 1 -- 172.21.15.33:0/2942726230 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563f5871f680 msgr2=0x563f58721a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:32.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.656+0000 7f3e16ffd640 1 --2- 172.21.15.33:0/2942726230 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563f5871f680 0x563f58721a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:32.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.656+0000 7f3e16ffd640 1 -- 172.21.15.33:0/2942726230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f587144a0 msgr2=0x563f58714880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:32.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.657+0000 7f3e17fff640 1 --2- 172.21.15.33:0/645959435 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f3e040a2c00 0x7f3e040a50c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3e08006010 tx=0x7f3e08009960 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:32.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.657+0000 7f3e16ffd640 1 --2- 172.21.15.33:0/2942726230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f587144a0 0x563f58714880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:32.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.657+0000 7f3e16ffd640 1 -- 172.21.15.33:0/2942726230 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f58606440 con 0x563f58714dc0 2024-09-12T12:27:32.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.657+0000 7f3e177fe640 1 --2- 172.21.15.33:0/2942726230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f587144a0 0x563f58714880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:27:32.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.657+0000 7f3e16ffd640 1 --2- 172.21.15.33:0/2942726230 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563f58714dc0 0x563f5871f140 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3e100ccc00 tx=0x7f3e10009510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e628134b098dfbc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:32.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.658+0000 7f3e0dffb640 1 -- 172.21.15.33:0/2942726230 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1009fd10 con 0x563f58714dc0 2024-09-12T12:27:32.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.658+0000 7f3e0dffb640 1 -- 172.21.15.33:0/2942726230 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3e100a45d0 con 0x563f58714dc0 2024-09-12T12:27:32.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.658+0000 7f3e0dffb640 1 -- 172.21.15.33:0/2942726230 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e100860d0 con 0x563f58714dc0 2024-09-12T12:27:32.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.659+0000 7f3e1fe5a740 1 -- 172.21.15.33:0/2942726230 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563f58714dc0 msgr2=0x563f5871f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:32.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.659+0000 7f3e1fe5a740 1 --2- 172.21.15.33:0/2942726230 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563f58714dc0 0x563f5871f140 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3e100ccc00 tx=0x7f3e10009510 comp rx=0 tx=0).stop 2024-09-12T12:27:32.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.659+0000 7f3e1fe5a740 1 -- 172.21.15.33:0/2942726230 shutdown_connections 2024-09-12T12:27:32.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.659+0000 7f3e1fe5a740 1 --2- 172.21.15.33:0/2942726230 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563f5871f680 0x563f58721a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:32.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.659+0000 7f3e1fe5a740 1 --2- 172.21.15.33:0/2942726230 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563f58714dc0 0x563f5871f140 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:32.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.659+0000 7f3e1fe5a740 1 --2- 172.21.15.33:0/2942726230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f587144a0 0x563f58714880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:32.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.659+0000 7f3e1fe5a740 1 -- 172.21.15.33:0/2942726230 >> 172.21.15.33:0/2942726230 conn(0x563f58710a30 msgr2=0x563f58710e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:32.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.659+0000 7f3e1fe5a740 1 -- 172.21.15.33:0/2942726230 shutdown_connections 2024-09-12T12:27:32.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.659+0000 7f3e1fe5a740 1 -- 172.21.15.33:0/2942726230 wait complete. 2024-09-12T12:27:32.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.660+0000 7f3e1fe5a740 1 -- start start 2024-09-12T12:27:32.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.660+0000 7f3e1fe5a740 1 Processor -- start 2024-09-12T12:27:32.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.660+0000 7f3e1fe5a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563f587144a0 0x563f5871ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:32.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.660+0000 7f3e1fe5a740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563f58714dc0 0x563f5871c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:32.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.660+0000 7f3e1fe5a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f5871f680 0x563f5871c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:32.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.660+0000 7f3e1fe5a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x563f58722250 con 0x563f5871f680 2024-09-12T12:27:32.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.660+0000 7f3e1fe5a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x563f58635050 con 0x563f587144a0 2024-09-12T12:27:32.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.660+0000 7f3e1fe5a740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x563f587223d0 con 0x563f58714dc0 2024-09-12T12:27:32.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.660+0000 7f3e1fe5a740 10 client.0 _ll_register_callbacks cb 0x563f58675160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:27:32.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.661+0000 7f3e17fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f5871f680 0x563f5871c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:32.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.661+0000 7f3e17fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f5871f680 0x563f5871c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58550/0 (socket says 172.21.15.33:58550) 2024-09-12T12:27:32.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.661+0000 7f3e17fff640 1 -- 172.21.15.33:0/1850461324 learned_addr learned my addr 172.21.15.33:0/1850461324 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:27:32.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.661+0000 7f3e177fe640 1 --2- 172.21.15.33:0/1850461324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563f587144a0 0x563f5871ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:32.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.661+0000 7f3e17fff640 1 -- 172.21.15.33:0/1850461324 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563f58714dc0 msgr2=0x563f5871c1c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:27:32.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.661+0000 7f3e17fff640 1 --2- 172.21.15.33:0/1850461324 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563f58714dc0 0x563f5871c1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:32.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.661+0000 7f3e17fff640 1 -- 172.21.15.33:0/1850461324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563f587144a0 msgr2=0x563f5871ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:32.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.661+0000 7f3e17fff640 1 --2- 172.21.15.33:0/1850461324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563f587144a0 0x563f5871ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:32.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.661+0000 7f3e17fff640 1 -- 172.21.15.33:0/1850461324 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f583eb3c0 con 0x563f5871f680 2024-09-12T12:27:32.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.662+0000 7f3e17fff640 1 --2- 172.21.15.33:0/1850461324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f5871f680 0x563f5871c700 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3e08033000 tx=0x7f3e0802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e87805049d4fbcc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:32.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.662+0000 7f3df6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:27:32.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.663+0000 7f3df6ffd640 1 -- 172.21.15.33:0/1850461324 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e08036040 con 0x563f5871f680 2024-09-12T12:27:32.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.663+0000 7f3e1fe5a740 1 -- 172.21.15.33:0/1850461324 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e100a45d0 con 0x563f5871f680 2024-09-12T12:27:32.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.663+0000 7f3df6ffd640 1 -- 172.21.15.33:0/1850461324 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f3e08004450 con 0x563f5871f680 2024-09-12T12:27:32.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.664+0000 7f3df6ffd640 1 -- 172.21.15.33:0/1850461324 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3e08030eb0 con 0x563f5871f680 2024-09-12T12:27:32.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.664+0000 7f3e1fe5a740 10 client.15447 fetch_fsmap learned FSMap version 25 2024-09-12T12:27:32.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.664+0000 7f3e1fe5a740 1 -- 172.21.15.33:0/1850461324 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563f5872dbe0 con 0x563f5871f680 2024-09-12T12:27:32.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.665+0000 7f3df6ffd640 1 -- 172.21.15.33:0/1850461324 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3e100a45d0 con 0x563f5871f680 2024-09-12T12:27:32.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.665+0000 7f3df6ffd640 1 -- 172.21.15.33:0/1850461324 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f3e08031af0 con 0x563f5871f680 2024-09-12T12:27:32.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.665+0000 7f3e1fe5a740 10 client.15447 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T12:27:32.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.665+0000 7f3e1fe5a740 10 client.15447 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:27:32.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.665+0000 7f3e1fe5a740 20 client.15447 populate_metadata read hostname 'smithi033' 2024-09-12T12:27:32.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.665+0000 7f3e1fe5a740 1 --2- 172.21.15.33:0/1850461324 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x563f5872f4b0 0x563f58731930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:32.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.665+0000 7f3e1fe5a740 4 client.15447 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:27:32.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.665+0000 7f3e1fe5a740 1 -- 172.21.15.33:0/1850461324 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563f58687850 con 0x563f5872f4b0 2024-09-12T12:27:32.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.665+0000 7f3e177fe640 1 --2- 172.21.15.33:0/1850461324 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x563f5872f4b0 0x563f58731930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:32.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.666+0000 7f3e177fe640 1 --2- 172.21.15.33:0/1850461324 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x563f5872f4b0 0x563f58731930 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35ffde0b0a968ade server_cookie=a3293b124327fdc1 in_seq=0 out_seq=0 2024-09-12T12:27:32.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.666+0000 7f3df6ffd640 10 client.15447 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:27:32.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.667+0000 7f3df6ffd640 1 -- 172.21.15.33:0/1850461324 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563f58687850 con 0x563f5872f4b0 2024-09-12T12:27:32.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.667+0000 7f3df6ffd640 10 client.15447 handle_command_reply: tid=0 2024-09-12T12:27:32.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.667+0000 7f3e1fe5a740 1 client.15447 shutdown 2024-09-12T12:27:32.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.668+0000 7f3e1fe5a740 1 -- 172.21.15.33:0/1850461324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f5871f680 msgr2=0x563f5871c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:32.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.668+0000 7f3e1fe5a740 1 --2- 172.21.15.33:0/1850461324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f5871f680 0x563f5871c700 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3e08033000 tx=0x7f3e0802a6f0 comp rx=0 tx=0).stop 2024-09-12T12:27:32.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.668+0000 7f3e1fe5a740 1 -- 172.21.15.33:0/1850461324 shutdown_connections 2024-09-12T12:27:32.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.668+0000 7f3e1fe5a740 1 --2- 172.21.15.33:0/1850461324 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x563f5872f4b0 0x563f58731930 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:32.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.668+0000 7f3e1fe5a740 1 --2- 172.21.15.33:0/1850461324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f5871f680 0x563f5871c700 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:32.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.668+0000 7f3e1fe5a740 1 --2- 172.21.15.33:0/1850461324 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563f58714dc0 0x563f5871c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:32.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.668+0000 7f3e1fe5a740 1 --2- 172.21.15.33:0/1850461324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563f587144a0 0x563f5871ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:32.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.668+0000 7f3df6ffd640 0 client.15447 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:27:32.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.668+0000 7f3e1fe5a740 1 -- 172.21.15.33:0/1850461324 >> 172.21.15.33:0/1850461324 conn(0x563f58710a30 msgr2=0x563f5870fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:32.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.668+0000 7f3e1fe5a740 1 -- 172.21.15.33:0/1850461324 shutdown_connections 2024-09-12T12:27:32.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.668+0000 7f3e1fe5a740 1 -- 172.21.15.33:0/1850461324 wait complete. 2024-09-12T12:27:32.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.668+0000 7f3e1fe5a740 20 client.15447 trim_cache size 0 max 16384 2024-09-12T12:27:32.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.697+0000 7f3e1fe5a740 1 Processor -- start 2024-09-12T12:27:32.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.697+0000 7f3e1fe5a740 1 -- start start 2024-09-12T12:27:32.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.697+0000 7f3e1fe5a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563f587144a0 0x563f5872b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:32.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.697+0000 7f3e1fe5a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f58714dc0 0x563f58737240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:32.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.697+0000 7f3e1fe5a740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563f5871f680 0x563f58737780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:32.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.697+0000 7f3e1fe5a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3df8012460 con 0x563f58714dc0 2024-09-12T12:27:32.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.697+0000 7f3e1fe5a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3df800fd30 con 0x563f587144a0 2024-09-12T12:27:32.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.697+0000 7f3e1fe5a740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3df800db80 con 0x563f5871f680 2024-09-12T12:27:32.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.698+0000 7f3e16ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f58714dc0 0x563f58737240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:32.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.698+0000 7f3e16ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f58714dc0 0x563f58737240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58556/0 (socket says 172.21.15.33:58556) 2024-09-12T12:27:32.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.698+0000 7f3e16ffd640 1 -- 172.21.15.33:0/804049132 learned_addr learned my addr 172.21.15.33:0/804049132 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:27:32.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.698+0000 7f3e177fe640 1 --2- 172.21.15.33:0/804049132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563f587144a0 0x563f5872b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:32.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.698+0000 7f3e17fff640 1 --2- 172.21.15.33:0/804049132 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563f5871f680 0x563f58737780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:32.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.698+0000 7f3e177fe640 1 -- 172.21.15.33:0/804049132 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563f5871f680 msgr2=0x563f58737780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:32.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.698+0000 7f3e177fe640 1 --2- 172.21.15.33:0/804049132 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563f5871f680 0x563f58737780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:32.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.698+0000 7f3e177fe640 1 -- 172.21.15.33:0/804049132 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f58714dc0 msgr2=0x563f58737240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:32.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.698+0000 7f3e177fe640 1 --2- 172.21.15.33:0/804049132 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f58714dc0 0x563f58737240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:32.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.698+0000 7f3e177fe640 1 -- 172.21.15.33:0/804049132 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f5871cf80 con 0x563f587144a0 2024-09-12T12:27:32.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.698+0000 7f3e177fe640 1 --2- 172.21.15.33:0/804049132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563f587144a0 0x563f5872b4e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x563f587321e0 tx=0x7f3e00005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a011450d9b568fc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:32.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.699+0000 7f3e0d7fa640 1 -- 172.21.15.33:0/804049132 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e000042f0 con 0x563f587144a0 2024-09-12T12:27:32.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.699+0000 7f3e0d7fa640 1 -- 172.21.15.33:0/804049132 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3e00004490 con 0x563f587144a0 2024-09-12T12:27:32.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.699+0000 7f3e0d7fa640 1 -- 172.21.15.33:0/804049132 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0001da70 con 0x563f587144a0 2024-09-12T12:27:32.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.699+0000 7f3e1fe5a740 1 -- 172.21.15.33:0/804049132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563f587144a0 msgr2=0x563f5872b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:32.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.699+0000 7f3e1fe5a740 1 --2- 172.21.15.33:0/804049132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563f587144a0 0x563f5872b4e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x563f587321e0 tx=0x7f3e00005f90 comp rx=0 tx=0).stop 2024-09-12T12:27:32.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.699+0000 7f3e1fe5a740 1 -- 172.21.15.33:0/804049132 shutdown_connections 2024-09-12T12:27:32.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.700+0000 7f3e1fe5a740 1 --2- 172.21.15.33:0/804049132 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563f5871f680 0x563f58737780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:32.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.700+0000 7f3e1fe5a740 1 --2- 172.21.15.33:0/804049132 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f58714dc0 0x563f58737240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:32.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.700+0000 7f3e1fe5a740 1 --2- 172.21.15.33:0/804049132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563f587144a0 0x563f5872b4e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:32.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.700+0000 7f3e1fe5a740 1 -- 172.21.15.33:0/804049132 >> 172.21.15.33:0/804049132 conn(0x563f58710a30 msgr2=0x563f5871aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:32.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.700+0000 7f3e1fe5a740 1 -- 172.21.15.33:0/804049132 shutdown_connections 2024-09-12T12:27:32.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.700+0000 7f3e1fe5a740 1 -- 172.21.15.33:0/804049132 wait complete. 2024-09-12T12:27:32.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.700+0000 7f3e1fe5a740 1 -- start start 2024-09-12T12:27:32.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.700+0000 7f3e1fe5a740 1 Processor -- start 2024-09-12T12:27:32.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.701+0000 7f3e1fe5a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f587144a0 0x563f58727910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:32.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.701+0000 7f3e1fe5a740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563f58714dc0 0x563f58727e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:32.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.701+0000 7f3e1fe5a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563f5871f680 0x563f58722cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:32.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.701+0000 7f3e1fe5a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3df800e1f0 con 0x563f587144a0 2024-09-12T12:27:32.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.701+0000 7f3e1fe5a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3df800f660 con 0x563f5871f680 2024-09-12T12:27:32.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.701+0000 7f3e1fe5a740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3df800e8c0 con 0x563f58714dc0 2024-09-12T12:27:32.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.701+0000 7f3e177fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f587144a0 0x563f58727910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:32.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.701+0000 7f3e1fe5a740 10 client.0 _ll_register_callbacks cb 0x7f3e10005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:27:32.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.701+0000 7f3e177fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f587144a0 0x563f58727910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58566/0 (socket says 172.21.15.33:58566) 2024-09-12T12:27:32.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.701+0000 7f3e177fe640 1 -- 172.21.15.33:0/3532715629 learned_addr learned my addr 172.21.15.33:0/3532715629 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:27:32.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.701+0000 7f3e17fff640 1 --2- 172.21.15.33:0/3532715629 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563f5871f680 0x563f58722cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:32.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.701+0000 7f3e16ffd640 1 --2- 172.21.15.33:0/3532715629 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563f58714dc0 0x563f58727e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:32.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.701+0000 7f3e177fe640 1 -- 172.21.15.33:0/3532715629 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563f58714dc0 msgr2=0x563f58727e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:32.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.701+0000 7f3e177fe640 1 --2- 172.21.15.33:0/3532715629 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563f58714dc0 0x563f58727e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:32.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.701+0000 7f3e177fe640 1 -- 172.21.15.33:0/3532715629 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563f5871f680 msgr2=0x563f58722cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:32.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.701+0000 7f3e177fe640 1 --2- 172.21.15.33:0/3532715629 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563f5871f680 0x563f58722cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:32.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.701+0000 7f3e177fe640 1 -- 172.21.15.33:0/3532715629 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f58723500 con 0x563f587144a0 2024-09-12T12:27:32.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.702+0000 7f3e177fe640 1 --2- 172.21.15.33:0/3532715629 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f587144a0 0x563f58727910 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f3e0000a010 tx=0x7f3e0001d440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dc4362ba271a3e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:32.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.702+0000 7f3df6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:27:32.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.702+0000 7f3df6ffd640 1 -- 172.21.15.33:0/3532715629 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e00005250 con 0x563f587144a0 2024-09-12T12:27:32.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.702+0000 7f3df6ffd640 1 -- 172.21.15.33:0/3532715629 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f3e000053f0 con 0x563f587144a0 2024-09-12T12:27:32.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.702+0000 7f3e1fe5a740 1 -- 172.21.15.33:0/3532715629 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e00004490 con 0x563f587144a0 2024-09-12T12:27:32.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.702+0000 7f3df6ffd640 1 -- 172.21.15.33:0/3532715629 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3e000055f0 con 0x563f587144a0 2024-09-12T12:27:32.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.702+0000 7f3e1fe5a740 10 client.15453 fetch_fsmap learned FSMap version 25 2024-09-12T12:27:32.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.702+0000 7f3e1fe5a740 1 -- 172.21.15.33:0/3532715629 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563f58799d80 con 0x563f587144a0 2024-09-12T12:27:32.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.703+0000 7f3df6ffd640 1 -- 172.21.15.33:0/3532715629 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3e0001dca0 con 0x563f587144a0 2024-09-12T12:27:32.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.703+0000 7f3df6ffd640 1 -- 172.21.15.33:0/3532715629 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f3e00004b70 con 0x563f587144a0 2024-09-12T12:27:32.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.703+0000 7f3e1fe5a740 10 client.15453 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T12:27:32.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.703+0000 7f3e1fe5a740 10 client.15453 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:27:32.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.703+0000 7f3e1fe5a740 20 client.15453 populate_metadata read hostname 'smithi033' 2024-09-12T12:27:32.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.703+0000 7f3e1fe5a740 1 --2- 172.21.15.33:0/3532715629 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x563f5872f4b0 0x563f5879c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:32.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.703+0000 7f3e1fe5a740 4 client.15453 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:27:32.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.703+0000 7f3e1fe5a740 1 -- 172.21.15.33:0/3532715629 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f3e00004490 con 0x563f5872f4b0 2024-09-12T12:27:32.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.703+0000 7f3e16ffd640 1 --2- 172.21.15.33:0/3532715629 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x563f5872f4b0 0x563f5879c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:32.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.704+0000 7f3e16ffd640 1 --2- 172.21.15.33:0/3532715629 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x563f5872f4b0 0x563f5879c410 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ead36b0a10e6d1e6 server_cookie=39a8eb3c1b34b36f in_seq=0 out_seq=0 2024-09-12T12:27:32.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.704+0000 7f3df6ffd640 10 client.15453 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:27:32.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.704+0000 7f3df6ffd640 1 -- 172.21.15.33:0/3532715629 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f3e00004490 con 0x563f5872f4b0 2024-09-12T12:27:32.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.704+0000 7f3df6ffd640 10 client.15453 handle_command_reply: tid=0 2024-09-12T12:27:32.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.704+0000 7f3e1fe5a740 1 client.15453 shutdown 2024-09-12T12:27:32.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.704+0000 7f3e1fe5a740 1 -- 172.21.15.33:0/3532715629 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f587144a0 msgr2=0x563f58727910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:32.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.704+0000 7f3e1fe5a740 1 --2- 172.21.15.33:0/3532715629 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f587144a0 0x563f58727910 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f3e0000a010 tx=0x7f3e0001d440 comp rx=0 tx=0).stop 2024-09-12T12:27:32.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.704+0000 7f3e1fe5a740 1 -- 172.21.15.33:0/3532715629 shutdown_connections 2024-09-12T12:27:32.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.704+0000 7f3e1fe5a740 1 --2- 172.21.15.33:0/3532715629 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x563f5872f4b0 0x563f5879c410 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:32.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.704+0000 7f3e1fe5a740 1 --2- 172.21.15.33:0/3532715629 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563f5871f680 0x563f58722cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:32.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.704+0000 7f3e1fe5a740 1 --2- 172.21.15.33:0/3532715629 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563f58714dc0 0x563f58727e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:32.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.704+0000 7f3e1fe5a740 1 --2- 172.21.15.33:0/3532715629 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f587144a0 0x563f58727910 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:32.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.704+0000 7f3e1fe5a740 1 -- 172.21.15.33:0/3532715629 >> 172.21.15.33:0/3532715629 conn(0x563f58710a30 msgr2=0x563f5871a650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:32.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.704+0000 7f3df6ffd640 0 client.15453 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:27:32.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.705+0000 7f3e1fe5a740 1 -- 172.21.15.33:0/3532715629 shutdown_connections 2024-09-12T12:27:32.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.705+0000 7f3e1fe5a740 1 -- 172.21.15.33:0/3532715629 wait complete. 2024-09-12T12:27:32.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.705+0000 7f3e1fe5a740 20 client.15453 trim_cache size 0 max 16384 2024-09-12T12:27:32.709 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:27:32.709 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "no active scrubs running", 2024-09-12T12:27:32.709 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": {} 2024-09-12T12:27:32.709 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:27:32.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.705+0000 7f3e1da81640 1 -- 172.21.15.33:0/645959435 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f3e040a2c00 msgr2=0x7f3e040a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:32.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.705+0000 7f3e1da81640 1 --2- 172.21.15.33:0/645959435 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f3e040a2c00 0x7f3e040a50c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3e08006010 tx=0x7f3e08009960 comp rx=0 tx=0).stop 2024-09-12T12:27:32.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.705+0000 7f3e1da81640 1 -- 172.21.15.33:0/645959435 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e181011e0 msgr2=0x7f3e1819f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:32.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.705+0000 7f3e1da81640 1 --2- 172.21.15.33:0/645959435 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e181011e0 0x7f3e1819f020 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3e10005fd0 tx=0x7f3e1000ee50 comp rx=0 tx=0).stop 2024-09-12T12:27:32.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.706+0000 7f3e1da81640 1 -- 172.21.15.33:0/645959435 shutdown_connections 2024-09-12T12:27:32.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.706+0000 7f3e1da81640 1 --2- 172.21.15.33:0/645959435 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f3e040a2c00 0x7f3e040a50c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:32.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.706+0000 7f3e1da81640 1 --2- 172.21.15.33:0/645959435 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e18105ec0 0x7f3e181a33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:32.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.706+0000 7f3e1da81640 1 --2- 172.21.15.33:0/645959435 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e181011e0 0x7f3e1819f020 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:32.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.706+0000 7f3e1da81640 1 --2- 172.21.15.33:0/645959435 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e181008c0 0x7f3e1819eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:32.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.706+0000 7f3e1da81640 1 -- 172.21.15.33:0/645959435 >> 172.21.15.33:0/645959435 conn(0x7f3e180fc7d0 msgr2=0x7f3e1810f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:32.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.706+0000 7f3e1da81640 1 -- 172.21.15.33:0/645959435 shutdown_connections 2024-09-12T12:27:32.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:32.706+0000 7f3e1da81640 1 -- 172.21.15.33:0/645959435 wait complete. 2024-09-12T12:27:33.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:33 smithi033 ceph-mon[31246]: pgmap v396: 129 pgs: 129 active+clean; 2.0 GiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 158 MiB/s wr, 86 op/s 2024-09-12T12:27:33.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:33 smithi102 ceph-mon[34799]: pgmap v396: 129 pgs: 129 active+clean; 2.0 GiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 158 MiB/s wr, 86 op/s 2024-09-12T12:27:33.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:33 smithi043 ceph-mon[34144]: pgmap v396: 129 pgs: 129 active+clean; 2.0 GiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 158 MiB/s wr, 86 op/s 2024-09-12T12:27:33.785 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T12:27:33.786 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:27:34.198 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:27:34.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:34 smithi102 ceph-mon[34799]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T12:27:34.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:34 smithi033 ceph-mon[31246]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T12:27:34.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:34 smithi043 ceph-mon[34144]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T12:27:34.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:34.781+0000 7f89c0cde640 1 -- 172.21.15.33:0/1330168046 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89bc102ea0 msgr2=0x7f89bc1005f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:34.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:34.781+0000 7f89c0cde640 1 --2- 172.21.15.33:0/1330168046 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89bc102ea0 0x7f89bc1005f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f89a4009860 tx=0x7f89a402a3d0 comp rx=0 tx=0).stop 2024-09-12T12:27:34.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:34.781+0000 7f89c0cde640 1 -- 172.21.15.33:0/1330168046 shutdown_connections 2024-09-12T12:27:34.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:34.781+0000 7f89c0cde640 1 --2- 172.21.15.33:0/1330168046 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f89bc100c10 0x7f89bc110840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:34.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:34.781+0000 7f89c0cde640 1 --2- 172.21.15.33:0/1330168046 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89bc102ea0 0x7f89bc1005f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:34.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:34.781+0000 7f89c0cde640 1 --2- 172.21.15.33:0/1330168046 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89bc102ac0 0x7f89bc1000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:34.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:34.781+0000 7f89c0cde640 1 -- 172.21.15.33:0/1330168046 >> 172.21.15.33:0/1330168046 conn(0x7f89bc077210 msgr2=0x7f89bc0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:34.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:34.781+0000 7f89c0cde640 1 -- 172.21.15.33:0/1330168046 shutdown_connections 2024-09-12T12:27:34.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:34.781+0000 7f89c0cde640 1 -- 172.21.15.33:0/1330168046 wait complete. 2024-09-12T12:27:34.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:34.782+0000 7f89c0cde640 1 Processor -- start 2024-09-12T12:27:34.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:34.782+0000 7f89c0cde640 1 -- start start 2024-09-12T12:27:34.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:34.782+0000 7f89c0cde640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89bc100c10 0x7f89bc1a4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:34.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:34.782+0000 7f89c0cde640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f89bc102ac0 0x7f89bc1a4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:34.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:34.782+0000 7f89c0cde640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89bc102ea0 0x7f89bc19e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:34.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:34.782+0000 7f89c0cde640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f89bc114040 con 0x7f89bc102ea0 2024-09-12T12:27:34.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:34.782+0000 7f89c0cde640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f89bc113ec0 con 0x7f89bc100c10 2024-09-12T12:27:34.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:34.782+0000 7f89c0cde640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f89bc1141c0 con 0x7f89bc102ac0 2024-09-12T12:27:34.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:34.782+0000 7f89ba59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89bc100c10 0x7f89bc1a4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:34.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:34.782+0000 7f89bad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89bc102ea0 0x7f89bc19e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:34.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:34.783+0000 7f89bad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89bc102ea0 0x7f89bc19e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58576/0 (socket says 172.21.15.33:58576) 2024-09-12T12:27:34.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:34.782+0000 7f89ba59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89bc100c10 0x7f89bc1a4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:44314/0 (socket says 172.21.15.33:44314) 2024-09-12T12:27:34.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:34.783+0000 7f89bad9d640 1 -- 172.21.15.33:0/3516049105 learned_addr learned my addr 172.21.15.33:0/3516049105 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:27:34.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:34.783+0000 7f89b3fff640 1 --2- 172.21.15.33:0/3516049105 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f89bc102ac0 0x7f89bc1a4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:34.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:34.783+0000 7f89ba59c640 1 -- 172.21.15.33:0/3516049105 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f89bc102ac0 msgr2=0x7f89bc1a4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:34.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:34.783+0000 7f89ba59c640 1 --2- 172.21.15.33:0/3516049105 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f89bc102ac0 0x7f89bc1a4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:34.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:34.783+0000 7f89ba59c640 1 -- 172.21.15.33:0/3516049105 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89bc102ea0 msgr2=0x7f89bc19e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:34.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:34.783+0000 7f89ba59c640 1 --2- 172.21.15.33:0/3516049105 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89bc102ea0 0x7f89bc19e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:34.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:34.783+0000 7f89ba59c640 1 -- 172.21.15.33:0/3516049105 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89bc19ef60 con 0x7f89bc100c10 2024-09-12T12:27:34.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:34.783+0000 7f89ba59c640 1 --2- 172.21.15.33:0/3516049105 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89bc100c10 0x7f89bc1a4640 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f89ac00e9f0 tx=0x7f89ac00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:34.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:34.783+0000 7f89b37fe640 1 -- 172.21.15.33:0/3516049105 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ac00cd80 con 0x7f89bc100c10 2024-09-12T12:27:34.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:34.784+0000 7f89b37fe640 1 -- 172.21.15.33:0/3516049105 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f89ac0035f0 con 0x7f89bc100c10 2024-09-12T12:27:34.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:34.784+0000 7f89c0cde640 1 -- 172.21.15.33:0/3516049105 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89bc19f250 con 0x7f89bc100c10 2024-09-12T12:27:34.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:34.784+0000 7f89c0cde640 1 -- 172.21.15.33:0/3516049105 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89bc1ab4a0 con 0x7f89bc100c10 2024-09-12T12:27:34.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:34.784+0000 7f89b37fe640 1 -- 172.21.15.33:0/3516049105 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ac010670 con 0x7f89bc100c10 2024-09-12T12:27:34.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:34.785+0000 7f89c0cde640 1 -- 172.21.15.33:0/3516049105 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f899c005290 con 0x7f89bc100c10 2024-09-12T12:27:34.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:34.787+0000 7f89b37fe640 1 -- 172.21.15.33:0/3516049105 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f89ac004000 con 0x7f89bc100c10 2024-09-12T12:27:34.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:34.788+0000 7f89b37fe640 1 --2- 172.21.15.33:0/3516049105 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f89a80a2c00 0x7f89a80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:34.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:34.788+0000 7f89b3fff640 1 --2- 172.21.15.33:0/3516049105 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f89a80a2c00 0x7f89a80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:34.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:34.788+0000 7f89b37fe640 1 -- 172.21.15.33:0/3516049105 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f89ac0cf510 con 0x7f89bc100c10 2024-09-12T12:27:34.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:34.789+0000 7f89b3fff640 1 --2- 172.21.15.33:0/3516049105 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f89a80a2c00 0x7f89a80a50c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f89bc19fb10 tx=0x7f89a4005d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:34.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:34.792+0000 7f89b37fe640 1 -- 172.21.15.33:0/3516049105 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f89ac09c0e0 con 0x7f89bc100c10 2024-09-12T12:27:35.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:35.168+0000 7f89c0cde640 1 -- 172.21.15.33:0/3516049105 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f899c005580 con 0x7f89bc100c10 2024-09-12T12:27:35.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:35.169+0000 7f89b37fe640 1 -- 172.21.15.33:0/3516049105 <== mon.2 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11913 (secure 0 0 0) 0x7f89ac09b9e0 con 0x7f89bc100c10 2024-09-12T12:27:35.170 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:27:35.170 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 26 2024-09-12T12:27:35.170 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":26,"btime":"2024-09-12T12:27:33:118378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3327066342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3327066342},{"type":"v1","addr":"172.21.15.33:6835","nonce":3327066342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/19516401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":19516401},{"type":"v1","addr":"172.21.15.33:6837","nonce":19516401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1260196118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1260196118},{"type":"v1","addr":"172.21.15.33:6839","nonce":1260196118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/4288248356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4288248356},{"type":"v1","addr":"172.21.15.33:6841","nonce":4288248356}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/3051073141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3051073141},{"type":"v1","addr":"172.21.15.43:6833","nonce":3051073141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3282762800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3282762800},{"type":"v1","addr":"172.21.15.43:6835","nonce":3282762800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:23:46.400609+0000","modified":"2024-09-12T12:27:32.553509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24490,"mds_2":24478},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3051713000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3051713000},{"type":"v1","addr":"172.21.15.102:6833","nonce":3051713000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6837/2472064883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2472064883},{"type":"v1","addr":"172.21.15.43:6837","nonce":2472064883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/1987408860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":1987408860},{"type":"v1","addr":"172.21.15.43:6839","nonce":1987408860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/4179527539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":4179527539},{"type":"v1","addr":"172.21.15.102:6835","nonce":4179527539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/2409953270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2409953270},{"type":"v1","addr":"172.21.15.102:6837","nonce":2409953270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.102:6839/1553271340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":1553271340},{"type":"v1","addr":"172.21.15.102:6839","nonce":1553271340}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24499,"qdb_cluster":[24478,24490,24499]},"id":1}]} 2024-09-12T12:27:35.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:35.173+0000 7f89c0cde640 1 -- 172.21.15.33:0/3516049105 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f89a80a2c00 msgr2=0x7f89a80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:35.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:35.173+0000 7f89c0cde640 1 --2- 172.21.15.33:0/3516049105 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f89a80a2c00 0x7f89a80a50c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f89bc19fb10 tx=0x7f89a4005d20 comp rx=0 tx=0).stop 2024-09-12T12:27:35.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:35.173+0000 7f89c0cde640 1 -- 172.21.15.33:0/3516049105 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89bc100c10 msgr2=0x7f89bc1a4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:35.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:35.173+0000 7f89c0cde640 1 --2- 172.21.15.33:0/3516049105 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89bc100c10 0x7f89bc1a4640 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f89ac00e9f0 tx=0x7f89ac00eeb0 comp rx=0 tx=0).stop 2024-09-12T12:27:35.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:35.173+0000 7f89c0cde640 1 -- 172.21.15.33:0/3516049105 shutdown_connections 2024-09-12T12:27:35.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:35.173+0000 7f89c0cde640 1 --2- 172.21.15.33:0/3516049105 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f89a80a2c00 0x7f89a80a50c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:35.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:35.173+0000 7f89c0cde640 1 --2- 172.21.15.33:0/3516049105 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89bc102ea0 0x7f89bc19e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:35.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:35.173+0000 7f89c0cde640 1 --2- 172.21.15.33:0/3516049105 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f89bc102ac0 0x7f89bc1a4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:35.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:35.173+0000 7f89c0cde640 1 --2- 172.21.15.33:0/3516049105 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89bc100c10 0x7f89bc1a4640 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:35.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:35.173+0000 7f89c0cde640 1 -- 172.21.15.33:0/3516049105 >> 172.21.15.33:0/3516049105 conn(0x7f89bc077210 msgr2=0x7f89bc10fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:35.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:35.173+0000 7f89c0cde640 1 -- 172.21.15.33:0/3516049105 shutdown_connections 2024-09-12T12:27:35.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:35.173+0000 7f89c0cde640 1 -- 172.21.15.33:0/3516049105 wait complete. 2024-09-12T12:27:35.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:35 smithi102 ceph-mon[34799]: pgmap v397: 129 pgs: 129 active+clean; 2.6 GiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 180 MiB/s wr, 101 op/s 2024-09-12T12:27:35.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:35 smithi033 ceph-mon[31246]: pgmap v397: 129 pgs: 129 active+clean; 2.6 GiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 180 MiB/s wr, 101 op/s 2024-09-12T12:27:35.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:35 smithi043 ceph-mon[34144]: pgmap v397: 129 pgs: 129 active+clean; 2.6 GiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 180 MiB/s wr, 101 op/s 2024-09-12T12:27:35.887 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T12:27:36.272 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:27:36.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:36 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/3516049105' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:27:36.402 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:36 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/3516049105' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:27:36.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:36 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/3516049105' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:27:36.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.833+0000 7fb79bfd2640 1 -- 172.21.15.33:0/3114670299 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb794102d40 msgr2=0x7fb794103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:36.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.833+0000 7fb79bfd2640 1 --2- 172.21.15.33:0/3114670299 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb794102d40 0x7fb794103120 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb790009900 tx=0x7fb79002a480 comp rx=0 tx=0).stop 2024-09-12T12:27:36.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.834+0000 7fb79bfd2640 1 -- 172.21.15.33:0/3114670299 shutdown_connections 2024-09-12T12:27:36.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.834+0000 7fb79bfd2640 1 --2- 172.21.15.33:0/3114670299 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb79410c170 0x7fb79410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:36.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.834+0000 7fb79bfd2640 1 --2- 172.21.15.33:0/3114670299 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb794103660 0x7fb79410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:36.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.834+0000 7fb79bfd2640 1 --2- 172.21.15.33:0/3114670299 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb794102d40 0x7fb794103120 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:36.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.834+0000 7fb79bfd2640 1 -- 172.21.15.33:0/3114670299 >> 172.21.15.33:0/3114670299 conn(0x7fb7940fc7a0 msgr2=0x7fb7940febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:36.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.834+0000 7fb79bfd2640 1 -- 172.21.15.33:0/3114670299 shutdown_connections 2024-09-12T12:27:36.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.834+0000 7fb79bfd2640 1 -- 172.21.15.33:0/3114670299 wait complete. 2024-09-12T12:27:36.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.834+0000 7fb79bfd2640 1 Processor -- start 2024-09-12T12:27:36.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.835+0000 7fb79bfd2640 1 -- start start 2024-09-12T12:27:36.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.835+0000 7fb79bfd2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb794102d40 0x7fb79410b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:36.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.835+0000 7fb79bfd2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb794103660 0x7fb794108720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:36.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.835+0000 7fb79bfd2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb79410c170 0x7fb794108c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:36.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.835+0000 7fb79bfd2640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb794101f60 con 0x7fb79410c170 2024-09-12T12:27:36.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.835+0000 7fb79bfd2640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb794101de0 con 0x7fb794102d40 2024-09-12T12:27:36.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.835+0000 7fb79bfd2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb7941020e0 con 0x7fb794103660 2024-09-12T12:27:36.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.835+0000 7fb799d6e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb794102d40 0x7fb79410b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:36.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.835+0000 7fb799d6e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb794102d40 0x7fb79410b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:44328/0 (socket says 172.21.15.33:44328) 2024-09-12T12:27:36.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.835+0000 7fb799d6e640 1 -- 172.21.15.33:0/3688325335 learned_addr learned my addr 172.21.15.33:0/3688325335 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:27:36.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.835+0000 7fb79a56f640 1 --2- 172.21.15.33:0/3688325335 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb79410c170 0x7fb794108c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:36.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.835+0000 7fb79956d640 1 --2- 172.21.15.33:0/3688325335 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb794103660 0x7fb794108720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:36.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.836+0000 7fb799d6e640 1 -- 172.21.15.33:0/3688325335 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb794103660 msgr2=0x7fb794108720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:36.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.836+0000 7fb799d6e640 1 --2- 172.21.15.33:0/3688325335 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb794103660 0x7fb794108720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:36.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.836+0000 7fb799d6e640 1 -- 172.21.15.33:0/3688325335 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb79410c170 msgr2=0x7fb794108c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:36.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.836+0000 7fb799d6e640 1 --2- 172.21.15.33:0/3688325335 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb79410c170 0x7fb794108c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:36.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.836+0000 7fb799d6e640 1 -- 172.21.15.33:0/3688325335 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7941091d0 con 0x7fb794102d40 2024-09-12T12:27:36.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.836+0000 7fb79956d640 1 --2- 172.21.15.33:0/3688325335 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb794103660 0x7fb794108720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:27:36.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.836+0000 7fb79a56f640 1 --2- 172.21.15.33:0/3688325335 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb79410c170 0x7fb794108c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:27:36.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.836+0000 7fb799d6e640 1 --2- 172.21.15.33:0/3688325335 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb794102d40 0x7fb79410b670 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb790005ab0 tx=0x7fb790003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:36.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.836+0000 7fb78affd640 1 -- 172.21.15.33:0/3688325335 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79003f070 con 0x7fb794102d40 2024-09-12T12:27:36.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.836+0000 7fb78affd640 1 -- 172.21.15.33:0/3688325335 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb790031b60 con 0x7fb794102d40 2024-09-12T12:27:36.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.836+0000 7fb78affd640 1 -- 172.21.15.33:0/3688325335 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb790035030 con 0x7fb794102d40 2024-09-12T12:27:36.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.836+0000 7fb79bfd2640 1 -- 172.21.15.33:0/3688325335 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb794109460 con 0x7fb794102d40 2024-09-12T12:27:36.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.836+0000 7fb79bfd2640 1 -- 172.21.15.33:0/3688325335 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7941ab340 con 0x7fb794102d40 2024-09-12T12:27:36.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.839+0000 7fb78affd640 1 -- 172.21.15.33:0/3688325335 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fb790042070 con 0x7fb794102d40 2024-09-12T12:27:36.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.841+0000 7fb78affd640 1 --2- 172.21.15.33:0/3688325335 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb7800a2c00 0x7fb7800a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:36.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.841+0000 7fb79e3ab740 1 Processor -- start 2024-09-12T12:27:36.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.841+0000 7fb79956d640 1 --2- 172.21.15.33:0/3688325335 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb7800a2c00 0x7fb7800a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:36.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.842+0000 7fb78affd640 1 -- 172.21.15.33:0/3688325335 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fb7900efa60 con 0x7fb794102d40 2024-09-12T12:27:36.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.842+0000 7fb79e3ab740 1 -- start start 2024-09-12T12:27:36.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.842+0000 7fb79e3ab740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557de40b5b40 0x557de40b4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:36.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.842+0000 7fb79e3ab740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557de40b45d0 0x557de40b4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:36.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.842+0000 7fb79e3ab740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557de40bf370 0x557de40c1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:36.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.842+0000 7fb79e3ab740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x557de401a2f0 con 0x557de40bf370 2024-09-12T12:27:36.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.842+0000 7fb79e3ab740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557de3fc1cf0 con 0x557de40b45d0 2024-09-12T12:27:36.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.842+0000 7fb79e3ab740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557de40162b0 con 0x557de40b5b40 2024-09-12T12:27:36.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.842+0000 7fb79a56f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557de40bf370 0x557de40c1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:36.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.842+0000 7fb79a56f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557de40bf370 0x557de40c1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58610/0 (socket says 172.21.15.33:58610) 2024-09-12T12:27:36.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.842+0000 7fb79a56f640 1 -- 172.21.15.33:0/2187316884 learned_addr learned my addr 172.21.15.33:0/2187316884 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:27:36.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.842+0000 7fb799d6e640 1 --2- 172.21.15.33:0/2187316884 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557de40b5b40 0x557de40b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:36.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.843+0000 7fb79956d640 1 --2- 172.21.15.33:0/3688325335 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb7800a2c00 0x7fb7800a50c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb7840095f0 tx=0x7fb784005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:36.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.843+0000 7fb799d6e640 1 -- 172.21.15.33:0/2187316884 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557de40b45d0 msgr2=0x557de40b4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:36.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.843+0000 7fb799d6e640 1 --2- 172.21.15.33:0/2187316884 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557de40b45d0 0x557de40b4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:36.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.843+0000 7fb799d6e640 1 -- 172.21.15.33:0/2187316884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557de40bf370 msgr2=0x557de40c1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:36.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.843+0000 7fb799d6e640 1 --2- 172.21.15.33:0/2187316884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557de40bf370 0x557de40c1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:36.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.843+0000 7fb799d6e640 1 -- 172.21.15.33:0/2187316884 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557de3fa63a0 con 0x557de40b5b40 2024-09-12T12:27:36.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.843+0000 7fb799d6e640 1 --2- 172.21.15.33:0/2187316884 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557de40b5b40 0x557de40b4090 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb790005ec0 tx=0x7fb79003ffb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e48dbfd29a3c780 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:36.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.843+0000 7fb77ffff640 1 -- 172.21.15.33:0/2187316884 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb790049050 con 0x557de40b5b40 2024-09-12T12:27:36.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.843+0000 7fb77ffff640 1 -- 172.21.15.33:0/2187316884 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb7900c4ba0 con 0x557de40b5b40 2024-09-12T12:27:36.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.843+0000 7fb77ffff640 1 -- 172.21.15.33:0/2187316884 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7900c4710 con 0x557de40b5b40 2024-09-12T12:27:36.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.844+0000 7fb79e3ab740 1 -- 172.21.15.33:0/2187316884 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557de40b5b40 msgr2=0x557de40b4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:36.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.844+0000 7fb79e3ab740 1 --2- 172.21.15.33:0/2187316884 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557de40b5b40 0x557de40b4090 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb790005ec0 tx=0x7fb79003ffb0 comp rx=0 tx=0).stop 2024-09-12T12:27:36.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.844+0000 7fb79e3ab740 1 -- 172.21.15.33:0/2187316884 shutdown_connections 2024-09-12T12:27:36.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.844+0000 7fb79e3ab740 1 --2- 172.21.15.33:0/2187316884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557de40bf370 0x557de40c1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:36.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.844+0000 7fb79e3ab740 1 --2- 172.21.15.33:0/2187316884 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557de40b45d0 0x557de40b4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:36.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.844+0000 7fb79e3ab740 1 --2- 172.21.15.33:0/2187316884 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557de40b5b40 0x557de40b4090 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:36.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.844+0000 7fb79e3ab740 1 -- 172.21.15.33:0/2187316884 >> 172.21.15.33:0/2187316884 conn(0x557de407d310 msgr2=0x557de40b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:36.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.845+0000 7fb79e3ab740 1 -- 172.21.15.33:0/2187316884 shutdown_connections 2024-09-12T12:27:36.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.845+0000 7fb79e3ab740 1 -- 172.21.15.33:0/2187316884 wait complete. 2024-09-12T12:27:36.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.845+0000 7fb79e3ab740 1 -- start start 2024-09-12T12:27:36.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.845+0000 7fb79e3ab740 1 Processor -- start 2024-09-12T12:27:36.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.846+0000 7fb79e3ab740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557de40b45d0 0x557de40bee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:36.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.846+0000 7fb79e3ab740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557de40b5b40 0x557de40bc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:36.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.846+0000 7fb79e3ab740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557de40bf370 0x557de40bc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:36.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.846+0000 7fb79e3ab740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x557de40d2e40 con 0x557de40b45d0 2024-09-12T12:27:36.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.846+0000 7fb79e3ab740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557de3fd5060 con 0x557de40bf370 2024-09-12T12:27:36.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.847+0000 7fb79e3ab740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557de40d2fc0 con 0x557de40b5b40 2024-09-12T12:27:36.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.847+0000 7fb79a56f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557de40bf370 0x557de40bc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:36.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.847+0000 7fb79a56f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557de40bf370 0x557de40bc870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:44360/0 (socket says 172.21.15.33:44360) 2024-09-12T12:27:36.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.847+0000 7fb79a56f640 1 -- 172.21.15.33:0/1263190404 learned_addr learned my addr 172.21.15.33:0/1263190404 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:27:36.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.847+0000 7fb79956d640 1 --2- 172.21.15.33:0/1263190404 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557de40b5b40 0x557de40bc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:36.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.847+0000 7fb79e3ab740 10 client.0 _ll_register_callbacks cb 0x557de3d288c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:27:36.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.847+0000 7fb799d6e640 1 --2- 172.21.15.33:0/1263190404 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557de40b45d0 0x557de40bee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:36.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.847+0000 7fb79a56f640 1 -- 172.21.15.33:0/1263190404 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557de40b5b40 msgr2=0x557de40bc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:36.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.847+0000 7fb79a56f640 1 --2- 172.21.15.33:0/1263190404 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557de40b5b40 0x557de40bc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:36.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.847+0000 7fb79a56f640 1 -- 172.21.15.33:0/1263190404 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557de40b45d0 msgr2=0x557de40bee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:36.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.847+0000 7fb79a56f640 1 --2- 172.21.15.33:0/1263190404 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557de40b45d0 0x557de40bee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:36.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.847+0000 7fb79a56f640 1 -- 172.21.15.33:0/1263190404 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557de3d8b3c0 con 0x557de40bf370 2024-09-12T12:27:36.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.847+0000 7fb799d6e640 1 --2- 172.21.15.33:0/1263190404 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557de40b45d0 0x557de40bee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:27:36.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.847+0000 7fb79e3ab740 1 -- 172.21.15.33:0/1263190404 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7900c4ba0 con 0x557de40bf370 2024-09-12T12:27:36.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.847+0000 7fb79a56f640 1 --2- 172.21.15.33:0/1263190404 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557de40bf370 0x557de40bc870 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb78c00fe20 tx=0x7fb78c012820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5047133993635410 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:36.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.847+0000 7fb77d7fa640 10 client.25121 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:27:36.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.848+0000 7fb77d7fa640 1 -- 172.21.15.33:0/1263190404 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb78c004b20 con 0x557de40bf370 2024-09-12T12:27:36.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.848+0000 7fb77d7fa640 1 -- 172.21.15.33:0/1263190404 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fb78c004cc0 con 0x557de40bf370 2024-09-12T12:27:36.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.848+0000 7fb77d7fa640 1 -- 172.21.15.33:0/1263190404 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb78c01c470 con 0x557de40bf370 2024-09-12T12:27:36.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.848+0000 7fb79e3ab740 10 client.25121 fetch_fsmap learned FSMap version 26 2024-09-12T12:27:36.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.848+0000 7fb79e3ab740 1 -- 172.21.15.33:0/1263190404 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({fsmap=26}) -- 0x557de40de890 con 0x557de40bf370 2024-09-12T12:27:36.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.848+0000 7fb77d7fa640 1 -- 172.21.15.33:0/1263190404 <== mon.2 v2:172.21.15.43:3300/0 4 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7fb78c01c610 con 0x557de40bf370 2024-09-12T12:27:36.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.848+0000 7fb79e3ab740 10 client.25121 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:27:36.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.848+0000 7fb79e3ab740 10 client.25121 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-12T12:27:36.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.848+0000 7fb79e3ab740 20 client.25121 populate_metadata read hostname 'smithi033' 2024-09-12T12:27:36.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.848+0000 7fb79e3ab740 1 --2- 172.21.15.33:0/1263190404 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x557de40dfbe0 0x557de40e1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:36.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.848+0000 7fb79e3ab740 4 client.25121 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:27:36.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.848+0000 7fb79e3ab740 1 -- 172.21.15.33:0/1263190404 --> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557de4027860 con 0x557de40dfbe0 2024-09-12T12:27:36.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.849+0000 7fb799d6e640 1 --2- 172.21.15.33:0/1263190404 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x557de40dfbe0 0x557de40e1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:36.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.849+0000 7fb799d6e640 1 --2- 172.21.15.33:0/1263190404 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x557de40dfbe0 0x557de40e1fd0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=168b8baa6ccef790 server_cookie=7157df7e3ac61293 in_seq=0 out_seq=0 2024-09-12T12:27:36.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.849+0000 7fb77d7fa640 10 client.25121 ms_handle_connect on v2:172.21.15.102:6834/4179527539 2024-09-12T12:27:36.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.850+0000 7fb77d7fa640 1 -- 172.21.15.33:0/1263190404 <== mds.2 v2:172.21.15.102:6834/4179527539 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fb79009ae50 con 0x557de40dfbe0 2024-09-12T12:27:36.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.850+0000 7fb77d7fa640 10 client.25121 handle_command_reply: tid=0 2024-09-12T12:27:36.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.850+0000 7fb79e3ab740 1 client.25121 shutdown 2024-09-12T12:27:36.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.850+0000 7fb79e3ab740 1 -- 172.21.15.33:0/1263190404 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557de40bf370 msgr2=0x557de40bc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:36.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.850+0000 7fb79e3ab740 1 --2- 172.21.15.33:0/1263190404 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557de40bf370 0x557de40bc870 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb78c00fe20 tx=0x7fb78c012820 comp rx=0 tx=0).stop 2024-09-12T12:27:36.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.850+0000 7fb79e3ab740 1 -- 172.21.15.33:0/1263190404 shutdown_connections 2024-09-12T12:27:36.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.850+0000 7fb79e3ab740 1 --2- 172.21.15.33:0/1263190404 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x557de40dfbe0 0x557de40e1fd0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:36.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.850+0000 7fb79e3ab740 1 --2- 172.21.15.33:0/1263190404 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557de40bf370 0x557de40bc870 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:36.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.850+0000 7fb79e3ab740 1 --2- 172.21.15.33:0/1263190404 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557de40b5b40 0x557de40bc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:36.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.850+0000 7fb79e3ab740 1 --2- 172.21.15.33:0/1263190404 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557de40b45d0 0x557de40bee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:36.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.850+0000 7fb79e3ab740 1 -- 172.21.15.33:0/1263190404 >> 172.21.15.33:0/1263190404 conn(0x557de407d310 msgr2=0x557de40b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:36.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.851+0000 7fb77d7fa640 0 client.25121 ms_handle_reset on v2:172.21.15.102:6834/4179527539 2024-09-12T12:27:36.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.851+0000 7fb79e3ab740 1 -- 172.21.15.33:0/1263190404 shutdown_connections 2024-09-12T12:27:36.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.851+0000 7fb79e3ab740 1 -- 172.21.15.33:0/1263190404 wait complete. 2024-09-12T12:27:36.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.851+0000 7fb79e3ab740 20 client.25121 trim_cache size 0 max 16384 2024-09-12T12:27:36.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.874+0000 7fb79e3ab740 1 Processor -- start 2024-09-12T12:27:36.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.874+0000 7fb79e3ab740 1 -- start start 2024-09-12T12:27:36.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.874+0000 7fb79e3ab740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557de40b45d0 0x557de40bc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:36.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.874+0000 7fb79e3ab740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557de40b5b40 0x557de40bb020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:36.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.874+0000 7fb79e3ab740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557de40bf370 0x557de40b7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:36.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.874+0000 7fb79e3ab740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb7941af330 con 0x557de40bf370 2024-09-12T12:27:36.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.874+0000 7fb79e3ab740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb7941acc00 con 0x557de40b5b40 2024-09-12T12:27:36.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.874+0000 7fb79e3ab740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb794109c50 con 0x557de40b45d0 2024-09-12T12:27:36.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.874+0000 7fb79a56f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557de40bf370 0x557de40b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:36.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.875+0000 7fb79956d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557de40b5b40 0x557de40bb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:36.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.875+0000 7fb79a56f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557de40bf370 0x557de40b7120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58640/0 (socket says 172.21.15.33:58640) 2024-09-12T12:27:36.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.875+0000 7fb79a56f640 1 -- 172.21.15.33:0/3499581612 learned_addr learned my addr 172.21.15.33:0/3499581612 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:27:36.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.875+0000 7fb799d6e640 1 --2- 172.21.15.33:0/3499581612 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557de40b45d0 0x557de40bc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:36.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.875+0000 7fb79a56f640 1 -- 172.21.15.33:0/3499581612 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557de40b45d0 msgr2=0x557de40bc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:36.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.875+0000 7fb79a56f640 1 --2- 172.21.15.33:0/3499581612 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557de40b45d0 0x557de40bc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:36.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.875+0000 7fb79a56f640 1 -- 172.21.15.33:0/3499581612 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557de40b5b40 msgr2=0x557de40bb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:36.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.875+0000 7fb79a56f640 1 --2- 172.21.15.33:0/3499581612 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557de40b5b40 0x557de40bb020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:36.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.875+0000 7fb79a56f640 1 -- 172.21.15.33:0/3499581612 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557de40bd460 con 0x557de40bf370 2024-09-12T12:27:36.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.875+0000 7fb79956d640 1 --2- 172.21.15.33:0/3499581612 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557de40b5b40 0x557de40bb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:27:36.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.875+0000 7fb79a56f640 1 --2- 172.21.15.33:0/3499581612 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557de40bf370 0x557de40b7120 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb78c006010 tx=0x7fb78c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdeb12db509d29a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:36.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.876+0000 7fb77f7fe640 1 -- 172.21.15.33:0/3499581612 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb78c01cd10 con 0x557de40bf370 2024-09-12T12:27:36.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.876+0000 7fb77f7fe640 1 -- 172.21.15.33:0/3499581612 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb7900c4ba0 con 0x557de40bf370 2024-09-12T12:27:36.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.876+0000 7fb77f7fe640 1 -- 172.21.15.33:0/3499581612 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb78c004360 con 0x557de40bf370 2024-09-12T12:27:36.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.877+0000 7fb79e3ab740 1 -- 172.21.15.33:0/3499581612 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557de40bf370 msgr2=0x557de40b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:36.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.877+0000 7fb79e3ab740 1 --2- 172.21.15.33:0/3499581612 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557de40bf370 0x557de40b7120 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb78c006010 tx=0x7fb78c014000 comp rx=0 tx=0).stop 2024-09-12T12:27:36.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.877+0000 7fb79e3ab740 1 -- 172.21.15.33:0/3499581612 shutdown_connections 2024-09-12T12:27:36.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.877+0000 7fb79e3ab740 1 --2- 172.21.15.33:0/3499581612 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557de40bf370 0x557de40b7120 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:36.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.877+0000 7fb79e3ab740 1 --2- 172.21.15.33:0/3499581612 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557de40b5b40 0x557de40bb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:36.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.877+0000 7fb79e3ab740 1 --2- 172.21.15.33:0/3499581612 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557de40b45d0 0x557de40bc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:36.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.877+0000 7fb79e3ab740 1 -- 172.21.15.33:0/3499581612 >> 172.21.15.33:0/3499581612 conn(0x557de407d310 msgr2=0x557de40bb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:36.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.877+0000 7fb79e3ab740 1 -- 172.21.15.33:0/3499581612 shutdown_connections 2024-09-12T12:27:36.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.877+0000 7fb79e3ab740 1 -- 172.21.15.33:0/3499581612 wait complete. 2024-09-12T12:27:36.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.877+0000 7fb79e3ab740 1 -- start start 2024-09-12T12:27:36.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.877+0000 7fb79e3ab740 1 Processor -- start 2024-09-12T12:27:36.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.878+0000 7fb79e3ab740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557de40b45d0 0x557de40d86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:36.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.878+0000 7fb79e3ab740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557de40b5b40 0x557de40b8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:36.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.878+0000 7fb79e3ab740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557de40bf370 0x557de40b9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:36.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.878+0000 7fb79e3ab740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb79411cfe0 con 0x557de40b45d0 2024-09-12T12:27:36.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.878+0000 7fb79e3ab740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb7941ac530 con 0x557de40bf370 2024-09-12T12:27:36.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.878+0000 7fb79e3ab740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb7941ab790 con 0x557de40b5b40 2024-09-12T12:27:36.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.878+0000 7fb79e3ab740 10 client.0 _ll_register_callbacks cb 0x7fb78c00f4a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:27:36.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.878+0000 7fb799d6e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557de40b45d0 0x557de40d86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:36.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.878+0000 7fb799d6e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557de40b45d0 0x557de40d86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58644/0 (socket says 172.21.15.33:58644) 2024-09-12T12:27:36.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.878+0000 7fb799d6e640 1 -- 172.21.15.33:0/2087060162 learned_addr learned my addr 172.21.15.33:0/2087060162 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:27:36.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.879+0000 7fb79a56f640 1 --2- 172.21.15.33:0/2087060162 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557de40bf370 0x557de40b9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:36.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.879+0000 7fb79956d640 1 --2- 172.21.15.33:0/2087060162 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557de40b5b40 0x557de40b8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:36.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.879+0000 7fb79a56f640 1 -- 172.21.15.33:0/2087060162 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557de40b5b40 msgr2=0x557de40b8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:36.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.879+0000 7fb79a56f640 1 --2- 172.21.15.33:0/2087060162 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557de40b5b40 0x557de40b8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:36.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.879+0000 7fb79a56f640 1 -- 172.21.15.33:0/2087060162 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557de40b45d0 msgr2=0x557de40d86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:36.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.879+0000 7fb79a56f640 1 --2- 172.21.15.33:0/2087060162 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557de40b45d0 0x557de40d86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:36.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.879+0000 7fb79a56f640 1 -- 172.21.15.33:0/2087060162 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557de40b9770 con 0x557de40bf370 2024-09-12T12:27:36.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.879+0000 7fb799d6e640 1 --2- 172.21.15.33:0/2087060162 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557de40b45d0 0x557de40d86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:27:36.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.879+0000 7fb79956d640 1 --2- 172.21.15.33:0/2087060162 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557de40b5b40 0x557de40b8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:27:36.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.879+0000 7fb79a56f640 1 --2- 172.21.15.33:0/2087060162 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557de40bf370 0x557de40b9130 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x557de40bb5b0 tx=0x7fb78c003e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a135f7eb3785695 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:36.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.879+0000 7fb77d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:27:36.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.879+0000 7fb77d7fa640 1 -- 172.21.15.33:0/2087060162 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb78c005280 con 0x557de40bf370 2024-09-12T12:27:36.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.879+0000 7fb79e3ab740 1 -- 172.21.15.33:0/2087060162 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7900c4ba0 con 0x557de40bf370 2024-09-12T12:27:36.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.880+0000 7fb77d7fa640 1 -- 172.21.15.33:0/2087060162 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fb78c005420 con 0x557de40bf370 2024-09-12T12:27:36.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.880+0000 7fb77d7fa640 1 -- 172.21.15.33:0/2087060162 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb78c005620 con 0x557de40bf370 2024-09-12T12:27:36.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.880+0000 7fb79e3ab740 10 client.25127 fetch_fsmap learned FSMap version 26 2024-09-12T12:27:36.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.880+0000 7fb79e3ab740 1 -- 172.21.15.33:0/2087060162 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x557de414a6a0 con 0x557de40bf370 2024-09-12T12:27:36.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.880+0000 7fb77d7fa640 1 -- 172.21.15.33:0/2087060162 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb7900c4ba0 con 0x557de40bf370 2024-09-12T12:27:36.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.880+0000 7fb77d7fa640 1 -- 172.21.15.33:0/2087060162 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7fb78c010a70 con 0x557de40bf370 2024-09-12T12:27:36.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.880+0000 7fb79e3ab740 10 client.25127 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:27:36.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.880+0000 7fb79e3ab740 10 client.25127 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-12T12:27:36.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.880+0000 7fb79e3ab740 20 client.25127 populate_metadata read hostname 'smithi033' 2024-09-12T12:27:36.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.880+0000 7fb79e3ab740 1 --2- 172.21.15.33:0/2087060162 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x557de414ad00 0x557de414d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:36.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.880+0000 7fb79e3ab740 4 client.25127 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:27:36.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.880+0000 7fb79e3ab740 1 -- 172.21.15.33:0/2087060162 --> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557de4021d70 con 0x557de414ad00 2024-09-12T12:27:36.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.881+0000 7fb799d6e640 1 --2- 172.21.15.33:0/2087060162 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x557de414ad00 0x557de414d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:36.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.881+0000 7fb77d7fa640 10 client.25127 ms_handle_connect on v2:172.21.15.102:6834/4179527539 2024-09-12T12:27:36.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.881+0000 7fb799d6e640 1 --2- 172.21.15.33:0/2087060162 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x557de414ad00 0x557de414d0f0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=21fdbdbeab723c7 server_cookie=5882aca77421004e in_seq=0 out_seq=0 2024-09-12T12:27:36.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.882+0000 7fb77d7fa640 1 -- 172.21.15.33:0/2087060162 <== mds.2 v2:172.21.15.102:6834/4179527539 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557de4021d70 con 0x557de414ad00 2024-09-12T12:27:36.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.882+0000 7fb77d7fa640 10 client.25127 handle_command_reply: tid=0 2024-09-12T12:27:36.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.882+0000 7fb79e3ab740 1 client.25127 shutdown 2024-09-12T12:27:36.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.882+0000 7fb79e3ab740 1 -- 172.21.15.33:0/2087060162 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557de40bf370 msgr2=0x557de40b9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:36.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.882+0000 7fb79e3ab740 1 --2- 172.21.15.33:0/2087060162 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557de40bf370 0x557de40b9130 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x557de40bb5b0 tx=0x7fb78c003e60 comp rx=0 tx=0).stop 2024-09-12T12:27:36.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.882+0000 7fb79e3ab740 1 -- 172.21.15.33:0/2087060162 shutdown_connections 2024-09-12T12:27:36.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.882+0000 7fb79e3ab740 1 --2- 172.21.15.33:0/2087060162 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x557de414ad00 0x557de414d0f0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:36.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.882+0000 7fb79e3ab740 1 --2- 172.21.15.33:0/2087060162 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557de40bf370 0x557de40b9130 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:36.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.882+0000 7fb79e3ab740 1 --2- 172.21.15.33:0/2087060162 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557de40b5b40 0x557de40b8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:36.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.882+0000 7fb79e3ab740 1 --2- 172.21.15.33:0/2087060162 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557de40b45d0 0x557de40d86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:36.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.882+0000 7fb79e3ab740 1 -- 172.21.15.33:0/2087060162 >> 172.21.15.33:0/2087060162 conn(0x557de407d310 msgr2=0x557de40be160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:36.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.882+0000 7fb77d7fa640 0 client.25127 ms_handle_reset on v2:172.21.15.102:6834/4179527539 2024-09-12T12:27:36.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.882+0000 7fb79e3ab740 1 -- 172.21.15.33:0/2087060162 shutdown_connections 2024-09-12T12:27:36.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.882+0000 7fb79e3ab740 1 -- 172.21.15.33:0/2087060162 wait complete. 2024-09-12T12:27:36.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.882+0000 7fb79e3ab740 20 client.25127 trim_cache size 0 max 16384 2024-09-12T12:27:36.888 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-09-12T12:27:36.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.883+0000 7fb79bfd2640 1 -- 172.21.15.33:0/3688325335 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb7800a2c00 msgr2=0x7fb7800a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:36.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.883+0000 7fb79bfd2640 1 --2- 172.21.15.33:0/3688325335 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb7800a2c00 0x7fb7800a50c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb7840095f0 tx=0x7fb784005f90 comp rx=0 tx=0).stop 2024-09-12T12:27:36.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.883+0000 7fb79bfd2640 1 -- 172.21.15.33:0/3688325335 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb794102d40 msgr2=0x7fb79410b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:36.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.883+0000 7fb79bfd2640 1 --2- 172.21.15.33:0/3688325335 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb794102d40 0x7fb79410b670 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb790005ab0 tx=0x7fb790003c10 comp rx=0 tx=0).stop 2024-09-12T12:27:36.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.883+0000 7fb79bfd2640 1 -- 172.21.15.33:0/3688325335 shutdown_connections 2024-09-12T12:27:36.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.883+0000 7fb79bfd2640 1 --2- 172.21.15.33:0/3688325335 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb7800a2c00 0x7fb7800a50c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:36.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.883+0000 7fb79bfd2640 1 --2- 172.21.15.33:0/3688325335 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb79410c170 0x7fb794108c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:36.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.883+0000 7fb79bfd2640 1 --2- 172.21.15.33:0/3688325335 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb794103660 0x7fb794108720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:36.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.883+0000 7fb79bfd2640 1 --2- 172.21.15.33:0/3688325335 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb794102d40 0x7fb79410b670 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:36.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.883+0000 7fb79bfd2640 1 -- 172.21.15.33:0/3688325335 >> 172.21.15.33:0/3688325335 conn(0x7fb7940fc7a0 msgr2=0x7fb79410da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:36.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.884+0000 7fb79bfd2640 1 -- 172.21.15.33:0/3688325335 shutdown_connections 2024-09-12T12:27:36.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:36.884+0000 7fb79bfd2640 1 -- 172.21.15.33:0/3688325335 wait complete. 2024-09-12T12:27:37.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:37 smithi102 ceph-mon[34799]: pgmap v398: 129 pgs: 129 active+clean; 2.6 GiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 137 MiB/s wr, 75 op/s 2024-09-12T12:27:37.445 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:37 smithi033 ceph-mon[31246]: pgmap v398: 129 pgs: 129 active+clean; 2.6 GiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 137 MiB/s wr, 75 op/s 2024-09-12T12:27:37.516 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:37 smithi043 ceph-mon[34144]: pgmap v398: 129 pgs: 129 active+clean; 2.6 GiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 137 MiB/s wr, 75 op/s 2024-09-12T12:27:38.982 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T12:27:39.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:39 smithi033 ceph-mon[31246]: pgmap v399: 129 pgs: 129 active+clean; 3.1 GiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 184 MiB/s wr, 100 op/s 2024-09-12T12:27:39.387 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:27:39.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:39 smithi102 ceph-mon[34799]: pgmap v399: 129 pgs: 129 active+clean; 3.1 GiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 184 MiB/s wr, 100 op/s 2024-09-12T12:27:39.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:39 smithi043 ceph-mon[34144]: pgmap v399: 129 pgs: 129 active+clean; 3.1 GiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 184 MiB/s wr, 100 op/s 2024-09-12T12:27:41.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:41 smithi033 ceph-mon[31246]: pgmap v400: 129 pgs: 129 active+clean; 3.3 GiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 147 MiB/s wr, 82 op/s 2024-09-12T12:27:41.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:41 smithi043 ceph-mon[34144]: pgmap v400: 129 pgs: 129 active+clean; 3.3 GiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 147 MiB/s wr, 82 op/s 2024-09-12T12:27:41.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:41 smithi102 ceph-mon[34799]: pgmap v400: 129 pgs: 129 active+clean; 3.3 GiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 147 MiB/s wr, 82 op/s 2024-09-12T12:27:43.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:43 smithi033 ceph-mon[31246]: pgmap v401: 129 pgs: 129 active+clean; 3.6 GiB data, 905 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 155 MiB/s wr, 85 op/s 2024-09-12T12:27:43.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.605+0000 7f99611f2640 1 -- 172.21.15.33:0/477478345 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f995c109e00 msgr2=0x7f995c10e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:43.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.605+0000 7f99611f2640 1 --2- 172.21.15.33:0/477478345 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f995c109e00 0x7f995c10e350 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9950009860 tx=0x7f995002a340 comp rx=0 tx=0).stop 2024-09-12T12:27:43.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.605+0000 7f99611f2640 1 -- 172.21.15.33:0/477478345 shutdown_connections 2024-09-12T12:27:43.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.605+0000 7f99611f2640 1 --2- 172.21.15.33:0/477478345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f995c10ea80 0x7f995c1154f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:43.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.605+0000 7f99611f2640 1 --2- 172.21.15.33:0/477478345 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f995c109e00 0x7f995c10e350 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:43.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.605+0000 7f99611f2640 1 --2- 172.21.15.33:0/477478345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f995c109450 0x7f995c109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:43.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.605+0000 7f99611f2640 1 -- 172.21.15.33:0/477478345 >> 172.21.15.33:0/477478345 conn(0x7f995c06e2d0 msgr2=0x7f995c06e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:43.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.605+0000 7f99611f2640 1 -- 172.21.15.33:0/477478345 shutdown_connections 2024-09-12T12:27:43.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.605+0000 7f99611f2640 1 -- 172.21.15.33:0/477478345 wait complete. 2024-09-12T12:27:43.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.606+0000 7f99611f2640 1 Processor -- start 2024-09-12T12:27:43.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.606+0000 7f99611f2640 1 -- start start 2024-09-12T12:27:43.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.607+0000 7f99611f2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f995c109450 0x7f995c1a6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:43.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.607+0000 7f99611f2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f995c109e00 0x7f995c1a6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:43.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.607+0000 7f99611f2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f995c10ea80 0x7f995c1a09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:43.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.607+0000 7f99611f2640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f995c11a640 con 0x7f995c109450 2024-09-12T12:27:43.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.607+0000 7f99611f2640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f995c11a4c0 con 0x7f995c10ea80 2024-09-12T12:27:43.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.607+0000 7f995ad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f995c109450 0x7f995c1a6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:43.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.607+0000 7f995ad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f995c109450 0x7f995c1a6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44876/0 (socket says 172.21.15.33:44876) 2024-09-12T12:27:43.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.607+0000 7f995ad9d640 1 -- 172.21.15.33:0/3421330615 learned_addr learned my addr 172.21.15.33:0/3421330615 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:27:43.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.607+0000 7f99611f2640 1 -- 172.21.15.33:0/3421330615 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f995c11a7c0 con 0x7f995c109e00 2024-09-12T12:27:43.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.607+0000 7f995b59e640 1 --2- 172.21.15.33:0/3421330615 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f995c10ea80 0x7f995c1a09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:43.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.607+0000 7f995a59c640 1 --2- 172.21.15.33:0/3421330615 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f995c109e00 0x7f995c1a6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:43.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.608+0000 7f995a59c640 1 -- 172.21.15.33:0/3421330615 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f995c10ea80 msgr2=0x7f995c1a09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:43.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.608+0000 7f995a59c640 1 --2- 172.21.15.33:0/3421330615 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f995c10ea80 0x7f995c1a09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:43.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.608+0000 7f995a59c640 1 -- 172.21.15.33:0/3421330615 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f995c109450 msgr2=0x7f995c1a6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:43.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.608+0000 7f995a59c640 1 --2- 172.21.15.33:0/3421330615 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f995c109450 0x7f995c1a6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:43.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.608+0000 7f995a59c640 1 -- 172.21.15.33:0/3421330615 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f995c1a1100 con 0x7f995c109e00 2024-09-12T12:27:43.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.608+0000 7f995ad9d640 1 --2- 172.21.15.33:0/3421330615 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f995c109450 0x7f995c1a6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:27:43.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.609+0000 7f995a59c640 1 --2- 172.21.15.33:0/3421330615 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f995c109e00 0x7f995c1a6d50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f995002a860 tx=0x7f9950030bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:43.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.610+0000 7f9943fff640 1 -- 172.21.15.33:0/3421330615 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9950040020 con 0x7f995c109e00 2024-09-12T12:27:43.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.610+0000 7f9943fff640 1 -- 172.21.15.33:0/3421330615 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9950038040 con 0x7f995c109e00 2024-09-12T12:27:43.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.610+0000 7f9943fff640 1 -- 172.21.15.33:0/3421330615 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9950037070 con 0x7f995c109e00 2024-09-12T12:27:43.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.610+0000 7f99611f2640 1 -- 172.21.15.33:0/3421330615 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f995c1a1390 con 0x7f995c109e00 2024-09-12T12:27:43.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.610+0000 7f99611f2640 1 -- 172.21.15.33:0/3421330615 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f995c1a17f0 con 0x7f995c109e00 2024-09-12T12:27:43.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.613+0000 7f99635cb740 1 Processor -- start 2024-09-12T12:27:43.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.614+0000 7f99635cb740 1 -- start start 2024-09-12T12:27:43.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.614+0000 7f99635cb740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb27afb40 0x557bb27ae090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:43.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.614+0000 7f99635cb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb27ae5d0 0x557bb27aea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:43.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.614+0000 7f99635cb740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557bb27b9370 0x557bb27bb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:43.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.614+0000 7f99635cb740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x557bb27142f0 con 0x557bb27b9370 2024-09-12T12:27:43.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.614+0000 7f99635cb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557bb26bbcf0 con 0x557bb27ae5d0 2024-09-12T12:27:43.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.614+0000 7f99635cb740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557bb27102b0 con 0x557bb27afb40 2024-09-12T12:27:43.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.614+0000 7f995b59e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb27afb40 0x557bb27ae090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:43.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.614+0000 7f995b59e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb27afb40 0x557bb27ae090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:45346/0 (socket says 172.21.15.33:45346) 2024-09-12T12:27:43.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.614+0000 7f995b59e640 1 -- 172.21.15.33:0/3645058642 learned_addr learned my addr 172.21.15.33:0/3645058642 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:27:43.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.615+0000 7f995b59e640 1 -- 172.21.15.33:0/3645058642 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb27ae5d0 msgr2=0x557bb27aea10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T12:27:43.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.615+0000 7f9943fff640 1 -- 172.21.15.33:0/3421330615 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9950043020 con 0x7f995c109e00 2024-09-12T12:27:43.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.615+0000 7f995ad9d640 1 --2- 172.21.15.33:0/3645058642 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb27ae5d0 0x557bb27aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:43.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.615+0000 7f995b59e640 1 --2- 172.21.15.33:0/3645058642 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb27ae5d0 0x557bb27aea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:43.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.615+0000 7f995b59e640 1 -- 172.21.15.33:0/3645058642 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557bb27b9370 msgr2=0x557bb27bb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:43.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.615+0000 7f995a59c640 1 --2- 172.21.15.33:0/3645058642 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557bb27b9370 0x557bb27bb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:43.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.615+0000 7f995b59e640 1 --2- 172.21.15.33:0/3645058642 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557bb27b9370 0x557bb27bb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:43.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.615+0000 7f995b59e640 1 -- 172.21.15.33:0/3645058642 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557bb26a03a0 con 0x557bb27afb40 2024-09-12T12:27:43.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.615+0000 7f995a59c640 1 --2- 172.21.15.33:0/3645058642 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557bb27b9370 0x557bb27bb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:27:43.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.616+0000 7f995b59e640 1 --2- 172.21.15.33:0/3645058642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb27afb40 0x557bb27ae090 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9954019880 tx=0x7f9954019d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfe9e4ab29a2ae1f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:43.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.616+0000 7f9943fff640 1 --2- 172.21.15.33:0/3421330615 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f99440a2c00 0x7f99440a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:43.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.616+0000 7f9943fff640 1 -- 172.21.15.33:0/3421330615 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f99500ef0d0 con 0x7f995c109e00 2024-09-12T12:27:43.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.616+0000 7f99417fa640 1 -- 172.21.15.33:0/3645058642 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9954003970 con 0x557bb27afb40 2024-09-12T12:27:43.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.616+0000 7f995ad9d640 1 --2- 172.21.15.33:0/3421330615 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f99440a2c00 0x7f99440a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:43.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.616+0000 7f99417fa640 1 -- 172.21.15.33:0/3645058642 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9954004020 con 0x557bb27afb40 2024-09-12T12:27:43.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.616+0000 7f99417fa640 1 -- 172.21.15.33:0/3645058642 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9954021650 con 0x557bb27afb40 2024-09-12T12:27:43.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.617+0000 7f99635cb740 1 -- 172.21.15.33:0/3645058642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb27afb40 msgr2=0x557bb27ae090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:43.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.617+0000 7f995ad9d640 1 --2- 172.21.15.33:0/3421330615 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f99440a2c00 0x7f99440a50c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x557bb27abac0 tx=0x7f994c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:43.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.617+0000 7f99635cb740 1 --2- 172.21.15.33:0/3645058642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb27afb40 0x557bb27ae090 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9954019880 tx=0x7f9954019d40 comp rx=0 tx=0).stop 2024-09-12T12:27:43.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.617+0000 7f99635cb740 1 -- 172.21.15.33:0/3645058642 shutdown_connections 2024-09-12T12:27:43.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.617+0000 7f99635cb740 1 --2- 172.21.15.33:0/3645058642 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557bb27b9370 0x557bb27bb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:43.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.617+0000 7f99635cb740 1 --2- 172.21.15.33:0/3645058642 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb27ae5d0 0x557bb27aea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:43.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.617+0000 7f99635cb740 1 --2- 172.21.15.33:0/3645058642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb27afb40 0x557bb27ae090 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:43.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.617+0000 7f99635cb740 1 -- 172.21.15.33:0/3645058642 >> 172.21.15.33:0/3645058642 conn(0x557bb2777310 msgr2=0x557bb27aac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:43.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.617+0000 7f99635cb740 1 -- 172.21.15.33:0/3645058642 shutdown_connections 2024-09-12T12:27:43.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.617+0000 7f99635cb740 1 -- 172.21.15.33:0/3645058642 wait complete. 2024-09-12T12:27:43.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.618+0000 7f99635cb740 1 -- start start 2024-09-12T12:27:43.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.618+0000 7f99635cb740 1 Processor -- start 2024-09-12T12:27:43.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.618+0000 7f99635cb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb27ae5d0 0x557bb27b8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:43.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.618+0000 7f99635cb740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557bb27afb40 0x557bb27b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:43.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.618+0000 7f99635cb740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb27b9370 0x557bb27b65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:43.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.618+0000 7f99635cb740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x557bb27bc0c0 con 0x557bb27afb40 2024-09-12T12:27:43.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.618+0000 7f99635cb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557bb26cf060 con 0x557bb27ae5d0 2024-09-12T12:27:43.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.618+0000 7f99635cb740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557bb27bc240 con 0x557bb27b9370 2024-09-12T12:27:43.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.618+0000 7f99635cb740 10 client.0 _ll_register_callbacks cb 0x557bb24228c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:27:43.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.618+0000 7f995b59e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb27b9370 0x557bb27b65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:43.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.618+0000 7f995b59e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb27b9370 0x557bb27b65d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:45348/0 (socket says 172.21.15.33:45348) 2024-09-12T12:27:43.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.619+0000 7f995b59e640 1 -- 172.21.15.33:0/2446997747 learned_addr learned my addr 172.21.15.33:0/2446997747 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:27:43.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.619+0000 7f995a59c640 1 --2- 172.21.15.33:0/2446997747 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557bb27afb40 0x557bb27b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:43.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.619+0000 7f995ad9d640 1 --2- 172.21.15.33:0/2446997747 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb27ae5d0 0x557bb27b8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:43.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.619+0000 7f995a59c640 1 -- 172.21.15.33:0/2446997747 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb27b9370 msgr2=0x557bb27b65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:43.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.619+0000 7f995a59c640 1 --2- 172.21.15.33:0/2446997747 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb27b9370 0x557bb27b65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:43.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.619+0000 7f995a59c640 1 -- 172.21.15.33:0/2446997747 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb27ae5d0 msgr2=0x557bb27b8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:43.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.619+0000 7f995a59c640 1 --2- 172.21.15.33:0/2446997747 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb27ae5d0 0x557bb27b8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:43.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.619+0000 7f995a59c640 1 -- 172.21.15.33:0/2446997747 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557bb24853c0 con 0x557bb27afb40 2024-09-12T12:27:43.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.619+0000 7f995a59c640 1 --2- 172.21.15.33:0/2446997747 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557bb27afb40 0x557bb27b6000 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x557bb27af070 tx=0x7f99500b77e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18056d76b895e3b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:43.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.619+0000 7f993eff5640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:27:43.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.619+0000 7f993eff5640 1 -- 172.21.15.33:0/2446997747 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99500baea0 con 0x557bb27afb40 2024-09-12T12:27:43.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.619+0000 7f993eff5640 1 -- 172.21.15.33:0/2446997747 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f99500f1110 con 0x557bb27afb40 2024-09-12T12:27:43.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.619+0000 7f99635cb740 1 -- 172.21.15.33:0/2446997747 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9954004020 con 0x557bb27afb40 2024-09-12T12:27:43.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.620+0000 7f993eff5640 1 -- 172.21.15.33:0/2446997747 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f99500f1310 con 0x557bb27afb40 2024-09-12T12:27:43.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.620+0000 7f99635cb740 10 client.15486 fetch_fsmap learned FSMap version 26 2024-09-12T12:27:43.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.620+0000 7f99635cb740 1 -- 172.21.15.33:0/2446997747 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x557bb27bc0c0 con 0x557bb27afb40 2024-09-12T12:27:43.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.620+0000 7f993eff5640 1 -- 172.21.15.33:0/2446997747 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9954004020 con 0x557bb27afb40 2024-09-12T12:27:43.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.620+0000 7f993eff5640 1 -- 172.21.15.33:0/2446997747 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f9950003bb0 con 0x557bb27afb40 2024-09-12T12:27:43.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.620+0000 7f99635cb740 10 client.15486 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:27:43.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.620+0000 7f99635cb740 10 client.15486 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-12T12:27:43.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.620+0000 7f99635cb740 20 client.15486 populate_metadata read hostname 'smithi033' 2024-09-12T12:27:43.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.620+0000 7f99635cb740 1 --2- 172.21.15.33:0/2446997747 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x557bb27c8f20 0x557bb27cb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:43.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.620+0000 7f99635cb740 4 client.15486 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:27:43.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.620+0000 7f99635cb740 1 -- 172.21.15.33:0/2446997747 --> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557bb2721860 con 0x557bb27c8f20 2024-09-12T12:27:43.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.620+0000 7f995ad9d640 1 --2- 172.21.15.33:0/2446997747 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x557bb27c8f20 0x557bb27cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:43.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.621+0000 7f993eff5640 10 client.15486 ms_handle_connect on v2:172.21.15.102:6836/2409953270 2024-09-12T12:27:43.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.621+0000 7f995ad9d640 1 --2- 172.21.15.33:0/2446997747 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x557bb27c8f20 0x557bb27cb310 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=57f7facfd30850f5 server_cookie=611858e58688ceae in_seq=0 out_seq=0 2024-09-12T12:27:43.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.622+0000 7f993eff5640 1 -- 172.21.15.33:0/2446997747 <== mds.1 v2:172.21.15.102:6836/2409953270 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557bb2721860 con 0x557bb27c8f20 2024-09-12T12:27:43.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.622+0000 7f993eff5640 10 client.15486 handle_command_reply: tid=0 2024-09-12T12:27:43.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.622+0000 7f99635cb740 1 client.15486 shutdown 2024-09-12T12:27:43.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.623+0000 7f99635cb740 1 -- 172.21.15.33:0/2446997747 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557bb27afb40 msgr2=0x557bb27b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:43.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.623+0000 7f99635cb740 1 --2- 172.21.15.33:0/2446997747 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557bb27afb40 0x557bb27b6000 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x557bb27af070 tx=0x7f99500b77e0 comp rx=0 tx=0).stop 2024-09-12T12:27:43.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.623+0000 7f99635cb740 1 -- 172.21.15.33:0/2446997747 shutdown_connections 2024-09-12T12:27:43.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.623+0000 7f99635cb740 1 --2- 172.21.15.33:0/2446997747 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x557bb27c8f20 0x557bb27cb310 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:43.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.623+0000 7f99635cb740 1 --2- 172.21.15.33:0/2446997747 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb27b9370 0x557bb27b65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:43.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.623+0000 7f99635cb740 1 --2- 172.21.15.33:0/2446997747 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557bb27afb40 0x557bb27b6000 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:43.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.623+0000 7f993eff5640 0 client.15486 ms_handle_reset on v2:172.21.15.102:6836/2409953270 2024-09-12T12:27:43.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.623+0000 7f99635cb740 1 --2- 172.21.15.33:0/2446997747 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb27ae5d0 0x557bb27b8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:43.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.623+0000 7f99635cb740 1 -- 172.21.15.33:0/2446997747 >> 172.21.15.33:0/2446997747 conn(0x557bb2777310 msgr2=0x557bb27b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:43.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.623+0000 7f99635cb740 1 -- 172.21.15.33:0/2446997747 shutdown_connections 2024-09-12T12:27:43.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.623+0000 7f99635cb740 1 -- 172.21.15.33:0/2446997747 wait complete. 2024-09-12T12:27:43.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.623+0000 7f99635cb740 20 client.15486 trim_cache size 0 max 16384 2024-09-12T12:27:43.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.648+0000 7f99635cb740 1 Processor -- start 2024-09-12T12:27:43.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.648+0000 7f99635cb740 1 -- start start 2024-09-12T12:27:43.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.649+0000 7f99635cb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb27ae5d0 0x557bb27b1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:43.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.649+0000 7f99635cb740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557bb27afb40 0x557bb27b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:43.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.649+0000 7f99635cb740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb27b9370 0x557bb27d0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:43.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.649+0000 7f99635cb740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f995c1b7a60 con 0x557bb27afb40 2024-09-12T12:27:43.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.649+0000 7f99635cb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f995c1b5330 con 0x557bb27ae5d0 2024-09-12T12:27:43.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.649+0000 7f99635cb740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f995c1b3180 con 0x557bb27b9370 2024-09-12T12:27:43.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.649+0000 7f995a59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557bb27afb40 0x557bb27b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:43.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.649+0000 7f995b59e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb27b9370 0x557bb27d0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:43.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.649+0000 7f995a59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557bb27afb40 0x557bb27b1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44894/0 (socket says 172.21.15.33:44894) 2024-09-12T12:27:43.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.649+0000 7f995b59e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb27b9370 0x557bb27d0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:45362/0 (socket says 172.21.15.33:45362) 2024-09-12T12:27:43.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.649+0000 7f995a59c640 1 -- 172.21.15.33:0/2169031746 learned_addr learned my addr 172.21.15.33:0/2169031746 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:27:43.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.649+0000 7f995ad9d640 1 --2- 172.21.15.33:0/2169031746 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb27ae5d0 0x557bb27b1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:43.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.649+0000 7f995ad9d640 1 -- 172.21.15.33:0/2169031746 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb27b9370 msgr2=0x557bb27d0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:43.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.649+0000 7f995ad9d640 1 --2- 172.21.15.33:0/2169031746 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb27b9370 0x557bb27d0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:43.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.649+0000 7f995ad9d640 1 -- 172.21.15.33:0/2169031746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557bb27afb40 msgr2=0x557bb27b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:43.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.649+0000 7f995ad9d640 1 --2- 172.21.15.33:0/2169031746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557bb27afb40 0x557bb27b1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:43.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.649+0000 7f995ad9d640 1 -- 172.21.15.33:0/2169031746 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557bb27cb960 con 0x557bb27ae5d0 2024-09-12T12:27:43.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.650+0000 7f995ad9d640 1 --2- 172.21.15.33:0/2169031746 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb27ae5d0 0x557bb27b1120 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x557bb27b6d20 tx=0x7f994c016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d181bce2f32c2a02 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:43.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.650+0000 7f9940ff9640 1 -- 172.21.15.33:0/2169031746 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994c02a430 con 0x557bb27ae5d0 2024-09-12T12:27:43.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.650+0000 7f9940ff9640 1 -- 172.21.15.33:0/2169031746 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f994c02aa80 con 0x557bb27ae5d0 2024-09-12T12:27:43.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.650+0000 7f9940ff9640 1 -- 172.21.15.33:0/2169031746 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994c01ecb0 con 0x557bb27ae5d0 2024-09-12T12:27:43.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.651+0000 7f99635cb740 1 -- 172.21.15.33:0/2169031746 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb27ae5d0 msgr2=0x557bb27b1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:43.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.651+0000 7f99635cb740 1 --2- 172.21.15.33:0/2169031746 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb27ae5d0 0x557bb27b1120 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x557bb27b6d20 tx=0x7f994c016000 comp rx=0 tx=0).stop 2024-09-12T12:27:43.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.651+0000 7f99635cb740 1 -- 172.21.15.33:0/2169031746 shutdown_connections 2024-09-12T12:27:43.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.651+0000 7f99635cb740 1 --2- 172.21.15.33:0/2169031746 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb27b9370 0x557bb27d0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:43.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.651+0000 7f99635cb740 1 --2- 172.21.15.33:0/2169031746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557bb27afb40 0x557bb27b1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:43.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.651+0000 7f99635cb740 1 --2- 172.21.15.33:0/2169031746 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb27ae5d0 0x557bb27b1120 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:43.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.651+0000 7f99635cb740 1 -- 172.21.15.33:0/2169031746 >> 172.21.15.33:0/2169031746 conn(0x557bb2777310 msgr2=0x557bb27b8080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:43.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.651+0000 7f99635cb740 1 -- 172.21.15.33:0/2169031746 shutdown_connections 2024-09-12T12:27:43.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.651+0000 7f99635cb740 1 -- 172.21.15.33:0/2169031746 wait complete. 2024-09-12T12:27:43.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.651+0000 7f99635cb740 1 -- start start 2024-09-12T12:27:43.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.652+0000 7f99635cb740 1 Processor -- start 2024-09-12T12:27:43.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.652+0000 7f99635cb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb27ae5d0 0x557bb27c14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:43.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.652+0000 7f99635cb740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557bb27afb40 0x557bb27c1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:43.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.652+0000 7f99635cb740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb27b9370 0x557bb27be4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:43.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.652+0000 7f99635cb740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f995c1b37f0 con 0x557bb27afb40 2024-09-12T12:27:43.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.652+0000 7f99635cb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f995c1b4c60 con 0x557bb27ae5d0 2024-09-12T12:27:43.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.652+0000 7f99635cb740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f995c1b3ec0 con 0x557bb27b9370 2024-09-12T12:27:43.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.652+0000 7f99635cb740 10 client.0 _ll_register_callbacks cb 0x7f9950030990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:27:43.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.652+0000 7f995ad9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb27ae5d0 0x557bb27c14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:43.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.652+0000 7f995ad9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb27ae5d0 0x557bb27c14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:54736/0 (socket says 172.21.15.33:54736) 2024-09-12T12:27:43.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.652+0000 7f995ad9d640 1 -- 172.21.15.33:0/1619102904 learned_addr learned my addr 172.21.15.33:0/1619102904 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:27:43.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.652+0000 7f995b59e640 1 --2- 172.21.15.33:0/1619102904 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb27b9370 0x557bb27be4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:43.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.652+0000 7f995a59c640 1 --2- 172.21.15.33:0/1619102904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557bb27afb40 0x557bb27c1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:43.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.653+0000 7f995b59e640 1 -- 172.21.15.33:0/1619102904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb27ae5d0 msgr2=0x557bb27c14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:43.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.653+0000 7f995b59e640 1 --2- 172.21.15.33:0/1619102904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb27ae5d0 0x557bb27c14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:43.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.653+0000 7f995b59e640 1 -- 172.21.15.33:0/1619102904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557bb27afb40 msgr2=0x557bb27c1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:43.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.653+0000 7f995b59e640 1 --2- 172.21.15.33:0/1619102904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557bb27afb40 0x557bb27c1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:43.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.653+0000 7f995b59e640 1 -- 172.21.15.33:0/1619102904 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557bb27af3a0 con 0x557bb27b9370 2024-09-12T12:27:43.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.653+0000 7f995b59e640 1 --2- 172.21.15.33:0/1619102904 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb27b9370 0x557bb27be4a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9954009fd0 tx=0x7f9954021620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1f2ef35c0a48b55 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:43.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.653+0000 7f993eff5640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:27:43.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.653+0000 7f993eff5640 1 -- 172.21.15.33:0/1619102904 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9954031060 con 0x557bb27b9370 2024-09-12T12:27:43.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.653+0000 7f99635cb740 1 -- 172.21.15.33:0/1619102904 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f994c02aa80 con 0x557bb27b9370 2024-09-12T12:27:43.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.653+0000 7f993eff5640 1 -- 172.21.15.33:0/1619102904 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f9954021c60 con 0x557bb27b9370 2024-09-12T12:27:43.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.654+0000 7f993eff5640 1 -- 172.21.15.33:0/1619102904 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9954038050 con 0x557bb27b9370 2024-09-12T12:27:43.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.654+0000 7f99635cb740 10 client.25210 fetch_fsmap learned FSMap version 26 2024-09-12T12:27:43.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.654+0000 7f99635cb740 1 -- 172.21.15.33:0/1619102904 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x557bb2834040 con 0x557bb27b9370 2024-09-12T12:27:43.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.654+0000 7f993eff5640 1 -- 172.21.15.33:0/1619102904 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f994c02aa80 con 0x557bb27b9370 2024-09-12T12:27:43.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.654+0000 7f993eff5640 1 -- 172.21.15.33:0/1619102904 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f9954020030 con 0x557bb27b9370 2024-09-12T12:27:43.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.654+0000 7f99635cb740 10 client.25210 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:27:43.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.654+0000 7f99635cb740 10 client.25210 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-12T12:27:43.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.654+0000 7f99635cb740 20 client.25210 populate_metadata read hostname 'smithi033' 2024-09-12T12:27:43.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.654+0000 7f99635cb740 1 --2- 172.21.15.33:0/1619102904 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x557bb2834520 0x557bb2836940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:43.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.654+0000 7f99635cb740 4 client.25210 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:27:43.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.654+0000 7f99635cb740 1 -- 172.21.15.33:0/1619102904 --> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557bb271bd70 con 0x557bb2834520 2024-09-12T12:27:43.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.654+0000 7f995ad9d640 1 --2- 172.21.15.33:0/1619102904 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x557bb2834520 0x557bb2836940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:43.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.655+0000 7f995ad9d640 1 --2- 172.21.15.33:0/1619102904 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x557bb2834520 0x557bb2836940 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a388bebb3f2387fd server_cookie=94d342d3205af8 in_seq=0 out_seq=0 2024-09-12T12:27:43.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.655+0000 7f993eff5640 10 client.25210 ms_handle_connect on v2:172.21.15.102:6836/2409953270 2024-09-12T12:27:43.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.655+0000 7f993eff5640 1 -- 172.21.15.33:0/1619102904 <== mds.1 v2:172.21.15.102:6836/2409953270 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557bb271bd70 con 0x557bb2834520 2024-09-12T12:27:43.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.655+0000 7f993eff5640 10 client.25210 handle_command_reply: tid=0 2024-09-12T12:27:43.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.655+0000 7f99635cb740 1 client.25210 shutdown 2024-09-12T12:27:43.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.655+0000 7f99635cb740 1 -- 172.21.15.33:0/1619102904 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb27b9370 msgr2=0x557bb27be4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:43.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.655+0000 7f99635cb740 1 --2- 172.21.15.33:0/1619102904 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb27b9370 0x557bb27be4a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9954009fd0 tx=0x7f9954021620 comp rx=0 tx=0).stop 2024-09-12T12:27:43.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.655+0000 7f99635cb740 1 -- 172.21.15.33:0/1619102904 shutdown_connections 2024-09-12T12:27:43.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.655+0000 7f99635cb740 1 --2- 172.21.15.33:0/1619102904 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x557bb2834520 0x557bb2836940 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:43.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.655+0000 7f99635cb740 1 --2- 172.21.15.33:0/1619102904 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb27b9370 0x557bb27be4a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:43.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.655+0000 7f99635cb740 1 --2- 172.21.15.33:0/1619102904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557bb27afb40 0x557bb27c1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:43.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.655+0000 7f99635cb740 1 --2- 172.21.15.33:0/1619102904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb27ae5d0 0x557bb27c14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:43.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.655+0000 7f99635cb740 1 -- 172.21.15.33:0/1619102904 >> 172.21.15.33:0/1619102904 conn(0x557bb2777310 msgr2=0x557bb27a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:43.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.655+0000 7f993eff5640 0 client.25210 ms_handle_reset on v2:172.21.15.102:6836/2409953270 2024-09-12T12:27:43.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.656+0000 7f99635cb740 1 -- 172.21.15.33:0/1619102904 shutdown_connections 2024-09-12T12:27:43.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.656+0000 7f99635cb740 1 -- 172.21.15.33:0/1619102904 wait complete. 2024-09-12T12:27:43.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.656+0000 7f99635cb740 20 client.25210 trim_cache size 0 max 16384 2024-09-12T12:27:43.523 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-09-12T12:27:43.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.656+0000 7f99611f2640 1 -- 172.21.15.33:0/3421330615 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f99440a2c00 msgr2=0x7f99440a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:43.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.656+0000 7f99611f2640 1 --2- 172.21.15.33:0/3421330615 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f99440a2c00 0x7f99440a50c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x557bb27abac0 tx=0x7f994c005f90 comp rx=0 tx=0).stop 2024-09-12T12:27:43.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.656+0000 7f99611f2640 1 -- 172.21.15.33:0/3421330615 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f995c109e00 msgr2=0x7f995c1a6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:43.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.656+0000 7f99611f2640 1 --2- 172.21.15.33:0/3421330615 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f995c109e00 0x7f995c1a6d50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f995002a860 tx=0x7f9950030bd0 comp rx=0 tx=0).stop 2024-09-12T12:27:43.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.656+0000 7f99611f2640 1 -- 172.21.15.33:0/3421330615 shutdown_connections 2024-09-12T12:27:43.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.656+0000 7f99611f2640 1 --2- 172.21.15.33:0/3421330615 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f99440a2c00 0x7f99440a50c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:43.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.656+0000 7f99611f2640 1 --2- 172.21.15.33:0/3421330615 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f995c10ea80 0x7f995c1a09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:43.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.656+0000 7f99611f2640 1 --2- 172.21.15.33:0/3421330615 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f995c109e00 0x7f995c1a6d50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:43.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.656+0000 7f99611f2640 1 --2- 172.21.15.33:0/3421330615 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f995c109450 0x7f995c1a6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:43.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.656+0000 7f99611f2640 1 -- 172.21.15.33:0/3421330615 >> 172.21.15.33:0/3421330615 conn(0x7f995c06e2d0 msgr2=0x7f995c10c660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:43.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.657+0000 7f99611f2640 1 -- 172.21.15.33:0/3421330615 shutdown_connections 2024-09-12T12:27:43.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:42.657+0000 7f99611f2640 1 -- 172.21.15.33:0/3421330615 wait complete. 2024-09-12T12:27:43.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:43 smithi043 ceph-mon[34144]: pgmap v401: 129 pgs: 129 active+clean; 3.6 GiB data, 905 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 155 MiB/s wr, 85 op/s 2024-09-12T12:27:43.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:43 smithi102 ceph-mon[34799]: pgmap v401: 129 pgs: 129 active+clean; 3.6 GiB data, 905 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 155 MiB/s wr, 85 op/s 2024-09-12T12:27:45.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:45 smithi033 ceph-mon[31246]: pgmap v402: 129 pgs: 129 active+clean; 4.1 GiB data, 960 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 175 MiB/s wr, 97 op/s 2024-09-12T12:27:45.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:45 smithi043 ceph-mon[34144]: pgmap v402: 129 pgs: 129 active+clean; 4.1 GiB data, 960 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 175 MiB/s wr, 97 op/s 2024-09-12T12:27:45.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:45 smithi102 ceph-mon[34799]: pgmap v402: 129 pgs: 129 active+clean; 4.1 GiB data, 960 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 175 MiB/s wr, 97 op/s 2024-09-12T12:27:47.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:47 smithi033 ceph-mon[31246]: pgmap v403: 129 pgs: 129 active+clean; 4.1 GiB data, 960 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 128 MiB/s wr, 70 op/s 2024-09-12T12:27:47.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:47 smithi043 ceph-mon[34144]: pgmap v403: 129 pgs: 129 active+clean; 4.1 GiB data, 960 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 128 MiB/s wr, 70 op/s 2024-09-12T12:27:47.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:47 smithi102 ceph-mon[34799]: pgmap v403: 129 pgs: 129 active+clean; 4.1 GiB data, 960 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 128 MiB/s wr, 70 op/s 2024-09-12T12:27:49.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:49 smithi033 ceph-mon[31246]: pgmap v404: 129 pgs: 129 active+clean; 4.6 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 170 MiB/s wr, 92 op/s 2024-09-12T12:27:49.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:49 smithi043 ceph-mon[34144]: pgmap v404: 129 pgs: 129 active+clean; 4.6 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 170 MiB/s wr, 92 op/s 2024-09-12T12:27:49.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:49 smithi102 ceph-mon[34799]: pgmap v404: 129 pgs: 129 active+clean; 4.6 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 170 MiB/s wr, 92 op/s 2024-09-12T12:27:50.615 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T12:27:51.033 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:27:51.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:51 smithi033 ceph-mon[31246]: pgmap v405: 129 pgs: 129 active+clean; 4.8 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 139 MiB/s wr, 76 op/s 2024-09-12T12:27:51.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:51 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:27:51.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:51 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:27:51.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:51 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:27:51.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:51 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:27:51.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:51 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:27:51.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:51 smithi043 ceph-mon[34144]: pgmap v405: 129 pgs: 129 active+clean; 4.8 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 139 MiB/s wr, 76 op/s 2024-09-12T12:27:51.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:51 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:27:51.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:51 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:27:51.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:51 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:27:51.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:51 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:27:51.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:51 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:27:51.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:51 smithi102 ceph-mon[34799]: pgmap v405: 129 pgs: 129 active+clean; 4.8 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 139 MiB/s wr, 76 op/s 2024-09-12T12:27:51.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:51 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:27:51.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:51 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:27:51.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:51 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:27:51.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:51 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:27:51.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:51 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:27:52.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.319+0000 7f6425bb5640 1 -- 172.21.15.33:0/3993284517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6420106a90 msgr2=0x7f6420106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:52.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.319+0000 7f6425bb5640 1 --2- 172.21.15.33:0/3993284517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6420106a90 0x7f6420106e70 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6410009930 tx=0x7f641002a420 comp rx=0 tx=0).stop 2024-09-12T12:27:52.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.319+0000 7f6425bb5640 1 -- 172.21.15.33:0/3993284517 shutdown_connections 2024-09-12T12:27:52.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.319+0000 7f6425bb5640 1 --2- 172.21.15.33:0/3993284517 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6420101430 0x7f642010d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.319+0000 7f6425bb5640 1 --2- 172.21.15.33:0/3993284517 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6420100a90 0x7f6420100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.319+0000 7f6425bb5640 1 --2- 172.21.15.33:0/3993284517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6420106a90 0x7f6420106e70 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.319+0000 7f6425bb5640 1 -- 172.21.15.33:0/3993284517 >> 172.21.15.33:0/3993284517 conn(0x7f64200fc7d0 msgr2=0x7f64200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:52.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.319+0000 7f6425bb5640 1 -- 172.21.15.33:0/3993284517 shutdown_connections 2024-09-12T12:27:52.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.320+0000 7f6425bb5640 1 -- 172.21.15.33:0/3993284517 wait complete. 2024-09-12T12:27:52.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.320+0000 7f6425bb5640 1 Processor -- start 2024-09-12T12:27:52.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.321+0000 7f6425bb5640 1 -- start start 2024-09-12T12:27:52.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.321+0000 7f6425bb5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6420100a90 0x7f642019e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:52.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.321+0000 7f6425bb5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6420101430 0x7f64201961b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:52.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.321+0000 7f6425bb5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6420106a90 0x7f64201966f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:52.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.321+0000 7f6425bb5640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6420110d00 con 0x7f6420100a90 2024-09-12T12:27:52.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.321+0000 7f6425bb5640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6420110b80 con 0x7f6420106a90 2024-09-12T12:27:52.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.321+0000 7f6425bb5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6420110e80 con 0x7f6420101430 2024-09-12T12:27:52.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.321+0000 7f641effd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6420101430 0x7f64201961b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:52.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.321+0000 7f641effd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6420101430 0x7f64201961b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:44702/0 (socket says 172.21.15.33:44702) 2024-09-12T12:27:52.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.321+0000 7f641effd640 1 -- 172.21.15.33:0/1755367467 learned_addr learned my addr 172.21.15.33:0/1755367467 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:27:52.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.321+0000 7f641ffff640 1 --2- 172.21.15.33:0/1755367467 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6420106a90 0x7f64201966f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:52.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.322+0000 7f641effd640 1 -- 172.21.15.33:0/1755367467 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6420106a90 msgr2=0x7f64201966f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:52.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.322+0000 7f641effd640 1 --2- 172.21.15.33:0/1755367467 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6420106a90 0x7f64201966f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.322+0000 7f641effd640 1 -- 172.21.15.33:0/1755367467 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6420100a90 msgr2=0x7f642019e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:52.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.322+0000 7f641f7fe640 1 --2- 172.21.15.33:0/1755367467 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6420100a90 0x7f642019e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:52.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.322+0000 7f641effd640 1 --2- 172.21.15.33:0/1755367467 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6420100a90 0x7f642019e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.322+0000 7f641effd640 1 -- 172.21.15.33:0/1755367467 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6420196cb0 con 0x7f6420101430 2024-09-12T12:27:52.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.322+0000 7f641f7fe640 1 --2- 172.21.15.33:0/1755367467 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6420100a90 0x7f642019e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:27:52.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.322+0000 7f641effd640 1 --2- 172.21.15.33:0/1755367467 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6420101430 0x7f64201961b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f641400e9f0 tx=0x7f641400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:52.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.322+0000 7f641cff9640 1 -- 172.21.15.33:0/1755367467 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f641400cd80 con 0x7f6420101430 2024-09-12T12:27:52.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.323+0000 7f6425bb5640 1 -- 172.21.15.33:0/1755367467 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6420196fa0 con 0x7f6420101430 2024-09-12T12:27:52.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.323+0000 7f6425bb5640 1 -- 172.21.15.33:0/1755367467 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64201b3d60 con 0x7f6420101430 2024-09-12T12:27:52.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.323+0000 7f641cff9640 1 -- 172.21.15.33:0/1755367467 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f64140108e0 con 0x7f6420101430 2024-09-12T12:27:52.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.323+0000 7f641cff9640 1 -- 172.21.15.33:0/1755367467 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6414018920 con 0x7f6420101430 2024-09-12T12:27:52.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.325+0000 7f641cff9640 1 -- 172.21.15.33:0/1755367467 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6414018ac0 con 0x7f6420101430 2024-09-12T12:27:52.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.326+0000 7f6427f8e740 1 Processor -- start 2024-09-12T12:27:52.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.326+0000 7f6427f8e740 1 -- start start 2024-09-12T12:27:52.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.326+0000 7f6427f8e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e4ba5dab40 0x55e4ba5d9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:52.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.326+0000 7f6427f8e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e4ba5d95d0 0x55e4ba5d9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:52.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.326+0000 7f6427f8e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e4ba5e4370 0x55e4ba5e6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:52.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.326+0000 7f6427f8e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e4ba53f2f0 con 0x55e4ba5e4370 2024-09-12T12:27:52.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.326+0000 7f6427f8e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e4ba4e6cf0 con 0x55e4ba5d95d0 2024-09-12T12:27:52.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.326+0000 7f6427f8e740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55e4ba53b2b0 con 0x55e4ba5dab40 2024-09-12T12:27:52.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.327+0000 7f641ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e4ba5dab40 0x55e4ba5d9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:52.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.327+0000 7f641ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e4ba5dab40 0x55e4ba5d9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:44706/0 (socket says 172.21.15.33:44706) 2024-09-12T12:27:52.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.327+0000 7f641ffff640 1 -- 172.21.15.33:0/601512837 learned_addr learned my addr 172.21.15.33:0/601512837 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:27:52.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.327+0000 7f641effd640 1 --2- 172.21.15.33:0/601512837 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e4ba5e4370 0x55e4ba5e6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:52.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.327+0000 7f641f7fe640 1 --2- 172.21.15.33:0/601512837 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e4ba5d95d0 0x55e4ba5d9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:52.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.327+0000 7f641effd640 1 -- 172.21.15.33:0/601512837 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e4ba5dab40 msgr2=0x55e4ba5d9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:52.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.327+0000 7f641effd640 1 --2- 172.21.15.33:0/601512837 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e4ba5dab40 0x55e4ba5d9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.327+0000 7f641effd640 1 -- 172.21.15.33:0/601512837 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e4ba5d95d0 msgr2=0x55e4ba5d9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:52.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.327+0000 7f641effd640 1 --2- 172.21.15.33:0/601512837 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e4ba5d95d0 0x55e4ba5d9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.327+0000 7f641effd640 1 -- 172.21.15.33:0/601512837 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4ba4cb3a0 con 0x55e4ba5e4370 2024-09-12T12:27:52.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.327+0000 7f641f7fe640 1 --2- 172.21.15.33:0/601512837 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e4ba5d95d0 0x55e4ba5d9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:27:52.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.327+0000 7f641ffff640 1 --2- 172.21.15.33:0/601512837 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e4ba5dab40 0x55e4ba5d9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:27:52.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.327+0000 7f641effd640 1 --2- 172.21.15.33:0/601512837 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e4ba5e4370 0x55e4ba5e6760 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f64140ccd60 tx=0x7f64140d7690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86b086c8c401e528 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:52.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.327+0000 7f641cff9640 1 --2- 172.21.15.33:0/1755367467 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f64080a2c00 0x7f64080a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:52.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.328+0000 7f641ffff640 1 --2- 172.21.15.33:0/1755367467 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f64080a2c00 0x7f64080a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:52.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.328+0000 7f6405ffb640 1 -- 172.21.15.33:0/601512837 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64140de070 con 0x55e4ba5e4370 2024-09-12T12:27:52.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.328+0000 7f6405ffb640 1 -- 172.21.15.33:0/601512837 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6414097df0 con 0x55e4ba5e4370 2024-09-12T12:27:52.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.328+0000 7f6405ffb640 1 -- 172.21.15.33:0/601512837 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f641409b450 con 0x55e4ba5e4370 2024-09-12T12:27:52.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.328+0000 7f641cff9640 1 -- 172.21.15.33:0/1755367467 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f64140cf620 con 0x7f6420101430 2024-09-12T12:27:52.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.329+0000 7f6427f8e740 1 -- 172.21.15.33:0/601512837 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e4ba5e4370 msgr2=0x55e4ba5e6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:52.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.329+0000 7f641ffff640 1 --2- 172.21.15.33:0/1755367467 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f64080a2c00 0x7f64080a50c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6418009fd0 tx=0x7f6418009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:52.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.329+0000 7f6427f8e740 1 --2- 172.21.15.33:0/601512837 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e4ba5e4370 0x55e4ba5e6760 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f64140ccd60 tx=0x7f64140d7690 comp rx=0 tx=0).stop 2024-09-12T12:27:52.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.329+0000 7f6427f8e740 1 -- 172.21.15.33:0/601512837 shutdown_connections 2024-09-12T12:27:52.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.329+0000 7f6427f8e740 1 --2- 172.21.15.33:0/601512837 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e4ba5e4370 0x55e4ba5e6760 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.329+0000 7f6427f8e740 1 --2- 172.21.15.33:0/601512837 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e4ba5d95d0 0x55e4ba5d9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.329+0000 7f6427f8e740 1 --2- 172.21.15.33:0/601512837 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e4ba5dab40 0x55e4ba5d9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.329+0000 7f6427f8e740 1 -- 172.21.15.33:0/601512837 >> 172.21.15.33:0/601512837 conn(0x55e4ba5a2310 msgr2=0x55e4ba5d5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:52.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.329+0000 7f6427f8e740 1 -- 172.21.15.33:0/601512837 shutdown_connections 2024-09-12T12:27:52.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.329+0000 7f6427f8e740 1 -- 172.21.15.33:0/601512837 wait complete. 2024-09-12T12:27:52.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.329+0000 7f6427f8e740 1 -- start start 2024-09-12T12:27:52.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.330+0000 7f6427f8e740 1 Processor -- start 2024-09-12T12:27:52.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.330+0000 7f6427f8e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e4ba5d95d0 0x55e4ba5e3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:52.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.330+0000 7f6427f8e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e4ba5dab40 0x55e4ba5e0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:52.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.330+0000 7f6427f8e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e4ba5e4370 0x55e4ba5e14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:52.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.330+0000 7f6427f8e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e4ba5e7070 con 0x55e4ba5e4370 2024-09-12T12:27:52.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.330+0000 7f6427f8e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e4ba4fa060 con 0x55e4ba5d95d0 2024-09-12T12:27:52.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.330+0000 7f6427f8e740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55e4ba5e71f0 con 0x55e4ba5dab40 2024-09-12T12:27:52.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.330+0000 7f641ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e4ba5e4370 0x55e4ba5e14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:52.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.330+0000 7f641effd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e4ba5dab40 0x55e4ba5e0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:52.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.331+0000 7f641ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e4ba5e4370 0x55e4ba5e14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40686/0 (socket says 172.21.15.33:40686) 2024-09-12T12:27:52.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.331+0000 7f641ffff640 1 -- 172.21.15.33:0/1442580025 learned_addr learned my addr 172.21.15.33:0/1442580025 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:27:52.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.331+0000 7f6427f8e740 10 client.0 _ll_register_callbacks cb 0x55e4ba24d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:27:52.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.331+0000 7f641f7fe640 1 --2- 172.21.15.33:0/1442580025 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e4ba5d95d0 0x55e4ba5e3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:52.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.331+0000 7f641ffff640 1 -- 172.21.15.33:0/1442580025 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e4ba5dab40 msgr2=0x55e4ba5e0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:52.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.331+0000 7f641ffff640 1 --2- 172.21.15.33:0/1442580025 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e4ba5dab40 0x55e4ba5e0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.331+0000 7f641ffff640 1 -- 172.21.15.33:0/1442580025 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e4ba5d95d0 msgr2=0x55e4ba5e3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:52.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.331+0000 7f641ffff640 1 --2- 172.21.15.33:0/1442580025 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e4ba5d95d0 0x55e4ba5e3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.331+0000 7f641ffff640 1 -- 172.21.15.33:0/1442580025 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4ba2b03c0 con 0x55e4ba5e4370 2024-09-12T12:27:52.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.331+0000 7f641ffff640 1 --2- 172.21.15.33:0/1442580025 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e4ba5e4370 0x55e4ba5e14d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f641800fab0 tx=0x7f6418004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92267239eb931439 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:52.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.331+0000 7f63feffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:27:52.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.331+0000 7f63feffd640 1 -- 172.21.15.33:0/1442580025 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6418003970 con 0x55e4ba5e4370 2024-09-12T12:27:52.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.332+0000 7f63feffd640 1 -- 172.21.15.33:0/1442580025 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f6418017030 con 0x55e4ba5e4370 2024-09-12T12:27:52.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.332+0000 7f6427f8e740 1 -- 172.21.15.33:0/1442580025 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6414097df0 con 0x55e4ba5e4370 2024-09-12T12:27:52.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.332+0000 7f63feffd640 1 -- 172.21.15.33:0/1442580025 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6418003b10 con 0x55e4ba5e4370 2024-09-12T12:27:52.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.332+0000 7f6427f8e740 10 client.15501 fetch_fsmap learned FSMap version 26 2024-09-12T12:27:52.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.332+0000 7f6427f8e740 1 -- 172.21.15.33:0/1442580025 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55e4ba5f2b40 con 0x55e4ba5e4370 2024-09-12T12:27:52.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.332+0000 7f63feffd640 1 -- 172.21.15.33:0/1442580025 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6414097df0 con 0x55e4ba5e4370 2024-09-12T12:27:52.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.332+0000 7f63feffd640 1 -- 172.21.15.33:0/1442580025 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f641801d700 con 0x55e4ba5e4370 2024-09-12T12:27:52.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.332+0000 7f6427f8e740 10 client.15501 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:27:52.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.332+0000 7f6427f8e740 10 client.15501 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:27:52.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.332+0000 7f6427f8e740 20 client.15501 populate_metadata read hostname 'smithi033' 2024-09-12T12:27:52.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.332+0000 7f6427f8e740 1 --2- 172.21.15.33:0/1442580025 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55e4ba5f44f0 0x55e4ba5f6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:52.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.333+0000 7f6427f8e740 4 client.15501 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:27:52.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.333+0000 7f6427f8e740 1 -- 172.21.15.33:0/1442580025 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e4ba54c860 con 0x55e4ba5f44f0 2024-09-12T12:27:52.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.333+0000 7f641f7fe640 1 --2- 172.21.15.33:0/1442580025 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55e4ba5f44f0 0x55e4ba5f6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:52.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.333+0000 7f63feffd640 10 client.15501 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:27:52.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.334+0000 7f641f7fe640 1 --2- 172.21.15.33:0/1442580025 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55e4ba5f44f0 0x55e4ba5f6970 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c976bf9e007dbe6 server_cookie=42c4a6eaee438a5e in_seq=0 out_seq=0 2024-09-12T12:27:52.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.334+0000 7f63feffd640 1 -- 172.21.15.33:0/1442580025 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e4ba54c860 con 0x55e4ba5f44f0 2024-09-12T12:27:52.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.334+0000 7f63feffd640 10 client.15501 handle_command_reply: tid=0 2024-09-12T12:27:52.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.334+0000 7f6427f8e740 1 client.15501 shutdown 2024-09-12T12:27:52.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.335+0000 7f6427f8e740 1 -- 172.21.15.33:0/1442580025 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e4ba5e4370 msgr2=0x55e4ba5e14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:52.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.335+0000 7f6427f8e740 1 --2- 172.21.15.33:0/1442580025 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e4ba5e4370 0x55e4ba5e14d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f641800fab0 tx=0x7f6418004ab0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.335+0000 7f6427f8e740 1 -- 172.21.15.33:0/1442580025 shutdown_connections 2024-09-12T12:27:52.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.335+0000 7f6427f8e740 1 --2- 172.21.15.33:0/1442580025 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55e4ba5f44f0 0x55e4ba5f6970 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.335+0000 7f6427f8e740 1 --2- 172.21.15.33:0/1442580025 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e4ba5e4370 0x55e4ba5e14d0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.335+0000 7f6427f8e740 1 --2- 172.21.15.33:0/1442580025 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e4ba5dab40 0x55e4ba5e0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.335+0000 7f6427f8e740 1 --2- 172.21.15.33:0/1442580025 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e4ba5d95d0 0x55e4ba5e3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.335+0000 7f6427f8e740 1 -- 172.21.15.33:0/1442580025 >> 172.21.15.33:0/1442580025 conn(0x55e4ba5a2310 msgr2=0x55e4ba5db930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:52.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.335+0000 7f63feffd640 0 client.15501 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:27:52.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.336+0000 7f6427f8e740 1 -- 172.21.15.33:0/1442580025 shutdown_connections 2024-09-12T12:27:52.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.336+0000 7f6427f8e740 1 -- 172.21.15.33:0/1442580025 wait complete. 2024-09-12T12:27:52.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.336+0000 7f6427f8e740 20 client.15501 trim_cache size 0 max 16384 2024-09-12T12:27:52.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.356+0000 7f6427f8e740 1 Processor -- start 2024-09-12T12:27:52.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.357+0000 7f6427f8e740 1 -- start start 2024-09-12T12:27:52.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.357+0000 7f6427f8e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e4ba5d95d0 0x55e4ba5d5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:52.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.357+0000 7f6427f8e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e4ba5dab40 0x55e4ba5f0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:52.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.357+0000 7f6427f8e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e4ba5e4370 0x55e4ba5dc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:52.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.357+0000 7f6427f8e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f640c012460 con 0x55e4ba5d95d0 2024-09-12T12:27:52.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.357+0000 7f6427f8e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f640c00fd30 con 0x55e4ba5dab40 2024-09-12T12:27:52.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.357+0000 7f6427f8e740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f640c00db80 con 0x55e4ba5e4370 2024-09-12T12:27:52.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.357+0000 7f641f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e4ba5d95d0 0x55e4ba5d5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:52.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.357+0000 7f641f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e4ba5d95d0 0x55e4ba5d5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40698/0 (socket says 172.21.15.33:40698) 2024-09-12T12:27:52.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.357+0000 7f641f7fe640 1 -- 172.21.15.33:0/2300026820 learned_addr learned my addr 172.21.15.33:0/2300026820 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:27:52.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.358+0000 7f641f7fe640 1 -- 172.21.15.33:0/2300026820 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e4ba5e4370 msgr2=0x55e4ba5dc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:52.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.358+0000 7f641f7fe640 1 --2- 172.21.15.33:0/2300026820 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e4ba5e4370 0x55e4ba5dc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.358+0000 7f641f7fe640 1 -- 172.21.15.33:0/2300026820 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e4ba5dab40 msgr2=0x55e4ba5f0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:52.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.358+0000 7f641f7fe640 1 --2- 172.21.15.33:0/2300026820 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e4ba5dab40 0x55e4ba5f0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.358+0000 7f641f7fe640 1 -- 172.21.15.33:0/2300026820 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4ba5e22f0 con 0x55e4ba5d95d0 2024-09-12T12:27:52.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.358+0000 7f641f7fe640 1 --2- 172.21.15.33:0/2300026820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e4ba5d95d0 0x55e4ba5d5e10 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f6410009900 tx=0x7f6410009630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85f35293bb99ae14 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:52.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.358+0000 7f64057fa640 1 -- 172.21.15.33:0/2300026820 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f641004a070 con 0x55e4ba5d95d0 2024-09-12T12:27:52.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.358+0000 7f64057fa640 1 -- 172.21.15.33:0/2300026820 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6410005040 con 0x55e4ba5d95d0 2024-09-12T12:27:52.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.358+0000 7f64057fa640 1 -- 172.21.15.33:0/2300026820 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6410035040 con 0x55e4ba5d95d0 2024-09-12T12:27:52.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.359+0000 7f6427f8e740 1 -- 172.21.15.33:0/2300026820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e4ba5d95d0 msgr2=0x55e4ba5d5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:52.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.359+0000 7f6427f8e740 1 --2- 172.21.15.33:0/2300026820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e4ba5d95d0 0x55e4ba5d5e10 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f6410009900 tx=0x7f6410009630 comp rx=0 tx=0).stop 2024-09-12T12:27:52.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.360+0000 7f6427f8e740 1 -- 172.21.15.33:0/2300026820 shutdown_connections 2024-09-12T12:27:52.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.360+0000 7f6427f8e740 1 --2- 172.21.15.33:0/2300026820 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e4ba5e4370 0x55e4ba5dc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.360+0000 7f6427f8e740 1 --2- 172.21.15.33:0/2300026820 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e4ba5dab40 0x55e4ba5f0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.360+0000 7f6427f8e740 1 --2- 172.21.15.33:0/2300026820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e4ba5d95d0 0x55e4ba5d5e10 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.360+0000 7f6427f8e740 1 -- 172.21.15.33:0/2300026820 >> 172.21.15.33:0/2300026820 conn(0x55e4ba5a2310 msgr2=0x55e4ba5d5700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:52.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.360+0000 7f6427f8e740 1 -- 172.21.15.33:0/2300026820 shutdown_connections 2024-09-12T12:27:52.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.360+0000 7f6427f8e740 1 -- 172.21.15.33:0/2300026820 wait complete. 2024-09-12T12:27:52.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.360+0000 7f6427f8e740 1 -- start start 2024-09-12T12:27:52.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.360+0000 7f6427f8e740 1 Processor -- start 2024-09-12T12:27:52.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.361+0000 7f6427f8e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e4ba5d95d0 0x55e4ba5e81c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:52.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.361+0000 7f6427f8e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e4ba5dab40 0x55e4ba5e8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:52.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.361+0000 7f641f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e4ba5d95d0 0x55e4ba5e81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:52.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.361+0000 7f641f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e4ba5d95d0 0x55e4ba5e81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40710/0 (socket says 172.21.15.33:40710) 2024-09-12T12:27:52.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.361+0000 7f6427f8e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e4ba5e4370 0x55e4ba5e8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:52.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.361+0000 7f641f7fe640 1 -- 172.21.15.33:0/105737514 learned_addr learned my addr 172.21.15.33:0/105737514 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:27:52.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.361+0000 7f6427f8e740 1 -- 172.21.15.33:0/105737514 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f640c00e1f0 con 0x55e4ba5d95d0 2024-09-12T12:27:52.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.361+0000 7f6427f8e740 1 -- 172.21.15.33:0/105737514 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f640c00f660 con 0x55e4ba5e4370 2024-09-12T12:27:52.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.361+0000 7f6427f8e740 1 -- 172.21.15.33:0/105737514 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f640c00e8c0 con 0x55e4ba5dab40 2024-09-12T12:27:52.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.361+0000 7f641effd640 1 --2- 172.21.15.33:0/105737514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e4ba5dab40 0x55e4ba5e8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:52.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.361+0000 7f6427f8e740 10 client.0 _ll_register_callbacks cb 0x7f6418011de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:27:52.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.361+0000 7f641ffff640 1 --2- 172.21.15.33:0/105737514 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e4ba5e4370 0x55e4ba5e8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:52.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.362+0000 7f641effd640 1 -- 172.21.15.33:0/105737514 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e4ba5e4370 msgr2=0x55e4ba5e8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:52.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.362+0000 7f641effd640 1 --2- 172.21.15.33:0/105737514 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e4ba5e4370 0x55e4ba5e8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.362+0000 7f641effd640 1 -- 172.21.15.33:0/105737514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e4ba5d95d0 msgr2=0x55e4ba5e81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:52.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.362+0000 7f641effd640 1 --2- 172.21.15.33:0/105737514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e4ba5d95d0 0x55e4ba5e81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.362+0000 7f641effd640 1 -- 172.21.15.33:0/105737514 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4ba65e250 con 0x55e4ba5dab40 2024-09-12T12:27:52.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.362+0000 7f641f7fe640 1 --2- 172.21.15.33:0/105737514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e4ba5d95d0 0x55e4ba5e81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:27:52.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.362+0000 7f641effd640 1 --2- 172.21.15.33:0/105737514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e4ba5dab40 0x55e4ba5e8700 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f641400c6a0 tx=0x7f64140cf990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40153acee33bf385 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:52.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.362+0000 7f63feffd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:27:52.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.362+0000 7f63feffd640 1 -- 172.21.15.33:0/105737514 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64140de040 con 0x55e4ba5dab40 2024-09-12T12:27:52.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.362+0000 7f63feffd640 1 -- 172.21.15.33:0/105737514 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f64140cf350 con 0x55e4ba5dab40 2024-09-12T12:27:52.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.362+0000 7f6427f8e740 1 -- 172.21.15.33:0/105737514 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6410005040 con 0x55e4ba5dab40 2024-09-12T12:27:52.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.362+0000 7f63feffd640 1 -- 172.21.15.33:0/105737514 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f641409b450 con 0x55e4ba5dab40 2024-09-12T12:27:52.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.362+0000 7f6427f8e740 10 client.25225 fetch_fsmap learned FSMap version 26 2024-09-12T12:27:52.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.362+0000 7f6427f8e740 1 -- 172.21.15.33:0/105737514 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55e4ba65f4b0 con 0x55e4ba5dab40 2024-09-12T12:27:52.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.363+0000 7f63feffd640 1 -- 172.21.15.33:0/105737514 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f64140d7e90 con 0x55e4ba5dab40 2024-09-12T12:27:52.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.363+0000 7f63feffd640 1 -- 172.21.15.33:0/105737514 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f64140981a0 con 0x55e4ba5dab40 2024-09-12T12:27:52.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.363+0000 7f6427f8e740 10 client.25225 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:27:52.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.363+0000 7f6427f8e740 10 client.25225 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:27:52.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.363+0000 7f6427f8e740 20 client.25225 populate_metadata read hostname 'smithi033' 2024-09-12T12:27:52.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.363+0000 7f6427f8e740 1 --2- 172.21.15.33:0/105737514 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55e4ba65f870 0x55e4ba661c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:52.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.363+0000 7f6427f8e740 4 client.25225 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:27:52.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.363+0000 7f6427f8e740 1 -- 172.21.15.33:0/105737514 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f6410005040 con 0x55e4ba65f870 2024-09-12T12:27:52.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.363+0000 7f641f7fe640 1 --2- 172.21.15.33:0/105737514 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55e4ba65f870 0x55e4ba661c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:52.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.364+0000 7f641f7fe640 1 --2- 172.21.15.33:0/105737514 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55e4ba65f870 0x55e4ba661c90 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb4b825da78d4b04 server_cookie=2e5b30f9106c45d3 in_seq=0 out_seq=0 2024-09-12T12:27:52.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.364+0000 7f63feffd640 10 client.25225 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:27:52.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.364+0000 7f63feffd640 1 -- 172.21.15.33:0/105737514 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f6410005040 con 0x55e4ba65f870 2024-09-12T12:27:52.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.364+0000 7f63feffd640 10 client.25225 handle_command_reply: tid=0 2024-09-12T12:27:52.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.364+0000 7f6427f8e740 1 client.25225 shutdown 2024-09-12T12:27:52.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.364+0000 7f6427f8e740 1 -- 172.21.15.33:0/105737514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e4ba5dab40 msgr2=0x55e4ba5e8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:52.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.364+0000 7f6427f8e740 1 --2- 172.21.15.33:0/105737514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e4ba5dab40 0x55e4ba5e8700 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f641400c6a0 tx=0x7f64140cf990 comp rx=0 tx=0).stop 2024-09-12T12:27:52.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.364+0000 7f6427f8e740 1 -- 172.21.15.33:0/105737514 shutdown_connections 2024-09-12T12:27:52.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.364+0000 7f6427f8e740 1 --2- 172.21.15.33:0/105737514 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55e4ba65f870 0x55e4ba661c90 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.364+0000 7f63feffd640 0 client.25225 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:27:52.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.364+0000 7f6427f8e740 1 --2- 172.21.15.33:0/105737514 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e4ba5e4370 0x55e4ba5e8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.364+0000 7f6427f8e740 1 --2- 172.21.15.33:0/105737514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e4ba5dab40 0x55e4ba5e8700 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.364+0000 7f6427f8e740 1 --2- 172.21.15.33:0/105737514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e4ba5d95d0 0x55e4ba5e81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.364+0000 7f6427f8e740 1 -- 172.21.15.33:0/105737514 >> 172.21.15.33:0/105737514 conn(0x55e4ba5a2310 msgr2=0x55e4ba5e27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:52.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.365+0000 7f6427f8e740 1 -- 172.21.15.33:0/105737514 shutdown_connections 2024-09-12T12:27:52.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.365+0000 7f6427f8e740 1 -- 172.21.15.33:0/105737514 wait complete. 2024-09-12T12:27:52.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.365+0000 7f6427f8e740 20 client.25225 trim_cache size 0 max 16384 2024-09-12T12:27:52.370 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-09-12T12:27:52.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.366+0000 7f6425bb5640 1 -- 172.21.15.33:0/1755367467 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f64080a2c00 msgr2=0x7f64080a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:52.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.366+0000 7f6425bb5640 1 --2- 172.21.15.33:0/1755367467 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f64080a2c00 0x7f64080a50c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6418009fd0 tx=0x7f6418009500 comp rx=0 tx=0).stop 2024-09-12T12:27:52.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.366+0000 7f6425bb5640 1 -- 172.21.15.33:0/1755367467 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6420101430 msgr2=0x7f64201961b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:52.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.366+0000 7f6425bb5640 1 --2- 172.21.15.33:0/1755367467 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6420101430 0x7f64201961b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f641400e9f0 tx=0x7f641400eeb0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.366+0000 7f6425bb5640 1 -- 172.21.15.33:0/1755367467 shutdown_connections 2024-09-12T12:27:52.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.366+0000 7f6425bb5640 1 --2- 172.21.15.33:0/1755367467 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f64080a2c00 0x7f64080a50c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.366+0000 7f6425bb5640 1 --2- 172.21.15.33:0/1755367467 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6420106a90 0x7f64201966f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.366+0000 7f6425bb5640 1 --2- 172.21.15.33:0/1755367467 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6420101430 0x7f64201961b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.366+0000 7f6425bb5640 1 --2- 172.21.15.33:0/1755367467 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6420100a90 0x7f642019e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:52.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.366+0000 7f6425bb5640 1 -- 172.21.15.33:0/1755367467 >> 172.21.15.33:0/1755367467 conn(0x7f64200fc7d0 msgr2=0x7f642006a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:52.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.366+0000 7f6425bb5640 1 -- 172.21.15.33:0/1755367467 shutdown_connections 2024-09-12T12:27:52.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:52.366+0000 7f6425bb5640 1 -- 172.21.15.33:0/1755367467 wait complete. 2024-09-12T12:27:52.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:52 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:27:52.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:52 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:27:52.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:52 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:27:52.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:52 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:27:52.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:52 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:27:52.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:52 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:27:52.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:52 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:27:52.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:52 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:27:52.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:52 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:27:53.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:53 smithi043 ceph-mon[34144]: pgmap v406: 129 pgs: 129 active+clean; 5.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 143 MiB/s wr, 77 op/s 2024-09-12T12:27:53.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:53 smithi102 ceph-mon[34799]: pgmap v406: 129 pgs: 129 active+clean; 5.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 143 MiB/s wr, 77 op/s 2024-09-12T12:27:53.980 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:53 smithi033 ceph-mon[31246]: pgmap v406: 129 pgs: 129 active+clean; 5.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 143 MiB/s wr, 77 op/s 2024-09-12T12:27:54.214 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T12:27:54.215 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T12:27:54.603 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:27:55.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.156+0000 7ff9ad59a640 1 -- 172.21.15.33:0/2519649098 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4035020 con 0x7ff9b0103780 2024-09-12T12:27:55.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.157+0000 7ff9b4dd2640 1 -- 172.21.15.33:0/2519649098 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9b0103780 msgr2=0x7ff9b0107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:55.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.157+0000 7ff9b4dd2640 1 --2- 172.21.15.33:0/2519649098 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9b0103780 0x7ff9b0107bc0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4009930 tx=0x7ff9a402a420 comp rx=0 tx=0).stop 2024-09-12T12:27:55.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.157+0000 7ff9b4dd2640 1 -- 172.21.15.33:0/2519649098 shutdown_connections 2024-09-12T12:27:55.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.157+0000 7ff9b4dd2640 1 --2- 172.21.15.33:0/2519649098 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9b0108300 0x7ff9b010ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:55.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.157+0000 7ff9b4dd2640 1 --2- 172.21.15.33:0/2519649098 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9b0103780 0x7ff9b0107bc0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:55.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.157+0000 7ff9b4dd2640 1 --2- 172.21.15.33:0/2519649098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9b0102dd0 0x7ff9b01031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:55.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.157+0000 7ff9b4dd2640 1 -- 172.21.15.33:0/2519649098 >> 172.21.15.33:0/2519649098 conn(0x7ff9b00fc7d0 msgr2=0x7ff9b00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:55.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.157+0000 7ff9b4dd2640 1 -- 172.21.15.33:0/2519649098 shutdown_connections 2024-09-12T12:27:55.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.157+0000 7ff9b4dd2640 1 -- 172.21.15.33:0/2519649098 wait complete. 2024-09-12T12:27:55.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.158+0000 7ff9b4dd2640 1 Processor -- start 2024-09-12T12:27:55.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.158+0000 7ff9b4dd2640 1 -- start start 2024-09-12T12:27:55.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.159+0000 7ff9b4dd2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9b0102dd0 0x7ff9b0100a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:55.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.159+0000 7ff9b4dd2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9b0103780 0x7ff9b0100f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:55.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.159+0000 7ff9b4dd2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9b0108300 0x7ff9b01014b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:55.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.159+0000 7ff9b4dd2640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b0111f50 con 0x7ff9b0103780 2024-09-12T12:27:55.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.159+0000 7ff9b4dd2640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b0111dd0 con 0x7ff9b0108300 2024-09-12T12:27:55.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.159+0000 7ff9b4dd2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b01120d0 con 0x7ff9b0102dd0 2024-09-12T12:27:55.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.159+0000 7ff9ae59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9b0102dd0 0x7ff9b0100a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:55.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.159+0000 7ff9add9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9b0103780 0x7ff9b0100f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:55.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.159+0000 7ff9ae59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9b0102dd0 0x7ff9b0100a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:44764/0 (socket says 172.21.15.33:44764) 2024-09-12T12:27:55.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.159+0000 7ff9ae59c640 1 -- 172.21.15.33:0/2627398145 learned_addr learned my addr 172.21.15.33:0/2627398145 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:27:55.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.159+0000 7ff9aed9d640 1 --2- 172.21.15.33:0/2627398145 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9b0108300 0x7ff9b01014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:55.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.160+0000 7ff9ae59c640 1 -- 172.21.15.33:0/2627398145 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9b0108300 msgr2=0x7ff9b01014b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:55.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.160+0000 7ff9ae59c640 1 --2- 172.21.15.33:0/2627398145 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9b0108300 0x7ff9b01014b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:55.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.160+0000 7ff9ae59c640 1 -- 172.21.15.33:0/2627398145 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9b0103780 msgr2=0x7ff9b0100f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:55.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.160+0000 7ff9ae59c640 1 --2- 172.21.15.33:0/2627398145 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9b0103780 0x7ff9b0100f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:55.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.160+0000 7ff9ae59c640 1 -- 172.21.15.33:0/2627398145 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b01a69f0 con 0x7ff9b0102dd0 2024-09-12T12:27:55.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.160+0000 7ff9aed9d640 1 --2- 172.21.15.33:0/2627398145 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9b0108300 0x7ff9b01014b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:27:55.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.160+0000 7ff9ae59c640 1 --2- 172.21.15.33:0/2627398145 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9b0102dd0 0x7ff9b0100a30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff9a000e9f0 tx=0x7ff9a000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:55.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.160+0000 7ff99f7fe640 1 -- 172.21.15.33:0/2627398145 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a000cd80 con 0x7ff9b0102dd0 2024-09-12T12:27:55.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.160+0000 7ff9b4dd2640 1 -- 172.21.15.33:0/2627398145 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9b01a6ce0 con 0x7ff9b0102dd0 2024-09-12T12:27:55.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.160+0000 7ff99f7fe640 1 -- 172.21.15.33:0/2627398145 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff9a00108e0 con 0x7ff9b0102dd0 2024-09-12T12:27:55.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.160+0000 7ff99f7fe640 1 -- 172.21.15.33:0/2627398145 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a000cd80 con 0x7ff9b0102dd0 2024-09-12T12:27:55.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.160+0000 7ff9b4dd2640 1 -- 172.21.15.33:0/2627398145 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9b01a71a0 con 0x7ff9b0102dd0 2024-09-12T12:27:55.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.163+0000 7ff99f7fe640 1 -- 172.21.15.33:0/2627398145 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ff9a0010430 con 0x7ff9b0102dd0 2024-09-12T12:27:55.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.164+0000 7ff99f7fe640 1 --2- 172.21.15.33:0/2627398145 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff9980a2f90 0x7ff9980a5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:55.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.164+0000 7ff9b71ab740 1 Processor -- start 2024-09-12T12:27:55.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.164+0000 7ff99f7fe640 1 -- 172.21.15.33:0/2627398145 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7ff9a000cb80 con 0x7ff9b0102dd0 2024-09-12T12:27:55.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.164+0000 7ff9b71ab740 1 -- start start 2024-09-12T12:27:55.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.164+0000 7ff9add9b640 1 --2- 172.21.15.33:0/2627398145 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff9980a2f90 0x7ff9980a5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:55.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.164+0000 7ff9b71ab740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d082cd0b60 0x55d082cd0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:55.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.164+0000 7ff9b71ab740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d082cd1480 0x55d082cdb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:55.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.164+0000 7ff9b71ab740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d082cdbd40 0x55d082cde130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:55.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.164+0000 7ff9b71ab740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55d082c36280 con 0x55d082cdbd40 2024-09-12T12:27:55.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.164+0000 7ff9b71ab740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d082bddb10 con 0x55d082cd0b60 2024-09-12T12:27:55.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.164+0000 7ff9b71ab740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d082c32240 con 0x55d082cd1480 2024-09-12T12:27:55.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.165+0000 7ff9aed9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d082cdbd40 0x55d082cde130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:55.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.165+0000 7ff9add9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d082cd1480 0x55d082cdb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:55.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.165+0000 7ff9aed9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d082cdbd40 0x55d082cde130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40744/0 (socket says 172.21.15.33:40744) 2024-09-12T12:27:55.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.165+0000 7ff9aed9d640 1 -- 172.21.15.33:0/2457889199 learned_addr learned my addr 172.21.15.33:0/2457889199 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:27:55.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.165+0000 7ff9ae59c640 1 --2- 172.21.15.33:0/2457889199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d082cd0b60 0x55d082cd0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:55.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.165+0000 7ff9aed9d640 1 -- 172.21.15.33:0/2457889199 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d082cd1480 msgr2=0x55d082cdb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:55.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.165+0000 7ff9aed9d640 1 --2- 172.21.15.33:0/2457889199 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d082cd1480 0x55d082cdb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:55.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.165+0000 7ff9aed9d640 1 -- 172.21.15.33:0/2457889199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d082cd0b60 msgr2=0x55d082cd0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:55.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.165+0000 7ff9aed9d640 1 --2- 172.21.15.33:0/2457889199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d082cd0b60 0x55d082cd0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:55.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.165+0000 7ff9aed9d640 1 -- 172.21.15.33:0/2457889199 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d082bea1f0 con 0x55d082cdbd40 2024-09-12T12:27:55.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.165+0000 7ff9add9b640 1 --2- 172.21.15.33:0/2457889199 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d082cd1480 0x55d082cdb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:27:55.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.165+0000 7ff9add9b640 1 --2- 172.21.15.33:0/2627398145 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff9980a2f90 0x7ff9980a5450 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4005ab0 tx=0x7ff9a4004120 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:55.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.165+0000 7ff9aed9d640 1 --2- 172.21.15.33:0/2457889199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d082cdbd40 0x55d082cde130 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8009ea0 tx=0x7ff9a8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d753bc801908a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:55.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.166+0000 7ff99cff9640 1 -- 172.21.15.33:0/2457889199 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a8016070 con 0x55d082cdbd40 2024-09-12T12:27:55.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.166+0000 7ff99cff9640 1 -- 172.21.15.33:0/2457889199 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff9a800ee80 con 0x55d082cdbd40 2024-09-12T12:27:55.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.166+0000 7ff99cff9640 1 -- 172.21.15.33:0/2457889199 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a80116d0 con 0x55d082cdbd40 2024-09-12T12:27:55.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.167+0000 7ff9b71ab740 1 -- 172.21.15.33:0/2457889199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d082cdbd40 msgr2=0x55d082cde130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:55.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.167+0000 7ff9b71ab740 1 --2- 172.21.15.33:0/2457889199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d082cdbd40 0x55d082cde130 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8009ea0 tx=0x7ff9a8009f90 comp rx=0 tx=0).stop 2024-09-12T12:27:55.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.167+0000 7ff9b71ab740 1 -- 172.21.15.33:0/2457889199 shutdown_connections 2024-09-12T12:27:55.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.167+0000 7ff9b71ab740 1 --2- 172.21.15.33:0/2457889199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d082cdbd40 0x55d082cde130 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:55.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.167+0000 7ff9b71ab740 1 --2- 172.21.15.33:0/2457889199 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d082cd1480 0x55d082cdb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:55.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.167+0000 7ff9b71ab740 1 --2- 172.21.15.33:0/2457889199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d082cd0b60 0x55d082cd0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:55.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.167+0000 7ff9b71ab740 1 -- 172.21.15.33:0/2457889199 >> 172.21.15.33:0/2457889199 conn(0x55d082ccd0f0 msgr2=0x55d082ccd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:55.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.167+0000 7ff9b71ab740 1 -- 172.21.15.33:0/2457889199 shutdown_connections 2024-09-12T12:27:55.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.167+0000 7ff9b71ab740 1 -- 172.21.15.33:0/2457889199 wait complete. 2024-09-12T12:27:55.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.167+0000 7ff9b71ab740 1 -- start start 2024-09-12T12:27:55.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.167+0000 7ff9b71ab740 1 Processor -- start 2024-09-12T12:27:55.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.168+0000 7ff9b71ab740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d082cd0b60 0x55d082cd8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:55.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.168+0000 7ff9b71ab740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d082cd1480 0x55d082cd90e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:55.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.168+0000 7ff9b71ab740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d082cdbd40 0x55d082cd9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:55.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.168+0000 7ff9b71ab740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55d082cde910 con 0x55d082cd0b60 2024-09-12T12:27:55.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.168+0000 7ff9b71ab740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d082bf0f10 con 0x55d082cdbd40 2024-09-12T12:27:55.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.168+0000 7ff9b71ab740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d082cdea90 con 0x55d082cd1480 2024-09-12T12:27:55.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.168+0000 7ff9b71ab740 10 client.0 _ll_register_callbacks cb 0x55d082bb9a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:27:55.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.168+0000 7ff9ae59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d082cd0b60 0x55d082cd8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:55.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.168+0000 7ff9ae59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d082cd0b60 0x55d082cd8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40758/0 (socket says 172.21.15.33:40758) 2024-09-12T12:27:55.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.168+0000 7ff9ae59c640 1 -- 172.21.15.33:0/1232728455 learned_addr learned my addr 172.21.15.33:0/1232728455 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:27:55.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.169+0000 7ff9add9b640 1 --2- 172.21.15.33:0/1232728455 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d082cd1480 0x55d082cd90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:55.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.169+0000 7ff9aed9d640 1 --2- 172.21.15.33:0/1232728455 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d082cdbd40 0x55d082cd9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:55.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.169+0000 7ff9ae59c640 1 -- 172.21.15.33:0/1232728455 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d082cd1480 msgr2=0x55d082cd90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:55.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.169+0000 7ff9ae59c640 1 --2- 172.21.15.33:0/1232728455 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d082cd1480 0x55d082cd90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:55.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.169+0000 7ff9ae59c640 1 -- 172.21.15.33:0/1232728455 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d082cdbd40 msgr2=0x55d082cd9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:55.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.169+0000 7ff9ae59c640 1 --2- 172.21.15.33:0/1232728455 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d082cdbd40 0x55d082cd9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:55.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.169+0000 7ff9ae59c640 1 -- 172.21.15.33:0/1232728455 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0829a76a0 con 0x55d082cd0b60 2024-09-12T12:27:55.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.169+0000 7ff9aed9d640 1 --2- 172.21.15.33:0/1232728455 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d082cdbd40 0x55d082cd9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:27:55.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.169+0000 7ff9ae59c640 1 --2- 172.21.15.33:0/1232728455 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d082cd0b60 0x55d082cd8ba0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0098020 tx=0x7ff9a0010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bc64d8300fccf02 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:55.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.169+0000 7ff995ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:27:55.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.169+0000 7ff995ffb640 1 -- 172.21.15.33:0/1232728455 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a0086070 con 0x55d082cd0b60 2024-09-12T12:27:55.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.169+0000 7ff995ffb640 1 -- 172.21.15.33:0/1232728455 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7ff9a0097cc0 con 0x55d082cd0b60 2024-09-12T12:27:55.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.169+0000 7ff9b71ab740 1 -- 172.21.15.33:0/1232728455 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d082c437f0 con 0x55d082cd0b60 2024-09-12T12:27:55.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.170+0000 7ff995ffb640 1 -- 172.21.15.33:0/1232728455 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff9a009fa00 con 0x55d082cd0b60 2024-09-12T12:27:55.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.170+0000 7ff9b71ab740 10 client.15519 fetch_fsmap learned FSMap version 26 2024-09-12T12:27:55.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.170+0000 7ff9b71ab740 1 -- 172.21.15.33:0/1232728455 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55d082cea520 con 0x55d082cd0b60 2024-09-12T12:27:55.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.170+0000 7ff995ffb640 1 -- 172.21.15.33:0/1232728455 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55d082c437f0 con 0x55d082cd0b60 2024-09-12T12:27:55.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.170+0000 7ff995ffb640 1 -- 172.21.15.33:0/1232728455 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7ff9a00974c0 con 0x55d082cd0b60 2024-09-12T12:27:55.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.170+0000 7ff9b71ab740 10 client.15519 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:27:55.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.170+0000 7ff9b71ab740 10 client.15519 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:27:55.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.170+0000 7ff9b71ab740 20 client.15519 populate_metadata read hostname 'smithi033' 2024-09-12T12:27:55.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.170+0000 7ff9b71ab740 1 --2- 172.21.15.33:0/1232728455 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55d082ceb9e0 0x55d082cede30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:55.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.171+0000 7ff9b71ab740 4 client.15519 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:27:55.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.171+0000 7ff9b71ab740 1 -- 172.21.15.33:0/1232728455 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d082c3dd00 con 0x55d082ceb9e0 2024-09-12T12:27:55.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.171+0000 7ff9add9b640 1 --2- 172.21.15.33:0/1232728455 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55d082ceb9e0 0x55d082cede30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:55.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.171+0000 7ff995ffb640 10 client.15519 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:27:55.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.171+0000 7ff9add9b640 1 --2- 172.21.15.33:0/1232728455 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55d082ceb9e0 0x55d082cede30 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df684642f01c0e1 server_cookie=b5f165999ec7b2b0 in_seq=0 out_seq=0 2024-09-12T12:27:55.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.172+0000 7ff995ffb640 1 -- 172.21.15.33:0/1232728455 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d082c3dd00 con 0x55d082ceb9e0 2024-09-12T12:27:55.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.172+0000 7ff995ffb640 10 client.15519 handle_command_reply: tid=0 2024-09-12T12:27:55.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.172+0000 7ff9b71ab740 1 client.15519 shutdown 2024-09-12T12:27:55.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.172+0000 7ff9b71ab740 1 -- 172.21.15.33:0/1232728455 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d082cd0b60 msgr2=0x55d082cd8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:55.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.172+0000 7ff9b71ab740 1 --2- 172.21.15.33:0/1232728455 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d082cd0b60 0x55d082cd8ba0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0098020 tx=0x7ff9a0010860 comp rx=0 tx=0).stop 2024-09-12T12:27:55.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.172+0000 7ff9b71ab740 1 -- 172.21.15.33:0/1232728455 shutdown_connections 2024-09-12T12:27:55.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.172+0000 7ff9b71ab740 1 --2- 172.21.15.33:0/1232728455 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55d082ceb9e0 0x55d082cede30 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:55.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.172+0000 7ff995ffb640 0 client.15519 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:27:55.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.172+0000 7ff9b71ab740 1 --2- 172.21.15.33:0/1232728455 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d082cdbd40 0x55d082cd9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:55.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.172+0000 7ff9b71ab740 1 --2- 172.21.15.33:0/1232728455 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d082cd1480 0x55d082cd90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:55.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.172+0000 7ff9b71ab740 1 --2- 172.21.15.33:0/1232728455 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d082cd0b60 0x55d082cd8ba0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:55.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.172+0000 7ff9b71ab740 1 -- 172.21.15.33:0/1232728455 >> 172.21.15.33:0/1232728455 conn(0x55d082ccd0f0 msgr2=0x55d082cd2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:55.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.173+0000 7ff9b71ab740 1 -- 172.21.15.33:0/1232728455 shutdown_connections 2024-09-12T12:27:55.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.173+0000 7ff9b71ab740 1 -- 172.21.15.33:0/1232728455 wait complete. 2024-09-12T12:27:55.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.173+0000 7ff9b71ab740 20 client.15519 trim_cache size 0 max 16384 2024-09-12T12:27:55.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.201+0000 7ff9b71ab740 1 Processor -- start 2024-09-12T12:27:55.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.201+0000 7ff9b71ab740 1 -- start start 2024-09-12T12:27:55.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.201+0000 7ff9b71ab740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d082cd0b60 0x55d082cd7a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:55.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.201+0000 7ff9b71ab740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d082cd1480 0x55d082cf36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:55.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.201+0000 7ff9b71ab740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d082cdbd40 0x55d082cf3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:55.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.201+0000 7ff9b71ab740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b01b3770 con 0x55d082cd1480 2024-09-12T12:27:55.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.201+0000 7ff9b71ab740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b01b1040 con 0x55d082cd0b60 2024-09-12T12:27:55.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.201+0000 7ff9b71ab740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b01aee90 con 0x55d082cdbd40 2024-09-12T12:27:55.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.201+0000 7ff9ae59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d082cd0b60 0x55d082cd7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:55.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.201+0000 7ff9ae59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d082cd0b60 0x55d082cd7a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:57064/0 (socket says 172.21.15.33:57064) 2024-09-12T12:27:55.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.201+0000 7ff9ae59c640 1 -- 172.21.15.33:0/1950022270 learned_addr learned my addr 172.21.15.33:0/1950022270 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:27:55.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.201+0000 7ff9aed9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d082cdbd40 0x55d082cf3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:55.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.201+0000 7ff9add9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d082cd1480 0x55d082cf36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:55.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.201+0000 7ff9ae59c640 1 -- 172.21.15.33:0/1950022270 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d082cdbd40 msgr2=0x55d082cf3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:55.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.202+0000 7ff9ae59c640 1 --2- 172.21.15.33:0/1950022270 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d082cdbd40 0x55d082cf3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:55.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.202+0000 7ff9ae59c640 1 -- 172.21.15.33:0/1950022270 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d082cd1480 msgr2=0x55d082cf36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:55.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.202+0000 7ff9ae59c640 1 --2- 172.21.15.33:0/1950022270 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d082cd1480 0x55d082cf36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:55.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.202+0000 7ff9ae59c640 1 -- 172.21.15.33:0/1950022270 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d082cccf20 con 0x55d082cd0b60 2024-09-12T12:27:55.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.202+0000 7ff9ae59c640 1 --2- 172.21.15.33:0/1950022270 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d082cd0b60 0x55d082cd7a50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0097ab0 tx=0x7ff9a0009700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca18676ee7ff12e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:55.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.202+0000 7ff997fff640 1 -- 172.21.15.33:0/1950022270 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a009b420 con 0x55d082cd0b60 2024-09-12T12:27:55.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.202+0000 7ff997fff640 1 -- 172.21.15.33:0/1950022270 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff9a0097cc0 con 0x55d082cd0b60 2024-09-12T12:27:55.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.202+0000 7ff997fff640 1 -- 172.21.15.33:0/1950022270 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a0097600 con 0x55d082cd0b60 2024-09-12T12:27:55.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.203+0000 7ff9b71ab740 1 -- 172.21.15.33:0/1950022270 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d082cd0b60 msgr2=0x55d082cd7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:55.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.203+0000 7ff9b71ab740 1 --2- 172.21.15.33:0/1950022270 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d082cd0b60 0x55d082cd7a50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0097ab0 tx=0x7ff9a0009700 comp rx=0 tx=0).stop 2024-09-12T12:27:55.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.203+0000 7ff9b71ab740 1 -- 172.21.15.33:0/1950022270 shutdown_connections 2024-09-12T12:27:55.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.203+0000 7ff9b71ab740 1 --2- 172.21.15.33:0/1950022270 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d082cdbd40 0x55d082cf3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:55.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.203+0000 7ff9b71ab740 1 --2- 172.21.15.33:0/1950022270 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d082cd1480 0x55d082cf36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:55.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.203+0000 7ff9b71ab740 1 --2- 172.21.15.33:0/1950022270 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d082cd0b60 0x55d082cd7a50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:55.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.203+0000 7ff9b71ab740 1 -- 172.21.15.33:0/1950022270 >> 172.21.15.33:0/1950022270 conn(0x55d082ccd0f0 msgr2=0x55d082cd7340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:55.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.203+0000 7ff9b71ab740 1 -- 172.21.15.33:0/1950022270 shutdown_connections 2024-09-12T12:27:55.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.203+0000 7ff9b71ab740 1 -- 172.21.15.33:0/1950022270 wait complete. 2024-09-12T12:27:55.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.204+0000 7ff9b71ab740 1 -- start start 2024-09-12T12:27:55.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.204+0000 7ff9b71ab740 1 Processor -- start 2024-09-12T12:27:55.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.204+0000 7ff9b71ab740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d082cd0b60 0x55d082cdfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:55.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.204+0000 7ff9b71ab740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d082cd1480 0x55d082ce0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:55.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.204+0000 7ff9b71ab740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d082cdbd40 0x55d082ce07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:55.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.204+0000 7ff9b71ab740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b01af500 con 0x55d082cd1480 2024-09-12T12:27:55.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.204+0000 7ff9b71ab740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b01b0970 con 0x55d082cdbd40 2024-09-12T12:27:55.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.204+0000 7ff9b71ab740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b01afbd0 con 0x55d082cd0b60 2024-09-12T12:27:55.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.204+0000 7ff9b71ab740 10 client.0 _ll_register_callbacks cb 0x7ff9a00978f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:27:55.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.205+0000 7ff9ae59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d082cd0b60 0x55d082cdfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:55.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.205+0000 7ff9ae59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d082cd0b60 0x55d082cdfd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:44798/0 (socket says 172.21.15.33:44798) 2024-09-12T12:27:55.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.205+0000 7ff9ae59c640 1 -- 172.21.15.33:0/69504528 learned_addr learned my addr 172.21.15.33:0/69504528 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:27:55.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.205+0000 7ff9add9b640 1 --2- 172.21.15.33:0/69504528 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d082cd1480 0x55d082ce0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:55.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.205+0000 7ff9ae59c640 1 -- 172.21.15.33:0/69504528 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d082cdbd40 msgr2=0x55d082ce07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:55.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.205+0000 7ff9ae59c640 1 --2- 172.21.15.33:0/69504528 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d082cdbd40 0x55d082ce07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:55.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.205+0000 7ff9ae59c640 1 -- 172.21.15.33:0/69504528 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d082cd1480 msgr2=0x55d082ce0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:55.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.205+0000 7ff9ae59c640 1 --2- 172.21.15.33:0/69504528 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d082cd1480 0x55d082ce0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:55.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.205+0000 7ff9ae59c640 1 -- 172.21.15.33:0/69504528 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d082d55970 con 0x55d082cd0b60 2024-09-12T12:27:55.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.205+0000 7ff9ae59c640 1 --2- 172.21.15.33:0/69504528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d082cd0b60 0x55d082cdfd40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff9a00cc940 tx=0x7ff9a0000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b421c3ce58f80b27 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:55.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.205+0000 7ff995ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:27:55.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.205+0000 7ff995ffb640 1 -- 172.21.15.33:0/69504528 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a009b420 con 0x55d082cd0b60 2024-09-12T12:27:55.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.205+0000 7ff995ffb640 1 -- 172.21.15.33:0/69504528 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7ff9a009aaa0 con 0x55d082cd0b60 2024-09-12T12:27:55.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.206+0000 7ff9b71ab740 1 -- 172.21.15.33:0/69504528 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9a0097cc0 con 0x55d082cd0b60 2024-09-12T12:27:55.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.206+0000 7ff995ffb640 1 -- 172.21.15.33:0/69504528 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff9a00a42c0 con 0x55d082cd0b60 2024-09-12T12:27:55.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.206+0000 7ff9b71ab740 10 client.25243 fetch_fsmap learned FSMap version 26 2024-09-12T12:27:55.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.206+0000 7ff9b71ab740 1 -- 172.21.15.33:0/69504528 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55d082d56cb0 con 0x55d082cd0b60 2024-09-12T12:27:55.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.206+0000 7ff995ffb640 1 -- 172.21.15.33:0/69504528 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff9a0097cc0 con 0x55d082cd0b60 2024-09-12T12:27:55.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.206+0000 7ff995ffb640 1 -- 172.21.15.33:0/69504528 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7ff9a00bb300 con 0x55d082cd0b60 2024-09-12T12:27:55.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.206+0000 7ff9b71ab740 10 client.25243 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:27:55.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.206+0000 7ff9b71ab740 10 client.25243 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:27:55.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.207+0000 7ff9b71ab740 20 client.25243 populate_metadata read hostname 'smithi033' 2024-09-12T12:27:55.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.207+0000 7ff9b71ab740 1 --2- 172.21.15.33:0/69504528 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55d082d57180 0x55d082d59570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:55.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.207+0000 7ff9b71ab740 4 client.25243 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T12:27:55.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.207+0000 7ff9b71ab740 1 -- 172.21.15.33:0/69504528 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d082bba110 con 0x55d082d57180 2024-09-12T12:27:55.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.207+0000 7ff9add9b640 1 --2- 172.21.15.33:0/69504528 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55d082d57180 0x55d082d59570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:55.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.207+0000 7ff9add9b640 1 --2- 172.21.15.33:0/69504528 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55d082d57180 0x55d082d59570 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a226779c8e565c41 server_cookie=a6f595836e823af6 in_seq=0 out_seq=0 2024-09-12T12:27:55.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.207+0000 7ff995ffb640 10 client.25243 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:27:55.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.208+0000 7ff995ffb640 1 -- 172.21.15.33:0/69504528 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d082bba110 con 0x55d082d57180 2024-09-12T12:27:55.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.209+0000 7ff995ffb640 10 client.25243 handle_command_reply: tid=0 2024-09-12T12:27:55.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.209+0000 7ff9b71ab740 1 client.25243 shutdown 2024-09-12T12:27:55.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.209+0000 7ff9b71ab740 1 -- 172.21.15.33:0/69504528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d082cd0b60 msgr2=0x55d082cdfd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:55.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.209+0000 7ff9b71ab740 1 --2- 172.21.15.33:0/69504528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d082cd0b60 0x55d082cdfd40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff9a00cc940 tx=0x7ff9a0000bc0 comp rx=0 tx=0).stop 2024-09-12T12:27:55.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.209+0000 7ff9b71ab740 1 -- 172.21.15.33:0/69504528 shutdown_connections 2024-09-12T12:27:55.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.209+0000 7ff9b71ab740 1 --2- 172.21.15.33:0/69504528 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55d082d57180 0x55d082d59570 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:55.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.209+0000 7ff9b71ab740 1 --2- 172.21.15.33:0/69504528 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d082cdbd40 0x55d082ce07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:55.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.209+0000 7ff995ffb640 0 client.25243 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:27:55.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.209+0000 7ff9b71ab740 1 --2- 172.21.15.33:0/69504528 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d082cd1480 0x55d082ce0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:55.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.209+0000 7ff9b71ab740 1 --2- 172.21.15.33:0/69504528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d082cd0b60 0x55d082cdfd40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:55.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.209+0000 7ff9b71ab740 1 -- 172.21.15.33:0/69504528 >> 172.21.15.33:0/69504528 conn(0x55d082ccd0f0 msgr2=0x55d082ccc270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:55.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.209+0000 7ff9b71ab740 1 -- 172.21.15.33:0/69504528 shutdown_connections 2024-09-12T12:27:55.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.209+0000 7ff9b71ab740 1 -- 172.21.15.33:0/69504528 wait complete. 2024-09-12T12:27:55.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.209+0000 7ff9b71ab740 20 client.25243 trim_cache size 0 max 16384 2024-09-12T12:27:55.214 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:27:55.214 INFO:teuthology.orchestra.run.smithi033.stdout: "return_code": 0, 2024-09-12T12:27:55.214 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_tag": "2749bc48-d6dc-41c8-a9d0-fd31ca8cfb09", 2024-09-12T12:27:55.214 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": "asynchronous" 2024-09-12T12:27:55.214 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:27:55.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.210+0000 7ff9b4dd2640 1 -- 172.21.15.33:0/2627398145 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff9980a2f90 msgr2=0x7ff9980a5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:55.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.210+0000 7ff9b4dd2640 1 --2- 172.21.15.33:0/2627398145 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff9980a2f90 0x7ff9980a5450 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4005ab0 tx=0x7ff9a4004120 comp rx=0 tx=0).stop 2024-09-12T12:27:55.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.210+0000 7ff9b4dd2640 1 -- 172.21.15.33:0/2627398145 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9b0102dd0 msgr2=0x7ff9b0100a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:55.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.210+0000 7ff9b4dd2640 1 --2- 172.21.15.33:0/2627398145 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9b0102dd0 0x7ff9b0100a30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff9a000e9f0 tx=0x7ff9a000eeb0 comp rx=0 tx=0).stop 2024-09-12T12:27:55.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.211+0000 7ff9b4dd2640 1 -- 172.21.15.33:0/2627398145 shutdown_connections 2024-09-12T12:27:55.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.211+0000 7ff9b4dd2640 1 --2- 172.21.15.33:0/2627398145 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff9980a2f90 0x7ff9980a5450 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:55.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.211+0000 7ff9b4dd2640 1 --2- 172.21.15.33:0/2627398145 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9b0108300 0x7ff9b01014b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:55.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.211+0000 7ff9b4dd2640 1 --2- 172.21.15.33:0/2627398145 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9b0103780 0x7ff9b0100f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:55.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.211+0000 7ff9b4dd2640 1 --2- 172.21.15.33:0/2627398145 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9b0102dd0 0x7ff9b0100a30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:55.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.211+0000 7ff9b4dd2640 1 -- 172.21.15.33:0/2627398145 >> 172.21.15.33:0/2627398145 conn(0x7ff9b00fc7d0 msgr2=0x7ff9b0105ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:55.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.211+0000 7ff9b4dd2640 1 -- 172.21.15.33:0/2627398145 shutdown_connections 2024-09-12T12:27:55.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:55.211+0000 7ff9b4dd2640 1 -- 172.21.15.33:0/2627398145 wait complete. 2024-09-12T12:27:55.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:55 smithi043 ceph-mon[34144]: pgmap v407: 129 pgs: 129 active+clean; 5.4 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 152 MiB/s wr, 84 op/s 2024-09-12T12:27:55.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:55 smithi043 ceph-mon[34144]: scrub summary: active paths [/] 2024-09-12T12:27:55.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:55 smithi043 ceph-mon[34144]: scrub summary: idle+waiting paths [/] 2024-09-12T12:27:55.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:55 smithi102 ceph-mon[34799]: pgmap v407: 129 pgs: 129 active+clean; 5.4 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 152 MiB/s wr, 84 op/s 2024-09-12T12:27:55.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:55 smithi102 ceph-mon[34799]: scrub summary: active paths [/] 2024-09-12T12:27:55.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:55 smithi102 ceph-mon[34799]: scrub summary: idle+waiting paths [/] 2024-09-12T12:27:55.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:55 smithi033 ceph-mon[31246]: pgmap v407: 129 pgs: 129 active+clean; 5.4 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 152 MiB/s wr, 84 op/s 2024-09-12T12:27:55.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:55 smithi033 ceph-mon[31246]: scrub summary: active paths [/] 2024-09-12T12:27:55.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:55 smithi033 ceph-mon[31246]: scrub summary: idle+waiting paths [/] 2024-09-12T12:27:56.097 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T12:27:56.484 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:27:56.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:56 smithi043 ceph-mon[34144]: scrub queued for path: / 2024-09-12T12:27:56.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:56 smithi043 ceph-mon[34144]: scrub summary: idle+waiting paths [/] 2024-09-12T12:27:56.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:56 smithi043 ceph-mon[34144]: scrub summary: active paths [/] 2024-09-12T12:27:56.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:56 smithi043 ceph-mon[34144]: scrub summary: idle+waiting paths [/] 2024-09-12T12:27:56.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:56 smithi102 ceph-mon[34799]: scrub queued for path: / 2024-09-12T12:27:56.939 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:56 smithi102 ceph-mon[34799]: scrub summary: idle+waiting paths [/] 2024-09-12T12:27:56.940 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:56 smithi102 ceph-mon[34799]: scrub summary: active paths [/] 2024-09-12T12:27:56.940 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:56 smithi102 ceph-mon[34799]: scrub summary: idle+waiting paths [/] 2024-09-12T12:27:56.940 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:56 smithi033 ceph-mon[31246]: scrub queued for path: / 2024-09-12T12:27:56.940 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:56 smithi033 ceph-mon[31246]: scrub summary: idle+waiting paths [/] 2024-09-12T12:27:56.940 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:56 smithi033 ceph-mon[31246]: scrub summary: active paths [/] 2024-09-12T12:27:56.940 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:56 smithi033 ceph-mon[31246]: scrub summary: idle+waiting paths [/] 2024-09-12T12:27:57.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.052+0000 7f5d9f6e5640 1 -- 172.21.15.33:0/1918044102 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d98103740 msgr2=0x7f5d98107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:57.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.052+0000 7f5d9f6e5640 1 --2- 172.21.15.33:0/1918044102 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d98103740 0x7f5d98107b80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5d88009890 tx=0x7f5d8802a380 comp rx=0 tx=0).stop 2024-09-12T12:27:57.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.052+0000 7f5d9f6e5640 1 -- 172.21.15.33:0/1918044102 shutdown_connections 2024-09-12T12:27:57.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.052+0000 7f5d9f6e5640 1 --2- 172.21.15.33:0/1918044102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d98108290 0x7f5d9810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.052+0000 7f5d9f6e5640 1 --2- 172.21.15.33:0/1918044102 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d98103740 0x7f5d98107b80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.052+0000 7f5d9f6e5640 1 --2- 172.21.15.33:0/1918044102 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d98102d90 0x7f5d98103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.052+0000 7f5d9f6e5640 1 -- 172.21.15.33:0/1918044102 >> 172.21.15.33:0/1918044102 conn(0x7f5d980fc7d0 msgr2=0x7f5d980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:57.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.052+0000 7f5d9f6e5640 1 -- 172.21.15.33:0/1918044102 shutdown_connections 2024-09-12T12:27:57.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.052+0000 7f5d9f6e5640 1 -- 172.21.15.33:0/1918044102 wait complete. 2024-09-12T12:27:57.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.053+0000 7f5d9f6e5640 1 Processor -- start 2024-09-12T12:27:57.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.053+0000 7f5d9f6e5640 1 -- start start 2024-09-12T12:27:57.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.053+0000 7f5d9f6e5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d98102d90 0x7f5d98103c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:57.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.053+0000 7f5d9f6e5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d98103740 0x7f5d98104150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:57.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.053+0000 7f5d9f6e5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d98108290 0x7f5d98104690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:57.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.053+0000 7f5d9f6e5640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5d98111f40 con 0x7f5d98108290 2024-09-12T12:27:57.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.053+0000 7f5d9f6e5640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5d98111dc0 con 0x7f5d98103740 2024-09-12T12:27:57.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.053+0000 7f5d9f6e5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5d981120c0 con 0x7f5d98102d90 2024-09-12T12:27:57.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.053+0000 7f5d9dc82640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d98108290 0x7f5d98104690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:57.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.053+0000 7f5d9cc80640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d98103740 0x7f5d98104150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:57.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.053+0000 7f5d9dc82640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d98108290 0x7f5d98104690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40790/0 (socket says 172.21.15.33:40790) 2024-09-12T12:27:57.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.053+0000 7f5d9cc80640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d98103740 0x7f5d98104150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:57090/0 (socket says 172.21.15.33:57090) 2024-09-12T12:27:57.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.053+0000 7f5d9dc82640 1 -- 172.21.15.33:0/3026185027 learned_addr learned my addr 172.21.15.33:0/3026185027 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:27:57.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.054+0000 7f5d9d481640 1 --2- 172.21.15.33:0/3026185027 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d98102d90 0x7f5d98103c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:57.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.054+0000 7f5d9dc82640 1 -- 172.21.15.33:0/3026185027 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d98102d90 msgr2=0x7f5d98103c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:57.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.054+0000 7f5d9dc82640 1 --2- 172.21.15.33:0/3026185027 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d98102d90 0x7f5d98103c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.054+0000 7f5d9dc82640 1 -- 172.21.15.33:0/3026185027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d98103740 msgr2=0x7f5d98104150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:57.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.054+0000 7f5d9dc82640 1 --2- 172.21.15.33:0/3026185027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d98103740 0x7f5d98104150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.054+0000 7f5d9dc82640 1 -- 172.21.15.33:0/3026185027 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d981aada0 con 0x7f5d98108290 2024-09-12T12:27:57.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.054+0000 7f5d9dc82640 1 --2- 172.21.15.33:0/3026185027 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d98108290 0x7f5d98104690 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f5d9000c370 tx=0x7f5d9000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:57.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.055+0000 7f5d8e7fc640 1 -- 172.21.15.33:0/3026185027 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d90003970 con 0x7f5d98108290 2024-09-12T12:27:57.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.055+0000 7f5d9f6e5640 1 -- 172.21.15.33:0/3026185027 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d981ab090 con 0x7f5d98108290 2024-09-12T12:27:57.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.055+0000 7f5d8e7fc640 1 -- 172.21.15.33:0/3026185027 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5d90004020 con 0x7f5d98108290 2024-09-12T12:27:57.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.055+0000 7f5d9f6e5640 1 -- 172.21.15.33:0/3026185027 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d981ab5a0 con 0x7f5d98108290 2024-09-12T12:27:57.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.055+0000 7f5d8e7fc640 1 -- 172.21.15.33:0/3026185027 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d90004d40 con 0x7f5d98108290 2024-09-12T12:27:57.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.059+0000 7f5d8e7fc640 1 -- 172.21.15.33:0/3026185027 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f5d9001d020 con 0x7f5d98108290 2024-09-12T12:27:57.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.060+0000 7f5d8e7fc640 1 --2- 172.21.15.33:0/3026185027 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f5d840a2b80 0x7f5d840a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:57.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.060+0000 7f5d9d481640 1 --2- 172.21.15.33:0/3026185027 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f5d840a2b80 0x7f5d840a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:57.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.060+0000 7f5da1abe740 1 Processor -- start 2024-09-12T12:27:57.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.060+0000 7f5d8e7fc640 1 -- 172.21.15.33:0/3026185027 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f5d900cf1f0 con 0x7f5d98108290 2024-09-12T12:27:57.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.061+0000 7f5da1abe740 1 -- start start 2024-09-12T12:27:57.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.061+0000 7f5d9d481640 1 --2- 172.21.15.33:0/3026185027 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f5d840a2b80 0x7f5d840a5040 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5d94005fd0 tx=0x7f5d9400b590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:57.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.061+0000 7f5da1abe740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a9158894a0 0x55a915889880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:57.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.061+0000 7f5da1abe740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a915889dc0 0x55a915894140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:57.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.061+0000 7f5da1abe740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a915894680 0x55a915896a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:57.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.061+0000 7f5da1abe740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a9157ef2e0 con 0x55a9158894a0 2024-09-12T12:27:57.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.061+0000 7f5da1abe740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a915796ce0 con 0x55a915894680 2024-09-12T12:27:57.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.061+0000 7f5da1abe740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a9157eb2a0 con 0x55a915889dc0 2024-09-12T12:27:57.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.061+0000 7f5d9d481640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a9158894a0 0x55a915889880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:57.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.061+0000 7f5d9cc80640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a915889dc0 0x55a915894140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:57.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.061+0000 7f5d9d481640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a9158894a0 0x55a915889880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40802/0 (socket says 172.21.15.33:40802) 2024-09-12T12:27:57.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.061+0000 7f5d9d481640 1 -- 172.21.15.33:0/2181584502 learned_addr learned my addr 172.21.15.33:0/2181584502 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:27:57.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.061+0000 7f5d9cc80640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a915889dc0 0x55a915894140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:44828/0 (socket says 172.21.15.33:44828) 2024-09-12T12:27:57.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.061+0000 7f5d9dc82640 1 --2- 172.21.15.33:0/2181584502 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a915894680 0x55a915896a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:57.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.062+0000 7f5d9d481640 1 -- 172.21.15.33:0/2181584502 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a915889dc0 msgr2=0x55a915894140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:57.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.062+0000 7f5d9d481640 1 --2- 172.21.15.33:0/2181584502 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a915889dc0 0x55a915894140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.062+0000 7f5d9d481640 1 -- 172.21.15.33:0/2181584502 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a915894680 msgr2=0x55a915896a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:57.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.062+0000 7f5d9d481640 1 --2- 172.21.15.33:0/2181584502 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a915894680 0x55a915896a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.062+0000 7f5d9d481640 1 -- 172.21.15.33:0/2181584502 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a91577b440 con 0x55a9158894a0 2024-09-12T12:27:57.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.062+0000 7f5d9dc82640 1 --2- 172.21.15.33:0/2181584502 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a915894680 0x55a915896a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:27:57.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.062+0000 7f5d9d481640 1 --2- 172.21.15.33:0/2181584502 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a9158894a0 0x55a915889880 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f5d94005bc0 tx=0x7f5d94012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3570e9d3ba4bcd66 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:57.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.062+0000 7f5d837fe640 1 -- 172.21.15.33:0/2181584502 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d94022070 con 0x55a9158894a0 2024-09-12T12:27:57.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.062+0000 7f5d837fe640 1 -- 172.21.15.33:0/2181584502 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5d9400fe80 con 0x55a9158894a0 2024-09-12T12:27:57.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.062+0000 7f5d837fe640 1 -- 172.21.15.33:0/2181584502 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d940109e0 con 0x55a9158894a0 2024-09-12T12:27:57.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.063+0000 7f5da1abe740 1 -- 172.21.15.33:0/2181584502 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a9158894a0 msgr2=0x55a915889880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:57.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.063+0000 7f5da1abe740 1 --2- 172.21.15.33:0/2181584502 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a9158894a0 0x55a915889880 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f5d94005bc0 tx=0x7f5d94012000 comp rx=0 tx=0).stop 2024-09-12T12:27:57.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.063+0000 7f5da1abe740 1 -- 172.21.15.33:0/2181584502 shutdown_connections 2024-09-12T12:27:57.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.063+0000 7f5da1abe740 1 --2- 172.21.15.33:0/2181584502 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a915894680 0x55a915896a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.063+0000 7f5da1abe740 1 --2- 172.21.15.33:0/2181584502 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a915889dc0 0x55a915894140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.063+0000 7f5da1abe740 1 --2- 172.21.15.33:0/2181584502 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a9158894a0 0x55a915889880 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.063+0000 7f5da1abe740 1 -- 172.21.15.33:0/2181584502 >> 172.21.15.33:0/2181584502 conn(0x55a915885a30 msgr2=0x55a915885e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:57.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.063+0000 7f5da1abe740 1 -- 172.21.15.33:0/2181584502 shutdown_connections 2024-09-12T12:27:57.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.063+0000 7f5da1abe740 1 -- 172.21.15.33:0/2181584502 wait complete. 2024-09-12T12:27:57.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.064+0000 7f5da1abe740 1 -- start start 2024-09-12T12:27:57.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.064+0000 7f5da1abe740 1 Processor -- start 2024-09-12T12:27:57.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.064+0000 7f5da1abe740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a9158894a0 0x55a915893f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:57.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.064+0000 7f5da1abe740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a915889dc0 0x55a915891220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:57.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.064+0000 7f5da1abe740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a915894680 0x55a915891760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:57.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.064+0000 7f5da1abe740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a915897250 con 0x55a915894680 2024-09-12T12:27:57.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.064+0000 7f5da1abe740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a9157aa050 con 0x55a9158894a0 2024-09-12T12:27:57.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.065+0000 7f5da1abe740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a9158973d0 con 0x55a915889dc0 2024-09-12T12:27:57.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.065+0000 7f5da1abe740 10 client.0 _ll_register_callbacks cb 0x55a9157ea160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:27:57.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.065+0000 7f5d9dc82640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a915894680 0x55a915891760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:57.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.065+0000 7f5d9dc82640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a915894680 0x55a915891760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40808/0 (socket says 172.21.15.33:40808) 2024-09-12T12:27:57.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.065+0000 7f5d9dc82640 1 -- 172.21.15.33:0/2090248683 learned_addr learned my addr 172.21.15.33:0/2090248683 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:27:57.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.065+0000 7f5d9cc80640 1 --2- 172.21.15.33:0/2090248683 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a915889dc0 0x55a915891220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:57.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.065+0000 7f5d9d481640 1 --2- 172.21.15.33:0/2090248683 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a9158894a0 0x55a915893f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:57.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.065+0000 7f5d9dc82640 1 -- 172.21.15.33:0/2090248683 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a915889dc0 msgr2=0x55a915891220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:57.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.065+0000 7f5d9dc82640 1 --2- 172.21.15.33:0/2090248683 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a915889dc0 0x55a915891220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.065+0000 7f5d9dc82640 1 -- 172.21.15.33:0/2090248683 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a9158894a0 msgr2=0x55a915893f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:57.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.065+0000 7f5d9dc82640 1 --2- 172.21.15.33:0/2090248683 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a9158894a0 0x55a915893f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.065+0000 7f5d9dc82640 1 -- 172.21.15.33:0/2090248683 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9155603c0 con 0x55a915894680 2024-09-12T12:27:57.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.065+0000 7f5d9dc82640 1 --2- 172.21.15.33:0/2090248683 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a915894680 0x55a915891760 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5d90009fb0 tx=0x7f5d9009b0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7573f4c249f3ade server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:57.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.065+0000 7f5d80ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:27:57.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.066+0000 7f5d80ff9640 1 -- 172.21.15.33:0/2090248683 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d900a40a0 con 0x55a915894680 2024-09-12T12:27:57.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.066+0000 7f5d80ff9640 1 -- 172.21.15.33:0/2090248683 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f5d90003b10 con 0x55a915894680 2024-09-12T12:27:57.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.066+0000 7f5da1abe740 1 -- 172.21.15.33:0/2090248683 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a9157fc850 con 0x55a915894680 2024-09-12T12:27:57.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.066+0000 7f5d80ff9640 1 -- 172.21.15.33:0/2090248683 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5d900a4330 con 0x55a915894680 2024-09-12T12:27:57.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.066+0000 7f5da1abe740 10 client.15537 fetch_fsmap learned FSMap version 26 2024-09-12T12:27:57.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.066+0000 7f5da1abe740 1 -- 172.21.15.33:0/2090248683 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a9158a2b90 con 0x55a915894680 2024-09-12T12:27:57.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.066+0000 7f5d80ff9640 1 -- 172.21.15.33:0/2090248683 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55a9157fc850 con 0x55a915894680 2024-09-12T12:27:57.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.066+0000 7f5d80ff9640 1 -- 172.21.15.33:0/2090248683 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f5d9000b040 con 0x55a915894680 2024-09-12T12:27:57.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.066+0000 7f5da1abe740 10 client.15537 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:27:57.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.066+0000 7f5da1abe740 10 client.15537 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:27:57.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.067+0000 7f5da1abe740 20 client.15537 populate_metadata read hostname 'smithi033' 2024-09-12T12:27:57.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.067+0000 7f5da1abe740 1 --2- 172.21.15.33:0/2090248683 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55a9158a4050 0x55a9158a6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:57.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.067+0000 7f5da1abe740 4 client.15537 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:27:57.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.067+0000 7f5da1abe740 1 -- 172.21.15.33:0/2090248683 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a9157f6d60 con 0x55a9158a4050 2024-09-12T12:27:57.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.067+0000 7f5d9d481640 1 --2- 172.21.15.33:0/2090248683 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55a9158a4050 0x55a9158a6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:57.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.067+0000 7f5d80ff9640 10 client.15537 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:27:57.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.067+0000 7f5d9d481640 1 --2- 172.21.15.33:0/2090248683 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55a9158a4050 0x55a9158a6440 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ef7b2ecb42b6e1d server_cookie=b8a70e8d5cbf6800 in_seq=0 out_seq=0 2024-09-12T12:27:57.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.068+0000 7f5d80ff9640 1 -- 172.21.15.33:0/2090248683 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a9157f6d60 con 0x55a9158a4050 2024-09-12T12:27:57.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.068+0000 7f5d80ff9640 10 client.15537 handle_command_reply: tid=0 2024-09-12T12:27:57.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.068+0000 7f5da1abe740 1 client.15537 shutdown 2024-09-12T12:27:57.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.068+0000 7f5da1abe740 1 -- 172.21.15.33:0/2090248683 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a915894680 msgr2=0x55a915891760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:57.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.068+0000 7f5da1abe740 1 --2- 172.21.15.33:0/2090248683 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a915894680 0x55a915891760 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5d90009fb0 tx=0x7f5d9009b0e0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.068+0000 7f5da1abe740 1 -- 172.21.15.33:0/2090248683 shutdown_connections 2024-09-12T12:27:57.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.068+0000 7f5da1abe740 1 --2- 172.21.15.33:0/2090248683 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55a9158a4050 0x55a9158a6440 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.068+0000 7f5da1abe740 1 --2- 172.21.15.33:0/2090248683 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a915894680 0x55a915891760 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.068+0000 7f5da1abe740 1 --2- 172.21.15.33:0/2090248683 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a915889dc0 0x55a915891220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.068+0000 7f5da1abe740 1 --2- 172.21.15.33:0/2090248683 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a9158894a0 0x55a915893f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.068+0000 7f5da1abe740 1 -- 172.21.15.33:0/2090248683 >> 172.21.15.33:0/2090248683 conn(0x55a915885a30 msgr2=0x55a915884b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:57.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.068+0000 7f5d80ff9640 0 client.15537 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:27:57.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.069+0000 7f5da1abe740 1 -- 172.21.15.33:0/2090248683 shutdown_connections 2024-09-12T12:27:57.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.069+0000 7f5da1abe740 1 -- 172.21.15.33:0/2090248683 wait complete. 2024-09-12T12:27:57.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.069+0000 7f5da1abe740 20 client.15537 trim_cache size 0 max 16384 2024-09-12T12:27:57.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.095+0000 7f5da1abe740 1 Processor -- start 2024-09-12T12:27:57.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.095+0000 7f5da1abe740 1 -- start start 2024-09-12T12:27:57.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.095+0000 7f5da1abe740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a9158894a0 0x55a9158a0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:57.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.095+0000 7f5da1abe740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a915889dc0 0x55a915890160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:57.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.095+0000 7f5da1abe740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a915894680 0x55a9158abc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:57.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.095+0000 7f5da1abe740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5d7c012410 con 0x55a9158894a0 2024-09-12T12:27:57.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.095+0000 7f5da1abe740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5d7c00fce0 con 0x55a915889dc0 2024-09-12T12:27:57.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.095+0000 7f5da1abe740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5d7c00db30 con 0x55a915894680 2024-09-12T12:27:57.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.096+0000 7f5d9d481640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a9158894a0 0x55a9158a0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:57.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.096+0000 7f5d9d481640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a9158894a0 0x55a9158a0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40816/0 (socket says 172.21.15.33:40816) 2024-09-12T12:27:57.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.096+0000 7f5d9d481640 1 -- 172.21.15.33:0/2736539123 learned_addr learned my addr 172.21.15.33:0/2736539123 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:27:57.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.096+0000 7f5d9cc80640 1 --2- 172.21.15.33:0/2736539123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a915889dc0 0x55a915890160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:57.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.096+0000 7f5d9dc82640 1 --2- 172.21.15.33:0/2736539123 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a915894680 0x55a9158abc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:57.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.096+0000 7f5d9cc80640 1 -- 172.21.15.33:0/2736539123 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a915894680 msgr2=0x55a9158abc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:57.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.096+0000 7f5d9cc80640 1 --2- 172.21.15.33:0/2736539123 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a915894680 0x55a9158abc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.096+0000 7f5d9cc80640 1 -- 172.21.15.33:0/2736539123 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a9158894a0 msgr2=0x55a9158a0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:57.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.096+0000 7f5d9cc80640 1 --2- 172.21.15.33:0/2736539123 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a9158894a0 0x55a9158a0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.096+0000 7f5d9cc80640 1 -- 172.21.15.33:0/2736539123 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a915889bf0 con 0x55a915889dc0 2024-09-12T12:27:57.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.096+0000 7f5d9dc82640 1 --2- 172.21.15.33:0/2736539123 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a915894680 0x55a9158abc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:27:57.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.096+0000 7f5d9cc80640 1 --2- 172.21.15.33:0/2736539123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a915889dc0 0x55a915890160 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5d88035040 tx=0x7f5d88030c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2fbb6ea8b60691 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:57.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.097+0000 7f5d82ffd640 1 -- 172.21.15.33:0/2736539123 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d88037040 con 0x55a915889dc0 2024-09-12T12:27:57.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.097+0000 7f5d82ffd640 1 -- 172.21.15.33:0/2736539123 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5d88038040 con 0x55a915889dc0 2024-09-12T12:27:57.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.097+0000 7f5d82ffd640 1 -- 172.21.15.33:0/2736539123 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d88003850 con 0x55a915889dc0 2024-09-12T12:27:57.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.097+0000 7f5da1abe740 1 -- 172.21.15.33:0/2736539123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a915889dc0 msgr2=0x55a915890160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:57.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.097+0000 7f5da1abe740 1 --2- 172.21.15.33:0/2736539123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a915889dc0 0x55a915890160 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5d88035040 tx=0x7f5d88030c00 comp rx=0 tx=0).stop 2024-09-12T12:27:57.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.098+0000 7f5da1abe740 1 -- 172.21.15.33:0/2736539123 shutdown_connections 2024-09-12T12:27:57.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.098+0000 7f5da1abe740 1 --2- 172.21.15.33:0/2736539123 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a915894680 0x55a9158abc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.098+0000 7f5da1abe740 1 --2- 172.21.15.33:0/2736539123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a915889dc0 0x55a915890160 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.098+0000 7f5da1abe740 1 --2- 172.21.15.33:0/2736539123 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a9158894a0 0x55a9158a0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.098+0000 7f5da1abe740 1 -- 172.21.15.33:0/2736539123 >> 172.21.15.33:0/2736539123 conn(0x55a915885a30 msgr2=0x55a91588b710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:57.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.098+0000 7f5da1abe740 1 -- 172.21.15.33:0/2736539123 shutdown_connections 2024-09-12T12:27:57.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.098+0000 7f5da1abe740 1 -- 172.21.15.33:0/2736539123 wait complete. 2024-09-12T12:27:57.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.098+0000 7f5da1abe740 1 -- start start 2024-09-12T12:27:57.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.098+0000 7f5da1abe740 1 Processor -- start 2024-09-12T12:27:57.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.099+0000 7f5da1abe740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a9158894a0 0x55a91589cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:57.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.099+0000 7f5da1abe740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a915889dc0 0x55a91588def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:57.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.099+0000 7f5da1abe740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a915894680 0x55a91588e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:57.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.099+0000 7f5d9dc82640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a915894680 0x55a91588e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:57.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.099+0000 7f5da1abe740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5d7c00e1a0 con 0x55a915894680 2024-09-12T12:27:57.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.099+0000 7f5d9cc80640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a915889dc0 0x55a91588def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:57.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.099+0000 7f5d9d481640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a9158894a0 0x55a91589cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:57.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.099+0000 7f5da1abe740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5d7c00f610 con 0x55a9158894a0 2024-09-12T12:27:57.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.099+0000 7f5d9dc82640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a915894680 0x55a91588e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40818/0 (socket says 172.21.15.33:40818) 2024-09-12T12:27:57.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.099+0000 7f5d9dc82640 1 -- 172.21.15.33:0/954538033 learned_addr learned my addr 172.21.15.33:0/954538033 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:27:57.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.099+0000 7f5da1abe740 1 -- 172.21.15.33:0/954538033 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5d7c00e870 con 0x55a915889dc0 2024-09-12T12:27:57.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.099+0000 7f5da1abe740 10 client.0 _ll_register_callbacks cb 0x7f5d900972a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:27:57.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.100+0000 7f5d9d481640 1 -- 172.21.15.33:0/954538033 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a915889dc0 msgr2=0x55a91588def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:57.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.100+0000 7f5d9d481640 1 --2- 172.21.15.33:0/954538033 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a915889dc0 0x55a91588def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.100+0000 7f5d9d481640 1 -- 172.21.15.33:0/954538033 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a915894680 msgr2=0x55a91588e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:57.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.100+0000 7f5d9d481640 1 --2- 172.21.15.33:0/954538033 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a915894680 0x55a91588e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.100+0000 7f5d9d481640 1 -- 172.21.15.33:0/954538033 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a91588ec60 con 0x55a9158894a0 2024-09-12T12:27:57.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.100+0000 7f5d9d481640 1 --2- 172.21.15.33:0/954538033 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a9158894a0 0x55a91589cdc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5d940105b0 tx=0x7f5d94011dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7481fbb331615c24 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:57.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.100+0000 7f5d80ff9640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:27:57.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.100+0000 7f5d80ff9640 1 -- 172.21.15.33:0/954538033 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d94022030 con 0x55a9158894a0 2024-09-12T12:27:57.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.100+0000 7f5d80ff9640 1 -- 172.21.15.33:0/954538033 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f5d94005550 con 0x55a9158894a0 2024-09-12T12:27:57.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.100+0000 7f5da1abe740 1 -- 172.21.15.33:0/954538033 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d88038040 con 0x55a9158894a0 2024-09-12T12:27:57.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.100+0000 7f5d80ff9640 1 -- 172.21.15.33:0/954538033 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5d94045050 con 0x55a9158894a0 2024-09-12T12:27:57.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.100+0000 7f5da1abe740 10 client.25175 fetch_fsmap learned FSMap version 26 2024-09-12T12:27:57.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.100+0000 7f5da1abe740 1 -- 172.21.15.33:0/954538033 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a91590eb50 con 0x55a9158894a0 2024-09-12T12:27:57.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.101+0000 7f5d80ff9640 1 -- 172.21.15.33:0/954538033 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5d88038040 con 0x55a9158894a0 2024-09-12T12:27:57.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.101+0000 7f5d80ff9640 1 -- 172.21.15.33:0/954538033 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f5d94010a00 con 0x55a9158894a0 2024-09-12T12:27:57.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.101+0000 7f5da1abe740 10 client.25175 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:27:57.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.101+0000 7f5da1abe740 10 client.25175 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:27:57.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.101+0000 7f5da1abe740 20 client.25175 populate_metadata read hostname 'smithi033' 2024-09-12T12:27:57.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.101+0000 7f5da1abe740 1 --2- 172.21.15.33:0/954538033 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55a91590eff0 0x55a9159113e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:57.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.101+0000 7f5da1abe740 4 client.25175 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:27:57.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.101+0000 7f5da1abe740 1 -- 172.21.15.33:0/954538033 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a915773210 con 0x55a91590eff0 2024-09-12T12:27:57.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.101+0000 7f5d9cc80640 1 --2- 172.21.15.33:0/954538033 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55a91590eff0 0x55a9159113e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:57.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.102+0000 7f5d80ff9640 10 client.25175 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:27:57.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.102+0000 7f5d9cc80640 1 --2- 172.21.15.33:0/954538033 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55a91590eff0 0x55a9159113e0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2d5f54f4e63ae2d server_cookie=8edde73cd97b2b2 in_seq=0 out_seq=0 2024-09-12T12:27:57.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.102+0000 7f5d80ff9640 1 -- 172.21.15.33:0/954538033 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55a915773210 con 0x55a91590eff0 2024-09-12T12:27:57.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.102+0000 7f5d80ff9640 10 client.25175 handle_command_reply: tid=0 2024-09-12T12:27:57.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.102+0000 7f5da1abe740 1 client.25175 shutdown 2024-09-12T12:27:57.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.102+0000 7f5da1abe740 1 -- 172.21.15.33:0/954538033 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a9158894a0 msgr2=0x55a91589cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:57.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.102+0000 7f5da1abe740 1 --2- 172.21.15.33:0/954538033 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a9158894a0 0x55a91589cdc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5d940105b0 tx=0x7f5d94011dd0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.102+0000 7f5da1abe740 1 -- 172.21.15.33:0/954538033 shutdown_connections 2024-09-12T12:27:57.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.102+0000 7f5da1abe740 1 --2- 172.21.15.33:0/954538033 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55a91590eff0 0x55a9159113e0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.103+0000 7f5da1abe740 1 --2- 172.21.15.33:0/954538033 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a915894680 0x55a91588e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.103+0000 7f5da1abe740 1 --2- 172.21.15.33:0/954538033 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a915889dc0 0x55a91588def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.103+0000 7f5da1abe740 1 --2- 172.21.15.33:0/954538033 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a9158894a0 0x55a91589cdc0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.103+0000 7f5da1abe740 1 -- 172.21.15.33:0/954538033 >> 172.21.15.33:0/954538033 conn(0x55a915885a30 msgr2=0x55a915892a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:57.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.103+0000 7f5d80ff9640 0 client.25175 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:27:57.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.103+0000 7f5da1abe740 1 -- 172.21.15.33:0/954538033 shutdown_connections 2024-09-12T12:27:57.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.103+0000 7f5da1abe740 1 -- 172.21.15.33:0/954538033 wait complete. 2024-09-12T12:27:57.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.103+0000 7f5da1abe740 20 client.25175 trim_cache size 0 max 16384 2024-09-12T12:27:57.109 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:27:57.109 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T12:27:57.109 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": { 2024-09-12T12:27:57.110 INFO:teuthology.orchestra.run.smithi033.stdout: "2749bc48-d6dc-41c8-a9d0-fd31ca8cfb09": { 2024-09-12T12:27:57.110 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-09-12T12:27:57.110 INFO:teuthology.orchestra.run.smithi033.stdout: "tag": "2749bc48-d6dc-41c8-a9d0-fd31ca8cfb09", 2024-09-12T12:27:57.110 INFO:teuthology.orchestra.run.smithi033.stdout: "options": "recursive,force" 2024-09-12T12:27:57.110 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:27:57.110 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:27:57.110 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:27:57.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.104+0000 7f5d9f6e5640 1 -- 172.21.15.33:0/3026185027 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f5d840a2b80 msgr2=0x7f5d840a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:57.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.104+0000 7f5d9f6e5640 1 --2- 172.21.15.33:0/3026185027 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f5d840a2b80 0x7f5d840a5040 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5d94005fd0 tx=0x7f5d9400b590 comp rx=0 tx=0).stop 2024-09-12T12:27:57.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.104+0000 7f5d9f6e5640 1 -- 172.21.15.33:0/3026185027 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d98108290 msgr2=0x7f5d98104690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:57.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.104+0000 7f5d9f6e5640 1 --2- 172.21.15.33:0/3026185027 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d98108290 0x7f5d98104690 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f5d9000c370 tx=0x7f5d9000c830 comp rx=0 tx=0).stop 2024-09-12T12:27:57.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.104+0000 7f5d9f6e5640 1 -- 172.21.15.33:0/3026185027 shutdown_connections 2024-09-12T12:27:57.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.104+0000 7f5d9f6e5640 1 --2- 172.21.15.33:0/3026185027 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f5d840a2b80 0x7f5d840a5040 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.104+0000 7f5d9f6e5640 1 --2- 172.21.15.33:0/3026185027 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d98108290 0x7f5d98104690 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.104+0000 7f5d9f6e5640 1 --2- 172.21.15.33:0/3026185027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d98103740 0x7f5d98104150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.104+0000 7f5d9f6e5640 1 --2- 172.21.15.33:0/3026185027 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d98102d90 0x7f5d98103c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:57.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.104+0000 7f5d9f6e5640 1 -- 172.21.15.33:0/3026185027 >> 172.21.15.33:0/3026185027 conn(0x7f5d980fc7d0 msgr2=0x7f5d98100e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:57.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.104+0000 7f5d9f6e5640 1 -- 172.21.15.33:0/3026185027 shutdown_connections 2024-09-12T12:27:57.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:27:57.104+0000 7f5d9f6e5640 1 -- 172.21.15.33:0/3026185027 wait complete. 2024-09-12T12:27:57.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:57 smithi043 ceph-mon[34144]: pgmap v408: 129 pgs: 129 active+clean; 5.4 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 112 MiB/s wr, 61 op/s 2024-09-12T12:27:57.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:57 smithi102 ceph-mon[34799]: pgmap v408: 129 pgs: 129 active+clean; 5.4 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 112 MiB/s wr, 61 op/s 2024-09-12T12:27:57.980 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:57 smithi033 ceph-mon[31246]: pgmap v408: 129 pgs: 129 active+clean; 5.4 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 112 MiB/s wr, 61 op/s 2024-09-12T12:27:58.072 INFO:tasks.cephfs.filesystem:scrub status for tag:2749bc48-d6dc-41c8-a9d0-fd31ca8cfb09 - {'path': '/', 'tag': '2749bc48-d6dc-41c8-a9d0-fd31ca8cfb09', 'options': 'recursive,force'} 2024-09-12T12:27:59.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:27:59 smithi043 ceph-mon[34144]: pgmap v409: 129 pgs: 129 active+clean; 6.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 162 MiB/s wr, 88 op/s 2024-09-12T12:27:59.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:27:59 smithi102 ceph-mon[34799]: pgmap v409: 129 pgs: 129 active+clean; 6.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 162 MiB/s wr, 88 op/s 2024-09-12T12:27:59.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:27:59 smithi033 ceph-mon[31246]: pgmap v409: 129 pgs: 129 active+clean; 6.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 162 MiB/s wr, 88 op/s 2024-09-12T12:28:01.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:28:01 smithi043 ceph-mon[34144]: pgmap v410: 129 pgs: 129 active+clean; 6.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 134 MiB/s wr, 74 op/s 2024-09-12T12:28:01.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:28:01 smithi102 ceph-mon[34799]: pgmap v410: 129 pgs: 129 active+clean; 6.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 134 MiB/s wr, 74 op/s 2024-09-12T12:28:01.980 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:28:01 smithi033 ceph-mon[31246]: pgmap v410: 129 pgs: 129 active+clean; 6.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 134 MiB/s wr, 74 op/s 2024-09-12T12:28:03.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:28:03 smithi043 ceph-mon[34144]: pgmap v411: 129 pgs: 129 active+clean; 6.4 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 141 MiB/s wr, 76 op/s 2024-09-12T12:28:03.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:28:03 smithi043 ceph-mon[34144]: scrub summary: idle 2024-09-12T12:28:03.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:28:03 smithi043 ceph-mon[34144]: scrub summary: idle 2024-09-12T12:28:03.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:28:03 smithi102 ceph-mon[34799]: pgmap v411: 129 pgs: 129 active+clean; 6.4 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 141 MiB/s wr, 76 op/s 2024-09-12T12:28:03.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:28:03 smithi102 ceph-mon[34799]: scrub summary: idle 2024-09-12T12:28:03.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:28:03 smithi102 ceph-mon[34799]: scrub summary: idle 2024-09-12T12:28:03.980 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:28:03 smithi033 ceph-mon[31246]: pgmap v411: 129 pgs: 129 active+clean; 6.4 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 141 MiB/s wr, 76 op/s 2024-09-12T12:28:03.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:28:03 smithi033 ceph-mon[31246]: scrub summary: idle 2024-09-12T12:28:03.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:28:03 smithi033 ceph-mon[31246]: scrub summary: idle 2024-09-12T12:28:05.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:28:05 smithi043 ceph-mon[34144]: pgmap v412: 129 pgs: 129 active+clean; 7.0 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 167 MiB/s wr, 91 op/s 2024-09-12T12:28:05.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:28:05 smithi102 ceph-mon[34799]: pgmap v412: 129 pgs: 129 active+clean; 7.0 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 167 MiB/s wr, 91 op/s 2024-09-12T12:28:05.980 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:28:05 smithi033 ceph-mon[31246]: pgmap v412: 129 pgs: 129 active+clean; 7.0 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 167 MiB/s wr, 91 op/s 2024-09-12T12:28:07.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:28:07 smithi043 ceph-mon[34144]: pgmap v413: 129 pgs: 129 active+clean; 7.0 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 135 MiB/s wr, 73 op/s 2024-09-12T12:28:07.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:28:07 smithi102 ceph-mon[34799]: pgmap v413: 129 pgs: 129 active+clean; 7.0 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 135 MiB/s wr, 73 op/s 2024-09-12T12:28:07.980 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:28:07 smithi033 ceph-mon[31246]: pgmap v413: 129 pgs: 129 active+clean; 7.0 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 135 MiB/s wr, 73 op/s 2024-09-12T12:28:09.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:28:09 smithi043 ceph-mon[34144]: pgmap v414: 129 pgs: 129 active+clean; 7.6 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 187 MiB/s wr, 100 op/s 2024-09-12T12:28:09.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:28:09 smithi102 ceph-mon[34799]: pgmap v414: 129 pgs: 129 active+clean; 7.6 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 187 MiB/s wr, 100 op/s 2024-09-12T12:28:09.980 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:28:09 smithi033 ceph-mon[31246]: pgmap v414: 129 pgs: 129 active+clean; 7.6 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 187 MiB/s wr, 100 op/s 2024-09-12T12:28:11.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:28:11 smithi043 ceph-mon[34144]: pgmap v415: 129 pgs: 129 active+clean; 7.8 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 153 MiB/s wr, 83 op/s 2024-09-12T12:28:11.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:28:11 smithi102 ceph-mon[34799]: pgmap v415: 129 pgs: 129 active+clean; 7.8 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 153 MiB/s wr, 83 op/s 2024-09-12T12:28:11.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:28:11 smithi033 ceph-mon[31246]: pgmap v415: 129 pgs: 129 active+clean; 7.8 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 153 MiB/s wr, 83 op/s 2024-09-12T12:28:13.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:28:13 smithi043 ceph-mon[34144]: pgmap v416: 129 pgs: 129 active+clean; 8.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 168 MiB/s wr, 90 op/s 2024-09-12T12:28:13.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:28:13 smithi102 ceph-mon[34799]: pgmap v416: 129 pgs: 129 active+clean; 8.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 168 MiB/s wr, 90 op/s 2024-09-12T12:28:13.980 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:28:13 smithi033 ceph-mon[31246]: pgmap v416: 129 pgs: 129 active+clean; 8.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 168 MiB/s wr, 90 op/s 2024-09-12T12:28:15.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:28:15 smithi043 ceph-mon[34144]: pgmap v417: 129 pgs: 129 active+clean; 8.6 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 184 MiB/s wr, 100 op/s 2024-09-12T12:28:15.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:28:15 smithi102 ceph-mon[34799]: pgmap v417: 129 pgs: 129 active+clean; 8.6 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 184 MiB/s wr, 100 op/s 2024-09-12T12:28:15.980 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:28:15 smithi033 ceph-mon[31246]: pgmap v417: 129 pgs: 129 active+clean; 8.6 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 184 MiB/s wr, 100 op/s 2024-09-12T12:28:18.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:28:17 smithi043 ceph-mon[34144]: pgmap v418: 129 pgs: 129 active+clean; 8.6 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 136 MiB/s wr, 73 op/s 2024-09-12T12:28:18.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:28:17 smithi102 ceph-mon[34799]: pgmap v418: 129 pgs: 129 active+clean; 8.6 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 136 MiB/s wr, 73 op/s 2024-09-12T12:28:18.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:28:17 smithi033 ceph-mon[31246]: pgmap v418: 129 pgs: 129 active+clean; 8.6 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 136 MiB/s wr, 73 op/s 2024-09-12T12:28:20.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:28:19 smithi043 ceph-mon[34144]: pgmap v419: 129 pgs: 129 active+clean; 9.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 189 MiB/s wr, 101 op/s 2024-09-12T12:28:20.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:28:19 smithi102 ceph-mon[34799]: pgmap v419: 129 pgs: 129 active+clean; 9.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 189 MiB/s wr, 101 op/s 2024-09-12T12:28:20.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:28:19 smithi033 ceph-mon[31246]: pgmap v419: 129 pgs: 129 active+clean; 9.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 189 MiB/s wr, 101 op/s 2024-09-12T12:28:22.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:28:21 smithi043 ceph-mon[34144]: pgmap v420: 129 pgs: 129 active+clean; 9.3 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 149 MiB/s wr, 81 op/s 2024-09-12T12:28:22.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:28:21 smithi102 ceph-mon[34799]: pgmap v420: 129 pgs: 129 active+clean; 9.3 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 149 MiB/s wr, 81 op/s 2024-09-12T12:28:22.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:28:21 smithi033 ceph-mon[31246]: pgmap v420: 129 pgs: 129 active+clean; 9.3 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 149 MiB/s wr, 81 op/s 2024-09-12T12:28:24.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:28:23 smithi043 ceph-mon[34144]: pgmap v421: 129 pgs: 129 active+clean; 9.6 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 159 MiB/s wr, 90 op/s 2024-09-12T12:28:24.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:28:23 smithi102 ceph-mon[34799]: pgmap v421: 129 pgs: 129 active+clean; 9.6 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 159 MiB/s wr, 90 op/s 2024-09-12T12:28:24.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:28:23 smithi033 ceph-mon[31246]: pgmap v421: 129 pgs: 129 active+clean; 9.6 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 159 MiB/s wr, 90 op/s 2024-09-12T12:28:25.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:28:24 smithi102 ceph-mon[34799]: pgmap v422: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 164 MiB/s wr, 167 op/s 2024-09-12T12:28:25.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:28:24 smithi033 ceph-mon[31246]: pgmap v422: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 164 MiB/s wr, 167 op/s 2024-09-12T12:28:25.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:28:24 smithi043 ceph-mon[34144]: pgmap v422: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 164 MiB/s wr, 167 op/s 2024-09-12T12:28:27.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:28:27 smithi043 ceph-mon[34144]: pgmap v423: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 126 MiB/s wr, 146 op/s 2024-09-12T12:28:27.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:28:27 smithi102 ceph-mon[34799]: pgmap v423: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 126 MiB/s wr, 146 op/s 2024-09-12T12:28:27.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:28:27 smithi033 ceph-mon[31246]: pgmap v423: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 126 MiB/s wr, 146 op/s 2024-09-12T12:28:28.073 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T12:28:28.491 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:28:29.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.120+0000 7f00439a6640 1 -- 172.21.15.33:0/3889924219 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f003c102790 msgr2=0x7f003c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:29.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.120+0000 7f00439a6640 1 --2- 172.21.15.33:0/3889924219 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f003c102790 0x7f003c1067e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f002c009900 tx=0x7f002c02a410 comp rx=0 tx=0).stop 2024-09-12T12:28:29.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.120+0000 7f00439a6640 1 -- 172.21.15.33:0/3889924219 shutdown_connections 2024-09-12T12:28:29.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.120+0000 7f00439a6640 1 --2- 172.21.15.33:0/3889924219 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f003c106f10 0x7f003c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:29.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.120+0000 7f00439a6640 1 --2- 172.21.15.33:0/3889924219 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f003c102790 0x7f003c1067e0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:29.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.120+0000 7f00439a6640 1 --2- 172.21.15.33:0/3889924219 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f003c101de0 0x7f003c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:29.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.120+0000 7f00439a6640 1 -- 172.21.15.33:0/3889924219 >> 172.21.15.33:0/3889924219 conn(0x7f003c0fd8e0 msgr2=0x7f003c0ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:29.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.120+0000 7f00439a6640 1 -- 172.21.15.33:0/3889924219 shutdown_connections 2024-09-12T12:28:29.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.121+0000 7f00439a6640 1 -- 172.21.15.33:0/3889924219 wait complete. 2024-09-12T12:28:29.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.121+0000 7f00439a6640 1 Processor -- start 2024-09-12T12:28:29.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.123+0000 7f00439a6640 1 -- start start 2024-09-12T12:28:29.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.123+0000 7f00439a6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f003c101de0 0x7f003c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:29.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.123+0000 7f00439a6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f003c102790 0x7f003c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:29.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.123+0000 7f00439a6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f003c106f10 0x7f003c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:29.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.123+0000 7f00439a6640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f003c111e60 con 0x7f003c102790 2024-09-12T12:28:29.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.123+0000 7f00439a6640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f003c111ce0 con 0x7f003c101de0 2024-09-12T12:28:29.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.123+0000 7f00439a6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f003c111fe0 con 0x7f003c106f10 2024-09-12T12:28:29.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.124+0000 7f0041f43640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f003c106f10 0x7f003c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:29.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.124+0000 7f0041f43640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f003c106f10 0x7f003c074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:53506/0 (socket says 172.21.15.33:53506) 2024-09-12T12:28:29.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.124+0000 7f0041f43640 1 -- 172.21.15.33:0/3842571320 learned_addr learned my addr 172.21.15.33:0/3842571320 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:28:29.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.124+0000 7f0040f41640 1 --2- 172.21.15.33:0/3842571320 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f003c102790 0x7f003c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:29.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.124+0000 7f0041f43640 1 -- 172.21.15.33:0/3842571320 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f003c101de0 msgr2=0x7f003c0744f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T12:28:29.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.124+0000 7f0041f43640 1 --2- 172.21.15.33:0/3842571320 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f003c101de0 0x7f003c0744f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:29.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.124+0000 7f0041f43640 1 -- 172.21.15.33:0/3842571320 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f003c102790 msgr2=0x7f003c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:29.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.124+0000 7f0041f43640 1 --2- 172.21.15.33:0/3842571320 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f003c102790 0x7f003c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:29.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.124+0000 7f0041f43640 1 -- 172.21.15.33:0/3842571320 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f003c1a6990 con 0x7f003c106f10 2024-09-12T12:28:29.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.125+0000 7f0041f43640 1 --2- 172.21.15.33:0/3842571320 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f003c106f10 0x7f003c074f70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f003800d750 tx=0x7f003800dc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:29.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.125+0000 7f00327fc640 1 -- 172.21.15.33:0/3842571320 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0038017070 con 0x7f003c106f10 2024-09-12T12:28:29.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.125+0000 7f00439a6640 1 -- 172.21.15.33:0/3842571320 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f003c1a6c80 con 0x7f003c106f10 2024-09-12T12:28:29.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.125+0000 7f00327fc640 1 -- 172.21.15.33:0/3842571320 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f00380054d0 con 0x7f003c106f10 2024-09-12T12:28:29.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.126+0000 7f00439a6640 1 -- 172.21.15.33:0/3842571320 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f003c1a7190 con 0x7f003c106f10 2024-09-12T12:28:29.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.126+0000 7f00327fc640 1 -- 172.21.15.33:0/3842571320 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0038017070 con 0x7f003c106f10 2024-09-12T12:28:29.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.131+0000 7f00327fc640 1 -- 172.21.15.33:0/3842571320 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f00380049b0 con 0x7f003c106f10 2024-09-12T12:28:29.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.133+0000 7f00327fc640 1 --2- 172.21.15.33:0/3842571320 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f00280a2f90 0x7f00280a5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:29.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.134+0000 7f00327fc640 1 -- 172.21.15.33:0/3842571320 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f00380099d0 con 0x7f003c106f10 2024-09-12T12:28:29.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.135+0000 7f0041742640 1 --2- 172.21.15.33:0/3842571320 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f00280a2f90 0x7f00280a5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:29.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.135+0000 7f0045d7f740 1 Processor -- start 2024-09-12T12:28:29.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.135+0000 7f0045d7f740 1 -- start start 2024-09-12T12:28:29.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.135+0000 7f0045d7f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef7cb534a0 0x55ef7cb53880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:29.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.136+0000 7f0045d7f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef7cb53dc0 0x55ef7cb5e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:29.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.136+0000 7f0045d7f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7cb5e680 0x55ef7cb60a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:29.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.136+0000 7f0045d7f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55ef7cab92e0 con 0x55ef7cb5e680 2024-09-12T12:28:29.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.136+0000 7f0045d7f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ef7ca60ce0 con 0x55ef7cb534a0 2024-09-12T12:28:29.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.136+0000 7f0045d7f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ef7cab52a0 con 0x55ef7cb53dc0 2024-09-12T12:28:29.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.136+0000 7f0041f43640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7cb5e680 0x55ef7cb60a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:29.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.136+0000 7f0041f43640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7cb5e680 0x55ef7cb60a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51508/0 (socket says 172.21.15.33:51508) 2024-09-12T12:28:29.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.136+0000 7f0041f43640 1 -- 172.21.15.33:0/2166157687 learned_addr learned my addr 172.21.15.33:0/2166157687 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:28:29.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.136+0000 7f0041742640 1 --2- 172.21.15.33:0/2166157687 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef7cb534a0 0x55ef7cb53880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:29.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.136+0000 7f0041742640 1 --2- 172.21.15.33:0/3842571320 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f00280a2f90 0x7f00280a5450 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f003400abb0 tx=0x7f0034009250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:29.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.136+0000 7f0041f43640 1 -- 172.21.15.33:0/2166157687 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef7cb53dc0 msgr2=0x55ef7cb5e140 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:28:29.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.136+0000 7f0041f43640 1 --2- 172.21.15.33:0/2166157687 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef7cb53dc0 0x55ef7cb5e140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:29.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.136+0000 7f0041f43640 1 -- 172.21.15.33:0/2166157687 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef7cb534a0 msgr2=0x55ef7cb53880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:29.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.136+0000 7f0041f43640 1 --2- 172.21.15.33:0/2166157687 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef7cb534a0 0x55ef7cb53880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:29.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.136+0000 7f0041f43640 1 -- 172.21.15.33:0/2166157687 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef7ca45440 con 0x55ef7cb5e680 2024-09-12T12:28:29.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.136+0000 7f0041742640 1 --2- 172.21.15.33:0/2166157687 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef7cb534a0 0x55ef7cb53880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:28:29.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.137+0000 7f0041f43640 1 --2- 172.21.15.33:0/2166157687 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7cb5e680 0x55ef7cb60a70 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f003809a2b0 tx=0x7f003809acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9a8a5d7b7a0e831 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:29.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.137+0000 7f00277fe640 1 -- 172.21.15.33:0/2166157687 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0038017070 con 0x55ef7cb5e680 2024-09-12T12:28:29.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.138+0000 7f00277fe640 1 -- 172.21.15.33:0/2166157687 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f00380054d0 con 0x55ef7cb5e680 2024-09-12T12:28:29.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.138+0000 7f00277fe640 1 -- 172.21.15.33:0/2166157687 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00380a2d00 con 0x55ef7cb5e680 2024-09-12T12:28:29.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.139+0000 7f0045d7f740 1 -- 172.21.15.33:0/2166157687 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7cb5e680 msgr2=0x55ef7cb60a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:29.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.139+0000 7f0045d7f740 1 --2- 172.21.15.33:0/2166157687 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7cb5e680 0x55ef7cb60a70 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f003809a2b0 tx=0x7f003809acb0 comp rx=0 tx=0).stop 2024-09-12T12:28:29.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.139+0000 7f0045d7f740 1 -- 172.21.15.33:0/2166157687 shutdown_connections 2024-09-12T12:28:29.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.139+0000 7f0045d7f740 1 --2- 172.21.15.33:0/2166157687 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7cb5e680 0x55ef7cb60a70 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:29.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.139+0000 7f0045d7f740 1 --2- 172.21.15.33:0/2166157687 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef7cb53dc0 0x55ef7cb5e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:29.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.139+0000 7f0045d7f740 1 --2- 172.21.15.33:0/2166157687 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef7cb534a0 0x55ef7cb53880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:29.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.139+0000 7f0045d7f740 1 -- 172.21.15.33:0/2166157687 >> 172.21.15.33:0/2166157687 conn(0x55ef7cb4fa30 msgr2=0x55ef7cb4fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:29.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.139+0000 7f0045d7f740 1 -- 172.21.15.33:0/2166157687 shutdown_connections 2024-09-12T12:28:29.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.139+0000 7f0045d7f740 1 -- 172.21.15.33:0/2166157687 wait complete. 2024-09-12T12:28:29.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.139+0000 7f0045d7f740 1 -- start start 2024-09-12T12:28:29.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.140+0000 7f0045d7f740 1 Processor -- start 2024-09-12T12:28:29.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.140+0000 7f0045d7f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef7cb534a0 0x55ef7cb5df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:29.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.140+0000 7f0045d7f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef7cb53dc0 0x55ef7cb5b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:29.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.140+0000 7f0045d7f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7cb5e680 0x55ef7cb5b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:29.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.141+0000 7f0045d7f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55ef7cb69a50 con 0x55ef7cb5e680 2024-09-12T12:28:29.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.141+0000 7f0045d7f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ef7ca74050 con 0x55ef7cb534a0 2024-09-12T12:28:29.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.141+0000 7f0045d7f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ef7cb69bd0 con 0x55ef7cb53dc0 2024-09-12T12:28:29.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.141+0000 7f0045d7f740 10 client.0 _ll_register_callbacks cb 0x55ef7cab4160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:28:29.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.141+0000 7f0041742640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef7cb534a0 0x55ef7cb5df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:29.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.141+0000 7f0041742640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef7cb534a0 0x55ef7cb5df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:40162/0 (socket says 172.21.15.33:40162) 2024-09-12T12:28:29.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.141+0000 7f0041742640 1 -- 172.21.15.33:0/3600907251 learned_addr learned my addr 172.21.15.33:0/3600907251 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:28:29.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.141+0000 7f0040f41640 1 --2- 172.21.15.33:0/3600907251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef7cb53dc0 0x55ef7cb5b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:29.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.141+0000 7f0041f43640 1 --2- 172.21.15.33:0/3600907251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7cb5e680 0x55ef7cb5b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:29.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.141+0000 7f0040f41640 1 -- 172.21.15.33:0/3600907251 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef7cb534a0 msgr2=0x55ef7cb5df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:29.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.141+0000 7f0040f41640 1 --2- 172.21.15.33:0/3600907251 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef7cb534a0 0x55ef7cb5df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:29.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.141+0000 7f0040f41640 1 -- 172.21.15.33:0/3600907251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7cb5e680 msgr2=0x55ef7cb5b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:29.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.141+0000 7f0040f41640 1 --2- 172.21.15.33:0/3600907251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7cb5e680 0x55ef7cb5b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:29.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.141+0000 7f0040f41640 1 -- 172.21.15.33:0/3600907251 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef7c82a3c0 con 0x55ef7cb53dc0 2024-09-12T12:28:29.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.141+0000 7f0041742640 1 --2- 172.21.15.33:0/3600907251 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef7cb534a0 0x55ef7cb5df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:28:29.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.142+0000 7f0040f41640 1 --2- 172.21.15.33:0/3600907251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef7cb53dc0 0x55ef7cb5b1f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f002c009230 tx=0x7f002c0316d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=723e888705f59ef server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:29.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.142+0000 7f0024ff9640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:28:29.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.142+0000 7f0024ff9640 1 -- 172.21.15.33:0/3600907251 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002c03f070 con 0x55ef7cb53dc0 2024-09-12T12:28:29.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.142+0000 7f0024ff9640 1 -- 172.21.15.33:0/3600907251 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f002c004240 con 0x55ef7cb53dc0 2024-09-12T12:28:29.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.142+0000 7f0045d7f740 1 -- 172.21.15.33:0/3600907251 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00380054d0 con 0x55ef7cb53dc0 2024-09-12T12:28:29.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.143+0000 7f0024ff9640 1 -- 172.21.15.33:0/3600907251 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f002c035070 con 0x55ef7cb53dc0 2024-09-12T12:28:29.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.143+0000 7f0045d7f740 10 client.25270 fetch_fsmap learned FSMap version 26 2024-09-12T12:28:29.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.143+0000 7f0045d7f740 1 -- 172.21.15.33:0/3600907251 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ef7cb61060 con 0x55ef7cb53dc0 2024-09-12T12:28:29.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.143+0000 7f0024ff9640 1 -- 172.21.15.33:0/3600907251 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f00380054d0 con 0x55ef7cb53dc0 2024-09-12T12:28:29.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.144+0000 7f0024ff9640 1 -- 172.21.15.33:0/3600907251 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f002c004a80 con 0x55ef7cb53dc0 2024-09-12T12:28:29.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.144+0000 7f0045d7f740 10 client.25270 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:28:29.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.144+0000 7f0045d7f740 10 client.25270 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:28:29.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.144+0000 7f0045d7f740 20 client.25270 populate_metadata read hostname 'smithi033' 2024-09-12T12:28:29.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.144+0000 7f0045d7f740 1 --2- 172.21.15.33:0/3600907251 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55ef7cb62520 0x55ef7cb64930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:29.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.144+0000 7f0045d7f740 4 client.25270 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:28:29.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.144+0000 7f0045d7f740 1 -- 172.21.15.33:0/3600907251 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ef7cac6850 con 0x55ef7cb62520 2024-09-12T12:28:29.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.144+0000 7f0041742640 1 --2- 172.21.15.33:0/3600907251 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55ef7cb62520 0x55ef7cb64930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:29.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.144+0000 7f0024ff9640 10 client.25270 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:28:29.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.145+0000 7f0041742640 1 --2- 172.21.15.33:0/3600907251 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55ef7cb62520 0x55ef7cb64930 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1b1af2dea07150 server_cookie=2ec2b74ca815d4e0 in_seq=0 out_seq=0 2024-09-12T12:28:29.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.146+0000 7f0024ff9640 1 -- 172.21.15.33:0/3600907251 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ef7cac6850 con 0x55ef7cb62520 2024-09-12T12:28:29.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.146+0000 7f0024ff9640 10 client.25270 handle_command_reply: tid=0 2024-09-12T12:28:29.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.146+0000 7f0045d7f740 1 client.25270 shutdown 2024-09-12T12:28:29.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.146+0000 7f0045d7f740 1 -- 172.21.15.33:0/3600907251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef7cb53dc0 msgr2=0x55ef7cb5b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:29.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.146+0000 7f0045d7f740 1 --2- 172.21.15.33:0/3600907251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef7cb53dc0 0x55ef7cb5b1f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f002c009230 tx=0x7f002c0316d0 comp rx=0 tx=0).stop 2024-09-12T12:28:29.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.146+0000 7f0045d7f740 1 -- 172.21.15.33:0/3600907251 shutdown_connections 2024-09-12T12:28:29.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.146+0000 7f0045d7f740 1 --2- 172.21.15.33:0/3600907251 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55ef7cb62520 0x55ef7cb64930 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:29.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.146+0000 7f0045d7f740 1 --2- 172.21.15.33:0/3600907251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7cb5e680 0x55ef7cb5b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:29.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.146+0000 7f0045d7f740 1 --2- 172.21.15.33:0/3600907251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef7cb53dc0 0x55ef7cb5b1f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:29.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.146+0000 7f0045d7f740 1 --2- 172.21.15.33:0/3600907251 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef7cb534a0 0x55ef7cb5df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:29.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.146+0000 7f0045d7f740 1 -- 172.21.15.33:0/3600907251 >> 172.21.15.33:0/3600907251 conn(0x55ef7cb4fa30 msgr2=0x55ef7cb55710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:29.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.146+0000 7f0024ff9640 0 client.25270 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:28:29.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.147+0000 7f0045d7f740 1 -- 172.21.15.33:0/3600907251 shutdown_connections 2024-09-12T12:28:29.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.147+0000 7f0045d7f740 1 -- 172.21.15.33:0/3600907251 wait complete. 2024-09-12T12:28:29.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.147+0000 7f0045d7f740 20 client.25270 trim_cache size 0 max 16384 2024-09-12T12:28:29.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.183+0000 7f0045d7f740 1 Processor -- start 2024-09-12T12:28:29.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.183+0000 7f0045d7f740 1 -- start start 2024-09-12T12:28:29.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.184+0000 7f0045d7f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7cb534a0 0x55ef7cb58450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:29.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.184+0000 7f0045d7f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef7cb53dc0 0x55ef7cb58990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:29.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.184+0000 7f0045d7f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef7cb5e680 0x55ef7cb54ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:29.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.184+0000 7f0045d7f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f003c1af380 con 0x55ef7cb534a0 2024-09-12T12:28:29.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.184+0000 7f0045d7f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f003c1acc50 con 0x55ef7cb53dc0 2024-09-12T12:28:29.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.184+0000 7f0045d7f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f003c1aaac0 con 0x55ef7cb5e680 2024-09-12T12:28:29.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.184+0000 7f0040f41640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef7cb53dc0 0x55ef7cb58990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:29.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.184+0000 7f0040f41640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef7cb53dc0 0x55ef7cb58990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:40166/0 (socket says 172.21.15.33:40166) 2024-09-12T12:28:29.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.184+0000 7f0040f41640 1 -- 172.21.15.33:0/2833541148 learned_addr learned my addr 172.21.15.33:0/2833541148 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:28:29.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.184+0000 7f0041f43640 1 --2- 172.21.15.33:0/2833541148 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef7cb5e680 0x55ef7cb54ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:29.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.184+0000 7f0041742640 1 --2- 172.21.15.33:0/2833541148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7cb534a0 0x55ef7cb58450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:29.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.184+0000 7f0040f41640 1 -- 172.21.15.33:0/2833541148 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef7cb5e680 msgr2=0x55ef7cb54ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:29.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.184+0000 7f0040f41640 1 --2- 172.21.15.33:0/2833541148 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef7cb5e680 0x55ef7cb54ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:29.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.184+0000 7f0040f41640 1 -- 172.21.15.33:0/2833541148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7cb534a0 msgr2=0x55ef7cb58450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:29.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.184+0000 7f0040f41640 1 --2- 172.21.15.33:0/2833541148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7cb534a0 0x55ef7cb58450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:29.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.184+0000 7f0040f41640 1 -- 172.21.15.33:0/2833541148 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef7cb5e2b0 con 0x55ef7cb53dc0 2024-09-12T12:28:29.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.185+0000 7f0040f41640 1 --2- 172.21.15.33:0/2833541148 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef7cb53dc0 0x55ef7cb58990 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f002c031a70 tx=0x7f002c009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6336fefdd29a7fe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:29.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.185+0000 7f0026ffd640 1 -- 172.21.15.33:0/2833541148 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002c03f070 con 0x55ef7cb53dc0 2024-09-12T12:28:29.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.186+0000 7f0026ffd640 1 -- 172.21.15.33:0/2833541148 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f002c004fa0 con 0x55ef7cb53dc0 2024-09-12T12:28:29.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.186+0000 7f0026ffd640 1 -- 172.21.15.33:0/2833541148 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002c0446a0 con 0x55ef7cb53dc0 2024-09-12T12:28:29.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.187+0000 7f0045d7f740 1 -- 172.21.15.33:0/2833541148 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef7cb53dc0 msgr2=0x55ef7cb58990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:29.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.187+0000 7f0045d7f740 1 --2- 172.21.15.33:0/2833541148 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef7cb53dc0 0x55ef7cb58990 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f002c031a70 tx=0x7f002c009260 comp rx=0 tx=0).stop 2024-09-12T12:28:29.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.187+0000 7f0045d7f740 1 -- 172.21.15.33:0/2833541148 shutdown_connections 2024-09-12T12:28:29.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.187+0000 7f0045d7f740 1 --2- 172.21.15.33:0/2833541148 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef7cb5e680 0x55ef7cb54ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:29.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.187+0000 7f0045d7f740 1 --2- 172.21.15.33:0/2833541148 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef7cb53dc0 0x55ef7cb58990 secure :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f002c031a70 tx=0x7f002c009260 comp rx=0 tx=0).stop 2024-09-12T12:28:29.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.187+0000 7f0045d7f740 1 --2- 172.21.15.33:0/2833541148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7cb534a0 0x55ef7cb58450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:29.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.187+0000 7f0045d7f740 1 -- 172.21.15.33:0/2833541148 >> 172.21.15.33:0/2833541148 conn(0x55ef7cb4fa30 msgr2=0x55ef7cb59ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:29.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.187+0000 7f0045d7f740 1 -- 172.21.15.33:0/2833541148 shutdown_connections 2024-09-12T12:28:29.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.187+0000 7f0045d7f740 1 -- 172.21.15.33:0/2833541148 wait complete. 2024-09-12T12:28:29.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.188+0000 7f0045d7f740 1 -- start start 2024-09-12T12:28:29.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.188+0000 7f0045d7f740 1 Processor -- start 2024-09-12T12:28:29.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.189+0000 7f0045d7f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef7cb534a0 0x55ef7cb77b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:29.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.189+0000 7f0045d7f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef7cb5e680 0x55ef7cb78040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:29.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.189+0000 7f0045d7f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7cb7a190 0x55ef7cb7a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:29.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.189+0000 7f0045d7f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f003c1ab110 con 0x55ef7cb7a190 2024-09-12T12:28:29.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.189+0000 7f0045d7f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f003c1ac580 con 0x55ef7cb5e680 2024-09-12T12:28:29.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.189+0000 7f0045d7f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f003c1ab7e0 con 0x55ef7cb534a0 2024-09-12T12:28:29.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.189+0000 7f0045d7f740 10 client.0 _ll_register_callbacks cb 0x7f002c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:28:29.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.189+0000 7f0041742640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef7cb534a0 0x55ef7cb77b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:29.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.189+0000 7f0041742640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef7cb534a0 0x55ef7cb77b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:53550/0 (socket says 172.21.15.33:53550) 2024-09-12T12:28:29.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.189+0000 7f0041742640 1 -- 172.21.15.33:0/2287076630 learned_addr learned my addr 172.21.15.33:0/2287076630 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:28:29.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.189+0000 7f0041f43640 1 --2- 172.21.15.33:0/2287076630 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7cb7a190 0x55ef7cb7a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:29.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.189+0000 7f0040f41640 1 --2- 172.21.15.33:0/2287076630 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef7cb5e680 0x55ef7cb78040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:29.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.189+0000 7f0041742640 1 -- 172.21.15.33:0/2287076630 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef7cb5e680 msgr2=0x55ef7cb78040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:29.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.189+0000 7f0041742640 1 --2- 172.21.15.33:0/2287076630 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef7cb5e680 0x55ef7cb78040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:29.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.189+0000 7f0041742640 1 -- 172.21.15.33:0/2287076630 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7cb7a190 msgr2=0x55ef7cb7a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:29.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.189+0000 7f0041742640 1 --2- 172.21.15.33:0/2287076630 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7cb7a190 0x55ef7cb7a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:29.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.189+0000 7f0041742640 1 -- 172.21.15.33:0/2287076630 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef7cb7ac00 con 0x55ef7cb534a0 2024-09-12T12:28:29.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.190+0000 7f0041742640 1 --2- 172.21.15.33:0/2287076630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef7cb534a0 0x55ef7cb77b00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x55ef7cb651a0 tx=0x7f0034004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=907bfd13365a403d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:29.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.190+0000 7f0024ff9640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:28:29.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.190+0000 7f0024ff9640 1 -- 172.21.15.33:0/2287076630 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0034018da0 con 0x55ef7cb534a0 2024-09-12T12:28:29.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.190+0000 7f0024ff9640 1 -- 172.21.15.33:0/2287076630 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f0034026480 con 0x55ef7cb534a0 2024-09-12T12:28:29.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.190+0000 7f0045d7f740 1 -- 172.21.15.33:0/2287076630 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f002c004fa0 con 0x55ef7cb534a0 2024-09-12T12:28:29.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.190+0000 7f0024ff9640 1 -- 172.21.15.33:0/2287076630 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0034039050 con 0x55ef7cb534a0 2024-09-12T12:28:29.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.191+0000 7f0045d7f740 10 client.25276 fetch_fsmap learned FSMap version 26 2024-09-12T12:28:29.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.191+0000 7f0045d7f740 1 -- 172.21.15.33:0/2287076630 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ef7cbd9330 con 0x55ef7cb534a0 2024-09-12T12:28:29.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.191+0000 7f0024ff9640 1 -- 172.21.15.33:0/2287076630 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f002c004fa0 con 0x55ef7cb534a0 2024-09-12T12:28:29.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.191+0000 7f0024ff9640 1 -- 172.21.15.33:0/2287076630 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f0034023050 con 0x55ef7cb534a0 2024-09-12T12:28:29.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.191+0000 7f0045d7f740 10 client.25276 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:28:29.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.191+0000 7f0045d7f740 10 client.25276 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:28:29.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.191+0000 7f0045d7f740 20 client.25276 populate_metadata read hostname 'smithi033' 2024-09-12T12:28:29.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.191+0000 7f0045d7f740 1 --2- 172.21.15.33:0/2287076630 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55ef7cbd9b10 0x55ef7cbdbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:29.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.191+0000 7f0045d7f740 4 client.25276 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:28:29.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.191+0000 7f0045d7f740 1 -- 172.21.15.33:0/2287076630 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ef7cac0d60 con 0x55ef7cbd9b10 2024-09-12T12:28:29.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.191+0000 7f0040f41640 1 --2- 172.21.15.33:0/2287076630 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55ef7cbd9b10 0x55ef7cbdbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:29.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.193+0000 7f0024ff9640 10 client.25276 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:28:29.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.193+0000 7f0040f41640 1 --2- 172.21.15.33:0/2287076630 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55ef7cbd9b10 0x55ef7cbdbf30 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3abadc0698cd2b2 server_cookie=34a896cefde83e26 in_seq=0 out_seq=0 2024-09-12T12:28:29.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.193+0000 7f0024ff9640 1 -- 172.21.15.33:0/2287076630 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ef7cac0d60 con 0x55ef7cbd9b10 2024-09-12T12:28:29.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.193+0000 7f0024ff9640 10 client.25276 handle_command_reply: tid=0 2024-09-12T12:28:29.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.193+0000 7f0045d7f740 1 client.25276 shutdown 2024-09-12T12:28:29.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.193+0000 7f0045d7f740 1 -- 172.21.15.33:0/2287076630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef7cb534a0 msgr2=0x55ef7cb77b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:29.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.193+0000 7f0045d7f740 1 --2- 172.21.15.33:0/2287076630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef7cb534a0 0x55ef7cb77b00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x55ef7cb651a0 tx=0x7f0034004ad0 comp rx=0 tx=0).stop 2024-09-12T12:28:29.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.193+0000 7f0045d7f740 1 -- 172.21.15.33:0/2287076630 shutdown_connections 2024-09-12T12:28:29.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.193+0000 7f0045d7f740 1 --2- 172.21.15.33:0/2287076630 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55ef7cbd9b10 0x55ef7cbdbf30 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:29.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.193+0000 7f0045d7f740 1 --2- 172.21.15.33:0/2287076630 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7cb7a190 0x55ef7cb7a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:29.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.193+0000 7f0045d7f740 1 --2- 172.21.15.33:0/2287076630 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef7cb5e680 0x55ef7cb78040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:29.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.193+0000 7f0045d7f740 1 --2- 172.21.15.33:0/2287076630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef7cb534a0 0x55ef7cb77b00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:29.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.193+0000 7f0045d7f740 1 -- 172.21.15.33:0/2287076630 >> 172.21.15.33:0/2287076630 conn(0x55ef7cb4fa30 msgr2=0x55ef7cb54ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:29.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.193+0000 7f0024ff9640 0 client.25276 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:28:29.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.194+0000 7f0045d7f740 1 -- 172.21.15.33:0/2287076630 shutdown_connections 2024-09-12T12:28:29.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.194+0000 7f0045d7f740 1 -- 172.21.15.33:0/2287076630 wait complete. 2024-09-12T12:28:29.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.194+0000 7f0045d7f740 20 client.25276 trim_cache size 0 max 16384 2024-09-12T12:28:29.196 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:28:29.196 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "no active scrubs running", 2024-09-12T12:28:29.196 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": {} 2024-09-12T12:28:29.196 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:28:29.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.195+0000 7f00439a6640 1 -- 172.21.15.33:0/3842571320 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f00280a2f90 msgr2=0x7f00280a5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:29.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.195+0000 7f00439a6640 1 --2- 172.21.15.33:0/3842571320 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f00280a2f90 0x7f00280a5450 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f003400abb0 tx=0x7f0034009250 comp rx=0 tx=0).stop 2024-09-12T12:28:29.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.195+0000 7f00439a6640 1 -- 172.21.15.33:0/3842571320 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f003c106f10 msgr2=0x7f003c074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:29.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.195+0000 7f00439a6640 1 --2- 172.21.15.33:0/3842571320 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f003c106f10 0x7f003c074f70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f003800d750 tx=0x7f003800dc10 comp rx=0 tx=0).stop 2024-09-12T12:28:29.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.195+0000 7f00439a6640 1 -- 172.21.15.33:0/3842571320 shutdown_connections 2024-09-12T12:28:29.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.195+0000 7f00439a6640 1 --2- 172.21.15.33:0/3842571320 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f00280a2f90 0x7f00280a5450 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:29.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.195+0000 7f00439a6640 1 --2- 172.21.15.33:0/3842571320 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f003c106f10 0x7f003c074f70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:29.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.195+0000 7f00439a6640 1 --2- 172.21.15.33:0/3842571320 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f003c102790 0x7f003c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:29.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.195+0000 7f00439a6640 1 --2- 172.21.15.33:0/3842571320 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f003c101de0 0x7f003c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:29.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.195+0000 7f00439a6640 1 -- 172.21.15.33:0/3842571320 >> 172.21.15.33:0/3842571320 conn(0x7f003c0fd8e0 msgr2=0x7f003c0fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:29.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.196+0000 7f00439a6640 1 -- 172.21.15.33:0/3842571320 shutdown_connections 2024-09-12T12:28:29.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:29.196+0000 7f00439a6640 1 -- 172.21.15.33:0/3842571320 wait complete. 2024-09-12T12:28:29.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:28:29 smithi033 ceph-mon[31246]: pgmap v424: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 147 MiB/s wr, 466 op/s 2024-09-12T12:28:29.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:28:29 smithi043 ceph-mon[34144]: pgmap v424: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 147 MiB/s wr, 466 op/s 2024-09-12T12:28:29.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:28:29 smithi102 ceph-mon[34799]: pgmap v424: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 147 MiB/s wr, 466 op/s 2024-09-12T12:28:30.168 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T12:28:30.169 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:28:30.637 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:28:31.077 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:28:31 smithi033 ceph-mon[31246]: pgmap v425: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 99 MiB/s wr, 531 op/s 2024-09-12T12:28:31.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.206+0000 7f3b9136a640 1 -- 172.21.15.33:0/3077977662 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b8c101270 msgr2=0x7f3b8c10d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:31.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.206+0000 7f3b9136a640 1 --2- 172.21.15.33:0/3077977662 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b8c101270 0x7f3b8c10d7a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3b84009cd0 tx=0x7f3b8402a8f0 comp rx=0 tx=0).stop 2024-09-12T12:28:31.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.206+0000 7f3b9136a640 1 -- 172.21.15.33:0/3077977662 shutdown_connections 2024-09-12T12:28:31.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.206+0000 7f3b9136a640 1 --2- 172.21.15.33:0/3077977662 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b8c101270 0x7f3b8c10d7a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:31.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.206+0000 7f3b9136a640 1 --2- 172.21.15.33:0/3077977662 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b8c1008d0 0x7f3b8c100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:31.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.206+0000 7f3b9136a640 1 --2- 172.21.15.33:0/3077977662 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b8c1068d0 0x7f3b8c106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:31.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.206+0000 7f3b9136a640 1 -- 172.21.15.33:0/3077977662 >> 172.21.15.33:0/3077977662 conn(0x7f3b8c0fc610 msgr2=0x7f3b8c0fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:31.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.206+0000 7f3b9136a640 1 -- 172.21.15.33:0/3077977662 shutdown_connections 2024-09-12T12:28:31.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.207+0000 7f3b9136a640 1 -- 172.21.15.33:0/3077977662 wait complete. 2024-09-12T12:28:31.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.208+0000 7f3b9136a640 1 Processor -- start 2024-09-12T12:28:31.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.208+0000 7f3b9136a640 1 -- start start 2024-09-12T12:28:31.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.208+0000 7f3b9136a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b8c1008d0 0x7f3b8c10c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:31.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.208+0000 7f3b9136a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b8c101270 0x7f3b8c10c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:31.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.208+0000 7f3b9136a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b8c1068d0 0x7f3b8c1a4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:31.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.208+0000 7f3b9136a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c10f560 con 0x7f3b8c1008d0 2024-09-12T12:28:31.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.208+0000 7f3b9136a640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c10f3e0 con 0x7f3b8c101270 2024-09-12T12:28:31.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.208+0000 7f3b9136a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c10f6e0 con 0x7f3b8c1068d0 2024-09-12T12:28:31.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.209+0000 7f3b90b69640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b8c1068d0 0x7f3b8c1a4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:31.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.209+0000 7f3b8bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b8c1008d0 0x7f3b8c10c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:31.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.209+0000 7f3b8bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b8c1008d0 0x7f3b8c10c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51912/0 (socket says 172.21.15.33:51912) 2024-09-12T12:28:31.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.209+0000 7f3b8bfff640 1 -- 172.21.15.33:0/3443498898 learned_addr learned my addr 172.21.15.33:0/3443498898 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:28:31.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.209+0000 7f3b8b7fe640 1 --2- 172.21.15.33:0/3443498898 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b8c101270 0x7f3b8c10c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:31.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.210+0000 7f3b8bfff640 1 -- 172.21.15.33:0/3443498898 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b8c1068d0 msgr2=0x7f3b8c1a4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:31.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.210+0000 7f3b8bfff640 1 --2- 172.21.15.33:0/3443498898 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b8c1068d0 0x7f3b8c1a4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:31.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.210+0000 7f3b8bfff640 1 -- 172.21.15.33:0/3443498898 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b8c101270 msgr2=0x7f3b8c10c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:31.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.210+0000 7f3b8bfff640 1 --2- 172.21.15.33:0/3443498898 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b8c101270 0x7f3b8c10c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:31.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.210+0000 7f3b8bfff640 1 -- 172.21.15.33:0/3443498898 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b8c1a4a30 con 0x7f3b8c1008d0 2024-09-12T12:28:31.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.210+0000 7f3b8bfff640 1 --2- 172.21.15.33:0/3443498898 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b8c1008d0 0x7f3b8c10c290 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c00b4a0 tx=0x7f3b7c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:31.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.213+0000 7f3b897fa640 1 -- 172.21.15.33:0/3443498898 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c014070 con 0x7f3b8c1008d0 2024-09-12T12:28:31.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.214+0000 7f3b897fa640 1 -- 172.21.15.33:0/3443498898 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3b7c010ac0 con 0x7f3b8c1008d0 2024-09-12T12:28:31.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.214+0000 7f3b897fa640 1 -- 172.21.15.33:0/3443498898 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c017be0 con 0x7f3b8c1008d0 2024-09-12T12:28:31.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.214+0000 7f3b9136a640 1 -- 172.21.15.33:0/3443498898 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b8c1a4d20 con 0x7f3b8c1008d0 2024-09-12T12:28:31.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.214+0000 7f3b9136a640 1 -- 172.21.15.33:0/3443498898 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b8c112d30 con 0x7f3b8c1008d0 2024-09-12T12:28:31.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.218+0000 7f3b897fa640 1 -- 172.21.15.33:0/3443498898 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3b7c017070 con 0x7f3b8c1008d0 2024-09-12T12:28:31.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.218+0000 7f3b9136a640 1 -- 172.21.15.33:0/3443498898 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b8c100d30 con 0x7f3b8c1008d0 2024-09-12T12:28:31.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.219+0000 7f3b897fa640 1 --2- 172.21.15.33:0/3443498898 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f3b740a2d50 0x7f3b740a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:31.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.220+0000 7f3b8b7fe640 1 --2- 172.21.15.33:0/3443498898 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f3b740a2d50 0x7f3b740a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:31.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.220+0000 7f3b897fa640 1 -- 172.21.15.33:0/3443498898 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f3b7c0ce7b0 con 0x7f3b8c1008d0 2024-09-12T12:28:31.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.224+0000 7f3b8b7fe640 1 --2- 172.21.15.33:0/3443498898 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f3b740a2d50 0x7f3b740a5210 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c104430 tx=0x7f3b80005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:31.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.229+0000 7f3b897fa640 1 -- 172.21.15.33:0/3443498898 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3b7c09b320 con 0x7f3b8c1008d0 2024-09-12T12:28:31.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:28:31 smithi043 ceph-mon[34144]: pgmap v425: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 99 MiB/s wr, 531 op/s 2024-09-12T12:28:31.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:28:31 smithi102 ceph-mon[34799]: pgmap v425: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 99 MiB/s wr, 531 op/s 2024-09-12T12:28:31.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.664+0000 7f3b9136a640 1 -- 172.21.15.33:0/3443498898 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3b8c113050 con 0x7f3b8c1008d0 2024-09-12T12:28:31.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.665+0000 7f3b897fa640 1 -- 172.21.15.33:0/3443498898 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11913 (secure 0 0 0) 0x7f3b7c09ac20 con 0x7f3b8c1008d0 2024-09-12T12:28:31.665 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:28:31.665 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":26,"btime":"2024-09-12T12:27:33:118378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3327066342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3327066342},{"type":"v1","addr":"172.21.15.33:6835","nonce":3327066342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/19516401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":19516401},{"type":"v1","addr":"172.21.15.33:6837","nonce":19516401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1260196118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1260196118},{"type":"v1","addr":"172.21.15.33:6839","nonce":1260196118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/4288248356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4288248356},{"type":"v1","addr":"172.21.15.33:6841","nonce":4288248356}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/3051073141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3051073141},{"type":"v1","addr":"172.21.15.43:6833","nonce":3051073141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3282762800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3282762800},{"type":"v1","addr":"172.21.15.43:6835","nonce":3282762800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:23:46.400609+0000","modified":"2024-09-12T12:27:32.553509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24490,"mds_2":24478},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3051713000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3051713000},{"type":"v1","addr":"172.21.15.102:6833","nonce":3051713000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6837/2472064883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2472064883},{"type":"v1","addr":"172.21.15.43:6837","nonce":2472064883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/1987408860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":1987408860},{"type":"v1","addr":"172.21.15.43:6839","nonce":1987408860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/4179527539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":4179527539},{"type":"v1","addr":"172.21.15.102:6835","nonce":4179527539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/2409953270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2409953270},{"type":"v1","addr":"172.21.15.102:6837","nonce":2409953270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.102:6839/1553271340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":1553271340},{"type":"v1","addr":"172.21.15.102:6839","nonce":1553271340}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24499,"qdb_cluster":[24478,24490,24499]},"id":1}]} 2024-09-12T12:28:31.666 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 26 2024-09-12T12:28:31.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.669+0000 7f3b9136a640 1 -- 172.21.15.33:0/3443498898 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f3b740a2d50 msgr2=0x7f3b740a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:31.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.669+0000 7f3b9136a640 1 --2- 172.21.15.33:0/3443498898 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f3b740a2d50 0x7f3b740a5210 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c104430 tx=0x7f3b80005f90 comp rx=0 tx=0).stop 2024-09-12T12:28:31.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.669+0000 7f3b9136a640 1 -- 172.21.15.33:0/3443498898 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b8c1008d0 msgr2=0x7f3b8c10c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:31.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.669+0000 7f3b9136a640 1 --2- 172.21.15.33:0/3443498898 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b8c1008d0 0x7f3b8c10c290 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c00b4a0 tx=0x7f3b7c00b960 comp rx=0 tx=0).stop 2024-09-12T12:28:31.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.669+0000 7f3b9136a640 1 -- 172.21.15.33:0/3443498898 shutdown_connections 2024-09-12T12:28:31.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.669+0000 7f3b9136a640 1 --2- 172.21.15.33:0/3443498898 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f3b740a2d50 0x7f3b740a5210 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:31.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.669+0000 7f3b9136a640 1 --2- 172.21.15.33:0/3443498898 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b8c1068d0 0x7f3b8c1a4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:31.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.669+0000 7f3b9136a640 1 --2- 172.21.15.33:0/3443498898 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b8c101270 0x7f3b8c10c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:31.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.669+0000 7f3b9136a640 1 --2- 172.21.15.33:0/3443498898 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b8c1008d0 0x7f3b8c10c290 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:31.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.669+0000 7f3b9136a640 1 -- 172.21.15.33:0/3443498898 >> 172.21.15.33:0/3443498898 conn(0x7f3b8c0fc610 msgr2=0x7f3b8c105b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:31.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.670+0000 7f3b9136a640 1 -- 172.21.15.33:0/3443498898 shutdown_connections 2024-09-12T12:28:31.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:31.670+0000 7f3b9136a640 1 -- 172.21.15.33:0/3443498898 wait complete. 2024-09-12T12:28:32.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:28:32 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/3443498898' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:28:32.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:28:32 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/3443498898' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:28:32.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:28:32 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/3443498898' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:28:33.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:28:33 smithi043 ceph-mon[34144]: pgmap v426: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 96 MiB/s wr, 659 op/s 2024-09-12T12:28:33.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:28:33 smithi102 ceph-mon[34799]: pgmap v426: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 96 MiB/s wr, 659 op/s 2024-09-12T12:28:33.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:28:33 smithi033 ceph-mon[31246]: pgmap v426: 129 pgs: 129 active+clean; 10 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 96 MiB/s wr, 659 op/s 2024-09-12T12:28:35.287 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:28:35 smithi033 ceph-mon[31246]: pgmap v427: 129 pgs: 129 active+clean; 10 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 84 MiB/s wr, 878 op/s 2024-09-12T12:28:35.289 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T12:28:35.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:28:35 smithi043 ceph-mon[34144]: pgmap v427: 129 pgs: 129 active+clean; 10 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 84 MiB/s wr, 878 op/s 2024-09-12T12:28:35.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:28:35 smithi102 ceph-mon[34799]: pgmap v427: 129 pgs: 129 active+clean; 10 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 84 MiB/s wr, 878 op/s 2024-09-12T12:28:35.758 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:28:36.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:36.993+0000 7f63511ae640 1 -- 172.21.15.33:0/3079450253 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f634c102570 msgr2=0x7f634c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:36.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:36.993+0000 7f63511ae640 1 --2- 172.21.15.33:0/3079450253 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f634c102570 0x7f634c1029b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6334009890 tx=0x7f633402a410 comp rx=0 tx=0).stop 2024-09-12T12:28:36.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:36.993+0000 7f63511ae640 1 -- 172.21.15.33:0/3079450253 shutdown_connections 2024-09-12T12:28:36.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:36.993+0000 7f63511ae640 1 --2- 172.21.15.33:0/3079450253 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f634c102ef0 0x7f634c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:36.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:36.993+0000 7f63511ae640 1 --2- 172.21.15.33:0/3079450253 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f634c102570 0x7f634c1029b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:36.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:36.993+0000 7f63511ae640 1 --2- 172.21.15.33:0/3079450253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f634c100e20 0x7f634c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:36.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:36.993+0000 7f63511ae640 1 -- 172.21.15.33:0/3079450253 >> 172.21.15.33:0/3079450253 conn(0x7f634c0fc7d0 msgr2=0x7f634c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:36.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:36.994+0000 7f63511ae640 1 -- 172.21.15.33:0/3079450253 shutdown_connections 2024-09-12T12:28:36.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:36.994+0000 7f63511ae640 1 -- 172.21.15.33:0/3079450253 wait complete. 2024-09-12T12:28:36.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:36.995+0000 7f63511ae640 1 Processor -- start 2024-09-12T12:28:36.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:36.995+0000 7f63511ae640 1 -- start start 2024-09-12T12:28:36.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:36.995+0000 7f63511ae640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f634c100e20 0x7f634c196050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:36.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:36.996+0000 7f63511ae640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f634c102570 0x7f634c196590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:36.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:36.996+0000 7f63511ae640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f634c102ef0 0x7f634c19a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:36.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:36.996+0000 7f634ad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f634c100e20 0x7f634c196050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:36.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:36.996+0000 7f63511ae640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f634c10fd30 con 0x7f634c100e20 2024-09-12T12:28:36.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:36.996+0000 7f63511ae640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f634c10fbb0 con 0x7f634c102ef0 2024-09-12T12:28:36.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:36.996+0000 7f63511ae640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f634c10feb0 con 0x7f634c102570 2024-09-12T12:28:36.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:36.996+0000 7f634b59e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f634c102ef0 0x7f634c19a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:36.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:36.996+0000 7f634b59e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f634c102ef0 0x7f634c19a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:49240/0 (socket says 172.21.15.33:49240) 2024-09-12T12:28:36.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:36.996+0000 7f634b59e640 1 -- 172.21.15.33:0/49750930 learned_addr learned my addr 172.21.15.33:0/49750930 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:28:36.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:36.996+0000 7f634a59c640 1 --2- 172.21.15.33:0/49750930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f634c102570 0x7f634c196590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:36.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:36.997+0000 7f634b59e640 1 -- 172.21.15.33:0/49750930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f634c102570 msgr2=0x7f634c196590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:36.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:36.997+0000 7f634b59e640 1 --2- 172.21.15.33:0/49750930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f634c102570 0x7f634c196590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:36.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:36.997+0000 7f634b59e640 1 -- 172.21.15.33:0/49750930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f634c100e20 msgr2=0x7f634c196050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:36.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:36.997+0000 7f634b59e640 1 --2- 172.21.15.33:0/49750930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f634c100e20 0x7f634c196050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:36.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:36.997+0000 7f634b59e640 1 -- 172.21.15.33:0/49750930 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f634c19b000 con 0x7f634c102ef0 2024-09-12T12:28:36.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:36.997+0000 7f634a59c640 1 --2- 172.21.15.33:0/49750930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f634c102570 0x7f634c196590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:28:36.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:36.998+0000 7f634b59e640 1 --2- 172.21.15.33:0/49750930 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f634c102ef0 0x7f634c19a920 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f634400eb10 tx=0x7f634400c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:36.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:36.998+0000 7f6343fff640 1 -- 172.21.15.33:0/49750930 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6344004b20 con 0x7f634c102ef0 2024-09-12T12:28:36.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:36.998+0000 7f6343fff640 1 -- 172.21.15.33:0/49750930 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6344004cc0 con 0x7f634c102ef0 2024-09-12T12:28:36.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:36.998+0000 7f6343fff640 1 -- 172.21.15.33:0/49750930 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6344010690 con 0x7f634c102ef0 2024-09-12T12:28:36.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:36.999+0000 7f63511ae640 1 -- 172.21.15.33:0/49750930 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f634c19b2f0 con 0x7f634c102ef0 2024-09-12T12:28:36.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:36.999+0000 7f63511ae640 1 -- 172.21.15.33:0/49750930 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f634c1a2bd0 con 0x7f634c102ef0 2024-09-12T12:28:37.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.003+0000 7f6353587740 1 Processor -- start 2024-09-12T12:28:37.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.003+0000 7f6343fff640 1 -- 172.21.15.33:0/49750930 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6344005000 con 0x7f634c102ef0 2024-09-12T12:28:37.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.004+0000 7f6353587740 1 -- start start 2024-09-12T12:28:37.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.004+0000 7f6353587740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56316c7a1350 0x56316c79f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:37.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.004+0000 7f6353587740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56316c79fde0 0x56316c7a0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:37.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.004+0000 7f6353587740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56316c7aab80 0x56316c7acf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:37.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.004+0000 7f634a59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56316c7a1350 0x56316c79f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:37.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.004+0000 7f6343fff640 1 --2- 172.21.15.33:0/49750930 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f63380a2d80 0x7f63380a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:37.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.005+0000 7f634a59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56316c7a1350 0x56316c79f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51936/0 (socket says 172.21.15.33:51936) 2024-09-12T12:28:37.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.005+0000 7f634a59c640 1 -- 172.21.15.33:0/1567408072 learned_addr learned my addr 172.21.15.33:0/1567408072 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:28:37.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.005+0000 7f6353587740 1 -- 172.21.15.33:0/1567408072 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56316c6fd2f0 con 0x56316c7a1350 2024-09-12T12:28:37.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.005+0000 7f6353587740 1 -- 172.21.15.33:0/1567408072 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56316c6a4cf0 con 0x56316c79fde0 2024-09-12T12:28:37.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.005+0000 7f6353587740 1 -- 172.21.15.33:0/1567408072 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56316c6f92b0 con 0x56316c7aab80 2024-09-12T12:28:37.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.005+0000 7f634a59c640 1 --2- 172.21.15.33:0/1567408072 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56316c7aab80 0x56316c7acf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:37.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.005+0000 7f6343fff640 1 -- 172.21.15.33:0/49750930 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f6344010430 con 0x7f634c102ef0 2024-09-12T12:28:37.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.005+0000 7f634ad9d640 1 --2- 172.21.15.33:0/1567408072 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56316c79fde0 0x56316c7a0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:37.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.005+0000 7f634a59c640 1 -- 172.21.15.33:0/1567408072 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56316c7aab80 msgr2=0x56316c7acf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:37.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.005+0000 7f634a59c640 1 --2- 172.21.15.33:0/1567408072 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56316c7aab80 0x56316c7acf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:37.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.005+0000 7f634a59c640 1 -- 172.21.15.33:0/1567408072 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56316c79fde0 msgr2=0x56316c7a0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:37.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.005+0000 7f634a59c640 1 --2- 172.21.15.33:0/1567408072 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56316c79fde0 0x56316c7a0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:37.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.005+0000 7f634a59c640 1 -- 172.21.15.33:0/1567408072 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56316c6893a0 con 0x56316c7a1350 2024-09-12T12:28:37.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.005+0000 7f634b59e640 1 --2- 172.21.15.33:0/49750930 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f63380a2d80 0x7f63380a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:37.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.005+0000 7f634ad9d640 1 --2- 172.21.15.33:0/1567408072 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56316c79fde0 0x56316c7a0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:28:37.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.006+0000 7f634b59e640 1 --2- 172.21.15.33:0/49750930 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f63380a2d80 0x7f63380a5240 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6344005ba0 tx=0x7f634400efd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:37.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.006+0000 7f634a59c640 1 --2- 172.21.15.33:0/1567408072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56316c7a1350 0x56316c79f8a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x56316c7a0880 tx=0x7f6334005a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48eb04ebd7753ff7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:37.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.007+0000 7f63417fa640 1 -- 172.21.15.33:0/1567408072 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6334005030 con 0x56316c7a1350 2024-09-12T12:28:37.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.007+0000 7f63417fa640 1 -- 172.21.15.33:0/1567408072 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f63340046c0 con 0x56316c7a1350 2024-09-12T12:28:37.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.007+0000 7f63417fa640 1 -- 172.21.15.33:0/1567408072 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6334031600 con 0x56316c7a1350 2024-09-12T12:28:37.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.008+0000 7f6353587740 1 -- 172.21.15.33:0/1567408072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56316c7a1350 msgr2=0x56316c79f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:37.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.008+0000 7f6353587740 1 --2- 172.21.15.33:0/1567408072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56316c7a1350 0x56316c79f8a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x56316c7a0880 tx=0x7f6334005a90 comp rx=0 tx=0).stop 2024-09-12T12:28:37.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.008+0000 7f6353587740 1 -- 172.21.15.33:0/1567408072 shutdown_connections 2024-09-12T12:28:37.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.008+0000 7f6353587740 1 --2- 172.21.15.33:0/1567408072 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56316c7aab80 0x56316c7acf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:37.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.008+0000 7f6353587740 1 --2- 172.21.15.33:0/1567408072 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56316c79fde0 0x56316c7a0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:37.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.008+0000 7f6353587740 1 --2- 172.21.15.33:0/1567408072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56316c7a1350 0x56316c79f8a0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:37.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.008+0000 7f6353587740 1 -- 172.21.15.33:0/1567408072 >> 172.21.15.33:0/1567408072 conn(0x56316c760310 msgr2=0x56316c79c470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:37.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.009+0000 7f6353587740 1 -- 172.21.15.33:0/1567408072 shutdown_connections 2024-09-12T12:28:37.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.009+0000 7f6353587740 1 -- 172.21.15.33:0/1567408072 wait complete. 2024-09-12T12:28:37.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.009+0000 7f6353587740 1 -- start start 2024-09-12T12:28:37.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.009+0000 7f6353587740 1 Processor -- start 2024-09-12T12:28:37.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.010+0000 7f6353587740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56316c79fde0 0x56316c7aa560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:37.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.010+0000 7f6353587740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56316c7a1350 0x56316c7a7810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:37.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.011+0000 7f6353587740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56316c7aab80 0x56316c7a7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:37.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.011+0000 7f634a59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56316c79fde0 0x56316c7aa560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:37.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.011+0000 7f634a59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56316c79fde0 0x56316c7aa560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:41890/0 (socket says 172.21.15.33:41890) 2024-09-12T12:28:37.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.011+0000 7f6353587740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56316c7ad820 con 0x56316c7aab80 2024-09-12T12:28:37.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.011+0000 7f634a59c640 1 -- 172.21.15.33:0/1023553486 learned_addr learned my addr 172.21.15.33:0/1023553486 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:28:37.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.011+0000 7f634ad9d640 1 --2- 172.21.15.33:0/1023553486 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56316c7a1350 0x56316c7a7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:37.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.011+0000 7f6353587740 1 -- 172.21.15.33:0/1023553486 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56316c6b8060 con 0x56316c7a1350 2024-09-12T12:28:37.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.011+0000 7f6353587740 1 -- 172.21.15.33:0/1023553486 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56316c7ad9a0 con 0x56316c79fde0 2024-09-12T12:28:37.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.011+0000 7f6353587740 10 client.0 _ll_register_callbacks cb 0x56316c40b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:28:37.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.012+0000 7f634a59c640 1 -- 172.21.15.33:0/1023553486 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56316c7a1350 msgr2=0x56316c7a7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:37.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.012+0000 7f634a59c640 1 --2- 172.21.15.33:0/1023553486 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56316c7a1350 0x56316c7a7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:37.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.012+0000 7f634a59c640 1 -- 172.21.15.33:0/1023553486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56316c7aab80 msgr2=0x56316c7a7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:37.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.012+0000 7f634a59c640 1 --2- 172.21.15.33:0/1023553486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56316c7aab80 0x56316c7a7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:37.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.012+0000 7f634a59c640 1 -- 172.21.15.33:0/1023553486 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56316c46e3c0 con 0x56316c79fde0 2024-09-12T12:28:37.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.012+0000 7f634a59c640 1 --2- 172.21.15.33:0/1023553486 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56316c79fde0 0x56316c7aa560 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f633402a9b0 tx=0x7f633400b010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f4f1e9949892fb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:37.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.012+0000 7f63327fc640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:28:37.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.012+0000 7f6353587740 1 -- 172.21.15.33:0/1023553486 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63340046c0 con 0x56316c79fde0 2024-09-12T12:28:37.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.012+0000 7f63327fc640 1 -- 172.21.15.33:0/1023553486 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63340053b0 con 0x56316c79fde0 2024-09-12T12:28:37.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.012+0000 7f63327fc640 1 -- 172.21.15.33:0/1023553486 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f6334005550 con 0x56316c79fde0 2024-09-12T12:28:37.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.013+0000 7f63327fc640 1 -- 172.21.15.33:0/1023553486 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f633405e050 con 0x56316c79fde0 2024-09-12T12:28:37.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.013+0000 7f6353587740 10 client.25291 fetch_fsmap learned FSMap version 26 2024-09-12T12:28:37.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.013+0000 7f6353587740 1 -- 172.21.15.33:0/1023553486 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({fsmap=26}) -- 0x56316c7ad820 con 0x56316c79fde0 2024-09-12T12:28:37.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.013+0000 7f63327fc640 1 -- 172.21.15.33:0/1023553486 <== mon.1 v2:172.21.15.102:3300/0 4 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f6334045050 con 0x56316c79fde0 2024-09-12T12:28:37.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.014+0000 7f6353587740 10 client.25291 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:28:37.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.014+0000 7f6353587740 10 client.25291 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-12T12:28:37.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.014+0000 7f6353587740 20 client.25291 populate_metadata read hostname 'smithi033' 2024-09-12T12:28:37.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.014+0000 7f6353587740 1 --2- 172.21.15.33:0/1023553486 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x56316c7ba310 0x56316c7bc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:37.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.014+0000 7f6353587740 4 client.25291 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:28:37.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.014+0000 7f6353587740 1 -- 172.21.15.33:0/1023553486 --> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f63340046c0 con 0x56316c7ba310 2024-09-12T12:28:37.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.014+0000 7f634ad9d640 1 --2- 172.21.15.33:0/1023553486 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x56316c7ba310 0x56316c7bc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:37.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.015+0000 7f634ad9d640 1 --2- 172.21.15.33:0/1023553486 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x56316c7ba310 0x56316c7bc700 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7c36ca1f71465343 server_cookie=d2d1c17ec6a95473 in_seq=0 out_seq=0 2024-09-12T12:28:37.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.016+0000 7f63327fc640 10 client.25291 ms_handle_connect on v2:172.21.15.102:6834/4179527539 2024-09-12T12:28:37.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.016+0000 7f63327fc640 1 -- 172.21.15.33:0/1023553486 <== mds.2 v2:172.21.15.102:6834/4179527539 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f63340046c0 con 0x56316c7ba310 2024-09-12T12:28:37.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.016+0000 7f63327fc640 10 client.25291 handle_command_reply: tid=0 2024-09-12T12:28:37.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.016+0000 7f6353587740 1 client.25291 shutdown 2024-09-12T12:28:37.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.017+0000 7f6353587740 1 -- 172.21.15.33:0/1023553486 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56316c79fde0 msgr2=0x56316c7aa560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:37.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.017+0000 7f6353587740 1 --2- 172.21.15.33:0/1023553486 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56316c79fde0 0x56316c7aa560 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f633402a9b0 tx=0x7f633400b010 comp rx=0 tx=0).stop 2024-09-12T12:28:37.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.017+0000 7f6353587740 1 -- 172.21.15.33:0/1023553486 shutdown_connections 2024-09-12T12:28:37.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.017+0000 7f6353587740 1 --2- 172.21.15.33:0/1023553486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56316c7aab80 0x56316c7a7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:37.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.017+0000 7f6353587740 1 --2- 172.21.15.33:0/1023553486 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x56316c7ba310 0x56316c7bc700 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:37.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.017+0000 7f6353587740 1 --2- 172.21.15.33:0/1023553486 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56316c7a1350 0x56316c7a7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:37.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.017+0000 7f6353587740 1 --2- 172.21.15.33:0/1023553486 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56316c79fde0 0x56316c7aa560 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:37.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.017+0000 7f6353587740 1 -- 172.21.15.33:0/1023553486 >> 172.21.15.33:0/1023553486 conn(0x56316c760310 msgr2=0x56316c7a2140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:37.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.017+0000 7f63327fc640 0 client.25291 ms_handle_reset on v2:172.21.15.102:6834/4179527539 2024-09-12T12:28:37.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.018+0000 7f6353587740 1 -- 172.21.15.33:0/1023553486 shutdown_connections 2024-09-12T12:28:37.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.018+0000 7f6353587740 1 -- 172.21.15.33:0/1023553486 wait complete. 2024-09-12T12:28:37.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.018+0000 7f6353587740 20 client.25291 trim_cache size 0 max 16384 2024-09-12T12:28:37.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.046+0000 7f6353587740 1 Processor -- start 2024-09-12T12:28:37.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.046+0000 7f6353587740 1 -- start start 2024-09-12T12:28:37.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.047+0000 7f6353587740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56316c760310 0x56316c7a67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:37.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.047+0000 7f6353587740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56316c79fde0 0x56316c7bf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:37.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.047+0000 7f6353587740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56316c7a1350 0x56316c7bf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:37.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.047+0000 7f6353587740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f634c1af280 con 0x56316c79fde0 2024-09-12T12:28:37.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.047+0000 7f6353587740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f634c1acb50 con 0x56316c7a1350 2024-09-12T12:28:37.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.047+0000 7f6353587740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f634c1aa9a0 con 0x56316c760310 2024-09-12T12:28:37.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.048+0000 7f634a59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56316c760310 0x56316c7a67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:37.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.048+0000 7f634a59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56316c7a1350 0x56316c7bf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:37.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.048+0000 7f634a59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56316c760310 0x56316c7a67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:41894/0 (socket says 172.21.15.33:41894) 2024-09-12T12:28:37.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.048+0000 7f634a59c640 1 -- 172.21.15.33:0/2135468312 learned_addr learned my addr 172.21.15.33:0/2135468312 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:28:37.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.048+0000 7f634ad9d640 1 --2- 172.21.15.33:0/2135468312 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56316c79fde0 0x56316c7bf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:37.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.048+0000 7f634a59c640 1 -- 172.21.15.33:0/2135468312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56316c7a1350 msgr2=0x56316c7bf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:37.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.048+0000 7f634a59c640 1 --2- 172.21.15.33:0/2135468312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56316c7a1350 0x56316c7bf880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:37.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.048+0000 7f634a59c640 1 -- 172.21.15.33:0/2135468312 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56316c79fde0 msgr2=0x56316c7bf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:37.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.048+0000 7f634a59c640 1 --2- 172.21.15.33:0/2135468312 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56316c79fde0 0x56316c7bf340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:37.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.048+0000 7f634a59c640 1 -- 172.21.15.33:0/2135468312 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56316c7aa080 con 0x56316c760310 2024-09-12T12:28:37.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.048+0000 7f634a59c640 1 --2- 172.21.15.33:0/2135468312 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56316c760310 0x56316c7a67f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x56316c7a2a80 tx=0x7f633403e070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf618fb0bebdedaa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:37.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.049+0000 7f6340ff9640 1 -- 172.21.15.33:0/2135468312 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63340046c0 con 0x56316c760310 2024-09-12T12:28:37.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.049+0000 7f6340ff9640 1 -- 172.21.15.33:0/2135468312 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6334051070 con 0x56316c760310 2024-09-12T12:28:37.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.049+0000 7f6340ff9640 1 -- 172.21.15.33:0/2135468312 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6334055900 con 0x56316c760310 2024-09-12T12:28:37.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.050+0000 7f6353587740 1 -- 172.21.15.33:0/2135468312 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56316c760310 msgr2=0x56316c7a67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:37.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.050+0000 7f6353587740 1 --2- 172.21.15.33:0/2135468312 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56316c760310 0x56316c7a67f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x56316c7a2a80 tx=0x7f633403e070 comp rx=0 tx=0).stop 2024-09-12T12:28:37.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.051+0000 7f6353587740 1 -- 172.21.15.33:0/2135468312 shutdown_connections 2024-09-12T12:28:37.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.051+0000 7f6353587740 1 --2- 172.21.15.33:0/2135468312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56316c7a1350 0x56316c7bf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:37.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.051+0000 7f6353587740 1 --2- 172.21.15.33:0/2135468312 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56316c79fde0 0x56316c7bf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:37.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.051+0000 7f6353587740 1 --2- 172.21.15.33:0/2135468312 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56316c760310 0x56316c7a67f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:37.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.051+0000 7f6353587740 1 -- 172.21.15.33:0/2135468312 >> 172.21.15.33:0/2135468312 conn(0x56316c7a3200 msgr2=0x56316c7a60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:37.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.051+0000 7f6353587740 1 -- 172.21.15.33:0/2135468312 shutdown_connections 2024-09-12T12:28:37.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.051+0000 7f6353587740 1 -- 172.21.15.33:0/2135468312 wait complete. 2024-09-12T12:28:37.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.051+0000 7f6353587740 1 -- start start 2024-09-12T12:28:37.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.051+0000 7f6353587740 1 Processor -- start 2024-09-12T12:28:37.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.052+0000 7f6353587740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56316c760310 0x56316c7bcfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:37.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.052+0000 7f6353587740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56316c79fde0 0x56316c7bd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:37.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.052+0000 7f6353587740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56316c7a1350 0x56316c7bda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:37.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.052+0000 7f6353587740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f634c1ab010 con 0x56316c7a1350 2024-09-12T12:28:37.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.052+0000 7f6353587740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f634c1ac480 con 0x56316c760310 2024-09-12T12:28:37.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.052+0000 7f6353587740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f634c1ab6e0 con 0x56316c79fde0 2024-09-12T12:28:37.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.052+0000 7f6353587740 10 client.0 _ll_register_callbacks cb 0x7f63340096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:28:37.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.052+0000 7f634ad9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56316c79fde0 0x56316c7bd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:37.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.052+0000 7f634ad9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56316c79fde0 0x56316c7bd520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:41902/0 (socket says 172.21.15.33:41902) 2024-09-12T12:28:37.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.052+0000 7f634ad9d640 1 -- 172.21.15.33:0/2990181589 learned_addr learned my addr 172.21.15.33:0/2990181589 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:28:37.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.052+0000 7f634a59c640 1 --2- 172.21.15.33:0/2990181589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56316c7a1350 0x56316c7bda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:37.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.052+0000 7f634a59c640 1 --2- 172.21.15.33:0/2990181589 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56316c760310 0x56316c7bcfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:37.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.052+0000 7f634ad9d640 1 -- 172.21.15.33:0/2990181589 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56316c760310 msgr2=0x56316c7bcfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:37.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.052+0000 7f634ad9d640 1 --2- 172.21.15.33:0/2990181589 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56316c760310 0x56316c7bcfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:37.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.052+0000 7f634ad9d640 1 -- 172.21.15.33:0/2990181589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56316c7a1350 msgr2=0x56316c7bda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:37.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.052+0000 7f634ad9d640 1 --2- 172.21.15.33:0/2990181589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56316c7a1350 0x56316c7bda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:37.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.052+0000 7f634ad9d640 1 -- 172.21.15.33:0/2990181589 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56316c823c50 con 0x56316c79fde0 2024-09-12T12:28:37.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.052+0000 7f634a59c640 1 --2- 172.21.15.33:0/2990181589 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56316c760310 0x56316c7bcfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:28:37.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.053+0000 7f634ad9d640 1 --2- 172.21.15.33:0/2990181589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56316c79fde0 0x56316c7bd520 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x56316c7a70a0 tx=0x7f633c009830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7856e7e54207c19 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:37.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.053+0000 7f63327fc640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:28:37.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.053+0000 7f63327fc640 1 -- 172.21.15.33:0/2990181589 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c004250 con 0x56316c79fde0 2024-09-12T12:28:37.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.053+0000 7f6353587740 1 -- 172.21.15.33:0/2990181589 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6334051070 con 0x56316c79fde0 2024-09-12T12:28:37.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.053+0000 7f63327fc640 1 -- 172.21.15.33:0/2990181589 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f633c0043f0 con 0x56316c79fde0 2024-09-12T12:28:37.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.053+0000 7f63327fc640 1 -- 172.21.15.33:0/2990181589 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f633c030050 con 0x56316c79fde0 2024-09-12T12:28:37.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.053+0000 7f6353587740 10 client.25297 fetch_fsmap learned FSMap version 26 2024-09-12T12:28:37.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.053+0000 7f6353587740 1 -- 172.21.15.33:0/2990181589 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56316c824eb0 con 0x56316c79fde0 2024-09-12T12:28:37.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.054+0000 7f63327fc640 1 -- 172.21.15.33:0/2990181589 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6334051070 con 0x56316c79fde0 2024-09-12T12:28:37.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.054+0000 7f63327fc640 1 -- 172.21.15.33:0/2990181589 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f633c01a6d0 con 0x56316c79fde0 2024-09-12T12:28:37.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.054+0000 7f6353587740 10 client.25297 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:28:37.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.054+0000 7f6353587740 10 client.25297 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-12T12:28:37.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.054+0000 7f6353587740 20 client.25297 populate_metadata read hostname 'smithi033' 2024-09-12T12:28:37.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.054+0000 7f6353587740 1 --2- 172.21.15.33:0/2990181589 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x56316c7aab80 0x56316c8275f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:37.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.054+0000 7f6353587740 4 client.25297 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:28:37.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.054+0000 7f6353587740 1 -- 172.21.15.33:0/2990181589 --> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56316c70a860 con 0x56316c7aab80 2024-09-12T12:28:37.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.054+0000 7f634a59c640 1 --2- 172.21.15.33:0/2990181589 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x56316c7aab80 0x56316c8275f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:37.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.054+0000 7f634a59c640 1 --2- 172.21.15.33:0/2990181589 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x56316c7aab80 0x56316c8275f0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ecbdfe80a82b179e server_cookie=96798e95331c1d9c in_seq=0 out_seq=0 2024-09-12T12:28:37.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.054+0000 7f63327fc640 10 client.25297 ms_handle_connect on v2:172.21.15.102:6834/4179527539 2024-09-12T12:28:37.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.055+0000 7f63327fc640 1 -- 172.21.15.33:0/2990181589 <== mds.2 v2:172.21.15.102:6834/4179527539 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56316c70a860 con 0x56316c7aab80 2024-09-12T12:28:37.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.055+0000 7f63327fc640 10 client.25297 handle_command_reply: tid=0 2024-09-12T12:28:37.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.055+0000 7f6353587740 1 client.25297 shutdown 2024-09-12T12:28:37.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.055+0000 7f6353587740 1 -- 172.21.15.33:0/2990181589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56316c79fde0 msgr2=0x56316c7bd520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:37.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.055+0000 7f6353587740 1 --2- 172.21.15.33:0/2990181589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56316c79fde0 0x56316c7bd520 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x56316c7a70a0 tx=0x7f633c009830 comp rx=0 tx=0).stop 2024-09-12T12:28:37.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.055+0000 7f6353587740 1 -- 172.21.15.33:0/2990181589 shutdown_connections 2024-09-12T12:28:37.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.055+0000 7f6353587740 1 --2- 172.21.15.33:0/2990181589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56316c7a1350 0x56316c7bda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:37.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.055+0000 7f6353587740 1 --2- 172.21.15.33:0/2990181589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56316c79fde0 0x56316c7bd520 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x56316c7a70a0 tx=0x7f633c009830 comp rx=0 tx=0).stop 2024-09-12T12:28:37.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.056+0000 7f6353587740 1 --2- 172.21.15.33:0/2990181589 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x56316c7aab80 0x56316c8275f0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:37.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.056+0000 7f6353587740 1 --2- 172.21.15.33:0/2990181589 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56316c760310 0x56316c7bcfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:37.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.056+0000 7f63327fc640 0 client.25297 ms_handle_reset on v2:172.21.15.102:6834/4179527539 2024-09-12T12:28:37.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.056+0000 7f6353587740 1 -- 172.21.15.33:0/2990181589 >> 172.21.15.33:0/2990181589 conn(0x56316c7a3200 msgr2=0x56316c7a6900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:37.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.056+0000 7f6353587740 1 -- 172.21.15.33:0/2990181589 shutdown_connections 2024-09-12T12:28:37.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.056+0000 7f6353587740 1 -- 172.21.15.33:0/2990181589 wait complete. 2024-09-12T12:28:37.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.056+0000 7f6353587740 20 client.25297 trim_cache size 0 max 16384 2024-09-12T12:28:37.059 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-09-12T12:28:37.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.057+0000 7f63511ae640 1 -- 172.21.15.33:0/49750930 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f63380a2d80 msgr2=0x7f63380a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:37.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.057+0000 7f63511ae640 1 --2- 172.21.15.33:0/49750930 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f63380a2d80 0x7f63380a5240 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6344005ba0 tx=0x7f634400efd0 comp rx=0 tx=0).stop 2024-09-12T12:28:37.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.057+0000 7f63511ae640 1 -- 172.21.15.33:0/49750930 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f634c102ef0 msgr2=0x7f634c19a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:37.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.057+0000 7f63511ae640 1 --2- 172.21.15.33:0/49750930 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f634c102ef0 0x7f634c19a920 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f634400eb10 tx=0x7f634400c2d0 comp rx=0 tx=0).stop 2024-09-12T12:28:37.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.057+0000 7f63511ae640 1 -- 172.21.15.33:0/49750930 shutdown_connections 2024-09-12T12:28:37.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.057+0000 7f63511ae640 1 --2- 172.21.15.33:0/49750930 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f63380a2d80 0x7f63380a5240 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:37.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.057+0000 7f63511ae640 1 --2- 172.21.15.33:0/49750930 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f634c102ef0 0x7f634c19a920 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:37.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.057+0000 7f63511ae640 1 --2- 172.21.15.33:0/49750930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f634c102570 0x7f634c196590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:37.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.057+0000 7f63511ae640 1 --2- 172.21.15.33:0/49750930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f634c100e20 0x7f634c196050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:37.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.057+0000 7f63511ae640 1 -- 172.21.15.33:0/49750930 >> 172.21.15.33:0/49750930 conn(0x7f634c0fc7d0 msgr2=0x7f634c1036e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:37.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.058+0000 7f63511ae640 1 -- 172.21.15.33:0/49750930 shutdown_connections 2024-09-12T12:28:37.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:37.058+0000 7f63511ae640 1 -- 172.21.15.33:0/49750930 wait complete. 2024-09-12T12:28:37.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:28:37 smithi033 ceph-mon[31246]: pgmap v428: 129 pgs: 129 active+clean; 10 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 49 MiB/s wr, 785 op/s 2024-09-12T12:28:37.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:28:37 smithi043 ceph-mon[34144]: pgmap v428: 129 pgs: 129 active+clean; 10 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 49 MiB/s wr, 785 op/s 2024-09-12T12:28:37.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:28:37 smithi102 ceph-mon[34799]: pgmap v428: 129 pgs: 129 active+clean; 10 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 49 MiB/s wr, 785 op/s 2024-09-12T12:28:37.918 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T12:28:38.371 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:28:39.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.214+0000 7f475dfa3640 1 -- 172.21.15.33:0/1898170208 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4758101df0 msgr2=0x7f47581021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:39.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.214+0000 7f475dfa3640 1 --2- 172.21.15.33:0/1898170208 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4758101df0 0x7f47581021d0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f474c009900 tx=0x7f474c02e800 comp rx=0 tx=0).stop 2024-09-12T12:28:39.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.214+0000 7f475dfa3640 1 -- 172.21.15.33:0/1898170208 shutdown_connections 2024-09-12T12:28:39.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.214+0000 7f475dfa3640 1 --2- 172.21.15.33:0/1898170208 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4758106f20 0x7f475810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:39.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.214+0000 7f475dfa3640 1 --2- 172.21.15.33:0/1898170208 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47581027a0 0x7f47581067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:39.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.214+0000 7f475dfa3640 1 --2- 172.21.15.33:0/1898170208 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4758101df0 0x7f47581021d0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:39.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.214+0000 7f475dfa3640 1 -- 172.21.15.33:0/1898170208 >> 172.21.15.33:0/1898170208 conn(0x7f47580fd8b0 msgr2=0x7f47580ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:39.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.215+0000 7f475dfa3640 1 -- 172.21.15.33:0/1898170208 shutdown_connections 2024-09-12T12:28:39.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.215+0000 7f475dfa3640 1 -- 172.21.15.33:0/1898170208 wait complete. 2024-09-12T12:28:39.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.216+0000 7f475dfa3640 1 Processor -- start 2024-09-12T12:28:39.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.217+0000 7f475dfa3640 1 -- start start 2024-09-12T12:28:39.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.218+0000 7f475dfa3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4758101df0 0x7f4758196250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:39.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.218+0000 7f475dfa3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47581027a0 0x7f4758196790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:39.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.218+0000 7f47577fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4758101df0 0x7f4758196250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:39.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.218+0000 7f4756ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47581027a0 0x7f4758196790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:39.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.218+0000 7f4756ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47581027a0 0x7f4758196790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:49290/0 (socket says 172.21.15.33:49290) 2024-09-12T12:28:39.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.218+0000 7f47577fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4758101df0 0x7f4758196250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:41918/0 (socket says 172.21.15.33:41918) 2024-09-12T12:28:39.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.218+0000 7f4756ffd640 1 -- 172.21.15.33:0/564301592 learned_addr learned my addr 172.21.15.33:0/564301592 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:28:39.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.219+0000 7f475dfa3640 1 --2- 172.21.15.33:0/564301592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4758106f20 0x7f475819ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:39.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.219+0000 7f475dfa3640 1 -- 172.21.15.33:0/564301592 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f475810fc70 con 0x7f4758106f20 2024-09-12T12:28:39.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.219+0000 7f475dfa3640 1 -- 172.21.15.33:0/564301592 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f475810faf0 con 0x7f47581027a0 2024-09-12T12:28:39.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.219+0000 7f475dfa3640 1 -- 172.21.15.33:0/564301592 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f475810fdf0 con 0x7f4758101df0 2024-09-12T12:28:39.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.219+0000 7f4757fff640 1 --2- 172.21.15.33:0/564301592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4758106f20 0x7f475819ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:39.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.220+0000 7f4756ffd640 1 -- 172.21.15.33:0/564301592 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4758101df0 msgr2=0x7f4758196250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:39.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.220+0000 7f4756ffd640 1 --2- 172.21.15.33:0/564301592 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4758101df0 0x7f4758196250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:39.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.220+0000 7f4756ffd640 1 -- 172.21.15.33:0/564301592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4758106f20 msgr2=0x7f475819ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:39.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.220+0000 7f4756ffd640 1 --2- 172.21.15.33:0/564301592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4758106f20 0x7f475819ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:39.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.220+0000 7f4756ffd640 1 -- 172.21.15.33:0/564301592 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f475819b200 con 0x7f47581027a0 2024-09-12T12:28:39.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.221+0000 7f4756ffd640 1 --2- 172.21.15.33:0/564301592 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47581027a0 0x7f4758196790 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f474800ea60 tx=0x7f474800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:39.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.221+0000 7f4757fff640 1 --2- 172.21.15.33:0/564301592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4758106f20 0x7f475819ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:28:39.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.221+0000 7f4754ff9640 1 -- 172.21.15.33:0/564301592 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f474800cde0 con 0x7f47581027a0 2024-09-12T12:28:39.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.221+0000 7f4754ff9640 1 -- 172.21.15.33:0/564301592 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f47480035f0 con 0x7f47581027a0 2024-09-12T12:28:39.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.221+0000 7f475dfa3640 1 -- 172.21.15.33:0/564301592 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f475819b4f0 con 0x7f47581027a0 2024-09-12T12:28:39.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.222+0000 7f4754ff9640 1 -- 172.21.15.33:0/564301592 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4748010690 con 0x7f47581027a0 2024-09-12T12:28:39.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.222+0000 7f475dfa3640 1 -- 172.21.15.33:0/564301592 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47581a2dd0 con 0x7f47581027a0 2024-09-12T12:28:39.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.226+0000 7f4754ff9640 1 -- 172.21.15.33:0/564301592 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4748004000 con 0x7f47581027a0 2024-09-12T12:28:39.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.228+0000 7f4754ff9640 1 --2- 172.21.15.33:0/564301592 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f47400a2ad0 0x7f47400a4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:39.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.228+0000 7f4754ff9640 1 -- 172.21.15.33:0/564301592 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f47480cf2b0 con 0x7f47581027a0 2024-09-12T12:28:39.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.229+0000 7f476037c740 1 Processor -- start 2024-09-12T12:28:39.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.229+0000 7f476037c740 1 -- start start 2024-09-12T12:28:39.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.229+0000 7f476037c740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f88c62b40 0x559f88c61090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:39.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.229+0000 7f476037c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f88c615d0 0x559f88c61a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:39.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.229+0000 7f476037c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f88c6c370 0x559f88c6e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:39.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.230+0000 7f476037c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x559f88bc72f0 con 0x559f88c615d0 2024-09-12T12:28:39.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.230+0000 7f4756ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f88c615d0 0x559f88c61a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:39.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.230+0000 7f4757fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f88c6c370 0x559f88c6e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:39.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.230+0000 7f4757fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f88c6c370 0x559f88c6e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:49292/0 (socket says 172.21.15.33:49292) 2024-09-12T12:28:39.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.230+0000 7f4757fff640 1 -- 172.21.15.33:0/3963125617 learned_addr learned my addr 172.21.15.33:0/3963125617 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:28:39.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.230+0000 7f476037c740 1 -- 172.21.15.33:0/3963125617 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559f88b6ecf0 con 0x559f88c6c370 2024-09-12T12:28:39.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.230+0000 7f476037c740 1 -- 172.21.15.33:0/3963125617 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x559f88bc32b0 con 0x559f88c62b40 2024-09-12T12:28:39.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.230+0000 7f47577fe640 1 --2- 172.21.15.33:0/3963125617 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f88c62b40 0x559f88c61090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:39.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.230+0000 7f47577fe640 1 --2- 172.21.15.33:0/564301592 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f47400a2ad0 0x7f47400a4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:39.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.230+0000 7f4757fff640 1 -- 172.21.15.33:0/3963125617 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f88c62b40 msgr2=0x559f88c61090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:39.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.230+0000 7f4757fff640 1 --2- 172.21.15.33:0/3963125617 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f88c62b40 0x559f88c61090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:39.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.231+0000 7f4757fff640 1 -- 172.21.15.33:0/3963125617 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f88c615d0 msgr2=0x559f88c61a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:39.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.231+0000 7f4757fff640 1 --2- 172.21.15.33:0/3963125617 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f88c615d0 0x559f88c61a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:39.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.231+0000 7f4757fff640 1 -- 172.21.15.33:0/3963125617 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f88b533a0 con 0x559f88c6c370 2024-09-12T12:28:39.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.231+0000 7f4756ffd640 1 --2- 172.21.15.33:0/3963125617 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f88c615d0 0x559f88c61a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:28:39.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.231+0000 7f4757fff640 1 --2- 172.21.15.33:0/3963125617 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f88c6c370 0x559f88c6e760 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4750011790 tx=0x7f4750011c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93fe9e0d127cba1b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:39.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.232+0000 7f473dffb640 1 -- 172.21.15.33:0/3963125617 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4750003c30 con 0x559f88c6c370 2024-09-12T12:28:39.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.232+0000 7f473dffb640 1 -- 172.21.15.33:0/3963125617 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f475000fe50 con 0x559f88c6c370 2024-09-12T12:28:39.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.232+0000 7f473dffb640 1 -- 172.21.15.33:0/3963125617 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47500193e0 con 0x559f88c6c370 2024-09-12T12:28:39.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.233+0000 7f476037c740 1 -- 172.21.15.33:0/3963125617 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f88c6c370 msgr2=0x559f88c6e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:39.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.233+0000 7f476037c740 1 --2- 172.21.15.33:0/3963125617 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f88c6c370 0x559f88c6e760 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4750011790 tx=0x7f4750011c50 comp rx=0 tx=0).stop 2024-09-12T12:28:39.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.233+0000 7f47577fe640 1 --2- 172.21.15.33:0/564301592 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f47400a2ad0 0x7f47400a4f90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f474c006010 tx=0x7f474c0363f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:39.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.233+0000 7f476037c740 1 -- 172.21.15.33:0/3963125617 shutdown_connections 2024-09-12T12:28:39.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.233+0000 7f476037c740 1 --2- 172.21.15.33:0/3963125617 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f88c6c370 0x559f88c6e760 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:39.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.233+0000 7f476037c740 1 --2- 172.21.15.33:0/3963125617 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f88c615d0 0x559f88c61a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:39.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.233+0000 7f476037c740 1 --2- 172.21.15.33:0/3963125617 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f88c62b40 0x559f88c61090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:39.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.233+0000 7f476037c740 1 -- 172.21.15.33:0/3963125617 >> 172.21.15.33:0/3963125617 conn(0x559f88c2a310 msgr2=0x559f88c5dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:39.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.233+0000 7f476037c740 1 -- 172.21.15.33:0/3963125617 shutdown_connections 2024-09-12T12:28:39.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.233+0000 7f476037c740 1 -- 172.21.15.33:0/3963125617 wait complete. 2024-09-12T12:28:39.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.234+0000 7f476037c740 1 -- start start 2024-09-12T12:28:39.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.234+0000 7f476037c740 1 Processor -- start 2024-09-12T12:28:39.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.234+0000 7f476037c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f88c615d0 0x559f88c6bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:39.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.234+0000 7f476037c740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f88c62b40 0x559f88c68f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:39.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.234+0000 7f476037c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f88c6c370 0x559f88c69480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:39.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.234+0000 7f476037c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x559f88c6f0c0 con 0x559f88c615d0 2024-09-12T12:28:39.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.235+0000 7f47577fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f88c615d0 0x559f88c6bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:39.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.235+0000 7f4756ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f88c62b40 0x559f88c68f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:39.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.235+0000 7f4756ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f88c62b40 0x559f88c68f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:41940/0 (socket says 172.21.15.33:41940) 2024-09-12T12:28:39.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.235+0000 7f4756ffd640 1 -- 172.21.15.33:0/331142727 learned_addr learned my addr 172.21.15.33:0/331142727 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:28:39.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.235+0000 7f4757fff640 1 --2- 172.21.15.33:0/331142727 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f88c6c370 0x559f88c69480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:39.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.235+0000 7f476037c740 1 -- 172.21.15.33:0/331142727 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559f88b82060 con 0x559f88c6c370 2024-09-12T12:28:39.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.235+0000 7f476037c740 1 -- 172.21.15.33:0/331142727 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x559f88c6f240 con 0x559f88c62b40 2024-09-12T12:28:39.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.235+0000 7f476037c740 10 client.0 _ll_register_callbacks cb 0x559f888d58c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:28:39.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.235+0000 7f4757fff640 1 -- 172.21.15.33:0/331142727 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f88c62b40 msgr2=0x559f88c68f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:39.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.235+0000 7f4757fff640 1 --2- 172.21.15.33:0/331142727 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f88c62b40 0x559f88c68f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:39.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.235+0000 7f4757fff640 1 -- 172.21.15.33:0/331142727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f88c615d0 msgr2=0x559f88c6bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:39.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.235+0000 7f4757fff640 1 --2- 172.21.15.33:0/331142727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f88c615d0 0x559f88c6bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:39.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.235+0000 7f4757fff640 1 -- 172.21.15.33:0/331142727 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f889383c0 con 0x559f88c6c370 2024-09-12T12:28:39.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.235+0000 7f4756ffd640 1 --2- 172.21.15.33:0/331142727 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f88c62b40 0x559f88c68f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:28:39.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.235+0000 7f4757fff640 1 --2- 172.21.15.33:0/331142727 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f88c6c370 0x559f88c69480 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4750005c10 tx=0x7f475000fda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e734764eadc0524 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:39.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.235+0000 7f4736ffd640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:28:39.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.236+0000 7f4736ffd640 1 -- 172.21.15.33:0/331142727 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475002a060 con 0x559f88c6c370 2024-09-12T12:28:39.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.236+0000 7f4736ffd640 1 -- 172.21.15.33:0/331142727 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f4750004a40 con 0x559f88c6c370 2024-09-12T12:28:39.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.236+0000 7f476037c740 1 -- 172.21.15.33:0/331142727 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f475000fe50 con 0x559f88c6c370 2024-09-12T12:28:39.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.236+0000 7f4736ffd640 1 -- 172.21.15.33:0/331142727 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4750031050 con 0x559f88c6c370 2024-09-12T12:28:39.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.236+0000 7f476037c740 10 client.25220 fetch_fsmap learned FSMap version 26 2024-09-12T12:28:39.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.236+0000 7f476037c740 1 -- 172.21.15.33:0/331142727 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x559f88c832c0 con 0x559f88c6c370 2024-09-12T12:28:39.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.236+0000 7f4736ffd640 1 -- 172.21.15.33:0/331142727 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4750011400 con 0x559f88c6c370 2024-09-12T12:28:39.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.237+0000 7f4736ffd640 1 -- 172.21.15.33:0/331142727 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f4750018070 con 0x559f88c6c370 2024-09-12T12:28:39.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.238+0000 7f476037c740 10 client.25220 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:28:39.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.238+0000 7f476037c740 10 client.25220 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-12T12:28:39.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.238+0000 7f476037c740 20 client.25220 populate_metadata read hostname 'smithi033' 2024-09-12T12:28:39.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.238+0000 7f476037c740 1 --2- 172.21.15.33:0/331142727 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x559f88c846c0 0x559f88c86ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:39.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.238+0000 7f476037c740 4 client.25220 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:28:39.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.238+0000 7f476037c740 1 -- 172.21.15.33:0/331142727 --> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f475000fe50 con 0x559f88c846c0 2024-09-12T12:28:39.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.238+0000 7f47577fe640 1 --2- 172.21.15.33:0/331142727 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x559f88c846c0 0x559f88c86ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:39.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.239+0000 7f47577fe640 1 --2- 172.21.15.33:0/331142727 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x559f88c846c0 0x559f88c86ab0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b88d3c119e935db3 server_cookie=98c5ac9d507ae647 in_seq=0 out_seq=0 2024-09-12T12:28:39.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.239+0000 7f4736ffd640 10 client.25220 ms_handle_connect on v2:172.21.15.102:6836/2409953270 2024-09-12T12:28:39.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.240+0000 7f4736ffd640 1 -- 172.21.15.33:0/331142727 <== mds.1 v2:172.21.15.102:6836/2409953270 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f475000fe50 con 0x559f88c846c0 2024-09-12T12:28:39.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.240+0000 7f4736ffd640 10 client.25220 handle_command_reply: tid=0 2024-09-12T12:28:39.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.240+0000 7f476037c740 1 client.25220 shutdown 2024-09-12T12:28:39.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.240+0000 7f476037c740 1 -- 172.21.15.33:0/331142727 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f88c6c370 msgr2=0x559f88c69480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:39.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.240+0000 7f476037c740 1 --2- 172.21.15.33:0/331142727 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f88c6c370 0x559f88c69480 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4750005c10 tx=0x7f475000fda0 comp rx=0 tx=0).stop 2024-09-12T12:28:39.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.240+0000 7f476037c740 1 -- 172.21.15.33:0/331142727 shutdown_connections 2024-09-12T12:28:39.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.240+0000 7f476037c740 1 --2- 172.21.15.33:0/331142727 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f88c6c370 0x559f88c69480 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:39.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.240+0000 7f476037c740 1 --2- 172.21.15.33:0/331142727 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x559f88c846c0 0x559f88c86ab0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:39.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.240+0000 7f476037c740 1 --2- 172.21.15.33:0/331142727 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f88c62b40 0x559f88c68f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:39.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.240+0000 7f476037c740 1 --2- 172.21.15.33:0/331142727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f88c615d0 0x559f88c6bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:39.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.240+0000 7f476037c740 1 -- 172.21.15.33:0/331142727 >> 172.21.15.33:0/331142727 conn(0x559f88c2a310 msgr2=0x559f88c63960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:39.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.240+0000 7f4736ffd640 0 client.25220 ms_handle_reset on v2:172.21.15.102:6836/2409953270 2024-09-12T12:28:39.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.241+0000 7f476037c740 1 -- 172.21.15.33:0/331142727 shutdown_connections 2024-09-12T12:28:39.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.241+0000 7f476037c740 1 -- 172.21.15.33:0/331142727 wait complete. 2024-09-12T12:28:39.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.241+0000 7f476037c740 20 client.25220 trim_cache size 0 max 16384 2024-09-12T12:28:39.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.265+0000 7f476037c740 1 Processor -- start 2024-09-12T12:28:39.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.265+0000 7f476037c740 1 -- start start 2024-09-12T12:28:39.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.265+0000 7f476037c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f88c2a310 0x559f88c642f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:39.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.265+0000 7f476037c740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f88c615d0 0x559f88c67f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:39.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.265+0000 7f476037c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f88c62b40 0x559f88c6d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:39.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.265+0000 7f476037c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f47581af0f0 con 0x559f88c2a310 2024-09-12T12:28:39.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.265+0000 7f476037c740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f47581ac9c0 con 0x559f88c62b40 2024-09-12T12:28:39.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.265+0000 7f476037c740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f47581aa810 con 0x559f88c615d0 2024-09-12T12:28:39.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.266+0000 7f4757fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f88c62b40 0x559f88c6d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:39.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.266+0000 7f4757fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f88c62b40 0x559f88c6d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:49306/0 (socket says 172.21.15.33:49306) 2024-09-12T12:28:39.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.266+0000 7f4757fff640 1 -- 172.21.15.33:0/749262251 learned_addr learned my addr 172.21.15.33:0/749262251 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:28:39.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.266+0000 7f4756ffd640 1 --2- 172.21.15.33:0/749262251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f88c615d0 0x559f88c67f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:39.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.266+0000 7f4757fff640 1 -- 172.21.15.33:0/749262251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f88c615d0 msgr2=0x559f88c67f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:39.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.266+0000 7f4757fff640 1 --2- 172.21.15.33:0/749262251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f88c615d0 0x559f88c67f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:39.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.266+0000 7f4757fff640 1 -- 172.21.15.33:0/749262251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f88c2a310 msgr2=0x559f88c642f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:39.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.266+0000 7f4757fff640 1 --2- 172.21.15.33:0/749262251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f88c2a310 0x559f88c642f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:39.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.266+0000 7f4757fff640 1 -- 172.21.15.33:0/749262251 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f88c5e960 con 0x559f88c62b40 2024-09-12T12:28:39.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.266+0000 7f4757fff640 1 --2- 172.21.15.33:0/749262251 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f88c62b40 0x559f88c6d760 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4750028040 tx=0x7f47500045f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=936c58160e671b1f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:39.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.267+0000 7f473d7fa640 1 -- 172.21.15.33:0/749262251 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475002a040 con 0x559f88c62b40 2024-09-12T12:28:39.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.267+0000 7f473d7fa640 1 -- 172.21.15.33:0/749262251 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4750004e60 con 0x559f88c62b40 2024-09-12T12:28:39.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.267+0000 7f473d7fa640 1 -- 172.21.15.33:0/749262251 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475001f040 con 0x559f88c62b40 2024-09-12T12:28:39.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.268+0000 7f476037c740 1 -- 172.21.15.33:0/749262251 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f88c62b40 msgr2=0x559f88c6d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:39.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.268+0000 7f476037c740 1 --2- 172.21.15.33:0/749262251 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f88c62b40 0x559f88c6d760 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4750028040 tx=0x7f47500045f0 comp rx=0 tx=0).stop 2024-09-12T12:28:39.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.269+0000 7f476037c740 1 -- 172.21.15.33:0/749262251 shutdown_connections 2024-09-12T12:28:39.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.269+0000 7f476037c740 1 --2- 172.21.15.33:0/749262251 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f88c62b40 0x559f88c6d760 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:39.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.269+0000 7f476037c740 1 --2- 172.21.15.33:0/749262251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f88c615d0 0x559f88c67f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:39.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.269+0000 7f476037c740 1 --2- 172.21.15.33:0/749262251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f88c2a310 0x559f88c642f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:39.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.269+0000 7f476037c740 1 -- 172.21.15.33:0/749262251 >> 172.21.15.33:0/749262251 conn(0x559f88c695e0 msgr2=0x559f88c67810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:39.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.269+0000 7f476037c740 1 -- 172.21.15.33:0/749262251 shutdown_connections 2024-09-12T12:28:39.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.270+0000 7f476037c740 1 -- 172.21.15.33:0/749262251 wait complete. 2024-09-12T12:28:39.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.270+0000 7f476037c740 1 -- start start 2024-09-12T12:28:39.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.270+0000 7f476037c740 1 Processor -- start 2024-09-12T12:28:39.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.271+0000 7f476037c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f88c2a310 0x559f88c8bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:39.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.271+0000 7f476037c740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f88c615d0 0x559f88c8c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:39.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.271+0000 7f476037c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f88c62b40 0x559f88c8c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:39.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.272+0000 7f4756ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f88c615d0 0x559f88c8c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:39.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.272+0000 7f4756ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f88c615d0 0x559f88c8c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:41970/0 (socket says 172.21.15.33:41970) 2024-09-12T12:28:39.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.272+0000 7f4756ffd640 1 -- 172.21.15.33:0/4288431101 learned_addr learned my addr 172.21.15.33:0/4288431101 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:28:39.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.272+0000 7f476037c740 1 -- 172.21.15.33:0/4288431101 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f47581aae80 con 0x559f88c2a310 2024-09-12T12:28:39.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.272+0000 7f4757fff640 1 --2- 172.21.15.33:0/4288431101 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f88c62b40 0x559f88c8c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:39.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.272+0000 7f476037c740 1 -- 172.21.15.33:0/4288431101 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f47581ac2f0 con 0x559f88c62b40 2024-09-12T12:28:39.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.272+0000 7f476037c740 1 -- 172.21.15.33:0/4288431101 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f47581ab550 con 0x559f88c615d0 2024-09-12T12:28:39.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.272+0000 7f476037c740 10 client.0 _ll_register_callbacks cb 0x7f4748009510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:28:39.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.272+0000 7f47577fe640 1 --2- 172.21.15.33:0/4288431101 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f88c2a310 0x559f88c8bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:39.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.275+0000 7f4756ffd640 1 -- 172.21.15.33:0/4288431101 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f88c62b40 msgr2=0x559f88c8c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:39.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.275+0000 7f4756ffd640 1 --2- 172.21.15.33:0/4288431101 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f88c62b40 0x559f88c8c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:39.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.275+0000 7f4756ffd640 1 -- 172.21.15.33:0/4288431101 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f88c2a310 msgr2=0x559f88c8bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:39.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.275+0000 7f4756ffd640 1 --2- 172.21.15.33:0/4288431101 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f88c2a310 0x559f88c8bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:39.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.275+0000 7f4756ffd640 1 -- 172.21.15.33:0/4288431101 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f88c5d4f0 con 0x559f88c615d0 2024-09-12T12:28:39.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.275+0000 7f47577fe640 1 --2- 172.21.15.33:0/4288431101 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f88c2a310 0x559f88c8bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:28:39.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.275+0000 7f4756ffd640 1 --2- 172.21.15.33:0/4288431101 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f88c615d0 0x559f88c8c480 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f474809b6b0 tx=0x7f474809bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c99aa7a6ea824a8f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:39.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.275+0000 7f4736ffd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:28:39.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.275+0000 7f4736ffd640 1 -- 172.21.15.33:0/4288431101 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47480b4060 con 0x559f88c615d0 2024-09-12T12:28:39.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.276+0000 7f4736ffd640 1 -- 172.21.15.33:0/4288431101 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f474809ab70 con 0x559f88c615d0 2024-09-12T12:28:39.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.276+0000 7f476037c740 1 -- 172.21.15.33:0/4288431101 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4750004e60 con 0x559f88c615d0 2024-09-12T12:28:39.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.276+0000 7f4736ffd640 1 -- 172.21.15.33:0/4288431101 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f47480b9050 con 0x559f88c615d0 2024-09-12T12:28:39.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.276+0000 7f476037c740 10 client.25315 fetch_fsmap learned FSMap version 26 2024-09-12T12:28:39.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.276+0000 7f476037c740 1 -- 172.21.15.33:0/4288431101 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x559f88cef320 con 0x559f88c615d0 2024-09-12T12:28:39.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.277+0000 7f4736ffd640 1 -- 172.21.15.33:0/4288431101 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f47480a4390 con 0x559f88c615d0 2024-09-12T12:28:39.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.278+0000 7f4736ffd640 1 -- 172.21.15.33:0/4288431101 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f47480a0c60 con 0x559f88c615d0 2024-09-12T12:28:39.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.278+0000 7f476037c740 10 client.25315 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:28:39.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.278+0000 7f476037c740 10 client.25315 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-12T12:28:39.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.278+0000 7f476037c740 20 client.25315 populate_metadata read hostname 'smithi033' 2024-09-12T12:28:39.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.278+0000 7f476037c740 1 --2- 172.21.15.33:0/4288431101 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x559f88c6c370 0x559f88cf1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:39.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.278+0000 7f476037c740 4 client.25315 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:28:39.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.278+0000 7f476037c740 1 -- 172.21.15.33:0/4288431101 --> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f4750004e60 con 0x559f88c6c370 2024-09-12T12:28:39.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.279+0000 7f47577fe640 1 --2- 172.21.15.33:0/4288431101 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x559f88c6c370 0x559f88cf1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:39.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.280+0000 7f47577fe640 1 --2- 172.21.15.33:0/4288431101 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x559f88c6c370 0x559f88cf1a60 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ec6e745d5d7d402f server_cookie=4a11fad99c9121f2 in_seq=0 out_seq=0 2024-09-12T12:28:39.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.281+0000 7f4736ffd640 10 client.25315 ms_handle_connect on v2:172.21.15.102:6836/2409953270 2024-09-12T12:28:39.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.281+0000 7f4736ffd640 1 -- 172.21.15.33:0/4288431101 <== mds.1 v2:172.21.15.102:6836/2409953270 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f4750004e60 con 0x559f88c6c370 2024-09-12T12:28:39.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.281+0000 7f4736ffd640 10 client.25315 handle_command_reply: tid=0 2024-09-12T12:28:39.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.281+0000 7f476037c740 1 client.25315 shutdown 2024-09-12T12:28:39.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.282+0000 7f476037c740 1 -- 172.21.15.33:0/4288431101 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f88c615d0 msgr2=0x559f88c8c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:39.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.282+0000 7f476037c740 1 --2- 172.21.15.33:0/4288431101 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f88c615d0 0x559f88c8c480 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f474809b6b0 tx=0x7f474809bf60 comp rx=0 tx=0).stop 2024-09-12T12:28:39.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.283+0000 7f476037c740 1 -- 172.21.15.33:0/4288431101 shutdown_connections 2024-09-12T12:28:39.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.283+0000 7f476037c740 1 --2- 172.21.15.33:0/4288431101 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f88c62b40 0x559f88c8c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:39.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.283+0000 7f476037c740 1 --2- 172.21.15.33:0/4288431101 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x559f88c6c370 0x559f88cf1a60 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:39.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.283+0000 7f476037c740 1 --2- 172.21.15.33:0/4288431101 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f88c615d0 0x559f88c8c480 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:39.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.283+0000 7f476037c740 1 --2- 172.21.15.33:0/4288431101 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f88c2a310 0x559f88c8bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:39.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.283+0000 7f476037c740 1 -- 172.21.15.33:0/4288431101 >> 172.21.15.33:0/4288431101 conn(0x559f88c695e0 msgr2=0x559f88c68030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:39.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.283+0000 7f4736ffd640 0 client.25315 ms_handle_reset on v2:172.21.15.102:6836/2409953270 2024-09-12T12:28:39.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.283+0000 7f476037c740 1 -- 172.21.15.33:0/4288431101 shutdown_connections 2024-09-12T12:28:39.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.283+0000 7f476037c740 1 -- 172.21.15.33:0/4288431101 wait complete. 2024-09-12T12:28:39.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.283+0000 7f476037c740 20 client.25315 trim_cache size 0 max 16384 2024-09-12T12:28:39.285 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-09-12T12:28:39.285 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:28:39 smithi033 ceph-mon[31246]: pgmap v429: 129 pgs: 129 active+clean; 10 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 66 MiB/s wr, 1.06k op/s 2024-09-12T12:28:39.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.284+0000 7f475dfa3640 1 -- 172.21.15.33:0/564301592 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f47400a2ad0 msgr2=0x7f47400a4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:39.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.284+0000 7f475dfa3640 1 --2- 172.21.15.33:0/564301592 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f47400a2ad0 0x7f47400a4f90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f474c006010 tx=0x7f474c0363f0 comp rx=0 tx=0).stop 2024-09-12T12:28:39.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.284+0000 7f475dfa3640 1 -- 172.21.15.33:0/564301592 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47581027a0 msgr2=0x7f4758196790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:39.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.284+0000 7f475dfa3640 1 --2- 172.21.15.33:0/564301592 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47581027a0 0x7f4758196790 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f474800ea60 tx=0x7f474800ef20 comp rx=0 tx=0).stop 2024-09-12T12:28:39.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.284+0000 7f475dfa3640 1 -- 172.21.15.33:0/564301592 shutdown_connections 2024-09-12T12:28:39.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.284+0000 7f475dfa3640 1 --2- 172.21.15.33:0/564301592 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f47400a2ad0 0x7f47400a4f90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:39.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.284+0000 7f475dfa3640 1 --2- 172.21.15.33:0/564301592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4758106f20 0x7f475819ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:39.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.284+0000 7f475dfa3640 1 --2- 172.21.15.33:0/564301592 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47581027a0 0x7f4758196790 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:39.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.284+0000 7f475dfa3640 1 --2- 172.21.15.33:0/564301592 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4758101df0 0x7f4758196250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:39.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.284+0000 7f475dfa3640 1 -- 172.21.15.33:0/564301592 >> 172.21.15.33:0/564301592 conn(0x7f47580fd8b0 msgr2=0x7f47580fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:39.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.284+0000 7f475dfa3640 1 -- 172.21.15.33:0/564301592 shutdown_connections 2024-09-12T12:28:39.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:39.285+0000 7f475dfa3640 1 -- 172.21.15.33:0/564301592 wait complete. 2024-09-12T12:28:39.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:28:39 smithi043 ceph-mon[34144]: pgmap v429: 129 pgs: 129 active+clean; 10 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 66 MiB/s wr, 1.06k op/s 2024-09-12T12:28:39.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:28:39 smithi102 ceph-mon[34799]: pgmap v429: 129 pgs: 129 active+clean; 10 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 66 MiB/s wr, 1.06k op/s 2024-09-12T12:28:40.140 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T12:28:40.616 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:28:41.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:28:41 smithi043 ceph-mon[34144]: pgmap v430: 129 pgs: 129 active+clean; 10 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 51 MiB/s wr, 820 op/s 2024-09-12T12:28:41.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:28:41 smithi102 ceph-mon[34799]: pgmap v430: 129 pgs: 129 active+clean; 10 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 51 MiB/s wr, 820 op/s 2024-09-12T12:28:41.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:28:41 smithi033 ceph-mon[31246]: pgmap v430: 129 pgs: 129 active+clean; 10 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 51 MiB/s wr, 820 op/s 2024-09-12T12:28:43.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:28:43 smithi043 ceph-mon[34144]: pgmap v431: 129 pgs: 129 active+clean; 10 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 53 MiB/s wr, 859 op/s 2024-09-12T12:28:43.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:28:43 smithi102 ceph-mon[34799]: pgmap v431: 129 pgs: 129 active+clean; 10 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 53 MiB/s wr, 859 op/s 2024-09-12T12:28:43.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:28:43 smithi033 ceph-mon[31246]: pgmap v431: 129 pgs: 129 active+clean; 10 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 53 MiB/s wr, 859 op/s 2024-09-12T12:28:43.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.285+0000 7f8c8fb57640 1 -- 172.21.15.33:0/486748841 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c88102ef0 msgr2=0x7f8c8810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:43.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.285+0000 7f8c8fb57640 1 --2- 172.21.15.33:0/486748841 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c88102ef0 0x7f8c8810da40 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f8c80009ca0 tx=0x7f8c8002a950 comp rx=0 tx=0).stop 2024-09-12T12:28:43.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.285+0000 7f8c8fb57640 1 -- 172.21.15.33:0/486748841 shutdown_connections 2024-09-12T12:28:43.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.285+0000 7f8c8fb57640 1 --2- 172.21.15.33:0/486748841 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c88102ef0 0x7f8c8810da40 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:43.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.285+0000 7f8c8fb57640 1 --2- 172.21.15.33:0/486748841 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c88102570 0x7f8c881029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:43.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.285+0000 7f8c8fb57640 1 --2- 172.21.15.33:0/486748841 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c88100e20 0x7f8c88101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:43.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.285+0000 7f8c8fb57640 1 -- 172.21.15.33:0/486748841 >> 172.21.15.33:0/486748841 conn(0x7f8c880fc7d0 msgr2=0x7f8c880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:43.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.285+0000 7f8c8fb57640 1 -- 172.21.15.33:0/486748841 shutdown_connections 2024-09-12T12:28:43.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.285+0000 7f8c8fb57640 1 -- 172.21.15.33:0/486748841 wait complete. 2024-09-12T12:28:43.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.286+0000 7f8c8fb57640 1 Processor -- start 2024-09-12T12:28:43.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.286+0000 7f8c8fb57640 1 -- start start 2024-09-12T12:28:43.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.286+0000 7f8c8fb57640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c88100e20 0x7f8c881972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:43.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.286+0000 7f8c8fb57640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c88102570 0x7f8c881977e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:43.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.286+0000 7f8c8fb57640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c88102ef0 0x7f8c8819bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:43.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.286+0000 7f8c8fb57640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8c88110e30 con 0x7f8c88102570 2024-09-12T12:28:43.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.286+0000 7f8c8fb57640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8c88110cb0 con 0x7f8c88100e20 2024-09-12T12:28:43.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.286+0000 7f8c8fb57640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8c88110fb0 con 0x7f8c88102ef0 2024-09-12T12:28:43.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.286+0000 7f8c8d0f2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c88102570 0x7f8c881977e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:43.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.286+0000 7f8c8d0f2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c88102570 0x7f8c881977e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34766/0 (socket says 172.21.15.33:34766) 2024-09-12T12:28:43.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.286+0000 7f8c8d8f3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c88100e20 0x7f8c881972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:43.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.286+0000 7f8c8d0f2640 1 -- 172.21.15.33:0/592299144 learned_addr learned my addr 172.21.15.33:0/592299144 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:28:43.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.286+0000 7f8c8e0f4640 1 --2- 172.21.15.33:0/592299144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c88102ef0 0x7f8c8819bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:43.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.287+0000 7f8c8d0f2640 1 -- 172.21.15.33:0/592299144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c88102ef0 msgr2=0x7f8c8819bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:43.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.287+0000 7f8c8d0f2640 1 --2- 172.21.15.33:0/592299144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c88102ef0 0x7f8c8819bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:43.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.287+0000 7f8c8d0f2640 1 -- 172.21.15.33:0/592299144 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c88100e20 msgr2=0x7f8c881972a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:43.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.287+0000 7f8c8d0f2640 1 --2- 172.21.15.33:0/592299144 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c88100e20 0x7f8c881972a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:43.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.287+0000 7f8c8d0f2640 1 -- 172.21.15.33:0/592299144 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c8819c250 con 0x7f8c88102570 2024-09-12T12:28:43.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.287+0000 7f8c8d0f2640 1 --2- 172.21.15.33:0/592299144 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c88102570 0x7f8c881977e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f8c7800d950 tx=0x7f8c7800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:43.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.287+0000 7f8c7effd640 1 -- 172.21.15.33:0/592299144 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c78017030 con 0x7f8c88102570 2024-09-12T12:28:43.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.287+0000 7f8c7effd640 1 -- 172.21.15.33:0/592299144 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8c78004020 con 0x7f8c88102570 2024-09-12T12:28:43.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.287+0000 7f8c8fb57640 1 -- 172.21.15.33:0/592299144 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c8819c540 con 0x7f8c88102570 2024-09-12T12:28:43.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.287+0000 7f8c7effd640 1 -- 172.21.15.33:0/592299144 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c780047a0 con 0x7f8c88102570 2024-09-12T12:28:43.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.287+0000 7f8c8fb57640 1 -- 172.21.15.33:0/592299144 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c88069f70 con 0x7f8c88102570 2024-09-12T12:28:43.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.289+0000 7f8c7effd640 1 -- 172.21.15.33:0/592299144 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f8c780041d0 con 0x7f8c88102570 2024-09-12T12:28:43.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.290+0000 7f8c91f30740 1 Processor -- start 2024-09-12T12:28:43.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.290+0000 7f8c91f30740 1 -- start start 2024-09-12T12:28:43.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.290+0000 7f8c91f30740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcb645b40 0x556bcb644090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:43.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.290+0000 7f8c91f30740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556bcb6445d0 0x556bcb644a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:43.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.290+0000 7f8c91f30740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556bcb64f370 0x556bcb651760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:43.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.290+0000 7f8c91f30740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x556bcb5aa2f0 con 0x556bcb645b40 2024-09-12T12:28:43.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.290+0000 7f8c91f30740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556bcb551cf0 con 0x556bcb64f370 2024-09-12T12:28:43.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.290+0000 7f8c91f30740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556bcb5a62b0 con 0x556bcb6445d0 2024-09-12T12:28:43.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.290+0000 7f8c8e0f4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcb645b40 0x556bcb644090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:43.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.290+0000 7f8c7effd640 1 --2- 172.21.15.33:0/592299144 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f8c740a2b80 0x7f8c740a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:43.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.290+0000 7f8c8e0f4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcb645b40 0x556bcb644090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34776/0 (socket says 172.21.15.33:34776) 2024-09-12T12:28:43.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.290+0000 7f8c8e0f4640 1 -- 172.21.15.33:0/3579733059 learned_addr learned my addr 172.21.15.33:0/3579733059 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:28:43.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.290+0000 7f8c8d8f3640 1 --2- 172.21.15.33:0/3579733059 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556bcb6445d0 0x556bcb644a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:43.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.290+0000 7f8c8d0f2640 1 --2- 172.21.15.33:0/3579733059 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556bcb64f370 0x556bcb651760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:43.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.291+0000 7f8c8e0f4640 1 --2- 172.21.15.33:0/592299144 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f8c740a2b80 0x7f8c740a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:43.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.291+0000 7f8c7effd640 1 -- 172.21.15.33:0/592299144 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f8c780cedd0 con 0x7f8c88102570 2024-09-12T12:28:43.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.291+0000 7f8c8d8f3640 1 -- 172.21.15.33:0/3579733059 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556bcb64f370 msgr2=0x556bcb651760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:43.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.291+0000 7f8c8d8f3640 1 --2- 172.21.15.33:0/3579733059 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556bcb64f370 0x556bcb651760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:43.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.291+0000 7f8c8d8f3640 1 -- 172.21.15.33:0/3579733059 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcb645b40 msgr2=0x556bcb644090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:43.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.291+0000 7f8c8d8f3640 1 --2- 172.21.15.33:0/3579733059 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcb645b40 0x556bcb644090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:43.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.291+0000 7f8c8d8f3640 1 -- 172.21.15.33:0/3579733059 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bcb5363a0 con 0x556bcb6445d0 2024-09-12T12:28:43.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.291+0000 7f8c8e0f4640 1 --2- 172.21.15.33:0/3579733059 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcb645b40 0x556bcb644090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:28:43.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.291+0000 7f8c8d8f3640 1 --2- 172.21.15.33:0/3579733059 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556bcb6445d0 0x556bcb644a10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8c84004630 tx=0x7f8c8400bb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecd2eaed63333636 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:43.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.291+0000 7f8c8e0f4640 1 --2- 172.21.15.33:0/592299144 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f8c740a2b80 0x7f8c740a5040 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8c80009a60 tx=0x7f8c8002a950 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:43.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.291+0000 7f8c73fff640 1 -- 172.21.15.33:0/3579733059 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c84003bd0 con 0x556bcb6445d0 2024-09-12T12:28:43.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.291+0000 7f8c73fff640 1 -- 172.21.15.33:0/3579733059 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8c84015070 con 0x556bcb6445d0 2024-09-12T12:28:43.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.291+0000 7f8c73fff640 1 -- 172.21.15.33:0/3579733059 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c84004c80 con 0x556bcb6445d0 2024-09-12T12:28:43.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.292+0000 7f8c91f30740 1 -- 172.21.15.33:0/3579733059 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556bcb6445d0 msgr2=0x556bcb644a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:43.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.292+0000 7f8c91f30740 1 --2- 172.21.15.33:0/3579733059 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556bcb6445d0 0x556bcb644a10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8c84004630 tx=0x7f8c8400bb20 comp rx=0 tx=0).stop 2024-09-12T12:28:43.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.292+0000 7f8c91f30740 1 -- 172.21.15.33:0/3579733059 shutdown_connections 2024-09-12T12:28:43.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.292+0000 7f8c91f30740 1 --2- 172.21.15.33:0/3579733059 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556bcb64f370 0x556bcb651760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:43.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.292+0000 7f8c91f30740 1 --2- 172.21.15.33:0/3579733059 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556bcb6445d0 0x556bcb644a10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:43.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.292+0000 7f8c91f30740 1 --2- 172.21.15.33:0/3579733059 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcb645b40 0x556bcb644090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:43.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.292+0000 7f8c91f30740 1 -- 172.21.15.33:0/3579733059 >> 172.21.15.33:0/3579733059 conn(0x556bcb60d310 msgr2=0x556bcb640c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:43.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.292+0000 7f8c91f30740 1 -- 172.21.15.33:0/3579733059 shutdown_connections 2024-09-12T12:28:43.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.292+0000 7f8c91f30740 1 -- 172.21.15.33:0/3579733059 wait complete. 2024-09-12T12:28:43.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.292+0000 7f8c91f30740 1 -- start start 2024-09-12T12:28:43.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.292+0000 7f8c91f30740 1 Processor -- start 2024-09-12T12:28:43.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.293+0000 7f8c91f30740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556bcb6445d0 0x556bcb64ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:43.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.293+0000 7f8c91f30740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcb645b40 0x556bcb64bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:43.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.293+0000 7f8c91f30740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556bcb64f370 0x556bcb64c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:43.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.293+0000 7f8c91f30740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x556bcb652070 con 0x556bcb645b40 2024-09-12T12:28:43.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.293+0000 7f8c91f30740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556bcb565060 con 0x556bcb64f370 2024-09-12T12:28:43.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.293+0000 7f8c91f30740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556bcb6521f0 con 0x556bcb6445d0 2024-09-12T12:28:43.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.293+0000 7f8c91f30740 10 client.0 _ll_register_callbacks cb 0x556bcb2b88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:28:43.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.293+0000 7f8c8d0f2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcb645b40 0x556bcb64bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:43.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.293+0000 7f8c8d0f2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcb645b40 0x556bcb64bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34788/0 (socket says 172.21.15.33:34788) 2024-09-12T12:28:43.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.293+0000 7f8c8d0f2640 1 -- 172.21.15.33:0/2948633166 learned_addr learned my addr 172.21.15.33:0/2948633166 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:28:43.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.293+0000 7f8c8e0f4640 1 --2- 172.21.15.33:0/2948633166 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556bcb64f370 0x556bcb64c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:43.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.293+0000 7f8c8d0f2640 1 -- 172.21.15.33:0/2948633166 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556bcb6445d0 msgr2=0x556bcb64ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:43.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.293+0000 7f8c8d8f3640 1 --2- 172.21.15.33:0/2948633166 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556bcb6445d0 0x556bcb64ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:43.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.293+0000 7f8c8d0f2640 1 --2- 172.21.15.33:0/2948633166 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556bcb6445d0 0x556bcb64ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:43.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.293+0000 7f8c8d0f2640 1 -- 172.21.15.33:0/2948633166 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556bcb64f370 msgr2=0x556bcb64c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:43.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.293+0000 7f8c8d0f2640 1 --2- 172.21.15.33:0/2948633166 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556bcb64f370 0x556bcb64c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:43.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.293+0000 7f8c8d0f2640 1 -- 172.21.15.33:0/2948633166 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556bcb31b3c0 con 0x556bcb645b40 2024-09-12T12:28:43.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.293+0000 7f8c8d8f3640 1 --2- 172.21.15.33:0/2948633166 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556bcb6445d0 0x556bcb64ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:28:43.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.293+0000 7f8c8d0f2640 1 --2- 172.21.15.33:0/2948633166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcb645b40 0x556bcb64bfe0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f8c78097c10 tx=0x7f8c7806a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b84dde381f3bf013 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:43.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.293+0000 7f8c717fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:28:43.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.294+0000 7f8c717fa640 1 -- 172.21.15.33:0/2948633166 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7809f5f0 con 0x556bcb645b40 2024-09-12T12:28:43.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.294+0000 7f8c717fa640 1 -- 172.21.15.33:0/2948633166 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f8c780a3a20 con 0x556bcb645b40 2024-09-12T12:28:43.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.294+0000 7f8c91f30740 1 -- 172.21.15.33:0/2948633166 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c84015070 con 0x556bcb645b40 2024-09-12T12:28:43.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.294+0000 7f8c717fa640 1 -- 172.21.15.33:0/2948633166 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8c780a3eb0 con 0x556bcb645b40 2024-09-12T12:28:43.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.294+0000 7f8c91f30740 10 client.15606 fetch_fsmap learned FSMap version 26 2024-09-12T12:28:43.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.294+0000 7f8c91f30740 1 -- 172.21.15.33:0/2948633166 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556bcb65dad0 con 0x556bcb645b40 2024-09-12T12:28:43.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.294+0000 7f8c717fa640 1 -- 172.21.15.33:0/2948633166 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8c84015070 con 0x556bcb645b40 2024-09-12T12:28:43.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.294+0000 7f8c717fa640 1 -- 172.21.15.33:0/2948633166 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f8c7809f130 con 0x556bcb645b40 2024-09-12T12:28:43.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.294+0000 7f8c91f30740 10 client.15606 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:28:43.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.294+0000 7f8c91f30740 10 client.15606 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:28:43.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.294+0000 7f8c91f30740 20 client.15606 populate_metadata read hostname 'smithi033' 2024-09-12T12:28:43.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.294+0000 7f8c91f30740 1 --2- 172.21.15.33:0/2948633166 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x556bcb65efe0 0x556bcb661450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:43.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.294+0000 7f8c91f30740 4 client.15606 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:28:43.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.294+0000 7f8c91f30740 1 -- 172.21.15.33:0/2948633166 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556bcb5b7860 con 0x556bcb65efe0 2024-09-12T12:28:43.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.294+0000 7f8c8d8f3640 1 --2- 172.21.15.33:0/2948633166 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x556bcb65efe0 0x556bcb661450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:43.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.295+0000 7f8c8d8f3640 1 --2- 172.21.15.33:0/2948633166 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x556bcb65efe0 0x556bcb661450 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb4b7183bee9300f server_cookie=9eb5978acd0c5d85 in_seq=0 out_seq=0 2024-09-12T12:28:43.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.295+0000 7f8c717fa640 10 client.15606 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:28:43.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.295+0000 7f8c717fa640 1 -- 172.21.15.33:0/2948633166 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556bcb5b7860 con 0x556bcb65efe0 2024-09-12T12:28:43.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.295+0000 7f8c717fa640 10 client.15606 handle_command_reply: tid=0 2024-09-12T12:28:43.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.296+0000 7f8c91f30740 1 client.15606 shutdown 2024-09-12T12:28:43.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.296+0000 7f8c91f30740 1 -- 172.21.15.33:0/2948633166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcb645b40 msgr2=0x556bcb64bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:43.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.296+0000 7f8c91f30740 1 --2- 172.21.15.33:0/2948633166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcb645b40 0x556bcb64bfe0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f8c78097c10 tx=0x7f8c7806a1c0 comp rx=0 tx=0).stop 2024-09-12T12:28:43.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.296+0000 7f8c91f30740 1 -- 172.21.15.33:0/2948633166 shutdown_connections 2024-09-12T12:28:43.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.296+0000 7f8c91f30740 1 --2- 172.21.15.33:0/2948633166 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x556bcb65efe0 0x556bcb661450 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:43.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.296+0000 7f8c91f30740 1 --2- 172.21.15.33:0/2948633166 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556bcb64f370 0x556bcb64c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:43.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.296+0000 7f8c91f30740 1 --2- 172.21.15.33:0/2948633166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcb645b40 0x556bcb64bfe0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:43.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.296+0000 7f8c91f30740 1 --2- 172.21.15.33:0/2948633166 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556bcb6445d0 0x556bcb64ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:43.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.296+0000 7f8c91f30740 1 -- 172.21.15.33:0/2948633166 >> 172.21.15.33:0/2948633166 conn(0x556bcb60d310 msgr2=0x556bcb646960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:43.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.296+0000 7f8c717fa640 0 client.15606 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:28:43.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.296+0000 7f8c91f30740 1 -- 172.21.15.33:0/2948633166 shutdown_connections 2024-09-12T12:28:43.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.296+0000 7f8c91f30740 1 -- 172.21.15.33:0/2948633166 wait complete. 2024-09-12T12:28:43.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.296+0000 7f8c91f30740 20 client.15606 trim_cache size 0 max 16384 2024-09-12T12:28:43.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.309+0000 7f8c91f30740 1 Processor -- start 2024-09-12T12:28:43.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.309+0000 7f8c91f30740 1 -- start start 2024-09-12T12:28:43.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.309+0000 7f8c91f30740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556bcb6445d0 0x556bcb65b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:43.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.309+0000 7f8c91f30740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556bcb645b40 0x556bcb657860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:43.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.309+0000 7f8c91f30740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcb64f370 0x556bcb657da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:43.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.309+0000 7f8c91f30740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8c881af190 con 0x556bcb64f370 2024-09-12T12:28:43.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.309+0000 7f8c91f30740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8c881aca60 con 0x556bcb645b40 2024-09-12T12:28:43.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.309+0000 7f8c91f30740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8c881aa8b0 con 0x556bcb6445d0 2024-09-12T12:28:43.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.309+0000 7f8c8e0f4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcb64f370 0x556bcb657da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:43.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.309+0000 7f8c8e0f4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcb64f370 0x556bcb657da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34790/0 (socket says 172.21.15.33:34790) 2024-09-12T12:28:43.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.309+0000 7f8c8e0f4640 1 -- 172.21.15.33:0/254975789 learned_addr learned my addr 172.21.15.33:0/254975789 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:28:43.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.309+0000 7f8c8d8f3640 1 --2- 172.21.15.33:0/254975789 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556bcb6445d0 0x556bcb65b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:43.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.310+0000 7f8c8d0f2640 1 --2- 172.21.15.33:0/254975789 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556bcb645b40 0x556bcb657860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:43.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.310+0000 7f8c8e0f4640 1 -- 172.21.15.33:0/254975789 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556bcb6445d0 msgr2=0x556bcb65b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:43.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.310+0000 7f8c8e0f4640 1 --2- 172.21.15.33:0/254975789 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556bcb6445d0 0x556bcb65b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:43.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.310+0000 7f8c8e0f4640 1 -- 172.21.15.33:0/254975789 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556bcb645b40 msgr2=0x556bcb657860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:43.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.310+0000 7f8c8e0f4640 1 --2- 172.21.15.33:0/254975789 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556bcb645b40 0x556bcb657860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:43.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.310+0000 7f8c8e0f4640 1 -- 172.21.15.33:0/254975789 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bcb64f060 con 0x556bcb64f370 2024-09-12T12:28:43.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.310+0000 7f8c8d0f2640 1 --2- 172.21.15.33:0/254975789 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556bcb645b40 0x556bcb657860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:28:43.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.310+0000 7f8c8e0f4640 1 --2- 172.21.15.33:0/254975789 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcb64f370 0x556bcb657da0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f8c80035000 tx=0x7f8c80005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=736a33b135288471 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:43.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.310+0000 7f8c737fe640 1 -- 172.21.15.33:0/254975789 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c80050070 con 0x556bcb64f370 2024-09-12T12:28:43.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.310+0000 7f8c737fe640 1 -- 172.21.15.33:0/254975789 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8c80003d70 con 0x556bcb64f370 2024-09-12T12:28:43.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.310+0000 7f8c737fe640 1 -- 172.21.15.33:0/254975789 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c80034040 con 0x556bcb64f370 2024-09-12T12:28:43.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.311+0000 7f8c91f30740 1 -- 172.21.15.33:0/254975789 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcb64f370 msgr2=0x556bcb657da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:43.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.311+0000 7f8c91f30740 1 --2- 172.21.15.33:0/254975789 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcb64f370 0x556bcb657da0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f8c80035000 tx=0x7f8c80005c50 comp rx=0 tx=0).stop 2024-09-12T12:28:43.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.311+0000 7f8c91f30740 1 -- 172.21.15.33:0/254975789 shutdown_connections 2024-09-12T12:28:43.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.311+0000 7f8c91f30740 1 --2- 172.21.15.33:0/254975789 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcb64f370 0x556bcb657da0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:43.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.311+0000 7f8c91f30740 1 --2- 172.21.15.33:0/254975789 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556bcb645b40 0x556bcb657860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:43.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.311+0000 7f8c91f30740 1 --2- 172.21.15.33:0/254975789 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556bcb6445d0 0x556bcb65b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:43.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.311+0000 7f8c91f30740 1 -- 172.21.15.33:0/254975789 >> 172.21.15.33:0/254975789 conn(0x556bcb60d310 msgr2=0x556bcb64b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:43.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.311+0000 7f8c91f30740 1 -- 172.21.15.33:0/254975789 shutdown_connections 2024-09-12T12:28:43.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.311+0000 7f8c91f30740 1 -- 172.21.15.33:0/254975789 wait complete. 2024-09-12T12:28:43.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.311+0000 7f8c91f30740 1 -- start start 2024-09-12T12:28:43.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.311+0000 7f8c91f30740 1 Processor -- start 2024-09-12T12:28:43.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.312+0000 7f8c91f30740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556bcb6445d0 0x556bcb6482b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:43.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.312+0000 7f8c91f30740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556bcb645b40 0x556bcb6487f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:43.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.312+0000 7f8c91f30740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcb64f370 0x556bcb648d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:43.677 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-09-12T12:28:43.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.312+0000 7f8c91f30740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8c881aaf20 con 0x556bcb64f370 2024-09-12T12:28:43.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.312+0000 7f8c91f30740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8c881ac390 con 0x556bcb645b40 2024-09-12T12:28:43.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.312+0000 7f8c91f30740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8c881ab5f0 con 0x556bcb6445d0 2024-09-12T12:28:43.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.312+0000 7f8c91f30740 10 client.0 _ll_register_callbacks cb 0x7f8c78097560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:28:43.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.312+0000 7f8c8e0f4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcb64f370 0x556bcb648d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:43.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.312+0000 7f8c8e0f4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcb64f370 0x556bcb648d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34800/0 (socket says 172.21.15.33:34800) 2024-09-12T12:28:43.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.312+0000 7f8c8e0f4640 1 -- 172.21.15.33:0/3003964363 learned_addr learned my addr 172.21.15.33:0/3003964363 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:28:43.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.312+0000 7f8c8d8f3640 1 --2- 172.21.15.33:0/3003964363 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556bcb6445d0 0x556bcb6482b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:43.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.312+0000 7f8c8d0f2640 1 --2- 172.21.15.33:0/3003964363 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556bcb645b40 0x556bcb6487f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:43.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.312+0000 7f8c8e0f4640 1 -- 172.21.15.33:0/3003964363 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556bcb6445d0 msgr2=0x556bcb6482b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:43.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.312+0000 7f8c8e0f4640 1 --2- 172.21.15.33:0/3003964363 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556bcb6445d0 0x556bcb6482b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:43.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.312+0000 7f8c8e0f4640 1 -- 172.21.15.33:0/3003964363 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556bcb645b40 msgr2=0x556bcb6487f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:43.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.312+0000 7f8c8e0f4640 1 --2- 172.21.15.33:0/3003964363 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556bcb645b40 0x556bcb6487f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:43.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.312+0000 7f8c8e0f4640 1 -- 172.21.15.33:0/3003964363 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556bcb649340 con 0x556bcb64f370 2024-09-12T12:28:43.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.312+0000 7f8c8e0f4640 1 --2- 172.21.15.33:0/3003964363 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcb64f370 0x556bcb648d30 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f8c80005e30 tx=0x7f8c800099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f0fd2673354068 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:43.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.312+0000 7f8c717fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:28:43.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.313+0000 7f8c717fa640 1 -- 172.21.15.33:0/3003964363 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c80050040 con 0x556bcb64f370 2024-09-12T12:28:43.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.313+0000 7f8c717fa640 1 -- 172.21.15.33:0/3003964363 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f8c80004130 con 0x556bcb64f370 2024-09-12T12:28:43.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.313+0000 7f8c91f30740 1 -- 172.21.15.33:0/3003964363 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c80003d70 con 0x556bcb64f370 2024-09-12T12:28:43.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.313+0000 7f8c717fa640 1 -- 172.21.15.33:0/3003964363 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8c80068050 con 0x556bcb64f370 2024-09-12T12:28:43.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.313+0000 7f8c91f30740 10 client.15612 fetch_fsmap learned FSMap version 26 2024-09-12T12:28:43.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.313+0000 7f8c91f30740 1 -- 172.21.15.33:0/3003964363 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556bcb6ce0d0 con 0x556bcb64f370 2024-09-12T12:28:43.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.313+0000 7f8c717fa640 1 -- 172.21.15.33:0/3003964363 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8c80003d70 con 0x556bcb64f370 2024-09-12T12:28:43.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.313+0000 7f8c717fa640 1 -- 172.21.15.33:0/3003964363 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f8c8004a040 con 0x556bcb64f370 2024-09-12T12:28:43.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.313+0000 7f8c91f30740 10 client.15612 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:28:43.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.313+0000 7f8c91f30740 10 client.15612 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:28:43.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.313+0000 7f8c91f30740 20 client.15612 populate_metadata read hostname 'smithi033' 2024-09-12T12:28:43.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.313+0000 7f8c91f30740 1 --2- 172.21.15.33:0/3003964363 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x556bcb6ce7f0 0x556bcb6d0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:43.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.313+0000 7f8c91f30740 4 client.15612 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:28:43.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.313+0000 7f8c91f30740 1 -- 172.21.15.33:0/3003964363 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556bcb5b1d70 con 0x556bcb6ce7f0 2024-09-12T12:28:43.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.314+0000 7f8c8d8f3640 1 --2- 172.21.15.33:0/3003964363 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x556bcb6ce7f0 0x556bcb6d0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:43.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.314+0000 7f8c8d8f3640 1 --2- 172.21.15.33:0/3003964363 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x556bcb6ce7f0 0x556bcb6d0c10 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffcf93c12aa092f8 server_cookie=1862716d6c802cd1 in_seq=0 out_seq=0 2024-09-12T12:28:43.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.314+0000 7f8c717fa640 10 client.15612 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:28:43.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.314+0000 7f8c717fa640 1 -- 172.21.15.33:0/3003964363 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556bcb5b1d70 con 0x556bcb6ce7f0 2024-09-12T12:28:43.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.314+0000 7f8c717fa640 10 client.15612 handle_command_reply: tid=0 2024-09-12T12:28:43.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.314+0000 7f8c91f30740 1 client.15612 shutdown 2024-09-12T12:28:43.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.314+0000 7f8c91f30740 1 -- 172.21.15.33:0/3003964363 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcb64f370 msgr2=0x556bcb648d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:43.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.314+0000 7f8c91f30740 1 --2- 172.21.15.33:0/3003964363 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcb64f370 0x556bcb648d30 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f8c80005e30 tx=0x7f8c800099c0 comp rx=0 tx=0).stop 2024-09-12T12:28:43.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.314+0000 7f8c91f30740 1 -- 172.21.15.33:0/3003964363 shutdown_connections 2024-09-12T12:28:43.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.314+0000 7f8c91f30740 1 --2- 172.21.15.33:0/3003964363 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x556bcb6ce7f0 0x556bcb6d0c10 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:43.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.314+0000 7f8c91f30740 1 --2- 172.21.15.33:0/3003964363 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcb64f370 0x556bcb648d30 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:43.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.314+0000 7f8c91f30740 1 --2- 172.21.15.33:0/3003964363 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556bcb645b40 0x556bcb6487f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:43.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.314+0000 7f8c717fa640 0 client.15612 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:28:43.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.314+0000 7f8c91f30740 1 --2- 172.21.15.33:0/3003964363 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556bcb6445d0 0x556bcb6482b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:43.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.314+0000 7f8c91f30740 1 -- 172.21.15.33:0/3003964363 >> 172.21.15.33:0/3003964363 conn(0x556bcb60d310 msgr2=0x556bcb64d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:43.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.314+0000 7f8c91f30740 1 -- 172.21.15.33:0/3003964363 shutdown_connections 2024-09-12T12:28:43.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.314+0000 7f8c91f30740 1 -- 172.21.15.33:0/3003964363 wait complete. 2024-09-12T12:28:43.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.315+0000 7f8c91f30740 20 client.15612 trim_cache size 0 max 16384 2024-09-12T12:28:43.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.315+0000 7f8c8fb57640 1 -- 172.21.15.33:0/592299144 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f8c740a2b80 msgr2=0x7f8c740a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:43.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.315+0000 7f8c8fb57640 1 --2- 172.21.15.33:0/592299144 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f8c740a2b80 0x7f8c740a5040 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8c80009a60 tx=0x7f8c8002a950 comp rx=0 tx=0).stop 2024-09-12T12:28:43.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.315+0000 7f8c8fb57640 1 -- 172.21.15.33:0/592299144 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c88102570 msgr2=0x7f8c881977e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:43.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.315+0000 7f8c8fb57640 1 --2- 172.21.15.33:0/592299144 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c88102570 0x7f8c881977e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f8c7800d950 tx=0x7f8c7800de10 comp rx=0 tx=0).stop 2024-09-12T12:28:43.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.315+0000 7f8c8fb57640 1 -- 172.21.15.33:0/592299144 shutdown_connections 2024-09-12T12:28:43.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.315+0000 7f8c8fb57640 1 --2- 172.21.15.33:0/592299144 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f8c740a2b80 0x7f8c740a5040 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:43.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.315+0000 7f8c8fb57640 1 --2- 172.21.15.33:0/592299144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c88102ef0 0x7f8c8819bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:43.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.315+0000 7f8c8fb57640 1 --2- 172.21.15.33:0/592299144 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c88102570 0x7f8c881977e0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:43.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.315+0000 7f8c8fb57640 1 --2- 172.21.15.33:0/592299144 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c88100e20 0x7f8c881972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:43.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.315+0000 7f8c8fb57640 1 -- 172.21.15.33:0/592299144 >> 172.21.15.33:0/592299144 conn(0x7f8c880fc7d0 msgr2=0x7f8c880febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:43.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.315+0000 7f8c8fb57640 1 -- 172.21.15.33:0/592299144 shutdown_connections 2024-09-12T12:28:43.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:42.315+0000 7f8c8fb57640 1 -- 172.21.15.33:0/592299144 wait complete. 2024-09-12T12:28:45.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:28:45 smithi043 ceph-mon[34144]: pgmap v432: 129 pgs: 129 active+clean; 10 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 56 MiB/s wr, 906 op/s 2024-09-12T12:28:45.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:28:45 smithi102 ceph-mon[34799]: pgmap v432: 129 pgs: 129 active+clean; 10 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 56 MiB/s wr, 906 op/s 2024-09-12T12:28:45.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:28:45 smithi033 ceph-mon[31246]: pgmap v432: 129 pgs: 129 active+clean; 10 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 56 MiB/s wr, 906 op/s 2024-09-12T12:28:47.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:28:47 smithi043 ceph-mon[34144]: pgmap v433: 129 pgs: 129 active+clean; 10 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 44 MiB/s wr, 713 op/s 2024-09-12T12:28:47.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:28:47 smithi102 ceph-mon[34799]: pgmap v433: 129 pgs: 129 active+clean; 10 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 44 MiB/s wr, 713 op/s 2024-09-12T12:28:47.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:28:47 smithi033 ceph-mon[31246]: pgmap v433: 129 pgs: 129 active+clean; 10 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 44 MiB/s wr, 713 op/s 2024-09-12T12:28:49.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:28:49 smithi043 ceph-mon[34144]: pgmap v434: 129 pgs: 129 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 58 MiB/s wr, 937 op/s 2024-09-12T12:28:49.388 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:28:49 smithi033 ceph-mon[31246]: pgmap v434: 129 pgs: 129 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 58 MiB/s wr, 937 op/s 2024-09-12T12:28:49.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:28:49 smithi102 ceph-mon[34799]: pgmap v434: 129 pgs: 129 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 58 MiB/s wr, 937 op/s 2024-09-12T12:28:51.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:28:51 smithi043 ceph-mon[34144]: pgmap v435: 129 pgs: 129 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 45 MiB/s wr, 728 op/s 2024-09-12T12:28:51.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:28:51 smithi102 ceph-mon[34799]: pgmap v435: 129 pgs: 129 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 45 MiB/s wr, 728 op/s 2024-09-12T12:28:51.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:28:51 smithi033 ceph-mon[31246]: pgmap v435: 129 pgs: 129 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 45 MiB/s wr, 728 op/s 2024-09-12T12:28:52.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:28:52 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:28:52.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:28:52 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:28:52.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:28:52 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:28:53.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:28:53 smithi043 ceph-mon[34144]: pgmap v436: 129 pgs: 129 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 48 MiB/s wr, 768 op/s 2024-09-12T12:28:53.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:28:53 smithi102 ceph-mon[34799]: pgmap v436: 129 pgs: 129 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 48 MiB/s wr, 768 op/s 2024-09-12T12:28:53.435 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:28:53 smithi033 ceph-mon[31246]: pgmap v436: 129 pgs: 129 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 48 MiB/s wr, 768 op/s 2024-09-12T12:28:54.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:28:54 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:28:54.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:28:54 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:28:54.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:28:54 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:28:54.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:28:54 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:28:54.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:28:54 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:28:54.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:28:54 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:28:54.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:28:54 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:28:54.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:28:54 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:28:54.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:28:54 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:28:54.490 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T12:28:54.490 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T12:28:54.822 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:28:56.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:28:55 smithi043 ceph-mon[34144]: pgmap v437: 129 pgs: 129 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 49 MiB/s wr, 796 op/s 2024-09-12T12:28:56.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:28:55 smithi102 ceph-mon[34799]: pgmap v437: 129 pgs: 129 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 49 MiB/s wr, 796 op/s 2024-09-12T12:28:56.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:28:55 smithi033 ceph-mon[31246]: pgmap v437: 129 pgs: 129 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 49 MiB/s wr, 796 op/s 2024-09-12T12:28:57.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.087+0000 7f9784320640 1 -- 172.21.15.33:0/107219583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f977c109830 msgr2=0x7f977c109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:57.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.087+0000 7f9784320640 1 --2- 172.21.15.33:0/107219583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f977c109830 0x7f977c109c90 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f9778009860 tx=0x7f977802a340 comp rx=0 tx=0).stop 2024-09-12T12:28:57.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.087+0000 7f9784320640 1 -- 172.21.15.33:0/107219583 shutdown_connections 2024-09-12T12:28:57.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.087+0000 7f9784320640 1 --2- 172.21.15.33:0/107219583 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f977c11b140 0x7f977c11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:57.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.087+0000 7f9784320640 1 --2- 172.21.15.33:0/107219583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f977c109830 0x7f977c109c90 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:57.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.087+0000 7f9784320640 1 --2- 172.21.15.33:0/107219583 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f977c109450 0x7f977c110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:57.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.087+0000 7f9784320640 1 -- 172.21.15.33:0/107219583 >> 172.21.15.33:0/107219583 conn(0x7f977c06e140 msgr2=0x7f977c06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:57.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.088+0000 7f9784320640 1 -- 172.21.15.33:0/107219583 shutdown_connections 2024-09-12T12:28:57.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.088+0000 7f9784320640 1 -- 172.21.15.33:0/107219583 wait complete. 2024-09-12T12:28:57.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.089+0000 7f9784320640 1 Processor -- start 2024-09-12T12:28:57.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.089+0000 7f9784320640 1 -- start start 2024-09-12T12:28:57.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.089+0000 7f9784320640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f977c109450 0x7f977c1a7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:57.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.089+0000 7f9784320640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f977c109830 0x7f977c1a76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:57.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.089+0000 7f9784320640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f977c11b140 0x7f977c1aba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:57.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.089+0000 7f9784320640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f977c120c50 con 0x7f977c11b140 2024-09-12T12:28:57.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.089+0000 7f9784320640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f977c120ad0 con 0x7f977c109830 2024-09-12T12:28:57.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.089+0000 7f9784320640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f977c120dd0 con 0x7f977c109450 2024-09-12T12:28:57.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.089+0000 7f97820bc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f977c109450 0x7f977c1a7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:57.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.089+0000 7f97820bc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f977c109450 0x7f977c1a7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:48186/0 (socket says 172.21.15.33:48186) 2024-09-12T12:28:57.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.089+0000 7f97820bc640 1 -- 172.21.15.33:0/1792700805 learned_addr learned my addr 172.21.15.33:0/1792700805 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:28:57.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.089+0000 7f97828bd640 1 --2- 172.21.15.33:0/1792700805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f977c11b140 0x7f977c1aba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:57.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.089+0000 7f97818bb640 1 --2- 172.21.15.33:0/1792700805 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f977c109830 0x7f977c1a76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:57.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.090+0000 7f97818bb640 1 -- 172.21.15.33:0/1792700805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f977c109450 msgr2=0x7f977c1a7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:57.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.090+0000 7f97818bb640 1 --2- 172.21.15.33:0/1792700805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f977c109450 0x7f977c1a7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:57.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.090+0000 7f97818bb640 1 -- 172.21.15.33:0/1792700805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f977c11b140 msgr2=0x7f977c1aba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:57.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.090+0000 7f97818bb640 1 --2- 172.21.15.33:0/1792700805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f977c11b140 0x7f977c1aba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:57.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.090+0000 7f97818bb640 1 -- 172.21.15.33:0/1792700805 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f977c1ac120 con 0x7f977c109830 2024-09-12T12:28:57.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.090+0000 7f97818bb640 1 --2- 172.21.15.33:0/1792700805 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f977c109830 0x7f977c1a76b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9778035040 tx=0x7f9778030bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:57.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.091+0000 7f97737fe640 1 -- 172.21.15.33:0/1792700805 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9778040020 con 0x7f977c109830 2024-09-12T12:28:57.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.091+0000 7f9784320640 1 -- 172.21.15.33:0/1792700805 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f977c1ac3b0 con 0x7f977c109830 2024-09-12T12:28:57.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.091+0000 7f97737fe640 1 -- 172.21.15.33:0/1792700805 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9778038040 con 0x7f977c109830 2024-09-12T12:28:57.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.091+0000 7f97737fe640 1 -- 172.21.15.33:0/1792700805 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9778037070 con 0x7f977c109830 2024-09-12T12:28:57.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.091+0000 7f9784320640 1 -- 172.21.15.33:0/1792700805 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f977c1b3cf0 con 0x7f977c109830 2024-09-12T12:28:57.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.095+0000 7f97737fe640 1 -- 172.21.15.33:0/1792700805 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9778043020 con 0x7f977c109830 2024-09-12T12:28:57.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.095+0000 7f97866f9740 1 Processor -- start 2024-09-12T12:28:57.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.096+0000 7f97866f9740 1 -- start start 2024-09-12T12:28:57.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.096+0000 7f97866f9740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a07f953b60 0x55a07f953f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:57.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.097+0000 7f97866f9740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a07f954480 0x55a07f95e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:57.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.097+0000 7f97866f9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a07f95ed40 0x55a07f961130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:57.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.097+0000 7f97828bd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a07f953b60 0x55a07f953f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:57.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.097+0000 7f97828bd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a07f953b60 0x55a07f953f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:48202/0 (socket says 172.21.15.33:48202) 2024-09-12T12:28:57.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.097+0000 7f97866f9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a07f8b9280 con 0x55a07f95ed40 2024-09-12T12:28:57.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.097+0000 7f97866f9740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a07f860b10 con 0x55a07f954480 2024-09-12T12:28:57.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.097+0000 7f97866f9740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a07f8b5240 con 0x55a07f953b60 2024-09-12T12:28:57.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.097+0000 7f97828bd640 1 -- 172.21.15.33:0/1963577769 learned_addr learned my addr 172.21.15.33:0/1963577769 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:28:57.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.097+0000 7f97737fe640 1 --2- 172.21.15.33:0/1792700805 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f97680a2c00 0x7f97680a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:57.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.097+0000 7f97820bc640 1 --2- 172.21.15.33:0/1963577769 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a07f954480 0x55a07f95e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:57.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.097+0000 7f97818bb640 1 --2- 172.21.15.33:0/1963577769 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a07f95ed40 0x55a07f961130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:57.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.097+0000 7f97828bd640 1 -- 172.21.15.33:0/1963577769 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a07f954480 msgr2=0x55a07f95e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:57.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.097+0000 7f97828bd640 1 --2- 172.21.15.33:0/1963577769 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a07f954480 0x55a07f95e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:57.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.097+0000 7f97828bd640 1 -- 172.21.15.33:0/1963577769 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a07f95ed40 msgr2=0x55a07f961130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:57.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.097+0000 7f97828bd640 1 --2- 172.21.15.33:0/1963577769 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a07f95ed40 0x55a07f961130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:57.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.097+0000 7f97828bd640 1 -- 172.21.15.33:0/1963577769 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a07f86d1f0 con 0x55a07f953b60 2024-09-12T12:28:57.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.097+0000 7f97818bb640 1 --2- 172.21.15.33:0/1963577769 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a07f95ed40 0x55a07f961130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:28:57.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.097+0000 7f97737fe640 1 -- 172.21.15.33:0/1792700805 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f97780eee70 con 0x7f977c109830 2024-09-12T12:28:57.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.098+0000 7f97828bd640 1 --2- 172.21.15.33:0/1792700805 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f97680a2c00 0x7f97680a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:57.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.098+0000 7f97828bd640 1 --2- 172.21.15.33:0/1963577769 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a07f953b60 0x55a07f953f40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f977400e5a0 tx=0x7f977400ea60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f793f774c86a36e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:57.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.098+0000 7f9770dea640 1 -- 172.21.15.33:0/1963577769 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977400dd70 con 0x55a07f953b60 2024-09-12T12:28:57.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.098+0000 7f9770dea640 1 -- 172.21.15.33:0/1963577769 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f97740198f0 con 0x55a07f953b60 2024-09-12T12:28:57.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.098+0000 7f9770dea640 1 -- 172.21.15.33:0/1963577769 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9774018a70 con 0x55a07f953b60 2024-09-12T12:28:57.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.099+0000 7f97828bd640 1 --2- 172.21.15.33:0/1792700805 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f97680a2c00 0x7f97680a50c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9774021000 tx=0x7f9774018d10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:57.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.099+0000 7f97866f9740 1 -- 172.21.15.33:0/1963577769 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a07f953b60 msgr2=0x55a07f953f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:57.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.099+0000 7f97866f9740 1 --2- 172.21.15.33:0/1963577769 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a07f953b60 0x55a07f953f40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f977400e5a0 tx=0x7f977400ea60 comp rx=0 tx=0).stop 2024-09-12T12:28:57.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.099+0000 7f97866f9740 1 -- 172.21.15.33:0/1963577769 shutdown_connections 2024-09-12T12:28:57.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.099+0000 7f97866f9740 1 --2- 172.21.15.33:0/1963577769 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a07f95ed40 0x55a07f961130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:57.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.100+0000 7f97866f9740 1 --2- 172.21.15.33:0/1963577769 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a07f954480 0x55a07f95e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:57.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.100+0000 7f97866f9740 1 --2- 172.21.15.33:0/1963577769 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a07f953b60 0x55a07f953f40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:57.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.100+0000 7f97866f9740 1 -- 172.21.15.33:0/1963577769 >> 172.21.15.33:0/1963577769 conn(0x55a07f9500f0 msgr2=0x55a07f9504d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:57.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.100+0000 7f97866f9740 1 -- 172.21.15.33:0/1963577769 shutdown_connections 2024-09-12T12:28:57.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.100+0000 7f97866f9740 1 -- 172.21.15.33:0/1963577769 wait complete. 2024-09-12T12:28:57.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.101+0000 7f97866f9740 1 -- start start 2024-09-12T12:28:57.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.101+0000 7f97866f9740 1 Processor -- start 2024-09-12T12:28:57.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.102+0000 7f97866f9740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a07f953b60 0x55a07f95bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:57.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.102+0000 7f97866f9740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a07f954480 0x55a07f95c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:57.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.102+0000 7f97866f9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a07f95ed40 0x55a07f95c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:57.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.102+0000 7f97820bc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a07f953b60 0x55a07f95bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:57.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.102+0000 7f97820bc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a07f953b60 0x55a07f95bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:37830/0 (socket says 172.21.15.33:37830) 2024-09-12T12:28:57.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.102+0000 7f97818bb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a07f954480 0x55a07f95c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:57.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.102+0000 7f97818bb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a07f954480 0x55a07f95c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:48208/0 (socket says 172.21.15.33:48208) 2024-09-12T12:28:57.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.102+0000 7f97820bc640 1 -- 172.21.15.33:0/2768189924 learned_addr learned my addr 172.21.15.33:0/2768189924 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:28:57.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.102+0000 7f97866f9740 1 -- 172.21.15.33:0/2768189924 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a07f961910 con 0x55a07f95ed40 2024-09-12T12:28:57.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.102+0000 7f97866f9740 1 -- 172.21.15.33:0/2768189924 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a07f873f10 con 0x55a07f953b60 2024-09-12T12:28:57.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.102+0000 7f97866f9740 1 -- 172.21.15.33:0/2768189924 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a07f961a90 con 0x55a07f954480 2024-09-12T12:28:57.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.102+0000 7f97866f9740 10 client.0 _ll_register_callbacks cb 0x55a07f83ca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:28:57.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.103+0000 7f97828bd640 1 --2- 172.21.15.33:0/2768189924 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a07f95ed40 0x55a07f95c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:57.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.103+0000 7f97820bc640 1 -- 172.21.15.33:0/2768189924 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a07f954480 msgr2=0x55a07f95c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:57.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.103+0000 7f97820bc640 1 --2- 172.21.15.33:0/2768189924 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a07f954480 0x55a07f95c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:57.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.103+0000 7f97820bc640 1 -- 172.21.15.33:0/2768189924 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a07f95ed40 msgr2=0x55a07f95c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:57.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.103+0000 7f97820bc640 1 --2- 172.21.15.33:0/2768189924 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a07f95ed40 0x55a07f95c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:57.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.103+0000 7f97820bc640 1 -- 172.21.15.33:0/2768189924 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a07f62a6a0 con 0x55a07f953b60 2024-09-12T12:28:57.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.104+0000 7f97820bc640 1 --2- 172.21.15.33:0/2768189924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a07f953b60 0x55a07f95bc20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f976c012760 tx=0x7f976c012c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52708cebeca6db61 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:57.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.104+0000 7f9765ffb640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:28:57.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.104+0000 7f9765ffb640 1 -- 172.21.15.33:0/2768189924 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f976c00f920 con 0x55a07f953b60 2024-09-12T12:28:57.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.104+0000 7f9765ffb640 1 -- 172.21.15.33:0/2768189924 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f976c00fac0 con 0x55a07f953b60 2024-09-12T12:28:57.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.104+0000 7f97866f9740 1 -- 172.21.15.33:0/2768189924 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97740198f0 con 0x55a07f953b60 2024-09-12T12:28:57.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.104+0000 7f9765ffb640 1 -- 172.21.15.33:0/2768189924 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f976c00fcc0 con 0x55a07f953b60 2024-09-12T12:28:57.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.104+0000 7f97866f9740 10 client.25256 fetch_fsmap learned FSMap version 26 2024-09-12T12:28:57.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.104+0000 7f97866f9740 1 -- 172.21.15.33:0/2768189924 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a07f96d510 con 0x55a07f953b60 2024-09-12T12:28:57.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.105+0000 7f9765ffb640 1 -- 172.21.15.33:0/2768189924 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f976c0108e0 con 0x55a07f953b60 2024-09-12T12:28:57.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.105+0000 7f9765ffb640 1 -- 172.21.15.33:0/2768189924 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f976c01c420 con 0x55a07f953b60 2024-09-12T12:28:57.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.105+0000 7f97866f9740 10 client.25256 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:28:57.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.105+0000 7f97866f9740 10 client.25256 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:28:57.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.105+0000 7f97866f9740 20 client.25256 populate_metadata read hostname 'smithi033' 2024-09-12T12:28:57.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.105+0000 7f97866f9740 1 --2- 172.21.15.33:0/2768189924 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55a07f96ea20 0x55a07f970e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:57.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.105+0000 7f97866f9740 4 client.25256 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:28:57.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.105+0000 7f97866f9740 1 -- 172.21.15.33:0/2768189924 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f97740198f0 con 0x55a07f96ea20 2024-09-12T12:28:57.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.106+0000 7f97818bb640 1 --2- 172.21.15.33:0/2768189924 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55a07f96ea20 0x55a07f970e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:57.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.106+0000 7f9765ffb640 10 client.25256 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:28:57.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.106+0000 7f97818bb640 1 --2- 172.21.15.33:0/2768189924 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55a07f96ea20 0x55a07f970e30 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2749c3d11a873903 server_cookie=3c1f00c1be5a3f0c in_seq=0 out_seq=0 2024-09-12T12:28:57.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.107+0000 7f9765ffb640 1 -- 172.21.15.33:0/2768189924 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f97740198f0 con 0x55a07f96ea20 2024-09-12T12:28:57.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.107+0000 7f9765ffb640 10 client.25256 handle_command_reply: tid=0 2024-09-12T12:28:57.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.107+0000 7f97866f9740 1 client.25256 shutdown 2024-09-12T12:28:57.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.107+0000 7f97866f9740 1 -- 172.21.15.33:0/2768189924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a07f953b60 msgr2=0x55a07f95bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:57.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.107+0000 7f97866f9740 1 --2- 172.21.15.33:0/2768189924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a07f953b60 0x55a07f95bc20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f976c012760 tx=0x7f976c012c20 comp rx=0 tx=0).stop 2024-09-12T12:28:57.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.107+0000 7f97866f9740 1 -- 172.21.15.33:0/2768189924 shutdown_connections 2024-09-12T12:28:57.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.108+0000 7f97866f9740 1 --2- 172.21.15.33:0/2768189924 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55a07f96ea20 0x55a07f970e30 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:57.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.108+0000 7f97866f9740 1 --2- 172.21.15.33:0/2768189924 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a07f95ed40 0x55a07f95c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:57.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.108+0000 7f97866f9740 1 --2- 172.21.15.33:0/2768189924 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a07f954480 0x55a07f95c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:57.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.108+0000 7f97866f9740 1 --2- 172.21.15.33:0/2768189924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a07f953b60 0x55a07f95bc20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:57.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.108+0000 7f9765ffb640 0 client.25256 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:28:57.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.108+0000 7f97866f9740 1 -- 172.21.15.33:0/2768189924 >> 172.21.15.33:0/2768189924 conn(0x55a07f9500f0 msgr2=0x55a07f94f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:57.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.108+0000 7f97866f9740 1 -- 172.21.15.33:0/2768189924 shutdown_connections 2024-09-12T12:28:57.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.108+0000 7f97866f9740 1 -- 172.21.15.33:0/2768189924 wait complete. 2024-09-12T12:28:57.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.108+0000 7f97866f9740 20 client.25256 trim_cache size 0 max 16384 2024-09-12T12:28:57.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.146+0000 7f97866f9740 1 Processor -- start 2024-09-12T12:28:57.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.146+0000 7f97866f9740 1 -- start start 2024-09-12T12:28:57.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.146+0000 7f97866f9740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a07f953b60 0x55a07f9565c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:57.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.146+0000 7f97866f9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a07f954480 0x55a07f976700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:57.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.147+0000 7f97820bc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a07f953b60 0x55a07f9565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:57.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.147+0000 7f97820bc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a07f953b60 0x55a07f9565c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:37838/0 (socket says 172.21.15.33:37838) 2024-09-12T12:28:57.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.147+0000 7f97820bc640 1 -- 172.21.15.33:0/2478729956 learned_addr learned my addr 172.21.15.33:0/2478729956 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:28:57.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.147+0000 7f97866f9740 1 --2- 172.21.15.33:0/2478729956 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a07f95ed40 0x55a07f976c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:57.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.147+0000 7f97866f9740 1 -- 172.21.15.33:0/2478729956 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f977c1c02a0 con 0x55a07f954480 2024-09-12T12:28:57.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.147+0000 7f97818bb640 1 --2- 172.21.15.33:0/2478729956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a07f954480 0x55a07f976700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:57.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.147+0000 7f97866f9740 1 -- 172.21.15.33:0/2478729956 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f977c1bdb70 con 0x55a07f953b60 2024-09-12T12:28:57.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.147+0000 7f97866f9740 1 -- 172.21.15.33:0/2478729956 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f977c1bb9c0 con 0x55a07f95ed40 2024-09-12T12:28:57.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.147+0000 7f97828bd640 1 --2- 172.21.15.33:0/2478729956 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a07f95ed40 0x55a07f976c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:57.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.148+0000 7f97820bc640 1 -- 172.21.15.33:0/2478729956 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a07f95ed40 msgr2=0x55a07f976c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:57.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.148+0000 7f97820bc640 1 --2- 172.21.15.33:0/2478729956 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a07f95ed40 0x55a07f976c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:57.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.148+0000 7f97820bc640 1 -- 172.21.15.33:0/2478729956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a07f954480 msgr2=0x55a07f976700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:57.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.148+0000 7f97820bc640 1 --2- 172.21.15.33:0/2478729956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a07f954480 0x55a07f976700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:57.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.148+0000 7f97820bc640 1 -- 172.21.15.33:0/2478729956 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a07f94fb90 con 0x55a07f953b60 2024-09-12T12:28:57.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.149+0000 7f97820bc640 1 --2- 172.21.15.33:0/2478729956 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a07f953b60 0x55a07f9565c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f976c009300 tx=0x7f976c009330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e791ceec0d0c53e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:57.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.149+0000 7f9767fff640 1 -- 172.21.15.33:0/2478729956 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f976c00fe60 con 0x55a07f953b60 2024-09-12T12:28:57.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.149+0000 7f9767fff640 1 -- 172.21.15.33:0/2478729956 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f976c0122e0 con 0x55a07f953b60 2024-09-12T12:28:57.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.149+0000 7f9767fff640 1 -- 172.21.15.33:0/2478729956 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f976c01c680 con 0x55a07f953b60 2024-09-12T12:28:57.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.150+0000 7f97866f9740 1 -- 172.21.15.33:0/2478729956 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a07f953b60 msgr2=0x55a07f9565c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:57.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.150+0000 7f97866f9740 1 --2- 172.21.15.33:0/2478729956 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a07f953b60 0x55a07f9565c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f976c009300 tx=0x7f976c009330 comp rx=0 tx=0).stop 2024-09-12T12:28:57.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.150+0000 7f97866f9740 1 -- 172.21.15.33:0/2478729956 shutdown_connections 2024-09-12T12:28:57.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.150+0000 7f97866f9740 1 --2- 172.21.15.33:0/2478729956 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a07f95ed40 0x55a07f976c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:57.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.150+0000 7f97866f9740 1 --2- 172.21.15.33:0/2478729956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a07f954480 0x55a07f976700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:57.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.150+0000 7f97866f9740 1 --2- 172.21.15.33:0/2478729956 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a07f953b60 0x55a07f9565c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:57.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.150+0000 7f97866f9740 1 -- 172.21.15.33:0/2478729956 >> 172.21.15.33:0/2478729956 conn(0x55a07f9500f0 msgr2=0x55a07f95db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:57.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.151+0000 7f97866f9740 1 -- 172.21.15.33:0/2478729956 shutdown_connections 2024-09-12T12:28:57.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.151+0000 7f97866f9740 1 -- 172.21.15.33:0/2478729956 wait complete. 2024-09-12T12:28:57.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.151+0000 7f97866f9740 1 -- start start 2024-09-12T12:28:57.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.152+0000 7f97866f9740 1 Processor -- start 2024-09-12T12:28:57.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.152+0000 7f97866f9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a07f953b60 0x55a07f963290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:57.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.152+0000 7f97866f9740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a07f954480 0x55a07f9637d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:57.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.152+0000 7f97866f9740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a07f95ed40 0x55a07f9d86d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:57.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.152+0000 7f97866f9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f977c1bc030 con 0x55a07f953b60 2024-09-12T12:28:57.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.152+0000 7f97866f9740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f977c1bd4a0 con 0x55a07f954480 2024-09-12T12:28:57.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.152+0000 7f97866f9740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f977c1bc700 con 0x55a07f95ed40 2024-09-12T12:28:57.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.152+0000 7f97828bd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a07f95ed40 0x55a07f9d86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:57.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.152+0000 7f97828bd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a07f95ed40 0x55a07f9d86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:48232/0 (socket says 172.21.15.33:48232) 2024-09-12T12:28:57.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.152+0000 7f97828bd640 1 -- 172.21.15.33:0/1511357559 learned_addr learned my addr 172.21.15.33:0/1511357559 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:28:57.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.152+0000 7f97820bc640 1 --2- 172.21.15.33:0/1511357559 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a07f953b60 0x55a07f963290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:57.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.152+0000 7f97866f9740 10 client.0 _ll_register_callbacks cb 0x7f976c009860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:28:57.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.153+0000 7f97818bb640 1 --2- 172.21.15.33:0/1511357559 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a07f954480 0x55a07f9637d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:57.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.153+0000 7f97828bd640 1 -- 172.21.15.33:0/1511357559 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a07f954480 msgr2=0x55a07f9637d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:57.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.153+0000 7f97828bd640 1 --2- 172.21.15.33:0/1511357559 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a07f954480 0x55a07f9637d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:57.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.153+0000 7f97828bd640 1 -- 172.21.15.33:0/1511357559 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a07f953b60 msgr2=0x55a07f963290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:28:57.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.153+0000 7f97828bd640 1 --2- 172.21.15.33:0/1511357559 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a07f953b60 0x55a07f963290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:57.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.153+0000 7f97828bd640 1 -- 172.21.15.33:0/1511357559 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a07f9d8cc0 con 0x55a07f95ed40 2024-09-12T12:28:57.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.153+0000 7f97818bb640 1 --2- 172.21.15.33:0/1511357559 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a07f954480 0x55a07f9637d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:28:57.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.153+0000 7f97828bd640 1 --2- 172.21.15.33:0/1511357559 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a07f95ed40 0x55a07f9d86d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9774010010 tx=0x7f9774019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d710794b98d81f6a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:28:57.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.153+0000 7f9765ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:28:57.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.153+0000 7f9765ffb640 1 -- 172.21.15.33:0/1511357559 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97740049a0 con 0x55a07f95ed40 2024-09-12T12:28:57.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.153+0000 7f9765ffb640 1 -- 172.21.15.33:0/1511357559 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f9774020040 con 0x55a07f95ed40 2024-09-12T12:28:57.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.153+0000 7f97866f9740 1 -- 172.21.15.33:0/1511357559 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f976c0122e0 con 0x55a07f95ed40 2024-09-12T12:28:57.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.154+0000 7f9765ffb640 1 -- 172.21.15.33:0/1511357559 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9774004b40 con 0x55a07f95ed40 2024-09-12T12:28:57.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.154+0000 7f97866f9740 10 client.25348 fetch_fsmap learned FSMap version 26 2024-09-12T12:28:57.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.154+0000 7f97866f9740 1 -- 172.21.15.33:0/1511357559 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a07f9d9fc0 con 0x55a07f95ed40 2024-09-12T12:28:57.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.154+0000 7f9765ffb640 1 -- 172.21.15.33:0/1511357559 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f977400bd10 con 0x55a07f95ed40 2024-09-12T12:28:57.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.155+0000 7f9765ffb640 1 -- 172.21.15.33:0/1511357559 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f977400b040 con 0x55a07f95ed40 2024-09-12T12:28:57.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.155+0000 7f97866f9740 10 client.25348 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:28:57.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.155+0000 7f97866f9740 10 client.25348 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:28:57.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.155+0000 7f97866f9740 20 client.25348 populate_metadata read hostname 'smithi033' 2024-09-12T12:28:57.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.155+0000 7f97866f9740 1 --2- 172.21.15.33:0/1511357559 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55a07f9da5d0 0x55a07f9dc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:28:57.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.155+0000 7f97866f9740 4 client.25348 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T12:28:57.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.155+0000 7f97866f9740 1 -- 172.21.15.33:0/1511357559 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f976c0122e0 con 0x55a07f9da5d0 2024-09-12T12:28:57.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.155+0000 7f97820bc640 1 --2- 172.21.15.33:0/1511357559 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55a07f9da5d0 0x55a07f9dc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:28:57.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.155+0000 7f9765ffb640 10 client.25348 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:28:57.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.155+0000 7f97820bc640 1 --2- 172.21.15.33:0/1511357559 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55a07f9da5d0 0x55a07f9dc9f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1092a0e252b6bba0 server_cookie=82a49a78fea2e387 in_seq=0 out_seq=0 2024-09-12T12:28:57.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.156+0000 7f9765ffb640 1 -- 172.21.15.33:0/1511357559 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f976c0122e0 con 0x55a07f9da5d0 2024-09-12T12:28:57.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.156+0000 7f9765ffb640 10 client.25348 handle_command_reply: tid=0 2024-09-12T12:28:57.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.156+0000 7f97866f9740 1 client.25348 shutdown 2024-09-12T12:28:57.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.157+0000 7f97866f9740 1 -- 172.21.15.33:0/1511357559 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a07f95ed40 msgr2=0x55a07f9d86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:57.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.157+0000 7f97866f9740 1 --2- 172.21.15.33:0/1511357559 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a07f95ed40 0x55a07f9d86d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9774010010 tx=0x7f9774019000 comp rx=0 tx=0).stop 2024-09-12T12:28:57.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.157+0000 7f97866f9740 1 -- 172.21.15.33:0/1511357559 shutdown_connections 2024-09-12T12:28:57.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.157+0000 7f97866f9740 1 --2- 172.21.15.33:0/1511357559 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55a07f9da5d0 0x55a07f9dc9f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:57.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.157+0000 7f97866f9740 1 --2- 172.21.15.33:0/1511357559 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a07f95ed40 0x55a07f9d86d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:57.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.157+0000 7f97866f9740 1 --2- 172.21.15.33:0/1511357559 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a07f954480 0x55a07f9637d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:57.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.157+0000 7f97866f9740 1 --2- 172.21.15.33:0/1511357559 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a07f953b60 0x55a07f963290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:57.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.157+0000 7f97866f9740 1 -- 172.21.15.33:0/1511357559 >> 172.21.15.33:0/1511357559 conn(0x55a07f9500f0 msgr2=0x55a07f95d190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:57.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.157+0000 7f9765ffb640 0 client.25348 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:28:57.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.157+0000 7f97866f9740 1 -- 172.21.15.33:0/1511357559 shutdown_connections 2024-09-12T12:28:57.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.157+0000 7f97866f9740 1 -- 172.21.15.33:0/1511357559 wait complete. 2024-09-12T12:28:57.159 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:28:57.159 INFO:teuthology.orchestra.run.smithi033.stdout: "return_code": 0, 2024-09-12T12:28:57.159 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_tag": "60ae017f-9cab-4d2f-a7f9-f0a5ff954b37", 2024-09-12T12:28:57.159 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": "asynchronous" 2024-09-12T12:28:57.160 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:28:57.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.157+0000 7f97866f9740 20 client.25348 trim_cache size 0 max 16384 2024-09-12T12:28:57.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.158+0000 7f9784320640 1 -- 172.21.15.33:0/1792700805 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f97680a2c00 msgr2=0x7f97680a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:57.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.158+0000 7f9784320640 1 --2- 172.21.15.33:0/1792700805 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f97680a2c00 0x7f97680a50c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9774021000 tx=0x7f9774018d10 comp rx=0 tx=0).stop 2024-09-12T12:28:57.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.158+0000 7f9784320640 1 -- 172.21.15.33:0/1792700805 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f977c109830 msgr2=0x7f977c1a76b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:28:57.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.158+0000 7f9784320640 1 --2- 172.21.15.33:0/1792700805 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f977c109830 0x7f977c1a76b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9778035040 tx=0x7f9778030bd0 comp rx=0 tx=0).stop 2024-09-12T12:28:57.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.159+0000 7f9784320640 1 -- 172.21.15.33:0/1792700805 shutdown_connections 2024-09-12T12:28:57.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.159+0000 7f9784320640 1 --2- 172.21.15.33:0/1792700805 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f97680a2c00 0x7f97680a50c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:57.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.159+0000 7f9784320640 1 --2- 172.21.15.33:0/1792700805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f977c11b140 0x7f977c1aba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:57.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.159+0000 7f9784320640 1 --2- 172.21.15.33:0/1792700805 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f977c109830 0x7f977c1a76b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:57.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.159+0000 7f9784320640 1 --2- 172.21.15.33:0/1792700805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f977c109450 0x7f977c1a7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:28:57.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.159+0000 7f9784320640 1 -- 172.21.15.33:0/1792700805 >> 172.21.15.33:0/1792700805 conn(0x7f977c06e140 msgr2=0x7f977c11c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:28:57.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.159+0000 7f9784320640 1 -- 172.21.15.33:0/1792700805 shutdown_connections 2024-09-12T12:28:57.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:28:57.159+0000 7f9784320640 1 -- 172.21.15.33:0/1792700805 wait complete. 2024-09-12T12:28:58.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:28:57 smithi043 ceph-mon[34144]: pgmap v438: 129 pgs: 129 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 40 MiB/s wr, 650 op/s 2024-09-12T12:28:58.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:28:57 smithi043 ceph-mon[34144]: scrub queued for path: / 2024-09-12T12:28:58.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:28:57 smithi043 ceph-mon[34144]: scrub summary: idle+waiting paths [/] 2024-09-12T12:28:58.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:28:57 smithi043 ceph-mon[34144]: scrub summary: active paths [/] 2024-09-12T12:28:58.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:28:57 smithi043 ceph-mon[34144]: scrub summary: active paths [/] 2024-09-12T12:28:58.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:28:57 smithi043 ceph-mon[34144]: scrub summary: idle+waiting paths [/] 2024-09-12T12:28:58.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:28:57 smithi043 ceph-mon[34144]: scrub summary: idle+waiting paths [/] 2024-09-12T12:28:58.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:28:57 smithi102 ceph-mon[34799]: pgmap v438: 129 pgs: 129 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 40 MiB/s wr, 650 op/s 2024-09-12T12:28:58.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:28:57 smithi102 ceph-mon[34799]: scrub queued for path: / 2024-09-12T12:28:58.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:28:57 smithi102 ceph-mon[34799]: scrub summary: idle+waiting paths [/] 2024-09-12T12:28:58.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:28:57 smithi102 ceph-mon[34799]: scrub summary: active paths [/] 2024-09-12T12:28:58.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:28:57 smithi102 ceph-mon[34799]: scrub summary: active paths [/] 2024-09-12T12:28:58.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:28:57 smithi102 ceph-mon[34799]: scrub summary: idle+waiting paths [/] 2024-09-12T12:28:58.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:28:57 smithi102 ceph-mon[34799]: scrub summary: idle+waiting paths [/] 2024-09-12T12:28:58.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:28:57 smithi033 ceph-mon[31246]: pgmap v438: 129 pgs: 129 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 40 MiB/s wr, 650 op/s 2024-09-12T12:28:58.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:28:57 smithi033 ceph-mon[31246]: scrub queued for path: / 2024-09-12T12:28:58.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:28:57 smithi033 ceph-mon[31246]: scrub summary: idle+waiting paths [/] 2024-09-12T12:28:58.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:28:57 smithi033 ceph-mon[31246]: scrub summary: active paths [/] 2024-09-12T12:28:58.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:28:57 smithi033 ceph-mon[31246]: scrub summary: active paths [/] 2024-09-12T12:28:58.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:28:57 smithi033 ceph-mon[31246]: scrub summary: idle+waiting paths [/] 2024-09-12T12:28:58.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:28:57 smithi033 ceph-mon[31246]: scrub summary: idle+waiting paths [/] 2024-09-12T12:28:59.049 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T12:28:59.528 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:28:59.973 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:28:59 smithi033 ceph-mon[31246]: pgmap v439: 129 pgs: 129 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 52 MiB/s wr, 840 op/s 2024-09-12T12:29:00.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:28:59 smithi043 ceph-mon[34144]: pgmap v439: 129 pgs: 129 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 52 MiB/s wr, 840 op/s 2024-09-12T12:29:00.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.117+0000 7f909f7c4640 1 -- 172.21.15.33:0/2797352954 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9098109120 msgr2=0x7f9098110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:00.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.117+0000 7f909f7c4640 1 --2- 172.21.15.33:0/2797352954 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9098109120 0x7f9098110ca0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9090013490 tx=0x7f9090032af0 comp rx=0 tx=0).stop 2024-09-12T12:29:00.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.117+0000 7f909f7c4640 1 -- 172.21.15.33:0/2797352954 shutdown_connections 2024-09-12T12:29:00.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.117+0000 7f909f7c4640 1 --2- 172.21.15.33:0/2797352954 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9098109120 0x7f9098110ca0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:00.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.117+0000 7f909f7c4640 1 --2- 172.21.15.33:0/2797352954 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90981049a0 0x7f90981089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:00.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.117+0000 7f909f7c4640 1 --2- 172.21.15.33:0/2797352954 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9098103ff0 0x7f90981043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:00.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.117+0000 7f909f7c4640 1 -- 172.21.15.33:0/2797352954 >> 172.21.15.33:0/2797352954 conn(0x7f90980ffab0 msgr2=0x7f9098101ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:29:00.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.118+0000 7f909f7c4640 1 -- 172.21.15.33:0/2797352954 shutdown_connections 2024-09-12T12:29:00.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.118+0000 7f909f7c4640 1 -- 172.21.15.33:0/2797352954 wait complete. 2024-09-12T12:29:00.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.118+0000 7f909f7c4640 1 Processor -- start 2024-09-12T12:29:00.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.118+0000 7f909f7c4640 1 -- start start 2024-09-12T12:29:00.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.119+0000 7f909f7c4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9098103ff0 0x7f90981966d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:00.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.119+0000 7f909f7c4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90981049a0 0x7f9098196c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:00.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.119+0000 7f909f7c4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9098109120 0x7f909819a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:00.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.119+0000 7f909f7c4640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9098078e70 con 0x7f9098103ff0 2024-09-12T12:29:00.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.119+0000 7f909f7c4640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9098078cf0 con 0x7f9098109120 2024-09-12T12:29:00.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.119+0000 7f909f7c4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9098078ff0 con 0x7f90981049a0 2024-09-12T12:29:00.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.119+0000 7f909d560640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9098103ff0 0x7f90981966d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:00.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.119+0000 7f909dd61640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9098109120 0x7f909819a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:00.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.119+0000 7f909cd5f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90981049a0 0x7f9098196c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:00.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.119+0000 7f909d560640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9098103ff0 0x7f90981966d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57812/0 (socket says 172.21.15.33:57812) 2024-09-12T12:29:00.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.119+0000 7f909d560640 1 -- 172.21.15.33:0/3937587365 learned_addr learned my addr 172.21.15.33:0/3937587365 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:29:00.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.119+0000 7f909cd5f640 1 -- 172.21.15.33:0/3937587365 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9098109120 msgr2=0x7f909819a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:00.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.119+0000 7f909cd5f640 1 --2- 172.21.15.33:0/3937587365 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9098109120 0x7f909819a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:00.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.119+0000 7f909cd5f640 1 -- 172.21.15.33:0/3937587365 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9098103ff0 msgr2=0x7f90981966d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:00.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.119+0000 7f909cd5f640 1 --2- 172.21.15.33:0/3937587365 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9098103ff0 0x7f90981966d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:00.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.120+0000 7f909cd5f640 1 -- 172.21.15.33:0/3937587365 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f909819b040 con 0x7f90981049a0 2024-09-12T12:29:00.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.120+0000 7f909cd5f640 1 --2- 172.21.15.33:0/3937587365 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90981049a0 0x7f9098196c10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f908800c970 tx=0x7f908800ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:29:00.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.120+0000 7f908e7fc640 1 -- 172.21.15.33:0/3937587365 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9088007bb0 con 0x7f90981049a0 2024-09-12T12:29:00.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.120+0000 7f908e7fc640 1 -- 172.21.15.33:0/3937587365 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9088007d50 con 0x7f90981049a0 2024-09-12T12:29:00.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.120+0000 7f908e7fc640 1 -- 172.21.15.33:0/3937587365 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908800e710 con 0x7f90981049a0 2024-09-12T12:29:00.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.120+0000 7f909f7c4640 1 -- 172.21.15.33:0/3937587365 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f909819b330 con 0x7f90981049a0 2024-09-12T12:29:00.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.120+0000 7f909f7c4640 1 -- 172.21.15.33:0/3937587365 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90981a2bd0 con 0x7f90981049a0 2024-09-12T12:29:00.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.123+0000 7f908e7fc640 1 -- 172.21.15.33:0/3937587365 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f908800f450 con 0x7f90981049a0 2024-09-12T12:29:00.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.124+0000 7f90a1b9d740 1 Processor -- start 2024-09-12T12:29:00.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.125+0000 7f90a1b9d740 1 -- start start 2024-09-12T12:29:00.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.125+0000 7f90a1b9d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7f925d4a0 0x55e7f925d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:00.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.125+0000 7f90a1b9d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e7f925ddc0 0x55e7f9268140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:00.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.125+0000 7f90a1b9d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7f9268680 0x55e7f926aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:00.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.125+0000 7f90a1b9d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e7f91c32e0 con 0x55e7f9268680 2024-09-12T12:29:00.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.125+0000 7f90a1b9d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e7f916ace0 con 0x55e7f925d4a0 2024-09-12T12:29:00.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.125+0000 7f90a1b9d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55e7f91bf2a0 con 0x55e7f925ddc0 2024-09-12T12:29:00.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.125+0000 7f908e7fc640 1 --2- 172.21.15.33:0/3937587365 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f90840a2d10 0x7f90840a51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:00.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.125+0000 7f909d560640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e7f925ddc0 0x55e7f9268140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:00.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.125+0000 7f909d560640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e7f925ddc0 0x55e7f9268140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:48254/0 (socket says 172.21.15.33:48254) 2024-09-12T12:29:00.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.125+0000 7f909d560640 1 -- 172.21.15.33:0/719202813 learned_addr learned my addr 172.21.15.33:0/719202813 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:29:00.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.125+0000 7f909cd5f640 1 --2- 172.21.15.33:0/719202813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7f9268680 0x55e7f926aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:00.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.125+0000 7f909dd61640 1 --2- 172.21.15.33:0/719202813 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7f925d4a0 0x55e7f925d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:00.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.125+0000 7f908e7fc640 1 -- 172.21.15.33:0/3937587365 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f90880cf7a0 con 0x7f90981049a0 2024-09-12T12:29:00.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.125+0000 7f909dd61640 1 --2- 172.21.15.33:0/3937587365 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f90840a2d10 0x7f90840a51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:00.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.126+0000 7f909dd61640 1 -- 172.21.15.33:0/719202813 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e7f925ddc0 msgr2=0x55e7f9268140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:00.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.126+0000 7f909dd61640 1 --2- 172.21.15.33:0/719202813 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e7f925ddc0 0x55e7f9268140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:00.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.126+0000 7f909dd61640 1 -- 172.21.15.33:0/719202813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7f9268680 msgr2=0x55e7f926aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:00.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.126+0000 7f909dd61640 1 --2- 172.21.15.33:0/719202813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7f9268680 0x55e7f926aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:00.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.126+0000 7f909dd61640 1 -- 172.21.15.33:0/719202813 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7f914f440 con 0x55e7f925d4a0 2024-09-12T12:29:00.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.126+0000 7f909d560640 1 --2- 172.21.15.33:0/719202813 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e7f925ddc0 0x55e7f9268140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:29:00.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.126+0000 7f909dd61640 1 --2- 172.21.15.33:0/719202813 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7f925d4a0 0x55e7f925d880 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9090014090 tx=0x7f9090010e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c79199d2b1d08b8b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:29:00.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.126+0000 7f90837fe640 1 -- 172.21.15.33:0/719202813 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909003a040 con 0x55e7f925d4a0 2024-09-12T12:29:00.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.127+0000 7f909dd61640 1 --2- 172.21.15.33:0/3937587365 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f90840a2d10 0x7f90840a51d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f909004d000 tx=0x7f909004f000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:29:00.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.127+0000 7f90837fe640 1 -- 172.21.15.33:0/719202813 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9090051070 con 0x55e7f925d4a0 2024-09-12T12:29:00.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.127+0000 7f90837fe640 1 -- 172.21.15.33:0/719202813 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9090056a40 con 0x55e7f925d4a0 2024-09-12T12:29:00.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.127+0000 7f90a1b9d740 1 -- 172.21.15.33:0/719202813 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7f925d4a0 msgr2=0x55e7f925d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:00.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.127+0000 7f90a1b9d740 1 --2- 172.21.15.33:0/719202813 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7f925d4a0 0x55e7f925d880 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9090014090 tx=0x7f9090010e20 comp rx=0 tx=0).stop 2024-09-12T12:29:00.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.127+0000 7f90a1b9d740 1 -- 172.21.15.33:0/719202813 shutdown_connections 2024-09-12T12:29:00.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.128+0000 7f90a1b9d740 1 --2- 172.21.15.33:0/719202813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7f9268680 0x55e7f926aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:00.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.128+0000 7f90a1b9d740 1 --2- 172.21.15.33:0/719202813 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e7f925ddc0 0x55e7f9268140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:00.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.128+0000 7f90a1b9d740 1 --2- 172.21.15.33:0/719202813 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7f925d4a0 0x55e7f925d880 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:00.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.128+0000 7f90a1b9d740 1 -- 172.21.15.33:0/719202813 >> 172.21.15.33:0/719202813 conn(0x55e7f9259a30 msgr2=0x55e7f9259e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:29:00.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.128+0000 7f90a1b9d740 1 -- 172.21.15.33:0/719202813 shutdown_connections 2024-09-12T12:29:00.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.128+0000 7f90a1b9d740 1 -- 172.21.15.33:0/719202813 wait complete. 2024-09-12T12:29:00.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.128+0000 7f90a1b9d740 1 -- start start 2024-09-12T12:29:00.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.128+0000 7f90a1b9d740 1 Processor -- start 2024-09-12T12:29:00.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.129+0000 7f90a1b9d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7f925d4a0 0x55e7f9268010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:00.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.129+0000 7f90a1b9d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7f925ddc0 0x55e7f92652c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:00.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.129+0000 7f90a1b9d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e7f9268680 0x55e7f9265840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:00.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.130+0000 7f90a1b9d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e7f926b2f0 con 0x55e7f925d4a0 2024-09-12T12:29:00.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.130+0000 7f909dd61640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e7f9268680 0x55e7f9265840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:00.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.130+0000 7f909dd61640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e7f9268680 0x55e7f9265840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:48258/0 (socket says 172.21.15.33:48258) 2024-09-12T12:29:00.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.130+0000 7f909cd5f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7f925ddc0 0x55e7f92652c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:00.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.130+0000 7f909dd61640 1 -- 172.21.15.33:0/3713490128 learned_addr learned my addr 172.21.15.33:0/3713490128 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:29:00.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.130+0000 7f90a1b9d740 1 -- 172.21.15.33:0/3713490128 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e7f917e050 con 0x55e7f925ddc0 2024-09-12T12:29:00.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.130+0000 7f90a1b9d740 1 -- 172.21.15.33:0/3713490128 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55e7f926b470 con 0x55e7f9268680 2024-09-12T12:29:00.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.130+0000 7f90a1b9d740 10 client.0 _ll_register_callbacks cb 0x55e7f91be160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:29:00.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.130+0000 7f909dd61640 1 -- 172.21.15.33:0/3713490128 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7f925ddc0 msgr2=0x55e7f92652c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:00.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.130+0000 7f909dd61640 1 --2- 172.21.15.33:0/3713490128 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7f925ddc0 0x55e7f92652c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:00.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.130+0000 7f909dd61640 1 -- 172.21.15.33:0/3713490128 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7f925d4a0 msgr2=0x55e7f9268010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T12:29:00.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.130+0000 7f909dd61640 1 --2- 172.21.15.33:0/3713490128 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7f925d4a0 0x55e7f9268010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:00.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.130+0000 7f909dd61640 1 -- 172.21.15.33:0/3713490128 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7f8f343c0 con 0x55e7f9268680 2024-09-12T12:29:00.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.131+0000 7f90a1b9d740 1 -- 172.21.15.33:0/3713490128 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9090051070 con 0x55e7f9268680 2024-09-12T12:29:00.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.131+0000 7f909dd61640 1 --2- 172.21.15.33:0/3713490128 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e7f9268680 0x55e7f9265840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9090034440 tx=0x7f9090034470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f813cf0fd8bb51a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:29:00.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.131+0000 7f9080ff9640 10 client.25360 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:29:00.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.131+0000 7f9080ff9640 1 -- 172.21.15.33:0/3713490128 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90900114a0 con 0x55e7f9268680 2024-09-12T12:29:00.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.131+0000 7f9080ff9640 1 -- 172.21.15.33:0/3713490128 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f9090011640 con 0x55e7f9268680 2024-09-12T12:29:00.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.131+0000 7f9080ff9640 1 -- 172.21.15.33:0/3713490128 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f909003f450 con 0x55e7f9268680 2024-09-12T12:29:00.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.131+0000 7f90a1b9d740 10 client.25360 fetch_fsmap learned FSMap version 26 2024-09-12T12:29:00.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.131+0000 7f90a1b9d740 1 -- 172.21.15.33:0/3713490128 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55e7f926b2f0 con 0x55e7f9268680 2024-09-12T12:29:00.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.132+0000 7f9080ff9640 1 -- 172.21.15.33:0/3713490128 <== mon.1 v2:172.21.15.102:3300/0 4 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f909003f5f0 con 0x55e7f9268680 2024-09-12T12:29:00.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.132+0000 7f90a1b9d740 10 client.25360 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:29:00.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.132+0000 7f90a1b9d740 10 client.25360 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:29:00.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.132+0000 7f90a1b9d740 20 client.25360 populate_metadata read hostname 'smithi033' 2024-09-12T12:29:00.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.132+0000 7f90a1b9d740 1 --2- 172.21.15.33:0/3713490128 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55e7f9277ce0 0x55e7f927a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:00.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.132+0000 7f90a1b9d740 4 client.25360 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:29:00.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.132+0000 7f90a1b9d740 1 -- 172.21.15.33:0/3713490128 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e7f91d0850 con 0x55e7f9277ce0 2024-09-12T12:29:00.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.132+0000 7f909d560640 1 --2- 172.21.15.33:0/3713490128 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55e7f9277ce0 0x55e7f927a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:00.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.133+0000 7f909d560640 1 --2- 172.21.15.33:0/3713490128 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55e7f9277ce0 0x55e7f927a0d0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9f8187e96428b9a server_cookie=17090525463e069f in_seq=0 out_seq=0 2024-09-12T12:29:00.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.133+0000 7f9080ff9640 10 client.25360 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:29:00.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.134+0000 7f9080ff9640 1 -- 172.21.15.33:0/3713490128 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e7f91d0850 con 0x55e7f9277ce0 2024-09-12T12:29:00.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.134+0000 7f9080ff9640 10 client.25360 handle_command_reply: tid=0 2024-09-12T12:29:00.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.135+0000 7f90a1b9d740 1 client.25360 shutdown 2024-09-12T12:29:00.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.135+0000 7f90a1b9d740 1 -- 172.21.15.33:0/3713490128 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e7f9268680 msgr2=0x55e7f9265840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:00.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.135+0000 7f90a1b9d740 1 --2- 172.21.15.33:0/3713490128 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e7f9268680 0x55e7f9265840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9090034440 tx=0x7f9090034470 comp rx=0 tx=0).stop 2024-09-12T12:29:00.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.135+0000 7f90a1b9d740 1 -- 172.21.15.33:0/3713490128 shutdown_connections 2024-09-12T12:29:00.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.135+0000 7f90a1b9d740 1 --2- 172.21.15.33:0/3713490128 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55e7f9277ce0 0x55e7f927a0d0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:00.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.135+0000 7f90a1b9d740 1 --2- 172.21.15.33:0/3713490128 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e7f9268680 0x55e7f9265840 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:00.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.135+0000 7f90a1b9d740 1 --2- 172.21.15.33:0/3713490128 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7f925ddc0 0x55e7f92652c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:00.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.135+0000 7f90a1b9d740 1 --2- 172.21.15.33:0/3713490128 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7f925d4a0 0x55e7f9268010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:00.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.135+0000 7f90a1b9d740 1 -- 172.21.15.33:0/3713490128 >> 172.21.15.33:0/3713490128 conn(0x55e7f9259a30 msgr2=0x55e7f925f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:29:00.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.136+0000 7f9080ff9640 0 client.25360 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:29:00.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.136+0000 7f90a1b9d740 1 -- 172.21.15.33:0/3713490128 shutdown_connections 2024-09-12T12:29:00.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.136+0000 7f90a1b9d740 1 -- 172.21.15.33:0/3713490128 wait complete. 2024-09-12T12:29:00.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.136+0000 7f90a1b9d740 20 client.25360 trim_cache size 0 max 16384 2024-09-12T12:29:00.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:28:59 smithi102 ceph-mon[34799]: pgmap v439: 129 pgs: 129 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 52 MiB/s wr, 840 op/s 2024-09-12T12:29:00.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.174+0000 7f90a1b9d740 1 Processor -- start 2024-09-12T12:29:00.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.175+0000 7f90a1b9d740 1 -- start start 2024-09-12T12:29:00.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.175+0000 7f90a1b9d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e7f925d4a0 0x55e7f9265810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:00.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.175+0000 7f90a1b9d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7f925ddc0 0x55e7f9274550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:00.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.175+0000 7f90a1b9d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7f9268680 0x55e7f9260030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:00.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.176+0000 7f90a1b9d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f90981af1d0 con 0x55e7f925ddc0 2024-09-12T12:29:00.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.176+0000 7f909d560640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e7f925d4a0 0x55e7f9265810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:00.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.176+0000 7f909d560640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e7f925d4a0 0x55e7f9265810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:48270/0 (socket says 172.21.15.33:48270) 2024-09-12T12:29:00.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.176+0000 7f909d560640 1 -- 172.21.15.33:0/3565712152 learned_addr learned my addr 172.21.15.33:0/3565712152 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:29:00.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.176+0000 7f909cd5f640 1 --2- 172.21.15.33:0/3565712152 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7f925ddc0 0x55e7f9274550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:00.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.176+0000 7f90a1b9d740 1 -- 172.21.15.33:0/3565712152 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f90981acaa0 con 0x55e7f9268680 2024-09-12T12:29:00.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.176+0000 7f909dd61640 1 --2- 172.21.15.33:0/3565712152 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7f9268680 0x55e7f9260030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:00.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.176+0000 7f90a1b9d740 1 -- 172.21.15.33:0/3565712152 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f90981aa940 con 0x55e7f925d4a0 2024-09-12T12:29:00.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.177+0000 7f909d560640 1 -- 172.21.15.33:0/3565712152 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7f9268680 msgr2=0x55e7f9260030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:00.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.177+0000 7f909d560640 1 --2- 172.21.15.33:0/3565712152 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7f9268680 0x55e7f9260030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:00.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.177+0000 7f909d560640 1 -- 172.21.15.33:0/3565712152 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7f925ddc0 msgr2=0x55e7f9274550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:00.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.177+0000 7f909d560640 1 --2- 172.21.15.33:0/3565712152 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7f925ddc0 0x55e7f9274550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:00.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.177+0000 7f909d560640 1 -- 172.21.15.33:0/3565712152 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7f925a4b0 con 0x55e7f925d4a0 2024-09-12T12:29:00.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.177+0000 7f909cd5f640 1 --2- 172.21.15.33:0/3565712152 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7f925ddc0 0x55e7f9274550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:29:00.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.177+0000 7f909d560640 1 --2- 172.21.15.33:0/3565712152 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e7f925d4a0 0x55e7f9265810 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9094009d10 tx=0x7f9094014840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7bf9db9cb19c99cc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:29:00.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.177+0000 7f9082ffd640 1 -- 172.21.15.33:0/3565712152 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9094014110 con 0x55e7f925d4a0 2024-09-12T12:29:00.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.177+0000 7f9082ffd640 1 -- 172.21.15.33:0/3565712152 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f90940142b0 con 0x55e7f925d4a0 2024-09-12T12:29:00.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.177+0000 7f9082ffd640 1 -- 172.21.15.33:0/3565712152 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9094004990 con 0x55e7f925d4a0 2024-09-12T12:29:00.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.178+0000 7f90a1b9d740 1 -- 172.21.15.33:0/3565712152 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e7f925d4a0 msgr2=0x55e7f9265810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:00.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.178+0000 7f90a1b9d740 1 --2- 172.21.15.33:0/3565712152 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e7f925d4a0 0x55e7f9265810 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9094009d10 tx=0x7f9094014840 comp rx=0 tx=0).stop 2024-09-12T12:29:00.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.179+0000 7f90a1b9d740 1 -- 172.21.15.33:0/3565712152 shutdown_connections 2024-09-12T12:29:00.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.179+0000 7f90a1b9d740 1 --2- 172.21.15.33:0/3565712152 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7f9268680 0x55e7f9260030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:00.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.179+0000 7f90a1b9d740 1 --2- 172.21.15.33:0/3565712152 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7f925ddc0 0x55e7f9274550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:00.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.179+0000 7f90a1b9d740 1 --2- 172.21.15.33:0/3565712152 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e7f925d4a0 0x55e7f9265810 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:00.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.179+0000 7f90a1b9d740 1 -- 172.21.15.33:0/3565712152 >> 172.21.15.33:0/3565712152 conn(0x55e7f9259a30 msgr2=0x55e7f9267340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:29:00.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.179+0000 7f90a1b9d740 1 -- 172.21.15.33:0/3565712152 shutdown_connections 2024-09-12T12:29:00.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.179+0000 7f90a1b9d740 1 -- 172.21.15.33:0/3565712152 wait complete. 2024-09-12T12:29:00.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.180+0000 7f90a1b9d740 1 -- start start 2024-09-12T12:29:00.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.180+0000 7f90a1b9d740 1 Processor -- start 2024-09-12T12:29:00.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.181+0000 7f90a1b9d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7f925d4a0 0x55e7f9270ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:00.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.181+0000 7f90a1b9d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7f925ddc0 0x55e7f926be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:00.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.181+0000 7f909d560640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7f925d4a0 0x55e7f9270ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:00.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.181+0000 7f909d560640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7f925d4a0 0x55e7f9270ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:37904/0 (socket says 172.21.15.33:37904) 2024-09-12T12:29:00.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.181+0000 7f909d560640 1 -- 172.21.15.33:0/332960370 learned_addr learned my addr 172.21.15.33:0/332960370 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:29:00.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.182+0000 7f90a1b9d740 1 --2- 172.21.15.33:0/332960370 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e7f9268680 0x55e7f926c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:00.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.182+0000 7f90a1b9d740 1 -- 172.21.15.33:0/332960370 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f90981aafb0 con 0x55e7f925ddc0 2024-09-12T12:29:00.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.182+0000 7f90a1b9d740 1 -- 172.21.15.33:0/332960370 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f90981ac3d0 con 0x55e7f925d4a0 2024-09-12T12:29:00.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.182+0000 7f90a1b9d740 1 -- 172.21.15.33:0/332960370 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f90981ab630 con 0x55e7f9268680 2024-09-12T12:29:00.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.182+0000 7f909dd61640 1 --2- 172.21.15.33:0/332960370 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e7f9268680 0x55e7f926c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:00.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.182+0000 7f90a1b9d740 10 client.0 _ll_register_callbacks cb 0x7f9094009750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:29:00.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.182+0000 7f909cd5f640 1 --2- 172.21.15.33:0/332960370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7f925ddc0 0x55e7f926be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:00.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.182+0000 7f909d560640 1 -- 172.21.15.33:0/332960370 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e7f9268680 msgr2=0x55e7f926c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:00.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.182+0000 7f909d560640 1 --2- 172.21.15.33:0/332960370 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e7f9268680 0x55e7f926c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:00.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.182+0000 7f909d560640 1 -- 172.21.15.33:0/332960370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7f925ddc0 msgr2=0x55e7f926be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:00.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.182+0000 7f909d560640 1 --2- 172.21.15.33:0/332960370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7f925ddc0 0x55e7f926be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:00.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.183+0000 7f909d560640 1 -- 172.21.15.33:0/332960370 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7f926c880 con 0x55e7f925d4a0 2024-09-12T12:29:00.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.183+0000 7f909d560640 1 --2- 172.21.15.33:0/332960370 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7f925d4a0 0x55e7f9270ad0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9094009f70 tx=0x7f9094009fa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a1677acc9bde47c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:29:00.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.183+0000 7f9080ff9640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:29:00.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.183+0000 7f9080ff9640 1 -- 172.21.15.33:0/332960370 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9094004260 con 0x55e7f925d4a0 2024-09-12T12:29:00.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.184+0000 7f9080ff9640 1 -- 172.21.15.33:0/332960370 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f9094004400 con 0x55e7f925d4a0 2024-09-12T12:29:00.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.184+0000 7f90a1b9d740 1 -- 172.21.15.33:0/332960370 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e7f9260ee0 con 0x55e7f925d4a0 2024-09-12T12:29:00.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.184+0000 7f9080ff9640 1 -- 172.21.15.33:0/332960370 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f90940035f0 con 0x55e7f925d4a0 2024-09-12T12:29:00.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.184+0000 7f90a1b9d740 10 client.25277 fetch_fsmap learned FSMap version 26 2024-09-12T12:29:00.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.185+0000 7f90a1b9d740 1 -- 172.21.15.33:0/332960370 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55e7f92e2450 con 0x55e7f925d4a0 2024-09-12T12:29:00.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.185+0000 7f9080ff9640 1 -- 172.21.15.33:0/332960370 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9094003c40 con 0x55e7f925d4a0 2024-09-12T12:29:00.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.185+0000 7f9080ff9640 1 -- 172.21.15.33:0/332960370 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f909402f070 con 0x55e7f925d4a0 2024-09-12T12:29:00.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.186+0000 7f90a1b9d740 10 client.25277 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:29:00.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.186+0000 7f90a1b9d740 10 client.25277 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:29:00.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.186+0000 7f90a1b9d740 20 client.25277 populate_metadata read hostname 'smithi033' 2024-09-12T12:29:00.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.186+0000 7f90a1b9d740 1 --2- 172.21.15.33:0/332960370 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55e7f92e29b0 0x55e7f92e4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:00.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.186+0000 7f90a1b9d740 4 client.25277 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:29:00.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.186+0000 7f90a1b9d740 1 -- 172.21.15.33:0/332960370 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e7f9260ee0 con 0x55e7f92e29b0 2024-09-12T12:29:00.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.186+0000 7f909cd5f640 1 --2- 172.21.15.33:0/332960370 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55e7f92e29b0 0x55e7f92e4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:00.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.187+0000 7f909cd5f640 1 --2- 172.21.15.33:0/332960370 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55e7f92e29b0 0x55e7f92e4da0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90a06c29e5bb2209 server_cookie=d5acb70ca59bbac7 in_seq=0 out_seq=0 2024-09-12T12:29:00.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.187+0000 7f9080ff9640 10 client.25277 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:29:00.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.187+0000 7f9080ff9640 1 -- 172.21.15.33:0/332960370 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55e7f9260ee0 con 0x55e7f92e29b0 2024-09-12T12:29:00.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.187+0000 7f9080ff9640 10 client.25277 handle_command_reply: tid=0 2024-09-12T12:29:00.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.187+0000 7f90a1b9d740 1 client.25277 shutdown 2024-09-12T12:29:00.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.187+0000 7f90a1b9d740 1 -- 172.21.15.33:0/332960370 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7f925d4a0 msgr2=0x55e7f9270ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:00.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.187+0000 7f90a1b9d740 1 --2- 172.21.15.33:0/332960370 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7f925d4a0 0x55e7f9270ad0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9094009f70 tx=0x7f9094009fa0 comp rx=0 tx=0).stop 2024-09-12T12:29:00.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.187+0000 7f90a1b9d740 1 -- 172.21.15.33:0/332960370 shutdown_connections 2024-09-12T12:29:00.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.187+0000 7f90a1b9d740 1 --2- 172.21.15.33:0/332960370 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55e7f92e29b0 0x55e7f92e4da0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:00.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.187+0000 7f90a1b9d740 1 --2- 172.21.15.33:0/332960370 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e7f9268680 0x55e7f926c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:00.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.187+0000 7f90a1b9d740 1 --2- 172.21.15.33:0/332960370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7f925ddc0 0x55e7f926be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:00.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.188+0000 7f90a1b9d740 1 --2- 172.21.15.33:0/332960370 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7f925d4a0 0x55e7f9270ad0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:00.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.188+0000 7f90a1b9d740 1 -- 172.21.15.33:0/332960370 >> 172.21.15.33:0/332960370 conn(0x55e7f9259a30 msgr2=0x55e7f925f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:29:00.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.188+0000 7f9080ff9640 0 client.25277 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:29:00.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.188+0000 7f90a1b9d740 1 -- 172.21.15.33:0/332960370 shutdown_connections 2024-09-12T12:29:00.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.188+0000 7f90a1b9d740 1 -- 172.21.15.33:0/332960370 wait complete. 2024-09-12T12:29:00.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.188+0000 7f90a1b9d740 20 client.25277 trim_cache size 0 max 16384 2024-09-12T12:29:00.190 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:29:00.190 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T12:29:00.190 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": { 2024-09-12T12:29:00.190 INFO:teuthology.orchestra.run.smithi033.stdout: "60ae017f-9cab-4d2f-a7f9-f0a5ff954b37": { 2024-09-12T12:29:00.190 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-09-12T12:29:00.190 INFO:teuthology.orchestra.run.smithi033.stdout: "tag": "60ae017f-9cab-4d2f-a7f9-f0a5ff954b37", 2024-09-12T12:29:00.190 INFO:teuthology.orchestra.run.smithi033.stdout: "options": "recursive,force" 2024-09-12T12:29:00.190 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:29:00.190 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:29:00.191 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:29:00.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.190+0000 7f909f7c4640 1 -- 172.21.15.33:0/3937587365 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f90840a2d10 msgr2=0x7f90840a51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:00.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.190+0000 7f909f7c4640 1 --2- 172.21.15.33:0/3937587365 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f90840a2d10 0x7f90840a51d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f909004d000 tx=0x7f909004f000 comp rx=0 tx=0).stop 2024-09-12T12:29:00.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.190+0000 7f909f7c4640 1 -- 172.21.15.33:0/3937587365 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90981049a0 msgr2=0x7f9098196c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:00.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.190+0000 7f909f7c4640 1 --2- 172.21.15.33:0/3937587365 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90981049a0 0x7f9098196c10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f908800c970 tx=0x7f908800ce30 comp rx=0 tx=0).stop 2024-09-12T12:29:00.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.190+0000 7f909f7c4640 1 -- 172.21.15.33:0/3937587365 shutdown_connections 2024-09-12T12:29:00.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.190+0000 7f909f7c4640 1 --2- 172.21.15.33:0/3937587365 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f90840a2d10 0x7f90840a51d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:00.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.190+0000 7f909f7c4640 1 --2- 172.21.15.33:0/3937587365 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9098109120 0x7f909819a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:00.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.190+0000 7f909f7c4640 1 --2- 172.21.15.33:0/3937587365 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90981049a0 0x7f9098196c10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:00.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.190+0000 7f909f7c4640 1 --2- 172.21.15.33:0/3937587365 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9098103ff0 0x7f90981966d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:00.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.190+0000 7f909f7c4640 1 -- 172.21.15.33:0/3937587365 >> 172.21.15.33:0/3937587365 conn(0x7f90980ffab0 msgr2=0x7f90981079d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:29:00.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.190+0000 7f909f7c4640 1 -- 172.21.15.33:0/3937587365 shutdown_connections 2024-09-12T12:29:00.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:00.190+0000 7f909f7c4640 1 -- 172.21.15.33:0/3937587365 wait complete. 2024-09-12T12:29:01.249 INFO:tasks.cephfs.filesystem:scrub status for tag:60ae017f-9cab-4d2f-a7f9-f0a5ff954b37 - {'path': '/', 'tag': '60ae017f-9cab-4d2f-a7f9-f0a5ff954b37', 'options': 'recursive,force'} 2024-09-12T12:29:02.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:29:01 smithi043 ceph-mon[34144]: pgmap v440: 129 pgs: 129 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 43 MiB/s wr, 688 op/s 2024-09-12T12:29:02.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:29:01 smithi102 ceph-mon[34799]: pgmap v440: 129 pgs: 129 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 43 MiB/s wr, 688 op/s 2024-09-12T12:29:02.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:29:01 smithi033 ceph-mon[31246]: pgmap v440: 129 pgs: 129 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 43 MiB/s wr, 688 op/s 2024-09-12T12:29:03.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:29:02 smithi043 ceph-mon[34144]: scrub summary: idle 2024-09-12T12:29:03.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:29:02 smithi102 ceph-mon[34799]: scrub summary: idle 2024-09-12T12:29:03.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:29:02 smithi033 ceph-mon[31246]: scrub summary: idle 2024-09-12T12:29:04.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:29:03 smithi043 ceph-mon[34144]: pgmap v441: 129 pgs: 129 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 46 MiB/s wr, 748 op/s 2024-09-12T12:29:04.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:29:03 smithi043 ceph-mon[34144]: scrub summary: idle 2024-09-12T12:29:04.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:29:03 smithi102 ceph-mon[34799]: pgmap v441: 129 pgs: 129 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 46 MiB/s wr, 748 op/s 2024-09-12T12:29:04.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:29:03 smithi102 ceph-mon[34799]: scrub summary: idle 2024-09-12T12:29:04.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:29:03 smithi033 ceph-mon[31246]: pgmap v441: 129 pgs: 129 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 46 MiB/s wr, 748 op/s 2024-09-12T12:29:04.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:29:03 smithi033 ceph-mon[31246]: scrub summary: idle 2024-09-12T12:29:06.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:29:05 smithi043 ceph-mon[34144]: pgmap v442: 129 pgs: 129 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 51 MiB/s wr, 818 op/s 2024-09-12T12:29:06.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:29:05 smithi102 ceph-mon[34799]: pgmap v442: 129 pgs: 129 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 51 MiB/s wr, 818 op/s 2024-09-12T12:29:06.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:29:05 smithi033 ceph-mon[31246]: pgmap v442: 129 pgs: 129 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 51 MiB/s wr, 818 op/s 2024-09-12T12:29:08.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:29:07 smithi043 ceph-mon[34144]: pgmap v443: 129 pgs: 129 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 44 MiB/s wr, 705 op/s 2024-09-12T12:29:08.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:29:07 smithi102 ceph-mon[34799]: pgmap v443: 129 pgs: 129 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 44 MiB/s wr, 705 op/s 2024-09-12T12:29:08.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:29:07 smithi033 ceph-mon[31246]: pgmap v443: 129 pgs: 129 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 44 MiB/s wr, 705 op/s 2024-09-12T12:29:09.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:29:08 smithi033 ceph-mon[31246]: pgmap v444: 129 pgs: 129 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 60 MiB/s wr, 962 op/s 2024-09-12T12:29:09.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:29:08 smithi043 ceph-mon[34144]: pgmap v444: 129 pgs: 129 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 60 MiB/s wr, 962 op/s 2024-09-12T12:29:09.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:29:08 smithi102 ceph-mon[34799]: pgmap v444: 129 pgs: 129 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 60 MiB/s wr, 962 op/s 2024-09-12T12:29:11.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:29:11 smithi043 ceph-mon[34144]: pgmap v445: 129 pgs: 129 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 51 MiB/s wr, 815 op/s 2024-09-12T12:29:11.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:29:11 smithi102 ceph-mon[34799]: pgmap v445: 129 pgs: 129 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 51 MiB/s wr, 815 op/s 2024-09-12T12:29:11.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:29:11 smithi033 ceph-mon[31246]: pgmap v445: 129 pgs: 129 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 51 MiB/s wr, 815 op/s 2024-09-12T12:29:13.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:29:13 smithi043 ceph-mon[34144]: pgmap v446: 129 pgs: 129 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 55 MiB/s wr, 881 op/s 2024-09-12T12:29:13.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:29:13 smithi102 ceph-mon[34799]: pgmap v446: 129 pgs: 129 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 55 MiB/s wr, 881 op/s 2024-09-12T12:29:13.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:29:13 smithi033 ceph-mon[31246]: pgmap v446: 129 pgs: 129 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 55 MiB/s wr, 881 op/s 2024-09-12T12:29:15.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:29:15 smithi043 ceph-mon[34144]: pgmap v447: 129 pgs: 129 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 59 MiB/s wr, 942 op/s 2024-09-12T12:29:15.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:29:15 smithi102 ceph-mon[34799]: pgmap v447: 129 pgs: 129 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 59 MiB/s wr, 942 op/s 2024-09-12T12:29:15.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:29:15 smithi033 ceph-mon[31246]: pgmap v447: 129 pgs: 129 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 59 MiB/s wr, 942 op/s 2024-09-12T12:29:17.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:29:17 smithi043 ceph-mon[34144]: pgmap v448: 129 pgs: 129 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 50 MiB/s wr, 800 op/s 2024-09-12T12:29:17.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:29:17 smithi102 ceph-mon[34799]: pgmap v448: 129 pgs: 129 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 50 MiB/s wr, 800 op/s 2024-09-12T12:29:17.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:29:17 smithi033 ceph-mon[31246]: pgmap v448: 129 pgs: 129 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 50 MiB/s wr, 800 op/s 2024-09-12T12:29:19.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:29:19 smithi043 ceph-mon[34144]: pgmap v449: 129 pgs: 129 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 65 MiB/s wr, 1.04k op/s 2024-09-12T12:29:19.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:29:19 smithi102 ceph-mon[34799]: pgmap v449: 129 pgs: 129 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 65 MiB/s wr, 1.04k op/s 2024-09-12T12:29:19.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:29:19 smithi033 ceph-mon[31246]: pgmap v449: 129 pgs: 129 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 65 MiB/s wr, 1.04k op/s 2024-09-12T12:29:21.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:29:21 smithi043 ceph-mon[34144]: pgmap v450: 129 pgs: 129 active+clean; 10 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 52 MiB/s wr, 830 op/s 2024-09-12T12:29:21.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:29:21 smithi102 ceph-mon[34799]: pgmap v450: 129 pgs: 129 active+clean; 10 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 52 MiB/s wr, 830 op/s 2024-09-12T12:29:21.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:29:21 smithi033 ceph-mon[31246]: pgmap v450: 129 pgs: 129 active+clean; 10 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 52 MiB/s wr, 830 op/s 2024-09-12T12:29:23.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:29:23 smithi043 ceph-mon[34144]: pgmap v451: 129 pgs: 129 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 54 MiB/s wr, 875 op/s 2024-09-12T12:29:23.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:29:23 smithi102 ceph-mon[34799]: pgmap v451: 129 pgs: 129 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 54 MiB/s wr, 875 op/s 2024-09-12T12:29:23.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:29:23 smithi033 ceph-mon[31246]: pgmap v451: 129 pgs: 129 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 54 MiB/s wr, 875 op/s 2024-09-12T12:29:25.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:29:25 smithi043 ceph-mon[34144]: pgmap v452: 129 pgs: 129 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 57 MiB/s wr, 918 op/s 2024-09-12T12:29:25.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:29:25 smithi102 ceph-mon[34799]: pgmap v452: 129 pgs: 129 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 57 MiB/s wr, 918 op/s 2024-09-12T12:29:25.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:29:25 smithi033 ceph-mon[31246]: pgmap v452: 129 pgs: 129 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 57 MiB/s wr, 918 op/s 2024-09-12T12:29:27.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:29:27 smithi043 ceph-mon[34144]: pgmap v453: 129 pgs: 129 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 48 MiB/s wr, 776 op/s 2024-09-12T12:29:27.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:29:27 smithi102 ceph-mon[34799]: pgmap v453: 129 pgs: 129 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 48 MiB/s wr, 776 op/s 2024-09-12T12:29:27.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:29:27 smithi033 ceph-mon[31246]: pgmap v453: 129 pgs: 129 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 48 MiB/s wr, 776 op/s 2024-09-12T12:29:29.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:29:29 smithi043 ceph-mon[34144]: pgmap v454: 129 pgs: 129 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 63 MiB/s wr, 1.01k op/s 2024-09-12T12:29:29.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:29:29 smithi102 ceph-mon[34799]: pgmap v454: 129 pgs: 129 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 63 MiB/s wr, 1.01k op/s 2024-09-12T12:29:29.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:29:29 smithi033 ceph-mon[31246]: pgmap v454: 129 pgs: 129 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 63 MiB/s wr, 1.01k op/s 2024-09-12T12:29:31.251 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T12:29:31.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:29:31 smithi043 ceph-mon[34144]: pgmap v455: 129 pgs: 129 active+clean; 10 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 50 MiB/s wr, 804 op/s 2024-09-12T12:29:31.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:29:31 smithi102 ceph-mon[34799]: pgmap v455: 129 pgs: 129 active+clean; 10 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 50 MiB/s wr, 804 op/s 2024-09-12T12:29:31.483 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:29:31 smithi033 ceph-mon[31246]: pgmap v455: 129 pgs: 129 active+clean; 10 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 50 MiB/s wr, 804 op/s 2024-09-12T12:29:31.742 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:29:32.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.333+0000 7f48c9bca640 1 -- 172.21.15.33:0/3846169033 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48c4100a80 msgr2=0x7f48c4100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:32.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.333+0000 7f48c9bca640 1 --2- 172.21.15.33:0/3846169033 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48c4100a80 0x7f48c4100ee0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f48b8009930 tx=0x7f48b802a420 comp rx=0 tx=0).stop 2024-09-12T12:29:32.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.333+0000 7f48c9bca640 1 -- 172.21.15.33:0/3846169033 shutdown_connections 2024-09-12T12:29:32.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.333+0000 7f48c9bca640 1 --2- 172.21.15.33:0/3846169033 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48c4101420 0x7f48c410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:32.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.333+0000 7f48c9bca640 1 --2- 172.21.15.33:0/3846169033 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48c4100a80 0x7f48c4100ee0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:32.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.333+0000 7f48c9bca640 1 --2- 172.21.15.33:0/3846169033 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48c4106a80 0x7f48c4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:32.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.333+0000 7f48c9bca640 1 -- 172.21.15.33:0/3846169033 >> 172.21.15.33:0/3846169033 conn(0x7f48c40fc7a0 msgr2=0x7f48c40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:29:32.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.333+0000 7f48c9bca640 1 -- 172.21.15.33:0/3846169033 shutdown_connections 2024-09-12T12:29:32.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.334+0000 7f48c9bca640 1 -- 172.21.15.33:0/3846169033 wait complete. 2024-09-12T12:29:32.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.335+0000 7f48c9bca640 1 Processor -- start 2024-09-12T12:29:32.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.335+0000 7f48c9bca640 1 -- start start 2024-09-12T12:29:32.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.335+0000 7f48c9bca640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48c4100a80 0x7f48c4109cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:32.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.335+0000 7f48c9bca640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48c4101420 0x7f48c410a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:32.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.335+0000 7f48c9bca640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48c4106a80 0x7f48c410a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:32.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.336+0000 7f48c9bca640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f48c410fc30 con 0x7f48c4106a80 2024-09-12T12:29:32.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.336+0000 7f48c9bca640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f48c410fab0 con 0x7f48c4100a80 2024-09-12T12:29:32.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.336+0000 7f48c9bca640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f48c410fdb0 con 0x7f48c4101420 2024-09-12T12:29:32.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.336+0000 7f48c37fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48c4100a80 0x7f48c4109cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:32.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.336+0000 7f48c37fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48c4100a80 0x7f48c4109cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:36150/0 (socket says 172.21.15.33:36150) 2024-09-12T12:29:32.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.336+0000 7f48c3fff640 1 --2- 172.21.15.33:0/278546721 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48c4106a80 0x7f48c410a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:32.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.336+0000 7f48c37fe640 1 -- 172.21.15.33:0/278546721 learned_addr learned my addr 172.21.15.33:0/278546721 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:29:32.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.336+0000 7f48c2ffd640 1 --2- 172.21.15.33:0/278546721 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48c4101420 0x7f48c410a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:32.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.336+0000 7f48c3fff640 1 -- 172.21.15.33:0/278546721 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48c4101420 msgr2=0x7f48c410a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:32.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.336+0000 7f48c3fff640 1 --2- 172.21.15.33:0/278546721 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48c4101420 0x7f48c410a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:32.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.336+0000 7f48c3fff640 1 -- 172.21.15.33:0/278546721 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48c4100a80 msgr2=0x7f48c4109cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:32.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.336+0000 7f48c3fff640 1 --2- 172.21.15.33:0/278546721 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48c4100a80 0x7f48c4109cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:32.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.336+0000 7f48c3fff640 1 -- 172.21.15.33:0/278546721 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48c41aac90 con 0x7f48c4106a80 2024-09-12T12:29:32.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.337+0000 7f48c3fff640 1 --2- 172.21.15.33:0/278546721 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48c4106a80 0x7f48c410a770 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f48bc00d6b0 tx=0x7f48bc00db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:29:32.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.337+0000 7f48c2ffd640 1 --2- 172.21.15.33:0/278546721 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48c4101420 0x7f48c410a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:29:32.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.337+0000 7f48c37fe640 1 --2- 172.21.15.33:0/278546721 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48c4100a80 0x7f48c4109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:29:32.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.338+0000 7f48c0ff9640 1 -- 172.21.15.33:0/278546721 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48bc017070 con 0x7f48c4106a80 2024-09-12T12:29:32.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.338+0000 7f48c0ff9640 1 -- 172.21.15.33:0/278546721 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f48bc009cd0 con 0x7f48c4106a80 2024-09-12T12:29:32.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.338+0000 7f48c0ff9640 1 -- 172.21.15.33:0/278546721 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48bc003cc0 con 0x7f48c4106a80 2024-09-12T12:29:32.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.338+0000 7f48c9bca640 1 -- 172.21.15.33:0/278546721 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48c41aaf80 con 0x7f48c4106a80 2024-09-12T12:29:32.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.338+0000 7f48c9bca640 1 -- 172.21.15.33:0/278546721 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48c41ab380 con 0x7f48c4106a80 2024-09-12T12:29:32.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.342+0000 7f48cbfa3740 1 Processor -- start 2024-09-12T12:29:32.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.342+0000 7f48c0ff9640 1 -- 172.21.15.33:0/278546721 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f48bc010460 con 0x7f48c4106a80 2024-09-12T12:29:32.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.343+0000 7f48c0ff9640 1 --2- 172.21.15.33:0/278546721 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f48ac0a2d10 0x7f48ac0a51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:32.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.344+0000 7f48c0ff9640 1 -- 172.21.15.33:0/278546721 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f48bc0ce620 con 0x7f48c4106a80 2024-09-12T12:29:32.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.344+0000 7f48cbfa3740 1 -- start start 2024-09-12T12:29:32.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.344+0000 7f48cbfa3740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557cb06ae4a0 0x557cb06ae880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:32.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.344+0000 7f48cbfa3740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557cb06aedc0 0x557cb06b9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:32.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.344+0000 7f48cbfa3740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557cb06b9680 0x557cb06bba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:32.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.344+0000 7f48cbfa3740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x557cb06142e0 con 0x557cb06ae4a0 2024-09-12T12:29:32.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.344+0000 7f48cbfa3740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557cb05bbce0 con 0x557cb06b9680 2024-09-12T12:29:32.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.344+0000 7f48cbfa3740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557cb06102a0 con 0x557cb06aedc0 2024-09-12T12:29:32.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.344+0000 7f48c2ffd640 1 --2- 172.21.15.33:0/278546721 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f48ac0a2d10 0x7f48ac0a51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:32.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.344+0000 7f48c37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557cb06ae4a0 0x557cb06ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:32.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.345+0000 7f48c2ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557cb06aedc0 0x557cb06b9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:32.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.345+0000 7f48c2ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557cb06aedc0 0x557cb06b9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:45174/0 (socket says 172.21.15.33:45174) 2024-09-12T12:29:32.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.345+0000 7f48c2ffd640 1 -- 172.21.15.33:0/744597823 learned_addr learned my addr 172.21.15.33:0/744597823 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:29:32.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.345+0000 7f48c3fff640 1 --2- 172.21.15.33:0/744597823 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557cb06b9680 0x557cb06bba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:32.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.345+0000 7f48c2ffd640 1 -- 172.21.15.33:0/744597823 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557cb06b9680 msgr2=0x557cb06bba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:32.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.345+0000 7f48c2ffd640 1 --2- 172.21.15.33:0/744597823 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557cb06b9680 0x557cb06bba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:32.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.345+0000 7f48c2ffd640 1 -- 172.21.15.33:0/744597823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557cb06ae4a0 msgr2=0x557cb06ae880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:32.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.345+0000 7f48c2ffd640 1 --2- 172.21.15.33:0/744597823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557cb06ae4a0 0x557cb06ae880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:32.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.345+0000 7f48c2ffd640 1 -- 172.21.15.33:0/744597823 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cb05a0440 con 0x557cb06aedc0 2024-09-12T12:29:32.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.345+0000 7f48c2ffd640 1 --2- 172.21.15.33:0/278546721 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f48ac0a2d10 0x7f48ac0a51d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f48b80057c0 tx=0x7f48b8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:29:32.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.345+0000 7f48c2ffd640 1 --2- 172.21.15.33:0/744597823 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557cb06aedc0 0x557cb06b9140 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f48b8009230 tx=0x7f48b8044000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d84f549d9f3ebe0b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:29:32.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.346+0000 7f48a9ffb640 1 -- 172.21.15.33:0/744597823 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b804d070 con 0x557cb06aedc0 2024-09-12T12:29:32.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.346+0000 7f48a9ffb640 1 -- 172.21.15.33:0/744597823 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f48b80054e0 con 0x557cb06aedc0 2024-09-12T12:29:32.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.346+0000 7f48a9ffb640 1 -- 172.21.15.33:0/744597823 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b8035040 con 0x557cb06aedc0 2024-09-12T12:29:32.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.347+0000 7f48cbfa3740 1 -- 172.21.15.33:0/744597823 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557cb06aedc0 msgr2=0x557cb06b9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:32.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.347+0000 7f48cbfa3740 1 --2- 172.21.15.33:0/744597823 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557cb06aedc0 0x557cb06b9140 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f48b8009230 tx=0x7f48b8044000 comp rx=0 tx=0).stop 2024-09-12T12:29:32.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.347+0000 7f48cbfa3740 1 -- 172.21.15.33:0/744597823 shutdown_connections 2024-09-12T12:29:32.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.347+0000 7f48cbfa3740 1 --2- 172.21.15.33:0/744597823 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557cb06b9680 0x557cb06bba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:32.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.347+0000 7f48cbfa3740 1 --2- 172.21.15.33:0/744597823 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557cb06aedc0 0x557cb06b9140 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:32.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.347+0000 7f48cbfa3740 1 --2- 172.21.15.33:0/744597823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557cb06ae4a0 0x557cb06ae880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:32.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.347+0000 7f48cbfa3740 1 -- 172.21.15.33:0/744597823 >> 172.21.15.33:0/744597823 conn(0x557cb06aaa30 msgr2=0x557cb06aae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:29:32.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.347+0000 7f48cbfa3740 1 -- 172.21.15.33:0/744597823 shutdown_connections 2024-09-12T12:29:32.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.347+0000 7f48cbfa3740 1 -- 172.21.15.33:0/744597823 wait complete. 2024-09-12T12:29:32.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.348+0000 7f48cbfa3740 1 -- start start 2024-09-12T12:29:32.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.348+0000 7f48cbfa3740 1 Processor -- start 2024-09-12T12:29:32.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.349+0000 7f48cbfa3740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557cb06ae4a0 0x557cb06b8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:32.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.349+0000 7f48cbfa3740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557cb06aedc0 0x557cb06b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:32.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.349+0000 7f48cbfa3740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557cb06b9680 0x557cb06b66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:32.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.349+0000 7f48cbfa3740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x557cb06cd300 con 0x557cb06aedc0 2024-09-12T12:29:32.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.349+0000 7f48cbfa3740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557cb05cf050 con 0x557cb06b9680 2024-09-12T12:29:32.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.349+0000 7f48cbfa3740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557cb06cd480 con 0x557cb06ae4a0 2024-09-12T12:29:32.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.349+0000 7f48cbfa3740 10 client.0 _ll_register_callbacks cb 0x557cb060f160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:29:32.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.349+0000 7f48c37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557cb06ae4a0 0x557cb06b8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:32.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.349+0000 7f48c37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557cb06ae4a0 0x557cb06b8ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:45178/0 (socket says 172.21.15.33:45178) 2024-09-12T12:29:32.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.349+0000 7f48c37fe640 1 -- 172.21.15.33:0/3477968943 learned_addr learned my addr 172.21.15.33:0/3477968943 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:29:32.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.349+0000 7f48c3fff640 1 --2- 172.21.15.33:0/3477968943 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557cb06b9680 0x557cb06b66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:32.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.350+0000 7f48c37fe640 1 -- 172.21.15.33:0/3477968943 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557cb06b9680 msgr2=0x557cb06b66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:32.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.350+0000 7f48c37fe640 1 --2- 172.21.15.33:0/3477968943 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557cb06b9680 0x557cb06b66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:32.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.350+0000 7f48c37fe640 1 -- 172.21.15.33:0/3477968943 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557cb06aedc0 msgr2=0x557cb06b61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:32.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.350+0000 7f48c37fe640 1 --2- 172.21.15.33:0/3477968943 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557cb06aedc0 0x557cb06b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:32.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.350+0000 7f48c37fe640 1 -- 172.21.15.33:0/3477968943 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557cb03853c0 con 0x557cb06ae4a0 2024-09-12T12:29:32.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.350+0000 7f48c37fe640 1 --2- 172.21.15.33:0/3477968943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557cb06ae4a0 0x557cb06b8ef0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f48b4011bd0 tx=0x7f48b4011fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aff72241d3fa6ec4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:29:32.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.350+0000 7f48a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:29:32.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.350+0000 7f48a2ffd640 1 -- 172.21.15.33:0/3477968943 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b4012da0 con 0x557cb06ae4a0 2024-09-12T12:29:32.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.350+0000 7f48a2ffd640 1 -- 172.21.15.33:0/3477968943 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f48b401b3c0 con 0x557cb06ae4a0 2024-09-12T12:29:32.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.351+0000 7f48cbfa3740 1 -- 172.21.15.33:0/3477968943 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48b80054e0 con 0x557cb06ae4a0 2024-09-12T12:29:32.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.351+0000 7f48a2ffd640 1 -- 172.21.15.33:0/3477968943 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f48b401b5c0 con 0x557cb06ae4a0 2024-09-12T12:29:32.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.351+0000 7f48cbfa3740 10 client.25375 fetch_fsmap learned FSMap version 26 2024-09-12T12:29:32.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.351+0000 7f48cbfa3740 1 -- 172.21.15.33:0/3477968943 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x557cb06d8ce0 con 0x557cb06ae4a0 2024-09-12T12:29:32.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.352+0000 7f48a2ffd640 1 -- 172.21.15.33:0/3477968943 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f48b80054e0 con 0x557cb06ae4a0 2024-09-12T12:29:32.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.352+0000 7f48a2ffd640 1 -- 172.21.15.33:0/3477968943 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f48b400f040 con 0x557cb06ae4a0 2024-09-12T12:29:32.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.352+0000 7f48cbfa3740 10 client.25375 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:29:32.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.352+0000 7f48cbfa3740 10 client.25375 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:29:32.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.352+0000 7f48cbfa3740 20 client.25375 populate_metadata read hostname 'smithi033' 2024-09-12T12:29:32.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.352+0000 7f48cbfa3740 1 --2- 172.21.15.33:0/3477968943 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x557cb06da1b0 0x557cb06dc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:32.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.352+0000 7f48cbfa3740 4 client.25375 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:29:32.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.352+0000 7f48cbfa3740 1 -- 172.21.15.33:0/3477968943 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557cb0621850 con 0x557cb06da1b0 2024-09-12T12:29:32.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.355+0000 7f48c2ffd640 1 --2- 172.21.15.33:0/3477968943 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x557cb06da1b0 0x557cb06dc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:32.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.360+0000 7f48c2ffd640 1 --2- 172.21.15.33:0/3477968943 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x557cb06da1b0 0x557cb06dc650 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec1327238a943f0d server_cookie=395d969a791f564d in_seq=0 out_seq=0 2024-09-12T12:29:32.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.361+0000 7f48a2ffd640 10 client.25375 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:29:32.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.361+0000 7f48a2ffd640 1 -- 172.21.15.33:0/3477968943 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557cb0621850 con 0x557cb06da1b0 2024-09-12T12:29:32.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.361+0000 7f48a2ffd640 10 client.25375 handle_command_reply: tid=0 2024-09-12T12:29:32.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.361+0000 7f48cbfa3740 1 client.25375 shutdown 2024-09-12T12:29:32.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.363+0000 7f48cbfa3740 1 -- 172.21.15.33:0/3477968943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557cb06ae4a0 msgr2=0x557cb06b8ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:32.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.363+0000 7f48cbfa3740 1 --2- 172.21.15.33:0/3477968943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557cb06ae4a0 0x557cb06b8ef0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f48b4011bd0 tx=0x7f48b4011fd0 comp rx=0 tx=0).stop 2024-09-12T12:29:32.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.363+0000 7f48cbfa3740 1 -- 172.21.15.33:0/3477968943 shutdown_connections 2024-09-12T12:29:32.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.363+0000 7f48cbfa3740 1 --2- 172.21.15.33:0/3477968943 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x557cb06da1b0 0x557cb06dc650 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:32.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.363+0000 7f48cbfa3740 1 --2- 172.21.15.33:0/3477968943 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557cb06b9680 0x557cb06b66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:32.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.363+0000 7f48cbfa3740 1 --2- 172.21.15.33:0/3477968943 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557cb06aedc0 0x557cb06b61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:32.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.363+0000 7f48cbfa3740 1 --2- 172.21.15.33:0/3477968943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557cb06ae4a0 0x557cb06b8ef0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:32.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.363+0000 7f48cbfa3740 1 -- 172.21.15.33:0/3477968943 >> 172.21.15.33:0/3477968943 conn(0x557cb06aaa30 msgr2=0x557cb06b0760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:29:32.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.367+0000 7f48a2ffd640 0 client.25375 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:29:32.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.367+0000 7f48cbfa3740 1 -- 172.21.15.33:0/3477968943 shutdown_connections 2024-09-12T12:29:32.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.367+0000 7f48cbfa3740 1 -- 172.21.15.33:0/3477968943 wait complete. 2024-09-12T12:29:32.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.367+0000 7f48cbfa3740 20 client.25375 trim_cache size 0 max 16384 2024-09-12T12:29:32.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.401+0000 7f48cbfa3740 1 Processor -- start 2024-09-12T12:29:32.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.402+0000 7f48cbfa3740 1 -- start start 2024-09-12T12:29:32.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.403+0000 7f48cbfa3740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557cb06ae4a0 0x557cb06e1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:32.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.403+0000 7f48cbfa3740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557cb06aedc0 0x557cb06e24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:32.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.403+0000 7f48c37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557cb06ae4a0 0x557cb06e1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:32.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.403+0000 7f48c37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557cb06ae4a0 0x557cb06e1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:45190/0 (socket says 172.21.15.33:45190) 2024-09-12T12:29:32.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.404+0000 7f48c2ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557cb06aedc0 0x557cb06e24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:32.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.404+0000 7f48cbfa3740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557cb06b9680 0x557cb06aff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:32.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.404+0000 7f48cbfa3740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f48b0012580 con 0x557cb06b9680 2024-09-12T12:29:32.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.404+0000 7f48cbfa3740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f48b000fe50 con 0x557cb06aedc0 2024-09-12T12:29:32.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.404+0000 7f48cbfa3740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f48b000dca0 con 0x557cb06ae4a0 2024-09-12T12:29:32.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.404+0000 7f48c37fe640 1 -- 172.21.15.33:0/389466880 learned_addr learned my addr 172.21.15.33:0/389466880 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:29:32.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.404+0000 7f48c3fff640 1 --2- 172.21.15.33:0/389466880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557cb06b9680 0x557cb06aff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:32.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.405+0000 7f48c3fff640 1 -- 172.21.15.33:0/389466880 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557cb06ae4a0 msgr2=0x557cb06e1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:32.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.405+0000 7f48c3fff640 1 --2- 172.21.15.33:0/389466880 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557cb06ae4a0 0x557cb06e1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:32.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.405+0000 7f48c3fff640 1 -- 172.21.15.33:0/389466880 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557cb06aedc0 msgr2=0x557cb06e24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:32.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.405+0000 7f48c3fff640 1 --2- 172.21.15.33:0/389466880 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557cb06aedc0 0x557cb06e24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:32.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.405+0000 7f48c3fff640 1 -- 172.21.15.33:0/389466880 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cb06aa860 con 0x557cb06b9680 2024-09-12T12:29:32.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.405+0000 7f48c3fff640 1 --2- 172.21.15.33:0/389466880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557cb06b9680 0x557cb06aff40 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f48bc005fd0 tx=0x7f48bc09bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40dd2746eb07b702 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:29:32.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.406+0000 7f48a97fa640 1 -- 172.21.15.33:0/389466880 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48bc020040 con 0x557cb06b9680 2024-09-12T12:29:32.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.406+0000 7f48a97fa640 1 -- 172.21.15.33:0/389466880 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f48bc099fc0 con 0x557cb06b9680 2024-09-12T12:29:32.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.406+0000 7f48a97fa640 1 -- 172.21.15.33:0/389466880 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48bc09bf20 con 0x557cb06b9680 2024-09-12T12:29:32.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.407+0000 7f48cbfa3740 1 -- 172.21.15.33:0/389466880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557cb06b9680 msgr2=0x557cb06aff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:32.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.407+0000 7f48cbfa3740 1 --2- 172.21.15.33:0/389466880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557cb06b9680 0x557cb06aff40 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f48bc005fd0 tx=0x7f48bc09bd80 comp rx=0 tx=0).stop 2024-09-12T12:29:32.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.407+0000 7f48cbfa3740 1 -- 172.21.15.33:0/389466880 shutdown_connections 2024-09-12T12:29:32.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.407+0000 7f48cbfa3740 1 --2- 172.21.15.33:0/389466880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557cb06b9680 0x557cb06aff40 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:32.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.407+0000 7f48cbfa3740 1 --2- 172.21.15.33:0/389466880 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557cb06aedc0 0x557cb06e24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:32.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.407+0000 7f48cbfa3740 1 --2- 172.21.15.33:0/389466880 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557cb06ae4a0 0x557cb06e1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:32.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.407+0000 7f48cbfa3740 1 -- 172.21.15.33:0/389466880 >> 172.21.15.33:0/389466880 conn(0x557cb06aaa30 msgr2=0x557cb06b5290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:29:32.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.407+0000 7f48cbfa3740 1 -- 172.21.15.33:0/389466880 shutdown_connections 2024-09-12T12:29:32.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.407+0000 7f48cbfa3740 1 -- 172.21.15.33:0/389466880 wait complete. 2024-09-12T12:29:32.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.408+0000 7f48cbfa3740 1 -- start start 2024-09-12T12:29:32.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.408+0000 7f48cbfa3740 1 Processor -- start 2024-09-12T12:29:32.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.409+0000 7f48cbfa3740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557cb06ae4a0 0x557cb06d2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:32.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.409+0000 7f48cbfa3740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557cb06aedc0 0x557cb06d2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:32.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.409+0000 7f48c37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557cb06ae4a0 0x557cb06d2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:32.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.409+0000 7f48cbfa3740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557cb06b9680 0x557cb06b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:32.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.409+0000 7f48cbfa3740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f48b000e310 con 0x557cb06b9680 2024-09-12T12:29:32.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.409+0000 7f48cbfa3740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f48b000f780 con 0x557cb06aedc0 2024-09-12T12:29:32.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.409+0000 7f48cbfa3740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f48b000e9e0 con 0x557cb06ae4a0 2024-09-12T12:29:32.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.409+0000 7f48c37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557cb06ae4a0 0x557cb06d2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:45198/0 (socket says 172.21.15.33:45198) 2024-09-12T12:29:32.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.409+0000 7f48c37fe640 1 -- 172.21.15.33:0/3797223188 learned_addr learned my addr 172.21.15.33:0/3797223188 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:29:32.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.409+0000 7f48cbfa3740 10 client.0 _ll_register_callbacks cb 0x7f48b4011810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:29:32.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.409+0000 7f48c2ffd640 1 --2- 172.21.15.33:0/3797223188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557cb06aedc0 0x557cb06d2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:32.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.410+0000 7f48c3fff640 1 --2- 172.21.15.33:0/3797223188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557cb06b9680 0x557cb06b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:32.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.410+0000 7f48c2ffd640 1 -- 172.21.15.33:0/3797223188 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557cb06ae4a0 msgr2=0x557cb06d2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:32.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.410+0000 7f48c2ffd640 1 --2- 172.21.15.33:0/3797223188 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557cb06ae4a0 0x557cb06d2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:32.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.410+0000 7f48c2ffd640 1 -- 172.21.15.33:0/3797223188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557cb06b9680 msgr2=0x557cb06b2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:32.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.410+0000 7f48c2ffd640 1 --2- 172.21.15.33:0/3797223188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557cb06b9680 0x557cb06b2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:32.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.410+0000 7f48c2ffd640 1 -- 172.21.15.33:0/3797223188 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557cb06b3390 con 0x557cb06aedc0 2024-09-12T12:29:32.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.411+0000 7f48c2ffd640 1 --2- 172.21.15.33:0/3797223188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557cb06aedc0 0x557cb06d2f90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x557cb06b77e0 tx=0x7f48b8005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=555196ade9b1f669 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:29:32.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.411+0000 7f48a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:29:32.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.411+0000 7f48a2ffd640 1 -- 172.21.15.33:0/3797223188 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b804d040 con 0x557cb06aedc0 2024-09-12T12:29:32.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.411+0000 7f48a2ffd640 1 -- 172.21.15.33:0/3797223188 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f48b80046c0 con 0x557cb06aedc0 2024-09-12T12:29:32.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.411+0000 7f48cbfa3740 1 -- 172.21.15.33:0/3797223188 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48bc099fc0 con 0x557cb06aedc0 2024-09-12T12:29:32.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.411+0000 7f48a2ffd640 1 -- 172.21.15.33:0/3797223188 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f48b8062050 con 0x557cb06aedc0 2024-09-12T12:29:32.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.411+0000 7f48cbfa3740 10 client.25295 fetch_fsmap learned FSMap version 26 2024-09-12T12:29:32.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.411+0000 7f48cbfa3740 1 -- 172.21.15.33:0/3797223188 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x557cb0744b40 con 0x557cb06aedc0 2024-09-12T12:29:32.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.412+0000 7f48a2ffd640 1 -- 172.21.15.33:0/3797223188 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f48bc099fc0 con 0x557cb06aedc0 2024-09-12T12:29:32.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.412+0000 7f48a2ffd640 1 -- 172.21.15.33:0/3797223188 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f48b803a050 con 0x557cb06aedc0 2024-09-12T12:29:32.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.412+0000 7f48cbfa3740 10 client.25295 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:29:32.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.412+0000 7f48cbfa3740 10 client.25295 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:29:32.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.412+0000 7f48cbfa3740 20 client.25295 populate_metadata read hostname 'smithi033' 2024-09-12T12:29:32.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.412+0000 7f48cbfa3740 1 --2- 172.21.15.33:0/3797223188 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x557cb0744e80 0x557cb0747270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:32.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.412+0000 7f48cbfa3740 4 client.25295 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:29:32.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.412+0000 7f48cbfa3740 1 -- 172.21.15.33:0/3797223188 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557cb061bd60 con 0x557cb0744e80 2024-09-12T12:29:32.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.412+0000 7f48c37fe640 1 --2- 172.21.15.33:0/3797223188 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x557cb0744e80 0x557cb0747270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:32.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.413+0000 7f48c37fe640 1 --2- 172.21.15.33:0/3797223188 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x557cb0744e80 0x557cb0747270 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86dde88a8a27741 server_cookie=a6062603a33d7f00 in_seq=0 out_seq=0 2024-09-12T12:29:32.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.413+0000 7f48a2ffd640 10 client.25295 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:29:32.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.413+0000 7f48a2ffd640 1 -- 172.21.15.33:0/3797223188 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x557cb061bd60 con 0x557cb0744e80 2024-09-12T12:29:32.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.413+0000 7f48a2ffd640 10 client.25295 handle_command_reply: tid=0 2024-09-12T12:29:32.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.413+0000 7f48cbfa3740 1 client.25295 shutdown 2024-09-12T12:29:32.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.414+0000 7f48cbfa3740 1 -- 172.21.15.33:0/3797223188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557cb06aedc0 msgr2=0x557cb06d2f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:32.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.414+0000 7f48cbfa3740 1 --2- 172.21.15.33:0/3797223188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557cb06aedc0 0x557cb06d2f90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x557cb06b77e0 tx=0x7f48b8005fd0 comp rx=0 tx=0).stop 2024-09-12T12:29:32.416 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:29:32.416 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "no active scrubs running", 2024-09-12T12:29:32.416 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": {} 2024-09-12T12:29:32.416 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:29:32.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.414+0000 7f48cbfa3740 1 -- 172.21.15.33:0/3797223188 shutdown_connections 2024-09-12T12:29:32.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.414+0000 7f48cbfa3740 1 --2- 172.21.15.33:0/3797223188 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x557cb0744e80 0x557cb0747270 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:32.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.414+0000 7f48cbfa3740 1 --2- 172.21.15.33:0/3797223188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557cb06b9680 0x557cb06b2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:32.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.414+0000 7f48cbfa3740 1 --2- 172.21.15.33:0/3797223188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557cb06aedc0 0x557cb06d2f90 secure :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0x557cb06b77e0 tx=0x7f48b8005fd0 comp rx=0 tx=0).stop 2024-09-12T12:29:32.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.414+0000 7f48cbfa3740 1 --2- 172.21.15.33:0/3797223188 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557cb06ae4a0 0x557cb06d2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:32.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.414+0000 7f48a2ffd640 0 client.25295 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:29:32.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.414+0000 7f48cbfa3740 1 -- 172.21.15.33:0/3797223188 >> 172.21.15.33:0/3797223188 conn(0x557cb06aaa30 msgr2=0x557cb06a9350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:29:32.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.414+0000 7f48cbfa3740 1 -- 172.21.15.33:0/3797223188 shutdown_connections 2024-09-12T12:29:32.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.414+0000 7f48cbfa3740 1 -- 172.21.15.33:0/3797223188 wait complete. 2024-09-12T12:29:32.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.414+0000 7f48cbfa3740 20 client.25295 trim_cache size 0 max 16384 2024-09-12T12:29:32.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.416+0000 7f48c9bca640 1 -- 172.21.15.33:0/278546721 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f48ac0a2d10 msgr2=0x7f48ac0a51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:32.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.416+0000 7f48c9bca640 1 --2- 172.21.15.33:0/278546721 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f48ac0a2d10 0x7f48ac0a51d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f48b80057c0 tx=0x7f48b8000bc0 comp rx=0 tx=0).stop 2024-09-12T12:29:32.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.416+0000 7f48c9bca640 1 -- 172.21.15.33:0/278546721 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48c4106a80 msgr2=0x7f48c410a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:32.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.416+0000 7f48c9bca640 1 --2- 172.21.15.33:0/278546721 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48c4106a80 0x7f48c410a770 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f48bc00d6b0 tx=0x7f48bc00db70 comp rx=0 tx=0).stop 2024-09-12T12:29:32.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.416+0000 7f48c9bca640 1 -- 172.21.15.33:0/278546721 shutdown_connections 2024-09-12T12:29:32.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.416+0000 7f48c9bca640 1 --2- 172.21.15.33:0/278546721 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f48ac0a2d10 0x7f48ac0a51d0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:32.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.416+0000 7f48c9bca640 1 --2- 172.21.15.33:0/278546721 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48c4106a80 0x7f48c410a770 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:32.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.416+0000 7f48c9bca640 1 --2- 172.21.15.33:0/278546721 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48c4101420 0x7f48c410a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:32.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.416+0000 7f48c9bca640 1 --2- 172.21.15.33:0/278546721 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48c4100a80 0x7f48c4109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:32.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.416+0000 7f48c9bca640 1 -- 172.21.15.33:0/278546721 >> 172.21.15.33:0/278546721 conn(0x7f48c40fc7a0 msgr2=0x7f48c40fd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:29:32.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.416+0000 7f48c9bca640 1 -- 172.21.15.33:0/278546721 shutdown_connections 2024-09-12T12:29:32.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:32.416+0000 7f48c9bca640 1 -- 172.21.15.33:0/278546721 wait complete. 2024-09-12T12:29:33.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:29:33 smithi043 ceph-mon[34144]: pgmap v456: 129 pgs: 129 active+clean; 10 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 53 MiB/s wr, 852 op/s 2024-09-12T12:29:33.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:29:33 smithi102 ceph-mon[34799]: pgmap v456: 129 pgs: 129 active+clean; 10 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 53 MiB/s wr, 852 op/s 2024-09-12T12:29:33.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:29:33 smithi033 ceph-mon[31246]: pgmap v456: 129 pgs: 129 active+clean; 10 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 53 MiB/s wr, 852 op/s 2024-09-12T12:29:35.313 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:29:35 smithi033 ceph-mon[31246]: pgmap v457: 129 pgs: 129 active+clean; 10 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 55 MiB/s wr, 893 op/s 2024-09-12T12:29:35.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:29:35 smithi043 ceph-mon[34144]: pgmap v457: 129 pgs: 129 active+clean; 10 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 55 MiB/s wr, 893 op/s 2024-09-12T12:29:35.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:29:35 smithi102 ceph-mon[34799]: pgmap v457: 129 pgs: 129 active+clean; 10 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 55 MiB/s wr, 893 op/s 2024-09-12T12:29:37.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:29:37 smithi043 ceph-mon[34144]: pgmap v458: 129 pgs: 129 active+clean; 10 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 47 MiB/s wr, 757 op/s 2024-09-12T12:29:37.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:29:37 smithi102 ceph-mon[34799]: pgmap v458: 129 pgs: 129 active+clean; 10 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 47 MiB/s wr, 757 op/s 2024-09-12T12:29:37.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:29:37 smithi033 ceph-mon[31246]: pgmap v458: 129 pgs: 129 active+clean; 10 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 47 MiB/s wr, 757 op/s 2024-09-12T12:29:39.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:29:39 smithi043 ceph-mon[34144]: pgmap v459: 129 pgs: 129 active+clean; 10 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 58 MiB/s wr, 927 op/s 2024-09-12T12:29:39.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:29:39 smithi043 ceph-mon[34144]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T12:29:39.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:29:39 smithi102 ceph-mon[34799]: pgmap v459: 129 pgs: 129 active+clean; 10 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 58 MiB/s wr, 927 op/s 2024-09-12T12:29:39.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:29:39 smithi102 ceph-mon[34799]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T12:29:39.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:29:39 smithi033 ceph-mon[31246]: pgmap v459: 129 pgs: 129 active+clean; 10 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 58 MiB/s wr, 927 op/s 2024-09-12T12:29:39.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:29:39 smithi033 ceph-mon[31246]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T12:29:41.092 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T12:29:41.092 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:29:41.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:29:41 smithi043 ceph-mon[34144]: pgmap v460: 129 pgs: 129 active+clean; 10 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 44 MiB/s wr, 702 op/s 2024-09-12T12:29:41.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:29:41 smithi102 ceph-mon[34799]: pgmap v460: 129 pgs: 129 active+clean; 10 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 44 MiB/s wr, 702 op/s 2024-09-12T12:29:41.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:29:41 smithi033 ceph-mon[31246]: pgmap v460: 129 pgs: 129 active+clean; 10 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 44 MiB/s wr, 702 op/s 2024-09-12T12:29:41.628 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:29:42.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:42.695+0000 7fcbd3df4640 1 -- 172.21.15.33:0/1032839553 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcbcc0ffc40 msgr2=0x7fcbcc1000c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:42.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:42.695+0000 7fcbd3df4640 1 --2- 172.21.15.33:0/1032839553 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcbcc0ffc40 0x7fcbcc1000c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8009930 tx=0x7fcbc802a430 comp rx=0 tx=0).stop 2024-09-12T12:29:42.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:42.695+0000 7fcbd3df4640 1 -- 172.21.15.33:0/1032839553 shutdown_connections 2024-09-12T12:29:42.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:42.695+0000 7fcbd3df4640 1 --2- 172.21.15.33:0/1032839553 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcbcc100600 0x7fcbcc10e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:42.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:42.695+0000 7fcbd3df4640 1 --2- 172.21.15.33:0/1032839553 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcbcc0ffc40 0x7fcbcc1000c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:42.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:42.695+0000 7fcbd3df4640 1 --2- 172.21.15.33:0/1032839553 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbcc106c80 0x7fcbcc107060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:42.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:42.695+0000 7fcbd3df4640 1 -- 172.21.15.33:0/1032839553 >> 172.21.15.33:0/1032839553 conn(0x7fcbcc0fba90 msgr2=0x7fcbcc0fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:29:42.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:42.695+0000 7fcbd3df4640 1 -- 172.21.15.33:0/1032839553 shutdown_connections 2024-09-12T12:29:42.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:42.697+0000 7fcbd3df4640 1 -- 172.21.15.33:0/1032839553 wait complete. 2024-09-12T12:29:42.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:42.698+0000 7fcbd3df4640 1 Processor -- start 2024-09-12T12:29:42.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:42.700+0000 7fcbd3df4640 1 -- start start 2024-09-12T12:29:42.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:42.700+0000 7fcbd3df4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbcc0ffc40 0x7fcbcc1960a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:42.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:42.701+0000 7fcbd3df4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcbcc100600 0x7fcbcc1965e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:42.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:42.701+0000 7fcbd3df4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcbcc106c80 0x7fcbcc19a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:42.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:42.701+0000 7fcbd3df4640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcbcc10fc60 con 0x7fcbcc106c80 2024-09-12T12:29:42.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:42.701+0000 7fcbd3df4640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcbcc10fae0 con 0x7fcbcc0ffc40 2024-09-12T12:29:42.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:42.701+0000 7fcbd3df4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fcbcc10fde0 con 0x7fcbcc100600 2024-09-12T12:29:42.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:42.701+0000 7fcbd138f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcbcc100600 0x7fcbcc1965e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:42.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:42.701+0000 7fcbd138f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcbcc100600 0x7fcbcc1965e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:57390/0 (socket says 172.21.15.33:57390) 2024-09-12T12:29:42.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:42.701+0000 7fcbd138f640 1 -- 172.21.15.33:0/2740823214 learned_addr learned my addr 172.21.15.33:0/2740823214 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:29:42.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:42.702+0000 7fcbd138f640 1 -- 172.21.15.33:0/2740823214 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbcc0ffc40 msgr2=0x7fcbcc1960a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T12:29:42.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:42.702+0000 7fcbd138f640 1 --2- 172.21.15.33:0/2740823214 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbcc0ffc40 0x7fcbcc1960a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:42.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:42.702+0000 7fcbd138f640 1 -- 172.21.15.33:0/2740823214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcbcc106c80 msgr2=0x7fcbcc19a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:42.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:42.702+0000 7fcbd138f640 1 --2- 172.21.15.33:0/2740823214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcbcc106c80 0x7fcbcc19a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:42.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:42.702+0000 7fcbd138f640 1 -- 172.21.15.33:0/2740823214 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbcc19b050 con 0x7fcbcc100600 2024-09-12T12:29:42.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:42.702+0000 7fcbd138f640 1 --2- 172.21.15.33:0/2740823214 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcbcc100600 0x7fcbcc1965e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcbc802a9a0 tx=0x7fcbc8003c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:29:42.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:42.703+0000 7fcbc2ffd640 1 -- 172.21.15.33:0/2740823214 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc803f070 con 0x7fcbcc100600 2024-09-12T12:29:42.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:42.703+0000 7fcbc2ffd640 1 -- 172.21.15.33:0/2740823214 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcbc803bb10 con 0x7fcbcc100600 2024-09-12T12:29:42.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:42.703+0000 7fcbd3df4640 1 -- 172.21.15.33:0/2740823214 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbcc19b2e0 con 0x7fcbcc100600 2024-09-12T12:29:42.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:42.703+0000 7fcbd3df4640 1 -- 172.21.15.33:0/2740823214 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbcc19b700 con 0x7fcbcc100600 2024-09-12T12:29:42.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:42.704+0000 7fcbc2ffd640 1 -- 172.21.15.33:0/2740823214 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc8035030 con 0x7fcbcc100600 2024-09-12T12:29:42.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:42.706+0000 7fcbd3df4640 1 -- 172.21.15.33:0/2740823214 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbcc1000c0 con 0x7fcbcc100600 2024-09-12T12:29:42.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:42.708+0000 7fcbc2ffd640 1 -- 172.21.15.33:0/2740823214 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fcbc8042070 con 0x7fcbcc100600 2024-09-12T12:29:42.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:42.709+0000 7fcbc2ffd640 1 --2- 172.21.15.33:0/2740823214 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fcbb80a71a0 0x7fcbb80a9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:42.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:42.709+0000 7fcbc2ffd640 1 -- 172.21.15.33:0/2740823214 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fcbc80efc30 con 0x7fcbcc100600 2024-09-12T12:29:42.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:42.709+0000 7fcbd1b90640 1 --2- 172.21.15.33:0/2740823214 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fcbb80a71a0 0x7fcbb80a9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:42.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:42.711+0000 7fcbd1b90640 1 --2- 172.21.15.33:0/2740823214 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fcbb80a71a0 0x7fcbb80a9660 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4005fd0 tx=0x7fcbc4009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:29:42.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:42.714+0000 7fcbc2ffd640 1 -- 172.21.15.33:0/2740823214 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcbc80bd630 con 0x7fcbcc100600 2024-09-12T12:29:43.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:43.146+0000 7fcbd3df4640 1 -- 172.21.15.33:0/2740823214 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcbcc02d7c0 con 0x7fcbcc100600 2024-09-12T12:29:43.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:43.147+0000 7fcbc2ffd640 1 -- 172.21.15.33:0/2740823214 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11912 (secure 0 0 0) 0x7fcbc80bcf30 con 0x7fcbcc100600 2024-09-12T12:29:43.147 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:29:43.147 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":27,"btime":"2024-09-12T12:29:38:065241+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3327066342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3327066342},{"type":"v1","addr":"172.21.15.33:6835","nonce":3327066342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/19516401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":19516401},{"type":"v1","addr":"172.21.15.33:6837","nonce":19516401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1260196118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1260196118},{"type":"v1","addr":"172.21.15.33:6839","nonce":1260196118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/4288248356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4288248356},{"type":"v1","addr":"172.21.15.33:6841","nonce":4288248356}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/3051073141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3051073141},{"type":"v1","addr":"172.21.15.43:6833","nonce":3051073141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3282762800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3282762800},{"type":"v1","addr":"172.21.15.43:6835","nonce":3282762800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:23:46.400609+0000","modified":"2024-09-12T12:29:37.555614+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24490,"mds_2":24478},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3051713000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3051713000},{"type":"v1","addr":"172.21.15.102:6833","nonce":3051713000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6837/2472064883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2472064883},{"type":"v1","addr":"172.21.15.43:6837","nonce":2472064883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/1987408860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":1987408860},{"type":"v1","addr":"172.21.15.43:6839","nonce":1987408860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/4179527539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":4179527539},{"type":"v1","addr":"172.21.15.102:6835","nonce":4179527539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/2409953270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2409953270},{"type":"v1","addr":"172.21.15.102:6837","nonce":2409953270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.102:6839/1553271340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":1553271340},{"type":"v1","addr":"172.21.15.102:6839","nonce":1553271340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24499,"qdb_cluster":[24499,24490,24478]},"id":1}]} 2024-09-12T12:29:43.148 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 27 2024-09-12T12:29:43.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:43.153+0000 7fcbd3df4640 1 -- 172.21.15.33:0/2740823214 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fcbb80a71a0 msgr2=0x7fcbb80a9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:43.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:43.153+0000 7fcbd3df4640 1 --2- 172.21.15.33:0/2740823214 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fcbb80a71a0 0x7fcbb80a9660 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4005fd0 tx=0x7fcbc4009500 comp rx=0 tx=0).stop 2024-09-12T12:29:43.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:43.153+0000 7fcbd3df4640 1 -- 172.21.15.33:0/2740823214 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcbcc100600 msgr2=0x7fcbcc1965e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:43.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:43.153+0000 7fcbd3df4640 1 --2- 172.21.15.33:0/2740823214 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcbcc100600 0x7fcbcc1965e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcbc802a9a0 tx=0x7fcbc8003c00 comp rx=0 tx=0).stop 2024-09-12T12:29:43.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:43.153+0000 7fcbd3df4640 1 -- 172.21.15.33:0/2740823214 shutdown_connections 2024-09-12T12:29:43.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:43.153+0000 7fcbd3df4640 1 --2- 172.21.15.33:0/2740823214 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fcbb80a71a0 0x7fcbb80a9660 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:43.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:43.153+0000 7fcbd3df4640 1 --2- 172.21.15.33:0/2740823214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcbcc106c80 0x7fcbcc19a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:43.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:43.153+0000 7fcbd3df4640 1 --2- 172.21.15.33:0/2740823214 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcbcc100600 0x7fcbcc1965e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:43.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:43.153+0000 7fcbd3df4640 1 --2- 172.21.15.33:0/2740823214 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbcc0ffc40 0x7fcbcc1960a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:43.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:43.153+0000 7fcbd3df4640 1 -- 172.21.15.33:0/2740823214 >> 172.21.15.33:0/2740823214 conn(0x7fcbcc0fba90 msgr2=0x7fcbcc0fd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:29:43.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:43.153+0000 7fcbd3df4640 1 -- 172.21.15.33:0/2740823214 shutdown_connections 2024-09-12T12:29:43.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:43.153+0000 7fcbd3df4640 1 -- 172.21.15.33:0/2740823214 wait complete. 2024-09-12T12:29:43.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:29:43 smithi043 ceph-mon[34144]: pgmap v461: 129 pgs: 129 active+clean; 10 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 45 MiB/s wr, 723 op/s 2024-09-12T12:29:43.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:29:43 smithi102 ceph-mon[34799]: pgmap v461: 129 pgs: 129 active+clean; 10 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 45 MiB/s wr, 723 op/s 2024-09-12T12:29:43.404 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:29:43 smithi033 ceph-mon[31246]: pgmap v461: 129 pgs: 129 active+clean; 10 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 45 MiB/s wr, 723 op/s 2024-09-12T12:29:44.042 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T12:29:44.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:29:44 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/2740823214' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:29:44.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:29:44 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/2740823214' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:29:44.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:29:44 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/2740823214' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:29:44.578 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:29:45.331 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:29:45 smithi033 ceph-mon[31246]: pgmap v462: 129 pgs: 129 active+clean; 10 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 46 MiB/s wr, 747 op/s 2024-09-12T12:29:45.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:29:45 smithi043 ceph-mon[34144]: pgmap v462: 129 pgs: 129 active+clean; 10 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 46 MiB/s wr, 747 op/s 2024-09-12T12:29:45.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.371+0000 7f126f1b5640 1 -- 172.21.15.33:0/2909685004 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1268102570 msgr2=0x7f12681029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:45.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.371+0000 7f126f1b5640 1 --2- 172.21.15.33:0/2909685004 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1268102570 0x7f12681029b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1258009be0 tx=0x7f125802a770 comp rx=0 tx=0).stop 2024-09-12T12:29:45.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.372+0000 7f126f1b5640 1 -- 172.21.15.33:0/2909685004 shutdown_connections 2024-09-12T12:29:45.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.372+0000 7f126f1b5640 1 --2- 172.21.15.33:0/2909685004 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1268102ef0 0x7f1268069f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:45.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.372+0000 7f126f1b5640 1 --2- 172.21.15.33:0/2909685004 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1268102570 0x7f12681029b0 secure :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1258009be0 tx=0x7f125802a770 comp rx=0 tx=0).stop 2024-09-12T12:29:45.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.372+0000 7f126f1b5640 1 --2- 172.21.15.33:0/2909685004 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1268100e20 0x7f1268101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:45.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.372+0000 7f126f1b5640 1 -- 172.21.15.33:0/2909685004 >> 172.21.15.33:0/2909685004 conn(0x7f12680fc7d0 msgr2=0x7f12680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:29:45.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.375+0000 7f126f1b5640 1 -- 172.21.15.33:0/2909685004 shutdown_connections 2024-09-12T12:29:45.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.376+0000 7f126f1b5640 1 -- 172.21.15.33:0/2909685004 wait complete. 2024-09-12T12:29:45.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.377+0000 7f126f1b5640 1 Processor -- start 2024-09-12T12:29:45.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.378+0000 7f126f1b5640 1 -- start start 2024-09-12T12:29:45.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.379+0000 7f126f1b5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1268100e20 0x7f1268196570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:45.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.379+0000 7f126f1b5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1268102ef0 0x7f1268196ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:45.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.379+0000 7f126f1b5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f126819ae40 0x7f126819b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:45.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.379+0000 7f1267fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1268102ef0 0x7f1268196ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:45.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.379+0000 7f1267fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1268102ef0 0x7f1268196ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50546/0 (socket says 172.21.15.33:50546) 2024-09-12T12:29:45.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.380+0000 7f1267fff640 1 -- 172.21.15.33:0/1431642704 learned_addr learned my addr 172.21.15.33:0/1431642704 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:29:45.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.380+0000 7f126f1b5640 1 -- 172.21.15.33:0/1431642704 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f126810fdd0 con 0x7f1268102ef0 2024-09-12T12:29:45.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.380+0000 7f126f1b5640 1 -- 172.21.15.33:0/1431642704 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f126810fc50 con 0x7f1268100e20 2024-09-12T12:29:45.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.380+0000 7f126f1b5640 1 -- 172.21.15.33:0/1431642704 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f126810ff50 con 0x7f126819ae40 2024-09-12T12:29:45.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.380+0000 7f1267fff640 1 -- 172.21.15.33:0/1431642704 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f126819ae40 msgr2=0x7f126819b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:45.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.380+0000 7f1267fff640 1 --2- 172.21.15.33:0/1431642704 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f126819ae40 0x7f126819b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:45.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.380+0000 7f1267fff640 1 -- 172.21.15.33:0/1431642704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1268100e20 msgr2=0x7f1268196570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:45.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.380+0000 7f1267fff640 1 --2- 172.21.15.33:0/1431642704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1268100e20 0x7f1268196570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:45.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.380+0000 7f1267fff640 1 -- 172.21.15.33:0/1431642704 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f126819b900 con 0x7f1268102ef0 2024-09-12T12:29:45.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.381+0000 7f1267fff640 1 --2- 172.21.15.33:0/1431642704 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1268102ef0 0x7f1268196ab0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f125802ad60 tx=0x7f1258003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:29:45.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.382+0000 7f1265ffb640 1 -- 172.21.15.33:0/1431642704 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1258041020 con 0x7f1268102ef0 2024-09-12T12:29:45.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.382+0000 7f1265ffb640 1 -- 172.21.15.33:0/1431642704 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1258037040 con 0x7f1268102ef0 2024-09-12T12:29:45.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.382+0000 7f126f1b5640 1 -- 172.21.15.33:0/1431642704 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f126819bb90 con 0x7f1268102ef0 2024-09-12T12:29:45.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.382+0000 7f126f1b5640 1 -- 172.21.15.33:0/1431642704 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12681a32c0 con 0x7f1268102ef0 2024-09-12T12:29:45.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.382+0000 7f1265ffb640 1 -- 172.21.15.33:0/1431642704 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1258036070 con 0x7f1268102ef0 2024-09-12T12:29:45.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.387+0000 7f1265ffb640 1 -- 172.21.15.33:0/1431642704 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1258044020 con 0x7f1268102ef0 2024-09-12T12:29:45.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.388+0000 7f127158e740 1 Processor -- start 2024-09-12T12:29:45.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.388+0000 7f127158e740 1 -- start start 2024-09-12T12:29:45.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.389+0000 7f127158e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559c76c6d350 0x559c76c6b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:45.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.389+0000 7f127158e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c76c6bde0 0x559c76c6c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:45.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.389+0000 7f127158e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c76c76b80 0x559c76c78f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:45.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.389+0000 7f126d752640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559c76c6d350 0x559c76c6b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:45.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.389+0000 7f126d752640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559c76c6d350 0x559c76c6b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:35120/0 (socket says 172.21.15.33:35120) 2024-09-12T12:29:45.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.389+0000 7f126cf51640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c76c6bde0 0x559c76c6c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:45.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.389+0000 7f126cf51640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c76c6bde0 0x559c76c6c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:57422/0 (socket says 172.21.15.33:57422) 2024-09-12T12:29:45.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.390+0000 7f127158e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x559c76bc92f0 con 0x559c76c76b80 2024-09-12T12:29:45.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.390+0000 7f127158e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559c76b70cf0 con 0x559c76c6d350 2024-09-12T12:29:45.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.390+0000 7f127158e740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x559c76bc52b0 con 0x559c76c6bde0 2024-09-12T12:29:45.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.390+0000 7f126d752640 1 -- 172.21.15.33:0/3034167750 learned_addr learned my addr 172.21.15.33:0/3034167750 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:29:45.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.391+0000 7f126d752640 1 -- 172.21.15.33:0/3034167750 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c76c6bde0 msgr2=0x559c76c6c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:45.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.391+0000 7f126d752640 1 --2- 172.21.15.33:0/3034167750 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c76c6bde0 0x559c76c6c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:45.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.391+0000 7f126d752640 1 -- 172.21.15.33:0/3034167750 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c76c76b80 msgr2=0x559c76c78f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:45.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.391+0000 7f126d752640 1 --2- 172.21.15.33:0/3034167750 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c76c76b80 0x559c76c78f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:45.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.391+0000 7f126d752640 1 -- 172.21.15.33:0/3034167750 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c76b553a0 con 0x559c76c6d350 2024-09-12T12:29:45.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.392+0000 7f1265ffb640 1 --2- 172.21.15.33:0/1431642704 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f12540a2d90 0x7f12540a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:45.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.392+0000 7f1265ffb640 1 -- 172.21.15.33:0/1431642704 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f12580efea0 con 0x7f1268102ef0 2024-09-12T12:29:45.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.394+0000 7f126cf51640 1 --2- 172.21.15.33:0/1431642704 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f12540a2d90 0x7f12540a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:45.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:29:45 smithi102 ceph-mon[34799]: pgmap v462: 129 pgs: 129 active+clean; 10 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 46 MiB/s wr, 747 op/s 2024-09-12T12:29:45.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.399+0000 7f126cf51640 1 --2- 172.21.15.33:0/1431642704 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f12540a2d90 0x7f12540a5250 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x559c76c692d0 tx=0x7f12500090e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:29:45.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.399+0000 7f126d752640 1 --2- 172.21.15.33:0/3034167750 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559c76c6d350 0x559c76c6b8a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1260009b30 tx=0x7f126000e350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e45eed1d96ca5f6a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:29:45.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.400+0000 7f125effd640 1 -- 172.21.15.33:0/3034167750 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126000ed00 con 0x559c76c6d350 2024-09-12T12:29:45.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.400+0000 7f125effd640 1 -- 172.21.15.33:0/3034167750 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f12600054d0 con 0x559c76c6d350 2024-09-12T12:29:45.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.400+0000 7f125effd640 1 -- 172.21.15.33:0/3034167750 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1260010430 con 0x559c76c6d350 2024-09-12T12:29:45.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.402+0000 7f127158e740 1 -- 172.21.15.33:0/3034167750 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559c76c6d350 msgr2=0x559c76c6b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:45.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.402+0000 7f127158e740 1 --2- 172.21.15.33:0/3034167750 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559c76c6d350 0x559c76c6b8a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1260009b30 tx=0x7f126000e350 comp rx=0 tx=0).stop 2024-09-12T12:29:45.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.404+0000 7f127158e740 1 -- 172.21.15.33:0/3034167750 shutdown_connections 2024-09-12T12:29:45.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.404+0000 7f127158e740 1 --2- 172.21.15.33:0/3034167750 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c76c76b80 0x559c76c78f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:45.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.404+0000 7f127158e740 1 --2- 172.21.15.33:0/3034167750 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c76c6bde0 0x559c76c6c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:45.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.404+0000 7f127158e740 1 --2- 172.21.15.33:0/3034167750 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559c76c6d350 0x559c76c6b8a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:45.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.404+0000 7f127158e740 1 -- 172.21.15.33:0/3034167750 >> 172.21.15.33:0/3034167750 conn(0x559c76c2c310 msgr2=0x559c76c68470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:29:45.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.406+0000 7f127158e740 1 -- 172.21.15.33:0/3034167750 shutdown_connections 2024-09-12T12:29:45.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.407+0000 7f127158e740 1 -- 172.21.15.33:0/3034167750 wait complete. 2024-09-12T12:29:45.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.408+0000 7f127158e740 1 -- start start 2024-09-12T12:29:45.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.408+0000 7f127158e740 1 Processor -- start 2024-09-12T12:29:45.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.409+0000 7f127158e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559c76c6bde0 0x559c76c73970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:45.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.409+0000 7f127158e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c76c6d350 0x559c76c73eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:45.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.409+0000 7f127158e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c76c76b80 0x559c76c743f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:45.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.410+0000 7f127158e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x559c76c79880 con 0x559c76c6d350 2024-09-12T12:29:45.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.410+0000 7f127158e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559c76b84060 con 0x559c76c6bde0 2024-09-12T12:29:45.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.410+0000 7f127158e740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x559c76c79a00 con 0x559c76c76b80 2024-09-12T12:29:45.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.410+0000 7f126d752640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c76c76b80 0x559c76c743f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:45.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.410+0000 7f126d752640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c76c76b80 0x559c76c743f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:57430/0 (socket says 172.21.15.33:57430) 2024-09-12T12:29:45.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.410+0000 7f126d752640 1 -- 172.21.15.33:0/2144153322 learned_addr learned my addr 172.21.15.33:0/2144153322 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:29:45.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.410+0000 7f127158e740 10 client.0 _ll_register_callbacks cb 0x559c768d78c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:29:45.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.411+0000 7f1267fff640 1 --2- 172.21.15.33:0/2144153322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c76c6d350 0x559c76c73eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:45.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.412+0000 7f126cf51640 1 --2- 172.21.15.33:0/2144153322 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559c76c6bde0 0x559c76c73970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:45.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.412+0000 7f1267fff640 1 -- 172.21.15.33:0/2144153322 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c76c76b80 msgr2=0x559c76c743f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:45.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.412+0000 7f1267fff640 1 --2- 172.21.15.33:0/2144153322 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c76c76b80 0x559c76c743f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:45.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.412+0000 7f1267fff640 1 -- 172.21.15.33:0/2144153322 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559c76c6bde0 msgr2=0x559c76c73970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:45.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.412+0000 7f1267fff640 1 --2- 172.21.15.33:0/2144153322 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559c76c6bde0 0x559c76c73970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:45.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.412+0000 7f1267fff640 1 -- 172.21.15.33:0/2144153322 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c7693a3c0 con 0x559c76c6d350 2024-09-12T12:29:45.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.412+0000 7f1267fff640 1 --2- 172.21.15.33:0/2144153322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c76c6d350 0x559c76c73eb0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x559c76c6c880 tx=0x7f12580bbf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26e2e771da06a67e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:29:45.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.412+0000 7f1247fff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:29:45.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.413+0000 7f1247fff640 1 -- 172.21.15.33:0/2144153322 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12580bca10 con 0x559c76c6d350 2024-09-12T12:29:45.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.413+0000 7f1247fff640 1 -- 172.21.15.33:0/2144153322 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f12580b8980 con 0x559c76c6d350 2024-09-12T12:29:45.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.413+0000 7f127158e740 1 -- 172.21.15.33:0/2144153322 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12600054d0 con 0x559c76c6d350 2024-09-12T12:29:45.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.414+0000 7f1247fff640 1 -- 172.21.15.33:0/2144153322 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f12580bc310 con 0x559c76c6d350 2024-09-12T12:29:45.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.414+0000 7f127158e740 10 client.15663 fetch_fsmap learned FSMap version 27 2024-09-12T12:29:45.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.414+0000 7f127158e740 1 -- 172.21.15.33:0/2144153322 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559c76c85480 con 0x559c76c6d350 2024-09-12T12:29:45.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.415+0000 7f1247fff640 1 -- 172.21.15.33:0/2144153322 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f12600054d0 con 0x559c76c6d350 2024-09-12T12:29:45.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.415+0000 7f1247fff640 1 -- 172.21.15.33:0/2144153322 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f12580c4af0 con 0x559c76c6d350 2024-09-12T12:29:45.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.417+0000 7f127158e740 10 client.15663 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:29:45.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.417+0000 7f127158e740 10 client.15663 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-12T12:29:45.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.417+0000 7f127158e740 20 client.15663 populate_metadata read hostname 'smithi033' 2024-09-12T12:29:45.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.417+0000 7f127158e740 1 --2- 172.21.15.33:0/2144153322 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x559c76c86a70 0x559c76c88e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:45.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.417+0000 7f127158e740 4 client.15663 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:29:45.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.417+0000 7f127158e740 1 -- 172.21.15.33:0/2144153322 --> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559c76bd6860 con 0x559c76c86a70 2024-09-12T12:29:45.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.417+0000 7f126cf51640 1 --2- 172.21.15.33:0/2144153322 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x559c76c86a70 0x559c76c88e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:45.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.418+0000 7f126cf51640 1 --2- 172.21.15.33:0/2144153322 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x559c76c86a70 0x559c76c88e90 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2e2d45b603c2fb46 server_cookie=39eac39f5ff7e950 in_seq=0 out_seq=0 2024-09-12T12:29:45.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.418+0000 7f1247fff640 10 client.15663 ms_handle_connect on v2:172.21.15.102:6834/4179527539 2024-09-12T12:29:45.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.419+0000 7f1247fff640 1 -- 172.21.15.33:0/2144153322 <== mds.2 v2:172.21.15.102:6834/4179527539 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559c76bd6860 con 0x559c76c86a70 2024-09-12T12:29:45.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.419+0000 7f1247fff640 10 client.15663 handle_command_reply: tid=0 2024-09-12T12:29:45.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.419+0000 7f127158e740 1 client.15663 shutdown 2024-09-12T12:29:45.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.420+0000 7f127158e740 1 -- 172.21.15.33:0/2144153322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c76c6d350 msgr2=0x559c76c73eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:45.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.420+0000 7f127158e740 1 --2- 172.21.15.33:0/2144153322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c76c6d350 0x559c76c73eb0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x559c76c6c880 tx=0x7f12580bbf10 comp rx=0 tx=0).stop 2024-09-12T12:29:45.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.421+0000 7f127158e740 1 -- 172.21.15.33:0/2144153322 shutdown_connections 2024-09-12T12:29:45.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.421+0000 7f127158e740 1 --2- 172.21.15.33:0/2144153322 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c76c76b80 0x559c76c743f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:45.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.421+0000 7f127158e740 1 --2- 172.21.15.33:0/2144153322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c76c6d350 0x559c76c73eb0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:45.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.421+0000 7f127158e740 1 --2- 172.21.15.33:0/2144153322 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x559c76c86a70 0x559c76c88e90 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:45.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.421+0000 7f127158e740 1 --2- 172.21.15.33:0/2144153322 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559c76c6bde0 0x559c76c73970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:45.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.421+0000 7f127158e740 1 -- 172.21.15.33:0/2144153322 >> 172.21.15.33:0/2144153322 conn(0x559c76c2c310 msgr2=0x559c76c6e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:29:45.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.421+0000 7f1247fff640 0 client.15663 ms_handle_reset on v2:172.21.15.102:6834/4179527539 2024-09-12T12:29:45.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.422+0000 7f127158e740 1 -- 172.21.15.33:0/2144153322 shutdown_connections 2024-09-12T12:29:45.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.422+0000 7f127158e740 1 -- 172.21.15.33:0/2144153322 wait complete. 2024-09-12T12:29:45.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.422+0000 7f127158e740 20 client.15663 trim_cache size 0 max 16384 2024-09-12T12:29:45.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.448+0000 7f127158e740 1 Processor -- start 2024-09-12T12:29:45.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.448+0000 7f127158e740 1 -- start start 2024-09-12T12:29:45.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.449+0000 7f127158e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c76c6bde0 0x559c76c68630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:45.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.449+0000 7f127158e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c76c6d350 0x559c76c8e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:45.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.449+0000 7f127158e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559c76c76b80 0x559c76c8ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:45.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.449+0000 7f127158e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f12681af980 con 0x559c76c6d350 2024-09-12T12:29:45.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.449+0000 7f126cf51640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c76c6bde0 0x559c76c68630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:45.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.449+0000 7f126cf51640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c76c6bde0 0x559c76c68630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:57440/0 (socket says 172.21.15.33:57440) 2024-09-12T12:29:45.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.449+0000 7f126cf51640 1 -- 172.21.15.33:0/3089251573 learned_addr learned my addr 172.21.15.33:0/3089251573 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:29:45.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.449+0000 7f127158e740 1 -- 172.21.15.33:0/3089251573 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f12681ad250 con 0x559c76c76b80 2024-09-12T12:29:45.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.449+0000 7f127158e740 1 -- 172.21.15.33:0/3089251573 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f12681ab0a0 con 0x559c76c6bde0 2024-09-12T12:29:45.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.449+0000 7f126d752640 1 --2- 172.21.15.33:0/3089251573 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559c76c76b80 0x559c76c8ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:45.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.450+0000 7f1267fff640 1 --2- 172.21.15.33:0/3089251573 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c76c6d350 0x559c76c8e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:45.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.450+0000 7f126cf51640 1 -- 172.21.15.33:0/3089251573 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559c76c76b80 msgr2=0x559c76c8ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:45.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.450+0000 7f126cf51640 1 --2- 172.21.15.33:0/3089251573 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559c76c76b80 0x559c76c8ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:45.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.450+0000 7f126cf51640 1 -- 172.21.15.33:0/3089251573 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c76c6d350 msgr2=0x559c76c8e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:45.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.450+0000 7f126cf51640 1 --2- 172.21.15.33:0/3089251573 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c76c6d350 0x559c76c8e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:45.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.450+0000 7f126cf51640 1 -- 172.21.15.33:0/3089251573 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c76c89470 con 0x559c76c6bde0 2024-09-12T12:29:45.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.450+0000 7f126cf51640 1 --2- 172.21.15.33:0/3089251573 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c76c6bde0 0x559c76c68630 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f125000e9e0 tx=0x7f1250011000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe1a16624d02b6c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:29:45.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.450+0000 7f125e7fc640 1 -- 172.21.15.33:0/3089251573 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1250015640 con 0x559c76c6bde0 2024-09-12T12:29:45.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.451+0000 7f125e7fc640 1 -- 172.21.15.33:0/3089251573 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f125002e070 con 0x559c76c6bde0 2024-09-12T12:29:45.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.451+0000 7f125e7fc640 1 -- 172.21.15.33:0/3089251573 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1250021a20 con 0x559c76c6bde0 2024-09-12T12:29:45.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.452+0000 7f127158e740 1 -- 172.21.15.33:0/3089251573 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c76c6bde0 msgr2=0x559c76c68630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:45.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.452+0000 7f127158e740 1 --2- 172.21.15.33:0/3089251573 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c76c6bde0 0x559c76c68630 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f125000e9e0 tx=0x7f1250011000 comp rx=0 tx=0).stop 2024-09-12T12:29:45.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.452+0000 7f127158e740 1 -- 172.21.15.33:0/3089251573 shutdown_connections 2024-09-12T12:29:45.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.452+0000 7f127158e740 1 --2- 172.21.15.33:0/3089251573 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559c76c76b80 0x559c76c8ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:45.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.452+0000 7f127158e740 1 --2- 172.21.15.33:0/3089251573 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c76c6d350 0x559c76c8e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:45.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.452+0000 7f127158e740 1 --2- 172.21.15.33:0/3089251573 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c76c6bde0 0x559c76c68630 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:45.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.452+0000 7f127158e740 1 -- 172.21.15.33:0/3089251573 >> 172.21.15.33:0/3089251573 conn(0x559c76c2c310 msgr2=0x559c76c5ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:29:45.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.453+0000 7f127158e740 1 -- 172.21.15.33:0/3089251573 shutdown_connections 2024-09-12T12:29:45.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.453+0000 7f127158e740 1 -- 172.21.15.33:0/3089251573 wait complete. 2024-09-12T12:29:45.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.453+0000 7f127158e740 1 -- start start 2024-09-12T12:29:45.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.454+0000 7f127158e740 1 Processor -- start 2024-09-12T12:29:45.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.454+0000 7f127158e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c76c6bde0 0x559c76c7a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:45.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.454+0000 7f127158e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559c76c6d350 0x559c76c7a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:45.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.454+0000 7f127158e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c76c76b80 0x559c76c65680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:45.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.454+0000 7f126cf51640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c76c6bde0 0x559c76c7a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:45.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.454+0000 7f126cf51640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c76c6bde0 0x559c76c7a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:57442/0 (socket says 172.21.15.33:57442) 2024-09-12T12:29:45.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.454+0000 7f126cf51640 1 -- 172.21.15.33:0/195237075 learned_addr learned my addr 172.21.15.33:0/195237075 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:29:45.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.455+0000 7f127158e740 1 -- 172.21.15.33:0/195237075 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f12681ab710 con 0x559c76c76b80 2024-09-12T12:29:45.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.455+0000 7f127158e740 1 -- 172.21.15.33:0/195237075 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f12681acb80 con 0x559c76c6d350 2024-09-12T12:29:45.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.455+0000 7f127158e740 1 -- 172.21.15.33:0/195237075 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f12681abde0 con 0x559c76c6bde0 2024-09-12T12:29:45.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.455+0000 7f127158e740 10 client.0 _ll_register_callbacks cb 0x7f12580daf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:29:45.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.455+0000 7f126d752640 1 --2- 172.21.15.33:0/195237075 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c76c76b80 0x559c76c65680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:45.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.455+0000 7f126cf51640 1 -- 172.21.15.33:0/195237075 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559c76c6d350 msgr2=0x559c76c7a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:45.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.455+0000 7f1267fff640 1 --2- 172.21.15.33:0/195237075 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559c76c6d350 0x559c76c7a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:45.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.455+0000 7f126cf51640 1 --2- 172.21.15.33:0/195237075 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559c76c6d350 0x559c76c7a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:45.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.455+0000 7f126cf51640 1 -- 172.21.15.33:0/195237075 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c76c76b80 msgr2=0x559c76c65680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:45.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.455+0000 7f126cf51640 1 --2- 172.21.15.33:0/195237075 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c76c76b80 0x559c76c65680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:45.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.455+0000 7f126cf51640 1 -- 172.21.15.33:0/195237075 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c76c65cc0 con 0x559c76c6bde0 2024-09-12T12:29:45.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.455+0000 7f126cf51640 1 --2- 172.21.15.33:0/195237075 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c76c6bde0 0x559c76c7a220 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1250009800 tx=0x7f1250021750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=303418c017ba1c3e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:29:45.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.455+0000 7f1247fff640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:29:45.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.457+0000 7f1247fff640 1 -- 172.21.15.33:0/195237075 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1250036020 con 0x559c76c6bde0 2024-09-12T12:29:45.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.457+0000 7f127158e740 1 -- 172.21.15.33:0/195237075 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f125002e070 con 0x559c76c6bde0 2024-09-12T12:29:45.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.458+0000 7f1247fff640 1 -- 172.21.15.33:0/195237075 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f1250015640 con 0x559c76c6bde0 2024-09-12T12:29:45.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.458+0000 7f1247fff640 1 -- 172.21.15.33:0/195237075 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f125003e050 con 0x559c76c6bde0 2024-09-12T12:29:45.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.460+0000 7f127158e740 10 client.25402 fetch_fsmap learned FSMap version 27 2024-09-12T12:29:45.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.460+0000 7f127158e740 1 -- 172.21.15.33:0/195237075 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559c76c66f20 con 0x559c76c6bde0 2024-09-12T12:29:45.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.460+0000 7f1247fff640 1 -- 172.21.15.33:0/195237075 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1250015cf0 con 0x559c76c6bde0 2024-09-12T12:29:45.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.460+0000 7f1247fff640 1 -- 172.21.15.33:0/195237075 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f1250032ad0 con 0x559c76c6bde0 2024-09-12T12:29:45.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.460+0000 7f127158e740 10 client.25402 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:29:45.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.461+0000 7f127158e740 10 client.25402 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-12T12:29:45.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.461+0000 7f127158e740 20 client.25402 populate_metadata read hostname 'smithi033' 2024-09-12T12:29:45.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.461+0000 7f127158e740 1 --2- 172.21.15.33:0/195237075 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x559c76c67640 0x559c76ceb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:45.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.461+0000 7f127158e740 4 client.25402 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:29:45.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.461+0000 7f127158e740 1 -- 172.21.15.33:0/195237075 --> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f125002e070 con 0x559c76c67640 2024-09-12T12:29:45.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.461+0000 7f1267fff640 1 --2- 172.21.15.33:0/195237075 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x559c76c67640 0x559c76ceb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:45.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.462+0000 7f1247fff640 10 client.25402 ms_handle_connect on v2:172.21.15.102:6834/4179527539 2024-09-12T12:29:45.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.462+0000 7f1267fff640 1 --2- 172.21.15.33:0/195237075 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x559c76c67640 0x559c76ceb6c0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ea1298872d70ee42 server_cookie=46ee579bf7bb7673 in_seq=0 out_seq=0 2024-09-12T12:29:45.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.462+0000 7f1247fff640 1 -- 172.21.15.33:0/195237075 <== mds.2 v2:172.21.15.102:6834/4179527539 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f125002e070 con 0x559c76c67640 2024-09-12T12:29:45.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.462+0000 7f1247fff640 10 client.25402 handle_command_reply: tid=0 2024-09-12T12:29:45.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.462+0000 7f127158e740 1 client.25402 shutdown 2024-09-12T12:29:45.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.463+0000 7f127158e740 1 -- 172.21.15.33:0/195237075 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c76c6bde0 msgr2=0x559c76c7a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:45.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.463+0000 7f127158e740 1 --2- 172.21.15.33:0/195237075 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c76c6bde0 0x559c76c7a220 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1250009800 tx=0x7f1250021750 comp rx=0 tx=0).stop 2024-09-12T12:29:45.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.463+0000 7f127158e740 1 -- 172.21.15.33:0/195237075 shutdown_connections 2024-09-12T12:29:45.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.463+0000 7f127158e740 1 --2- 172.21.15.33:0/195237075 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c76c76b80 0x559c76c65680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:45.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.463+0000 7f127158e740 1 --2- 172.21.15.33:0/195237075 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x559c76c67640 0x559c76ceb6c0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:45.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.463+0000 7f127158e740 1 --2- 172.21.15.33:0/195237075 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559c76c6d350 0x559c76c7a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:45.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.463+0000 7f127158e740 1 --2- 172.21.15.33:0/195237075 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c76c6bde0 0x559c76c7a220 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:45.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.463+0000 7f1247fff640 0 client.25402 ms_handle_reset on v2:172.21.15.102:6834/4179527539 2024-09-12T12:29:45.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.463+0000 7f127158e740 1 -- 172.21.15.33:0/195237075 >> 172.21.15.33:0/195237075 conn(0x559c76c2c310 msgr2=0x559c76c72110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:29:45.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.463+0000 7f127158e740 1 -- 172.21.15.33:0/195237075 shutdown_connections 2024-09-12T12:29:45.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.463+0000 7f127158e740 1 -- 172.21.15.33:0/195237075 wait complete. 2024-09-12T12:29:45.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.464+0000 7f127158e740 20 client.25402 trim_cache size 0 max 16384 2024-09-12T12:29:45.468 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-09-12T12:29:45.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.469+0000 7f126f1b5640 1 -- 172.21.15.33:0/1431642704 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f12540a2d90 msgr2=0x7f12540a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:45.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.469+0000 7f126f1b5640 1 --2- 172.21.15.33:0/1431642704 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f12540a2d90 0x7f12540a5250 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x559c76c692d0 tx=0x7f12500090e0 comp rx=0 tx=0).stop 2024-09-12T12:29:45.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.469+0000 7f126f1b5640 1 -- 172.21.15.33:0/1431642704 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1268102ef0 msgr2=0x7f1268196ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:45.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.469+0000 7f126f1b5640 1 --2- 172.21.15.33:0/1431642704 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1268102ef0 0x7f1268196ab0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f125802ad60 tx=0x7f1258003ce0 comp rx=0 tx=0).stop 2024-09-12T12:29:45.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.470+0000 7f126f1b5640 1 -- 172.21.15.33:0/1431642704 shutdown_connections 2024-09-12T12:29:45.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.470+0000 7f126f1b5640 1 --2- 172.21.15.33:0/1431642704 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f12540a2d90 0x7f12540a5250 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:45.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.470+0000 7f126f1b5640 1 --2- 172.21.15.33:0/1431642704 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f126819ae40 0x7f126819b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:45.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.470+0000 7f126f1b5640 1 --2- 172.21.15.33:0/1431642704 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1268102ef0 0x7f1268196ab0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:45.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.470+0000 7f126f1b5640 1 --2- 172.21.15.33:0/1431642704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1268100e20 0x7f1268196570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:45.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.470+0000 7f126f1b5640 1 -- 172.21.15.33:0/1431642704 >> 172.21.15.33:0/1431642704 conn(0x7f12680fc7d0 msgr2=0x7f1268106fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:29:45.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.470+0000 7f126f1b5640 1 -- 172.21.15.33:0/1431642704 shutdown_connections 2024-09-12T12:29:45.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:45.470+0000 7f126f1b5640 1 -- 172.21.15.33:0/1431642704 wait complete. 2024-09-12T12:29:47.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:29:47 smithi043 ceph-mon[34144]: pgmap v463: 129 pgs: 129 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 38 MiB/s wr, 614 op/s 2024-09-12T12:29:47.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:29:47 smithi102 ceph-mon[34799]: pgmap v463: 129 pgs: 129 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 38 MiB/s wr, 614 op/s 2024-09-12T12:29:47.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:29:47 smithi033 ceph-mon[31246]: pgmap v463: 129 pgs: 129 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 38 MiB/s wr, 614 op/s 2024-09-12T12:29:49.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:29:49 smithi043 ceph-mon[34144]: pgmap v464: 129 pgs: 129 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 51 MiB/s wr, 827 op/s 2024-09-12T12:29:49.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:29:49 smithi102 ceph-mon[34799]: pgmap v464: 129 pgs: 129 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 51 MiB/s wr, 827 op/s 2024-09-12T12:29:49.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:29:49 smithi033 ceph-mon[31246]: pgmap v464: 129 pgs: 129 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 51 MiB/s wr, 827 op/s 2024-09-12T12:29:49.842 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T12:29:50.357 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:29:50.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.968+0000 7ffb0e440640 1 -- 172.21.15.33:0/1376023683 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb00004cb0 msgr2=0x7ffb000050f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:50.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.968+0000 7ffb0e440640 1 --2- 172.21.15.33:0/1376023683 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb00004cb0 0x7ffb000050f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ffb08067960 tx=0x7ffb080a7de0 comp rx=0 tx=0).stop 2024-09-12T12:29:50.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.968+0000 7ffb0e440640 1 -- 172.21.15.33:0/1376023683 shutdown_connections 2024-09-12T12:29:50.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.968+0000 7ffb0e440640 1 --2- 172.21.15.33:0/1376023683 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb00005740 0x7ffb00097fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:50.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.968+0000 7ffb0e440640 1 --2- 172.21.15.33:0/1376023683 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb00004cb0 0x7ffb000050f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:50.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.968+0000 7ffb0e440640 1 --2- 172.21.15.33:0/1376023683 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb0009a4c0 0x7ffb0009a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:50.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.968+0000 7ffb0e440640 1 -- 172.21.15.33:0/1376023683 >> 172.21.15.33:0/1376023683 conn(0x7ffb0000a1f0 msgr2=0x7ffb0000a600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:29:50.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.969+0000 7ffb0e440640 1 -- 172.21.15.33:0/1376023683 shutdown_connections 2024-09-12T12:29:50.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.969+0000 7ffb0e440640 1 -- 172.21.15.33:0/1376023683 wait complete. 2024-09-12T12:29:50.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.969+0000 7ffb0e440640 1 Processor -- start 2024-09-12T12:29:50.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.969+0000 7ffb0e440640 1 -- start start 2024-09-12T12:29:50.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.970+0000 7ffb0e440640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb00005740 0x7ffb000a4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:50.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.970+0000 7ffb0e440640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb0009a4c0 0x7ffb000a5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:50.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.970+0000 7ffb0e440640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb001664f0 0x7ffb001688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:50.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.970+0000 7ffb0e440640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ffb0009d590 con 0x7ffb0009a4c0 2024-09-12T12:29:50.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.970+0000 7ffb0e440640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ffb0009d410 con 0x7ffb00005740 2024-09-12T12:29:50.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.970+0000 7ffb0e440640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ffb0009d710 con 0x7ffb001664f0 2024-09-12T12:29:50.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.970+0000 7ffb0cc3d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb0009a4c0 0x7ffb000a5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:50.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.970+0000 7ffb0cc3d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb0009a4c0 0x7ffb000a5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48166/0 (socket says 172.21.15.33:48166) 2024-09-12T12:29:50.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.970+0000 7ffb0cc3d640 1 -- 172.21.15.33:0/2307246345 learned_addr learned my addr 172.21.15.33:0/2307246345 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:29:50.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.970+0000 7ffb0d43e640 1 --2- 172.21.15.33:0/2307246345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb00005740 0x7ffb000a4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:50.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.970+0000 7ffb0dc3f640 1 --2- 172.21.15.33:0/2307246345 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb001664f0 0x7ffb001688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:50.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.972+0000 7ffb0d43e640 1 -- 172.21.15.33:0/2307246345 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb001664f0 msgr2=0x7ffb001688e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:50.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.972+0000 7ffb0d43e640 1 --2- 172.21.15.33:0/2307246345 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb001664f0 0x7ffb001688e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:50.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.972+0000 7ffb0d43e640 1 -- 172.21.15.33:0/2307246345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb0009a4c0 msgr2=0x7ffb000a5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:50.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.972+0000 7ffb0d43e640 1 --2- 172.21.15.33:0/2307246345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb0009a4c0 0x7ffb000a5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:50.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.972+0000 7ffb0d43e640 1 -- 172.21.15.33:0/2307246345 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb00168ea0 con 0x7ffb00005740 2024-09-12T12:29:50.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.972+0000 7ffb0d43e640 1 --2- 172.21.15.33:0/2307246345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb00005740 0x7ffb000a4b20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffb0400e9f0 tx=0x7ffb0400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:29:50.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.973+0000 7ffafe7fc640 1 -- 172.21.15.33:0/2307246345 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0400ccc0 con 0x7ffb00005740 2024-09-12T12:29:50.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.973+0000 7ffb0e440640 1 -- 172.21.15.33:0/2307246345 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb0013f4b0 con 0x7ffb00005740 2024-09-12T12:29:50.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.973+0000 7ffb0e440640 1 -- 172.21.15.33:0/2307246345 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb0013f9a0 con 0x7ffb00005740 2024-09-12T12:29:50.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.973+0000 7ffafe7fc640 1 -- 172.21.15.33:0/2307246345 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffb040108e0 con 0x7ffb00005740 2024-09-12T12:29:50.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.973+0000 7ffafe7fc640 1 -- 172.21.15.33:0/2307246345 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb040188e0 con 0x7ffb00005740 2024-09-12T12:29:50.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.978+0000 7ffafe7fc640 1 -- 172.21.15.33:0/2307246345 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ffb04018a80 con 0x7ffb00005740 2024-09-12T12:29:50.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.982+0000 7ffb11a7b740 1 Processor -- start 2024-09-12T12:29:50.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.983+0000 7ffb11a7b740 1 -- start start 2024-09-12T12:29:50.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.983+0000 7ffb11a7b740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56150ffadcf0 0x56150ffac240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:50.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.983+0000 7ffb11a7b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56150ffac780 0x56150ffacbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:50.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.983+0000 7ffb11a7b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56150ffb7520 0x56150ffb9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:50.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.983+0000 7ffb11a7b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56150ff122f0 con 0x56150ffb7520 2024-09-12T12:29:50.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.983+0000 7ffb11a7b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56150feb9cf0 con 0x56150ffac780 2024-09-12T12:29:50.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.983+0000 7ffb11a7b740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56150ff0e2b0 con 0x56150ffadcf0 2024-09-12T12:29:50.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.983+0000 7ffb0dc3f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56150ffadcf0 0x56150ffac240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:50.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.983+0000 7ffb0dc3f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56150ffadcf0 0x56150ffac240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:41490/0 (socket says 172.21.15.33:41490) 2024-09-12T12:29:50.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.983+0000 7ffb0dc3f640 1 -- 172.21.15.33:0/2141178961 learned_addr learned my addr 172.21.15.33:0/2141178961 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:29:50.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.983+0000 7ffb0cc3d640 1 --2- 172.21.15.33:0/2141178961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56150ffb7520 0x56150ffb9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:50.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.984+0000 7ffb0cc3d640 1 -- 172.21.15.33:0/2141178961 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56150ffadcf0 msgr2=0x56150ffac240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:50.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.984+0000 7ffb0cc3d640 1 --2- 172.21.15.33:0/2141178961 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56150ffadcf0 0x56150ffac240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:50.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.984+0000 7ffb0cc3d640 1 -- 172.21.15.33:0/2141178961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56150ffac780 msgr2=0x56150ffacbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:50.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.984+0000 7ffb0cc3d640 1 --2- 172.21.15.33:0/2141178961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56150ffac780 0x56150ffacbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:50.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.984+0000 7ffb0cc3d640 1 -- 172.21.15.33:0/2141178961 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56150fe9e3a0 con 0x56150ffb7520 2024-09-12T12:29:50.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.984+0000 7ffb0cc3d640 1 --2- 172.21.15.33:0/2141178961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56150ffb7520 0x56150ffb9910 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ffb08051790 tx=0x7ffb08067b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7d96715c49b8cab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:29:50.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.985+0000 7ffafe7fc640 1 --2- 172.21.15.33:0/2307246345 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ffaf40e6d30 0x7ffaf40e91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:50.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.985+0000 7ffafe7fc640 1 -- 172.21.15.33:0/2307246345 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7ffb040d0540 con 0x7ffb00005740 2024-09-12T12:29:50.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.985+0000 7ffb0dc3f640 1 --2- 172.21.15.33:0/2307246345 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ffaf40e6d30 0x7ffaf40e91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:50.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.986+0000 7ffb0dc3f640 1 --2- 172.21.15.33:0/2307246345 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ffaf40e6d30 0x7ffaf40e91f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ffaf800ad50 tx=0x7ffaf800a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:29:50.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.987+0000 7ffaf37fe640 1 -- 172.21.15.33:0/2141178961 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb080a8bb0 con 0x56150ffb7520 2024-09-12T12:29:50.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.988+0000 7ffaf37fe640 1 -- 172.21.15.33:0/2141178961 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffb080ac040 con 0x56150ffb7520 2024-09-12T12:29:50.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.989+0000 7ffb11a7b740 1 -- 172.21.15.33:0/2141178961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56150ffb7520 msgr2=0x56150ffb9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:50.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.989+0000 7ffb11a7b740 1 --2- 172.21.15.33:0/2141178961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56150ffb7520 0x56150ffb9910 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ffb08051790 tx=0x7ffb08067b20 comp rx=0 tx=0).stop 2024-09-12T12:29:50.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.989+0000 7ffb11a7b740 1 -- 172.21.15.33:0/2141178961 shutdown_connections 2024-09-12T12:29:50.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.989+0000 7ffb11a7b740 1 --2- 172.21.15.33:0/2141178961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56150ffb7520 0x56150ffb9910 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:50.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.989+0000 7ffb11a7b740 1 --2- 172.21.15.33:0/2141178961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56150ffac780 0x56150ffacbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:50.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.989+0000 7ffb11a7b740 1 --2- 172.21.15.33:0/2141178961 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56150ffadcf0 0x56150ffac240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:50.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.989+0000 7ffb11a7b740 1 -- 172.21.15.33:0/2141178961 >> 172.21.15.33:0/2141178961 conn(0x56150ff75310 msgr2=0x56150ffa8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:29:50.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.991+0000 7ffb11a7b740 1 -- 172.21.15.33:0/2141178961 shutdown_connections 2024-09-12T12:29:50.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.991+0000 7ffb11a7b740 1 -- 172.21.15.33:0/2141178961 wait complete. 2024-09-12T12:29:50.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.991+0000 7ffb11a7b740 1 -- start start 2024-09-12T12:29:50.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.991+0000 7ffb11a7b740 1 Processor -- start 2024-09-12T12:29:50.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.992+0000 7ffb11a7b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56150ffac780 0x56150ffb6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:50.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.993+0000 7ffb11a7b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56150ffadcf0 0x56150ffb4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:50.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.993+0000 7ffb0d43e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56150ffac780 0x56150ffb6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:50.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.993+0000 7ffb0d43e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56150ffac780 0x56150ffb6e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:54502/0 (socket says 172.21.15.33:54502) 2024-09-12T12:29:50.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.993+0000 7ffb0d43e640 1 -- 172.21.15.33:0/2941089787 learned_addr learned my addr 172.21.15.33:0/2941089787 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:29:50.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.993+0000 7ffb11a7b740 1 --2- 172.21.15.33:0/2941089787 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56150ffb7520 0x56150ffb46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:50.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.993+0000 7ffb0cc3d640 1 --2- 172.21.15.33:0/2941089787 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56150ffadcf0 0x56150ffb4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:50.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.993+0000 7ffb11a7b740 1 -- 172.21.15.33:0/2941089787 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56150ffba210 con 0x56150ffadcf0 2024-09-12T12:29:50.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.993+0000 7ffb11a7b740 1 -- 172.21.15.33:0/2941089787 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56150fecd060 con 0x56150ffac780 2024-09-12T12:29:50.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.993+0000 7ffb11a7b740 1 -- 172.21.15.33:0/2941089787 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56150ffba390 con 0x56150ffb7520 2024-09-12T12:29:50.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.993+0000 7ffb0dc3f640 1 --2- 172.21.15.33:0/2941089787 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56150ffb7520 0x56150ffb46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:50.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.993+0000 7ffb11a7b740 10 client.0 _ll_register_callbacks cb 0x56150fc208c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:29:50.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.994+0000 7ffb0d43e640 1 -- 172.21.15.33:0/2941089787 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56150ffb7520 msgr2=0x56150ffb46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:50.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.994+0000 7ffb0d43e640 1 --2- 172.21.15.33:0/2941089787 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56150ffb7520 0x56150ffb46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:50.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.994+0000 7ffb0d43e640 1 -- 172.21.15.33:0/2941089787 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56150ffadcf0 msgr2=0x56150ffb4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:50.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.994+0000 7ffb0d43e640 1 --2- 172.21.15.33:0/2941089787 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56150ffadcf0 0x56150ffb4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:50.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.994+0000 7ffb0d43e640 1 -- 172.21.15.33:0/2941089787 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56150fc833c0 con 0x56150ffac780 2024-09-12T12:29:50.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.994+0000 7ffb0cc3d640 1 --2- 172.21.15.33:0/2941089787 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56150ffadcf0 0x56150ffb4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:29:50.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.994+0000 7ffb0d43e640 1 --2- 172.21.15.33:0/2941089787 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56150ffac780 0x56150ffb6e60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffb040cdcb0 tx=0x7ffb0409d250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28d7ca6bbaf632c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:29:50.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.994+0000 7ffaf0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:29:50.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.995+0000 7ffaf0ff9640 1 -- 172.21.15.33:0/2941089787 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb040cf070 con 0x56150ffac780 2024-09-12T12:29:50.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.995+0000 7ffaf0ff9640 1 -- 172.21.15.33:0/2941089787 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7ffb04010550 con 0x56150ffac780 2024-09-12T12:29:50.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.995+0000 7ffb11a7b740 1 -- 172.21.15.33:0/2941089787 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb080ac040 con 0x56150ffac780 2024-09-12T12:29:50.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.995+0000 7ffaf0ff9640 1 -- 172.21.15.33:0/2941089787 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ffb040a5680 con 0x56150ffac780 2024-09-12T12:29:50.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.995+0000 7ffb11a7b740 10 client.25313 fetch_fsmap learned FSMap version 27 2024-09-12T12:29:50.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.996+0000 7ffb11a7b740 1 -- 172.21.15.33:0/2941089787 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56150ffc5cf0 con 0x56150ffac780 2024-09-12T12:29:50.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.996+0000 7ffaf0ff9640 1 -- 172.21.15.33:0/2941089787 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffb080ac040 con 0x56150ffac780 2024-09-12T12:29:50.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.996+0000 7ffaf0ff9640 1 -- 172.21.15.33:0/2941089787 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7ffb04010c00 con 0x56150ffac780 2024-09-12T12:29:50.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.996+0000 7ffb11a7b740 10 client.25313 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:29:50.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.996+0000 7ffb11a7b740 10 client.25313 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-12T12:29:50.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.996+0000 7ffb11a7b740 20 client.25313 populate_metadata read hostname 'smithi033' 2024-09-12T12:29:50.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.996+0000 7ffb11a7b740 1 --2- 172.21.15.33:0/2941089787 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x56150ffc7480 0x56150ffc9870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:50.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.996+0000 7ffb11a7b740 4 client.25313 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:29:50.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.996+0000 7ffb11a7b740 1 -- 172.21.15.33:0/2941089787 --> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56150ff1f860 con 0x56150ffc7480 2024-09-12T12:29:50.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.996+0000 7ffb0cc3d640 1 --2- 172.21.15.33:0/2941089787 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x56150ffc7480 0x56150ffc9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:50.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.997+0000 7ffb0cc3d640 1 --2- 172.21.15.33:0/2941089787 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x56150ffc7480 0x56150ffc9870 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1c0b491e61ae1cbc server_cookie=38a963ed8f1a2892 in_seq=0 out_seq=0 2024-09-12T12:29:50.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.997+0000 7ffaf0ff9640 10 client.25313 ms_handle_connect on v2:172.21.15.102:6836/2409953270 2024-09-12T12:29:50.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.999+0000 7ffaf0ff9640 1 -- 172.21.15.33:0/2941089787 <== mds.1 v2:172.21.15.102:6836/2409953270 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56150ff1f860 con 0x56150ffc7480 2024-09-12T12:29:50.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.999+0000 7ffaf0ff9640 10 client.25313 handle_command_reply: tid=0 2024-09-12T12:29:50.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:50.999+0000 7ffb11a7b740 1 client.25313 shutdown 2024-09-12T12:29:51.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.000+0000 7ffb11a7b740 1 -- 172.21.15.33:0/2941089787 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56150ffac780 msgr2=0x56150ffb6e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:51.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.000+0000 7ffb11a7b740 1 --2- 172.21.15.33:0/2941089787 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56150ffac780 0x56150ffb6e60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffb040cdcb0 tx=0x7ffb0409d250 comp rx=0 tx=0).stop 2024-09-12T12:29:51.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.000+0000 7ffb11a7b740 1 -- 172.21.15.33:0/2941089787 shutdown_connections 2024-09-12T12:29:51.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.000+0000 7ffb11a7b740 1 --2- 172.21.15.33:0/2941089787 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x56150ffc7480 0x56150ffc9870 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:51.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.000+0000 7ffb11a7b740 1 --2- 172.21.15.33:0/2941089787 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56150ffb7520 0x56150ffb46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:51.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.000+0000 7ffb11a7b740 1 --2- 172.21.15.33:0/2941089787 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56150ffadcf0 0x56150ffb4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:51.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.000+0000 7ffb11a7b740 1 --2- 172.21.15.33:0/2941089787 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56150ffac780 0x56150ffb6e60 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:51.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.000+0000 7ffb11a7b740 1 -- 172.21.15.33:0/2941089787 >> 172.21.15.33:0/2941089787 conn(0x56150ff75310 msgr2=0x56150ffaeb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:29:51.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.000+0000 7ffaf0ff9640 0 client.25313 ms_handle_reset on v2:172.21.15.102:6836/2409953270 2024-09-12T12:29:51.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.000+0000 7ffb11a7b740 1 -- 172.21.15.33:0/2941089787 shutdown_connections 2024-09-12T12:29:51.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.001+0000 7ffb11a7b740 1 -- 172.21.15.33:0/2941089787 wait complete. 2024-09-12T12:29:51.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.001+0000 7ffb11a7b740 20 client.25313 trim_cache size 0 max 16384 2024-09-12T12:29:51.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.026+0000 7ffb11a7b740 1 Processor -- start 2024-09-12T12:29:51.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.026+0000 7ffb11a7b740 1 -- start start 2024-09-12T12:29:51.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.026+0000 7ffb11a7b740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56150ff75310 0x56150ffa3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:51.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.026+0000 7ffb11a7b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56150ffac780 0x56150ffb60d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:51.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.027+0000 7ffb0d43e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56150ff75310 0x56150ffa3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:51.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.027+0000 7ffb0d43e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56150ff75310 0x56150ffa3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:41504/0 (socket says 172.21.15.33:41504) 2024-09-12T12:29:51.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.027+0000 7ffb0d43e640 1 -- 172.21.15.33:0/1715835365 learned_addr learned my addr 172.21.15.33:0/1715835365 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:29:51.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.027+0000 7ffb11a7b740 1 --2- 172.21.15.33:0/1715835365 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56150ffadcf0 0x56150ffaf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:51.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.027+0000 7ffb11a7b740 1 -- 172.21.15.33:0/1715835365 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ffaec0124d0 con 0x56150ffac780 2024-09-12T12:29:51.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.027+0000 7ffb11a7b740 1 -- 172.21.15.33:0/1715835365 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ffaec00fda0 con 0x56150ffadcf0 2024-09-12T12:29:51.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.027+0000 7ffb0dc3f640 1 --2- 172.21.15.33:0/1715835365 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56150ffadcf0 0x56150ffaf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:51.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.027+0000 7ffb11a7b740 1 -- 172.21.15.33:0/1715835365 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ffaec00dbf0 con 0x56150ff75310 2024-09-12T12:29:51.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.027+0000 7ffb0cc3d640 1 --2- 172.21.15.33:0/1715835365 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56150ffac780 0x56150ffb60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:51.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.028+0000 7ffb0cc3d640 1 -- 172.21.15.33:0/1715835365 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56150ff75310 msgr2=0x56150ffa3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:51.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.028+0000 7ffb0cc3d640 1 --2- 172.21.15.33:0/1715835365 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56150ff75310 0x56150ffa3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:51.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.028+0000 7ffb0cc3d640 1 -- 172.21.15.33:0/1715835365 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56150ffadcf0 msgr2=0x56150ffaf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:51.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.028+0000 7ffb0cc3d640 1 --2- 172.21.15.33:0/1715835365 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56150ffadcf0 0x56150ffaf330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:51.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.028+0000 7ffb0cc3d640 1 -- 172.21.15.33:0/1715835365 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56150ffb3110 con 0x56150ffac780 2024-09-12T12:29:51.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.031+0000 7ffb0cc3d640 1 --2- 172.21.15.33:0/1715835365 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56150ffac780 0x56150ffb60d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ffb0806d010 tx=0x7ffb080a7de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65f37eaa12354bf6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:29:51.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.032+0000 7ffb0d43e640 1 --2- 172.21.15.33:0/1715835365 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56150ff75310 0x56150ffa3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:29:51.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.032+0000 7ffb0dc3f640 1 --2- 172.21.15.33:0/1715835365 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56150ffadcf0 0x56150ffaf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:29:51.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.033+0000 7ffaf2ffd640 1 -- 172.21.15.33:0/1715835365 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb080b0a10 con 0x56150ffac780 2024-09-12T12:29:51.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.033+0000 7ffaf2ffd640 1 -- 172.21.15.33:0/1715835365 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffb080ac040 con 0x56150ffac780 2024-09-12T12:29:51.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.033+0000 7ffaf2ffd640 1 -- 172.21.15.33:0/1715835365 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb08088b40 con 0x56150ffac780 2024-09-12T12:29:51.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.035+0000 7ffb11a7b740 1 -- 172.21.15.33:0/1715835365 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56150ffac780 msgr2=0x56150ffb60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:51.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.035+0000 7ffb11a7b740 1 --2- 172.21.15.33:0/1715835365 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56150ffac780 0x56150ffb60d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ffb0806d010 tx=0x7ffb080a7de0 comp rx=0 tx=0).stop 2024-09-12T12:29:51.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.035+0000 7ffb11a7b740 1 -- 172.21.15.33:0/1715835365 shutdown_connections 2024-09-12T12:29:51.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.036+0000 7ffb11a7b740 1 --2- 172.21.15.33:0/1715835365 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56150ffadcf0 0x56150ffaf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:51.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.036+0000 7ffb11a7b740 1 --2- 172.21.15.33:0/1715835365 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56150ffac780 0x56150ffb60d0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:51.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.036+0000 7ffb11a7b740 1 --2- 172.21.15.33:0/1715835365 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56150ff75310 0x56150ffa3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:51.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.036+0000 7ffb11a7b740 1 -- 172.21.15.33:0/1715835365 >> 172.21.15.33:0/1715835365 conn(0x56150ffac3a0 msgr2=0x56150ffb59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:29:51.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.036+0000 7ffb11a7b740 1 -- 172.21.15.33:0/1715835365 shutdown_connections 2024-09-12T12:29:51.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.036+0000 7ffb11a7b740 1 -- 172.21.15.33:0/1715835365 wait complete. 2024-09-12T12:29:51.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.037+0000 7ffb11a7b740 1 -- start start 2024-09-12T12:29:51.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.037+0000 7ffb11a7b740 1 Processor -- start 2024-09-12T12:29:51.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.038+0000 7ffb11a7b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56150ff75310 0x56150ffca410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:51.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.038+0000 7ffb11a7b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56150ffac780 0x56150ffca950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:51.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.038+0000 7ffb11a7b740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56150ffadcf0 0x56150ffcae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:51.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.038+0000 7ffb11a7b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ffaec00e260 con 0x56150ffac780 2024-09-12T12:29:51.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.038+0000 7ffb11a7b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ffaec00f6d0 con 0x56150ff75310 2024-09-12T12:29:51.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.038+0000 7ffb11a7b740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ffaec00e930 con 0x56150ffadcf0 2024-09-12T12:29:51.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.038+0000 7ffb11a7b740 10 client.0 _ll_register_callbacks cb 0x7ffb0400ce60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:29:51.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.038+0000 7ffb0dc3f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56150ffadcf0 0x56150ffcae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:51.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.038+0000 7ffb0dc3f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56150ffadcf0 0x56150ffcae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:41512/0 (socket says 172.21.15.33:41512) 2024-09-12T12:29:51.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.038+0000 7ffb0dc3f640 1 -- 172.21.15.33:0/581593355 learned_addr learned my addr 172.21.15.33:0/581593355 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:29:51.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.038+0000 7ffb0d43e640 1 --2- 172.21.15.33:0/581593355 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56150ff75310 0x56150ffca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:51.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.039+0000 7ffb0dc3f640 1 -- 172.21.15.33:0/581593355 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56150ff75310 msgr2=0x56150ffca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:51.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.039+0000 7ffb0dc3f640 1 --2- 172.21.15.33:0/581593355 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56150ff75310 0x56150ffca410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:51.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.039+0000 7ffb0dc3f640 1 -- 172.21.15.33:0/581593355 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56150ffac780 msgr2=0x56150ffca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:51.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.039+0000 7ffb0dc3f640 1 --2- 172.21.15.33:0/581593355 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56150ffac780 0x56150ffca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:51.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.039+0000 7ffb0dc3f640 1 -- 172.21.15.33:0/581593355 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56150ffb4a50 con 0x56150ffadcf0 2024-09-12T12:29:51.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.039+0000 7ffb0d43e640 1 --2- 172.21.15.33:0/581593355 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56150ff75310 0x56150ffca410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:29:51.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.039+0000 7ffb0dc3f640 1 --2- 172.21.15.33:0/581593355 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56150ffadcf0 0x56150ffcae90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ffaf80038a0 tx=0x7ffaf8004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49ea56e2c8345763 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:29:51.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.040+0000 7ffaf0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:29:51.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.040+0000 7ffaf0ff9640 1 -- 172.21.15.33:0/581593355 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf802c060 con 0x56150ffadcf0 2024-09-12T12:29:51.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.040+0000 7ffaf0ff9640 1 -- 172.21.15.33:0/581593355 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7ffaf8027430 con 0x56150ffadcf0 2024-09-12T12:29:51.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.040+0000 7ffb11a7b740 1 -- 172.21.15.33:0/581593355 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb080ac040 con 0x56150ffadcf0 2024-09-12T12:29:51.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.040+0000 7ffaf0ff9640 1 -- 172.21.15.33:0/581593355 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ffaf8027670 con 0x56150ffadcf0 2024-09-12T12:29:51.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.040+0000 7ffb11a7b740 10 client.25417 fetch_fsmap learned FSMap version 27 2024-09-12T12:29:51.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.040+0000 7ffb11a7b740 1 -- 172.21.15.33:0/581593355 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5615100320d0 con 0x56150ffadcf0 2024-09-12T12:29:51.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.041+0000 7ffaf0ff9640 1 -- 172.21.15.33:0/581593355 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffb080ac040 con 0x56150ffadcf0 2024-09-12T12:29:51.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.041+0000 7ffaf0ff9640 1 -- 172.21.15.33:0/581593355 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7ffaf8026070 con 0x56150ffadcf0 2024-09-12T12:29:51.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.042+0000 7ffb11a7b740 10 client.25417 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:29:51.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.042+0000 7ffb11a7b740 10 client.25417 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-12T12:29:51.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.042+0000 7ffb11a7b740 20 client.25417 populate_metadata read hostname 'smithi033' 2024-09-12T12:29:51.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.042+0000 7ffb11a7b740 1 --2- 172.21.15.33:0/581593355 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x56150ffb7520 0x5615100348a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:51.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.042+0000 7ffb11a7b740 4 client.25417 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:29:51.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.042+0000 7ffb11a7b740 1 -- 172.21.15.33:0/581593355 --> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56150ff19d70 con 0x56150ffb7520 2024-09-12T12:29:51.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.042+0000 7ffb0d43e640 1 --2- 172.21.15.33:0/581593355 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x56150ffb7520 0x5615100348a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:51.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.043+0000 7ffb0d43e640 1 --2- 172.21.15.33:0/581593355 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x56150ffb7520 0x5615100348a0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9072edf410ff043e server_cookie=e107ccc70a0ebf7c in_seq=0 out_seq=0 2024-09-12T12:29:51.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.043+0000 7ffaf0ff9640 10 client.25417 ms_handle_connect on v2:172.21.15.102:6836/2409953270 2024-09-12T12:29:51.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.043+0000 7ffaf0ff9640 1 -- 172.21.15.33:0/581593355 <== mds.1 v2:172.21.15.102:6836/2409953270 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56150ff19d70 con 0x56150ffb7520 2024-09-12T12:29:51.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.043+0000 7ffaf0ff9640 10 client.25417 handle_command_reply: tid=0 2024-09-12T12:29:51.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.044+0000 7ffb11a7b740 1 client.25417 shutdown 2024-09-12T12:29:51.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.046+0000 7ffb11a7b740 1 -- 172.21.15.33:0/581593355 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56150ffadcf0 msgr2=0x56150ffcae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:51.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.046+0000 7ffb11a7b740 1 --2- 172.21.15.33:0/581593355 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56150ffadcf0 0x56150ffcae90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ffaf80038a0 tx=0x7ffaf8004730 comp rx=0 tx=0).stop 2024-09-12T12:29:51.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.046+0000 7ffb11a7b740 1 -- 172.21.15.33:0/581593355 shutdown_connections 2024-09-12T12:29:51.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.046+0000 7ffb11a7b740 1 --2- 172.21.15.33:0/581593355 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x56150ffb7520 0x5615100348a0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:51.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.047+0000 7ffaf0ff9640 0 client.25417 ms_handle_reset on v2:172.21.15.102:6836/2409953270 2024-09-12T12:29:51.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.047+0000 7ffb11a7b740 1 --2- 172.21.15.33:0/581593355 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56150ffadcf0 0x56150ffcae90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:51.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.047+0000 7ffb11a7b740 1 --2- 172.21.15.33:0/581593355 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56150ffac780 0x56150ffca950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:51.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.047+0000 7ffb11a7b740 1 --2- 172.21.15.33:0/581593355 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56150ff75310 0x56150ffca410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:51.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.047+0000 7ffb11a7b740 1 -- 172.21.15.33:0/581593355 >> 172.21.15.33:0/581593355 conn(0x56150ffac3a0 msgr2=0x56150ffa7eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:29:51.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.050+0000 7ffb11a7b740 1 -- 172.21.15.33:0/581593355 shutdown_connections 2024-09-12T12:29:51.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.050+0000 7ffb11a7b740 1 -- 172.21.15.33:0/581593355 wait complete. 2024-09-12T12:29:51.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.050+0000 7ffb11a7b740 20 client.25417 trim_cache size 0 max 16384 2024-09-12T12:29:51.051 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-09-12T12:29:51.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.052+0000 7ffb0e440640 1 -- 172.21.15.33:0/2307246345 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ffaf40e6d30 msgr2=0x7ffaf40e91f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:51.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.052+0000 7ffb0e440640 1 --2- 172.21.15.33:0/2307246345 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ffaf40e6d30 0x7ffaf40e91f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ffaf800ad50 tx=0x7ffaf800a250 comp rx=0 tx=0).stop 2024-09-12T12:29:51.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.052+0000 7ffb0e440640 1 -- 172.21.15.33:0/2307246345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb00005740 msgr2=0x7ffb000a4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:51.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.052+0000 7ffb0e440640 1 --2- 172.21.15.33:0/2307246345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb00005740 0x7ffb000a4b20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffb0400e9f0 tx=0x7ffb0400eeb0 comp rx=0 tx=0).stop 2024-09-12T12:29:51.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.052+0000 7ffb0e440640 1 -- 172.21.15.33:0/2307246345 shutdown_connections 2024-09-12T12:29:51.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.052+0000 7ffb0e440640 1 --2- 172.21.15.33:0/2307246345 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ffaf40e6d30 0x7ffaf40e91f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:51.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.052+0000 7ffb0e440640 1 --2- 172.21.15.33:0/2307246345 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb001664f0 0x7ffb001688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:51.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.052+0000 7ffb0e440640 1 --2- 172.21.15.33:0/2307246345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb0009a4c0 0x7ffb000a5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:51.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.052+0000 7ffb0e440640 1 --2- 172.21.15.33:0/2307246345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb00005740 0x7ffb000a4b20 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:51.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.052+0000 7ffb0e440640 1 -- 172.21.15.33:0/2307246345 >> 172.21.15.33:0/2307246345 conn(0x7ffb0000a1f0 msgr2=0x7ffb00092270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:29:51.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.052+0000 7ffb0e440640 1 -- 172.21.15.33:0/2307246345 shutdown_connections 2024-09-12T12:29:51.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:51.052+0000 7ffb0e440640 1 -- 172.21.15.33:0/2307246345 wait complete. 2024-09-12T12:29:51.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:29:51 smithi043 ceph-mon[34144]: pgmap v465: 129 pgs: 129 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 42 MiB/s wr, 680 op/s 2024-09-12T12:29:51.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:29:51 smithi102 ceph-mon[34799]: pgmap v465: 129 pgs: 129 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 42 MiB/s wr, 680 op/s 2024-09-12T12:29:51.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:29:51 smithi033 ceph-mon[31246]: pgmap v465: 129 pgs: 129 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 42 MiB/s wr, 680 op/s 2024-09-12T12:29:53.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:29:53 smithi102 ceph-mon[34799]: pgmap v466: 129 pgs: 129 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 46 MiB/s wr, 746 op/s 2024-09-12T12:29:53.410 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:29:53 smithi033 ceph-mon[31246]: pgmap v466: 129 pgs: 129 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 46 MiB/s wr, 746 op/s 2024-09-12T12:29:53.412 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T12:29:53.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:29:53 smithi043 ceph-mon[34144]: pgmap v466: 129 pgs: 129 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 46 MiB/s wr, 746 op/s 2024-09-12T12:29:53.904 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:29:54.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:29:54 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:29:54.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:29:54 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:29:54.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:29:54 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:29:55.321 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-09-12T12:29:55.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.211+0000 7f0b054b7640 1 -- 172.21.15.33:0/2022156195 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b00108c30 msgr2=0x7f0b0010cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:55.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.211+0000 7f0b054b7640 1 --2- 172.21.15.33:0/2022156195 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b00108c30 0x7f0b0010cc30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0af8009ca0 tx=0x7f0af802a8f0 comp rx=0 tx=0).stop 2024-09-12T12:29:55.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.213+0000 7f0b054b7640 1 -- 172.21.15.33:0/2022156195 shutdown_connections 2024-09-12T12:29:55.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.213+0000 7f0b054b7640 1 --2- 172.21.15.33:0/2022156195 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b0010d360 0x7f0b00114ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:55.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.213+0000 7f0b054b7640 1 --2- 172.21.15.33:0/2022156195 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b00108c30 0x7f0b0010cc30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:55.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.213+0000 7f0b054b7640 1 --2- 172.21.15.33:0/2022156195 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b00108280 0x7f0b00108660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:55.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.213+0000 7f0b054b7640 1 -- 172.21.15.33:0/2022156195 >> 172.21.15.33:0/2022156195 conn(0x7f0b000779f0 msgr2=0x7f0b00079e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:29:55.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.213+0000 7f0b054b7640 1 -- 172.21.15.33:0/2022156195 shutdown_connections 2024-09-12T12:29:55.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.213+0000 7f0b054b7640 1 -- 172.21.15.33:0/2022156195 wait complete. 2024-09-12T12:29:55.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.214+0000 7f0b054b7640 1 Processor -- start 2024-09-12T12:29:55.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.215+0000 7f0b054b7640 1 -- start start 2024-09-12T12:29:55.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.215+0000 7f0b054b7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b00108280 0x7f0b001a4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:55.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.216+0000 7f0b054b7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b00108c30 0x7f0b001a4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:55.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.216+0000 7f0afffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b00108280 0x7f0b001a4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:55.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.216+0000 7f0afffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b00108280 0x7f0b001a4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:41528/0 (socket says 172.21.15.33:41528) 2024-09-12T12:29:55.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.216+0000 7f0afffff640 1 -- 172.21.15.33:0/1203706005 learned_addr learned my addr 172.21.15.33:0/1203706005 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:29:55.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.216+0000 7f0b054b7640 1 --2- 172.21.15.33:0/1203706005 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b0010d360 0x7f0b0019e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:55.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.216+0000 7f0aff7fe640 1 --2- 172.21.15.33:0/1203706005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b00108c30 0x7f0b001a4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:55.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.216+0000 7f0b054b7640 1 -- 172.21.15.33:0/1203706005 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0b00118330 con 0x7f0b0010d360 2024-09-12T12:29:55.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.216+0000 7f0b054b7640 1 -- 172.21.15.33:0/1203706005 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0b001181b0 con 0x7f0b00108c30 2024-09-12T12:29:55.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.216+0000 7f0b054b7640 1 -- 172.21.15.33:0/1203706005 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0b001184b0 con 0x7f0b00108280 2024-09-12T12:29:55.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.217+0000 7f0aff7fe640 1 -- 172.21.15.33:0/1203706005 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b00108280 msgr2=0x7f0b001a4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:55.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.217+0000 7f0aff7fe640 1 --2- 172.21.15.33:0/1203706005 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b00108280 0x7f0b001a4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:55.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.217+0000 7f0aff7fe640 1 -- 172.21.15.33:0/1203706005 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b0010d360 msgr2=0x7f0b0019e720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T12:29:55.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.217+0000 7f0aff7fe640 1 --2- 172.21.15.33:0/1203706005 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b0010d360 0x7f0b0019e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:55.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.217+0000 7f0aff7fe640 1 -- 172.21.15.33:0/1203706005 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b0019ef90 con 0x7f0b00108c30 2024-09-12T12:29:55.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.218+0000 7f0aff7fe640 1 --2- 172.21.15.33:0/1203706005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b00108c30 0x7f0b001a4b90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0af8006010 tx=0x7f0af8003f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:29:55.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.218+0000 7f0afd7fa640 1 -- 172.21.15.33:0/1203706005 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af80307f0 con 0x7f0b00108c30 2024-09-12T12:29:55.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.218+0000 7f0afd7fa640 1 -- 172.21.15.33:0/1203706005 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0af8040070 con 0x7f0b00108c30 2024-09-12T12:29:55.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.218+0000 7f0b054b7640 1 -- 172.21.15.33:0/1203706005 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b0019f220 con 0x7f0b00108c30 2024-09-12T12:29:55.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.219+0000 7f0b054b7640 1 -- 172.21.15.33:0/1203706005 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b001ab5d0 con 0x7f0b00108c30 2024-09-12T12:29:55.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.220+0000 7f0afd7fa640 1 -- 172.21.15.33:0/1203706005 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af80456d0 con 0x7f0b00108c30 2024-09-12T12:29:55.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.222+0000 7f0b08af2740 1 Processor -- start 2024-09-12T12:29:55.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.223+0000 7f0b08af2740 1 -- start start 2024-09-12T12:29:55.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.223+0000 7f0b08af2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5632cec2acf0 0x5632cec29240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:55.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.223+0000 7f0b08af2740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632cec29780 0x5632cec29bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:55.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.223+0000 7f0b08af2740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5632cec45530 0x5632cec47920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:55.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.223+0000 7f0b08af2740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5632ceb8f2f0 con 0x5632cec29780 2024-09-12T12:29:55.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.223+0000 7f0b08af2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5632ceb36cf0 con 0x5632cec2acf0 2024-09-12T12:29:55.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.223+0000 7f0b08af2740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5632ceb8b2b0 con 0x5632cec45530 2024-09-12T12:29:55.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.226+0000 7f0b04cb6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5632cec2acf0 0x5632cec29240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:55.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.226+0000 7f0b04cb6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5632cec2acf0 0x5632cec29240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:54546/0 (socket says 172.21.15.33:54546) 2024-09-12T12:29:55.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.226+0000 7f0b04cb6640 1 -- 172.21.15.33:0/1114024820 learned_addr learned my addr 172.21.15.33:0/1114024820 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:29:55.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.226+0000 7f0aff7fe640 1 --2- 172.21.15.33:0/1114024820 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5632cec45530 0x5632cec47920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:55.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.228+0000 7f0afd7fa640 1 -- 172.21.15.33:0/1203706005 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0af8031750 con 0x7f0b00108c30 2024-09-12T12:29:55.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.228+0000 7f0afffff640 1 --2- 172.21.15.33:0/1114024820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632cec29780 0x5632cec29bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:55.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.228+0000 7f0b04cb6640 1 -- 172.21.15.33:0/1114024820 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5632cec45530 msgr2=0x5632cec47920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:55.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.228+0000 7f0b04cb6640 1 --2- 172.21.15.33:0/1114024820 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5632cec45530 0x5632cec47920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:55.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.228+0000 7f0b04cb6640 1 -- 172.21.15.33:0/1114024820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632cec29780 msgr2=0x5632cec29bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:55.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.228+0000 7f0b04cb6640 1 --2- 172.21.15.33:0/1114024820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632cec29780 0x5632cec29bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:55.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.228+0000 7f0b04cb6640 1 -- 172.21.15.33:0/1114024820 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632ceb1b3a0 con 0x5632cec2acf0 2024-09-12T12:29:55.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.229+0000 7f0afd7fa640 1 --2- 172.21.15.33:0/1203706005 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0ae80a2c80 0x7f0ae80a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:55.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.229+0000 7f0b04cb6640 1 --2- 172.21.15.33:0/1114024820 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5632cec2acf0 0x5632cec29240 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0af4009760 tx=0x7f0af4009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=447d926e0e3beaa6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:29:55.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.229+0000 7f0afd7fa640 1 -- 172.21.15.33:0/1203706005 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f0af80f10c0 con 0x7f0b00108c30 2024-09-12T12:29:55.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.229+0000 7f0ae67fc640 1 -- 172.21.15.33:0/1114024820 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af4015020 con 0x5632cec2acf0 2024-09-12T12:29:55.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.230+0000 7f0ae67fc640 1 -- 172.21.15.33:0/1114024820 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0af4011420 con 0x5632cec2acf0 2024-09-12T12:29:55.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.231+0000 7f0b08af2740 1 -- 172.21.15.33:0/1114024820 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5632cec2acf0 msgr2=0x5632cec29240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:55.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.231+0000 7f0b08af2740 1 --2- 172.21.15.33:0/1114024820 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5632cec2acf0 0x5632cec29240 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0af4009760 tx=0x7f0af4009c20 comp rx=0 tx=0).stop 2024-09-12T12:29:55.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.233+0000 7f0afffff640 1 --2- 172.21.15.33:0/1203706005 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0ae80a2c80 0x7f0ae80a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:55.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.234+0000 7f0b08af2740 1 -- 172.21.15.33:0/1114024820 shutdown_connections 2024-09-12T12:29:55.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.234+0000 7f0b08af2740 1 --2- 172.21.15.33:0/1114024820 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5632cec45530 0x5632cec47920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:55.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.234+0000 7f0b08af2740 1 --2- 172.21.15.33:0/1114024820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632cec29780 0x5632cec29bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:55.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.234+0000 7f0b08af2740 1 --2- 172.21.15.33:0/1114024820 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5632cec2acf0 0x5632cec29240 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:55.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.234+0000 7f0b08af2740 1 -- 172.21.15.33:0/1114024820 >> 172.21.15.33:0/1114024820 conn(0x5632cebf2310 msgr2=0x5632cec25e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:29:55.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.234+0000 7f0afffff640 1 --2- 172.21.15.33:0/1203706005 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0ae80a2c80 0x7f0ae80a5140 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x5632cec26c70 tx=0x7f0af0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:29:55.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.235+0000 7f0b08af2740 1 -- 172.21.15.33:0/1114024820 shutdown_connections 2024-09-12T12:29:55.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.235+0000 7f0b08af2740 1 -- 172.21.15.33:0/1114024820 wait complete. 2024-09-12T12:29:55.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.235+0000 7f0b08af2740 1 -- start start 2024-09-12T12:29:55.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.236+0000 7f0b08af2740 1 Processor -- start 2024-09-12T12:29:55.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.236+0000 7f0b08af2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5632cec29780 0x5632cec44ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:55.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.236+0000 7f0b08af2740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5632cec2acf0 0x5632cec42190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:55.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.236+0000 7f0b08af2740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632cec45530 0x5632cec42730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:55.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.236+0000 7f0b08af2740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5632cec48280 con 0x5632cec45530 2024-09-12T12:29:55.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.236+0000 7f0b08af2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5632ceb4a060 con 0x5632cec29780 2024-09-12T12:29:55.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.236+0000 7f0b08af2740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5632cec48400 con 0x5632cec2acf0 2024-09-12T12:29:55.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.236+0000 7f0b08af2740 10 client.0 _ll_register_callbacks cb 0x5632ce89d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:29:55.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.237+0000 7f0aff7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5632cec2acf0 0x5632cec42190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:55.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.237+0000 7f0aff7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5632cec2acf0 0x5632cec42190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:41548/0 (socket says 172.21.15.33:41548) 2024-09-12T12:29:55.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.237+0000 7f0afffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5632cec29780 0x5632cec44ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:55.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.237+0000 7f0aff7fe640 1 -- 172.21.15.33:0/3303158965 learned_addr learned my addr 172.21.15.33:0/3303158965 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:29:55.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.237+0000 7f0aff7fe640 1 -- 172.21.15.33:0/3303158965 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5632cec29780 msgr2=0x5632cec44ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:55.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.237+0000 7f0aff7fe640 1 --2- 172.21.15.33:0/3303158965 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5632cec29780 0x5632cec44ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:55.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.237+0000 7f0aff7fe640 1 -- 172.21.15.33:0/3303158965 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632cec45530 msgr2=0x5632cec42730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:55.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.237+0000 7f0aff7fe640 1 --2- 172.21.15.33:0/3303158965 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632cec45530 0x5632cec42730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:55.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.237+0000 7f0aff7fe640 1 -- 172.21.15.33:0/3303158965 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632ce9003c0 con 0x5632cec2acf0 2024-09-12T12:29:55.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.238+0000 7f0aff7fe640 1 --2- 172.21.15.33:0/3303158965 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5632cec2acf0 0x5632cec42190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0af8009ca0 tx=0x7f0af80b97d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfbb96032a009d7f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:29:55.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.239+0000 7f0adf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:29:55.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.239+0000 7f0adf7fe640 1 -- 172.21.15.33:0/3303158965 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af80dd050 con 0x5632cec2acf0 2024-09-12T12:29:55.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.239+0000 7f0adf7fe640 1 -- 172.21.15.33:0/3303158965 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f0af80c5f10 con 0x5632cec2acf0 2024-09-12T12:29:55.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.239+0000 7f0b08af2740 1 -- 172.21.15.33:0/3303158965 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5632ceb9c860 con 0x5632cec2acf0 2024-09-12T12:29:55.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.240+0000 7f0adf7fe640 1 -- 172.21.15.33:0/3303158965 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0af80bce90 con 0x5632cec2acf0 2024-09-12T12:29:55.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.240+0000 7f0b08af2740 10 client.25429 fetch_fsmap learned FSMap version 27 2024-09-12T12:29:55.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.240+0000 7f0b08af2740 1 -- 172.21.15.33:0/3303158965 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5632cec482b0 con 0x5632cec2acf0 2024-09-12T12:29:55.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.241+0000 7f0adf7fe640 1 -- 172.21.15.33:0/3303158965 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x5632ceb9c860 con 0x5632cec2acf0 2024-09-12T12:29:55.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.241+0000 7f0adf7fe640 1 -- 172.21.15.33:0/3303158965 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f0af804d070 con 0x5632cec2acf0 2024-09-12T12:29:55.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.241+0000 7f0b08af2740 10 client.25429 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:29:55.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.241+0000 7f0b08af2740 10 client.25429 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:29:55.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.241+0000 7f0b08af2740 20 client.25429 populate_metadata read hostname 'smithi033' 2024-09-12T12:29:55.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.241+0000 7f0b08af2740 1 --2- 172.21.15.33:0/3303158965 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5632cec554c0 0x5632cec57940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:55.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.241+0000 7f0b08af2740 4 client.25429 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:29:55.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.241+0000 7f0b08af2740 1 -- 172.21.15.33:0/3303158965 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5632ceb96d70 con 0x5632cec554c0 2024-09-12T12:29:55.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.242+0000 7f0afffff640 1 --2- 172.21.15.33:0/3303158965 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5632cec554c0 0x5632cec57940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:55.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.242+0000 7f0afffff640 1 --2- 172.21.15.33:0/3303158965 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5632cec554c0 0x5632cec57940 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87091b24b187dc1b server_cookie=19929fdd6c30ea69 in_seq=0 out_seq=0 2024-09-12T12:29:55.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.242+0000 7f0adf7fe640 10 client.25429 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:29:55.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.243+0000 7f0adf7fe640 1 -- 172.21.15.33:0/3303158965 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5632ceb96d70 con 0x5632cec554c0 2024-09-12T12:29:55.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.243+0000 7f0adf7fe640 10 client.25429 handle_command_reply: tid=0 2024-09-12T12:29:55.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.243+0000 7f0b08af2740 1 client.25429 shutdown 2024-09-12T12:29:55.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.244+0000 7f0b08af2740 1 -- 172.21.15.33:0/3303158965 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5632cec2acf0 msgr2=0x5632cec42190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:55.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.244+0000 7f0b08af2740 1 --2- 172.21.15.33:0/3303158965 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5632cec2acf0 0x5632cec42190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0af8009ca0 tx=0x7f0af80b97d0 comp rx=0 tx=0).stop 2024-09-12T12:29:55.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.244+0000 7f0b08af2740 1 -- 172.21.15.33:0/3303158965 shutdown_connections 2024-09-12T12:29:55.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.244+0000 7f0b08af2740 1 --2- 172.21.15.33:0/3303158965 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5632cec554c0 0x5632cec57940 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:55.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.244+0000 7f0b08af2740 1 --2- 172.21.15.33:0/3303158965 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632cec45530 0x5632cec42730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:55.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.244+0000 7f0b08af2740 1 --2- 172.21.15.33:0/3303158965 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5632cec2acf0 0x5632cec42190 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:55.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.244+0000 7f0b08af2740 1 --2- 172.21.15.33:0/3303158965 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5632cec29780 0x5632cec44ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:55.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.244+0000 7f0b08af2740 1 -- 172.21.15.33:0/3303158965 >> 172.21.15.33:0/3303158965 conn(0x5632cebf2310 msgr2=0x5632cec2bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:29:55.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.244+0000 7f0adf7fe640 0 client.25429 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:29:55.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.244+0000 7f0b08af2740 1 -- 172.21.15.33:0/3303158965 shutdown_connections 2024-09-12T12:29:55.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.244+0000 7f0b08af2740 1 -- 172.21.15.33:0/3303158965 wait complete. 2024-09-12T12:29:55.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.244+0000 7f0b08af2740 20 client.25429 trim_cache size 0 max 16384 2024-09-12T12:29:55.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.271+0000 7f0b08af2740 1 Processor -- start 2024-09-12T12:29:55.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.271+0000 7f0b08af2740 1 -- start start 2024-09-12T12:29:55.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.272+0000 7f0b08af2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5632cec29780 0x5632cec51600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:55.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.272+0000 7f0b08af2740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632cec2acf0 0x5632cec41a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:55.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.272+0000 7f0b08af2740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5632cec45530 0x5632cec41f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:55.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.272+0000 7f0b08af2740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0aec012570 con 0x5632cec2acf0 2024-09-12T12:29:55.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.272+0000 7f0b08af2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0aec00fe40 con 0x5632cec29780 2024-09-12T12:29:55.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.272+0000 7f0b08af2740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0aec00dc90 con 0x5632cec45530 2024-09-12T12:29:55.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.272+0000 7f0afffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5632cec29780 0x5632cec51600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:55.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.272+0000 7f0afffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5632cec29780 0x5632cec51600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:54564/0 (socket says 172.21.15.33:54564) 2024-09-12T12:29:55.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.272+0000 7f0afffff640 1 -- 172.21.15.33:0/3555911979 learned_addr learned my addr 172.21.15.33:0/3555911979 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:29:55.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.273+0000 7f0afffff640 1 -- 172.21.15.33:0/3555911979 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5632cec45530 msgr2=0x5632cec41f90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:29:55.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.273+0000 7f0afffff640 1 --2- 172.21.15.33:0/3555911979 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5632cec45530 0x5632cec41f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:55.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.273+0000 7f0afffff640 1 -- 172.21.15.33:0/3555911979 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632cec2acf0 msgr2=0x5632cec41a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:55.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.273+0000 7f0afffff640 1 --2- 172.21.15.33:0/3555911979 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632cec2acf0 0x5632cec41a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:55.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.273+0000 7f0afffff640 1 -- 172.21.15.33:0/3555911979 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632cec2a910 con 0x5632cec29780 2024-09-12T12:29:55.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.275+0000 7f0afffff640 1 --2- 172.21.15.33:0/3555911979 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5632cec29780 0x5632cec51600 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0af0009610 tx=0x7f0af0014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e014a78957d3b79 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:29:55.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.277+0000 7f0ae5ffb640 1 -- 172.21.15.33:0/3555911979 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af002e070 con 0x5632cec29780 2024-09-12T12:29:55.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.277+0000 7f0ae5ffb640 1 -- 172.21.15.33:0/3555911979 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0af001a040 con 0x5632cec29780 2024-09-12T12:29:55.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.277+0000 7f0ae5ffb640 1 -- 172.21.15.33:0/3555911979 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af0015d70 con 0x5632cec29780 2024-09-12T12:29:55.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.278+0000 7f0b08af2740 1 -- 172.21.15.33:0/3555911979 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5632cec29780 msgr2=0x5632cec51600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:55.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.278+0000 7f0b08af2740 1 --2- 172.21.15.33:0/3555911979 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5632cec29780 0x5632cec51600 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0af0009610 tx=0x7f0af0014000 comp rx=0 tx=0).stop 2024-09-12T12:29:55.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.278+0000 7f0b08af2740 1 -- 172.21.15.33:0/3555911979 shutdown_connections 2024-09-12T12:29:55.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.278+0000 7f0b08af2740 1 --2- 172.21.15.33:0/3555911979 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5632cec45530 0x5632cec41f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:55.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.278+0000 7f0b08af2740 1 --2- 172.21.15.33:0/3555911979 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632cec2acf0 0x5632cec41a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:55.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.278+0000 7f0b08af2740 1 --2- 172.21.15.33:0/3555911979 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5632cec29780 0x5632cec51600 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:55.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.278+0000 7f0b08af2740 1 -- 172.21.15.33:0/3555911979 >> 172.21.15.33:0/3555911979 conn(0x5632cebf2310 msgr2=0x5632cec3d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:29:55.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.278+0000 7f0b08af2740 1 -- 172.21.15.33:0/3555911979 shutdown_connections 2024-09-12T12:29:55.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.279+0000 7f0b08af2740 1 -- 172.21.15.33:0/3555911979 wait complete. 2024-09-12T12:29:55.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.279+0000 7f0b08af2740 1 -- start start 2024-09-12T12:29:55.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.280+0000 7f0b08af2740 1 Processor -- start 2024-09-12T12:29:55.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.280+0000 7f0b08af2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5632cec29780 0x5632cecb84d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:55.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.280+0000 7f0b08af2740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632cec2acf0 0x5632cecb8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:55.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.281+0000 7f0b08af2740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5632cec45530 0x5632cec48cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:55.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.281+0000 7f0b08af2740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0aec00e300 con 0x5632cec2acf0 2024-09-12T12:29:55.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.281+0000 7f0b08af2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0aec00f770 con 0x5632cec29780 2024-09-12T12:29:55.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.281+0000 7f0b08af2740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0aec00e9d0 con 0x5632cec45530 2024-09-12T12:29:55.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.281+0000 7f0b04cb6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5632cec45530 0x5632cec48cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:55.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.281+0000 7f0b04cb6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5632cec45530 0x5632cec48cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:41554/0 (socket says 172.21.15.33:41554) 2024-09-12T12:29:55.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.281+0000 7f0b04cb6640 1 -- 172.21.15.33:0/2315551270 learned_addr learned my addr 172.21.15.33:0/2315551270 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:29:55.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.281+0000 7f0afffff640 1 --2- 172.21.15.33:0/2315551270 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5632cec29780 0x5632cecb84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:55.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.281+0000 7f0b08af2740 10 client.0 _ll_register_callbacks cb 0x7f0af80b9110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:29:55.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.281+0000 7f0aff7fe640 1 --2- 172.21.15.33:0/2315551270 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632cec2acf0 0x5632cecb8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:55.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.282+0000 7f0afffff640 1 -- 172.21.15.33:0/2315551270 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5632cec45530 msgr2=0x5632cec48cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:55.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.282+0000 7f0afffff640 1 --2- 172.21.15.33:0/2315551270 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5632cec45530 0x5632cec48cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:55.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.282+0000 7f0afffff640 1 -- 172.21.15.33:0/2315551270 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632cec2acf0 msgr2=0x5632cecb8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:55.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.282+0000 7f0afffff640 1 --2- 172.21.15.33:0/2315551270 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632cec2acf0 0x5632cecb8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:55.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.282+0000 7f0afffff640 1 -- 172.21.15.33:0/2315551270 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632cec493e0 con 0x5632cec29780 2024-09-12T12:29:55.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.282+0000 7f0b04cb6640 1 --2- 172.21.15.33:0/2315551270 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5632cec45530 0x5632cec48cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:29:55.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.282+0000 7f0afffff640 1 --2- 172.21.15.33:0/2315551270 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5632cec29780 0x5632cecb84d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0af0008010 tx=0x7f0af0011e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3ea1433ea038ad5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:29:55.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.282+0000 7f0adf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:29:55.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.283+0000 7f0adf7fe640 1 -- 172.21.15.33:0/2315551270 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af002e030 con 0x5632cec29780 2024-09-12T12:29:55.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.283+0000 7f0adf7fe640 1 -- 172.21.15.33:0/2315551270 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f0af000f040 con 0x5632cec29780 2024-09-12T12:29:55.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.283+0000 7f0b08af2740 1 -- 172.21.15.33:0/2315551270 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0af001a040 con 0x5632cec29780 2024-09-12T12:29:55.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.283+0000 7f0adf7fe640 1 -- 172.21.15.33:0/2315551270 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0af0015e00 con 0x5632cec29780 2024-09-12T12:29:55.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.283+0000 7f0b08af2740 10 client.25328 fetch_fsmap learned FSMap version 27 2024-09-12T12:29:55.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.283+0000 7f0b08af2740 1 -- 172.21.15.33:0/2315551270 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5632cecbfca0 con 0x5632cec29780 2024-09-12T12:29:55.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.285+0000 7f0adf7fe640 1 -- 172.21.15.33:0/2315551270 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0af0030070 con 0x5632cec29780 2024-09-12T12:29:55.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.286+0000 7f0adf7fe640 1 -- 172.21.15.33:0/2315551270 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f0af0014af0 con 0x5632cec29780 2024-09-12T12:29:55.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.286+0000 7f0b08af2740 10 client.25328 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:29:55.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.286+0000 7f0b08af2740 10 client.25328 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:29:55.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.286+0000 7f0b08af2740 20 client.25328 populate_metadata read hostname 'smithi033' 2024-09-12T12:29:55.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.286+0000 7f0b08af2740 1 --2- 172.21.15.33:0/2315551270 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5632cecc01c0 0x5632cecc25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:55.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.286+0000 7f0b08af2740 4 client.25328 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:29:55.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.286+0000 7f0b08af2740 1 -- 172.21.15.33:0/2315551270 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f0af001a040 con 0x5632cecc01c0 2024-09-12T12:29:55.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.286+0000 7f0aff7fe640 1 --2- 172.21.15.33:0/2315551270 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5632cecc01c0 0x5632cecc25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:55.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.287+0000 7f0aff7fe640 1 --2- 172.21.15.33:0/2315551270 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5632cecc01c0 0x5632cecc25e0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab8077a5505ec1cd server_cookie=4bb7553b339d2851 in_seq=0 out_seq=0 2024-09-12T12:29:55.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.287+0000 7f0adf7fe640 10 client.25328 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:29:55.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.288+0000 7f0adf7fe640 1 -- 172.21.15.33:0/2315551270 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f0af001a040 con 0x5632cecc01c0 2024-09-12T12:29:55.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.288+0000 7f0adf7fe640 10 client.25328 handle_command_reply: tid=0 2024-09-12T12:29:55.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.289+0000 7f0b08af2740 1 client.25328 shutdown 2024-09-12T12:29:55.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.292+0000 7f0b08af2740 1 -- 172.21.15.33:0/2315551270 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5632cec29780 msgr2=0x5632cecb84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:55.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.292+0000 7f0b08af2740 1 --2- 172.21.15.33:0/2315551270 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5632cec29780 0x5632cecb84d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0af0008010 tx=0x7f0af0011e40 comp rx=0 tx=0).stop 2024-09-12T12:29:55.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.292+0000 7f0b08af2740 1 -- 172.21.15.33:0/2315551270 shutdown_connections 2024-09-12T12:29:55.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.292+0000 7f0b08af2740 1 --2- 172.21.15.33:0/2315551270 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5632cecc01c0 0x5632cecc25e0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:55.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.292+0000 7f0b08af2740 1 --2- 172.21.15.33:0/2315551270 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5632cec45530 0x5632cec48cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:55.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.293+0000 7f0b08af2740 1 --2- 172.21.15.33:0/2315551270 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632cec2acf0 0x5632cecb8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:55.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.292+0000 7f0adf7fe640 0 client.25328 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:29:55.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.293+0000 7f0b08af2740 1 --2- 172.21.15.33:0/2315551270 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5632cec29780 0x5632cecb84d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:55.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.293+0000 7f0b08af2740 1 -- 172.21.15.33:0/2315551270 >> 172.21.15.33:0/2315551270 conn(0x5632cebf2310 msgr2=0x5632cec41a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:29:55.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.293+0000 7f0b08af2740 1 -- 172.21.15.33:0/2315551270 shutdown_connections 2024-09-12T12:29:55.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.293+0000 7f0b08af2740 1 -- 172.21.15.33:0/2315551270 wait complete. 2024-09-12T12:29:55.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.293+0000 7f0b08af2740 20 client.25328 trim_cache size 0 max 16384 2024-09-12T12:29:55.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.295+0000 7f0b054b7640 1 -- 172.21.15.33:0/1203706005 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0ae80a2c80 msgr2=0x7f0ae80a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:55.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.295+0000 7f0b054b7640 1 --2- 172.21.15.33:0/1203706005 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0ae80a2c80 0x7f0ae80a5140 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x5632cec26c70 tx=0x7f0af0008040 comp rx=0 tx=0).stop 2024-09-12T12:29:55.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.295+0000 7f0b054b7640 1 -- 172.21.15.33:0/1203706005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b00108c30 msgr2=0x7f0b001a4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:55.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.295+0000 7f0b054b7640 1 --2- 172.21.15.33:0/1203706005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b00108c30 0x7f0b001a4b90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0af8006010 tx=0x7f0af8003f10 comp rx=0 tx=0).stop 2024-09-12T12:29:55.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.298+0000 7f0b054b7640 1 -- 172.21.15.33:0/1203706005 shutdown_connections 2024-09-12T12:29:55.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.298+0000 7f0b054b7640 1 --2- 172.21.15.33:0/1203706005 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0ae80a2c80 0x7f0ae80a5140 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:55.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.298+0000 7f0b054b7640 1 --2- 172.21.15.33:0/1203706005 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b0010d360 0x7f0b0019e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:55.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.298+0000 7f0b054b7640 1 --2- 172.21.15.33:0/1203706005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b00108c30 0x7f0b001a4b90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:55.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.298+0000 7f0b054b7640 1 --2- 172.21.15.33:0/1203706005 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b00108280 0x7f0b001a4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:55.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.298+0000 7f0b054b7640 1 -- 172.21.15.33:0/1203706005 >> 172.21.15.33:0/1203706005 conn(0x7f0b000779f0 msgr2=0x7f0b00078920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:29:55.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.299+0000 7f0b054b7640 1 -- 172.21.15.33:0/1203706005 shutdown_connections 2024-09-12T12:29:55.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:55.299+0000 7f0b054b7640 1 -- 172.21.15.33:0/1203706005 wait complete. 2024-09-12T12:29:55.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:29:55 smithi033 ceph-mon[31246]: pgmap v467: 129 pgs: 129 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 50 MiB/s wr, 806 op/s 2024-09-12T12:29:55.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:29:55 smithi043 ceph-mon[34144]: pgmap v467: 129 pgs: 129 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 50 MiB/s wr, 806 op/s 2024-09-12T12:29:55.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:29:55 smithi102 ceph-mon[34799]: pgmap v467: 129 pgs: 129 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 50 MiB/s wr, 806 op/s 2024-09-12T12:29:56.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:29:56 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:29:56.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:29:56 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:29:56.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:29:56 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:29:56.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:29:56 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:29:56.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:29:56 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:29:56.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:29:56 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:29:56.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:29:56 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:29:56.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:29:56 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:29:56.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:29:56 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:29:57.177 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T12:29:57.178 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T12:29:57.482 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:29:57 smithi033 ceph-mon[31246]: pgmap v468: 129 pgs: 129 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 43 MiB/s wr, 696 op/s 2024-09-12T12:29:57.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:29:57 smithi043 ceph-mon[34144]: pgmap v468: 129 pgs: 129 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 43 MiB/s wr, 696 op/s 2024-09-12T12:29:57.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:29:57 smithi102 ceph-mon[34799]: pgmap v468: 129 pgs: 129 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 43 MiB/s wr, 696 op/s 2024-09-12T12:29:57.693 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:29:58.943 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:29:58.943 INFO:teuthology.orchestra.run.smithi033.stdout: "return_code": 0, 2024-09-12T12:29:58.943 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_tag": "00e67ac7-4707-4528-ae83-06be16a11bb5", 2024-09-12T12:29:58.944 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": "asynchronous" 2024-09-12T12:29:58.944 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:29:58.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.244+0000 7f8353924640 1 -- 172.21.15.33:0/1242285589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f834c106f20 msgr2=0x7f834c10eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:58.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.244+0000 7f8353924640 1 --2- 172.21.15.33:0/1242285589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f834c106f20 0x7f834c10eaa0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f8344009900 tx=0x7f834402a410 comp rx=0 tx=0).stop 2024-09-12T12:29:58.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.244+0000 7f8353924640 1 -- 172.21.15.33:0/1242285589 shutdown_connections 2024-09-12T12:29:58.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.244+0000 7f8353924640 1 --2- 172.21.15.33:0/1242285589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f834c106f20 0x7f834c10eaa0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:58.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.244+0000 7f8353924640 1 --2- 172.21.15.33:0/1242285589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f834c1027a0 0x7f834c1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:58.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.244+0000 7f8353924640 1 --2- 172.21.15.33:0/1242285589 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f834c101df0 0x7f834c1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:58.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.244+0000 7f8353924640 1 -- 172.21.15.33:0/1242285589 >> 172.21.15.33:0/1242285589 conn(0x7f834c0fd8f0 msgr2=0x7f834c0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:29:58.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.244+0000 7f8353924640 1 -- 172.21.15.33:0/1242285589 shutdown_connections 2024-09-12T12:29:58.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.244+0000 7f8353924640 1 -- 172.21.15.33:0/1242285589 wait complete. 2024-09-12T12:29:58.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.245+0000 7f8353924640 1 Processor -- start 2024-09-12T12:29:58.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.245+0000 7f8353924640 1 -- start start 2024-09-12T12:29:58.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.245+0000 7f8353924640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f834c101df0 0x7f834c198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:58.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.245+0000 7f8353924640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f834c1027a0 0x7f834c1987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:58.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.245+0000 7f8353924640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f834c106f20 0x7f834c19cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:58.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.245+0000 7f8353924640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f834c111e30 con 0x7f834c106f20 2024-09-12T12:29:58.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.245+0000 7f8353924640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f834c111cb0 con 0x7f834c101df0 2024-09-12T12:29:58.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.245+0000 7f8353924640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f834c111fb0 con 0x7f834c1027a0 2024-09-12T12:29:58.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.245+0000 7f8351ec1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f834c106f20 0x7f834c19cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:58.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.245+0000 7f8350ebf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f834c1027a0 0x7f834c1987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:58.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.245+0000 7f8351ec1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f834c106f20 0x7f834c19cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48266/0 (socket says 172.21.15.33:48266) 2024-09-12T12:29:58.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.245+0000 7f8351ec1640 1 -- 172.21.15.33:0/956391240 learned_addr learned my addr 172.21.15.33:0/956391240 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:29:58.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.246+0000 7f83516c0640 1 --2- 172.21.15.33:0/956391240 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f834c101df0 0x7f834c198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:58.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.246+0000 7f8351ec1640 1 -- 172.21.15.33:0/956391240 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f834c1027a0 msgr2=0x7f834c1987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:58.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.246+0000 7f8351ec1640 1 --2- 172.21.15.33:0/956391240 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f834c1027a0 0x7f834c1987b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:58.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.246+0000 7f8351ec1640 1 -- 172.21.15.33:0/956391240 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f834c101df0 msgr2=0x7f834c198270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:58.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.246+0000 7f8351ec1640 1 --2- 172.21.15.33:0/956391240 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f834c101df0 0x7f834c198270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:58.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.246+0000 7f8351ec1640 1 -- 172.21.15.33:0/956391240 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f834c19d220 con 0x7f834c106f20 2024-09-12T12:29:58.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.246+0000 7f8350ebf640 1 --2- 172.21.15.33:0/956391240 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f834c1027a0 0x7f834c1987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:29:58.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.246+0000 7f83516c0640 1 --2- 172.21.15.33:0/956391240 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f834c101df0 0x7f834c198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:29:58.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.246+0000 7f8351ec1640 1 --2- 172.21.15.33:0/956391240 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f834c106f20 0x7f834c19cb40 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8344004770 tx=0x7f8344004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:29:58.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.246+0000 7f834a7fc640 1 -- 172.21.15.33:0/956391240 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834403f030 con 0x7f834c106f20 2024-09-12T12:29:58.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.246+0000 7f834a7fc640 1 -- 172.21.15.33:0/956391240 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f83440318e0 con 0x7f834c106f20 2024-09-12T12:29:58.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.246+0000 7f8353924640 1 -- 172.21.15.33:0/956391240 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f834c19d4b0 con 0x7f834c106f20 2024-09-12T12:29:58.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.246+0000 7f834a7fc640 1 -- 172.21.15.33:0/956391240 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8344035070 con 0x7f834c106f20 2024-09-12T12:29:58.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.246+0000 7f8353924640 1 -- 172.21.15.33:0/956391240 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f834c1a4df0 con 0x7f834c106f20 2024-09-12T12:29:58.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.248+0000 7f834a7fc640 1 -- 172.21.15.33:0/956391240 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f8344042030 con 0x7f834c106f20 2024-09-12T12:29:58.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.249+0000 7f8355cfd740 1 Processor -- start 2024-09-12T12:29:58.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.249+0000 7f8355cfd740 1 -- start start 2024-09-12T12:29:58.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.249+0000 7f8355cfd740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b9de64a20 0x555b9de64e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:58.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.249+0000 7f8355cfd740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b9de65340 0x555b9de73c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:58.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.249+0000 7f8355cfd740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b9de74150 0x555b9de76540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:58.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.249+0000 7f8355cfd740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x555b9ddca280 con 0x555b9de64a20 2024-09-12T12:29:58.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.249+0000 7f8355cfd740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x555b9dd71b10 con 0x555b9de65340 2024-09-12T12:29:58.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.249+0000 7f8355cfd740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x555b9ddc6240 con 0x555b9de74150 2024-09-12T12:29:58.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.249+0000 7f834a7fc640 1 --2- 172.21.15.33:0/956391240 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f83340a2b80 0x7f83340a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:58.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.249+0000 7f8350ebf640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b9de64a20 0x555b9de64e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:58.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.249+0000 7f8350ebf640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b9de64a20 0x555b9de64e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48278/0 (socket says 172.21.15.33:48278) 2024-09-12T12:29:58.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.249+0000 7f8350ebf640 1 -- 172.21.15.33:0/3382771593 learned_addr learned my addr 172.21.15.33:0/3382771593 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:29:58.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.249+0000 7f8351ec1640 1 --2- 172.21.15.33:0/956391240 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f83340a2b80 0x7f83340a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:58.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.249+0000 7f8350ebf640 1 --2- 172.21.15.33:0/3382771593 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b9de74150 0x555b9de76540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:58.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.249+0000 7f83516c0640 1 --2- 172.21.15.33:0/3382771593 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b9de65340 0x555b9de73c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:58.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.249+0000 7f834a7fc640 1 -- 172.21.15.33:0/956391240 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f83440efaf0 con 0x7f834c106f20 2024-09-12T12:29:58.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.250+0000 7f8350ebf640 1 -- 172.21.15.33:0/3382771593 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b9de65340 msgr2=0x555b9de73c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:58.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.250+0000 7f8350ebf640 1 --2- 172.21.15.33:0/3382771593 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b9de65340 0x555b9de73c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:58.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.250+0000 7f8350ebf640 1 -- 172.21.15.33:0/3382771593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b9de64a20 msgr2=0x555b9de64e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:58.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.250+0000 7f8350ebf640 1 --2- 172.21.15.33:0/3382771593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b9de64a20 0x555b9de64e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:58.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.250+0000 7f8350ebf640 1 -- 172.21.15.33:0/3382771593 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b9dd7e1f0 con 0x555b9de74150 2024-09-12T12:29:58.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.250+0000 7f8350ebf640 1 --2- 172.21.15.33:0/3382771593 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b9de74150 0x555b9de76540 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f834000afd0 tx=0x7f8340004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49ae56be02c99f19 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:29:58.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.250+0000 7f83337fe640 1 -- 172.21.15.33:0/3382771593 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8340011e80 con 0x555b9de74150 2024-09-12T12:29:58.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.250+0000 7f8351ec1640 1 --2- 172.21.15.33:0/956391240 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f83340a2b80 0x7f83340a5040 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f83440b8930 tx=0x7f834408aee0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:29:58.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.250+0000 7f83337fe640 1 -- 172.21.15.33:0/3382771593 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f83400054d0 con 0x555b9de74150 2024-09-12T12:29:58.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.250+0000 7f83337fe640 1 -- 172.21.15.33:0/3382771593 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8340004a00 con 0x555b9de74150 2024-09-12T12:29:58.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.251+0000 7f8355cfd740 1 -- 172.21.15.33:0/3382771593 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b9de74150 msgr2=0x555b9de76540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:58.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.251+0000 7f8355cfd740 1 --2- 172.21.15.33:0/3382771593 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b9de74150 0x555b9de76540 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f834000afd0 tx=0x7f8340004730 comp rx=0 tx=0).stop 2024-09-12T12:29:58.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.251+0000 7f8355cfd740 1 -- 172.21.15.33:0/3382771593 shutdown_connections 2024-09-12T12:29:58.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.251+0000 7f8355cfd740 1 --2- 172.21.15.33:0/3382771593 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b9de74150 0x555b9de76540 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:58.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.251+0000 7f8355cfd740 1 --2- 172.21.15.33:0/3382771593 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b9de65340 0x555b9de73c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:58.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.251+0000 7f8355cfd740 1 --2- 172.21.15.33:0/3382771593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b9de64a20 0x555b9de64e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:58.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.251+0000 7f8355cfd740 1 -- 172.21.15.33:0/3382771593 >> 172.21.15.33:0/3382771593 conn(0x555b9de610f0 msgr2=0x555b9de614d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:29:58.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.252+0000 7f8355cfd740 1 -- 172.21.15.33:0/3382771593 shutdown_connections 2024-09-12T12:29:58.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.252+0000 7f8355cfd740 1 -- 172.21.15.33:0/3382771593 wait complete. 2024-09-12T12:29:58.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.252+0000 7f8355cfd740 1 -- start start 2024-09-12T12:29:58.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.252+0000 7f8355cfd740 1 Processor -- start 2024-09-12T12:29:58.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.253+0000 7f8355cfd740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b9de64a20 0x555b9de71050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:58.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.253+0000 7f8355cfd740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b9de65340 0x555b9de71590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:58.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.253+0000 7f8355cfd740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b9de74150 0x555b9de71ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:58.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.253+0000 7f8355cfd740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x555b9de76cc0 con 0x555b9de65340 2024-09-12T12:29:58.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.253+0000 7f8355cfd740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x555b9dd84f10 con 0x555b9de64a20 2024-09-12T12:29:58.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.253+0000 7f8355cfd740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x555b9de76e40 con 0x555b9de74150 2024-09-12T12:29:58.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.253+0000 7f8355cfd740 10 client.0 _ll_register_callbacks cb 0x555b9dd4da40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:29:58.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.253+0000 7f83516c0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b9de65340 0x555b9de71590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:58.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.253+0000 7f83516c0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b9de65340 0x555b9de71590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48288/0 (socket says 172.21.15.33:48288) 2024-09-12T12:29:58.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.253+0000 7f83516c0640 1 -- 172.21.15.33:0/277695982 learned_addr learned my addr 172.21.15.33:0/277695982 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:29:58.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.253+0000 7f8350ebf640 1 --2- 172.21.15.33:0/277695982 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b9de74150 0x555b9de71ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:58.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.253+0000 7f8350ebf640 1 --2- 172.21.15.33:0/277695982 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b9de64a20 0x555b9de71050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:58.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.253+0000 7f83516c0640 1 -- 172.21.15.33:0/277695982 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b9de74150 msgr2=0x555b9de71ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:58.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.253+0000 7f83516c0640 1 --2- 172.21.15.33:0/277695982 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b9de74150 0x555b9de71ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:58.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.253+0000 7f83516c0640 1 -- 172.21.15.33:0/277695982 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b9de64a20 msgr2=0x555b9de71050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:58.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.253+0000 7f83516c0640 1 --2- 172.21.15.33:0/277695982 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b9de64a20 0x555b9de71050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:58.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.253+0000 7f83516c0640 1 -- 172.21.15.33:0/277695982 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b9db3b6a0 con 0x555b9de65340 2024-09-12T12:29:58.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.254+0000 7f83516c0640 1 --2- 172.21.15.33:0/277695982 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b9de65340 0x555b9de71590 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f833c004320 tx=0x7f833c003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62e6fef8cb431b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:29:58.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.254+0000 7f8330ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:29:58.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.254+0000 7f8330ff9640 1 -- 172.21.15.33:0/277695982 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833c011940 con 0x555b9de65340 2024-09-12T12:29:58.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.254+0000 7f8330ff9640 1 -- 172.21.15.33:0/277695982 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f833c011ae0 con 0x555b9de65340 2024-09-12T12:29:58.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.254+0000 7f8355cfd740 1 -- 172.21.15.33:0/277695982 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83400054d0 con 0x555b9de65340 2024-09-12T12:29:58.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.255+0000 7f8330ff9640 1 -- 172.21.15.33:0/277695982 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f833c011ce0 con 0x555b9de65340 2024-09-12T12:29:58.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.255+0000 7f8355cfd740 10 client.15699 fetch_fsmap learned FSMap version 27 2024-09-12T12:29:58.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.255+0000 7f8355cfd740 1 -- 172.21.15.33:0/277695982 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555b9de82990 con 0x555b9de65340 2024-09-12T12:29:58.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.255+0000 7f8330ff9640 1 -- 172.21.15.33:0/277695982 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f83400054d0 con 0x555b9de65340 2024-09-12T12:29:58.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.255+0000 7f8330ff9640 1 -- 172.21.15.33:0/277695982 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f833c0104b0 con 0x555b9de65340 2024-09-12T12:29:58.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.255+0000 7f8355cfd740 10 client.15699 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:29:58.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.255+0000 7f8355cfd740 10 client.15699 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:29:58.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.255+0000 7f8355cfd740 20 client.15699 populate_metadata read hostname 'smithi033' 2024-09-12T12:29:58.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.255+0000 7f8355cfd740 1 --2- 172.21.15.33:0/277695982 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x555b9de842c0 0x555b9de86760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:58.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.255+0000 7f8355cfd740 4 client.15699 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:29:58.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.255+0000 7f8355cfd740 1 -- 172.21.15.33:0/277695982 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555b9ddd77f0 con 0x555b9de842c0 2024-09-12T12:29:58.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.256+0000 7f8350ebf640 1 --2- 172.21.15.33:0/277695982 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x555b9de842c0 0x555b9de86760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:58.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.256+0000 7f8350ebf640 1 --2- 172.21.15.33:0/277695982 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x555b9de842c0 0x555b9de86760 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14db12b621e6e1a7 server_cookie=e37d62f6ebe67a3c in_seq=0 out_seq=0 2024-09-12T12:29:58.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.256+0000 7f8330ff9640 10 client.15699 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:29:58.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.257+0000 7f8330ff9640 1 -- 172.21.15.33:0/277695982 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555b9ddd77f0 con 0x555b9de842c0 2024-09-12T12:29:58.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.257+0000 7f8330ff9640 10 client.15699 handle_command_reply: tid=0 2024-09-12T12:29:58.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.257+0000 7f8355cfd740 1 client.15699 shutdown 2024-09-12T12:29:58.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.257+0000 7f8355cfd740 1 -- 172.21.15.33:0/277695982 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b9de65340 msgr2=0x555b9de71590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:58.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.257+0000 7f8355cfd740 1 --2- 172.21.15.33:0/277695982 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b9de65340 0x555b9de71590 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f833c004320 tx=0x7f833c003f90 comp rx=0 tx=0).stop 2024-09-12T12:29:58.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.257+0000 7f8355cfd740 1 -- 172.21.15.33:0/277695982 shutdown_connections 2024-09-12T12:29:58.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.257+0000 7f8355cfd740 1 --2- 172.21.15.33:0/277695982 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x555b9de842c0 0x555b9de86760 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:58.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.257+0000 7f8355cfd740 1 --2- 172.21.15.33:0/277695982 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b9de74150 0x555b9de71ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:58.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.257+0000 7f8355cfd740 1 --2- 172.21.15.33:0/277695982 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b9de65340 0x555b9de71590 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:58.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.257+0000 7f8355cfd740 1 --2- 172.21.15.33:0/277695982 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b9de64a20 0x555b9de71050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:58.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.257+0000 7f8355cfd740 1 -- 172.21.15.33:0/277695982 >> 172.21.15.33:0/277695982 conn(0x555b9de610f0 msgr2=0x555b9de66e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:29:58.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.257+0000 7f8330ff9640 0 client.15699 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:29:58.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.258+0000 7f8355cfd740 1 -- 172.21.15.33:0/277695982 shutdown_connections 2024-09-12T12:29:58.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.258+0000 7f8355cfd740 1 -- 172.21.15.33:0/277695982 wait complete. 2024-09-12T12:29:58.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.258+0000 7f8355cfd740 20 client.15699 trim_cache size 0 max 16384 2024-09-12T12:29:58.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.294+0000 7f8355cfd740 1 Processor -- start 2024-09-12T12:29:58.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.294+0000 7f8355cfd740 1 -- start start 2024-09-12T12:29:58.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.294+0000 7f8355cfd740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b9de64a20 0x555b9de6b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:58.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.294+0000 7f8355cfd740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b9de65340 0x555b9de8c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:58.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.295+0000 7f8355cfd740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b9de74150 0x555b9de8c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:58.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.295+0000 7f8355cfd740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f834c1af220 con 0x555b9de64a20 2024-09-12T12:29:58.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.295+0000 7f8355cfd740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f834c1acaf0 con 0x555b9de65340 2024-09-12T12:29:58.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.295+0000 7f8355cfd740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f834c1aa940 con 0x555b9de74150 2024-09-12T12:29:58.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.295+0000 7f83516c0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b9de65340 0x555b9de8c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:58.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.295+0000 7f83516c0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b9de65340 0x555b9de8c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:54612/0 (socket says 172.21.15.33:54612) 2024-09-12T12:29:58.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.295+0000 7f83516c0640 1 -- 172.21.15.33:0/2423450251 learned_addr learned my addr 172.21.15.33:0/2423450251 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:29:58.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.296+0000 7f8350ebf640 1 --2- 172.21.15.33:0/2423450251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b9de74150 0x555b9de8c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:58.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.296+0000 7f8350ebf640 1 --2- 172.21.15.33:0/2423450251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b9de64a20 0x555b9de6b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:58.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.297+0000 7f8350ebf640 1 -- 172.21.15.33:0/2423450251 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b9de65340 msgr2=0x555b9de8c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:58.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.297+0000 7f8350ebf640 1 --2- 172.21.15.33:0/2423450251 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b9de65340 0x555b9de8c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:58.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.297+0000 7f8350ebf640 1 -- 172.21.15.33:0/2423450251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b9de64a20 msgr2=0x555b9de6b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:58.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.297+0000 7f8350ebf640 1 --2- 172.21.15.33:0/2423450251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b9de64a20 0x555b9de6b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:58.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.297+0000 7f8350ebf640 1 -- 172.21.15.33:0/2423450251 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b9de60b90 con 0x555b9de74150 2024-09-12T12:29:58.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.298+0000 7f8350ebf640 1 --2- 172.21.15.33:0/2423450251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b9de74150 0x555b9de8c5b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8340005d60 tx=0x7f8340017040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ee1195f5d11d0b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:29:58.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.299+0000 7f8332ffd640 1 -- 172.21.15.33:0/2423450251 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8340014110 con 0x555b9de74150 2024-09-12T12:29:58.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.299+0000 7f8332ffd640 1 -- 172.21.15.33:0/2423450251 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f834002f810 con 0x555b9de74150 2024-09-12T12:29:58.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.299+0000 7f8332ffd640 1 -- 172.21.15.33:0/2423450251 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83400226a0 con 0x555b9de74150 2024-09-12T12:29:58.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.300+0000 7f8355cfd740 1 -- 172.21.15.33:0/2423450251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b9de74150 msgr2=0x555b9de8c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:58.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.300+0000 7f8355cfd740 1 --2- 172.21.15.33:0/2423450251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b9de74150 0x555b9de8c5b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8340005d60 tx=0x7f8340017040 comp rx=0 tx=0).stop 2024-09-12T12:29:58.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.303+0000 7f8355cfd740 1 -- 172.21.15.33:0/2423450251 shutdown_connections 2024-09-12T12:29:58.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.303+0000 7f8355cfd740 1 --2- 172.21.15.33:0/2423450251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b9de74150 0x555b9de8c5b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:58.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.303+0000 7f8355cfd740 1 --2- 172.21.15.33:0/2423450251 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b9de65340 0x555b9de8c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:58.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.303+0000 7f8355cfd740 1 --2- 172.21.15.33:0/2423450251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b9de64a20 0x555b9de6b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:58.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.303+0000 7f8355cfd740 1 -- 172.21.15.33:0/2423450251 >> 172.21.15.33:0/2423450251 conn(0x555b9de610f0 msgr2=0x555b9de72fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:29:58.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.305+0000 7f8355cfd740 1 -- 172.21.15.33:0/2423450251 shutdown_connections 2024-09-12T12:29:58.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.305+0000 7f8355cfd740 1 -- 172.21.15.33:0/2423450251 wait complete. 2024-09-12T12:29:58.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.306+0000 7f8355cfd740 1 -- start start 2024-09-12T12:29:58.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.306+0000 7f8355cfd740 1 Processor -- start 2024-09-12T12:29:58.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.307+0000 7f8355cfd740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b9de64a20 0x555b9de6b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:58.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.307+0000 7f8355cfd740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b9de65340 0x555b9de7c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:58.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.307+0000 7f8355cfd740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b9de74150 0x555b9de7c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:58.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.307+0000 7f8355cfd740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f834c1aafb0 con 0x555b9de65340 2024-09-12T12:29:58.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.307+0000 7f8355cfd740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f834c1ac420 con 0x555b9de74150 2024-09-12T12:29:58.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.307+0000 7f8355cfd740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f834c1ab680 con 0x555b9de64a20 2024-09-12T12:29:58.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.307+0000 7f8355cfd740 10 client.0 _ll_register_callbacks cb 0x7f833c009c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:29:58.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.309+0000 7f83516c0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b9de65340 0x555b9de7c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:58.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.309+0000 7f83516c0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b9de65340 0x555b9de7c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48314/0 (socket says 172.21.15.33:48314) 2024-09-12T12:29:58.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.309+0000 7f83516c0640 1 -- 172.21.15.33:0/899431873 learned_addr learned my addr 172.21.15.33:0/899431873 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:29:58.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.309+0000 7f8350ebf640 1 --2- 172.21.15.33:0/899431873 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b9de64a20 0x555b9de6b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:58.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.309+0000 7f8350ebf640 1 --2- 172.21.15.33:0/899431873 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b9de74150 0x555b9de7c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:58.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.310+0000 7f8350ebf640 1 -- 172.21.15.33:0/899431873 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b9de74150 msgr2=0x555b9de7c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:58.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.310+0000 7f8350ebf640 1 --2- 172.21.15.33:0/899431873 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b9de74150 0x555b9de7c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:58.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.310+0000 7f8350ebf640 1 -- 172.21.15.33:0/899431873 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b9de65340 msgr2=0x555b9de7c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:29:58.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.310+0000 7f8350ebf640 1 --2- 172.21.15.33:0/899431873 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b9de65340 0x555b9de7c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:58.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.310+0000 7f8350ebf640 1 -- 172.21.15.33:0/899431873 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b9de76e30 con 0x555b9de64a20 2024-09-12T12:29:58.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.310+0000 7f8350ebf640 1 --2- 172.21.15.33:0/899431873 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b9de64a20 0x555b9de6b2d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8340014b60 tx=0x7f8340005700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db5eb5626035477b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:29:58.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.310+0000 7f8330ff9640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:29:58.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.310+0000 7f8330ff9640 1 -- 172.21.15.33:0/899431873 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8340037040 con 0x555b9de64a20 2024-09-12T12:29:58.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.311+0000 7f8330ff9640 1 -- 172.21.15.33:0/899431873 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f834002f360 con 0x555b9de64a20 2024-09-12T12:29:58.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.311+0000 7f8355cfd740 1 -- 172.21.15.33:0/899431873 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f834002f810 con 0x555b9de64a20 2024-09-12T12:29:58.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.315+0000 7f8330ff9640 1 -- 172.21.15.33:0/899431873 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f834002fc80 con 0x555b9de64a20 2024-09-12T12:29:58.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.315+0000 7f8355cfd740 10 client.25447 fetch_fsmap learned FSMap version 27 2024-09-12T12:29:58.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.315+0000 7f8355cfd740 1 -- 172.21.15.33:0/899431873 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555b9deeb020 con 0x555b9de64a20 2024-09-12T12:29:58.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.316+0000 7f8330ff9640 1 -- 172.21.15.33:0/899431873 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f834002f810 con 0x555b9de64a20 2024-09-12T12:29:58.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.317+0000 7f8330ff9640 1 -- 172.21.15.33:0/899431873 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f834000f450 con 0x555b9de64a20 2024-09-12T12:29:58.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.317+0000 7f8355cfd740 10 client.25447 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:29:58.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.317+0000 7f8355cfd740 10 client.25447 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:29:58.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.317+0000 7f8355cfd740 20 client.25447 populate_metadata read hostname 'smithi033' 2024-09-12T12:29:58.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.317+0000 7f8355cfd740 1 --2- 172.21.15.33:0/899431873 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x555b9deeb310 0x555b9deed730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:29:58.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.317+0000 7f8355cfd740 4 client.25447 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T12:29:58.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.317+0000 7f8355cfd740 1 -- 172.21.15.33:0/899431873 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x555b9ddd1d00 con 0x555b9deeb310 2024-09-12T12:29:58.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.318+0000 7f83516c0640 1 --2- 172.21.15.33:0/899431873 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x555b9deeb310 0x555b9deed730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:29:58.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.319+0000 7f83516c0640 1 --2- 172.21.15.33:0/899431873 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x555b9deeb310 0x555b9deed730 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9450ba102ec603 server_cookie=c1d2b249d8267d0c in_seq=0 out_seq=0 2024-09-12T12:29:58.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.319+0000 7f8330ff9640 10 client.25447 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:29:58.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.320+0000 7f8330ff9640 1 -- 172.21.15.33:0/899431873 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555b9ddd1d00 con 0x555b9deeb310 2024-09-12T12:29:58.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.320+0000 7f8330ff9640 10 client.25447 handle_command_reply: tid=0 2024-09-12T12:29:58.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.320+0000 7f8355cfd740 1 client.25447 shutdown 2024-09-12T12:29:58.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.321+0000 7f8355cfd740 1 -- 172.21.15.33:0/899431873 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b9de64a20 msgr2=0x555b9de6b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:58.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.321+0000 7f8355cfd740 1 --2- 172.21.15.33:0/899431873 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b9de64a20 0x555b9de6b2d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8340014b60 tx=0x7f8340005700 comp rx=0 tx=0).stop 2024-09-12T12:29:58.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.321+0000 7f8355cfd740 1 -- 172.21.15.33:0/899431873 shutdown_connections 2024-09-12T12:29:58.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.321+0000 7f8355cfd740 1 --2- 172.21.15.33:0/899431873 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x555b9deeb310 0x555b9deed730 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:58.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.322+0000 7f8355cfd740 1 --2- 172.21.15.33:0/899431873 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b9de74150 0x555b9de7c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:58.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.322+0000 7f8355cfd740 1 --2- 172.21.15.33:0/899431873 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b9de65340 0x555b9de7c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:58.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.322+0000 7f8355cfd740 1 --2- 172.21.15.33:0/899431873 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b9de64a20 0x555b9de6b2d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:58.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.322+0000 7f8355cfd740 1 -- 172.21.15.33:0/899431873 >> 172.21.15.33:0/899431873 conn(0x555b9de610f0 msgr2=0x555b9de71010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:29:58.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.322+0000 7f8330ff9640 0 client.25447 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:29:58.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.324+0000 7f8355cfd740 1 -- 172.21.15.33:0/899431873 shutdown_connections 2024-09-12T12:29:58.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.324+0000 7f8355cfd740 1 -- 172.21.15.33:0/899431873 wait complete. 2024-09-12T12:29:58.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.324+0000 7f8355cfd740 20 client.25447 trim_cache size 0 max 16384 2024-09-12T12:29:58.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.327+0000 7f8353924640 1 -- 172.21.15.33:0/956391240 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f83340a2b80 msgr2=0x7f83340a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:58.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.327+0000 7f8353924640 1 --2- 172.21.15.33:0/956391240 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f83340a2b80 0x7f83340a5040 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f83440b8930 tx=0x7f834408aee0 comp rx=0 tx=0).stop 2024-09-12T12:29:58.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.327+0000 7f8353924640 1 -- 172.21.15.33:0/956391240 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f834c106f20 msgr2=0x7f834c19cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:29:58.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.327+0000 7f8353924640 1 --2- 172.21.15.33:0/956391240 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f834c106f20 0x7f834c19cb40 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8344004770 tx=0x7f8344004270 comp rx=0 tx=0).stop 2024-09-12T12:29:58.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.327+0000 7f8353924640 1 -- 172.21.15.33:0/956391240 shutdown_connections 2024-09-12T12:29:58.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.327+0000 7f8353924640 1 --2- 172.21.15.33:0/956391240 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f83340a2b80 0x7f83340a5040 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:58.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.327+0000 7f8353924640 1 --2- 172.21.15.33:0/956391240 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f834c106f20 0x7f834c19cb40 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:58.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.327+0000 7f8353924640 1 --2- 172.21.15.33:0/956391240 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f834c1027a0 0x7f834c1987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:58.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.327+0000 7f8353924640 1 --2- 172.21.15.33:0/956391240 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f834c101df0 0x7f834c198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:29:58.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.327+0000 7f8353924640 1 -- 172.21.15.33:0/956391240 >> 172.21.15.33:0/956391240 conn(0x7f834c0fd8f0 msgr2=0x7f834c0febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:29:58.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.327+0000 7f8353924640 1 -- 172.21.15.33:0/956391240 shutdown_connections 2024-09-12T12:29:58.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:29:58.327+0000 7f8353924640 1 -- 172.21.15.33:0/956391240 wait complete. 2024-09-12T12:29:59.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:29:59 smithi043 ceph-mon[34144]: pgmap v469: 129 pgs: 129 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 57 MiB/s wr, 911 op/s 2024-09-12T12:29:59.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:29:59 smithi043 ceph-mon[34144]: scrub queued for path: / 2024-09-12T12:29:59.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:29:59 smithi043 ceph-mon[34144]: scrub summary: idle+waiting paths [/] 2024-09-12T12:29:59.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:29:59 smithi043 ceph-mon[34144]: scrub summary: active paths [/] 2024-09-12T12:29:59.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:29:59 smithi043 ceph-mon[34144]: scrub summary: idle+waiting paths [/] 2024-09-12T12:29:59.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:29:59 smithi102 ceph-mon[34799]: pgmap v469: 129 pgs: 129 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 57 MiB/s wr, 911 op/s 2024-09-12T12:29:59.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:29:59 smithi102 ceph-mon[34799]: scrub queued for path: / 2024-09-12T12:29:59.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:29:59 smithi102 ceph-mon[34799]: scrub summary: idle+waiting paths [/] 2024-09-12T12:29:59.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:29:59 smithi102 ceph-mon[34799]: scrub summary: active paths [/] 2024-09-12T12:29:59.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:29:59 smithi102 ceph-mon[34799]: scrub summary: idle+waiting paths [/] 2024-09-12T12:29:59.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:29:59 smithi033 ceph-mon[31246]: pgmap v469: 129 pgs: 129 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 57 MiB/s wr, 911 op/s 2024-09-12T12:29:59.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:29:59 smithi033 ceph-mon[31246]: scrub queued for path: / 2024-09-12T12:29:59.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:29:59 smithi033 ceph-mon[31246]: scrub summary: idle+waiting paths [/] 2024-09-12T12:29:59.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:29:59 smithi033 ceph-mon[31246]: scrub summary: active paths [/] 2024-09-12T12:29:59.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:29:59 smithi033 ceph-mon[31246]: scrub summary: idle+waiting paths [/] 2024-09-12T12:30:00.449 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:30:00 smithi033 ceph-mon[31246]: scrub summary: active paths [/] 2024-09-12T12:30:00.450 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:30:00 smithi033 ceph-mon[31246]: scrub summary: idle+waiting paths [/] 2024-09-12T12:30:00.450 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:30:00 smithi033 ceph-mon[31246]: overall HEALTH_OK 2024-09-12T12:30:00.513 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T12:30:00.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:30:00 smithi043 ceph-mon[34144]: scrub summary: active paths [/] 2024-09-12T12:30:00.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:30:00 smithi043 ceph-mon[34144]: scrub summary: idle+waiting paths [/] 2024-09-12T12:30:00.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:30:00 smithi043 ceph-mon[34144]: overall HEALTH_OK 2024-09-12T12:30:00.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:30:00 smithi102 ceph-mon[34799]: scrub summary: active paths [/] 2024-09-12T12:30:00.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:30:00 smithi102 ceph-mon[34799]: scrub summary: idle+waiting paths [/] 2024-09-12T12:30:00.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:30:00 smithi102 ceph-mon[34799]: overall HEALTH_OK 2024-09-12T12:30:01.029 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:30:01.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:30:01 smithi033 ceph-mon[31246]: pgmap v470: 129 pgs: 129 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 45 MiB/s wr, 728 op/s 2024-09-12T12:30:01.617 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:30:01 smithi043 ceph-mon[34144]: pgmap v470: 129 pgs: 129 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 45 MiB/s wr, 728 op/s 2024-09-12T12:30:01.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:30:01 smithi102 ceph-mon[34799]: pgmap v470: 129 pgs: 129 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 45 MiB/s wr, 728 op/s 2024-09-12T12:30:02.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.372+0000 7fe1bb59e640 1 -- 172.21.15.33:0/827760775 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1b40b2dc0 msgr2=0x7fe1b40b51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:02.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.372+0000 7fe1bb59e640 1 --2- 172.21.15.33:0/827760775 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1b40b2dc0 0x7fe1b40b51f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc067960 tx=0x7fe1bc08e340 comp rx=0 tx=0).stop 2024-09-12T12:30:02.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.372+0000 7fe1bb59e640 1 -- 172.21.15.33:0/827760775 shutdown_connections 2024-09-12T12:30:02.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.372+0000 7fe1bb59e640 1 --2- 172.21.15.33:0/827760775 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1b40b2dc0 0x7fe1b40b51f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:02.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.372+0000 7fe1bb59e640 1 --2- 172.21.15.33:0/827760775 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1b40a5370 0x7fe1b40b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:02.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.372+0000 7fe1bb59e640 1 --2- 172.21.15.33:0/827760775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1b40a4a50 0x7fe1b40a4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:02.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.372+0000 7fe1bb59e640 1 -- 172.21.15.33:0/827760775 >> 172.21.15.33:0/827760775 conn(0x7fe1b401a0a0 msgr2=0x7fe1b401a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:30:02.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.373+0000 7fe1bb59e640 1 -- 172.21.15.33:0/827760775 shutdown_connections 2024-09-12T12:30:02.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.373+0000 7fe1bb59e640 1 -- 172.21.15.33:0/827760775 wait complete. 2024-09-12T12:30:02.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.374+0000 7fe1bb59e640 1 Processor -- start 2024-09-12T12:30:02.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.374+0000 7fe1bb59e640 1 -- start start 2024-09-12T12:30:02.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.374+0000 7fe1bb59e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1b40a4a50 0x7fe1b40beba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:02.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.374+0000 7fe1bb59e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1b40a5370 0x7fe1b40b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:02.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.374+0000 7fe1bb59e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1b40b2dc0 0x7fe1b40b2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:02.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.374+0000 7fe1bb59e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b40a9fb0 con 0x7fe1b40a4a50 2024-09-12T12:30:02.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.374+0000 7fe1bb59e640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b40a9e30 con 0x7fe1b40b2dc0 2024-09-12T12:30:02.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.374+0000 7fe1bb59e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b40aa130 con 0x7fe1b40a5370 2024-09-12T12:30:02.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.375+0000 7fe1bad9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1b40b2dc0 0x7fe1b40b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:02.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.375+0000 7fe1ba59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1b40a4a50 0x7fe1b40beba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:02.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.375+0000 7fe1b9d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1b40a5370 0x7fe1b40b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:02.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.375+0000 7fe1b9d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1b40a5370 0x7fe1b40b1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:36406/0 (socket says 172.21.15.33:36406) 2024-09-12T12:30:02.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.375+0000 7fe1b9d9b640 1 -- 172.21.15.33:0/1632529038 learned_addr learned my addr 172.21.15.33:0/1632529038 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:30:02.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.377+0000 7fe1ba59c640 1 -- 172.21.15.33:0/1632529038 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1b40a5370 msgr2=0x7fe1b40b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:02.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.377+0000 7fe1ba59c640 1 --2- 172.21.15.33:0/1632529038 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1b40a5370 0x7fe1b40b1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:02.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.377+0000 7fe1ba59c640 1 -- 172.21.15.33:0/1632529038 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1b40b2dc0 msgr2=0x7fe1b40b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:02.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.377+0000 7fe1ba59c640 1 --2- 172.21.15.33:0/1632529038 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1b40b2dc0 0x7fe1b40b2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:02.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.378+0000 7fe1ba59c640 1 -- 172.21.15.33:0/1632529038 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1b40b25c0 con 0x7fe1b40a4a50 2024-09-12T12:30:02.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.378+0000 7fe1b9d9b640 1 --2- 172.21.15.33:0/1632529038 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1b40a5370 0x7fe1b40b1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:30:02.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.379+0000 7fe1ba59c640 1 --2- 172.21.15.33:0/1632529038 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1b40a4a50 0x7fe1b40beba0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac00b3f0 tx=0x7fe1ac00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:30:02.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.380+0000 7fe1ab7fe640 1 -- 172.21.15.33:0/1632529038 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac015020 con 0x7fe1b40a4a50 2024-09-12T12:30:02.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.381+0000 7fe1bb59e640 1 -- 172.21.15.33:0/1632529038 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1b40b28b0 con 0x7fe1b40a4a50 2024-09-12T12:30:02.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.381+0000 7fe1bb59e640 1 -- 172.21.15.33:0/1632529038 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1b40ba8e0 con 0x7fe1b40a4a50 2024-09-12T12:30:02.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.381+0000 7fe1ab7fe640 1 -- 172.21.15.33:0/1632529038 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe1ac011ce0 con 0x7fe1b40a4a50 2024-09-12T12:30:02.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.381+0000 7fe1ab7fe640 1 -- 172.21.15.33:0/1632529038 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac010e10 con 0x7fe1b40a4a50 2024-09-12T12:30:02.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.388+0000 7fe1c2c1a740 1 Processor -- start 2024-09-12T12:30:02.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.388+0000 7fe1ab7fe640 1 -- 172.21.15.33:0/1632529038 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe1ac018020 con 0x7fe1b40a4a50 2024-09-12T12:30:02.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.389+0000 7fe1c2c1a740 1 -- start start 2024-09-12T12:30:02.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.390+0000 7fe1c2c1a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0ff10c670 0x55d0ff10ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:02.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.390+0000 7fe1c2c1a740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d0ff10cf90 0x55d0ff117310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:02.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.390+0000 7fe1c2c1a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0ff117850 0x55d0ff119c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:02.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.390+0000 7fe1c2c1a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55d0ff0722e0 con 0x55d0ff117850 2024-09-12T12:30:02.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.390+0000 7fe1c2c1a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d0ff019ce0 con 0x55d0ff10c670 2024-09-12T12:30:02.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.390+0000 7fe1c2c1a740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d0ff06e2a0 con 0x55d0ff10cf90 2024-09-12T12:30:02.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.390+0000 7fe1bad9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0ff10c670 0x55d0ff10ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:02.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.390+0000 7fe1bad9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0ff10c670 0x55d0ff10ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:56956/0 (socket says 172.21.15.33:56956) 2024-09-12T12:30:02.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.390+0000 7fe1bad9d640 1 -- 172.21.15.33:0/4264343291 learned_addr learned my addr 172.21.15.33:0/4264343291 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:30:02.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.390+0000 7fe1ba59c640 1 --2- 172.21.15.33:0/4264343291 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d0ff10cf90 0x55d0ff117310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:02.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.391+0000 7fe1ab7fe640 1 --2- 172.21.15.33:0/1632529038 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe1a40a2d60 0x7fe1a40a5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:02.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.391+0000 7fe1b9d9b640 1 --2- 172.21.15.33:0/4264343291 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0ff117850 0x55d0ff119c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:02.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.392+0000 7fe1ab7fe640 1 -- 172.21.15.33:0/1632529038 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fe1ac0cfaf0 con 0x7fe1b40a4a50 2024-09-12T12:30:02.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.392+0000 7fe1b9d9b640 1 -- 172.21.15.33:0/4264343291 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d0ff10cf90 msgr2=0x55d0ff117310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:30:02.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.392+0000 7fe1b9d9b640 1 --2- 172.21.15.33:0/4264343291 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d0ff10cf90 0x55d0ff117310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:02.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.392+0000 7fe1b9d9b640 1 -- 172.21.15.33:0/4264343291 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0ff10c670 msgr2=0x55d0ff10ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:30:02.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.392+0000 7fe1b9d9b640 1 --2- 172.21.15.33:0/4264343291 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0ff10c670 0x55d0ff10ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:02.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.392+0000 7fe1b9d9b640 1 -- 172.21.15.33:0/4264343291 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0feffe440 con 0x55d0ff117850 2024-09-12T12:30:02.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.393+0000 7fe1b9d9b640 1 --2- 172.21.15.33:0/4264343291 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0ff117850 0x55d0ff119c40 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000f4f0 tx=0x7fe1b000f9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=514968310f8a8b24 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:30:02.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.393+0000 7fe1a8ff9640 1 -- 172.21.15.33:0/4264343291 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b0004220 con 0x55d0ff117850 2024-09-12T12:30:02.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.393+0000 7fe1a8ff9640 1 -- 172.21.15.33:0/4264343291 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe1b00043c0 con 0x55d0ff117850 2024-09-12T12:30:02.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.394+0000 7fe1a8ff9640 1 -- 172.21.15.33:0/4264343291 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b0003d30 con 0x55d0ff117850 2024-09-12T12:30:02.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.394+0000 7fe1c2c1a740 1 -- 172.21.15.33:0/4264343291 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0ff117850 msgr2=0x55d0ff119c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:02.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.394+0000 7fe1c2c1a740 1 --2- 172.21.15.33:0/4264343291 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0ff117850 0x55d0ff119c40 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000f4f0 tx=0x7fe1b000f9b0 comp rx=0 tx=0).stop 2024-09-12T12:30:02.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.398+0000 7fe1bad9d640 1 --2- 172.21.15.33:0/1632529038 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe1a40a2d60 0x7fe1a40a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:02.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.398+0000 7fe1c2c1a740 1 -- 172.21.15.33:0/4264343291 shutdown_connections 2024-09-12T12:30:02.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.398+0000 7fe1c2c1a740 1 --2- 172.21.15.33:0/4264343291 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0ff117850 0x55d0ff119c40 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:02.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.398+0000 7fe1c2c1a740 1 --2- 172.21.15.33:0/4264343291 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d0ff10cf90 0x55d0ff117310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:02.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.398+0000 7fe1c2c1a740 1 --2- 172.21.15.33:0/4264343291 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0ff10c670 0x55d0ff10ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:02.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.398+0000 7fe1c2c1a740 1 -- 172.21.15.33:0/4264343291 >> 172.21.15.33:0/4264343291 conn(0x55d0ff108c00 msgr2=0x55d0ff108fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:30:02.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.401+0000 7fe1c2c1a740 1 -- 172.21.15.33:0/4264343291 shutdown_connections 2024-09-12T12:30:02.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.401+0000 7fe1c2c1a740 1 -- 172.21.15.33:0/4264343291 wait complete. 2024-09-12T12:30:02.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.401+0000 7fe1bad9d640 1 --2- 172.21.15.33:0/1632529038 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe1a40a2d60 0x7fe1a40a5220 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc08e930 tx=0x7fe1bc050650 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:30:02.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.401+0000 7fe1c2c1a740 1 -- start start 2024-09-12T12:30:02.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.402+0000 7fe1c2c1a740 1 Processor -- start 2024-09-12T12:30:02.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.402+0000 7fe1c2c1a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0ff10c670 0x55d0ff117020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:02.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.402+0000 7fe1c2c1a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0ff10cf90 0x55d0ff1142d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:02.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.402+0000 7fe1c2c1a740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d0ff117850 0x55d0ff114810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:02.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.402+0000 7fe1c2c1a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55d0ff11a4c0 con 0x55d0ff10cf90 2024-09-12T12:30:02.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.402+0000 7fe1c2c1a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d0ff02d050 con 0x55d0ff10c670 2024-09-12T12:30:02.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.402+0000 7fe1c2c1a740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d0ff11a640 con 0x55d0ff117850 2024-09-12T12:30:02.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.402+0000 7fe1c2c1a740 10 client.0 _ll_register_callbacks cb 0x55d0ff06d160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:30:02.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.403+0000 7fe1ba59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0ff10c670 0x55d0ff117020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:02.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.403+0000 7fe1ba59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0ff10c670 0x55d0ff117020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:56966/0 (socket says 172.21.15.33:56966) 2024-09-12T12:30:02.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.403+0000 7fe1ba59c640 1 -- 172.21.15.33:0/1986178222 learned_addr learned my addr 172.21.15.33:0/1986178222 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:30:02.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.403+0000 7fe1bad9d640 1 --2- 172.21.15.33:0/1986178222 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d0ff117850 0x55d0ff114810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:02.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.405+0000 7fe1b9d9b640 1 --2- 172.21.15.33:0/1986178222 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0ff10cf90 0x55d0ff1142d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:02.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.405+0000 7fe1bad9d640 1 -- 172.21.15.33:0/1986178222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0ff10c670 msgr2=0x55d0ff117020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:30:02.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.405+0000 7fe1bad9d640 1 --2- 172.21.15.33:0/1986178222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0ff10c670 0x55d0ff117020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:02.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.405+0000 7fe1bad9d640 1 -- 172.21.15.33:0/1986178222 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0ff10cf90 msgr2=0x55d0ff1142d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:30:02.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.405+0000 7fe1bad9d640 1 --2- 172.21.15.33:0/1986178222 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0ff10cf90 0x55d0ff1142d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:02.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.405+0000 7fe1bad9d640 1 -- 172.21.15.33:0/1986178222 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0fede33c0 con 0x55d0ff117850 2024-09-12T12:30:02.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.405+0000 7fe1bad9d640 1 --2- 172.21.15.33:0/1986178222 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d0ff117850 0x55d0ff114810 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc0637b0 tx=0x7fe1bc050ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa3a36ca7ee031d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:30:02.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.405+0000 7fe1a1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:30:02.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.406+0000 7fe1a1ffb640 1 -- 172.21.15.33:0/1986178222 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc062e40 con 0x55d0ff117850 2024-09-12T12:30:02.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.406+0000 7fe1c2c1a740 1 -- 172.21.15.33:0/1986178222 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1b00043c0 con 0x55d0ff117850 2024-09-12T12:30:02.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.406+0000 7fe1a1ffb640 1 -- 172.21.15.33:0/1986178222 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fe1bc06e6c0 con 0x55d0ff117850 2024-09-12T12:30:02.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.406+0000 7fe1a1ffb640 1 -- 172.21.15.33:0/1986178222 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe1bc06e8c0 con 0x55d0ff117850 2024-09-12T12:30:02.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.406+0000 7fe1c2c1a740 10 client.25456 fetch_fsmap learned FSMap version 27 2024-09-12T12:30:02.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.406+0000 7fe1c2c1a740 1 -- 172.21.15.33:0/1986178222 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d0ff125d80 con 0x55d0ff117850 2024-09-12T12:30:02.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.407+0000 7fe1a1ffb640 1 -- 172.21.15.33:0/1986178222 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe1b00043c0 con 0x55d0ff117850 2024-09-12T12:30:02.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.408+0000 7fe1a1ffb640 1 -- 172.21.15.33:0/1986178222 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fe1bc09f070 con 0x55d0ff117850 2024-09-12T12:30:02.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.408+0000 7fe1c2c1a740 10 client.25456 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:30:02.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.408+0000 7fe1c2c1a740 10 client.25456 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:30:02.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.408+0000 7fe1c2c1a740 20 client.25456 populate_metadata read hostname 'smithi033' 2024-09-12T12:30:02.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.408+0000 7fe1c2c1a740 1 --2- 172.21.15.33:0/1986178222 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55d0ff127680 0x55d0ff129b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:02.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.408+0000 7fe1c2c1a740 4 client.25456 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:30:02.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.408+0000 7fe1c2c1a740 1 -- 172.21.15.33:0/1986178222 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0ff07f850 con 0x55d0ff127680 2024-09-12T12:30:02.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.415+0000 7fe1ba59c640 1 --2- 172.21.15.33:0/1986178222 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55d0ff127680 0x55d0ff129b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:02.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.419+0000 7fe1ba59c640 1 --2- 172.21.15.33:0/1986178222 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55d0ff127680 0x55d0ff129b40 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7eccbb836b2448d2 server_cookie=13f7893c70c7f71f in_seq=0 out_seq=0 2024-09-12T12:30:02.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.419+0000 7fe1a1ffb640 10 client.25456 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:30:02.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.419+0000 7fe1a1ffb640 1 -- 172.21.15.33:0/1986178222 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d0ff07f850 con 0x55d0ff127680 2024-09-12T12:30:02.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.419+0000 7fe1a1ffb640 10 client.25456 handle_command_reply: tid=0 2024-09-12T12:30:02.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.420+0000 7fe1c2c1a740 1 client.25456 shutdown 2024-09-12T12:30:02.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.424+0000 7fe1c2c1a740 1 -- 172.21.15.33:0/1986178222 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d0ff117850 msgr2=0x55d0ff114810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:02.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.424+0000 7fe1c2c1a740 1 --2- 172.21.15.33:0/1986178222 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d0ff117850 0x55d0ff114810 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc0637b0 tx=0x7fe1bc050ea0 comp rx=0 tx=0).stop 2024-09-12T12:30:02.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.424+0000 7fe1c2c1a740 1 -- 172.21.15.33:0/1986178222 shutdown_connections 2024-09-12T12:30:02.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.424+0000 7fe1c2c1a740 1 --2- 172.21.15.33:0/1986178222 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55d0ff127680 0x55d0ff129b40 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:02.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.424+0000 7fe1c2c1a740 1 --2- 172.21.15.33:0/1986178222 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d0ff117850 0x55d0ff114810 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:02.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.424+0000 7fe1c2c1a740 1 --2- 172.21.15.33:0/1986178222 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0ff10cf90 0x55d0ff1142d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:02.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.424+0000 7fe1c2c1a740 1 --2- 172.21.15.33:0/1986178222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0ff10c670 0x55d0ff117020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:02.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.424+0000 7fe1c2c1a740 1 -- 172.21.15.33:0/1986178222 >> 172.21.15.33:0/1986178222 conn(0x55d0ff108c00 msgr2=0x55d0ff10e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:30:02.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.425+0000 7fe1a1ffb640 0 client.25456 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:30:02.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.426+0000 7fe1c2c1a740 1 -- 172.21.15.33:0/1986178222 shutdown_connections 2024-09-12T12:30:02.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.427+0000 7fe1c2c1a740 1 -- 172.21.15.33:0/1986178222 wait complete. 2024-09-12T12:30:02.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.427+0000 7fe1c2c1a740 20 client.25456 trim_cache size 0 max 16384 2024-09-12T12:30:02.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.462+0000 7fe1c2c1a740 1 Processor -- start 2024-09-12T12:30:02.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.462+0000 7fe1c2c1a740 1 -- start start 2024-09-12T12:30:02.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.462+0000 7fe1c2c1a740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d0ff10c670 0x55d0ff116240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:02.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.462+0000 7fe1c2c1a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0ff10cf90 0x55d0ff12f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:02.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.462+0000 7fe1c2c1a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0ff117850 0x55d0ff12f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:02.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.462+0000 7fe1c2c1a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe19c0123f0 con 0x55d0ff117850 2024-09-12T12:30:02.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.462+0000 7fe1c2c1a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe19c00fcc0 con 0x55d0ff10cf90 2024-09-12T12:30:02.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.462+0000 7fe1c2c1a740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe19c00dbc0 con 0x55d0ff10c670 2024-09-12T12:30:02.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.462+0000 7fe1ba59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d0ff10c670 0x55d0ff116240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:02.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.462+0000 7fe1b9d9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0ff10cf90 0x55d0ff12f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:02.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.462+0000 7fe1ba59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d0ff10c670 0x55d0ff116240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:36434/0 (socket says 172.21.15.33:36434) 2024-09-12T12:30:02.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.462+0000 7fe1ba59c640 1 -- 172.21.15.33:0/2462198934 learned_addr learned my addr 172.21.15.33:0/2462198934 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:30:02.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.463+0000 7fe1bad9d640 1 --2- 172.21.15.33:0/2462198934 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0ff117850 0x55d0ff12f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:02.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.463+0000 7fe1b9d9b640 1 -- 172.21.15.33:0/2462198934 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d0ff10c670 msgr2=0x55d0ff116240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:30:02.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.463+0000 7fe1b9d9b640 1 --2- 172.21.15.33:0/2462198934 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d0ff10c670 0x55d0ff116240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:02.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.463+0000 7fe1b9d9b640 1 -- 172.21.15.33:0/2462198934 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0ff117850 msgr2=0x55d0ff12f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:30:02.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.463+0000 7fe1b9d9b640 1 --2- 172.21.15.33:0/2462198934 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0ff117850 0x55d0ff12f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:02.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.463+0000 7fe1b9d9b640 1 -- 172.21.15.33:0/2462198934 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0ff113280 con 0x55d0ff10cf90 2024-09-12T12:30:02.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.463+0000 7fe1b9d9b640 1 --2- 172.21.15.33:0/2462198934 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0ff10cf90 0x55d0ff12f450 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0000c00 tx=0x7fe1b000ac00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4cf348dabcfa52 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:30:02.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.463+0000 7fe1a3fff640 1 -- 172.21.15.33:0/2462198934 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b0026070 con 0x55d0ff10cf90 2024-09-12T12:30:02.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.464+0000 7fe1a3fff640 1 -- 172.21.15.33:0/2462198934 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe1b0010760 con 0x55d0ff10cf90 2024-09-12T12:30:02.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.464+0000 7fe1a3fff640 1 -- 172.21.15.33:0/2462198934 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b0003890 con 0x55d0ff10cf90 2024-09-12T12:30:02.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.465+0000 7fe1c2c1a740 1 -- 172.21.15.33:0/2462198934 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0ff10cf90 msgr2=0x55d0ff12f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:02.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.465+0000 7fe1c2c1a740 1 --2- 172.21.15.33:0/2462198934 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0ff10cf90 0x55d0ff12f450 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0000c00 tx=0x7fe1b000ac00 comp rx=0 tx=0).stop 2024-09-12T12:30:02.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.465+0000 7fe1c2c1a740 1 -- 172.21.15.33:0/2462198934 shutdown_connections 2024-09-12T12:30:02.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.465+0000 7fe1c2c1a740 1 --2- 172.21.15.33:0/2462198934 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0ff117850 0x55d0ff12f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:02.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.465+0000 7fe1c2c1a740 1 --2- 172.21.15.33:0/2462198934 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0ff10cf90 0x55d0ff12f450 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:02.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.465+0000 7fe1c2c1a740 1 --2- 172.21.15.33:0/2462198934 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d0ff10c670 0x55d0ff116240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:02.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.465+0000 7fe1c2c1a740 1 -- 172.21.15.33:0/2462198934 >> 172.21.15.33:0/2462198934 conn(0x55d0ff108c00 msgr2=0x55d0ff115b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:30:02.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.468+0000 7fe1c2c1a740 1 -- 172.21.15.33:0/2462198934 shutdown_connections 2024-09-12T12:30:02.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.469+0000 7fe1c2c1a740 1 -- 172.21.15.33:0/2462198934 wait complete. 2024-09-12T12:30:02.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.469+0000 7fe1c2c1a740 1 -- start start 2024-09-12T12:30:02.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.469+0000 7fe1c2c1a740 1 Processor -- start 2024-09-12T12:30:02.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.470+0000 7fe1c2c1a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0ff10c670 0x55d0ff10ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:02.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.470+0000 7fe1c2c1a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0ff10cf90 0x55d0ff10f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:02.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.470+0000 7fe1c2c1a740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d0ff117850 0x55d0ff10f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:02.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.470+0000 7fe1c2c1a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe19c00e180 con 0x55d0ff10c670 2024-09-12T12:30:02.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.470+0000 7fe1c2c1a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe19c00f5f0 con 0x55d0ff10cf90 2024-09-12T12:30:02.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.470+0000 7fe1c2c1a740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe19c00e850 con 0x55d0ff117850 2024-09-12T12:30:02.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.470+0000 7fe1c2c1a740 10 client.0 _ll_register_callbacks cb 0x7fe1bc050f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:30:02.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.470+0000 7fe1bad9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d0ff117850 0x55d0ff10f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:02.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.470+0000 7fe1bad9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d0ff117850 0x55d0ff10f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:36448/0 (socket says 172.21.15.33:36448) 2024-09-12T12:30:02.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.470+0000 7fe1bad9d640 1 -- 172.21.15.33:0/2694797443 learned_addr learned my addr 172.21.15.33:0/2694797443 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:30:02.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.470+0000 7fe1b9d9b640 1 --2- 172.21.15.33:0/2694797443 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0ff10cf90 0x55d0ff10f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:02.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.470+0000 7fe1bad9d640 1 -- 172.21.15.33:0/2694797443 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0ff10cf90 msgr2=0x55d0ff10f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:30:02.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.470+0000 7fe1bad9d640 1 --2- 172.21.15.33:0/2694797443 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0ff10cf90 0x55d0ff10f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:02.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.470+0000 7fe1bad9d640 1 -- 172.21.15.33:0/2694797443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0ff10c670 msgr2=0x55d0ff10ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:30:02.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.470+0000 7fe1bad9d640 1 --2- 172.21.15.33:0/2694797443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0ff10c670 0x55d0ff10ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:02.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.470+0000 7fe1bad9d640 1 -- 172.21.15.33:0/2694797443 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0ff191420 con 0x55d0ff117850 2024-09-12T12:30:02.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.471+0000 7fe1bad9d640 1 --2- 172.21.15.33:0/2694797443 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d0ff117850 0x55d0ff10f810 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc067bf0 tx=0x7fe1bc08ea50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15f247bcd2becbcc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:30:02.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.471+0000 7fe1a1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:30:02.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.471+0000 7fe1a1ffb640 1 -- 172.21.15.33:0/2694797443 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc06ec70 con 0x55d0ff117850 2024-09-12T12:30:02.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.471+0000 7fe1c2c1a740 1 -- 172.21.15.33:0/2694797443 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1b0010760 con 0x55d0ff117850 2024-09-12T12:30:02.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.471+0000 7fe1a1ffb640 1 -- 172.21.15.33:0/2694797443 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fe1bc06ee10 con 0x55d0ff117850 2024-09-12T12:30:02.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.471+0000 7fe1a1ffb640 1 -- 172.21.15.33:0/2694797443 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe1bc0a1410 con 0x55d0ff117850 2024-09-12T12:30:02.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.471+0000 7fe1c2c1a740 10 client.25462 fetch_fsmap learned FSMap version 27 2024-09-12T12:30:02.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.471+0000 7fe1c2c1a740 1 -- 172.21.15.33:0/2694797443 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d0ff192630 con 0x55d0ff117850 2024-09-12T12:30:02.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.472+0000 7fe1a1ffb640 1 -- 172.21.15.33:0/2694797443 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe1b0010760 con 0x55d0ff117850 2024-09-12T12:30:02.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.472+0000 7fe1a1ffb640 1 -- 172.21.15.33:0/2694797443 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fe1bc09f040 con 0x55d0ff117850 2024-09-12T12:30:02.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.472+0000 7fe1c2c1a740 10 client.25462 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:30:02.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.472+0000 7fe1c2c1a740 10 client.25462 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:30:02.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.472+0000 7fe1c2c1a740 20 client.25462 populate_metadata read hostname 'smithi033' 2024-09-12T12:30:02.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.472+0000 7fe1c2c1a740 1 --2- 172.21.15.33:0/2694797443 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55d0ff192cf0 0x55d0ff195130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:02.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.472+0000 7fe1c2c1a740 4 client.25462 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:30:02.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.472+0000 7fe1c2c1a740 1 -- 172.21.15.33:0/2694797443 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d0ff079d60 con 0x55d0ff192cf0 2024-09-12T12:30:02.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.475+0000 7fe1ba59c640 1 --2- 172.21.15.33:0/2694797443 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55d0ff192cf0 0x55d0ff195130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:02.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.476+0000 7fe1ba59c640 1 --2- 172.21.15.33:0/2694797443 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55d0ff192cf0 0x55d0ff195130 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e3807d1283440c6 server_cookie=c6b99e78edc3164f in_seq=0 out_seq=0 2024-09-12T12:30:02.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.476+0000 7fe1a1ffb640 10 client.25462 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:30:02.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.479+0000 7fe1a1ffb640 1 -- 172.21.15.33:0/2694797443 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55d0ff079d60 con 0x55d0ff192cf0 2024-09-12T12:30:02.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.479+0000 7fe1a1ffb640 10 client.25462 handle_command_reply: tid=0 2024-09-12T12:30:02.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.479+0000 7fe1c2c1a740 1 client.25462 shutdown 2024-09-12T12:30:02.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.481+0000 7fe1c2c1a740 1 -- 172.21.15.33:0/2694797443 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d0ff117850 msgr2=0x55d0ff10f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:02.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.482+0000 7fe1c2c1a740 1 --2- 172.21.15.33:0/2694797443 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d0ff117850 0x55d0ff10f810 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc067bf0 tx=0x7fe1bc08ea50 comp rx=0 tx=0).stop 2024-09-12T12:30:02.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.482+0000 7fe1c2c1a740 1 -- 172.21.15.33:0/2694797443 shutdown_connections 2024-09-12T12:30:02.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.482+0000 7fe1c2c1a740 1 --2- 172.21.15.33:0/2694797443 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55d0ff192cf0 0x55d0ff195130 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:02.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.482+0000 7fe1c2c1a740 1 --2- 172.21.15.33:0/2694797443 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d0ff117850 0x55d0ff10f810 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:02.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.482+0000 7fe1c2c1a740 1 --2- 172.21.15.33:0/2694797443 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0ff10cf90 0x55d0ff10f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:02.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.482+0000 7fe1c2c1a740 1 --2- 172.21.15.33:0/2694797443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0ff10c670 0x55d0ff10ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:02.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.482+0000 7fe1c2c1a740 1 -- 172.21.15.33:0/2694797443 >> 172.21.15.33:0/2694797443 conn(0x55d0ff108c00 msgr2=0x55d0ff107d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:30:02.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.483+0000 7fe1a1ffb640 0 client.25462 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:30:02.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.483+0000 7fe1c2c1a740 1 -- 172.21.15.33:0/2694797443 shutdown_connections 2024-09-12T12:30:02.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.483+0000 7fe1c2c1a740 1 -- 172.21.15.33:0/2694797443 wait complete. 2024-09-12T12:30:02.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.483+0000 7fe1c2c1a740 20 client.25462 trim_cache size 0 max 16384 2024-09-12T12:30:02.485 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:30:02.485 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T12:30:02.485 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": { 2024-09-12T12:30:02.485 INFO:teuthology.orchestra.run.smithi033.stdout: "00e67ac7-4707-4528-ae83-06be16a11bb5": { 2024-09-12T12:30:02.485 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-09-12T12:30:02.485 INFO:teuthology.orchestra.run.smithi033.stdout: "tag": "00e67ac7-4707-4528-ae83-06be16a11bb5", 2024-09-12T12:30:02.485 INFO:teuthology.orchestra.run.smithi033.stdout: "options": "recursive,force" 2024-09-12T12:30:02.485 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:30:02.485 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:30:02.485 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:30:02.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.486+0000 7fe1bb59e640 1 -- 172.21.15.33:0/1632529038 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe1a40a2d60 msgr2=0x7fe1a40a5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:02.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.486+0000 7fe1bb59e640 1 --2- 172.21.15.33:0/1632529038 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe1a40a2d60 0x7fe1a40a5220 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc08e930 tx=0x7fe1bc050650 comp rx=0 tx=0).stop 2024-09-12T12:30:02.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.486+0000 7fe1bb59e640 1 -- 172.21.15.33:0/1632529038 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1b40a4a50 msgr2=0x7fe1b40beba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:02.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.486+0000 7fe1bb59e640 1 --2- 172.21.15.33:0/1632529038 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1b40a4a50 0x7fe1b40beba0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac00b3f0 tx=0x7fe1ac00b8b0 comp rx=0 tx=0).stop 2024-09-12T12:30:02.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.488+0000 7fe1bb59e640 1 -- 172.21.15.33:0/1632529038 shutdown_connections 2024-09-12T12:30:02.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.488+0000 7fe1bb59e640 1 --2- 172.21.15.33:0/1632529038 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe1a40a2d60 0x7fe1a40a5220 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:02.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.488+0000 7fe1bb59e640 1 --2- 172.21.15.33:0/1632529038 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1b40b2dc0 0x7fe1b40b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:02.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.488+0000 7fe1bb59e640 1 --2- 172.21.15.33:0/1632529038 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1b40a5370 0x7fe1b40b1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:02.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.488+0000 7fe1bb59e640 1 --2- 172.21.15.33:0/1632529038 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1b40a4a50 0x7fe1b40beba0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:02.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.488+0000 7fe1bb59e640 1 -- 172.21.15.33:0/1632529038 >> 172.21.15.33:0/1632529038 conn(0x7fe1b401a0a0 msgr2=0x7fe1b40b32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:30:02.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.488+0000 7fe1bb59e640 1 -- 172.21.15.33:0/1632529038 shutdown_connections 2024-09-12T12:30:02.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:02.489+0000 7fe1bb59e640 1 -- 172.21.15.33:0/1632529038 wait complete. 2024-09-12T12:30:03.414 INFO:tasks.cephfs.filesystem:scrub status for tag:00e67ac7-4707-4528-ae83-06be16a11bb5 - {'path': '/', 'tag': '00e67ac7-4707-4528-ae83-06be16a11bb5', 'options': 'recursive,force'} 2024-09-12T12:30:03.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:30:03 smithi043 ceph-mon[34144]: pgmap v471: 129 pgs: 129 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 48 MiB/s wr, 778 op/s 2024-09-12T12:30:03.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:30:03 smithi102 ceph-mon[34799]: pgmap v471: 129 pgs: 129 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 48 MiB/s wr, 778 op/s 2024-09-12T12:30:03.730 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:30:03 smithi033 ceph-mon[31246]: pgmap v471: 129 pgs: 129 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 48 MiB/s wr, 778 op/s 2024-09-12T12:30:05.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:30:05 smithi043 ceph-mon[34144]: pgmap v472: 129 pgs: 129 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 51 MiB/s wr, 820 op/s 2024-09-12T12:30:05.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:30:05 smithi102 ceph-mon[34799]: pgmap v472: 129 pgs: 129 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 51 MiB/s wr, 820 op/s 2024-09-12T12:30:05.730 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:30:05 smithi033 ceph-mon[31246]: pgmap v472: 129 pgs: 129 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 51 MiB/s wr, 820 op/s 2024-09-12T12:30:07.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:30:07 smithi043 ceph-mon[34144]: pgmap v473: 129 pgs: 129 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 43 MiB/s wr, 697 op/s 2024-09-12T12:30:07.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:30:07 smithi102 ceph-mon[34799]: pgmap v473: 129 pgs: 129 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 43 MiB/s wr, 697 op/s 2024-09-12T12:30:07.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:30:07 smithi033 ceph-mon[31246]: pgmap v473: 129 pgs: 129 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 43 MiB/s wr, 697 op/s 2024-09-12T12:30:08.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:30:08 smithi043 ceph-mon[34144]: scrub summary: idle 2024-09-12T12:30:08.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:30:08 smithi043 ceph-mon[34144]: scrub summary: idle 2024-09-12T12:30:08.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:30:08 smithi102 ceph-mon[34799]: scrub summary: idle 2024-09-12T12:30:08.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:30:08 smithi102 ceph-mon[34799]: scrub summary: idle 2024-09-12T12:30:08.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:30:08 smithi033 ceph-mon[31246]: scrub summary: idle 2024-09-12T12:30:08.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:30:08 smithi033 ceph-mon[31246]: scrub summary: idle 2024-09-12T12:30:09.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:30:09 smithi043 ceph-mon[34144]: pgmap v474: 129 pgs: 129 active+clean; 10 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 56 MiB/s wr, 901 op/s 2024-09-12T12:30:09.632 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:30:09 smithi033 ceph-mon[31246]: pgmap v474: 129 pgs: 129 active+clean; 10 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 56 MiB/s wr, 901 op/s 2024-09-12T12:30:09.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:30:09 smithi102 ceph-mon[34799]: pgmap v474: 129 pgs: 129 active+clean; 10 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 56 MiB/s wr, 901 op/s 2024-09-12T12:30:11.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:30:11 smithi043 ceph-mon[34144]: pgmap v475: 129 pgs: 129 active+clean; 10 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 45 MiB/s wr, 722 op/s 2024-09-12T12:30:11.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:30:11 smithi102 ceph-mon[34799]: pgmap v475: 129 pgs: 129 active+clean; 10 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 45 MiB/s wr, 722 op/s 2024-09-12T12:30:11.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:30:11 smithi033 ceph-mon[31246]: pgmap v475: 129 pgs: 129 active+clean; 10 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 45 MiB/s wr, 722 op/s 2024-09-12T12:30:13.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:30:13 smithi043 ceph-mon[34144]: pgmap v476: 129 pgs: 129 active+clean; 10 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 48 MiB/s wr, 769 op/s 2024-09-12T12:30:13.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:30:13 smithi102 ceph-mon[34799]: pgmap v476: 129 pgs: 129 active+clean; 10 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 48 MiB/s wr, 769 op/s 2024-09-12T12:30:13.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:30:13 smithi033 ceph-mon[31246]: pgmap v476: 129 pgs: 129 active+clean; 10 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 48 MiB/s wr, 769 op/s 2024-09-12T12:30:15.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:30:15 smithi043 ceph-mon[34144]: pgmap v477: 129 pgs: 129 active+clean; 10 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 51 MiB/s wr, 819 op/s 2024-09-12T12:30:15.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:30:15 smithi102 ceph-mon[34799]: pgmap v477: 129 pgs: 129 active+clean; 10 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 51 MiB/s wr, 819 op/s 2024-09-12T12:30:15.730 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:30:15 smithi033 ceph-mon[31246]: pgmap v477: 129 pgs: 129 active+clean; 10 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 51 MiB/s wr, 819 op/s 2024-09-12T12:30:17.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:30:17 smithi043 ceph-mon[34144]: pgmap v478: 129 pgs: 129 active+clean; 10 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 44 MiB/s wr, 699 op/s 2024-09-12T12:30:17.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:30:17 smithi102 ceph-mon[34799]: pgmap v478: 129 pgs: 129 active+clean; 10 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 44 MiB/s wr, 699 op/s 2024-09-12T12:30:17.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:30:17 smithi033 ceph-mon[31246]: pgmap v478: 129 pgs: 129 active+clean; 10 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 44 MiB/s wr, 699 op/s 2024-09-12T12:30:19.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:30:19 smithi043 ceph-mon[34144]: pgmap v479: 129 pgs: 129 active+clean; 10 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 57 MiB/s wr, 908 op/s 2024-09-12T12:30:19.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:30:19 smithi102 ceph-mon[34799]: pgmap v479: 129 pgs: 129 active+clean; 10 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 57 MiB/s wr, 908 op/s 2024-09-12T12:30:19.730 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:30:19 smithi033 ceph-mon[31246]: pgmap v479: 129 pgs: 129 active+clean; 10 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 57 MiB/s wr, 908 op/s 2024-09-12T12:30:21.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:30:21 smithi043 ceph-mon[34144]: pgmap v480: 129 pgs: 129 active+clean; 10 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 46 MiB/s wr, 733 op/s 2024-09-12T12:30:21.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:30:21 smithi102 ceph-mon[34799]: pgmap v480: 129 pgs: 129 active+clean; 10 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 46 MiB/s wr, 733 op/s 2024-09-12T12:30:21.730 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:30:21 smithi033 ceph-mon[31246]: pgmap v480: 129 pgs: 129 active+clean; 10 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 46 MiB/s wr, 733 op/s 2024-09-12T12:30:23.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:30:23 smithi043 ceph-mon[34144]: pgmap v481: 129 pgs: 129 active+clean; 10 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 48 MiB/s wr, 771 op/s 2024-09-12T12:30:23.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:30:23 smithi102 ceph-mon[34799]: pgmap v481: 129 pgs: 129 active+clean; 10 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 48 MiB/s wr, 771 op/s 2024-09-12T12:30:23.730 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:30:23 smithi033 ceph-mon[31246]: pgmap v481: 129 pgs: 129 active+clean; 10 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 48 MiB/s wr, 771 op/s 2024-09-12T12:30:25.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:30:25 smithi043 ceph-mon[34144]: pgmap v482: 129 pgs: 129 active+clean; 10 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 50 MiB/s wr, 811 op/s 2024-09-12T12:30:25.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:30:25 smithi102 ceph-mon[34799]: pgmap v482: 129 pgs: 129 active+clean; 10 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 50 MiB/s wr, 811 op/s 2024-09-12T12:30:25.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:30:25 smithi033 ceph-mon[31246]: pgmap v482: 129 pgs: 129 active+clean; 10 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 50 MiB/s wr, 811 op/s 2024-09-12T12:30:27.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:30:27 smithi043 ceph-mon[34144]: pgmap v483: 129 pgs: 129 active+clean; 10 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 43 MiB/s wr, 689 op/s 2024-09-12T12:30:27.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:30:27 smithi102 ceph-mon[34799]: pgmap v483: 129 pgs: 129 active+clean; 10 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 43 MiB/s wr, 689 op/s 2024-09-12T12:30:27.730 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:30:27 smithi033 ceph-mon[31246]: pgmap v483: 129 pgs: 129 active+clean; 10 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 43 MiB/s wr, 689 op/s 2024-09-12T12:30:29.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:30:29 smithi043 ceph-mon[34144]: pgmap v484: 129 pgs: 129 active+clean; 10 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 56 MiB/s wr, 898 op/s 2024-09-12T12:30:29.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:30:29 smithi102 ceph-mon[34799]: pgmap v484: 129 pgs: 129 active+clean; 10 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 56 MiB/s wr, 898 op/s 2024-09-12T12:30:29.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:30:29 smithi033 ceph-mon[31246]: pgmap v484: 129 pgs: 129 active+clean; 10 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 56 MiB/s wr, 898 op/s 2024-09-12T12:30:31.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:30:31 smithi043 ceph-mon[34144]: pgmap v485: 129 pgs: 129 active+clean; 10 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 45 MiB/s wr, 718 op/s 2024-09-12T12:30:31.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:30:31 smithi102 ceph-mon[34799]: pgmap v485: 129 pgs: 129 active+clean; 10 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 45 MiB/s wr, 718 op/s 2024-09-12T12:30:31.730 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:30:31 smithi033 ceph-mon[31246]: pgmap v485: 129 pgs: 129 active+clean; 10 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 45 MiB/s wr, 718 op/s 2024-09-12T12:30:33.415 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T12:30:33.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:30:33 smithi043 ceph-mon[34144]: pgmap v486: 129 pgs: 129 active+clean; 10 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 47 MiB/s wr, 758 op/s 2024-09-12T12:30:33.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:30:33 smithi102 ceph-mon[34799]: pgmap v486: 129 pgs: 129 active+clean; 10 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 47 MiB/s wr, 758 op/s 2024-09-12T12:30:33.730 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:30:33 smithi033 ceph-mon[31246]: pgmap v486: 129 pgs: 129 active+clean; 10 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 47 MiB/s wr, 758 op/s 2024-09-12T12:30:34.736 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:30:35.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:30:35 smithi033 ceph-mon[31246]: pgmap v487: 129 pgs: 129 active+clean; 10 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 50 MiB/s wr, 805 op/s 2024-09-12T12:30:35.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:30:35 smithi043 ceph-mon[34144]: pgmap v487: 129 pgs: 129 active+clean; 10 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 50 MiB/s wr, 805 op/s 2024-09-12T12:30:35.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:30:35 smithi102 ceph-mon[34799]: pgmap v487: 129 pgs: 129 active+clean; 10 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 50 MiB/s wr, 805 op/s 2024-09-12T12:30:37.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.042+0000 7fc7b0b3b640 1 -- 172.21.15.33:0/2037145845 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7ac114ab0 msgr2=0x7fc7ac116ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:37.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.042+0000 7fc7b0b3b640 1 --2- 172.21.15.33:0/2037145845 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7ac114ab0 0x7fc7ac116ea0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4009ca0 tx=0x7fc7a402a950 comp rx=0 tx=0).stop 2024-09-12T12:30:37.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.046+0000 7fc7b0b3b640 1 -- 172.21.15.33:0/2037145845 shutdown_connections 2024-09-12T12:30:37.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.046+0000 7fc7b0b3b640 1 --2- 172.21.15.33:0/2037145845 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7ac114ab0 0x7fc7ac116ea0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:37.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.046+0000 7fc7b0b3b640 1 --2- 172.21.15.33:0/2037145845 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7ac109b10 0x7fc7ac114570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:37.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.046+0000 7fc7b0b3b640 1 --2- 172.21.15.33:0/2037145845 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7ac1091f0 0x7fc7ac1095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:37.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.046+0000 7fc7b0b3b640 1 -- 172.21.15.33:0/2037145845 >> 172.21.15.33:0/2037145845 conn(0x7fc7ac06e140 msgr2=0x7fc7ac06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:30:37.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.047+0000 7fc7b0b3b640 1 -- 172.21.15.33:0/2037145845 shutdown_connections 2024-09-12T12:30:37.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.047+0000 7fc7b0b3b640 1 -- 172.21.15.33:0/2037145845 wait complete. 2024-09-12T12:30:37.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.048+0000 7fc7b0b3b640 1 Processor -- start 2024-09-12T12:30:37.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.048+0000 7fc7b0b3b640 1 -- start start 2024-09-12T12:30:37.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.048+0000 7fc7b0b3b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7ac1091f0 0x7fc7ac113f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:37.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.048+0000 7fc7b0b3b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7ac109b10 0x7fc7ac1144d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:37.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.048+0000 7fc7b0b3b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7ac114ab0 0x7fc7ac10b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:37.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.048+0000 7fc7b0b3b640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ac11a630 con 0x7fc7ac1091f0 2024-09-12T12:30:37.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.048+0000 7fc7b0b3b640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ac11a4b0 con 0x7fc7ac114ab0 2024-09-12T12:30:37.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.048+0000 7fc7b0b3b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ac11a7b0 con 0x7fc7ac109b10 2024-09-12T12:30:37.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.049+0000 7fc7aa59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7ac1091f0 0x7fc7ac113f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:37.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.049+0000 7fc7aa59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7ac1091f0 0x7fc7ac113f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49104/0 (socket says 172.21.15.33:49104) 2024-09-12T12:30:37.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.049+0000 7fc7aa59c640 1 -- 172.21.15.33:0/2272655265 learned_addr learned my addr 172.21.15.33:0/2272655265 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:30:37.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.049+0000 7fc7aa59c640 1 -- 172.21.15.33:0/2272655265 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7ac109b10 msgr2=0x7fc7ac1144d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T12:30:37.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.049+0000 7fc7aa59c640 1 --2- 172.21.15.33:0/2272655265 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7ac109b10 0x7fc7ac1144d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:37.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.049+0000 7fc7aa59c640 1 -- 172.21.15.33:0/2272655265 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7ac114ab0 msgr2=0x7fc7ac10b070 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T12:30:37.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.049+0000 7fc7aa59c640 1 --2- 172.21.15.33:0/2272655265 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7ac114ab0 0x7fc7ac10b070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:37.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.049+0000 7fc7aa59c640 1 -- 172.21.15.33:0/2272655265 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7ac10b930 con 0x7fc7ac1091f0 2024-09-12T12:30:37.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.050+0000 7fc7aa59c640 1 --2- 172.21.15.33:0/2272655265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7ac1091f0 0x7fc7ac113f90 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc79c00e9f0 tx=0x7fc79c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:30:37.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.050+0000 7fc79b7fe640 1 -- 172.21.15.33:0/2272655265 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79c00cd80 con 0x7fc7ac1091f0 2024-09-12T12:30:37.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.052+0000 7fc7b0b3b640 1 -- 172.21.15.33:0/2272655265 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7ac10bc20 con 0x7fc7ac1091f0 2024-09-12T12:30:37.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.052+0000 7fc7b0b3b640 1 -- 172.21.15.33:0/2272655265 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7ac10fc00 con 0x7fc7ac1091f0 2024-09-12T12:30:37.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.055+0000 7fc79b7fe640 1 -- 172.21.15.33:0/2272655265 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc79c0054d0 con 0x7fc7ac1091f0 2024-09-12T12:30:37.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.055+0000 7fc79b7fe640 1 -- 172.21.15.33:0/2272655265 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79c010430 con 0x7fc7ac1091f0 2024-09-12T12:30:37.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.057+0000 7fc7b2f14740 1 Processor -- start 2024-09-12T12:30:37.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.057+0000 7fc7b2f14740 1 -- start start 2024-09-12T12:30:37.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.057+0000 7fc7b2f14740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572bdb734a0 0x5572bdb73880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:37.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.058+0000 7fc7b2f14740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5572bdb73dc0 0x5572bdb7e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:37.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.058+0000 7fc7b2f14740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572bdb7e680 0x5572bdb80a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:37.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.058+0000 7fc7b2f14740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5572bdad92e0 con 0x5572bdb7e680 2024-09-12T12:30:37.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.058+0000 7fc7b2f14740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5572bda80ce0 con 0x5572bdb73dc0 2024-09-12T12:30:37.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.058+0000 7fc7b2f14740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5572bdad52a0 con 0x5572bdb734a0 2024-09-12T12:30:37.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.059+0000 7fc7aad9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572bdb734a0 0x5572bdb73880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:37.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.060+0000 7fc7a9d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572bdb7e680 0x5572bdb80a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:37.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.060+0000 7fc7a9d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572bdb7e680 0x5572bdb80a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49106/0 (socket says 172.21.15.33:49106) 2024-09-12T12:30:37.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.060+0000 7fc7a9d9b640 1 -- 172.21.15.33:0/1955003533 learned_addr learned my addr 172.21.15.33:0/1955003533 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:30:37.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.061+0000 7fc7aad9d640 1 -- 172.21.15.33:0/1955003533 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5572bdb73dc0 msgr2=0x5572bdb7e140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T12:30:37.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.061+0000 7fc7aad9d640 1 --2- 172.21.15.33:0/1955003533 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5572bdb73dc0 0x5572bdb7e140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:37.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.061+0000 7fc7aad9d640 1 -- 172.21.15.33:0/1955003533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572bdb7e680 msgr2=0x5572bdb80a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:30:37.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.061+0000 7fc7aad9d640 1 --2- 172.21.15.33:0/1955003533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572bdb7e680 0x5572bdb80a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:37.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.061+0000 7fc7aad9d640 1 -- 172.21.15.33:0/1955003533 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572bda65440 con 0x5572bdb734a0 2024-09-12T12:30:37.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.062+0000 7fc7aad9d640 1 --2- 172.21.15.33:0/1955003533 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572bdb734a0 0x5572bdb73880 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4009bf0 tx=0x7fc7a4009a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=483f5b6b4e197ea2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:30:37.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.062+0000 7fc798ff9640 1 -- 172.21.15.33:0/1955003533 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a4034040 con 0x5572bdb734a0 2024-09-12T12:30:37.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.062+0000 7fc798ff9640 1 -- 172.21.15.33:0/1955003533 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc7a4003e20 con 0x5572bdb734a0 2024-09-12T12:30:37.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.062+0000 7fc798ff9640 1 -- 172.21.15.33:0/1955003533 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a40042a0 con 0x5572bdb734a0 2024-09-12T12:30:37.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.064+0000 7fc7b2f14740 1 -- 172.21.15.33:0/1955003533 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572bdb734a0 msgr2=0x5572bdb73880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:37.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.064+0000 7fc7b2f14740 1 --2- 172.21.15.33:0/1955003533 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572bdb734a0 0x5572bdb73880 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4009bf0 tx=0x7fc7a4009a20 comp rx=0 tx=0).stop 2024-09-12T12:30:37.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.065+0000 7fc79b7fe640 1 -- 172.21.15.33:0/2272655265 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc79c0046c0 con 0x7fc7ac1091f0 2024-09-12T12:30:37.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.065+0000 7fc7b2f14740 1 -- 172.21.15.33:0/1955003533 shutdown_connections 2024-09-12T12:30:37.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.065+0000 7fc7b2f14740 1 --2- 172.21.15.33:0/1955003533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572bdb7e680 0x5572bdb80a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:37.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.065+0000 7fc7b2f14740 1 --2- 172.21.15.33:0/1955003533 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5572bdb73dc0 0x5572bdb7e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:37.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.065+0000 7fc7b2f14740 1 --2- 172.21.15.33:0/1955003533 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572bdb734a0 0x5572bdb73880 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:37.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.065+0000 7fc7b2f14740 1 -- 172.21.15.33:0/1955003533 >> 172.21.15.33:0/1955003533 conn(0x5572bdb6fa30 msgr2=0x5572bdb6fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:30:37.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.065+0000 7fc7b2f14740 1 -- 172.21.15.33:0/1955003533 shutdown_connections 2024-09-12T12:30:37.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.066+0000 7fc7b2f14740 1 -- 172.21.15.33:0/1955003533 wait complete. 2024-09-12T12:30:37.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.066+0000 7fc79b7fe640 1 --2- 172.21.15.33:0/2272655265 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc7940a2b50 0x7fc7940a5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:37.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.066+0000 7fc79b7fe640 1 -- 172.21.15.33:0/2272655265 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fc79c0cf830 con 0x7fc7ac1091f0 2024-09-12T12:30:37.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.066+0000 7fc7b2f14740 1 -- start start 2024-09-12T12:30:37.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.067+0000 7fc7b2f14740 1 Processor -- start 2024-09-12T12:30:37.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.067+0000 7fc7b2f14740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572bdb734a0 0x5572bdb7dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:37.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.067+0000 7fc7b2f14740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5572bdb73dc0 0x5572bdb7b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:37.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.067+0000 7fc7b2f14740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572bdb7e680 0x5572bdb7b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:37.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.067+0000 7fc7b2f14740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5572bdb81250 con 0x5572bdb734a0 2024-09-12T12:30:37.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.067+0000 7fc7b2f14740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5572bda94050 con 0x5572bdb73dc0 2024-09-12T12:30:37.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.067+0000 7fc7b2f14740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5572bdb813d0 con 0x5572bdb7e680 2024-09-12T12:30:37.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.067+0000 7fc7b2f14740 10 client.0 _ll_register_callbacks cb 0x5572bdad4160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:30:37.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.068+0000 7fc7aad9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572bdb7e680 0x5572bdb7b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:37.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.068+0000 7fc7aad9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572bdb7e680 0x5572bdb7b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:33180/0 (socket says 172.21.15.33:33180) 2024-09-12T12:30:37.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.068+0000 7fc7aad9d640 1 -- 172.21.15.33:0/3603627761 learned_addr learned my addr 172.21.15.33:0/3603627761 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:30:37.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.069+0000 7fc7aad9d640 1 -- 172.21.15.33:0/3603627761 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5572bdb73dc0 msgr2=0x5572bdb7b190 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:30:37.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.069+0000 7fc7aad9d640 1 --2- 172.21.15.33:0/3603627761 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5572bdb73dc0 0x5572bdb7b190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:37.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.069+0000 7fc7aad9d640 1 -- 172.21.15.33:0/3603627761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572bdb734a0 msgr2=0x5572bdb7dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:30:37.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.069+0000 7fc7aad9d640 1 --2- 172.21.15.33:0/3603627761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572bdb734a0 0x5572bdb7dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:37.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.069+0000 7fc7aad9d640 1 -- 172.21.15.33:0/3603627761 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572bd84a3c0 con 0x5572bdb7e680 2024-09-12T12:30:37.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.070+0000 7fc7aad9d640 1 --2- 172.21.15.33:0/3603627761 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572bdb7e680 0x5572bdb7b6d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4009620 tx=0x7fc7a402f600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45b9f99ad27d8447 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:30:37.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.070+0000 7fc7a9d9b640 1 --2- 172.21.15.33:0/2272655265 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc7940a2b50 0x7fc7940a5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:37.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.070+0000 7fc791ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:30:37.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.070+0000 7fc791ffb640 1 -- 172.21.15.33:0/3603627761 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a4050020 con 0x5572bdb7e680 2024-09-12T12:30:37.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.070+0000 7fc7b2f14740 1 -- 172.21.15.33:0/3603627761 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7a4003e20 con 0x5572bdb7e680 2024-09-12T12:30:37.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.070+0000 7fc791ffb640 1 -- 172.21.15.33:0/3603627761 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fc7a4003b70 con 0x5572bdb7e680 2024-09-12T12:30:37.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.071+0000 7fc791ffb640 1 -- 172.21.15.33:0/3603627761 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc7a405b050 con 0x5572bdb7e680 2024-09-12T12:30:37.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.071+0000 7fc7a9d9b640 1 --2- 172.21.15.33:0/2272655265 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc7940a2b50 0x7fc7940a5010 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x5572bdb7c740 tx=0x7fc7a000d450 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:30:37.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.072+0000 7fc7b2f14740 10 client.25471 fetch_fsmap learned FSMap version 27 2024-09-12T12:30:37.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.072+0000 7fc7b2f14740 1 -- 172.21.15.33:0/3603627761 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5572bdb81280 con 0x5572bdb7e680 2024-09-12T12:30:37.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.073+0000 7fc791ffb640 1 -- 172.21.15.33:0/3603627761 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc7a4003e20 con 0x5572bdb7e680 2024-09-12T12:30:37.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.073+0000 7fc791ffb640 1 -- 172.21.15.33:0/3603627761 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fc7a404b030 con 0x5572bdb7e680 2024-09-12T12:30:37.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.073+0000 7fc7b2f14740 10 client.25471 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:30:37.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.073+0000 7fc7b2f14740 10 client.25471 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:30:37.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.073+0000 7fc7b2f14740 20 client.25471 populate_metadata read hostname 'smithi033' 2024-09-12T12:30:37.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.073+0000 7fc7b2f14740 1 --2- 172.21.15.33:0/3603627761 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5572bdb8e2e0 0x5572bdb90740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:37.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.073+0000 7fc7b2f14740 4 client.25471 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:30:37.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.073+0000 7fc7b2f14740 1 -- 172.21.15.33:0/3603627761 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5572bdae6850 con 0x5572bdb8e2e0 2024-09-12T12:30:37.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.074+0000 7fc7aa59c640 1 --2- 172.21.15.33:0/3603627761 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5572bdb8e2e0 0x5572bdb90740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:37.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.079+0000 7fc7aa59c640 1 --2- 172.21.15.33:0/3603627761 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5572bdb8e2e0 0x5572bdb90740 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45ccaecb6a9df785 server_cookie=8c0e6163d800ae1d in_seq=0 out_seq=0 2024-09-12T12:30:37.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.080+0000 7fc791ffb640 10 client.25471 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:30:37.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.081+0000 7fc791ffb640 1 -- 172.21.15.33:0/3603627761 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5572bdae6850 con 0x5572bdb8e2e0 2024-09-12T12:30:37.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.081+0000 7fc791ffb640 10 client.25471 handle_command_reply: tid=0 2024-09-12T12:30:37.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.082+0000 7fc7b2f14740 1 client.25471 shutdown 2024-09-12T12:30:37.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.087+0000 7fc7b2f14740 1 -- 172.21.15.33:0/3603627761 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572bdb7e680 msgr2=0x5572bdb7b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:37.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.087+0000 7fc7b2f14740 1 --2- 172.21.15.33:0/3603627761 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572bdb7e680 0x5572bdb7b6d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4009620 tx=0x7fc7a402f600 comp rx=0 tx=0).stop 2024-09-12T12:30:37.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.087+0000 7fc7b2f14740 1 -- 172.21.15.33:0/3603627761 shutdown_connections 2024-09-12T12:30:37.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.087+0000 7fc7b2f14740 1 --2- 172.21.15.33:0/3603627761 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5572bdb8e2e0 0x5572bdb90740 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:37.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.087+0000 7fc7b2f14740 1 --2- 172.21.15.33:0/3603627761 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572bdb7e680 0x5572bdb7b6d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:37.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.087+0000 7fc7b2f14740 1 --2- 172.21.15.33:0/3603627761 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5572bdb73dc0 0x5572bdb7b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:37.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.087+0000 7fc7b2f14740 1 --2- 172.21.15.33:0/3603627761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572bdb734a0 0x5572bdb7dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:37.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.087+0000 7fc7b2f14740 1 -- 172.21.15.33:0/3603627761 >> 172.21.15.33:0/3603627761 conn(0x5572bdb6fa30 msgr2=0x5572bdb75710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:30:37.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.087+0000 7fc791ffb640 0 client.25471 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:30:37.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.090+0000 7fc7b2f14740 1 -- 172.21.15.33:0/3603627761 shutdown_connections 2024-09-12T12:30:37.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.091+0000 7fc7b2f14740 1 -- 172.21.15.33:0/3603627761 wait complete. 2024-09-12T12:30:37.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.091+0000 7fc7b2f14740 20 client.25471 trim_cache size 0 max 16384 2024-09-12T12:30:37.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.129+0000 7fc7b2f14740 1 Processor -- start 2024-09-12T12:30:37.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.129+0000 7fc7b2f14740 1 -- start start 2024-09-12T12:30:37.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.129+0000 7fc7b2f14740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572bdb734a0 0x5572bdb902f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:37.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.129+0000 7fc7b2f14740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572bdb73dc0 0x5572bdb767f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:37.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.129+0000 7fc7b2f14740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5572bdb7e680 0x5572bdb96010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:37.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.129+0000 7fc7b2f14740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc78c012580 con 0x5572bdb734a0 2024-09-12T12:30:37.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.129+0000 7fc7b2f14740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc78c00fe50 con 0x5572bdb7e680 2024-09-12T12:30:37.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.129+0000 7fc7b2f14740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc78c00dca0 con 0x5572bdb73dc0 2024-09-12T12:30:37.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.129+0000 7fc7aa59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572bdb734a0 0x5572bdb902f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:37.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.129+0000 7fc7aa59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572bdb734a0 0x5572bdb902f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49122/0 (socket says 172.21.15.33:49122) 2024-09-12T12:30:37.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.129+0000 7fc7aa59c640 1 -- 172.21.15.33:0/331904825 learned_addr learned my addr 172.21.15.33:0/331904825 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:30:37.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.130+0000 7fc7aad9d640 1 --2- 172.21.15.33:0/331904825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5572bdb7e680 0x5572bdb96010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:37.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.130+0000 7fc7a9d9b640 1 --2- 172.21.15.33:0/331904825 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572bdb73dc0 0x5572bdb767f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:37.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.131+0000 7fc7aa59c640 1 -- 172.21.15.33:0/331904825 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572bdb73dc0 msgr2=0x5572bdb767f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:30:37.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.131+0000 7fc7aa59c640 1 --2- 172.21.15.33:0/331904825 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572bdb73dc0 0x5572bdb767f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:37.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.131+0000 7fc7aa59c640 1 -- 172.21.15.33:0/331904825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5572bdb7e680 msgr2=0x5572bdb96010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:30:37.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.131+0000 7fc7aa59c640 1 --2- 172.21.15.33:0/331904825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5572bdb7e680 0x5572bdb96010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:37.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.131+0000 7fc7aa59c640 1 -- 172.21.15.33:0/331904825 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572bdb7a140 con 0x5572bdb734a0 2024-09-12T12:30:37.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.134+0000 7fc7aa59c640 1 --2- 172.21.15.33:0/331904825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572bdb734a0 0x5572bdb902f0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fc79c004a20 tx=0x7fc79c0095b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9709474d685e64a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:30:37.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.135+0000 7fc793fff640 1 -- 172.21.15.33:0/331904825 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79c0b9070 con 0x5572bdb734a0 2024-09-12T12:30:37.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.135+0000 7fc793fff640 1 -- 172.21.15.33:0/331904825 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc79c0a0050 con 0x5572bdb734a0 2024-09-12T12:30:37.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.135+0000 7fc793fff640 1 -- 172.21.15.33:0/331904825 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79c0a4480 con 0x5572bdb734a0 2024-09-12T12:30:37.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.136+0000 7fc7b2f14740 1 -- 172.21.15.33:0/331904825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572bdb734a0 msgr2=0x5572bdb902f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:37.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.136+0000 7fc7b2f14740 1 --2- 172.21.15.33:0/331904825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572bdb734a0 0x5572bdb902f0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fc79c004a20 tx=0x7fc79c0095b0 comp rx=0 tx=0).stop 2024-09-12T12:30:37.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.137+0000 7fc7b2f14740 1 -- 172.21.15.33:0/331904825 shutdown_connections 2024-09-12T12:30:37.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.137+0000 7fc7b2f14740 1 --2- 172.21.15.33:0/331904825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5572bdb7e680 0x5572bdb96010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:37.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.137+0000 7fc7b2f14740 1 --2- 172.21.15.33:0/331904825 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572bdb73dc0 0x5572bdb767f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:37.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.137+0000 7fc7b2f14740 1 --2- 172.21.15.33:0/331904825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572bdb734a0 0x5572bdb902f0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:37.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.137+0000 7fc7b2f14740 1 -- 172.21.15.33:0/331904825 >> 172.21.15.33:0/331904825 conn(0x5572bdb6fa30 msgr2=0x5572bdb760e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:30:37.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.137+0000 7fc7b2f14740 1 -- 172.21.15.33:0/331904825 shutdown_connections 2024-09-12T12:30:37.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.138+0000 7fc7b2f14740 1 -- 172.21.15.33:0/331904825 wait complete. 2024-09-12T12:30:37.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.138+0000 7fc7b2f14740 1 -- start start 2024-09-12T12:30:37.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.138+0000 7fc7b2f14740 1 Processor -- start 2024-09-12T12:30:37.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.139+0000 7fc7b2f14740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572bdb734a0 0x5572bdb868a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:37.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.139+0000 7fc7b2f14740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572bdb73dc0 0x5572bdb86e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:37.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.139+0000 7fc7b2f14740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5572bdb7e680 0x5572bdb77ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:37.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.139+0000 7fc7b2f14740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc78c00e310 con 0x5572bdb734a0 2024-09-12T12:30:37.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.139+0000 7fc7b2f14740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc78c00f780 con 0x5572bdb7e680 2024-09-12T12:30:37.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.139+0000 7fc7b2f14740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc78c00e9e0 con 0x5572bdb73dc0 2024-09-12T12:30:37.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.139+0000 7fc7b2f14740 10 client.0 _ll_register_callbacks cb 0x7fc7a4009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:30:37.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.139+0000 7fc7aa59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572bdb734a0 0x5572bdb868a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:37.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.139+0000 7fc7aa59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572bdb734a0 0x5572bdb868a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49132/0 (socket says 172.21.15.33:49132) 2024-09-12T12:30:37.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.139+0000 7fc7aa59c640 1 -- 172.21.15.33:0/1360398699 learned_addr learned my addr 172.21.15.33:0/1360398699 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:30:37.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.140+0000 7fc7aa59c640 1 -- 172.21.15.33:0/1360398699 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572bdb73dc0 msgr2=0x5572bdb86e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:30:37.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.140+0000 7fc7aa59c640 1 --2- 172.21.15.33:0/1360398699 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572bdb73dc0 0x5572bdb86e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:37.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.140+0000 7fc7aa59c640 1 -- 172.21.15.33:0/1360398699 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5572bdb7e680 msgr2=0x5572bdb77ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:30:37.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.140+0000 7fc7aa59c640 1 --2- 172.21.15.33:0/1360398699 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5572bdb7e680 0x5572bdb77ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:37.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.140+0000 7fc7aa59c640 1 -- 172.21.15.33:0/1360398699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572bdb7e250 con 0x5572bdb734a0 2024-09-12T12:30:37.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.142+0000 7fc7aa59c640 1 --2- 172.21.15.33:0/1360398699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572bdb734a0 0x5572bdb868a0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fc79c00e9c0 tx=0x7fc79c005bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd5b2ceb645b5497 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:30:37.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.143+0000 7fc791ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:30:37.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.144+0000 7fc791ffb640 1 -- 172.21.15.33:0/1360398699 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79c0b9040 con 0x5572bdb734a0 2024-09-12T12:30:37.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.144+0000 7fc791ffb640 1 -- 172.21.15.33:0/1360398699 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fc79c0cd050 con 0x5572bdb734a0 2024-09-12T12:30:37.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.144+0000 7fc7b2f14740 1 -- 172.21.15.33:0/1360398699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc79c0a0050 con 0x5572bdb734a0 2024-09-12T12:30:37.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.145+0000 7fc791ffb640 1 -- 172.21.15.33:0/1360398699 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc79c098310 con 0x5572bdb734a0 2024-09-12T12:30:37.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.146+0000 7fc7b2f14740 10 client.15732 fetch_fsmap learned FSMap version 27 2024-09-12T12:30:37.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.146+0000 7fc7b2f14740 1 -- 172.21.15.33:0/1360398699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5572bdbf89b0 con 0x5572bdb734a0 2024-09-12T12:30:37.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.147+0000 7fc791ffb640 1 -- 172.21.15.33:0/1360398699 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc79c0a0050 con 0x5572bdb734a0 2024-09-12T12:30:37.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.148+0000 7fc791ffb640 1 -- 172.21.15.33:0/1360398699 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fc79c082030 con 0x5572bdb734a0 2024-09-12T12:30:37.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.148+0000 7fc7b2f14740 10 client.15732 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:30:37.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.148+0000 7fc7b2f14740 10 client.15732 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:30:37.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.148+0000 7fc7b2f14740 20 client.15732 populate_metadata read hostname 'smithi033' 2024-09-12T12:30:37.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.148+0000 7fc7b2f14740 1 --2- 172.21.15.33:0/1360398699 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5572bdbf8fd0 0x5572bdbfb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:37.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.148+0000 7fc7b2f14740 4 client.15732 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:30:37.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.148+0000 7fc7b2f14740 1 -- 172.21.15.33:0/1360398699 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5572bdae0d60 con 0x5572bdbf8fd0 2024-09-12T12:30:37.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.148+0000 7fc7a9d9b640 1 --2- 172.21.15.33:0/1360398699 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5572bdbf8fd0 0x5572bdbfb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:37.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.150+0000 7fc7a9d9b640 1 --2- 172.21.15.33:0/1360398699 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5572bdbf8fd0 0x5572bdbfb410 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c7270024868143e server_cookie=7c725d767ee46fa6 in_seq=0 out_seq=0 2024-09-12T12:30:37.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.150+0000 7fc791ffb640 10 client.15732 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:30:37.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.153+0000 7fc791ffb640 1 -- 172.21.15.33:0/1360398699 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5572bdae0d60 con 0x5572bdbf8fd0 2024-09-12T12:30:37.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.153+0000 7fc791ffb640 10 client.15732 handle_command_reply: tid=0 2024-09-12T12:30:37.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.154+0000 7fc7b2f14740 1 client.15732 shutdown 2024-09-12T12:30:37.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.158+0000 7fc7b2f14740 1 -- 172.21.15.33:0/1360398699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572bdb734a0 msgr2=0x5572bdb868a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:37.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.158+0000 7fc7b2f14740 1 --2- 172.21.15.33:0/1360398699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572bdb734a0 0x5572bdb868a0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fc79c00e9c0 tx=0x7fc79c005bf0 comp rx=0 tx=0).stop 2024-09-12T12:30:37.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.159+0000 7fc7b2f14740 1 -- 172.21.15.33:0/1360398699 shutdown_connections 2024-09-12T12:30:37.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.159+0000 7fc7b2f14740 1 --2- 172.21.15.33:0/1360398699 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5572bdbf8fd0 0x5572bdbfb410 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:37.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.159+0000 7fc7b2f14740 1 --2- 172.21.15.33:0/1360398699 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5572bdb7e680 0x5572bdb77ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:37.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.159+0000 7fc7b2f14740 1 --2- 172.21.15.33:0/1360398699 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572bdb73dc0 0x5572bdb86e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:37.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.159+0000 7fc7b2f14740 1 --2- 172.21.15.33:0/1360398699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572bdb734a0 0x5572bdb868a0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:37.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.159+0000 7fc791ffb640 0 client.15732 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:30:37.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.159+0000 7fc7b2f14740 1 -- 172.21.15.33:0/1360398699 >> 172.21.15.33:0/1360398699 conn(0x5572bdb6fa30 msgr2=0x5572bdb7c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:30:37.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.159+0000 7fc7b2f14740 1 -- 172.21.15.33:0/1360398699 shutdown_connections 2024-09-12T12:30:37.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.159+0000 7fc7b2f14740 1 -- 172.21.15.33:0/1360398699 wait complete. 2024-09-12T12:30:37.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.160+0000 7fc7b2f14740 20 client.15732 trim_cache size 0 max 16384 2024-09-12T12:30:37.161 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:30:37.161 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "no active scrubs running", 2024-09-12T12:30:37.161 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": {} 2024-09-12T12:30:37.161 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:30:37.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.162+0000 7fc7b0b3b640 1 -- 172.21.15.33:0/2272655265 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc7940a2b50 msgr2=0x7fc7940a5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:37.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.162+0000 7fc7b0b3b640 1 --2- 172.21.15.33:0/2272655265 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc7940a2b50 0x7fc7940a5010 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x5572bdb7c740 tx=0x7fc7a000d450 comp rx=0 tx=0).stop 2024-09-12T12:30:37.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.162+0000 7fc7b0b3b640 1 -- 172.21.15.33:0/2272655265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7ac1091f0 msgr2=0x7fc7ac113f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:37.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.162+0000 7fc7b0b3b640 1 --2- 172.21.15.33:0/2272655265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7ac1091f0 0x7fc7ac113f90 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc79c00e9f0 tx=0x7fc79c00edf0 comp rx=0 tx=0).stop 2024-09-12T12:30:37.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.162+0000 7fc7b0b3b640 1 -- 172.21.15.33:0/2272655265 shutdown_connections 2024-09-12T12:30:37.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.162+0000 7fc7b0b3b640 1 --2- 172.21.15.33:0/2272655265 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc7940a2b50 0x7fc7940a5010 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:37.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.162+0000 7fc7b0b3b640 1 --2- 172.21.15.33:0/2272655265 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7ac114ab0 0x7fc7ac10b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:37.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.162+0000 7fc7b0b3b640 1 --2- 172.21.15.33:0/2272655265 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7ac109b10 0x7fc7ac1144d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:37.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.162+0000 7fc7b0b3b640 1 --2- 172.21.15.33:0/2272655265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7ac1091f0 0x7fc7ac113f90 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:37.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.162+0000 7fc7b0b3b640 1 -- 172.21.15.33:0/2272655265 >> 172.21.15.33:0/2272655265 conn(0x7fc7ac06e140 msgr2=0x7fc7ac071e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:30:37.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.165+0000 7fc7b0b3b640 1 -- 172.21.15.33:0/2272655265 shutdown_connections 2024-09-12T12:30:37.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:37.165+0000 7fc7b0b3b640 1 -- 172.21.15.33:0/2272655265 wait complete. 2024-09-12T12:30:37.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:30:37 smithi033 ceph-mon[31246]: pgmap v488: 129 pgs: 129 active+clean; 10 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 43 MiB/s wr, 687 op/s 2024-09-12T12:30:37.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:30:37 smithi102 ceph-mon[34799]: pgmap v488: 129 pgs: 129 active+clean; 10 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 43 MiB/s wr, 687 op/s 2024-09-12T12:30:37.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:30:37 smithi043 ceph-mon[34144]: pgmap v488: 129 pgs: 129 active+clean; 10 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 43 MiB/s wr, 687 op/s 2024-09-12T12:30:38.033 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T12:30:38.033 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:30:38.622 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:30:39.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.351+0000 7f88e56e9640 1 -- 172.21.15.33:0/329678134 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88e0109120 msgr2=0x7f88e0110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:39.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.351+0000 7f88e56e9640 1 --2- 172.21.15.33:0/329678134 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88e0109120 0x7f88e0110ca0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f88d8009860 tx=0x7f88d802a360 comp rx=0 tx=0).stop 2024-09-12T12:30:39.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.352+0000 7f88e56e9640 1 -- 172.21.15.33:0/329678134 shutdown_connections 2024-09-12T12:30:39.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.352+0000 7f88e56e9640 1 --2- 172.21.15.33:0/329678134 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88e0109120 0x7f88e0110ca0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:39.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.352+0000 7f88e56e9640 1 --2- 172.21.15.33:0/329678134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88e01049a0 0x7f88e01089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:39.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.352+0000 7f88e56e9640 1 --2- 172.21.15.33:0/329678134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88e0103ff0 0x7f88e01043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:39.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.352+0000 7f88e56e9640 1 -- 172.21.15.33:0/329678134 >> 172.21.15.33:0/329678134 conn(0x7f88e00ffab0 msgr2=0x7f88e0101ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:30:39.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.352+0000 7f88e56e9640 1 -- 172.21.15.33:0/329678134 shutdown_connections 2024-09-12T12:30:39.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.352+0000 7f88e56e9640 1 -- 172.21.15.33:0/329678134 wait complete. 2024-09-12T12:30:39.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.353+0000 7f88e56e9640 1 Processor -- start 2024-09-12T12:30:39.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.353+0000 7f88e56e9640 1 -- start start 2024-09-12T12:30:39.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.354+0000 7f88e56e9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88e0103ff0 0x7f88e0076700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:39.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.354+0000 7f88e56e9640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88e01049a0 0x7f88e0076c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:39.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.354+0000 7f88e56e9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88e0109120 0x7f88e0077180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:39.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.354+0000 7f88e56e9640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f88e0113fe0 con 0x7f88e0109120 2024-09-12T12:30:39.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.354+0000 7f88e56e9640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f88e0113e60 con 0x7f88e01049a0 2024-09-12T12:30:39.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.354+0000 7f88e56e9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f88e0114160 con 0x7f88e0103ff0 2024-09-12T12:30:39.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.354+0000 7f88de7fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88e01049a0 0x7f88e0076c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:39.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.354+0000 7f88de7fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88e01049a0 0x7f88e0076c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:38570/0 (socket says 172.21.15.33:38570) 2024-09-12T12:30:39.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.354+0000 7f88de7fc640 1 -- 172.21.15.33:0/2374417094 learned_addr learned my addr 172.21.15.33:0/2374417094 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:30:39.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.354+0000 7f88df7fe640 1 --2- 172.21.15.33:0/2374417094 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88e0109120 0x7f88e0077180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:39.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.355+0000 7f88de7fc640 1 -- 172.21.15.33:0/2374417094 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88e0103ff0 msgr2=0x7f88e0076700 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T12:30:39.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.355+0000 7f88de7fc640 1 --2- 172.21.15.33:0/2374417094 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88e0103ff0 0x7f88e0076700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:39.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.355+0000 7f88de7fc640 1 -- 172.21.15.33:0/2374417094 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88e0109120 msgr2=0x7f88e0077180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:39.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.355+0000 7f88de7fc640 1 --2- 172.21.15.33:0/2374417094 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88e0109120 0x7f88e0077180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:39.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.355+0000 7f88de7fc640 1 -- 172.21.15.33:0/2374417094 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88e01aabe0 con 0x7f88e01049a0 2024-09-12T12:30:39.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.355+0000 7f88df7fe640 1 --2- 172.21.15.33:0/2374417094 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88e0109120 0x7f88e0077180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:30:39.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.355+0000 7f88de7fc640 1 --2- 172.21.15.33:0/2374417094 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88e01049a0 0x7f88e0076c40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f88d0009fd0 tx=0x7f88d000c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:30:39.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.356+0000 7f88d7fff640 1 -- 172.21.15.33:0/2374417094 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d001b070 con 0x7f88e01049a0 2024-09-12T12:30:39.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.356+0000 7f88d7fff640 1 -- 172.21.15.33:0/2374417094 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f88d000bae0 con 0x7f88e01049a0 2024-09-12T12:30:39.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.357+0000 7f88d7fff640 1 -- 172.21.15.33:0/2374417094 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d0016b30 con 0x7f88e01049a0 2024-09-12T12:30:39.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.357+0000 7f88e56e9640 1 -- 172.21.15.33:0/2374417094 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88e01aaed0 con 0x7f88e01049a0 2024-09-12T12:30:39.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.357+0000 7f88e56e9640 1 -- 172.21.15.33:0/2374417094 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88e01ab270 con 0x7f88e01049a0 2024-09-12T12:30:39.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.361+0000 7f88e56e9640 1 -- 172.21.15.33:0/2374417094 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88e01054d0 con 0x7f88e01049a0 2024-09-12T12:30:39.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.362+0000 7f88d7fff640 1 -- 172.21.15.33:0/2374417094 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f88d000bc90 con 0x7f88e01049a0 2024-09-12T12:30:39.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.363+0000 7f88d7fff640 1 --2- 172.21.15.33:0/2374417094 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f88cc0a2b00 0x7f88cc0a4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:39.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.363+0000 7f88d7fff640 1 -- 172.21.15.33:0/2374417094 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f88d00cf540 con 0x7f88e01049a0 2024-09-12T12:30:39.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.364+0000 7f88deffd640 1 --2- 172.21.15.33:0/2374417094 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f88cc0a2b00 0x7f88cc0a4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:39.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.366+0000 7f88deffd640 1 --2- 172.21.15.33:0/2374417094 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f88cc0a2b00 0x7f88cc0a4fc0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f88c800b990 tx=0x7f88c800b370 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:30:39.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.369+0000 7f88d7fff640 1 -- 172.21.15.33:0/2374417094 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f88d009c110 con 0x7f88e01049a0 2024-09-12T12:30:39.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:30:39 smithi102 ceph-mon[34799]: pgmap v489: 129 pgs: 129 active+clean; 10 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 54 MiB/s wr, 875 op/s 2024-09-12T12:30:39.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:30:39 smithi033 ceph-mon[31246]: pgmap v489: 129 pgs: 129 active+clean; 10 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 54 MiB/s wr, 875 op/s 2024-09-12T12:30:39.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.793+0000 7f88e56e9640 1 -- 172.21.15.33:0/2374417094 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f88e0077c30 con 0x7f88e01049a0 2024-09-12T12:30:39.795 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:30:39.795 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":27,"btime":"2024-09-12T12:29:38:065241+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3327066342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3327066342},{"type":"v1","addr":"172.21.15.33:6835","nonce":3327066342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/19516401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":19516401},{"type":"v1","addr":"172.21.15.33:6837","nonce":19516401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1260196118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1260196118},{"type":"v1","addr":"172.21.15.33:6839","nonce":1260196118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/4288248356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4288248356},{"type":"v1","addr":"172.21.15.33:6841","nonce":4288248356}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/3051073141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3051073141},{"type":"v1","addr":"172.21.15.43:6833","nonce":3051073141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3282762800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3282762800},{"type":"v1","addr":"172.21.15.43:6835","nonce":3282762800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:23:46.400609+0000","modified":"2024-09-12T12:29:37.555614+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24490,"mds_2":24478},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3051713000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3051713000},{"type":"v1","addr":"172.21.15.102:6833","nonce":3051713000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6837/2472064883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2472064883},{"type":"v1","addr":"172.21.15.43:6837","nonce":2472064883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/1987408860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":1987408860},{"type":"v1","addr":"172.21.15.43:6839","nonce":1987408860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/4179527539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":4179527539},{"type":"v1","addr":"172.21.15.102:6835","nonce":4179527539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/2409953270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2409953270},{"type":"v1","addr":"172.21.15.102:6837","nonce":2409953270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.102:6839/1553271340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":1553271340},{"type":"v1","addr":"172.21.15.102:6839","nonce":1553271340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24499,"qdb_cluster":[24499,24490,24478]},"id":1}]} 2024-09-12T12:30:39.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.794+0000 7f88d7fff640 1 -- 172.21.15.33:0/2374417094 <== mon.2 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11912 (secure 0 0 0) 0x7f88d009ba10 con 0x7f88e01049a0 2024-09-12T12:30:39.795 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 27 2024-09-12T12:30:39.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.798+0000 7f88e56e9640 1 -- 172.21.15.33:0/2374417094 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f88cc0a2b00 msgr2=0x7f88cc0a4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:39.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.798+0000 7f88e56e9640 1 --2- 172.21.15.33:0/2374417094 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f88cc0a2b00 0x7f88cc0a4fc0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f88c800b990 tx=0x7f88c800b370 comp rx=0 tx=0).stop 2024-09-12T12:30:39.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.798+0000 7f88e56e9640 1 -- 172.21.15.33:0/2374417094 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88e01049a0 msgr2=0x7f88e0076c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:39.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.798+0000 7f88e56e9640 1 --2- 172.21.15.33:0/2374417094 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88e01049a0 0x7f88e0076c40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f88d0009fd0 tx=0x7f88d000c800 comp rx=0 tx=0).stop 2024-09-12T12:30:39.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.798+0000 7f88e56e9640 1 -- 172.21.15.33:0/2374417094 shutdown_connections 2024-09-12T12:30:39.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.798+0000 7f88e56e9640 1 --2- 172.21.15.33:0/2374417094 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f88cc0a2b00 0x7f88cc0a4fc0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:39.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.798+0000 7f88e56e9640 1 --2- 172.21.15.33:0/2374417094 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88e0109120 0x7f88e0077180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:39.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.798+0000 7f88e56e9640 1 --2- 172.21.15.33:0/2374417094 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88e01049a0 0x7f88e0076c40 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:39.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.798+0000 7f88e56e9640 1 --2- 172.21.15.33:0/2374417094 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88e0103ff0 0x7f88e0076700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:39.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.799+0000 7f88e56e9640 1 -- 172.21.15.33:0/2374417094 >> 172.21.15.33:0/2374417094 conn(0x7f88e00ffab0 msgr2=0x7f88e0100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:30:39.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.800+0000 7f88e56e9640 1 -- 172.21.15.33:0/2374417094 shutdown_connections 2024-09-12T12:30:39.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:39.801+0000 7f88e56e9640 1 -- 172.21.15.33:0/2374417094 wait complete. 2024-09-12T12:30:39.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:30:39 smithi043 ceph-mon[34144]: pgmap v489: 129 pgs: 129 active+clean; 10 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 54 MiB/s wr, 875 op/s 2024-09-12T12:30:40.648 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:30:40 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/2374417094' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:30:40.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:30:40 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/2374417094' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:30:40.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:30:40 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/2374417094' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:30:41.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:30:41 smithi102 ceph-mon[34799]: pgmap v490: 129 pgs: 129 active+clean; 10 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 43 MiB/s wr, 688 op/s 2024-09-12T12:30:41.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:30:41 smithi033 ceph-mon[31246]: pgmap v490: 129 pgs: 129 active+clean; 10 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 43 MiB/s wr, 688 op/s 2024-09-12T12:30:41.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:30:41 smithi043 ceph-mon[34144]: pgmap v490: 129 pgs: 129 active+clean; 10 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 43 MiB/s wr, 688 op/s 2024-09-12T12:30:43.001 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T12:30:43.593 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:30:43.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:30:43 smithi102 ceph-mon[34799]: pgmap v491: 129 pgs: 129 active+clean; 10 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 45 MiB/s wr, 726 op/s 2024-09-12T12:30:43.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:30:43 smithi033 ceph-mon[31246]: pgmap v491: 129 pgs: 129 active+clean; 10 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 45 MiB/s wr, 726 op/s 2024-09-12T12:30:43.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:30:43 smithi043 ceph-mon[34144]: pgmap v491: 129 pgs: 129 active+clean; 10 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 45 MiB/s wr, 726 op/s 2024-09-12T12:30:44.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.266+0000 7f26a173f640 1 -- 172.21.15.33:0/2910408195 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2694006590 msgr2=0x7f26940069f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:44.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.266+0000 7f26a173f640 1 --2- 172.21.15.33:0/2910408195 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2694006590 0x7f26940069f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f268c009900 tx=0x7f268c02a440 comp rx=0 tx=0).stop 2024-09-12T12:30:44.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.267+0000 7f26a173f640 1 -- 172.21.15.33:0/2910408195 shutdown_connections 2024-09-12T12:30:44.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.267+0000 7f26a173f640 1 --2- 172.21.15.33:0/2910408195 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26940a1f60 0x7f26940a4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:44.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.267+0000 7f26a173f640 1 --2- 172.21.15.33:0/2910408195 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2694006590 0x7f26940069f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:44.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.267+0000 7f26a173f640 1 --2- 172.21.15.33:0/2910408195 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26940964e0 0x7f2694006050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:44.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.267+0000 7f26a173f640 1 -- 172.21.15.33:0/2910408195 >> 172.21.15.33:0/2910408195 conn(0x7f269400b440 msgr2=0x7f269400b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:30:44.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.275+0000 7f26a173f640 1 -- 172.21.15.33:0/2910408195 shutdown_connections 2024-09-12T12:30:44.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.277+0000 7f26a173f640 1 -- 172.21.15.33:0/2910408195 wait complete. 2024-09-12T12:30:44.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.278+0000 7f26a173f640 1 Processor -- start 2024-09-12T12:30:44.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.279+0000 7f26a173f640 1 -- start start 2024-09-12T12:30:44.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.279+0000 7f26a173f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2694006590 0x7f26940a1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:44.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.279+0000 7f26a173f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f26940964e0 0x7f269409e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:44.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.279+0000 7f26a173f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26940a1f60 0x7f269409ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:44.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.279+0000 7f26a173f640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f26940a7ba0 con 0x7f26940a1f60 2024-09-12T12:30:44.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.279+0000 7f26a173f640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f26940a7a20 con 0x7f2694006590 2024-09-12T12:30:44.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.279+0000 7f26a173f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f26940a7d20 con 0x7f26940964e0 2024-09-12T12:30:44.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.282+0000 7f269b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26940a1f60 0x7f269409ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:44.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.282+0000 7f269b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26940a1f60 0x7f269409ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56892/0 (socket says 172.21.15.33:56892) 2024-09-12T12:30:44.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.282+0000 7f269b7fe640 1 -- 172.21.15.33:0/415723163 learned_addr learned my addr 172.21.15.33:0/415723163 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:30:44.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.282+0000 7f269affd640 1 --2- 172.21.15.33:0/415723163 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2694006590 0x7f26940a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:44.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.285+0000 7f269a7fc640 1 --2- 172.21.15.33:0/415723163 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f26940964e0 0x7f269409e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:44.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.285+0000 7f269affd640 1 -- 172.21.15.33:0/415723163 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f26940964e0 msgr2=0x7f269409e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:44.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.285+0000 7f269affd640 1 --2- 172.21.15.33:0/415723163 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f26940964e0 0x7f269409e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:44.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.285+0000 7f269affd640 1 -- 172.21.15.33:0/415723163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26940a1f60 msgr2=0x7f269409ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:44.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.285+0000 7f269affd640 1 --2- 172.21.15.33:0/415723163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26940a1f60 0x7f269409ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:44.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.285+0000 7f269affd640 1 -- 172.21.15.33:0/415723163 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f269409f710 con 0x7f2694006590 2024-09-12T12:30:44.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.287+0000 7f269affd640 1 --2- 172.21.15.33:0/415723163 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2694006590 0x7f26940a1890 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2690009fd0 tx=0x7f269000b870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:30:44.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.287+0000 7f2683fff640 1 -- 172.21.15.33:0/415723163 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2690015020 con 0x7f2694006590 2024-09-12T12:30:44.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.288+0000 7f2683fff640 1 -- 172.21.15.33:0/415723163 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2690011ce0 con 0x7f2694006590 2024-09-12T12:30:44.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.288+0000 7f2683fff640 1 -- 172.21.15.33:0/415723163 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2690010e40 con 0x7f2694006590 2024-09-12T12:30:44.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.290+0000 7f26a173f640 1 -- 172.21.15.33:0/415723163 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f269413e9a0 con 0x7f2694006590 2024-09-12T12:30:44.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.290+0000 7f26a173f640 1 -- 172.21.15.33:0/415723163 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f269413ee60 con 0x7f2694006590 2024-09-12T12:30:44.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.295+0000 7f26a3b18740 1 Processor -- start 2024-09-12T12:30:44.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.296+0000 7f2683fff640 1 -- 172.21.15.33:0/415723163 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2690018020 con 0x7f2694006590 2024-09-12T12:30:44.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.297+0000 7f26a3b18740 1 -- start start 2024-09-12T12:30:44.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.297+0000 7f26a3b18740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e027020cf0 0x55e02701f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:44.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.297+0000 7f26a3b18740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e02701f780 0x55e02701fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:44.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.297+0000 7f26a3b18740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e02703b530 0x55e02703d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:44.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.297+0000 7f26a3b18740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e026f852f0 con 0x55e02701f780 2024-09-12T12:30:44.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.297+0000 7f26a3b18740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e026f2ccf0 con 0x55e027020cf0 2024-09-12T12:30:44.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.297+0000 7f26a3b18740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55e026f812b0 con 0x55e02703b530 2024-09-12T12:30:44.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.297+0000 7f269affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e02701f780 0x55e02701fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:44.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.297+0000 7f269affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e02701f780 0x55e02701fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56904/0 (socket says 172.21.15.33:56904) 2024-09-12T12:30:44.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.297+0000 7f269affd640 1 -- 172.21.15.33:0/1380480386 learned_addr learned my addr 172.21.15.33:0/1380480386 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:30:44.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.298+0000 7f2683fff640 1 --2- 172.21.15.33:0/415723163 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f26840a2d20 0x7f26840a51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:44.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.298+0000 7f269affd640 1 -- 172.21.15.33:0/1380480386 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e02703b530 msgr2=0x55e02703d920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T12:30:44.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.298+0000 7f269affd640 1 --2- 172.21.15.33:0/1380480386 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e02703b530 0x55e02703d920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:44.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.298+0000 7f269affd640 1 -- 172.21.15.33:0/1380480386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e027020cf0 msgr2=0x55e02701f240 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:30:44.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.298+0000 7f269affd640 1 --2- 172.21.15.33:0/1380480386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e027020cf0 0x55e02701f240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:44.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.298+0000 7f269affd640 1 -- 172.21.15.33:0/1380480386 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e026f113a0 con 0x55e02701f780 2024-09-12T12:30:44.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.298+0000 7f2683fff640 1 -- 172.21.15.33:0/415723163 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f26900ceb90 con 0x7f2694006590 2024-09-12T12:30:44.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.300+0000 7f269affd640 1 --2- 172.21.15.33:0/1380480386 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e02701f780 0x55e02701fbc0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f269006d0c0 tx=0x7f269006e110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8d08b14c3764b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:30:44.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.301+0000 7f26817fa640 1 -- 172.21.15.33:0/1380480386 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269009bbc0 con 0x55e02701f780 2024-09-12T12:30:44.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.301+0000 7f269b7fe640 1 --2- 172.21.15.33:0/415723163 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f26840a2d20 0x7f26840a51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:44.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.301+0000 7f26817fa640 1 -- 172.21.15.33:0/1380480386 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f26900d3040 con 0x55e02701f780 2024-09-12T12:30:44.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.302+0000 7f26a3b18740 1 -- 172.21.15.33:0/1380480386 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e02701f780 msgr2=0x55e02701fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:44.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.302+0000 7f26a3b18740 1 --2- 172.21.15.33:0/1380480386 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e02701f780 0x55e02701fbc0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f269006d0c0 tx=0x7f269006e110 comp rx=0 tx=0).stop 2024-09-12T12:30:44.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.303+0000 7f269b7fe640 1 --2- 172.21.15.33:0/415723163 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f26840a2d20 0x7f26840a51e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f269c050280 tx=0x7f269c077040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:30:44.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.303+0000 7f26a3b18740 1 -- 172.21.15.33:0/1380480386 shutdown_connections 2024-09-12T12:30:44.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.303+0000 7f26a3b18740 1 --2- 172.21.15.33:0/1380480386 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e02703b530 0x55e02703d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:44.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.303+0000 7f26a3b18740 1 --2- 172.21.15.33:0/1380480386 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e02701f780 0x55e02701fbc0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:44.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.303+0000 7f26a3b18740 1 --2- 172.21.15.33:0/1380480386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e027020cf0 0x55e02701f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:44.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.303+0000 7f26a3b18740 1 -- 172.21.15.33:0/1380480386 >> 172.21.15.33:0/1380480386 conn(0x55e026fe8310 msgr2=0x55e02701be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:30:44.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.306+0000 7f26a3b18740 1 -- 172.21.15.33:0/1380480386 shutdown_connections 2024-09-12T12:30:44.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.306+0000 7f26a3b18740 1 -- 172.21.15.33:0/1380480386 wait complete. 2024-09-12T12:30:44.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.307+0000 7f26a3b18740 1 -- start start 2024-09-12T12:30:44.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.307+0000 7f26a3b18740 1 Processor -- start 2024-09-12T12:30:44.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.307+0000 7f26a3b18740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e02701f780 0x55e02702c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:44.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.307+0000 7f26a3b18740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e027020cf0 0x55e02702c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:44.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.307+0000 7f26a3b18740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e02703b530 0x55e0270277d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:44.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.307+0000 7f26a3b18740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e0270226a0 con 0x55e027020cf0 2024-09-12T12:30:44.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.307+0000 7f26a3b18740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e026f40060 con 0x55e02703b530 2024-09-12T12:30:44.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.307+0000 7f26a3b18740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55e027022820 con 0x55e02701f780 2024-09-12T12:30:44.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.307+0000 7f26a3b18740 10 client.0 _ll_register_callbacks cb 0x55e026c938c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:30:44.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.308+0000 7f269b7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e02703b530 0x55e0270277d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:44.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.308+0000 7f269b7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e02703b530 0x55e0270277d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:59938/0 (socket says 172.21.15.33:59938) 2024-09-12T12:30:44.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.308+0000 7f269b7fe640 1 -- 172.21.15.33:0/3346244631 learned_addr learned my addr 172.21.15.33:0/3346244631 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:30:44.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.308+0000 7f269b7fe640 1 -- 172.21.15.33:0/3346244631 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e02701f780 msgr2=0x55e02702c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:30:44.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.308+0000 7f269b7fe640 1 --2- 172.21.15.33:0/3346244631 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e02701f780 0x55e02702c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:44.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.308+0000 7f269b7fe640 1 -- 172.21.15.33:0/3346244631 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e027020cf0 msgr2=0x55e02702c9f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T12:30:44.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.308+0000 7f269b7fe640 1 --2- 172.21.15.33:0/3346244631 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e027020cf0 0x55e02702c9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:44.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.308+0000 7f269b7fe640 1 -- 172.21.15.33:0/3346244631 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e026cf63c0 con 0x55e02703b530 2024-09-12T12:30:44.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.309+0000 7f269b7fe640 1 --2- 172.21.15.33:0/3346244631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e02703b530 0x55e0270277d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f269c0689b0 tx=0x7f269c067f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb6411165faf4801 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:30:44.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.309+0000 7f267eff5640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:30:44.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.309+0000 7f267eff5640 1 -- 172.21.15.33:0/3346244631 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269c087060 con 0x55e02703b530 2024-09-12T12:30:44.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.309+0000 7f26a3b18740 1 -- 172.21.15.33:0/3346244631 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26900d3040 con 0x55e02703b530 2024-09-12T12:30:44.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.309+0000 7f267eff5640 1 -- 172.21.15.33:0/3346244631 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f269c081d00 con 0x55e02703b530 2024-09-12T12:30:44.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.310+0000 7f267eff5640 1 -- 172.21.15.33:0/3346244631 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f269c082480 con 0x55e02703b530 2024-09-12T12:30:44.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.310+0000 7f26a3b18740 10 client.25379 fetch_fsmap learned FSMap version 27 2024-09-12T12:30:44.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.310+0000 7f26a3b18740 1 -- 172.21.15.33:0/3346244631 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e0270361f0 con 0x55e02703b530 2024-09-12T12:30:44.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.310+0000 7f267eff5640 1 -- 172.21.15.33:0/3346244631 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f26900d3040 con 0x55e02703b530 2024-09-12T12:30:44.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.311+0000 7f267eff5640 1 -- 172.21.15.33:0/3346244631 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f269c08a050 con 0x55e02703b530 2024-09-12T12:30:44.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.311+0000 7f26a3b18740 10 client.25379 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:30:44.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.311+0000 7f26a3b18740 10 client.25379 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-12T12:30:44.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.311+0000 7f26a3b18740 20 client.25379 populate_metadata read hostname 'smithi033' 2024-09-12T12:30:44.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.311+0000 7f26a3b18740 1 --2- 172.21.15.33:0/3346244631 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x55e027037b10 0x55e027039fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:44.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.311+0000 7f26a3b18740 4 client.25379 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:30:44.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.311+0000 7f26a3b18740 1 -- 172.21.15.33:0/3346244631 --> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e026f92860 con 0x55e027037b10 2024-09-12T12:30:44.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.313+0000 7f269affd640 1 --2- 172.21.15.33:0/3346244631 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x55e027037b10 0x55e027039fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:44.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.317+0000 7f267eff5640 10 client.25379 ms_handle_connect on v2:172.21.15.102:6834/4179527539 2024-09-12T12:30:44.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.317+0000 7f269affd640 1 --2- 172.21.15.33:0/3346244631 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x55e027037b10 0x55e027039fd0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b5c1e98a4492292a server_cookie=da70f727f3245a1e in_seq=0 out_seq=0 2024-09-12T12:30:44.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.319+0000 7f267eff5640 1 -- 172.21.15.33:0/3346244631 <== mds.2 v2:172.21.15.102:6834/4179527539 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e026f92860 con 0x55e027037b10 2024-09-12T12:30:44.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.319+0000 7f267eff5640 10 client.25379 handle_command_reply: tid=0 2024-09-12T12:30:44.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.319+0000 7f26a3b18740 1 client.25379 shutdown 2024-09-12T12:30:44.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.323+0000 7f26a3b18740 1 -- 172.21.15.33:0/3346244631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e02703b530 msgr2=0x55e0270277d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:44.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.323+0000 7f26a3b18740 1 --2- 172.21.15.33:0/3346244631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e02703b530 0x55e0270277d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f269c0689b0 tx=0x7f269c067f40 comp rx=0 tx=0).stop 2024-09-12T12:30:44.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.326+0000 7f26a3b18740 1 -- 172.21.15.33:0/3346244631 shutdown_connections 2024-09-12T12:30:44.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.326+0000 7f26a3b18740 1 --2- 172.21.15.33:0/3346244631 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x55e027037b10 0x55e027039fd0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:44.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.326+0000 7f26a3b18740 1 --2- 172.21.15.33:0/3346244631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e02703b530 0x55e0270277d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:44.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.326+0000 7f26a3b18740 1 --2- 172.21.15.33:0/3346244631 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e027020cf0 0x55e02702c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:44.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.326+0000 7f26a3b18740 1 --2- 172.21.15.33:0/3346244631 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e02701f780 0x55e02702c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:44.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.326+0000 7f26a3b18740 1 -- 172.21.15.33:0/3346244631 >> 172.21.15.33:0/3346244631 conn(0x55e026fe8310 msgr2=0x55e027021b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:30:44.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.326+0000 7f267eff5640 0 client.25379 ms_handle_reset on v2:172.21.15.102:6834/4179527539 2024-09-12T12:30:44.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.329+0000 7f26a3b18740 1 -- 172.21.15.33:0/3346244631 shutdown_connections 2024-09-12T12:30:44.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.329+0000 7f26a3b18740 1 -- 172.21.15.33:0/3346244631 wait complete. 2024-09-12T12:30:44.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.329+0000 7f26a3b18740 20 client.25379 trim_cache size 0 max 16384 2024-09-12T12:30:44.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.356+0000 7f26a3b18740 1 Processor -- start 2024-09-12T12:30:44.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.358+0000 7f26a3b18740 1 -- start start 2024-09-12T12:30:44.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.358+0000 7f26a3b18740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e02701f780 0x55e02701bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:44.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.358+0000 7f26a3b18740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e027020cf0 0x55e027027090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:44.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.358+0000 7f26a3b18740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e02703b530 0x55e0270275d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:44.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.358+0000 7f26a3b18740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2688012570 con 0x55e02701f780 2024-09-12T12:30:44.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.358+0000 7f26a3b18740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f268800fe40 con 0x55e027020cf0 2024-09-12T12:30:44.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.358+0000 7f26a3b18740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f268800dc30 con 0x55e02703b530 2024-09-12T12:30:44.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.359+0000 7f269affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e02701f780 0x55e02701bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:44.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.359+0000 7f269affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e02701f780 0x55e02701bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56920/0 (socket says 172.21.15.33:56920) 2024-09-12T12:30:44.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.359+0000 7f269affd640 1 -- 172.21.15.33:0/1357434388 learned_addr learned my addr 172.21.15.33:0/1357434388 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:30:44.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.360+0000 7f269a7fc640 1 --2- 172.21.15.33:0/1357434388 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e027020cf0 0x55e027027090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:44.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.361+0000 7f269affd640 1 -- 172.21.15.33:0/1357434388 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e02703b530 msgr2=0x55e0270275d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:30:44.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.361+0000 7f269affd640 1 --2- 172.21.15.33:0/1357434388 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e02703b530 0x55e0270275d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:44.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.361+0000 7f269affd640 1 -- 172.21.15.33:0/1357434388 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e027020cf0 msgr2=0x55e027027090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:30:44.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.361+0000 7f269affd640 1 --2- 172.21.15.33:0/1357434388 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e027020cf0 0x55e027027090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:44.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.361+0000 7f269affd640 1 -- 172.21.15.33:0/1357434388 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e027027b10 con 0x55e02701f780 2024-09-12T12:30:44.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.362+0000 7f269affd640 1 --2- 172.21.15.33:0/1357434388 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e02701f780 0x55e02701bfc0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f269009bd80 tx=0x7f26900d2670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5784f729d6eb5083 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:30:44.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.363+0000 7f2680ff9640 1 -- 172.21.15.33:0/1357434388 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2690010380 con 0x55e02701f780 2024-09-12T12:30:44.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.363+0000 7f2680ff9640 1 -- 172.21.15.33:0/1357434388 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f269006f040 con 0x55e02701f780 2024-09-12T12:30:44.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.363+0000 7f2680ff9640 1 -- 172.21.15.33:0/1357434388 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269006f6c0 con 0x55e02701f780 2024-09-12T12:30:44.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.364+0000 7f26a3b18740 1 -- 172.21.15.33:0/1357434388 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e02701f780 msgr2=0x55e02701bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:44.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.364+0000 7f26a3b18740 1 --2- 172.21.15.33:0/1357434388 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e02701f780 0x55e02701bfc0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f269009bd80 tx=0x7f26900d2670 comp rx=0 tx=0).stop 2024-09-12T12:30:44.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.366+0000 7f26a3b18740 1 -- 172.21.15.33:0/1357434388 shutdown_connections 2024-09-12T12:30:44.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.366+0000 7f26a3b18740 1 --2- 172.21.15.33:0/1357434388 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e02703b530 0x55e0270275d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:44.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.366+0000 7f26a3b18740 1 --2- 172.21.15.33:0/1357434388 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e027020cf0 0x55e027027090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:44.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.366+0000 7f26a3b18740 1 --2- 172.21.15.33:0/1357434388 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e02701f780 0x55e02701bfc0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:44.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.366+0000 7f26a3b18740 1 -- 172.21.15.33:0/1357434388 >> 172.21.15.33:0/1357434388 conn(0x55e026fe8310 msgr2=0x55e02701b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:30:44.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.366+0000 7f26a3b18740 1 -- 172.21.15.33:0/1357434388 shutdown_connections 2024-09-12T12:30:44.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.366+0000 7f26a3b18740 1 -- 172.21.15.33:0/1357434388 wait complete. 2024-09-12T12:30:44.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.366+0000 7f26a3b18740 1 -- start start 2024-09-12T12:30:44.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.367+0000 7f26a3b18740 1 Processor -- start 2024-09-12T12:30:44.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.367+0000 7f26a3b18740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e02701f780 0x55e027033ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:44.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.367+0000 7f26a3b18740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e027020cf0 0x55e027034000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:44.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.367+0000 7f26a3b18740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e02703b530 0x55e02702de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:44.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.368+0000 7f26a3b18740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f268800e300 con 0x55e027020cf0 2024-09-12T12:30:44.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.368+0000 7f26a3b18740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f268800f770 con 0x55e02701f780 2024-09-12T12:30:44.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.368+0000 7f26a3b18740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f268800e9d0 con 0x55e02703b530 2024-09-12T12:30:44.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.368+0000 7f26a3b18740 10 client.0 _ll_register_callbacks cb 0x7f269c06b5c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:30:44.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.368+0000 7f269affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e02701f780 0x55e027033ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:44.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.368+0000 7f269affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e02701f780 0x55e027033ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:59962/0 (socket says 172.21.15.33:59962) 2024-09-12T12:30:44.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.368+0000 7f269affd640 1 -- 172.21.15.33:0/602344598 learned_addr learned my addr 172.21.15.33:0/602344598 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:30:44.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.368+0000 7f269a7fc640 1 --2- 172.21.15.33:0/602344598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e027020cf0 0x55e027034000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:44.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.368+0000 7f269affd640 1 -- 172.21.15.33:0/602344598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e02703b530 msgr2=0x55e02702de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:30:44.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.368+0000 7f269b7fe640 1 --2- 172.21.15.33:0/602344598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e02703b530 0x55e02702de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:44.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.368+0000 7f269affd640 1 --2- 172.21.15.33:0/602344598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e02703b530 0x55e02702de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:44.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.368+0000 7f269affd640 1 -- 172.21.15.33:0/602344598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e027020cf0 msgr2=0x55e027034000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:30:44.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.368+0000 7f269affd640 1 --2- 172.21.15.33:0/602344598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e027020cf0 0x55e027034000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:44.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.368+0000 7f269affd640 1 -- 172.21.15.33:0/602344598 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e02702e690 con 0x55e02701f780 2024-09-12T12:30:44.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.368+0000 7f269b7fe640 1 --2- 172.21.15.33:0/602344598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e02703b530 0x55e02702de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:30:44.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.369+0000 7f269affd640 1 --2- 172.21.15.33:0/602344598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e02701f780 0x55e027033ac0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f26900984e0 tx=0x7f2690004720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c88e583e50509a21 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:30:44.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.369+0000 7f267eff5640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:30:44.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.369+0000 7f267eff5640 1 -- 172.21.15.33:0/602344598 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2690010380 con 0x55e02701f780 2024-09-12T12:30:44.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.370+0000 7f267eff5640 1 -- 172.21.15.33:0/602344598 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f26900bb0b0 con 0x55e02701f780 2024-09-12T12:30:44.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.370+0000 7f26a3b18740 1 -- 172.21.15.33:0/602344598 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f269006f040 con 0x55e02701f780 2024-09-12T12:30:44.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.370+0000 7f267eff5640 1 -- 172.21.15.33:0/602344598 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f269009c780 con 0x55e02701f780 2024-09-12T12:30:44.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.370+0000 7f26a3b18740 10 client.25385 fetch_fsmap learned FSMap version 27 2024-09-12T12:30:44.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.370+0000 7f26a3b18740 1 -- 172.21.15.33:0/602344598 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e0270b5b70 con 0x55e02701f780 2024-09-12T12:30:44.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.371+0000 7f267eff5640 1 -- 172.21.15.33:0/602344598 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f26900b4050 con 0x55e02701f780 2024-09-12T12:30:44.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.371+0000 7f267eff5640 1 -- 172.21.15.33:0/602344598 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f26900986f0 con 0x55e02701f780 2024-09-12T12:30:44.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.371+0000 7f26a3b18740 10 client.25385 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:30:44.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.371+0000 7f26a3b18740 10 client.25385 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-12T12:30:44.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.371+0000 7f26a3b18740 20 client.25385 populate_metadata read hostname 'smithi033' 2024-09-12T12:30:44.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.371+0000 7f26a3b18740 1 --2- 172.21.15.33:0/602344598 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x55e0270b5d40 0x55e0270b8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:44.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.371+0000 7f26a3b18740 4 client.25385 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:30:44.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.371+0000 7f26a3b18740 1 -- 172.21.15.33:0/602344598 --> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f269006f040 con 0x55e0270b5d40 2024-09-12T12:30:44.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.374+0000 7f269a7fc640 1 --2- 172.21.15.33:0/602344598 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x55e0270b5d40 0x55e0270b8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:44.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.380+0000 7f269a7fc640 1 --2- 172.21.15.33:0/602344598 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x55e0270b5d40 0x55e0270b8130 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9d031ae379aa9cdc server_cookie=60cef035e0be7b9 in_seq=0 out_seq=0 2024-09-12T12:30:44.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.381+0000 7f267eff5640 10 client.25385 ms_handle_connect on v2:172.21.15.102:6834/4179527539 2024-09-12T12:30:44.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.381+0000 7f267eff5640 1 -- 172.21.15.33:0/602344598 <== mds.2 v2:172.21.15.102:6834/4179527539 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f269006f040 con 0x55e0270b5d40 2024-09-12T12:30:44.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.381+0000 7f267eff5640 10 client.25385 handle_command_reply: tid=0 2024-09-12T12:30:44.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.381+0000 7f26a3b18740 1 client.25385 shutdown 2024-09-12T12:30:44.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.382+0000 7f26a3b18740 1 -- 172.21.15.33:0/602344598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e02701f780 msgr2=0x55e027033ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:44.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.382+0000 7f26a3b18740 1 --2- 172.21.15.33:0/602344598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e02701f780 0x55e027033ac0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f26900984e0 tx=0x7f2690004720 comp rx=0 tx=0).stop 2024-09-12T12:30:44.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.383+0000 7f26a3b18740 1 -- 172.21.15.33:0/602344598 shutdown_connections 2024-09-12T12:30:44.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.383+0000 7f26a3b18740 1 --2- 172.21.15.33:0/602344598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e02703b530 0x55e02702de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:44.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.383+0000 7f26a3b18740 1 --2- 172.21.15.33:0/602344598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e027020cf0 0x55e027034000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:44.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.383+0000 7f26a3b18740 1 --2- 172.21.15.33:0/602344598 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x55e0270b5d40 0x55e0270b8130 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:44.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.383+0000 7f26a3b18740 1 --2- 172.21.15.33:0/602344598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e02701f780 0x55e027033ac0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:44.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.383+0000 7f267eff5640 0 client.25385 ms_handle_reset on v2:172.21.15.102:6834/4179527539 2024-09-12T12:30:44.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.383+0000 7f26a3b18740 1 -- 172.21.15.33:0/602344598 >> 172.21.15.33:0/602344598 conn(0x55e026fe8310 msgr2=0x55e027025c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:30:44.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.383+0000 7f26a3b18740 1 -- 172.21.15.33:0/602344598 shutdown_connections 2024-09-12T12:30:44.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.385+0000 7f26a3b18740 1 -- 172.21.15.33:0/602344598 wait complete. 2024-09-12T12:30:44.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.385+0000 7f26a3b18740 20 client.25385 trim_cache size 0 max 16384 2024-09-12T12:30:44.386 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-09-12T12:30:44.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.387+0000 7f26a173f640 1 -- 172.21.15.33:0/415723163 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f26840a2d20 msgr2=0x7f26840a51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:44.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.387+0000 7f26a173f640 1 --2- 172.21.15.33:0/415723163 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f26840a2d20 0x7f26840a51e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f269c050280 tx=0x7f269c077040 comp rx=0 tx=0).stop 2024-09-12T12:30:44.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.387+0000 7f26a173f640 1 -- 172.21.15.33:0/415723163 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2694006590 msgr2=0x7f26940a1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:44.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.387+0000 7f26a173f640 1 --2- 172.21.15.33:0/415723163 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2694006590 0x7f26940a1890 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2690009fd0 tx=0x7f269000b870 comp rx=0 tx=0).stop 2024-09-12T12:30:44.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.387+0000 7f26a173f640 1 -- 172.21.15.33:0/415723163 shutdown_connections 2024-09-12T12:30:44.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.387+0000 7f26a173f640 1 --2- 172.21.15.33:0/415723163 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f26840a2d20 0x7f26840a51e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:44.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.388+0000 7f26a173f640 1 --2- 172.21.15.33:0/415723163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26940a1f60 0x7f269409ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:44.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.388+0000 7f26a173f640 1 --2- 172.21.15.33:0/415723163 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f26940964e0 0x7f269409e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:44.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.388+0000 7f26a173f640 1 --2- 172.21.15.33:0/415723163 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2694006590 0x7f26940a1890 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:44.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.388+0000 7f26a173f640 1 -- 172.21.15.33:0/415723163 >> 172.21.15.33:0/415723163 conn(0x7f269400b440 msgr2=0x7f26940a2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:30:44.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.389+0000 7f26a173f640 1 -- 172.21.15.33:0/415723163 shutdown_connections 2024-09-12T12:30:44.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:44.389+0000 7f26a173f640 1 -- 172.21.15.33:0/415723163 wait complete. 2024-09-12T12:30:45.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:30:45 smithi033 ceph-mon[31246]: pgmap v492: 129 pgs: 129 active+clean; 10 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 47 MiB/s wr, 759 op/s 2024-09-12T12:30:45.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:30:45 smithi043 ceph-mon[34144]: pgmap v492: 129 pgs: 129 active+clean; 10 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 47 MiB/s wr, 759 op/s 2024-09-12T12:30:45.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:30:45 smithi102 ceph-mon[34799]: pgmap v492: 129 pgs: 129 active+clean; 10 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 47 MiB/s wr, 759 op/s 2024-09-12T12:30:47.730 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:30:47 smithi033 ceph-mon[31246]: pgmap v493: 129 pgs: 129 active+clean; 10 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 39 MiB/s wr, 635 op/s 2024-09-12T12:30:47.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:30:47 smithi043 ceph-mon[34144]: pgmap v493: 129 pgs: 129 active+clean; 10 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 39 MiB/s wr, 635 op/s 2024-09-12T12:30:47.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:30:47 smithi102 ceph-mon[34799]: pgmap v493: 129 pgs: 129 active+clean; 10 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 39 MiB/s wr, 635 op/s 2024-09-12T12:30:49.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:30:49 smithi033 ceph-mon[31246]: pgmap v494: 129 pgs: 129 active+clean; 10 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 50 MiB/s wr, 802 op/s 2024-09-12T12:30:49.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:30:49 smithi043 ceph-mon[34144]: pgmap v494: 129 pgs: 129 active+clean; 10 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 50 MiB/s wr, 802 op/s 2024-09-12T12:30:49.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:30:49 smithi102 ceph-mon[34799]: pgmap v494: 129 pgs: 129 active+clean; 10 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 50 MiB/s wr, 802 op/s 2024-09-12T12:30:50.034 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T12:30:50.628 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:30:51.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:30:51 smithi033 ceph-mon[31246]: pgmap v495: 129 pgs: 129 active+clean; 10 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 39 MiB/s wr, 627 op/s 2024-09-12T12:30:51.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:30:51 smithi043 ceph-mon[34144]: pgmap v495: 129 pgs: 129 active+clean; 10 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 39 MiB/s wr, 627 op/s 2024-09-12T12:30:51.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:30:51 smithi102 ceph-mon[34799]: pgmap v495: 129 pgs: 129 active+clean; 10 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 39 MiB/s wr, 627 op/s 2024-09-12T12:30:53.733 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:30:53 smithi033 ceph-mon[31246]: pgmap v496: 129 pgs: 129 active+clean; 10 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 41 MiB/s wr, 661 op/s 2024-09-12T12:30:53.805 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-09-12T12:30:53.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.387+0000 7fd2d9f30640 1 -- 172.21.15.33:0/2628780658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2d4106f50 msgr2=0x7fd2d410eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:53.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.387+0000 7fd2d9f30640 1 --2- 172.21.15.33:0/2628780658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2d4106f50 0x7fd2d410eaf0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc009cd0 tx=0x7fd2cc02a8e0 comp rx=0 tx=0).stop 2024-09-12T12:30:53.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.387+0000 7fd2d9f30640 1 -- 172.21.15.33:0/2628780658 shutdown_connections 2024-09-12T12:30:53.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.387+0000 7fd2d9f30640 1 --2- 172.21.15.33:0/2628780658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2d4106f50 0x7fd2d410eaf0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:53.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.387+0000 7fd2d9f30640 1 --2- 172.21.15.33:0/2628780658 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2d4100ca0 0x7fd2d4106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:53.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.387+0000 7fd2d9f30640 1 --2- 172.21.15.33:0/2628780658 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2d41002f0 0x7fd2d41006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:53.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.387+0000 7fd2d9f30640 1 -- 172.21.15.33:0/2628780658 >> 172.21.15.33:0/2628780658 conn(0x7fd2d4077210 msgr2=0x7fd2d40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:30:53.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.387+0000 7fd2d9f30640 1 -- 172.21.15.33:0/2628780658 shutdown_connections 2024-09-12T12:30:53.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.387+0000 7fd2d9f30640 1 -- 172.21.15.33:0/2628780658 wait complete. 2024-09-12T12:30:53.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.388+0000 7fd2d9f30640 1 Processor -- start 2024-09-12T12:30:53.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.388+0000 7fd2d9f30640 1 -- start start 2024-09-12T12:30:53.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.388+0000 7fd2d9f30640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2d41002f0 0x7fd2d4198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:53.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.388+0000 7fd2d9f30640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2d4100ca0 0x7fd2d41988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:53.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.388+0000 7fd2d9f30640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2d4106f50 0x7fd2d419cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:53.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.388+0000 7fd2d9f30640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d4111e50 con 0x7fd2d41002f0 2024-09-12T12:30:53.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.388+0000 7fd2d9f30640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d4111cd0 con 0x7fd2d4106f50 2024-09-12T12:30:53.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.388+0000 7fd2d9f30640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d4111fd0 con 0x7fd2d4100ca0 2024-09-12T12:30:53.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.389+0000 7fd2d37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2d41002f0 0x7fd2d4198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:53.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.389+0000 7fd2d37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2d41002f0 0x7fd2d4198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49264/0 (socket says 172.21.15.33:49264) 2024-09-12T12:30:53.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.389+0000 7fd2d37fe640 1 -- 172.21.15.33:0/3772061272 learned_addr learned my addr 172.21.15.33:0/3772061272 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:30:53.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.389+0000 7fd2caffd640 1 --2- 172.21.15.33:0/3772061272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2d4100ca0 0x7fd2d41988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:53.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.389+0000 7fd2d3fff640 1 --2- 172.21.15.33:0/3772061272 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2d4106f50 0x7fd2d419cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:53.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.389+0000 7fd2d37fe640 1 -- 172.21.15.33:0/3772061272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2d4100ca0 msgr2=0x7fd2d41988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:53.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.389+0000 7fd2d37fe640 1 --2- 172.21.15.33:0/3772061272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2d4100ca0 0x7fd2d41988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:53.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.389+0000 7fd2d37fe640 1 -- 172.21.15.33:0/3772061272 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2d4106f50 msgr2=0x7fd2d419cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:53.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.389+0000 7fd2d37fe640 1 --2- 172.21.15.33:0/3772061272 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2d4106f50 0x7fd2d419cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:53.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.389+0000 7fd2d37fe640 1 -- 172.21.15.33:0/3772061272 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2d419d340 con 0x7fd2d41002f0 2024-09-12T12:30:53.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.389+0000 7fd2caffd640 1 --2- 172.21.15.33:0/3772061272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2d4100ca0 0x7fd2d41988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:30:53.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.389+0000 7fd2d3fff640 1 --2- 172.21.15.33:0/3772061272 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2d4106f50 0x7fd2d419cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:30:53.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.389+0000 7fd2d37fe640 1 --2- 172.21.15.33:0/3772061272 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2d41002f0 0x7fd2d4198390 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd2c400e9f0 tx=0x7fd2c400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:30:53.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.389+0000 7fd2d17fa640 1 -- 172.21.15.33:0/3772061272 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c400cd80 con 0x7fd2d41002f0 2024-09-12T12:30:53.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.389+0000 7fd2d17fa640 1 -- 172.21.15.33:0/3772061272 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd2c40108e0 con 0x7fd2d41002f0 2024-09-12T12:30:53.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.389+0000 7fd2d9f30640 1 -- 172.21.15.33:0/3772061272 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2d419d630 con 0x7fd2d41002f0 2024-09-12T12:30:53.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.389+0000 7fd2d17fa640 1 -- 172.21.15.33:0/3772061272 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c4018920 con 0x7fd2d41002f0 2024-09-12T12:30:53.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.389+0000 7fd2d9f30640 1 -- 172.21.15.33:0/3772061272 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2d41a4f10 con 0x7fd2d41002f0 2024-09-12T12:30:53.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.392+0000 7fd2d17fa640 1 -- 172.21.15.33:0/3772061272 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd2c4010a90 con 0x7fd2d41002f0 2024-09-12T12:30:53.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.392+0000 7fd2dc309740 1 Processor -- start 2024-09-12T12:30:53.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.392+0000 7fd2dc309740 1 -- start start 2024-09-12T12:30:53.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.392+0000 7fd2dc309740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563de66f9b40 0x563de66f8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:53.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.392+0000 7fd2dc309740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563de66f85d0 0x563de66f8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:53.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.392+0000 7fd2dc309740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563de6703370 0x563de6705760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:53.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.392+0000 7fd2dc309740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x563de665e2f0 con 0x563de66f85d0 2024-09-12T12:30:53.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.392+0000 7fd2dc309740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x563de6605cf0 con 0x563de6703370 2024-09-12T12:30:53.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.392+0000 7fd2dc309740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x563de665a2b0 con 0x563de66f9b40 2024-09-12T12:30:53.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.392+0000 7fd2d37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563de66f85d0 0x563de66f8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:53.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.392+0000 7fd2d37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563de66f85d0 0x563de66f8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49274/0 (socket says 172.21.15.33:49274) 2024-09-12T12:30:53.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.392+0000 7fd2d37fe640 1 -- 172.21.15.33:0/3204030504 learned_addr learned my addr 172.21.15.33:0/3204030504 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:30:53.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.392+0000 7fd2d3fff640 1 --2- 172.21.15.33:0/3204030504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563de66f9b40 0x563de66f8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:53.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.392+0000 7fd2caffd640 1 --2- 172.21.15.33:0/3204030504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563de6703370 0x563de6705760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:53.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.393+0000 7fd2d17fa640 1 --2- 172.21.15.33:0/3772061272 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd2c00a2b80 0x7fd2c00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:53.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.393+0000 7fd2d37fe640 1 -- 172.21.15.33:0/3204030504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563de66f9b40 msgr2=0x563de66f8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:30:53.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.393+0000 7fd2d37fe640 1 --2- 172.21.15.33:0/3204030504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563de66f9b40 0x563de66f8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:53.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.393+0000 7fd2d37fe640 1 -- 172.21.15.33:0/3204030504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563de6703370 msgr2=0x563de6705760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:30:53.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.393+0000 7fd2d37fe640 1 --2- 172.21.15.33:0/3204030504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563de6703370 0x563de6705760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:53.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.393+0000 7fd2d37fe640 1 -- 172.21.15.33:0/3204030504 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563de65ea3a0 con 0x563de66f85d0 2024-09-12T12:30:53.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.393+0000 7fd2d3fff640 1 --2- 172.21.15.33:0/3204030504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563de66f9b40 0x563de66f8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:30:53.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.393+0000 7fd2d3fff640 1 --2- 172.21.15.33:0/3772061272 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd2c00a2b80 0x7fd2c00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:53.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.393+0000 7fd2d37fe640 1 --2- 172.21.15.33:0/3204030504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563de66f85d0 0x563de66f8a10 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd2c40b7e50 tx=0x7fd2c40d5f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2c793012decb573 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:30:53.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.393+0000 7fd2d17fa640 1 -- 172.21.15.33:0/3772061272 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fd2c40cf750 con 0x7fd2d41002f0 2024-09-12T12:30:53.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.393+0000 7fd2c9ffb640 1 -- 172.21.15.33:0/3204030504 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c4026030 con 0x563de66f85d0 2024-09-12T12:30:53.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.393+0000 7fd2c9ffb640 1 -- 172.21.15.33:0/3204030504 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd2c40b5b00 con 0x563de66f85d0 2024-09-12T12:30:53.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.393+0000 7fd2c9ffb640 1 -- 172.21.15.33:0/3204030504 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c409c320 con 0x563de66f85d0 2024-09-12T12:30:53.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.394+0000 7fd2dc309740 1 -- 172.21.15.33:0/3204030504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563de66f85d0 msgr2=0x563de66f8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:53.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.394+0000 7fd2d3fff640 1 --2- 172.21.15.33:0/3772061272 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd2c00a2b80 0x7fd2c00a5040 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc004af0 tx=0x7fd2cc03f040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:30:53.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.394+0000 7fd2dc309740 1 --2- 172.21.15.33:0/3204030504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563de66f85d0 0x563de66f8a10 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd2c40b7e50 tx=0x7fd2c40d5f60 comp rx=0 tx=0).stop 2024-09-12T12:30:53.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.394+0000 7fd2dc309740 1 -- 172.21.15.33:0/3204030504 shutdown_connections 2024-09-12T12:30:53.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.394+0000 7fd2dc309740 1 --2- 172.21.15.33:0/3204030504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563de6703370 0x563de6705760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:53.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.394+0000 7fd2dc309740 1 --2- 172.21.15.33:0/3204030504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563de66f85d0 0x563de66f8a10 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:53.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.394+0000 7fd2dc309740 1 --2- 172.21.15.33:0/3204030504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563de66f9b40 0x563de66f8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:53.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.394+0000 7fd2dc309740 1 -- 172.21.15.33:0/3204030504 >> 172.21.15.33:0/3204030504 conn(0x563de66c1310 msgr2=0x563de66f4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:30:53.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.394+0000 7fd2dc309740 1 -- 172.21.15.33:0/3204030504 shutdown_connections 2024-09-12T12:30:53.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.394+0000 7fd2dc309740 1 -- 172.21.15.33:0/3204030504 wait complete. 2024-09-12T12:30:53.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.394+0000 7fd2dc309740 1 -- start start 2024-09-12T12:30:53.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.395+0000 7fd2dc309740 1 Processor -- start 2024-09-12T12:30:53.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.395+0000 7fd2dc309740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563de66f85d0 0x563de6702e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:53.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.395+0000 7fd2dc309740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563de66f9b40 0x563de67000b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:53.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.395+0000 7fd2dc309740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563de6703370 0x563de6700840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:53.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.395+0000 7fd2dc309740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x563de6706070 con 0x563de66f9b40 2024-09-12T12:30:53.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.395+0000 7fd2dc309740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x563de6619060 con 0x563de6703370 2024-09-12T12:30:53.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.395+0000 7fd2d37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563de66f85d0 0x563de6702e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:53.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.395+0000 7fd2caffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563de66f9b40 0x563de67000b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:53.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.395+0000 7fd2dc309740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x563de67061f0 con 0x563de66f85d0 2024-09-12T12:30:53.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.395+0000 7fd2d37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563de66f85d0 0x563de6702e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:49932/0 (socket says 172.21.15.33:49932) 2024-09-12T12:30:53.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.395+0000 7fd2caffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563de66f9b40 0x563de67000b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49284/0 (socket says 172.21.15.33:49284) 2024-09-12T12:30:53.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.395+0000 7fd2caffd640 1 -- 172.21.15.33:0/2069218325 learned_addr learned my addr 172.21.15.33:0/2069218325 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:30:53.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.396+0000 7fd2d3fff640 1 --2- 172.21.15.33:0/2069218325 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563de6703370 0x563de6700840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:53.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.396+0000 7fd2dc309740 10 client.0 _ll_register_callbacks cb 0x563de636c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:30:53.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.396+0000 7fd2caffd640 1 -- 172.21.15.33:0/2069218325 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563de66f85d0 msgr2=0x563de6702e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:30:53.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.396+0000 7fd2caffd640 1 --2- 172.21.15.33:0/2069218325 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563de66f85d0 0x563de6702e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:53.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.396+0000 7fd2caffd640 1 -- 172.21.15.33:0/2069218325 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563de6703370 msgr2=0x563de6700840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:30:53.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.396+0000 7fd2caffd640 1 --2- 172.21.15.33:0/2069218325 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563de6703370 0x563de6700840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:53.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.396+0000 7fd2caffd640 1 -- 172.21.15.33:0/2069218325 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563de63cf3c0 con 0x563de66f9b40 2024-09-12T12:30:53.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.396+0000 7fd2d37fe640 1 --2- 172.21.15.33:0/2069218325 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563de66f85d0 0x563de6702e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:30:53.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.396+0000 7fd2dc309740 1 -- 172.21.15.33:0/2069218325 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563de666b860 con 0x563de66f9b40 2024-09-12T12:30:53.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.396+0000 7fd2caffd640 1 --2- 172.21.15.33:0/2069218325 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563de66f9b40 0x563de67000b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc012d20 tx=0x7fd2bc00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65cd618f064c1101 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:30:53.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.396+0000 7fd2b2ffd640 10 client.15762 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:30:53.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.396+0000 7fd2b2ffd640 1 -- 172.21.15.33:0/2069218325 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc0120d0 con 0x563de66f9b40 2024-09-12T12:30:53.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.396+0000 7fd2b2ffd640 1 -- 172.21.15.33:0/2069218325 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fd2bc0047a0 con 0x563de66f9b40 2024-09-12T12:30:53.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.396+0000 7fd2b2ffd640 1 -- 172.21.15.33:0/2069218325 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd2bc0049a0 con 0x563de66f9b40 2024-09-12T12:30:53.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.396+0000 7fd2dc309740 10 client.15762 fetch_fsmap learned FSMap version 27 2024-09-12T12:30:53.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.396+0000 7fd2dc309740 1 -- 172.21.15.33:0/2069218325 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({fsmap=27}) -- 0x563de6711b50 con 0x563de66f9b40 2024-09-12T12:30:53.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.397+0000 7fd2b2ffd640 1 -- 172.21.15.33:0/2069218325 <== mon.0 v2:172.21.15.33:3300/0 4 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fd2bc004b40 con 0x563de66f9b40 2024-09-12T12:30:53.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.397+0000 7fd2dc309740 10 client.15762 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:30:53.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.397+0000 7fd2dc309740 10 client.15762 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-12T12:30:53.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.397+0000 7fd2dc309740 20 client.15762 populate_metadata read hostname 'smithi033' 2024-09-12T12:30:53.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.397+0000 7fd2dc309740 1 --2- 172.21.15.33:0/2069218325 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x563de6712f00 0x563de67152f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:53.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.397+0000 7fd2dc309740 4 client.15762 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:30:53.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.397+0000 7fd2dc309740 1 -- 172.21.15.33:0/2069218325 --> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563de6665d70 con 0x563de6712f00 2024-09-12T12:30:53.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.397+0000 7fd2d37fe640 1 --2- 172.21.15.33:0/2069218325 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x563de6712f00 0x563de67152f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:53.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.397+0000 7fd2d37fe640 1 --2- 172.21.15.33:0/2069218325 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x563de6712f00 0x563de67152f0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=80df7da21de68690 server_cookie=56643bbdc38cde23 in_seq=0 out_seq=0 2024-09-12T12:30:53.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.397+0000 7fd2b2ffd640 10 client.15762 ms_handle_connect on v2:172.21.15.102:6836/2409953270 2024-09-12T12:30:53.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.398+0000 7fd2b2ffd640 1 -- 172.21.15.33:0/2069218325 <== mds.1 v2:172.21.15.102:6836/2409953270 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563de6665d70 con 0x563de6712f00 2024-09-12T12:30:53.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.398+0000 7fd2b2ffd640 10 client.15762 handle_command_reply: tid=0 2024-09-12T12:30:53.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.398+0000 7fd2dc309740 1 client.15762 shutdown 2024-09-12T12:30:53.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.398+0000 7fd2dc309740 1 -- 172.21.15.33:0/2069218325 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563de66f9b40 msgr2=0x563de67000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:53.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.398+0000 7fd2dc309740 1 --2- 172.21.15.33:0/2069218325 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563de66f9b40 0x563de67000b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc012d20 tx=0x7fd2bc00f790 comp rx=0 tx=0).stop 2024-09-12T12:30:53.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.398+0000 7fd2dc309740 1 -- 172.21.15.33:0/2069218325 shutdown_connections 2024-09-12T12:30:53.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.398+0000 7fd2dc309740 1 --2- 172.21.15.33:0/2069218325 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563de6703370 0x563de6700840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:53.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.398+0000 7fd2dc309740 1 --2- 172.21.15.33:0/2069218325 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563de66f9b40 0x563de67000b0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:53.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.398+0000 7fd2dc309740 1 --2- 172.21.15.33:0/2069218325 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x563de6712f00 0x563de67152f0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:53.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.398+0000 7fd2dc309740 1 --2- 172.21.15.33:0/2069218325 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563de66f85d0 0x563de6702e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:53.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.398+0000 7fd2b2ffd640 0 client.15762 ms_handle_reset on v2:172.21.15.102:6836/2409953270 2024-09-12T12:30:53.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.398+0000 7fd2dc309740 1 -- 172.21.15.33:0/2069218325 >> 172.21.15.33:0/2069218325 conn(0x563de66c1310 msgr2=0x563de66fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:30:53.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.399+0000 7fd2dc309740 1 -- 172.21.15.33:0/2069218325 shutdown_connections 2024-09-12T12:30:53.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.399+0000 7fd2dc309740 1 -- 172.21.15.33:0/2069218325 wait complete. 2024-09-12T12:30:53.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.399+0000 7fd2dc309740 20 client.15762 trim_cache size 0 max 16384 2024-09-12T12:30:53.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.412+0000 7fd2dc309740 1 Processor -- start 2024-09-12T12:30:53.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.412+0000 7fd2dc309740 1 -- start start 2024-09-12T12:30:53.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.412+0000 7fd2dc309740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563de66f85d0 0x563de66fb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:53.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.412+0000 7fd2dc309740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563de66f9b40 0x563de66fb660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:53.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.412+0000 7fd2dc309740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563de6703370 0x563de671ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:53.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.412+0000 7fd2dc309740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d41b14e0 con 0x563de66f9b40 2024-09-12T12:30:53.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.412+0000 7fd2dc309740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d41aedb0 con 0x563de6703370 2024-09-12T12:30:53.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.412+0000 7fd2dc309740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d41acc00 con 0x563de66f85d0 2024-09-12T12:30:53.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.412+0000 7fd2caffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563de66f9b40 0x563de66fb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:53.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.412+0000 7fd2d37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563de66f85d0 0x563de66fb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:53.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.412+0000 7fd2d3fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563de6703370 0x563de671ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:53.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.412+0000 7fd2caffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563de66f9b40 0x563de66fb660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49288/0 (socket says 172.21.15.33:49288) 2024-09-12T12:30:53.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.412+0000 7fd2caffd640 1 -- 172.21.15.33:0/1807823547 learned_addr learned my addr 172.21.15.33:0/1807823547 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:30:53.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.413+0000 7fd2d37fe640 1 -- 172.21.15.33:0/1807823547 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563de6703370 msgr2=0x563de671ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:30:53.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.413+0000 7fd2d37fe640 1 --2- 172.21.15.33:0/1807823547 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563de6703370 0x563de671ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:53.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.413+0000 7fd2d37fe640 1 -- 172.21.15.33:0/1807823547 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563de66f9b40 msgr2=0x563de66fb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:30:53.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.413+0000 7fd2d37fe640 1 --2- 172.21.15.33:0/1807823547 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563de66f9b40 0x563de66fb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:53.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.413+0000 7fd2d37fe640 1 -- 172.21.15.33:0/1807823547 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563de6703170 con 0x563de66f85d0 2024-09-12T12:30:53.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.413+0000 7fd2d37fe640 1 --2- 172.21.15.33:0/1807823547 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563de66f85d0 0x563de66fb120 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd2c40985f0 tx=0x7fd2c4010de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4eb1be04b39e921e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:30:53.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.415+0000 7fd2c97fa640 1 -- 172.21.15.33:0/1807823547 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c409b580 con 0x563de66f85d0 2024-09-12T12:30:53.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.415+0000 7fd2c97fa640 1 -- 172.21.15.33:0/1807823547 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd2c409c320 con 0x563de66f85d0 2024-09-12T12:30:53.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.415+0000 7fd2c97fa640 1 -- 172.21.15.33:0/1807823547 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c4099f20 con 0x563de66f85d0 2024-09-12T12:30:53.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.416+0000 7fd2dc309740 1 -- 172.21.15.33:0/1807823547 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563de66f85d0 msgr2=0x563de66fb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:53.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.416+0000 7fd2dc309740 1 --2- 172.21.15.33:0/1807823547 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563de66f85d0 0x563de66fb120 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd2c40985f0 tx=0x7fd2c4010de0 comp rx=0 tx=0).stop 2024-09-12T12:30:53.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.416+0000 7fd2dc309740 1 -- 172.21.15.33:0/1807823547 shutdown_connections 2024-09-12T12:30:53.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.416+0000 7fd2dc309740 1 --2- 172.21.15.33:0/1807823547 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563de6703370 0x563de671ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:53.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.416+0000 7fd2dc309740 1 --2- 172.21.15.33:0/1807823547 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563de66f9b40 0x563de66fb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:53.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.416+0000 7fd2dc309740 1 --2- 172.21.15.33:0/1807823547 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563de66f85d0 0x563de66fb120 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:53.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.416+0000 7fd2dc309740 1 -- 172.21.15.33:0/1807823547 >> 172.21.15.33:0/1807823547 conn(0x563de66c1310 msgr2=0x563de66ff1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:30:53.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.416+0000 7fd2dc309740 1 -- 172.21.15.33:0/1807823547 shutdown_connections 2024-09-12T12:30:53.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.416+0000 7fd2dc309740 1 -- 172.21.15.33:0/1807823547 wait complete. 2024-09-12T12:30:53.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.416+0000 7fd2dc309740 1 -- start start 2024-09-12T12:30:53.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.416+0000 7fd2dc309740 1 Processor -- start 2024-09-12T12:30:53.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.417+0000 7fd2dc309740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563de66f85d0 0x563de670b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:53.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.417+0000 7fd2dc309740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563de66f9b40 0x563de66fcb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:53.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.417+0000 7fd2dc309740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563de6703370 0x563de66fd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:53.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.417+0000 7fd2dc309740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d41ad270 con 0x563de66f85d0 2024-09-12T12:30:53.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.417+0000 7fd2dc309740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d41ae6e0 con 0x563de6703370 2024-09-12T12:30:53.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.417+0000 7fd2dc309740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d41ad940 con 0x563de66f9b40 2024-09-12T12:30:53.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.417+0000 7fd2dc309740 10 client.0 _ll_register_callbacks cb 0x7fd2bc009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:30:53.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.417+0000 7fd2d37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563de66f85d0 0x563de670b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:53.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.417+0000 7fd2d37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563de66f85d0 0x563de670b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49304/0 (socket says 172.21.15.33:49304) 2024-09-12T12:30:53.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.417+0000 7fd2d37fe640 1 -- 172.21.15.33:0/2676745550 learned_addr learned my addr 172.21.15.33:0/2676745550 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:30:53.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.417+0000 7fd2d3fff640 1 --2- 172.21.15.33:0/2676745550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563de6703370 0x563de66fd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:53.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.417+0000 7fd2caffd640 1 --2- 172.21.15.33:0/2676745550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563de66f9b40 0x563de66fcb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:53.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.417+0000 7fd2d37fe640 1 -- 172.21.15.33:0/2676745550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563de66f9b40 msgr2=0x563de66fcb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:30:53.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.417+0000 7fd2d37fe640 1 --2- 172.21.15.33:0/2676745550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563de66f9b40 0x563de66fcb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:53.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.417+0000 7fd2d37fe640 1 -- 172.21.15.33:0/2676745550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563de6703370 msgr2=0x563de66fd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:30:53.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.417+0000 7fd2d37fe640 1 --2- 172.21.15.33:0/2676745550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563de6703370 0x563de66fd0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:53.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.417+0000 7fd2d37fe640 1 -- 172.21.15.33:0/2676745550 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563de66fd690 con 0x563de66f85d0 2024-09-12T12:30:53.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.417+0000 7fd2d3fff640 1 --2- 172.21.15.33:0/2676745550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563de6703370 0x563de66fd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:30:53.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.417+0000 7fd2d37fe640 1 --2- 172.21.15.33:0/2676745550 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563de66f85d0 0x563de670b950 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd2c40985a0 tx=0x7fd2c40cfad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1210167b74280661 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:30:53.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.417+0000 7fd2b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:30:53.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.417+0000 7fd2b2ffd640 1 -- 172.21.15.33:0/2676745550 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c409b580 con 0x563de66f85d0 2024-09-12T12:30:53.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.417+0000 7fd2dc309740 1 -- 172.21.15.33:0/2676745550 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2c409c320 con 0x563de66f85d0 2024-09-12T12:30:53.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.417+0000 7fd2b2ffd640 1 -- 172.21.15.33:0/2676745550 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fd2c40afe00 con 0x563de66f85d0 2024-09-12T12:30:53.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.418+0000 7fd2b2ffd640 1 -- 172.21.15.33:0/2676745550 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd2c409bc20 con 0x563de66f85d0 2024-09-12T12:30:53.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.418+0000 7fd2dc309740 10 client.15768 fetch_fsmap learned FSMap version 27 2024-09-12T12:30:53.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.418+0000 7fd2dc309740 1 -- 172.21.15.33:0/2676745550 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563de677d8d0 con 0x563de66f85d0 2024-09-12T12:30:53.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.418+0000 7fd2b2ffd640 1 -- 172.21.15.33:0/2676745550 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd2c409c320 con 0x563de66f85d0 2024-09-12T12:30:53.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.418+0000 7fd2b2ffd640 1 -- 172.21.15.33:0/2676745550 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fd2c4097970 con 0x563de66f85d0 2024-09-12T12:30:53.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.418+0000 7fd2dc309740 10 client.15768 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:30:53.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.418+0000 7fd2dc309740 10 client.15768 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-12T12:30:53.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.418+0000 7fd2dc309740 20 client.15768 populate_metadata read hostname 'smithi033' 2024-09-12T12:30:53.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.418+0000 7fd2dc309740 1 --2- 172.21.15.33:0/2676745550 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x563de6712f00 0x563de677fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:53.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.418+0000 7fd2dc309740 4 client.15768 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:30:53.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.418+0000 7fd2dc309740 1 -- 172.21.15.33:0/2676745550 --> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563de65e2170 con 0x563de6712f00 2024-09-12T12:30:53.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.418+0000 7fd2caffd640 1 --2- 172.21.15.33:0/2676745550 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x563de6712f00 0x563de677fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:53.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.419+0000 7fd2b2ffd640 10 client.15768 ms_handle_connect on v2:172.21.15.102:6836/2409953270 2024-09-12T12:30:53.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.419+0000 7fd2caffd640 1 --2- 172.21.15.33:0/2676745550 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x563de6712f00 0x563de677fb00 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=373d81a3f11f215e server_cookie=aa2ca8660b1aaf1 in_seq=0 out_seq=0 2024-09-12T12:30:53.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.419+0000 7fd2b2ffd640 1 -- 172.21.15.33:0/2676745550 <== mds.1 v2:172.21.15.102:6836/2409953270 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563de65e2170 con 0x563de6712f00 2024-09-12T12:30:53.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.419+0000 7fd2b2ffd640 10 client.15768 handle_command_reply: tid=0 2024-09-12T12:30:53.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.419+0000 7fd2dc309740 1 client.15768 shutdown 2024-09-12T12:30:53.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.419+0000 7fd2dc309740 1 -- 172.21.15.33:0/2676745550 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563de66f85d0 msgr2=0x563de670b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:53.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.419+0000 7fd2dc309740 1 --2- 172.21.15.33:0/2676745550 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563de66f85d0 0x563de670b950 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd2c40985a0 tx=0x7fd2c40cfad0 comp rx=0 tx=0).stop 2024-09-12T12:30:53.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.419+0000 7fd2dc309740 1 -- 172.21.15.33:0/2676745550 shutdown_connections 2024-09-12T12:30:53.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.419+0000 7fd2dc309740 1 --2- 172.21.15.33:0/2676745550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563de6703370 0x563de66fd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:53.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.419+0000 7fd2dc309740 1 --2- 172.21.15.33:0/2676745550 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x563de6712f00 0x563de677fb00 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:53.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.419+0000 7fd2dc309740 1 --2- 172.21.15.33:0/2676745550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563de66f9b40 0x563de66fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:53.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.419+0000 7fd2dc309740 1 --2- 172.21.15.33:0/2676745550 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563de66f85d0 0x563de670b950 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:53.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.419+0000 7fd2b2ffd640 0 client.15768 ms_handle_reset on v2:172.21.15.102:6836/2409953270 2024-09-12T12:30:53.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.419+0000 7fd2dc309740 1 -- 172.21.15.33:0/2676745550 >> 172.21.15.33:0/2676745550 conn(0x563de66c1310 msgr2=0x563de670e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:30:53.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.419+0000 7fd2dc309740 1 -- 172.21.15.33:0/2676745550 shutdown_connections 2024-09-12T12:30:53.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.419+0000 7fd2dc309740 1 -- 172.21.15.33:0/2676745550 wait complete. 2024-09-12T12:30:53.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.419+0000 7fd2dc309740 20 client.15768 trim_cache size 0 max 16384 2024-09-12T12:30:53.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.420+0000 7fd2d9f30640 1 -- 172.21.15.33:0/3772061272 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd2c00a2b80 msgr2=0x7fd2c00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:53.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.420+0000 7fd2d9f30640 1 --2- 172.21.15.33:0/3772061272 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd2c00a2b80 0x7fd2c00a5040 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc004af0 tx=0x7fd2cc03f040 comp rx=0 tx=0).stop 2024-09-12T12:30:53.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.420+0000 7fd2d9f30640 1 -- 172.21.15.33:0/3772061272 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2d41002f0 msgr2=0x7fd2d4198390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:53.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.420+0000 7fd2d9f30640 1 --2- 172.21.15.33:0/3772061272 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2d41002f0 0x7fd2d4198390 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd2c400e9f0 tx=0x7fd2c400eeb0 comp rx=0 tx=0).stop 2024-09-12T12:30:53.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.420+0000 7fd2d9f30640 1 -- 172.21.15.33:0/3772061272 shutdown_connections 2024-09-12T12:30:53.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.420+0000 7fd2d9f30640 1 --2- 172.21.15.33:0/3772061272 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd2c00a2b80 0x7fd2c00a5040 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:53.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.420+0000 7fd2d9f30640 1 --2- 172.21.15.33:0/3772061272 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2d4106f50 0x7fd2d419cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:53.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.420+0000 7fd2d9f30640 1 --2- 172.21.15.33:0/3772061272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2d4100ca0 0x7fd2d41988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:53.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.420+0000 7fd2d9f30640 1 --2- 172.21.15.33:0/3772061272 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2d41002f0 0x7fd2d4198390 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:53.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.420+0000 7fd2d9f30640 1 -- 172.21.15.33:0/3772061272 >> 172.21.15.33:0/3772061272 conn(0x7fd2d4077210 msgr2=0x7fd2d41052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:30:53.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.420+0000 7fd2d9f30640 1 -- 172.21.15.33:0/3772061272 shutdown_connections 2024-09-12T12:30:53.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:52.420+0000 7fd2d9f30640 1 -- 172.21.15.33:0/3772061272 wait complete. 2024-09-12T12:30:53.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:30:53 smithi043 ceph-mon[34144]: pgmap v496: 129 pgs: 129 active+clean; 10 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 41 MiB/s wr, 661 op/s 2024-09-12T12:30:53.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:30:53 smithi102 ceph-mon[34799]: pgmap v496: 129 pgs: 129 active+clean; 10 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 41 MiB/s wr, 661 op/s 2024-09-12T12:30:55.080 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T12:30:55.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:30:55 smithi033 ceph-mon[31246]: pgmap v497: 129 pgs: 129 active+clean; 10 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 43 MiB/s wr, 697 op/s 2024-09-12T12:30:55.777 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:30:55.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:30:55 smithi043 ceph-mon[34144]: pgmap v497: 129 pgs: 129 active+clean; 10 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 43 MiB/s wr, 697 op/s 2024-09-12T12:30:55.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:30:55 smithi102 ceph-mon[34799]: pgmap v497: 129 pgs: 129 active+clean; 10 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 43 MiB/s wr, 697 op/s 2024-09-12T12:30:56.560 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:30:56 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:30:56.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.679+0000 7f51eeb3a640 1 -- 172.21.15.33:0/1663765692 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51e8109830 msgr2=0x7f51e8109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:56.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.679+0000 7f51eeb3a640 1 --2- 172.21.15.33:0/1663765692 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51e8109830 0x7f51e8109c90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f51d001a910 tx=0x7f51d003b470 comp rx=0 tx=0).stop 2024-09-12T12:30:56.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.680+0000 7f51eeb3a640 1 -- 172.21.15.33:0/1663765692 shutdown_connections 2024-09-12T12:30:56.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.680+0000 7f51eeb3a640 1 --2- 172.21.15.33:0/1663765692 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f51e811b140 0x7f51e811d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:56.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.680+0000 7f51eeb3a640 1 --2- 172.21.15.33:0/1663765692 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51e8109830 0x7f51e8109c90 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:56.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.680+0000 7f51eeb3a640 1 --2- 172.21.15.33:0/1663765692 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51e8109450 0x7f51e8110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:56.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.680+0000 7f51eeb3a640 1 -- 172.21.15.33:0/1663765692 >> 172.21.15.33:0/1663765692 conn(0x7f51e806e140 msgr2=0x7f51e806e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:30:56.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.683+0000 7f51eeb3a640 1 -- 172.21.15.33:0/1663765692 shutdown_connections 2024-09-12T12:30:56.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.683+0000 7f51eeb3a640 1 -- 172.21.15.33:0/1663765692 wait complete. 2024-09-12T12:30:56.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.684+0000 7f51eeb3a640 1 Processor -- start 2024-09-12T12:30:56.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.684+0000 7f51eeb3a640 1 -- start start 2024-09-12T12:30:56.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.685+0000 7f51eeb3a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51e8109450 0x7f51e811a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:56.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.685+0000 7f51eeb3a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f51e8109830 0x7f51e81167d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:56.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.685+0000 7f51eeb3a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51e811b140 0x7f51e8116d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:56.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.685+0000 7f51eeb3a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f51e81131d0 con 0x7f51e8109450 2024-09-12T12:30:56.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.685+0000 7f51eeb3a640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f51e8113050 con 0x7f51e811b140 2024-09-12T12:30:56.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.685+0000 7f51eeb3a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f51e8113350 con 0x7f51e8109830 2024-09-12T12:30:56.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.685+0000 7f51e7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f51e8109830 0x7f51e81167d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:56.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.685+0000 7f51e7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f51e8109830 0x7f51e81167d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:49950/0 (socket says 172.21.15.33:49950) 2024-09-12T12:30:56.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.685+0000 7f51e7fff640 1 -- 172.21.15.33:0/2913876963 learned_addr learned my addr 172.21.15.33:0/2913876963 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:30:56.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.685+0000 7f51ed0d7640 1 --2- 172.21.15.33:0/2913876963 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51e811b140 0x7f51e8116d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:56.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.685+0000 7f51e7fff640 1 -- 172.21.15.33:0/2913876963 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51e811b140 msgr2=0x7f51e8116d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:56.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.685+0000 7f51e7fff640 1 --2- 172.21.15.33:0/2913876963 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51e811b140 0x7f51e8116d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:56.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.685+0000 7f51e7fff640 1 -- 172.21.15.33:0/2913876963 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51e8109450 msgr2=0x7f51e811a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:56.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.685+0000 7f51e7fff640 1 --2- 172.21.15.33:0/2913876963 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51e8109450 0x7f51e811a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:56.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.685+0000 7f51e7fff640 1 -- 172.21.15.33:0/2913876963 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51e81172d0 con 0x7f51e8109830 2024-09-12T12:30:56.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.686+0000 7f51e7fff640 1 --2- 172.21.15.33:0/2913876963 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f51e8109830 0x7f51e81167d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f51d0005ab0 tx=0x7f51d0040f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:30:56.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.686+0000 7f51e5ffb640 1 -- 172.21.15.33:0/2913876963 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d0046030 con 0x7f51e8109830 2024-09-12T12:30:56.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.686+0000 7f51eeb3a640 1 -- 172.21.15.33:0/2913876963 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51e8117560 con 0x7f51e8109830 2024-09-12T12:30:56.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.687+0000 7f51eeb3a640 1 -- 172.21.15.33:0/2913876963 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51e81cd460 con 0x7f51e8109830 2024-09-12T12:30:56.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.687+0000 7f51e5ffb640 1 -- 172.21.15.33:0/2913876963 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f51d00049d0 con 0x7f51e8109830 2024-09-12T12:30:56.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.687+0000 7f51e5ffb640 1 -- 172.21.15.33:0/2913876963 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d0003ce0 con 0x7f51e8109830 2024-09-12T12:30:56.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.693+0000 7f51e5ffb640 1 -- 172.21.15.33:0/2913876963 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f51d000c040 con 0x7f51e8109830 2024-09-12T12:30:56.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.694+0000 7f51e5ffb640 1 --2- 172.21.15.33:0/2913876963 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f51d40a2cc0 0x7f51d40a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:56.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.695+0000 7f51e5ffb640 1 -- 172.21.15.33:0/2913876963 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f51d00effe0 con 0x7f51e8109830 2024-09-12T12:30:56.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.707+0000 7f51f0f13740 1 Processor -- start 2024-09-12T12:30:56.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.697+0000 7f51ec8d6640 1 --2- 172.21.15.33:0/2913876963 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f51d40a2cc0 0x7f51d40a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:56.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.707+0000 7f51f0f13740 1 -- start start 2024-09-12T12:30:56.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.708+0000 7f51f0f13740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5653bb698b40 0x5653bb697090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:56.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.708+0000 7f51f0f13740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653bb6975d0 0x5653bb697a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:56.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.708+0000 7f51f0f13740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653bb6a2370 0x5653bb6a4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:56.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.708+0000 7f51f0f13740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5653bb5fd2f0 con 0x5653bb6975d0 2024-09-12T12:30:56.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.708+0000 7f51f0f13740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5653bb5a4cf0 con 0x5653bb6a2370 2024-09-12T12:30:56.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.708+0000 7f51f0f13740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5653bb5f92b0 con 0x5653bb698b40 2024-09-12T12:30:56.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.711+0000 7f51ed0d7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653bb6a2370 0x5653bb6a4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:56.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.711+0000 7f51ec8d6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5653bb698b40 0x5653bb697090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:56.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.711+0000 7f51ec8d6640 1 --2- 172.21.15.33:0/2913876963 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f51d40a2cc0 0x7f51d40a5180 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f51d800ab90 tx=0x7f51d8009250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:30:56.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.714+0000 7f51e7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653bb6975d0 0x5653bb697a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:56.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.714+0000 7f51e7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653bb6975d0 0x5653bb697a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49328/0 (socket says 172.21.15.33:49328) 2024-09-12T12:30:56.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.714+0000 7f51e7fff640 1 -- 172.21.15.33:0/1073312140 learned_addr learned my addr 172.21.15.33:0/1073312140 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:30:56.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.715+0000 7f51ec8d6640 1 -- 172.21.15.33:0/1073312140 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653bb6a2370 msgr2=0x5653bb6a4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:30:56.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.715+0000 7f51ec8d6640 1 --2- 172.21.15.33:0/1073312140 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653bb6a2370 0x5653bb6a4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:56.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.715+0000 7f51ec8d6640 1 -- 172.21.15.33:0/1073312140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653bb6975d0 msgr2=0x5653bb697a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:30:56.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.715+0000 7f51ec8d6640 1 --2- 172.21.15.33:0/1073312140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653bb6975d0 0x5653bb697a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:56.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.715+0000 7f51ec8d6640 1 -- 172.21.15.33:0/1073312140 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653bb5893a0 con 0x5653bb698b40 2024-09-12T12:30:56.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.716+0000 7f51ec8d6640 1 --2- 172.21.15.33:0/1073312140 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5653bb698b40 0x5653bb697090 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f51d800cea0 tx=0x7f51d8014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1703d6729dd8eddb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:30:56.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.717+0000 7f51ed0d7640 1 --2- 172.21.15.33:0/1073312140 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653bb6a2370 0x5653bb6a4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:30:56.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.720+0000 7f51deffd640 1 -- 172.21.15.33:0/1073312140 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d8025070 con 0x5653bb698b40 2024-09-12T12:30:56.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.720+0000 7f51deffd640 1 -- 172.21.15.33:0/1073312140 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f51d80168d0 con 0x5653bb698b40 2024-09-12T12:30:56.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.721+0000 7f51f0f13740 1 -- 172.21.15.33:0/1073312140 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5653bb698b40 msgr2=0x5653bb697090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:56.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.721+0000 7f51f0f13740 1 --2- 172.21.15.33:0/1073312140 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5653bb698b40 0x5653bb697090 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f51d800cea0 tx=0x7f51d8014000 comp rx=0 tx=0).stop 2024-09-12T12:30:56.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.725+0000 7f51f0f13740 1 -- 172.21.15.33:0/1073312140 shutdown_connections 2024-09-12T12:30:56.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.725+0000 7f51f0f13740 1 --2- 172.21.15.33:0/1073312140 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653bb6a2370 0x5653bb6a4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:56.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.725+0000 7f51f0f13740 1 --2- 172.21.15.33:0/1073312140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653bb6975d0 0x5653bb697a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:56.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.725+0000 7f51f0f13740 1 --2- 172.21.15.33:0/1073312140 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5653bb698b40 0x5653bb697090 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:56.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.725+0000 7f51f0f13740 1 -- 172.21.15.33:0/1073312140 >> 172.21.15.33:0/1073312140 conn(0x5653bb660310 msgr2=0x5653bb693c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:30:56.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.728+0000 7f51f0f13740 1 -- 172.21.15.33:0/1073312140 shutdown_connections 2024-09-12T12:30:56.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.731+0000 7f51f0f13740 1 -- 172.21.15.33:0/1073312140 wait complete. 2024-09-12T12:30:56.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.731+0000 7f51f0f13740 1 -- start start 2024-09-12T12:30:56.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.731+0000 7f51f0f13740 1 Processor -- start 2024-09-12T12:30:56.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.733+0000 7f51f0f13740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5653bb6975d0 0x5653bb6a1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:56.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.733+0000 7f51f0f13740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653bb698b40 0x5653bb69ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:56.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.733+0000 7f51f0f13740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653bb6a2370 0x5653bb69f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:56.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.734+0000 7f51f0f13740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5653bb6a50c0 con 0x5653bb6a2370 2024-09-12T12:30:56.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.734+0000 7f51f0f13740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5653bb5b8060 con 0x5653bb698b40 2024-09-12T12:30:56.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.734+0000 7f51f0f13740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5653bb6a5240 con 0x5653bb6975d0 2024-09-12T12:30:56.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.734+0000 7f51ed0d7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653bb6a2370 0x5653bb69f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:56.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.734+0000 7f51ed0d7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653bb6a2370 0x5653bb69f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49330/0 (socket says 172.21.15.33:49330) 2024-09-12T12:30:56.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.734+0000 7f51ed0d7640 1 -- 172.21.15.33:0/2252457096 learned_addr learned my addr 172.21.15.33:0/2252457096 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:30:56.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.734+0000 7f51f0f13740 10 client.0 _ll_register_callbacks cb 0x5653bb30b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:30:56.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.734+0000 7f51e7fff640 1 --2- 172.21.15.33:0/2252457096 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653bb698b40 0x5653bb69ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:56.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.734+0000 7f51ec8d6640 1 --2- 172.21.15.33:0/2252457096 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5653bb6975d0 0x5653bb6a1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:56.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.738+0000 7f51e7fff640 1 -- 172.21.15.33:0/2252457096 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5653bb6975d0 msgr2=0x5653bb6a1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:30:56.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.738+0000 7f51e7fff640 1 --2- 172.21.15.33:0/2252457096 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5653bb6975d0 0x5653bb6a1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:56.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.738+0000 7f51e7fff640 1 -- 172.21.15.33:0/2252457096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653bb6a2370 msgr2=0x5653bb69f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:30:56.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.738+0000 7f51e7fff640 1 --2- 172.21.15.33:0/2252457096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653bb6a2370 0x5653bb69f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:56.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.738+0000 7f51e7fff640 1 -- 172.21.15.33:0/2252457096 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653bb36e3c0 con 0x5653bb698b40 2024-09-12T12:30:56.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.742+0000 7f51e7fff640 1 --2- 172.21.15.33:0/2252457096 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653bb698b40 0x5653bb69ef20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f51d00c4b90 tx=0x7f51d00b80e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9d75a11cb59b8f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:30:56.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.742+0000 7f51c7fff640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:30:56.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.744+0000 7f51c7fff640 1 -- 172.21.15.33:0/2252457096 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d00da060 con 0x5653bb698b40 2024-09-12T12:30:56.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.744+0000 7f51f0f13740 1 -- 172.21.15.33:0/2252457096 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51d80168d0 con 0x5653bb698b40 2024-09-12T12:30:56.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.744+0000 7f51c7fff640 1 -- 172.21.15.33:0/2252457096 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f51d0004b80 con 0x5653bb698b40 2024-09-12T12:30:56.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.744+0000 7f51c7fff640 1 -- 172.21.15.33:0/2252457096 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f51d00a2050 con 0x5653bb698b40 2024-09-12T12:30:56.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.745+0000 7f51f0f13740 10 client.25415 fetch_fsmap learned FSMap version 27 2024-09-12T12:30:56.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.745+0000 7f51f0f13740 1 -- 172.21.15.33:0/2252457096 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5653bb6b0b00 con 0x5653bb698b40 2024-09-12T12:30:56.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.746+0000 7f51c7fff640 1 -- 172.21.15.33:0/2252457096 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f51d80168d0 con 0x5653bb698b40 2024-09-12T12:30:56.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.747+0000 7f51c7fff640 1 -- 172.21.15.33:0/2252457096 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f51d00413a0 con 0x5653bb698b40 2024-09-12T12:30:56.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.748+0000 7f51f0f13740 10 client.25415 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:30:56.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.748+0000 7f51f0f13740 10 client.25415 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:30:56.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.748+0000 7f51f0f13740 20 client.25415 populate_metadata read hostname 'smithi033' 2024-09-12T12:30:56.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.748+0000 7f51f0f13740 1 --2- 172.21.15.33:0/2252457096 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5653bb6b1fe0 0x5653bb6b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:56.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.748+0000 7f51f0f13740 4 client.25415 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:30:56.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.748+0000 7f51f0f13740 1 -- 172.21.15.33:0/2252457096 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5653bb60a860 con 0x5653bb6b1fe0 2024-09-12T12:30:56.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.748+0000 7f51ec8d6640 1 --2- 172.21.15.33:0/2252457096 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5653bb6b1fe0 0x5653bb6b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:56.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.750+0000 7f51ec8d6640 1 --2- 172.21.15.33:0/2252457096 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5653bb6b1fe0 0x5653bb6b4460 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13eef2e1895befc8 server_cookie=6345e13774742e9e in_seq=0 out_seq=0 2024-09-12T12:30:56.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.750+0000 7f51c7fff640 10 client.25415 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:30:56.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.751+0000 7f51c7fff640 1 -- 172.21.15.33:0/2252457096 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5653bb60a860 con 0x5653bb6b1fe0 2024-09-12T12:30:56.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.751+0000 7f51c7fff640 10 client.25415 handle_command_reply: tid=0 2024-09-12T12:30:56.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.751+0000 7f51f0f13740 1 client.25415 shutdown 2024-09-12T12:30:56.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.753+0000 7f51f0f13740 1 -- 172.21.15.33:0/2252457096 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653bb698b40 msgr2=0x5653bb69ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:56.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.753+0000 7f51f0f13740 1 --2- 172.21.15.33:0/2252457096 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653bb698b40 0x5653bb69ef20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f51d00c4b90 tx=0x7f51d00b80e0 comp rx=0 tx=0).stop 2024-09-12T12:30:56.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.755+0000 7f51f0f13740 1 -- 172.21.15.33:0/2252457096 shutdown_connections 2024-09-12T12:30:56.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.755+0000 7f51f0f13740 1 --2- 172.21.15.33:0/2252457096 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5653bb6b1fe0 0x5653bb6b4460 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:56.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.755+0000 7f51f0f13740 1 --2- 172.21.15.33:0/2252457096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653bb6a2370 0x5653bb69f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:56.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.755+0000 7f51f0f13740 1 --2- 172.21.15.33:0/2252457096 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653bb698b40 0x5653bb69ef20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:56.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.755+0000 7f51f0f13740 1 --2- 172.21.15.33:0/2252457096 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5653bb6975d0 0x5653bb6a1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:56.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.755+0000 7f51f0f13740 1 -- 172.21.15.33:0/2252457096 >> 172.21.15.33:0/2252457096 conn(0x5653bb660310 msgr2=0x5653bb699930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:30:56.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.755+0000 7f51c7fff640 0 client.25415 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:30:56.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.759+0000 7f51f0f13740 1 -- 172.21.15.33:0/2252457096 shutdown_connections 2024-09-12T12:30:56.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.760+0000 7f51f0f13740 1 -- 172.21.15.33:0/2252457096 wait complete. 2024-09-12T12:30:56.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.760+0000 7f51f0f13740 20 client.25415 trim_cache size 0 max 16384 2024-09-12T12:30:56.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.785+0000 7f51f0f13740 1 Processor -- start 2024-09-12T12:30:56.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.785+0000 7f51f0f13740 1 -- start start 2024-09-12T12:30:56.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.786+0000 7f51f0f13740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653bb6975d0 0x5653bb6ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:56.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.786+0000 7f51f0f13740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5653bb698b40 0x5653bb6b9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:56.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.786+0000 7f51f0f13740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653bb6a2370 0x5653bb6ba270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:56.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.786+0000 7f51ec8d6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653bb6975d0 0x5653bb6ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:56.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.786+0000 7f51ec8d6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653bb6975d0 0x5653bb6ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:48186/0 (socket says 172.21.15.33:48186) 2024-09-12T12:30:56.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.787+0000 7f51ec8d6640 1 -- 172.21.15.33:0/1213151374 learned_addr learned my addr 172.21.15.33:0/1213151374 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:30:56.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.787+0000 7f51ed0d7640 1 --2- 172.21.15.33:0/1213151374 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653bb6a2370 0x5653bb6ba270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:56.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.787+0000 7f51f0f13740 1 -- 172.21.15.33:0/1213151374 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f51c80123e0 con 0x5653bb6a2370 2024-09-12T12:30:56.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.787+0000 7f51f0f13740 1 -- 172.21.15.33:0/1213151374 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f51c800fcb0 con 0x5653bb6975d0 2024-09-12T12:30:56.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.787+0000 7f51f0f13740 1 -- 172.21.15.33:0/1213151374 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f51c800dbb0 con 0x5653bb698b40 2024-09-12T12:30:56.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.787+0000 7f51ed0d7640 1 -- 172.21.15.33:0/1213151374 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5653bb698b40 msgr2=0x5653bb6b9d30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:30:56.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.787+0000 7f51ed0d7640 1 --2- 172.21.15.33:0/1213151374 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5653bb698b40 0x5653bb6b9d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:56.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.787+0000 7f51ed0d7640 1 -- 172.21.15.33:0/1213151374 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653bb6975d0 msgr2=0x5653bb6ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:30:56.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.787+0000 7f51ed0d7640 1 --2- 172.21.15.33:0/1213151374 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653bb6975d0 0x5653bb6ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:56.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.788+0000 7f51ed0d7640 1 -- 172.21.15.33:0/1213151374 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653bb6a1fe0 con 0x5653bb6a2370 2024-09-12T12:30:56.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.788+0000 7f51ed0d7640 1 --2- 172.21.15.33:0/1213151374 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653bb6a2370 0x5653bb6ba270 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f51e00058c0 tx=0x7f51e0012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9228b93316ca4d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:30:56.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.789+0000 7f51de7fc640 1 -- 172.21.15.33:0/1213151374 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e000bd00 con 0x5653bb6a2370 2024-09-12T12:30:56.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.789+0000 7f51de7fc640 1 -- 172.21.15.33:0/1213151374 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f51e00118f0 con 0x5653bb6a2370 2024-09-12T12:30:56.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.790+0000 7f51de7fc640 1 -- 172.21.15.33:0/1213151374 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e000f860 con 0x5653bb6a2370 2024-09-12T12:30:56.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.790+0000 7f51f0f13740 1 -- 172.21.15.33:0/1213151374 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653bb6a2370 msgr2=0x5653bb6ba270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:56.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.790+0000 7f51f0f13740 1 --2- 172.21.15.33:0/1213151374 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653bb6a2370 0x5653bb6ba270 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f51e00058c0 tx=0x7f51e0012820 comp rx=0 tx=0).stop 2024-09-12T12:30:56.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.790+0000 7f51f0f13740 1 -- 172.21.15.33:0/1213151374 shutdown_connections 2024-09-12T12:30:56.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.790+0000 7f51f0f13740 1 --2- 172.21.15.33:0/1213151374 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653bb6a2370 0x5653bb6ba270 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:56.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.790+0000 7f51f0f13740 1 --2- 172.21.15.33:0/1213151374 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5653bb698b40 0x5653bb6b9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:56.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.790+0000 7f51f0f13740 1 --2- 172.21.15.33:0/1213151374 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653bb6975d0 0x5653bb6ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:56.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.790+0000 7f51f0f13740 1 -- 172.21.15.33:0/1213151374 >> 172.21.15.33:0/1213151374 conn(0x5653bb660310 msgr2=0x5653bb69e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:30:56.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.790+0000 7f51f0f13740 1 -- 172.21.15.33:0/1213151374 shutdown_connections 2024-09-12T12:30:56.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.790+0000 7f51f0f13740 1 -- 172.21.15.33:0/1213151374 wait complete. 2024-09-12T12:30:56.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.791+0000 7f51f0f13740 1 -- start start 2024-09-12T12:30:56.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.791+0000 7f51f0f13740 1 Processor -- start 2024-09-12T12:30:56.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.792+0000 7f51f0f13740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5653bb6975d0 0x5653bb6aa880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:56.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.792+0000 7f51f0f13740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653bb698b40 0x5653bb6aadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:56.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.792+0000 7f51f0f13740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653bb6a2370 0x5653bb69b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:56.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.792+0000 7f51f0f13740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f51c800e170 con 0x5653bb6a2370 2024-09-12T12:30:56.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.792+0000 7f51f0f13740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f51c800f5e0 con 0x5653bb698b40 2024-09-12T12:30:56.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.792+0000 7f51f0f13740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f51c800e840 con 0x5653bb6975d0 2024-09-12T12:30:56.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.792+0000 7f51f0f13740 10 client.0 _ll_register_callbacks cb 0x7f51d00b8740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:30:56.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.792+0000 7f51ec8d6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5653bb6975d0 0x5653bb6aa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:56.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.792+0000 7f51ec8d6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5653bb6975d0 0x5653bb6aa880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:49994/0 (socket says 172.21.15.33:49994) 2024-09-12T12:30:56.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.792+0000 7f51ec8d6640 1 -- 172.21.15.33:0/1634417427 learned_addr learned my addr 172.21.15.33:0/1634417427 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:30:56.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.792+0000 7f51e7fff640 1 --2- 172.21.15.33:0/1634417427 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653bb698b40 0x5653bb6aadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:56.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.792+0000 7f51ec8d6640 1 -- 172.21.15.33:0/1634417427 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653bb698b40 msgr2=0x5653bb6aadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:30:56.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.792+0000 7f51ec8d6640 1 --2- 172.21.15.33:0/1634417427 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653bb698b40 0x5653bb6aadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:56.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.792+0000 7f51ec8d6640 1 -- 172.21.15.33:0/1634417427 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653bb6a2370 msgr2=0x5653bb69b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:30:56.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.792+0000 7f51ec8d6640 1 --2- 172.21.15.33:0/1634417427 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653bb6a2370 0x5653bb69b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:56.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.793+0000 7f51ec8d6640 1 -- 172.21.15.33:0/1634417427 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653bb69c150 con 0x5653bb6975d0 2024-09-12T12:30:56.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.794+0000 7f51ec8d6640 1 --2- 172.21.15.33:0/1634417427 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5653bb6975d0 0x5653bb6aa880 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f51d800c8c0 tx=0x7f51d8020b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=546b173833d7fd06 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:30:56.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.794+0000 7f51c7fff640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:30:56.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.794+0000 7f51c7fff640 1 -- 172.21.15.33:0/1634417427 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d803c060 con 0x5653bb6975d0 2024-09-12T12:30:56.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.794+0000 7f51f0f13740 1 -- 172.21.15.33:0/1634417427 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51e00118f0 con 0x5653bb6975d0 2024-09-12T12:30:56.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.794+0000 7f51c7fff640 1 -- 172.21.15.33:0/1634417427 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f51d80164a0 con 0x5653bb6975d0 2024-09-12T12:30:56.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.795+0000 7f51c7fff640 1 -- 172.21.15.33:0/1634417427 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f51d8025040 con 0x5653bb6975d0 2024-09-12T12:30:56.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.795+0000 7f51f0f13740 10 client.25513 fetch_fsmap learned FSMap version 27 2024-09-12T12:30:56.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.795+0000 7f51f0f13740 1 -- 172.21.15.33:0/1634417427 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5653bb73e950 con 0x5653bb6975d0 2024-09-12T12:30:56.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.798+0000 7f51c7fff640 1 -- 172.21.15.33:0/1634417427 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f51e00118f0 con 0x5653bb6975d0 2024-09-12T12:30:56.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.799+0000 7f51c7fff640 1 -- 172.21.15.33:0/1634417427 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f51d801f030 con 0x5653bb6975d0 2024-09-12T12:30:56.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.799+0000 7f51f0f13740 10 client.25513 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:30:56.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.799+0000 7f51f0f13740 10 client.25513 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:30:56.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.799+0000 7f51f0f13740 20 client.25513 populate_metadata read hostname 'smithi033' 2024-09-12T12:30:56.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.799+0000 7f51f0f13740 1 --2- 172.21.15.33:0/1634417427 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5653bb73f0a0 0x5653bb7414e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:30:56.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.799+0000 7f51f0f13740 4 client.25513 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:30:56.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.799+0000 7f51f0f13740 1 -- 172.21.15.33:0/1634417427 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5653bb604d70 con 0x5653bb73f0a0 2024-09-12T12:30:56.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.802+0000 7f51e7fff640 1 --2- 172.21.15.33:0/1634417427 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5653bb73f0a0 0x5653bb7414e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:30:56.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.815+0000 7f51e7fff640 1 --2- 172.21.15.33:0/1634417427 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5653bb73f0a0 0x5653bb7414e0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=575e3be2f9e3d8d5 server_cookie=967a8429310dd665 in_seq=0 out_seq=0 2024-09-12T12:30:56.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.815+0000 7f51c7fff640 10 client.25513 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:30:56.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.815+0000 7f51c7fff640 1 -- 172.21.15.33:0/1634417427 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5653bb604d70 con 0x5653bb73f0a0 2024-09-12T12:30:56.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.815+0000 7f51c7fff640 10 client.25513 handle_command_reply: tid=0 2024-09-12T12:30:56.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.815+0000 7f51f0f13740 1 client.25513 shutdown 2024-09-12T12:30:56.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.815+0000 7f51f0f13740 1 -- 172.21.15.33:0/1634417427 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5653bb6975d0 msgr2=0x5653bb6aa880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:56.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.815+0000 7f51f0f13740 1 --2- 172.21.15.33:0/1634417427 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5653bb6975d0 0x5653bb6aa880 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f51d800c8c0 tx=0x7f51d8020b90 comp rx=0 tx=0).stop 2024-09-12T12:30:56.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.815+0000 7f51f0f13740 1 -- 172.21.15.33:0/1634417427 shutdown_connections 2024-09-12T12:30:56.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.815+0000 7f51f0f13740 1 --2- 172.21.15.33:0/1634417427 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5653bb73f0a0 0x5653bb7414e0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:56.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.815+0000 7f51f0f13740 1 --2- 172.21.15.33:0/1634417427 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653bb6a2370 0x5653bb69b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:56.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.815+0000 7f51f0f13740 1 --2- 172.21.15.33:0/1634417427 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653bb698b40 0x5653bb6aadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:56.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.815+0000 7f51f0f13740 1 --2- 172.21.15.33:0/1634417427 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5653bb6975d0 0x5653bb6aa880 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:56.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.815+0000 7f51f0f13740 1 -- 172.21.15.33:0/1634417427 >> 172.21.15.33:0/1634417427 conn(0x5653bb660310 msgr2=0x5653bb6a0780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:30:56.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.817+0000 7f51c7fff640 0 client.25513 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:30:56.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.818+0000 7f51f0f13740 1 -- 172.21.15.33:0/1634417427 shutdown_connections 2024-09-12T12:30:56.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.818+0000 7f51f0f13740 1 -- 172.21.15.33:0/1634417427 wait complete. 2024-09-12T12:30:56.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.818+0000 7f51f0f13740 20 client.25513 trim_cache size 0 max 16384 2024-09-12T12:30:56.819 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-09-12T12:30:56.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.819+0000 7f51eeb3a640 1 -- 172.21.15.33:0/2913876963 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f51d40a2cc0 msgr2=0x7f51d40a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:56.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.819+0000 7f51eeb3a640 1 --2- 172.21.15.33:0/2913876963 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f51d40a2cc0 0x7f51d40a5180 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f51d800ab90 tx=0x7f51d8009250 comp rx=0 tx=0).stop 2024-09-12T12:30:56.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.819+0000 7f51eeb3a640 1 -- 172.21.15.33:0/2913876963 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f51e8109830 msgr2=0x7f51e81167d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:30:56.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.819+0000 7f51eeb3a640 1 --2- 172.21.15.33:0/2913876963 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f51e8109830 0x7f51e81167d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f51d0005ab0 tx=0x7f51d0040f90 comp rx=0 tx=0).stop 2024-09-12T12:30:56.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.824+0000 7f51eeb3a640 1 -- 172.21.15.33:0/2913876963 shutdown_connections 2024-09-12T12:30:56.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.824+0000 7f51eeb3a640 1 --2- 172.21.15.33:0/2913876963 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f51d40a2cc0 0x7f51d40a5180 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:56.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.824+0000 7f51eeb3a640 1 --2- 172.21.15.33:0/2913876963 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51e811b140 0x7f51e8116d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:56.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.824+0000 7f51eeb3a640 1 --2- 172.21.15.33:0/2913876963 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f51e8109830 0x7f51e81167d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:56.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.824+0000 7f51eeb3a640 1 --2- 172.21.15.33:0/2913876963 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51e8109450 0x7f51e811a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:30:56.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.824+0000 7f51eeb3a640 1 -- 172.21.15.33:0/2913876963 >> 172.21.15.33:0/2913876963 conn(0x7f51e806e140 msgr2=0x7f51e8070c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:30:56.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.824+0000 7f51eeb3a640 1 -- 172.21.15.33:0/2913876963 shutdown_connections 2024-09-12T12:30:56.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:30:56.824+0000 7f51eeb3a640 1 -- 172.21.15.33:0/2913876963 wait complete. 2024-09-12T12:30:56.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:30:56 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:30:56.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:30:56 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:30:57.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:30:57 smithi033 ceph-mon[31246]: pgmap v498: 129 pgs: 129 active+clean; 10 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 36 MiB/s wr, 585 op/s 2024-09-12T12:30:57.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:30:57 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:30:57.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:30:57 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:30:57.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:30:57 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:30:57.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:30:57 smithi043 ceph-mon[34144]: pgmap v498: 129 pgs: 129 active+clean; 10 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 36 MiB/s wr, 585 op/s 2024-09-12T12:30:57.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:30:57 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:30:57.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:30:57 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:30:57.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:30:57 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:30:57.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:30:57 smithi102 ceph-mon[34799]: pgmap v498: 129 pgs: 129 active+clean; 10 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 36 MiB/s wr, 585 op/s 2024-09-12T12:30:57.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:30:57 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:30:57.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:30:57 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:30:57.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:30:57 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:30:59.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:30:59 smithi033 ceph-mon[31246]: pgmap v499: 129 pgs: 129 active+clean; 10 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 48 MiB/s wr, 769 op/s 2024-09-12T12:30:59.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:30:59 smithi043 ceph-mon[34144]: pgmap v499: 129 pgs: 129 active+clean; 10 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 48 MiB/s wr, 769 op/s 2024-09-12T12:30:59.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:30:59 smithi102 ceph-mon[34799]: pgmap v499: 129 pgs: 129 active+clean; 10 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 48 MiB/s wr, 769 op/s 2024-09-12T12:31:01.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:31:01 smithi033 ceph-mon[31246]: pgmap v500: 129 pgs: 129 active+clean; 10 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 38 MiB/s wr, 619 op/s 2024-09-12T12:31:01.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:31:01 smithi043 ceph-mon[34144]: pgmap v500: 129 pgs: 129 active+clean; 10 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 38 MiB/s wr, 619 op/s 2024-09-12T12:31:01.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:31:01 smithi102 ceph-mon[34799]: pgmap v500: 129 pgs: 129 active+clean; 10 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 38 MiB/s wr, 619 op/s 2024-09-12T12:31:02.167 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T12:31:02.167 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T12:31:02.808 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:31:03.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:31:03 smithi033 ceph-mon[31246]: pgmap v501: 129 pgs: 129 active+clean; 10 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 41 MiB/s wr, 657 op/s 2024-09-12T12:31:03.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.731+0000 7fb1b08ed640 1 -- 172.21.15.33:0/2337632477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1ac06ea30 msgr2=0x7fb1ac06ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:03.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.731+0000 7fb1b08ed640 1 --2- 172.21.15.33:0/2337632477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1ac06ea30 0x7fb1ac06ee70 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4009ca0 tx=0x7fb1a402a8e0 comp rx=0 tx=0).stop 2024-09-12T12:31:03.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.736+0000 7fb1b08ed640 1 -- 172.21.15.33:0/2337632477 shutdown_connections 2024-09-12T12:31:03.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.736+0000 7fb1b08ed640 1 --2- 172.21.15.33:0/2337632477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1ac11b140 0x7fb1ac11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:03.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.736+0000 7fb1b08ed640 1 --2- 172.21.15.33:0/2337632477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1ac06ea30 0x7fb1ac06ee70 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:03.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.736+0000 7fb1b08ed640 1 --2- 172.21.15.33:0/2337632477 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1ac110190 0x7fb1ac06e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:03.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.736+0000 7fb1b08ed640 1 -- 172.21.15.33:0/2337632477 >> 172.21.15.33:0/2337632477 conn(0x7fb1ac073180 msgr2=0x7fb1ac073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:31:03.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.737+0000 7fb1b08ed640 1 -- 172.21.15.33:0/2337632477 shutdown_connections 2024-09-12T12:31:03.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.737+0000 7fb1b08ed640 1 -- 172.21.15.33:0/2337632477 wait complete. 2024-09-12T12:31:03.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.738+0000 7fb1b08ed640 1 Processor -- start 2024-09-12T12:31:03.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.739+0000 7fb1b08ed640 1 -- start start 2024-09-12T12:31:03.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.739+0000 7fb1b08ed640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1ac06ea30 0x7fb1ac11a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:03.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.739+0000 7fb1b08ed640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1ac110190 0x7fb1ac11a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:03.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.739+0000 7fb1b08ed640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1ac11b140 0x7fb1ac114500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:03.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.739+0000 7fb1b08ed640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb1ac110dd0 con 0x7fb1ac06ea30 2024-09-12T12:31:03.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.739+0000 7fb1b08ed640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb1ac110c50 con 0x7fb1ac11b140 2024-09-12T12:31:03.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.739+0000 7fb1b08ed640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb1ac110f50 con 0x7fb1ac110190 2024-09-12T12:31:03.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.739+0000 7fb1aaffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1ac110190 0x7fb1ac11a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:03.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.739+0000 7fb1aaffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1ac110190 0x7fb1ac11a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:47686/0 (socket says 172.21.15.33:47686) 2024-09-12T12:31:03.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.739+0000 7fb1aaffd640 1 -- 172.21.15.33:0/3008850890 learned_addr learned my addr 172.21.15.33:0/3008850890 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:31:03.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.740+0000 7fb1abfff640 1 --2- 172.21.15.33:0/3008850890 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1ac11b140 0x7fb1ac114500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:03.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.740+0000 7fb1aaffd640 1 -- 172.21.15.33:0/3008850890 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1ac11b140 msgr2=0x7fb1ac114500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:03.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.740+0000 7fb1aaffd640 1 --2- 172.21.15.33:0/3008850890 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1ac11b140 0x7fb1ac114500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:03.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.740+0000 7fb1aaffd640 1 -- 172.21.15.33:0/3008850890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1ac06ea30 msgr2=0x7fb1ac11a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:03.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.740+0000 7fb1aaffd640 1 --2- 172.21.15.33:0/3008850890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1ac06ea30 0x7fb1ac11a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:03.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.740+0000 7fb1aaffd640 1 -- 172.21.15.33:0/3008850890 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1ac114dc0 con 0x7fb1ac110190 2024-09-12T12:31:03.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.740+0000 7fb1aaffd640 1 --2- 172.21.15.33:0/3008850890 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1ac110190 0x7fb1ac11a9c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4006010 tx=0x7fb1a4003c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:31:03.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.742+0000 7fb1a8ff9640 1 -- 172.21.15.33:0/3008850890 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a4004240 con 0x7fb1ac110190 2024-09-12T12:31:03.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.742+0000 7fb1a8ff9640 1 -- 172.21.15.33:0/3008850890 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb1a4003e10 con 0x7fb1ac110190 2024-09-12T12:31:03.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.742+0000 7fb1b08ed640 1 -- 172.21.15.33:0/3008850890 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1ac115050 con 0x7fb1ac110190 2024-09-12T12:31:03.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.742+0000 7fb1b08ed640 1 -- 172.21.15.33:0/3008850890 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1ac07a620 con 0x7fb1ac110190 2024-09-12T12:31:03.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.742+0000 7fb1a8ff9640 1 -- 172.21.15.33:0/3008850890 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a4030e10 con 0x7fb1ac110190 2024-09-12T12:31:03.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.749+0000 7fb1a8ff9640 1 -- 172.21.15.33:0/3008850890 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fb1a404d440 con 0x7fb1ac110190 2024-09-12T12:31:03.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.754+0000 7fb1b3f28740 1 Processor -- start 2024-09-12T12:31:03.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.756+0000 7fb1a8ff9640 1 --2- 172.21.15.33:0/3008850890 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb1940a2da0 0x7fb1940a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:03.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.756+0000 7fb1a8ff9640 1 -- 172.21.15.33:0/3008850890 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fb1a40f1500 con 0x7fb1ac110190 2024-09-12T12:31:03.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.759+0000 7fb1b3f28740 1 -- start start 2024-09-12T12:31:03.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.759+0000 7fb1b3f28740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5584bdcbad70 0x5584bdcbb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:03.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.759+0000 7fb1b3f28740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5584bdcbb690 0x5584bdcc5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:03.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.759+0000 7fb1b3f28740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5584bdcc5f50 0x5584bdcc8340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:03.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.759+0000 7fb1b3f28740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5584bdc20280 con 0x5584bdcbad70 2024-09-12T12:31:03.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.759+0000 7fb1b3f28740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5584bdbc7b10 con 0x5584bdcc5f50 2024-09-12T12:31:03.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.759+0000 7fb1b3f28740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5584bdc1c240 con 0x5584bdcbb690 2024-09-12T12:31:03.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.759+0000 7fb1abfff640 1 --2- 172.21.15.33:0/3008850890 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb1940a2da0 0x7fb1940a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:03.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.759+0000 7fb1ab7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5584bdcbad70 0x5584bdcbb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:03.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.759+0000 7fb1ab7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5584bdcbad70 0x5584bdcbb150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33406/0 (socket says 172.21.15.33:33406) 2024-09-12T12:31:03.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.759+0000 7fb1ab7fe640 1 -- 172.21.15.33:0/2816675543 learned_addr learned my addr 172.21.15.33:0/2816675543 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:31:03.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.760+0000 7fb1abfff640 1 --2- 172.21.15.33:0/2816675543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5584bdcc5f50 0x5584bdcc8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:03.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.761+0000 7fb1abfff640 1 -- 172.21.15.33:0/2816675543 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5584bdcbb690 msgr2=0x5584bdcc5a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T12:31:03.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.761+0000 7fb1abfff640 1 --2- 172.21.15.33:0/2816675543 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5584bdcbb690 0x5584bdcc5a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:03.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.761+0000 7fb1abfff640 1 -- 172.21.15.33:0/2816675543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5584bdcbad70 msgr2=0x5584bdcbb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:31:03.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.761+0000 7fb1abfff640 1 --2- 172.21.15.33:0/2816675543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5584bdcbad70 0x5584bdcbb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:03.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.761+0000 7fb1abfff640 1 -- 172.21.15.33:0/2816675543 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584bdbd41f0 con 0x5584bdcc5f50 2024-09-12T12:31:03.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.761+0000 7fb1abfff640 1 --2- 172.21.15.33:0/2816675543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5584bdcc5f50 0x5584bdcc8340 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac06b4a0 tx=0x7fb1a0014dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1dc542ad8c24b07d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:31:03.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.762+0000 7fb191ffb640 1 -- 172.21.15.33:0/2816675543 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a00142d0 con 0x5584bdcc5f50 2024-09-12T12:31:03.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.762+0000 7fb191ffb640 1 -- 172.21.15.33:0/2816675543 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb1a000ec60 con 0x5584bdcc5f50 2024-09-12T12:31:03.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.763+0000 7fb1b3f28740 1 -- 172.21.15.33:0/2816675543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5584bdcc5f50 msgr2=0x5584bdcc8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:03.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.763+0000 7fb191ffb640 1 -- 172.21.15.33:0/2816675543 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a00142d0 con 0x5584bdcc5f50 2024-09-12T12:31:03.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.763+0000 7fb1b3f28740 1 --2- 172.21.15.33:0/2816675543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5584bdcc5f50 0x5584bdcc8340 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac06b4a0 tx=0x7fb1a0014dc0 comp rx=0 tx=0).stop 2024-09-12T12:31:03.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.763+0000 7fb1b3f28740 1 -- 172.21.15.33:0/2816675543 shutdown_connections 2024-09-12T12:31:03.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.763+0000 7fb1b3f28740 1 --2- 172.21.15.33:0/2816675543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5584bdcc5f50 0x5584bdcc8340 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:03.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.763+0000 7fb1b3f28740 1 --2- 172.21.15.33:0/2816675543 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5584bdcbb690 0x5584bdcc5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:03.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.763+0000 7fb1b3f28740 1 --2- 172.21.15.33:0/2816675543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5584bdcbad70 0x5584bdcbb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:03.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.763+0000 7fb1b3f28740 1 -- 172.21.15.33:0/2816675543 >> 172.21.15.33:0/2816675543 conn(0x5584bdcb7300 msgr2=0x5584bdcb76e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:31:03.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.764+0000 7fb1abfff640 1 --2- 172.21.15.33:0/3008850890 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb1940a2da0 0x7fb1940a5260 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb1a00117b0 tx=0x7fb1a000f000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:31:03.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.767+0000 7fb1b3f28740 1 -- 172.21.15.33:0/2816675543 shutdown_connections 2024-09-12T12:31:03.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.770+0000 7fb1b3f28740 1 -- 172.21.15.33:0/2816675543 wait complete. 2024-09-12T12:31:03.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.770+0000 7fb1b3f28740 1 -- start start 2024-09-12T12:31:03.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.770+0000 7fb1b3f28740 1 Processor -- start 2024-09-12T12:31:03.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.772+0000 7fb1b3f28740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5584bdcbad70 0x5584bdcc5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:03.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.772+0000 7fb1b3f28740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5584bdcbb690 0x5584bdcc2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:03.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.772+0000 7fb1b3f28740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5584bdcc5f50 0x5584bdcc3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:03.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.772+0000 7fb1b3f28740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5584bdcc8b70 con 0x5584bdcbb690 2024-09-12T12:31:03.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.772+0000 7fb1b3f28740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5584bdbdaf10 con 0x5584bdcc5f50 2024-09-12T12:31:03.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.772+0000 7fb1b3f28740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5584bdcc8cf0 con 0x5584bdcbad70 2024-09-12T12:31:03.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.772+0000 7fb1b3f28740 10 client.0 _ll_register_callbacks cb 0x5584bdba3a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:31:03.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.773+0000 7fb1ab7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5584bdcbad70 0x5584bdcc5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:03.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.773+0000 7fb1ab7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5584bdcbad70 0x5584bdcc5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:47696/0 (socket says 172.21.15.33:47696) 2024-09-12T12:31:03.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.773+0000 7fb1ab7fe640 1 -- 172.21.15.33:0/3503258682 learned_addr learned my addr 172.21.15.33:0/3503258682 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:31:03.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.773+0000 7fb1abfff640 1 --2- 172.21.15.33:0/3503258682 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5584bdcc5f50 0x5584bdcc3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:03.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.774+0000 7fb1ab7fe640 1 -- 172.21.15.33:0/3503258682 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5584bdcc5f50 msgr2=0x5584bdcc3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:31:03.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.774+0000 7fb1ab7fe640 1 --2- 172.21.15.33:0/3503258682 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5584bdcc5f50 0x5584bdcc3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:03.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.774+0000 7fb1ab7fe640 1 -- 172.21.15.33:0/3503258682 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5584bdcbb690 msgr2=0x5584bdcc2cd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T12:31:03.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.774+0000 7fb1ab7fe640 1 --2- 172.21.15.33:0/3503258682 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5584bdcbb690 0x5584bdcc2cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:03.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.774+0000 7fb1ab7fe640 1 -- 172.21.15.33:0/3503258682 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584bd9916a0 con 0x5584bdcbad70 2024-09-12T12:31:03.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.774+0000 7fb1ab7fe640 1 --2- 172.21.15.33:0/3503258682 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5584bdcbad70 0x5584bdcc5980 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb19c00bdd0 tx=0x7fb19c00f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c90f230edd542e10 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:31:03.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.775+0000 7fb18affd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:31:03.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.775+0000 7fb18affd640 1 -- 172.21.15.33:0/3503258682 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb19c004260 con 0x5584bdcbad70 2024-09-12T12:31:03.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.775+0000 7fb1b3f28740 1 -- 172.21.15.33:0/3503258682 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1a000ec60 con 0x5584bdcbad70 2024-09-12T12:31:03.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.775+0000 7fb18affd640 1 -- 172.21.15.33:0/3503258682 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fb19c004400 con 0x5584bdcbad70 2024-09-12T12:31:03.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.775+0000 7fb18affd640 1 -- 172.21.15.33:0/3503258682 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb19c044050 con 0x5584bdcbad70 2024-09-12T12:31:03.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.777+0000 7fb1b3f28740 10 client.25522 fetch_fsmap learned FSMap version 27 2024-09-12T12:31:03.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.777+0000 7fb1b3f28740 1 -- 172.21.15.33:0/3503258682 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5584bdcd4790 con 0x5584bdcbad70 2024-09-12T12:31:03.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.777+0000 7fb18affd640 1 -- 172.21.15.33:0/3503258682 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb1a000ec60 con 0x5584bdcbad70 2024-09-12T12:31:03.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.777+0000 7fb18affd640 1 -- 172.21.15.33:0/3503258682 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fb19c0337e0 con 0x5584bdcbad70 2024-09-12T12:31:03.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.777+0000 7fb1b3f28740 10 client.25522 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:31:03.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.777+0000 7fb1b3f28740 10 client.25522 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:31:03.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.777+0000 7fb1b3f28740 20 client.25522 populate_metadata read hostname 'smithi033' 2024-09-12T12:31:03.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.777+0000 7fb1b3f28740 1 --2- 172.21.15.33:0/3503258682 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5584bdcd6120 0x5584bdcd85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:03.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.777+0000 7fb1b3f28740 4 client.25522 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:31:03.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.777+0000 7fb1b3f28740 1 -- 172.21.15.33:0/3503258682 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5584bdc2d7f0 con 0x5584bdcd6120 2024-09-12T12:31:03.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.778+0000 7fb1aaffd640 1 --2- 172.21.15.33:0/3503258682 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5584bdcd6120 0x5584bdcd85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:03.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.781+0000 7fb1aaffd640 1 --2- 172.21.15.33:0/3503258682 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5584bdcd6120 0x5584bdcd85a0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fcde6f9d6b6db18b server_cookie=2c8717a30025ef17 in_seq=0 out_seq=0 2024-09-12T12:31:03.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.782+0000 7fb18affd640 10 client.25522 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:31:03.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.783+0000 7fb18affd640 1 -- 172.21.15.33:0/3503258682 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5584bdc2d7f0 con 0x5584bdcd6120 2024-09-12T12:31:03.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.783+0000 7fb18affd640 10 client.25522 handle_command_reply: tid=0 2024-09-12T12:31:03.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.783+0000 7fb1b3f28740 1 client.25522 shutdown 2024-09-12T12:31:03.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.793+0000 7fb1b3f28740 1 -- 172.21.15.33:0/3503258682 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5584bdcbad70 msgr2=0x5584bdcc5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:03.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.793+0000 7fb1b3f28740 1 --2- 172.21.15.33:0/3503258682 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5584bdcbad70 0x5584bdcc5980 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb19c00bdd0 tx=0x7fb19c00f730 comp rx=0 tx=0).stop 2024-09-12T12:31:03.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.795+0000 7fb1b3f28740 1 -- 172.21.15.33:0/3503258682 shutdown_connections 2024-09-12T12:31:03.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.795+0000 7fb1b3f28740 1 --2- 172.21.15.33:0/3503258682 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5584bdcd6120 0x5584bdcd85a0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:03.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.795+0000 7fb1b3f28740 1 --2- 172.21.15.33:0/3503258682 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5584bdcc5f50 0x5584bdcc3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:03.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.795+0000 7fb1b3f28740 1 --2- 172.21.15.33:0/3503258682 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5584bdcbb690 0x5584bdcc2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:03.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.795+0000 7fb1b3f28740 1 --2- 172.21.15.33:0/3503258682 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5584bdcbad70 0x5584bdcc5980 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:03.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.795+0000 7fb1b3f28740 1 -- 172.21.15.33:0/3503258682 >> 172.21.15.33:0/3503258682 conn(0x5584bdcb7300 msgr2=0x5584bdcbd030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:31:03.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.796+0000 7fb18affd640 0 client.25522 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:31:03.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.796+0000 7fb1b3f28740 1 -- 172.21.15.33:0/3503258682 shutdown_connections 2024-09-12T12:31:03.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.796+0000 7fb1b3f28740 1 -- 172.21.15.33:0/3503258682 wait complete. 2024-09-12T12:31:03.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.796+0000 7fb1b3f28740 20 client.25522 trim_cache size 0 max 16384 2024-09-12T12:31:03.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.832+0000 7fb1b3f28740 1 Processor -- start 2024-09-12T12:31:03.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.835+0000 7fb1b3f28740 1 -- start start 2024-09-12T12:31:03.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.836+0000 7fb1b3f28740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5584bdcbad70 0x5584bdcd8590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:03.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.836+0000 7fb1b3f28740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5584bdcbb690 0x5584bdcddeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:03.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.836+0000 7fb1b3f28740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5584bdcc5f50 0x5584bdcde3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:03.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.836+0000 7fb1b3f28740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb1980125c0 con 0x5584bdcbb690 2024-09-12T12:31:03.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.836+0000 7fb1b3f28740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb19800fe90 con 0x5584bdcc5f50 2024-09-12T12:31:03.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.836+0000 7fb1b3f28740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb19800dce0 con 0x5584bdcbad70 2024-09-12T12:31:03.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.836+0000 7fb1ab7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5584bdcbad70 0x5584bdcd8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:03.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.836+0000 7fb1abfff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5584bdcc5f50 0x5584bdcde3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:03.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.837+0000 7fb1abfff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5584bdcc5f50 0x5584bdcde3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:41670/0 (socket says 172.21.15.33:41670) 2024-09-12T12:31:03.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.837+0000 7fb1aaffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5584bdcbb690 0x5584bdcddeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:03.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.837+0000 7fb1abfff640 1 -- 172.21.15.33:0/4006010877 learned_addr learned my addr 172.21.15.33:0/4006010877 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:31:03.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.839+0000 7fb1aaffd640 1 -- 172.21.15.33:0/4006010877 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5584bdcbad70 msgr2=0x5584bdcd8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:31:03.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.840+0000 7fb1aaffd640 1 --2- 172.21.15.33:0/4006010877 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5584bdcbad70 0x5584bdcd8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:03.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.840+0000 7fb1aaffd640 1 -- 172.21.15.33:0/4006010877 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5584bdcc5f50 msgr2=0x5584bdcde3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:31:03.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.840+0000 7fb1aaffd640 1 --2- 172.21.15.33:0/4006010877 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5584bdcc5f50 0x5584bdcde3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:03.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.840+0000 7fb1aaffd640 1 -- 172.21.15.33:0/4006010877 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584bdcbaba0 con 0x5584bdcbb690 2024-09-12T12:31:03.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.846+0000 7fb1aaffd640 1 --2- 172.21.15.33:0/4006010877 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5584bdcbb690 0x5584bdcddeb0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x5584bdcb8160 tx=0x7fb1a4005eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a20838620b3d25b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:31:03.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.848+0000 7fb1917fa640 1 -- 172.21.15.33:0/4006010877 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a40bd2d0 con 0x5584bdcbb690 2024-09-12T12:31:03.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.848+0000 7fb1917fa640 1 -- 172.21.15.33:0/4006010877 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb1a4036040 con 0x5584bdcbb690 2024-09-12T12:31:03.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.848+0000 7fb1917fa640 1 -- 172.21.15.33:0/4006010877 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a40f11b0 con 0x5584bdcbb690 2024-09-12T12:31:03.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.849+0000 7fb1b3f28740 1 -- 172.21.15.33:0/4006010877 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5584bdcbb690 msgr2=0x5584bdcddeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:03.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.849+0000 7fb1b3f28740 1 --2- 172.21.15.33:0/4006010877 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5584bdcbb690 0x5584bdcddeb0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x5584bdcb8160 tx=0x7fb1a4005eb0 comp rx=0 tx=0).stop 2024-09-12T12:31:03.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.852+0000 7fb1b3f28740 1 -- 172.21.15.33:0/4006010877 shutdown_connections 2024-09-12T12:31:03.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.852+0000 7fb1b3f28740 1 --2- 172.21.15.33:0/4006010877 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5584bdcc5f50 0x5584bdcde3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:03.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.852+0000 7fb1b3f28740 1 --2- 172.21.15.33:0/4006010877 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5584bdcbb690 0x5584bdcddeb0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:03.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.852+0000 7fb1b3f28740 1 --2- 172.21.15.33:0/4006010877 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5584bdcbad70 0x5584bdcd8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:03.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.852+0000 7fb1b3f28740 1 -- 172.21.15.33:0/4006010877 >> 172.21.15.33:0/4006010877 conn(0x5584bdcb7300 msgr2=0x5584bdcc15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:31:03.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.858+0000 7fb1b3f28740 1 -- 172.21.15.33:0/4006010877 shutdown_connections 2024-09-12T12:31:03.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.858+0000 7fb1b3f28740 1 -- 172.21.15.33:0/4006010877 wait complete. 2024-09-12T12:31:03.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.859+0000 7fb1b3f28740 1 -- start start 2024-09-12T12:31:03.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.859+0000 7fb1b3f28740 1 Processor -- start 2024-09-12T12:31:03.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.862+0000 7fb1b3f28740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5584bdcbad70 0x5584bdcbfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:03.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.862+0000 7fb1b3f28740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5584bdcbb690 0x5584bdcc0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:03.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.862+0000 7fb1b3f28740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5584bdcc5f50 0x5584bdcc0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:03.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.862+0000 7fb1b3f28740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb19800e350 con 0x5584bdcbad70 2024-09-12T12:31:03.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.862+0000 7fb1b3f28740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb19800f7c0 con 0x5584bdcbb690 2024-09-12T12:31:03.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.862+0000 7fb1b3f28740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb19800ea20 con 0x5584bdcc5f50 2024-09-12T12:31:03.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.862+0000 7fb1b3f28740 10 client.0 _ll_register_callbacks cb 0x7fb19c00b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:31:03.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.863+0000 7fb1aaffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5584bdcbb690 0x5584bdcc0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:03.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.863+0000 7fb1aaffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5584bdcbb690 0x5584bdcc0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:41676/0 (socket says 172.21.15.33:41676) 2024-09-12T12:31:03.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.863+0000 7fb1aaffd640 1 -- 172.21.15.33:0/3115108519 learned_addr learned my addr 172.21.15.33:0/3115108519 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:31:03.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.864+0000 7fb1abfff640 1 --2- 172.21.15.33:0/3115108519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5584bdcc5f50 0x5584bdcc0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:03.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:31:03 smithi043 ceph-mon[34144]: pgmap v501: 129 pgs: 129 active+clean; 10 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 41 MiB/s wr, 657 op/s 2024-09-12T12:31:03.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.864+0000 7fb1ab7fe640 1 --2- 172.21.15.33:0/3115108519 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5584bdcbad70 0x5584bdcbfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:03.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.864+0000 7fb1aaffd640 1 -- 172.21.15.33:0/3115108519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5584bdcc5f50 msgr2=0x5584bdcc0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:31:03.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.864+0000 7fb1aaffd640 1 --2- 172.21.15.33:0/3115108519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5584bdcc5f50 0x5584bdcc0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:03.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.864+0000 7fb1aaffd640 1 -- 172.21.15.33:0/3115108519 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5584bdcbad70 msgr2=0x5584bdcbfbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:31:03.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.864+0000 7fb1aaffd640 1 --2- 172.21.15.33:0/3115108519 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5584bdcbad70 0x5584bdcbfbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:03.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.864+0000 7fb1aaffd640 1 -- 172.21.15.33:0/3115108519 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584bdcb7130 con 0x5584bdcbb690 2024-09-12T12:31:03.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.864+0000 7fb1ab7fe640 1 --2- 172.21.15.33:0/3115108519 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5584bdcbad70 0x5584bdcbfbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:31:03.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.864+0000 7fb1aaffd640 1 --2- 172.21.15.33:0/3115108519 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5584bdcbb690 0x5584bdcc0110 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4004af0 tx=0x7fb1a40be0e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4516556c665964d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:31:03.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.864+0000 7fb18affd640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:31:03.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.864+0000 7fb18affd640 1 -- 172.21.15.33:0/3115108519 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a40c1d20 con 0x5584bdcbb690 2024-09-12T12:31:03.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.865+0000 7fb1b3f28740 1 -- 172.21.15.33:0/3115108519 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1a4036040 con 0x5584bdcbb690 2024-09-12T12:31:03.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.865+0000 7fb18affd640 1 -- 172.21.15.33:0/3115108519 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fb1a40f11b0 con 0x5584bdcbb690 2024-09-12T12:31:03.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.865+0000 7fb18affd640 1 -- 172.21.15.33:0/3115108519 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb1a40c65e0 con 0x5584bdcbb690 2024-09-12T12:31:03.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.870+0000 7fb1b3f28740 10 client.25436 fetch_fsmap learned FSMap version 27 2024-09-12T12:31:03.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.870+0000 7fb1b3f28740 1 -- 172.21.15.33:0/3115108519 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5584bdd40ee0 con 0x5584bdcbb690 2024-09-12T12:31:03.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.870+0000 7fb18affd640 1 -- 172.21.15.33:0/3115108519 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb1a4036040 con 0x5584bdcbb690 2024-09-12T12:31:03.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.871+0000 7fb18affd640 1 -- 172.21.15.33:0/3115108519 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fb1a40c6170 con 0x5584bdcbb690 2024-09-12T12:31:03.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.873+0000 7fb1b3f28740 10 client.25436 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:31:03.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.873+0000 7fb1b3f28740 10 client.25436 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:31:03.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.873+0000 7fb1b3f28740 20 client.25436 populate_metadata read hostname 'smithi033' 2024-09-12T12:31:03.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.873+0000 7fb1b3f28740 1 --2- 172.21.15.33:0/3115108519 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5584bdd41300 0x5584bdd43720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:03.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.873+0000 7fb1b3f28740 4 client.25436 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T12:31:03.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.873+0000 7fb1b3f28740 1 -- 172.21.15.33:0/3115108519 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5584bdc27d00 con 0x5584bdd41300 2024-09-12T12:31:03.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.874+0000 7fb1ab7fe640 1 --2- 172.21.15.33:0/3115108519 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5584bdd41300 0x5584bdd43720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:03.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.874+0000 7fb1ab7fe640 1 --2- 172.21.15.33:0/3115108519 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5584bdd41300 0x5584bdd43720 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a63083a55d66345a server_cookie=4a4671018431c1b8 in_seq=0 out_seq=0 2024-09-12T12:31:03.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.874+0000 7fb18affd640 10 client.25436 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:31:03.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.876+0000 7fb18affd640 1 -- 172.21.15.33:0/3115108519 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5584bdc27d00 con 0x5584bdd41300 2024-09-12T12:31:03.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.876+0000 7fb18affd640 10 client.25436 handle_command_reply: tid=0 2024-09-12T12:31:03.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.878+0000 7fb1b3f28740 1 client.25436 shutdown 2024-09-12T12:31:03.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.881+0000 7fb1b3f28740 1 -- 172.21.15.33:0/3115108519 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5584bdcbb690 msgr2=0x5584bdcc0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:03.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.881+0000 7fb1b3f28740 1 --2- 172.21.15.33:0/3115108519 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5584bdcbb690 0x5584bdcc0110 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4004af0 tx=0x7fb1a40be0e0 comp rx=0 tx=0).stop 2024-09-12T12:31:03.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.882+0000 7fb1b3f28740 1 -- 172.21.15.33:0/3115108519 shutdown_connections 2024-09-12T12:31:03.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.882+0000 7fb1b3f28740 1 --2- 172.21.15.33:0/3115108519 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5584bdd41300 0x5584bdd43720 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:03.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.882+0000 7fb1b3f28740 1 --2- 172.21.15.33:0/3115108519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5584bdcc5f50 0x5584bdcc0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:03.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.882+0000 7fb1b3f28740 1 --2- 172.21.15.33:0/3115108519 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5584bdcbb690 0x5584bdcc0110 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:03.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.882+0000 7fb1b3f28740 1 --2- 172.21.15.33:0/3115108519 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5584bdcbad70 0x5584bdcbfbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:03.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.882+0000 7fb1b3f28740 1 -- 172.21.15.33:0/3115108519 >> 172.21.15.33:0/3115108519 conn(0x5584bdcb7300 msgr2=0x5584bdcc19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:31:03.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.882+0000 7fb18affd640 0 client.25436 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:31:03.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.883+0000 7fb1b3f28740 1 -- 172.21.15.33:0/3115108519 shutdown_connections 2024-09-12T12:31:03.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.884+0000 7fb1b3f28740 1 -- 172.21.15.33:0/3115108519 wait complete. 2024-09-12T12:31:03.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.885+0000 7fb1b3f28740 20 client.25436 trim_cache size 0 max 16384 2024-09-12T12:31:03.885 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:31:03.885 INFO:teuthology.orchestra.run.smithi033.stdout: "return_code": 0, 2024-09-12T12:31:03.885 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_tag": "9ff6c806-fa73-4837-88e9-a8c6f163c01f", 2024-09-12T12:31:03.885 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": "asynchronous" 2024-09-12T12:31:03.885 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:31:03.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.886+0000 7fb1b08ed640 1 -- 172.21.15.33:0/3008850890 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb1940a2da0 msgr2=0x7fb1940a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:03.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.886+0000 7fb1b08ed640 1 --2- 172.21.15.33:0/3008850890 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb1940a2da0 0x7fb1940a5260 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb1a00117b0 tx=0x7fb1a000f000 comp rx=0 tx=0).stop 2024-09-12T12:31:03.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.886+0000 7fb1b08ed640 1 -- 172.21.15.33:0/3008850890 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1ac110190 msgr2=0x7fb1ac11a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:03.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.886+0000 7fb1b08ed640 1 --2- 172.21.15.33:0/3008850890 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1ac110190 0x7fb1ac11a9c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4006010 tx=0x7fb1a4003c20 comp rx=0 tx=0).stop 2024-09-12T12:31:03.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.887+0000 7fb1b08ed640 1 -- 172.21.15.33:0/3008850890 shutdown_connections 2024-09-12T12:31:03.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.887+0000 7fb1b08ed640 1 --2- 172.21.15.33:0/3008850890 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb1940a2da0 0x7fb1940a5260 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:03.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.887+0000 7fb1b08ed640 1 --2- 172.21.15.33:0/3008850890 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1ac11b140 0x7fb1ac114500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:03.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.887+0000 7fb1b08ed640 1 --2- 172.21.15.33:0/3008850890 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1ac110190 0x7fb1ac11a9c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:03.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.887+0000 7fb1b08ed640 1 --2- 172.21.15.33:0/3008850890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1ac06ea30 0x7fb1ac11a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:03.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.887+0000 7fb1b08ed640 1 -- 172.21.15.33:0/3008850890 >> 172.21.15.33:0/3008850890 conn(0x7fb1ac073180 msgr2=0x7fb1ac11b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:31:03.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.887+0000 7fb1b08ed640 1 -- 172.21.15.33:0/3008850890 shutdown_connections 2024-09-12T12:31:03.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:03.888+0000 7fb1b08ed640 1 -- 172.21.15.33:0/3008850890 wait complete. 2024-09-12T12:31:03.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:31:03 smithi102 ceph-mon[34799]: pgmap v501: 129 pgs: 129 active+clean; 10 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 41 MiB/s wr, 657 op/s 2024-09-12T12:31:04.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:31:04 smithi033 ceph-mon[31246]: scrub summary: active paths [/] 2024-09-12T12:31:04.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:31:04 smithi033 ceph-mon[31246]: scrub summary: idle+waiting paths [/] 2024-09-12T12:31:04.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:31:04 smithi043 ceph-mon[34144]: scrub summary: active paths [/] 2024-09-12T12:31:04.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:31:04 smithi043 ceph-mon[34144]: scrub summary: idle+waiting paths [/] 2024-09-12T12:31:04.872 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T12:31:04.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:31:04 smithi102 ceph-mon[34799]: scrub summary: active paths [/] 2024-09-12T12:31:04.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:31:04 smithi102 ceph-mon[34799]: scrub summary: idle+waiting paths [/] 2024-09-12T12:31:05.611 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:31:05.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:31:05 smithi033 ceph-mon[31246]: scrub queued for path: / 2024-09-12T12:31:05.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:31:05 smithi033 ceph-mon[31246]: scrub summary: idle+waiting paths [/] 2024-09-12T12:31:05.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:31:05 smithi033 ceph-mon[31246]: scrub summary: active paths [/] 2024-09-12T12:31:05.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:31:05 smithi033 ceph-mon[31246]: scrub summary: idle+waiting paths [/] 2024-09-12T12:31:05.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:31:05 smithi033 ceph-mon[31246]: pgmap v502: 129 pgs: 129 active+clean; 10 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 43 MiB/s wr, 699 op/s 2024-09-12T12:31:05.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:31:05 smithi043 ceph-mon[34144]: scrub queued for path: / 2024-09-12T12:31:05.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:31:05 smithi043 ceph-mon[34144]: scrub summary: idle+waiting paths [/] 2024-09-12T12:31:05.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:31:05 smithi043 ceph-mon[34144]: scrub summary: active paths [/] 2024-09-12T12:31:05.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:31:05 smithi043 ceph-mon[34144]: scrub summary: idle+waiting paths [/] 2024-09-12T12:31:05.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:31:05 smithi043 ceph-mon[34144]: pgmap v502: 129 pgs: 129 active+clean; 10 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 43 MiB/s wr, 699 op/s 2024-09-12T12:31:05.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:31:05 smithi102 ceph-mon[34799]: scrub queued for path: / 2024-09-12T12:31:05.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:31:05 smithi102 ceph-mon[34799]: scrub summary: idle+waiting paths [/] 2024-09-12T12:31:05.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:31:05 smithi102 ceph-mon[34799]: scrub summary: active paths [/] 2024-09-12T12:31:05.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:31:05 smithi102 ceph-mon[34799]: scrub summary: idle+waiting paths [/] 2024-09-12T12:31:05.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:31:05 smithi102 ceph-mon[34799]: pgmap v502: 129 pgs: 129 active+clean; 10 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 43 MiB/s wr, 699 op/s 2024-09-12T12:31:07.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.569+0000 7f6714b43640 1 -- 172.21.15.33:0/3109836089 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f671011b140 msgr2=0x7f671011d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:07.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.569+0000 7f6714b43640 1 --2- 172.21.15.33:0/3109836089 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f671011b140 0x7f671011d530 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6708009be0 tx=0x7f670802a710 comp rx=0 tx=0).stop 2024-09-12T12:31:07.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.570+0000 7f6714b43640 1 -- 172.21.15.33:0/3109836089 shutdown_connections 2024-09-12T12:31:07.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.570+0000 7f6714b43640 1 --2- 172.21.15.33:0/3109836089 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f671011b140 0x7f671011d530 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:07.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.570+0000 7f6714b43640 1 --2- 172.21.15.33:0/3109836089 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6710109830 0x7f6710109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:07.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.570+0000 7f6714b43640 1 --2- 172.21.15.33:0/3109836089 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6710109450 0x7f6710110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:07.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.570+0000 7f6714b43640 1 -- 172.21.15.33:0/3109836089 >> 172.21.15.33:0/3109836089 conn(0x7f671006e140 msgr2=0x7f671006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:31:07.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.571+0000 7f6714b43640 1 -- 172.21.15.33:0/3109836089 shutdown_connections 2024-09-12T12:31:07.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.572+0000 7f6714b43640 1 -- 172.21.15.33:0/3109836089 wait complete. 2024-09-12T12:31:07.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.573+0000 7f6714b43640 1 Processor -- start 2024-09-12T12:31:07.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.574+0000 7f6714b43640 1 -- start start 2024-09-12T12:31:07.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.575+0000 7f6714b43640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6710109450 0x7f67101a7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:07.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.575+0000 7f6714b43640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6710109830 0x7f67101a7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:07.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.575+0000 7f6714b43640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f671011b140 0x7f67101abb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:07.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.575+0000 7f6714b43640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6710120c90 con 0x7f671011b140 2024-09-12T12:31:07.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.575+0000 7f6714b43640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6710120b10 con 0x7f6710109450 2024-09-12T12:31:07.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.575+0000 7f6714b43640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6710120e10 con 0x7f6710109830 2024-09-12T12:31:07.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.575+0000 7f670ed9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f671011b140 0x7f67101abb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:07.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.575+0000 7f670ed9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f671011b140 0x7f67101abb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33446/0 (socket says 172.21.15.33:33446) 2024-09-12T12:31:07.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.575+0000 7f670ed9d640 1 -- 172.21.15.33:0/3583091924 learned_addr learned my addr 172.21.15.33:0/3583091924 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:31:07.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.575+0000 7f670e59c640 1 --2- 172.21.15.33:0/3583091924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6710109450 0x7f67101a7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:07.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.577+0000 7f670ed9d640 1 -- 172.21.15.33:0/3583091924 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6710109830 msgr2=0x7f67101a7770 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T12:31:07.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.577+0000 7f670ed9d640 1 --2- 172.21.15.33:0/3583091924 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6710109830 0x7f67101a7770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:07.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.577+0000 7f670ed9d640 1 -- 172.21.15.33:0/3583091924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6710109450 msgr2=0x7f67101a7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:07.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.577+0000 7f670ed9d640 1 --2- 172.21.15.33:0/3583091924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6710109450 0x7f67101a7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:07.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.577+0000 7f670ed9d640 1 -- 172.21.15.33:0/3583091924 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67101ac200 con 0x7f671011b140 2024-09-12T12:31:07.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.578+0000 7f670ed9d640 1 --2- 172.21.15.33:0/3583091924 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f671011b140 0x7f67101abb00 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f6708031040 tx=0x7f6708030640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:31:07.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.579+0000 7f67077fe640 1 -- 172.21.15.33:0/3583091924 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6708041020 con 0x7f671011b140 2024-09-12T12:31:07.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.579+0000 7f67077fe640 1 -- 172.21.15.33:0/3583091924 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6708037040 con 0x7f671011b140 2024-09-12T12:31:07.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.579+0000 7f67077fe640 1 -- 172.21.15.33:0/3583091924 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6708036070 con 0x7f671011b140 2024-09-12T12:31:07.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.580+0000 7f6714b43640 1 -- 172.21.15.33:0/3583091924 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67101ac490 con 0x7f671011b140 2024-09-12T12:31:07.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.581+0000 7f6714b43640 1 -- 172.21.15.33:0/3583091924 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67101ac830 con 0x7f671011b140 2024-09-12T12:31:07.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.585+0000 7f6716f1c740 1 Processor -- start 2024-09-12T12:31:07.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.586+0000 7f67077fe640 1 -- 172.21.15.33:0/3583091924 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6708044020 con 0x7f671011b140 2024-09-12T12:31:07.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.586+0000 7f6716f1c740 1 -- start start 2024-09-12T12:31:07.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.586+0000 7f6716f1c740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56491e5874a0 0x56491e587880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:07.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.586+0000 7f6716f1c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56491e587dc0 0x56491e592140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:07.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.586+0000 7f6716f1c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56491e592680 0x56491e594a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:07.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.586+0000 7f6716f1c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56491e4ed2e0 con 0x56491e587dc0 2024-09-12T12:31:07.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.586+0000 7f6716f1c740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56491e494ce0 con 0x56491e592680 2024-09-12T12:31:07.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.586+0000 7f6716f1c740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56491e4e92a0 con 0x56491e5874a0 2024-09-12T12:31:07.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.587+0000 7f670e59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56491e587dc0 0x56491e592140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:07.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.587+0000 7f670e59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56491e587dc0 0x56491e592140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33452/0 (socket says 172.21.15.33:33452) 2024-09-12T12:31:07.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.587+0000 7f670e59c640 1 -- 172.21.15.33:0/1491717139 learned_addr learned my addr 172.21.15.33:0/1491717139 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:31:07.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.587+0000 7f67077fe640 1 --2- 172.21.15.33:0/3583091924 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f66fc0a2cc0 0x7f66fc0a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:07.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.588+0000 7f67077fe640 1 -- 172.21.15.33:0/3583091924 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f67080efb70 con 0x7f671011b140 2024-09-12T12:31:07.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.589+0000 7f670ed9d640 1 --2- 172.21.15.33:0/3583091924 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f66fc0a2cc0 0x7f66fc0a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:07.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.592+0000 7f670dd9b640 1 --2- 172.21.15.33:0/1491717139 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56491e5874a0 0x56491e587880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:07.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.592+0000 7f670e59c640 1 -- 172.21.15.33:0/1491717139 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56491e5874a0 msgr2=0x56491e587880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:31:07.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.592+0000 7f670e59c640 1 --2- 172.21.15.33:0/1491717139 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56491e5874a0 0x56491e587880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:07.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.592+0000 7f670e59c640 1 -- 172.21.15.33:0/1491717139 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56491e592680 msgr2=0x56491e594a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:31:07.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.592+0000 7f670dd9b640 1 --2- 172.21.15.33:0/1491717139 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56491e592680 0x56491e594a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:07.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.592+0000 7f670e59c640 1 --2- 172.21.15.33:0/1491717139 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56491e592680 0x56491e594a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:07.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.592+0000 7f670e59c640 1 -- 172.21.15.33:0/1491717139 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56491e479440 con 0x56491e587dc0 2024-09-12T12:31:07.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.592+0000 7f670ed9d640 1 --2- 172.21.15.33:0/3583091924 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f66fc0a2cc0 0x7f66fc0a5180 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f67080bbf70 tx=0x7f6708030730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:31:07.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.592+0000 7f670e59c640 1 --2- 172.21.15.33:0/1491717139 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56491e587dc0 0x56491e592140 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f66f8009d20 tx=0x7f66f80117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edaed6c52c777c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:31:07.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.593+0000 7f6704ff9640 1 -- 172.21.15.33:0/1491717139 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f8012650 con 0x56491e587dc0 2024-09-12T12:31:07.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.593+0000 7f6704ff9640 1 -- 172.21.15.33:0/1491717139 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f66f8009e10 con 0x56491e587dc0 2024-09-12T12:31:07.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.593+0000 7f6704ff9640 1 -- 172.21.15.33:0/1491717139 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f800fc30 con 0x56491e587dc0 2024-09-12T12:31:07.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.595+0000 7f6716f1c740 1 -- 172.21.15.33:0/1491717139 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56491e587dc0 msgr2=0x56491e592140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:07.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.595+0000 7f6716f1c740 1 --2- 172.21.15.33:0/1491717139 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56491e587dc0 0x56491e592140 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f66f8009d20 tx=0x7f66f80117b0 comp rx=0 tx=0).stop 2024-09-12T12:31:07.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.596+0000 7f6716f1c740 1 -- 172.21.15.33:0/1491717139 shutdown_connections 2024-09-12T12:31:07.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.596+0000 7f6716f1c740 1 --2- 172.21.15.33:0/1491717139 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56491e592680 0x56491e594a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:07.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.596+0000 7f6716f1c740 1 --2- 172.21.15.33:0/1491717139 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56491e587dc0 0x56491e592140 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:07.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.596+0000 7f6716f1c740 1 --2- 172.21.15.33:0/1491717139 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56491e5874a0 0x56491e587880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:07.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.596+0000 7f6716f1c740 1 -- 172.21.15.33:0/1491717139 >> 172.21.15.33:0/1491717139 conn(0x56491e583a30 msgr2=0x56491e583e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:31:07.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.599+0000 7f6716f1c740 1 -- 172.21.15.33:0/1491717139 shutdown_connections 2024-09-12T12:31:07.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.606+0000 7f6716f1c740 1 -- 172.21.15.33:0/1491717139 wait complete. 2024-09-12T12:31:07.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.607+0000 7f6716f1c740 1 -- start start 2024-09-12T12:31:07.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.607+0000 7f6716f1c740 1 Processor -- start 2024-09-12T12:31:07.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.607+0000 7f6716f1c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56491e5874a0 0x56491e591f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:07.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.607+0000 7f6716f1c740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56491e587dc0 0x56491e58f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:07.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.607+0000 7f6716f1c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56491e592680 0x56491e58f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:07.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.607+0000 7f6716f1c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56491e595250 con 0x56491e5874a0 2024-09-12T12:31:07.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.607+0000 7f6716f1c740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56491e4a8050 con 0x56491e592680 2024-09-12T12:31:07.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.607+0000 7f6716f1c740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56491e5953d0 con 0x56491e587dc0 2024-09-12T12:31:07.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.607+0000 7f6716f1c740 10 client.0 _ll_register_callbacks cb 0x56491e4e8160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:31:07.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.608+0000 7f670dd9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56491e592680 0x56491e58f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:07.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.608+0000 7f670dd9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56491e592680 0x56491e58f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:41706/0 (socket says 172.21.15.33:41706) 2024-09-12T12:31:07.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.608+0000 7f670dd9b640 1 -- 172.21.15.33:0/1990153674 learned_addr learned my addr 172.21.15.33:0/1990153674 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:31:07.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.608+0000 7f670e59c640 1 --2- 172.21.15.33:0/1990153674 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56491e587dc0 0x56491e58f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:07.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.609+0000 7f670dd9b640 1 --2- 172.21.15.33:0/1990153674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56491e5874a0 0x56491e591f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:07.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.609+0000 7f670dd9b640 1 -- 172.21.15.33:0/1990153674 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56491e587dc0 msgr2=0x56491e58f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:31:07.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.609+0000 7f670dd9b640 1 --2- 172.21.15.33:0/1990153674 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56491e587dc0 0x56491e58f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:07.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.609+0000 7f670dd9b640 1 -- 172.21.15.33:0/1990153674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56491e5874a0 msgr2=0x56491e591f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:31:07.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.609+0000 7f670dd9b640 1 --2- 172.21.15.33:0/1990153674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56491e5874a0 0x56491e591f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:07.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.609+0000 7f670dd9b640 1 -- 172.21.15.33:0/1990153674 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56491e25e3c0 con 0x56491e592680 2024-09-12T12:31:07.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.610+0000 7f670dd9b640 1 --2- 172.21.15.33:0/1990153674 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56491e592680 0x56491e58f710 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f670000dec0 tx=0x7f67000047d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4787a18d14e129ba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:31:07.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.610+0000 7f66f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:31:07.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.611+0000 7f66f5ffb640 1 -- 172.21.15.33:0/1990153674 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f670000fe20 con 0x56491e592680 2024-09-12T12:31:07.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.611+0000 7f66f5ffb640 1 -- 172.21.15.33:0/1990153674 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f6700018420 con 0x56491e592680 2024-09-12T12:31:07.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.611+0000 7f6716f1c740 1 -- 172.21.15.33:0/1990153674 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66f8009e10 con 0x56491e592680 2024-09-12T12:31:07.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.612+0000 7f66f5ffb640 1 -- 172.21.15.33:0/1990153674 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6700018620 con 0x56491e592680 2024-09-12T12:31:07.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.613+0000 7f6716f1c740 10 client.25445 fetch_fsmap learned FSMap version 27 2024-09-12T12:31:07.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.613+0000 7f6716f1c740 1 -- 172.21.15.33:0/1990153674 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56491e5a0ba0 con 0x56491e592680 2024-09-12T12:31:07.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.614+0000 7f66f5ffb640 1 -- 172.21.15.33:0/1990153674 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f66f8009e10 con 0x56491e592680 2024-09-12T12:31:07.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.614+0000 7f66f5ffb640 1 -- 172.21.15.33:0/1990153674 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f6700014450 con 0x56491e592680 2024-09-12T12:31:07.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.614+0000 7f6716f1c740 10 client.25445 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:31:07.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.614+0000 7f6716f1c740 10 client.25445 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:31:07.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.614+0000 7f6716f1c740 20 client.25445 populate_metadata read hostname 'smithi033' 2024-09-12T12:31:07.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.614+0000 7f6716f1c740 1 --2- 172.21.15.33:0/1990153674 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x56491e5a2440 0x56491e5a48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:07.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.614+0000 7f6716f1c740 4 client.25445 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:31:07.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.614+0000 7f6716f1c740 1 -- 172.21.15.33:0/1990153674 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56491e4fa850 con 0x56491e5a2440 2024-09-12T12:31:07.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.619+0000 7f670e59c640 1 --2- 172.21.15.33:0/1990153674 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x56491e5a2440 0x56491e5a48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:07.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.619+0000 7f670e59c640 1 --2- 172.21.15.33:0/1990153674 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x56491e5a2440 0x56491e5a48a0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa2713794e46a05a server_cookie=9b440fb7b5ba1dff in_seq=0 out_seq=0 2024-09-12T12:31:07.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.619+0000 7f66f5ffb640 10 client.25445 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:31:07.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.621+0000 7f66f5ffb640 1 -- 172.21.15.33:0/1990153674 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56491e4fa850 con 0x56491e5a2440 2024-09-12T12:31:07.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.621+0000 7f66f5ffb640 10 client.25445 handle_command_reply: tid=0 2024-09-12T12:31:07.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.621+0000 7f6716f1c740 1 client.25445 shutdown 2024-09-12T12:31:07.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.621+0000 7f6716f1c740 1 -- 172.21.15.33:0/1990153674 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56491e592680 msgr2=0x56491e58f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:07.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.621+0000 7f6716f1c740 1 --2- 172.21.15.33:0/1990153674 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56491e592680 0x56491e58f710 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f670000dec0 tx=0x7f67000047d0 comp rx=0 tx=0).stop 2024-09-12T12:31:07.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.622+0000 7f6716f1c740 1 -- 172.21.15.33:0/1990153674 shutdown_connections 2024-09-12T12:31:07.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.622+0000 7f6716f1c740 1 --2- 172.21.15.33:0/1990153674 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x56491e5a2440 0x56491e5a48a0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:07.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.622+0000 7f6716f1c740 1 --2- 172.21.15.33:0/1990153674 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56491e592680 0x56491e58f710 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:07.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.622+0000 7f6716f1c740 1 --2- 172.21.15.33:0/1990153674 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56491e587dc0 0x56491e58f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:07.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.622+0000 7f6716f1c740 1 --2- 172.21.15.33:0/1990153674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56491e5874a0 0x56491e591f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:07.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.622+0000 7f6716f1c740 1 -- 172.21.15.33:0/1990153674 >> 172.21.15.33:0/1990153674 conn(0x56491e583a30 msgr2=0x56491e589710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:31:07.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.622+0000 7f66f5ffb640 0 client.25445 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:31:07.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.623+0000 7f6716f1c740 1 -- 172.21.15.33:0/1990153674 shutdown_connections 2024-09-12T12:31:07.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.623+0000 7f6716f1c740 1 -- 172.21.15.33:0/1990153674 wait complete. 2024-09-12T12:31:07.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.623+0000 7f6716f1c740 20 client.25445 trim_cache size 0 max 16384 2024-09-12T12:31:07.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.660+0000 7f6716f1c740 1 Processor -- start 2024-09-12T12:31:07.660 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:31:07 smithi033 ceph-mon[31246]: pgmap v503: 129 pgs: 129 active+clean; 10 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 37 MiB/s wr, 595 op/s 2024-09-12T12:31:07.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.661+0000 7f6716f1c740 1 -- start start 2024-09-12T12:31:07.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.661+0000 7f6716f1c740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56491e5874a0 0x56491e59e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:07.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.661+0000 7f6716f1c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56491e587dc0 0x56491e5aa1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:07.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.661+0000 7f6716f1c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56491e592680 0x56491e5aa6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:07.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.661+0000 7f6716f1c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f67101c8c80 con 0x56491e587dc0 2024-09-12T12:31:07.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.661+0000 7f6716f1c740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f67101c6550 con 0x56491e592680 2024-09-12T12:31:07.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.661+0000 7f6716f1c740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6710118700 con 0x56491e5874a0 2024-09-12T12:31:07.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.663+0000 7f670dd9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56491e5874a0 0x56491e59e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:07.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.663+0000 7f670dd9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56491e5874a0 0x56491e59e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:47776/0 (socket says 172.21.15.33:47776) 2024-09-12T12:31:07.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.663+0000 7f670dd9b640 1 -- 172.21.15.33:0/3988144184 learned_addr learned my addr 172.21.15.33:0/3988144184 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:31:07.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.663+0000 7f670dd9b640 1 --2- 172.21.15.33:0/3988144184 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56491e592680 0x56491e5aa6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:07.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.663+0000 7f670e59c640 1 --2- 172.21.15.33:0/3988144184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56491e587dc0 0x56491e5aa1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:07.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.663+0000 7f670dd9b640 1 -- 172.21.15.33:0/3988144184 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56491e592680 msgr2=0x56491e5aa6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:31:07.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.663+0000 7f670dd9b640 1 --2- 172.21.15.33:0/3988144184 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56491e592680 0x56491e5aa6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:07.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.663+0000 7f670dd9b640 1 -- 172.21.15.33:0/3988144184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56491e587dc0 msgr2=0x56491e5aa1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:31:07.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.663+0000 7f670dd9b640 1 --2- 172.21.15.33:0/3988144184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56491e587dc0 0x56491e5aa1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:07.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.663+0000 7f670dd9b640 1 -- 172.21.15.33:0/3988144184 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56491e583860 con 0x56491e5874a0 2024-09-12T12:31:07.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.663+0000 7f670e59c640 1 --2- 172.21.15.33:0/3988144184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56491e587dc0 0x56491e5aa1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:31:07.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.664+0000 7f670dd9b640 1 --2- 172.21.15.33:0/3988144184 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56491e5874a0 0x56491e59e4e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6700016730 tx=0x7f6700004840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d2d6151a7ed8479 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:31:07.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.664+0000 7f66f7fff640 1 -- 172.21.15.33:0/3988144184 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f670000d2a0 con 0x56491e5874a0 2024-09-12T12:31:07.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.665+0000 7f66f7fff640 1 -- 172.21.15.33:0/3988144184 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f670001d070 con 0x56491e5874a0 2024-09-12T12:31:07.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.665+0000 7f66f7fff640 1 -- 172.21.15.33:0/3988144184 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67000145f0 con 0x56491e5874a0 2024-09-12T12:31:07.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.666+0000 7f6716f1c740 1 -- 172.21.15.33:0/3988144184 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56491e5874a0 msgr2=0x56491e59e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:07.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.666+0000 7f6716f1c740 1 --2- 172.21.15.33:0/3988144184 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56491e5874a0 0x56491e59e4e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6700016730 tx=0x7f6700004840 comp rx=0 tx=0).stop 2024-09-12T12:31:07.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.669+0000 7f6716f1c740 1 -- 172.21.15.33:0/3988144184 shutdown_connections 2024-09-12T12:31:07.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.669+0000 7f6716f1c740 1 --2- 172.21.15.33:0/3988144184 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56491e592680 0x56491e5aa6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:07.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.669+0000 7f6716f1c740 1 --2- 172.21.15.33:0/3988144184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56491e587dc0 0x56491e5aa1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:07.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.669+0000 7f6716f1c740 1 --2- 172.21.15.33:0/3988144184 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56491e5874a0 0x56491e59e4e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:07.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.669+0000 7f6716f1c740 1 -- 172.21.15.33:0/3988144184 >> 172.21.15.33:0/3988144184 conn(0x56491e583a30 msgr2=0x56491e58a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:31:07.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.670+0000 7f6716f1c740 1 -- 172.21.15.33:0/3988144184 shutdown_connections 2024-09-12T12:31:07.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.671+0000 7f6716f1c740 1 -- 172.21.15.33:0/3988144184 wait complete. 2024-09-12T12:31:07.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.671+0000 7f6716f1c740 1 -- start start 2024-09-12T12:31:07.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.671+0000 7f6716f1c740 1 Processor -- start 2024-09-12T12:31:07.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.671+0000 7f6716f1c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56491e5874a0 0x56491e59acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:07.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.672+0000 7f6716f1c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56491e587dc0 0x56491e596020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:07.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.672+0000 7f6716f1c740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56491e592680 0x56491e596560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:07.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.672+0000 7f6716f1c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6710118d70 con 0x56491e587dc0 2024-09-12T12:31:07.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.672+0000 7f6716f1c740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f67101c5e80 con 0x56491e5874a0 2024-09-12T12:31:07.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.672+0000 7f6716f1c740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f67101c50e0 con 0x56491e592680 2024-09-12T12:31:07.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.672+0000 7f6716f1c740 10 client.0 _ll_register_callbacks cb 0x7f670000d1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:31:07.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.672+0000 7f670dd9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56491e5874a0 0x56491e59acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:07.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.672+0000 7f670dd9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56491e592680 0x56491e596560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:07.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.672+0000 7f670dd9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56491e5874a0 0x56491e59acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:41722/0 (socket says 172.21.15.33:41722) 2024-09-12T12:31:07.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.672+0000 7f670dd9b640 1 -- 172.21.15.33:0/143291507 learned_addr learned my addr 172.21.15.33:0/143291507 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:31:07.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.673+0000 7f670e59c640 1 --2- 172.21.15.33:0/143291507 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56491e587dc0 0x56491e596020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:07.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.673+0000 7f670dd9b640 1 -- 172.21.15.33:0/143291507 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56491e5874a0 msgr2=0x56491e59acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:31:07.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.673+0000 7f670dd9b640 1 --2- 172.21.15.33:0/143291507 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56491e5874a0 0x56491e59acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:07.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.673+0000 7f670dd9b640 1 -- 172.21.15.33:0/143291507 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56491e587dc0 msgr2=0x56491e596020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:31:07.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.673+0000 7f670dd9b640 1 --2- 172.21.15.33:0/143291507 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56491e587dc0 0x56491e596020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:07.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.673+0000 7f670dd9b640 1 -- 172.21.15.33:0/143291507 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56491e596d90 con 0x56491e592680 2024-09-12T12:31:07.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.673+0000 7f670dd9b640 1 --2- 172.21.15.33:0/143291507 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56491e592680 0x56491e596560 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f67000147f0 tx=0x7f6700000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3facc774d2034b6f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:31:07.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.673+0000 7f66f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:31:07.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.674+0000 7f66f5ffb640 1 -- 172.21.15.33:0/143291507 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f670000fc20 con 0x56491e592680 2024-09-12T12:31:07.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.674+0000 7f6716f1c740 1 -- 172.21.15.33:0/143291507 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f670001d070 con 0x56491e592680 2024-09-12T12:31:07.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.674+0000 7f66f5ffb640 1 -- 172.21.15.33:0/143291507 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f670000fdc0 con 0x56491e592680 2024-09-12T12:31:07.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.674+0000 7f66f5ffb640 1 -- 172.21.15.33:0/143291507 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f67000149e0 con 0x56491e592680 2024-09-12T12:31:07.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.674+0000 7f6716f1c740 10 client.25537 fetch_fsmap learned FSMap version 27 2024-09-12T12:31:07.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.674+0000 7f6716f1c740 1 -- 172.21.15.33:0/143291507 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56491e60d070 con 0x56491e592680 2024-09-12T12:31:07.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.675+0000 7f66f5ffb640 1 -- 172.21.15.33:0/143291507 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f670001d070 con 0x56491e592680 2024-09-12T12:31:07.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.675+0000 7f66f5ffb640 1 -- 172.21.15.33:0/143291507 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f67000225b0 con 0x56491e592680 2024-09-12T12:31:07.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.677+0000 7f6716f1c740 10 client.25537 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:31:07.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.677+0000 7f6716f1c740 10 client.25537 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:31:07.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.677+0000 7f6716f1c740 20 client.25537 populate_metadata read hostname 'smithi033' 2024-09-12T12:31:07.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.677+0000 7f6716f1c740 1 --2- 172.21.15.33:0/143291507 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x56491e60d6e0 0x56491e60fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:07.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.677+0000 7f6716f1c740 4 client.25537 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:31:07.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.677+0000 7f6716f1c740 1 -- 172.21.15.33:0/143291507 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56491e4f4d60 con 0x56491e60d6e0 2024-09-12T12:31:07.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.677+0000 7f670e59c640 1 --2- 172.21.15.33:0/143291507 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x56491e60d6e0 0x56491e60fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:07.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.683+0000 7f670e59c640 1 --2- 172.21.15.33:0/143291507 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x56491e60d6e0 0x56491e60fb00 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b35c9b6c3c503809 server_cookie=1b9da8b528e802f2 in_seq=0 out_seq=0 2024-09-12T12:31:07.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.683+0000 7f66f5ffb640 10 client.25537 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:31:07.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.684+0000 7f66f5ffb640 1 -- 172.21.15.33:0/143291507 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x56491e4f4d60 con 0x56491e60d6e0 2024-09-12T12:31:07.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.684+0000 7f66f5ffb640 10 client.25537 handle_command_reply: tid=0 2024-09-12T12:31:07.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.686+0000 7f6716f1c740 1 client.25537 shutdown 2024-09-12T12:31:07.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.693+0000 7f6716f1c740 1 -- 172.21.15.33:0/143291507 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56491e592680 msgr2=0x56491e596560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:07.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.693+0000 7f6716f1c740 1 --2- 172.21.15.33:0/143291507 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56491e592680 0x56491e596560 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f67000147f0 tx=0x7f6700000bc0 comp rx=0 tx=0).stop 2024-09-12T12:31:07.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.694+0000 7f6716f1c740 1 -- 172.21.15.33:0/143291507 shutdown_connections 2024-09-12T12:31:07.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.694+0000 7f6716f1c740 1 --2- 172.21.15.33:0/143291507 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x56491e60d6e0 0x56491e60fb00 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:07.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.694+0000 7f6716f1c740 1 --2- 172.21.15.33:0/143291507 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56491e592680 0x56491e596560 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:07.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.694+0000 7f6716f1c740 1 --2- 172.21.15.33:0/143291507 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56491e587dc0 0x56491e596020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:07.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.694+0000 7f6716f1c740 1 --2- 172.21.15.33:0/143291507 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56491e5874a0 0x56491e59acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:07.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.694+0000 7f6716f1c740 1 -- 172.21.15.33:0/143291507 >> 172.21.15.33:0/143291507 conn(0x56491e583a30 msgr2=0x56491e590a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:31:07.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.694+0000 7f66f5ffb640 0 client.25537 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:31:07.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.695+0000 7f6716f1c740 1 -- 172.21.15.33:0/143291507 shutdown_connections 2024-09-12T12:31:07.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.695+0000 7f6716f1c740 1 -- 172.21.15.33:0/143291507 wait complete. 2024-09-12T12:31:07.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.695+0000 7f6716f1c740 20 client.25537 trim_cache size 0 max 16384 2024-09-12T12:31:07.696 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:31:07.696 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T12:31:07.696 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": { 2024-09-12T12:31:07.696 INFO:teuthology.orchestra.run.smithi033.stdout: "9ff6c806-fa73-4837-88e9-a8c6f163c01f": { 2024-09-12T12:31:07.697 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-09-12T12:31:07.697 INFO:teuthology.orchestra.run.smithi033.stdout: "tag": "9ff6c806-fa73-4837-88e9-a8c6f163c01f", 2024-09-12T12:31:07.697 INFO:teuthology.orchestra.run.smithi033.stdout: "options": "recursive,force" 2024-09-12T12:31:07.697 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:31:07.697 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:31:07.697 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:31:07.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.696+0000 7f6714b43640 1 -- 172.21.15.33:0/3583091924 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f66fc0a2cc0 msgr2=0x7f66fc0a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:07.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.696+0000 7f6714b43640 1 --2- 172.21.15.33:0/3583091924 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f66fc0a2cc0 0x7f66fc0a5180 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f67080bbf70 tx=0x7f6708030730 comp rx=0 tx=0).stop 2024-09-12T12:31:07.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.696+0000 7f6714b43640 1 -- 172.21.15.33:0/3583091924 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f671011b140 msgr2=0x7f67101abb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:07.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.696+0000 7f6714b43640 1 --2- 172.21.15.33:0/3583091924 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f671011b140 0x7f67101abb00 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f6708031040 tx=0x7f6708030640 comp rx=0 tx=0).stop 2024-09-12T12:31:07.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.697+0000 7f6714b43640 1 -- 172.21.15.33:0/3583091924 shutdown_connections 2024-09-12T12:31:07.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.697+0000 7f6714b43640 1 --2- 172.21.15.33:0/3583091924 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f66fc0a2cc0 0x7f66fc0a5180 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:07.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.697+0000 7f6714b43640 1 --2- 172.21.15.33:0/3583091924 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f671011b140 0x7f67101abb00 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:07.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.697+0000 7f6714b43640 1 --2- 172.21.15.33:0/3583091924 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6710109830 0x7f67101a7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:07.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.697+0000 7f6714b43640 1 --2- 172.21.15.33:0/3583091924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6710109450 0x7f67101a7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:07.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.697+0000 7f6714b43640 1 -- 172.21.15.33:0/3583091924 >> 172.21.15.33:0/3583091924 conn(0x7f671006e140 msgr2=0x7f671011c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:31:07.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.697+0000 7f6714b43640 1 -- 172.21.15.33:0/3583091924 shutdown_connections 2024-09-12T12:31:07.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:07.697+0000 7f6714b43640 1 -- 172.21.15.33:0/3583091924 wait complete. 2024-09-12T12:31:07.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:31:07 smithi043 ceph-mon[34144]: pgmap v503: 129 pgs: 129 active+clean; 10 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 37 MiB/s wr, 595 op/s 2024-09-12T12:31:07.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:31:07 smithi102 ceph-mon[34799]: pgmap v503: 129 pgs: 129 active+clean; 10 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 37 MiB/s wr, 595 op/s 2024-09-12T12:31:08.655 INFO:tasks.cephfs.filesystem:scrub status for tag:9ff6c806-fa73-4837-88e9-a8c6f163c01f - {'path': '/', 'tag': '9ff6c806-fa73-4837-88e9-a8c6f163c01f', 'options': 'recursive,force'} 2024-09-12T12:31:09.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:31:09 smithi033 ceph-mon[31246]: pgmap v504: 129 pgs: 129 active+clean; 10 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 49 MiB/s wr, 790 op/s 2024-09-12T12:31:09.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:31:09 smithi043 ceph-mon[34144]: pgmap v504: 129 pgs: 129 active+clean; 10 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 49 MiB/s wr, 790 op/s 2024-09-12T12:31:09.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:31:09 smithi102 ceph-mon[34799]: pgmap v504: 129 pgs: 129 active+clean; 10 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 49 MiB/s wr, 790 op/s 2024-09-12T12:31:11.506 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:31:11 smithi033 ceph-mon[31246]: pgmap v505: 129 pgs: 129 active+clean; 10 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 39 MiB/s wr, 635 op/s 2024-09-12T12:31:11.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:31:11 smithi043 ceph-mon[34144]: pgmap v505: 129 pgs: 129 active+clean; 10 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 39 MiB/s wr, 635 op/s 2024-09-12T12:31:11.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:31:11 smithi102 ceph-mon[34799]: pgmap v505: 129 pgs: 129 active+clean; 10 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 39 MiB/s wr, 635 op/s 2024-09-12T12:31:13.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:31:13 smithi043 ceph-mon[34144]: pgmap v506: 129 pgs: 129 active+clean; 10 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 42 MiB/s wr, 681 op/s 2024-09-12T12:31:13.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:31:13 smithi043 ceph-mon[34144]: scrub summary: idle 2024-09-12T12:31:13.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:31:13 smithi043 ceph-mon[34144]: scrub summary: idle 2024-09-12T12:31:13.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:31:13 smithi102 ceph-mon[34799]: pgmap v506: 129 pgs: 129 active+clean; 10 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 42 MiB/s wr, 681 op/s 2024-09-12T12:31:13.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:31:13 smithi102 ceph-mon[34799]: scrub summary: idle 2024-09-12T12:31:13.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:31:13 smithi102 ceph-mon[34799]: scrub summary: idle 2024-09-12T12:31:13.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:31:13 smithi033 ceph-mon[31246]: pgmap v506: 129 pgs: 129 active+clean; 10 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 42 MiB/s wr, 681 op/s 2024-09-12T12:31:13.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:31:13 smithi033 ceph-mon[31246]: scrub summary: idle 2024-09-12T12:31:13.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:31:13 smithi033 ceph-mon[31246]: scrub summary: idle 2024-09-12T12:31:15.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:31:15 smithi043 ceph-mon[34144]: pgmap v507: 129 pgs: 129 active+clean; 10 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 45 MiB/s wr, 729 op/s 2024-09-12T12:31:15.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:31:15 smithi102 ceph-mon[34799]: pgmap v507: 129 pgs: 129 active+clean; 10 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 45 MiB/s wr, 729 op/s 2024-09-12T12:31:15.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:31:15 smithi033 ceph-mon[31246]: pgmap v507: 129 pgs: 129 active+clean; 10 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 45 MiB/s wr, 729 op/s 2024-09-12T12:31:17.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:31:17 smithi043 ceph-mon[34144]: pgmap v508: 129 pgs: 129 active+clean; 10 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 39 MiB/s wr, 622 op/s 2024-09-12T12:31:17.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:31:17 smithi102 ceph-mon[34799]: pgmap v508: 129 pgs: 129 active+clean; 10 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 39 MiB/s wr, 622 op/s 2024-09-12T12:31:17.980 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:31:17 smithi033 ceph-mon[31246]: pgmap v508: 129 pgs: 129 active+clean; 10 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 39 MiB/s wr, 622 op/s 2024-09-12T12:31:19.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:31:19 smithi043 ceph-mon[34144]: pgmap v509: 129 pgs: 129 active+clean; 10 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 50 MiB/s wr, 802 op/s 2024-09-12T12:31:19.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:31:19 smithi102 ceph-mon[34799]: pgmap v509: 129 pgs: 129 active+clean; 10 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 50 MiB/s wr, 802 op/s 2024-09-12T12:31:19.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:31:19 smithi033 ceph-mon[31246]: pgmap v509: 129 pgs: 129 active+clean; 10 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 50 MiB/s wr, 802 op/s 2024-09-12T12:31:21.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:31:21 smithi033 ceph-mon[31246]: pgmap v510: 129 pgs: 129 active+clean; 10 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 39 MiB/s wr, 632 op/s 2024-09-12T12:31:21.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:31:21 smithi043 ceph-mon[34144]: pgmap v510: 129 pgs: 129 active+clean; 10 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 39 MiB/s wr, 632 op/s 2024-09-12T12:31:21.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:31:21 smithi102 ceph-mon[34799]: pgmap v510: 129 pgs: 129 active+clean; 10 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 39 MiB/s wr, 632 op/s 2024-09-12T12:31:23.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:31:23 smithi043 ceph-mon[34144]: pgmap v511: 129 pgs: 129 active+clean; 10 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 42 MiB/s wr, 676 op/s 2024-09-12T12:31:23.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:31:23 smithi102 ceph-mon[34799]: pgmap v511: 129 pgs: 129 active+clean; 10 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 42 MiB/s wr, 676 op/s 2024-09-12T12:31:23.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:31:23 smithi033 ceph-mon[31246]: pgmap v511: 129 pgs: 129 active+clean; 10 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 42 MiB/s wr, 676 op/s 2024-09-12T12:31:25.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:31:25 smithi043 ceph-mon[34144]: pgmap v512: 129 pgs: 129 active+clean; 10 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 44 MiB/s wr, 716 op/s 2024-09-12T12:31:25.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:31:25 smithi102 ceph-mon[34799]: pgmap v512: 129 pgs: 129 active+clean; 10 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 44 MiB/s wr, 716 op/s 2024-09-12T12:31:25.980 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:31:25 smithi033 ceph-mon[31246]: pgmap v512: 129 pgs: 129 active+clean; 10 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 44 MiB/s wr, 716 op/s 2024-09-12T12:31:27.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:31:27 smithi043 ceph-mon[34144]: pgmap v513: 129 pgs: 129 active+clean; 10 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 38 MiB/s wr, 616 op/s 2024-09-12T12:31:27.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:31:27 smithi102 ceph-mon[34799]: pgmap v513: 129 pgs: 129 active+clean; 10 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 38 MiB/s wr, 616 op/s 2024-09-12T12:31:27.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:31:27 smithi033 ceph-mon[31246]: pgmap v513: 129 pgs: 129 active+clean; 10 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 38 MiB/s wr, 616 op/s 2024-09-12T12:31:29.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:31:29 smithi043 ceph-mon[34144]: pgmap v514: 129 pgs: 129 active+clean; 10 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 50 MiB/s wr, 809 op/s 2024-09-12T12:31:29.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:31:29 smithi102 ceph-mon[34799]: pgmap v514: 129 pgs: 129 active+clean; 10 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 50 MiB/s wr, 809 op/s 2024-09-12T12:31:29.980 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:31:29 smithi033 ceph-mon[31246]: pgmap v514: 129 pgs: 129 active+clean; 10 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 50 MiB/s wr, 809 op/s 2024-09-12T12:31:31.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:31:31 smithi043 ceph-mon[34144]: pgmap v515: 129 pgs: 129 active+clean; 10 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 41 MiB/s wr, 660 op/s 2024-09-12T12:31:31.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:31:31 smithi102 ceph-mon[34799]: pgmap v515: 129 pgs: 129 active+clean; 10 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 41 MiB/s wr, 660 op/s 2024-09-12T12:31:31.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:31:31 smithi033 ceph-mon[31246]: pgmap v515: 129 pgs: 129 active+clean; 10 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 41 MiB/s wr, 660 op/s 2024-09-12T12:31:33.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:31:33 smithi043 ceph-mon[34144]: pgmap v516: 129 pgs: 129 active+clean; 10 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 44 MiB/s wr, 702 op/s 2024-09-12T12:31:33.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:31:33 smithi102 ceph-mon[34799]: pgmap v516: 129 pgs: 129 active+clean; 10 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 44 MiB/s wr, 702 op/s 2024-09-12T12:31:33.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:31:33 smithi033 ceph-mon[31246]: pgmap v516: 129 pgs: 129 active+clean; 10 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 44 MiB/s wr, 702 op/s 2024-09-12T12:31:35.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:31:35 smithi043 ceph-mon[34144]: pgmap v517: 129 pgs: 129 active+clean; 10 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 47 MiB/s wr, 750 op/s 2024-09-12T12:31:35.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:31:35 smithi102 ceph-mon[34799]: pgmap v517: 129 pgs: 129 active+clean; 10 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 47 MiB/s wr, 750 op/s 2024-09-12T12:31:35.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:31:35 smithi033 ceph-mon[31246]: pgmap v517: 129 pgs: 129 active+clean; 10 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 47 MiB/s wr, 750 op/s 2024-09-12T12:31:37.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:31:37 smithi043 ceph-mon[34144]: pgmap v518: 129 pgs: 129 active+clean; 10 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 40 MiB/s wr, 641 op/s 2024-09-12T12:31:37.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:31:37 smithi102 ceph-mon[34799]: pgmap v518: 129 pgs: 129 active+clean; 10 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 40 MiB/s wr, 641 op/s 2024-09-12T12:31:37.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:31:37 smithi033 ceph-mon[31246]: pgmap v518: 129 pgs: 129 active+clean; 10 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 40 MiB/s wr, 641 op/s 2024-09-12T12:31:38.656 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T12:31:39.395 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:31:39.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:31:39 smithi043 ceph-mon[34144]: pgmap v519: 129 pgs: 129 active+clean; 10 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 52 MiB/s wr, 832 op/s 2024-09-12T12:31:39.867 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:31:39 smithi033 ceph-mon[31246]: pgmap v519: 129 pgs: 129 active+clean; 10 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 52 MiB/s wr, 832 op/s 2024-09-12T12:31:39.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:31:39 smithi102 ceph-mon[34799]: pgmap v519: 129 pgs: 129 active+clean; 10 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 52 MiB/s wr, 832 op/s 2024-09-12T12:31:41.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:31:41 smithi043 ceph-mon[34144]: pgmap v520: 129 pgs: 129 active+clean; 10 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 41 MiB/s wr, 669 op/s 2024-09-12T12:31:41.878 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:31:41 smithi033 ceph-mon[31246]: pgmap v520: 129 pgs: 129 active+clean; 10 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 41 MiB/s wr, 669 op/s 2024-09-12T12:31:41.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:31:41 smithi102 ceph-mon[34799]: pgmap v520: 129 pgs: 129 active+clean; 10 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 41 MiB/s wr, 669 op/s 2024-09-12T12:31:42.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.877+0000 7fcc54184640 1 -- 172.21.15.33:0/213869651 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc4c109450 msgr2=0x7fcc4c109830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:42.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.877+0000 7fcc54184640 1 --2- 172.21.15.33:0/213869651 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc4c109450 0x7fcc4c109830 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c00afd0 tx=0x7fcc3c02a590 comp rx=0 tx=0).stop 2024-09-12T12:31:42.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.877+0000 7fcc54184640 1 -- 172.21.15.33:0/213869651 shutdown_connections 2024-09-12T12:31:42.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.877+0000 7fcc54184640 1 --2- 172.21.15.33:0/213869651 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc4c074990 0x7fcc4c07b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:42.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.877+0000 7fcc54184640 1 --2- 172.21.15.33:0/213869651 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc4c109e00 0x7fcc4c0742d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:42.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.877+0000 7fcc54184640 1 --2- 172.21.15.33:0/213869651 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc4c109450 0x7fcc4c109830 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:42.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.877+0000 7fcc54184640 1 -- 172.21.15.33:0/213869651 >> 172.21.15.33:0/213869651 conn(0x7fcc4c06e140 msgr2=0x7fcc4c06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:31:42.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.877+0000 7fcc54184640 1 -- 172.21.15.33:0/213869651 shutdown_connections 2024-09-12T12:31:42.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.877+0000 7fcc54184640 1 -- 172.21.15.33:0/213869651 wait complete. 2024-09-12T12:31:42.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.878+0000 7fcc54184640 1 Processor -- start 2024-09-12T12:31:42.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.878+0000 7fcc54184640 1 -- start start 2024-09-12T12:31:42.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.878+0000 7fcc54184640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc4c074990 0x7fcc4c07b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:42.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.878+0000 7fcc54184640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc4c109450 0x7fcc4c076210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:42.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.879+0000 7fcc54184640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc4c109e00 0x7fcc4c076750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:42.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.879+0000 7fcc54184640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4c07e6c0 con 0x7fcc4c109e00 2024-09-12T12:31:42.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.879+0000 7fcc54184640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4c07e540 con 0x7fcc4c074990 2024-09-12T12:31:42.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.879+0000 7fcc54184640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4c07e840 con 0x7fcc4c109450 2024-09-12T12:31:42.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.879+0000 7fcc52721640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc4c109e00 0x7fcc4c076750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:42.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.879+0000 7fcc52721640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc4c109e00 0x7fcc4c076750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33028/0 (socket says 172.21.15.33:33028) 2024-09-12T12:31:42.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.879+0000 7fcc52721640 1 -- 172.21.15.33:0/3712408939 learned_addr learned my addr 172.21.15.33:0/3712408939 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:31:42.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.879+0000 7fcc5171f640 1 --2- 172.21.15.33:0/3712408939 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc4c109450 0x7fcc4c076210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:42.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.879+0000 7fcc51f20640 1 --2- 172.21.15.33:0/3712408939 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc4c074990 0x7fcc4c07b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:42.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.879+0000 7fcc52721640 1 -- 172.21.15.33:0/3712408939 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc4c109450 msgr2=0x7fcc4c076210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:42.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.879+0000 7fcc52721640 1 --2- 172.21.15.33:0/3712408939 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc4c109450 0x7fcc4c076210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:42.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.879+0000 7fcc52721640 1 -- 172.21.15.33:0/3712408939 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc4c074990 msgr2=0x7fcc4c07b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:42.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.879+0000 7fcc52721640 1 --2- 172.21.15.33:0/3712408939 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc4c074990 0x7fcc4c07b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:42.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.879+0000 7fcc52721640 1 -- 172.21.15.33:0/3712408939 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc4c077010 con 0x7fcc4c109e00 2024-09-12T12:31:42.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.880+0000 7fcc52721640 1 --2- 172.21.15.33:0/3712408939 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc4c109e00 0x7fcc4c076750 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fcc44009fd0 tx=0x7fcc4400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:31:42.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.880+0000 7fcc4affd640 1 -- 172.21.15.33:0/3712408939 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc44011830 con 0x7fcc4c109e00 2024-09-12T12:31:42.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.880+0000 7fcc54184640 1 -- 172.21.15.33:0/3712408939 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc4c137290 con 0x7fcc4c109e00 2024-09-12T12:31:42.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.880+0000 7fcc54184640 1 -- 172.21.15.33:0/3712408939 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc4c137850 con 0x7fcc4c109e00 2024-09-12T12:31:42.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.881+0000 7fcc4affd640 1 -- 172.21.15.33:0/3712408939 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcc44016070 con 0x7fcc4c109e00 2024-09-12T12:31:42.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.881+0000 7fcc4affd640 1 -- 172.21.15.33:0/3712408939 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc44010de0 con 0x7fcc4c109e00 2024-09-12T12:31:42.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.885+0000 7fcc5655d740 1 Processor -- start 2024-09-12T12:31:42.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.898+0000 7fcc4affd640 1 -- 172.21.15.33:0/3712408939 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fcc44010380 con 0x7fcc4c109e00 2024-09-12T12:31:42.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.898+0000 7fcc5655d740 1 -- start start 2024-09-12T12:31:42.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.899+0000 7fcc4affd640 1 --2- 172.21.15.33:0/3712408939 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fcc340a2cc0 0x7fcc340a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:42.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.899+0000 7fcc4affd640 1 -- 172.21.15.33:0/3712408939 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fcc440ce9b0 con 0x7fcc4c109e00 2024-09-12T12:31:42.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.900+0000 7fcc5655d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646cb2284a0 0x5646cb228880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:42.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.900+0000 7fcc5655d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5646cb228dc0 0x5646cb233140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:42.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.900+0000 7fcc51f20640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646cb2284a0 0x5646cb228880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:42.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.900+0000 7fcc51f20640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646cb2284a0 0x5646cb228880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:54352/0 (socket says 172.21.15.33:54352) 2024-09-12T12:31:42.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.900+0000 7fcc5655d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646cb233680 0x5646cb235a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:42.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.900+0000 7fcc51f20640 1 -- 172.21.15.33:0/4004960765 learned_addr learned my addr 172.21.15.33:0/4004960765 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:31:42.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.900+0000 7fcc5655d740 1 -- 172.21.15.33:0/4004960765 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5646cb18e2e0 con 0x5646cb228dc0 2024-09-12T12:31:42.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.900+0000 7fcc5655d740 1 -- 172.21.15.33:0/4004960765 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5646cb135ce0 con 0x5646cb233680 2024-09-12T12:31:42.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.900+0000 7fcc5655d740 1 -- 172.21.15.33:0/4004960765 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5646cb18a2a0 con 0x5646cb2284a0 2024-09-12T12:31:42.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.900+0000 7fcc52721640 1 --2- 172.21.15.33:0/4004960765 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646cb233680 0x5646cb235a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:42.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.901+0000 7fcc52721640 1 -- 172.21.15.33:0/4004960765 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646cb2284a0 msgr2=0x5646cb228880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:31:42.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.901+0000 7fcc52721640 1 --2- 172.21.15.33:0/4004960765 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646cb2284a0 0x5646cb228880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:42.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.901+0000 7fcc52721640 1 -- 172.21.15.33:0/4004960765 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5646cb228dc0 msgr2=0x5646cb233140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:31:42.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.901+0000 7fcc52721640 1 --2- 172.21.15.33:0/4004960765 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5646cb228dc0 0x5646cb233140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:42.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.901+0000 7fcc52721640 1 -- 172.21.15.33:0/4004960765 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646cb11a440 con 0x5646cb233680 2024-09-12T12:31:42.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.901+0000 7fcc51f20640 1 --2- 172.21.15.33:0/4004960765 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646cb2284a0 0x5646cb228880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:31:42.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.901+0000 7fcc5171f640 1 --2- 172.21.15.33:0/3712408939 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fcc340a2cc0 0x7fcc340a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:42.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.903+0000 7fcc52721640 1 --2- 172.21.15.33:0/4004960765 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646cb233680 0x5646cb235a70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcc44006fd0 tx=0x7fcc4409a870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e03cb688e2f8551a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:31:42.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.904+0000 7fcc33fff640 1 -- 172.21.15.33:0/4004960765 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc440a3a90 con 0x5646cb233680 2024-09-12T12:31:42.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.904+0000 7fcc33fff640 1 -- 172.21.15.33:0/4004960765 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcc44099120 con 0x5646cb233680 2024-09-12T12:31:42.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.904+0000 7fcc33fff640 1 -- 172.21.15.33:0/4004960765 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc44096ed0 con 0x5646cb233680 2024-09-12T12:31:42.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.905+0000 7fcc5655d740 1 -- 172.21.15.33:0/4004960765 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646cb233680 msgr2=0x5646cb235a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:42.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.905+0000 7fcc5655d740 1 --2- 172.21.15.33:0/4004960765 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646cb233680 0x5646cb235a70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcc44006fd0 tx=0x7fcc4409a870 comp rx=0 tx=0).stop 2024-09-12T12:31:42.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.905+0000 7fcc5655d740 1 -- 172.21.15.33:0/4004960765 shutdown_connections 2024-09-12T12:31:42.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.905+0000 7fcc5655d740 1 --2- 172.21.15.33:0/4004960765 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646cb233680 0x5646cb235a70 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:42.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.905+0000 7fcc5655d740 1 --2- 172.21.15.33:0/4004960765 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5646cb228dc0 0x5646cb233140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:42.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.905+0000 7fcc5655d740 1 --2- 172.21.15.33:0/4004960765 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646cb2284a0 0x5646cb228880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:42.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.905+0000 7fcc5655d740 1 -- 172.21.15.33:0/4004960765 >> 172.21.15.33:0/4004960765 conn(0x5646cb224a30 msgr2=0x5646cb224e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:31:42.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.913+0000 7fcc5171f640 1 --2- 172.21.15.33:0/3712408939 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fcc340a2cc0 0x7fcc340a5180 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x5646cb225890 tx=0x7fcc4000f040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:31:42.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.913+0000 7fcc5655d740 1 -- 172.21.15.33:0/4004960765 shutdown_connections 2024-09-12T12:31:42.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.913+0000 7fcc5655d740 1 -- 172.21.15.33:0/4004960765 wait complete. 2024-09-12T12:31:42.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.914+0000 7fcc5655d740 1 -- start start 2024-09-12T12:31:42.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.914+0000 7fcc5655d740 1 Processor -- start 2024-09-12T12:31:42.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.915+0000 7fcc5655d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646cb2284a0 0x5646cb233070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:42.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.915+0000 7fcc5655d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5646cb228dc0 0x5646cb230320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:42.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.915+0000 7fcc5655d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646cb233680 0x5646cb230910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:42.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.915+0000 7fcc5655d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5646cb236250 con 0x5646cb228dc0 2024-09-12T12:31:42.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.915+0000 7fcc5655d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5646cb149050 con 0x5646cb2284a0 2024-09-12T12:31:42.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.915+0000 7fcc5655d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5646cb2363d0 con 0x5646cb233680 2024-09-12T12:31:42.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.915+0000 7fcc5655d740 10 client.0 _ll_register_callbacks cb 0x5646cb189160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:31:42.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.916+0000 7fcc52721640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646cb233680 0x5646cb230910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:42.310 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:31:42.310 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "no active scrubs running", 2024-09-12T12:31:42.310 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": {} 2024-09-12T12:31:42.310 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:31:42.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.916+0000 7fcc52721640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646cb233680 0x5646cb230910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:54364/0 (socket says 172.21.15.33:54364) 2024-09-12T12:31:42.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.916+0000 7fcc52721640 1 -- 172.21.15.33:0/1894535686 learned_addr learned my addr 172.21.15.33:0/1894535686 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:31:42.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.916+0000 7fcc51f20640 1 --2- 172.21.15.33:0/1894535686 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646cb2284a0 0x5646cb233070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:42.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.917+0000 7fcc52721640 1 -- 172.21.15.33:0/1894535686 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646cb2284a0 msgr2=0x5646cb233070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:31:42.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.917+0000 7fcc52721640 1 --2- 172.21.15.33:0/1894535686 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646cb2284a0 0x5646cb233070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:42.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.917+0000 7fcc52721640 1 -- 172.21.15.33:0/1894535686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5646cb228dc0 msgr2=0x5646cb230320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:31:42.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.917+0000 7fcc52721640 1 --2- 172.21.15.33:0/1894535686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5646cb228dc0 0x5646cb230320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:42.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.917+0000 7fcc52721640 1 -- 172.21.15.33:0/1894535686 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646caeff3c0 con 0x5646cb233680 2024-09-12T12:31:42.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.918+0000 7fcc52721640 1 --2- 172.21.15.33:0/1894535686 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646cb233680 0x5646cb230910 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcc440977f0 tx=0x7fcc4409f350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a350d4f8925b6e0b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:31:42.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.918+0000 7fcc317fa640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:31:42.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.918+0000 7fcc317fa640 1 -- 172.21.15.33:0/1894535686 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc44096e50 con 0x5646cb233680 2024-09-12T12:31:42.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.918+0000 7fcc317fa640 1 -- 172.21.15.33:0/1894535686 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fcc440b9570 con 0x5646cb233680 2024-09-12T12:31:42.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.922+0000 7fcc5655d740 1 -- 172.21.15.33:0/1894535686 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc44099120 con 0x5646cb233680 2024-09-12T12:31:42.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.929+0000 7fcc317fa640 1 -- 172.21.15.33:0/1894535686 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcc440b9770 con 0x5646cb233680 2024-09-12T12:31:42.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.929+0000 7fcc5655d740 10 client.25549 fetch_fsmap learned FSMap version 27 2024-09-12T12:31:42.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.929+0000 7fcc5655d740 1 -- 172.21.15.33:0/1894535686 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5646cb236250 con 0x5646cb233680 2024-09-12T12:31:42.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.929+0000 7fcc317fa640 1 -- 172.21.15.33:0/1894535686 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcc44099120 con 0x5646cb233680 2024-09-12T12:31:42.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.930+0000 7fcc317fa640 1 -- 172.21.15.33:0/1894535686 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fcc44099e00 con 0x5646cb233680 2024-09-12T12:31:42.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.930+0000 7fcc5655d740 10 client.25549 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:31:42.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.930+0000 7fcc5655d740 10 client.25549 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:31:42.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.930+0000 7fcc5655d740 20 client.25549 populate_metadata read hostname 'smithi033' 2024-09-12T12:31:42.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.930+0000 7fcc5655d740 1 --2- 172.21.15.33:0/1894535686 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5646cb242e90 0x5646cb245280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:42.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.930+0000 7fcc5655d740 4 client.25549 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:31:42.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.930+0000 7fcc5655d740 1 -- 172.21.15.33:0/1894535686 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5646cb19b850 con 0x5646cb242e90 2024-09-12T12:31:42.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.930+0000 7fcc51f20640 1 --2- 172.21.15.33:0/1894535686 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5646cb242e90 0x5646cb245280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:42.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.931+0000 7fcc51f20640 1 --2- 172.21.15.33:0/1894535686 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5646cb242e90 0x5646cb245280 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72eba9574fc877eb server_cookie=84f6297c6664c5c5 in_seq=0 out_seq=0 2024-09-12T12:31:42.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.931+0000 7fcc317fa640 10 client.25549 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:31:42.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.931+0000 7fcc317fa640 1 -- 172.21.15.33:0/1894535686 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5646cb19b850 con 0x5646cb242e90 2024-09-12T12:31:42.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.932+0000 7fcc317fa640 10 client.25549 handle_command_reply: tid=0 2024-09-12T12:31:42.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.932+0000 7fcc5655d740 1 client.25549 shutdown 2024-09-12T12:31:42.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.937+0000 7fcc5655d740 1 -- 172.21.15.33:0/1894535686 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646cb233680 msgr2=0x5646cb230910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:42.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.937+0000 7fcc5655d740 1 --2- 172.21.15.33:0/1894535686 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646cb233680 0x5646cb230910 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcc440977f0 tx=0x7fcc4409f350 comp rx=0 tx=0).stop 2024-09-12T12:31:42.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.937+0000 7fcc5655d740 1 -- 172.21.15.33:0/1894535686 shutdown_connections 2024-09-12T12:31:42.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.937+0000 7fcc5655d740 1 --2- 172.21.15.33:0/1894535686 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5646cb242e90 0x5646cb245280 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:42.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.937+0000 7fcc5655d740 1 --2- 172.21.15.33:0/1894535686 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646cb233680 0x5646cb230910 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:42.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.937+0000 7fcc5655d740 1 --2- 172.21.15.33:0/1894535686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5646cb228dc0 0x5646cb230320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:42.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.937+0000 7fcc5655d740 1 --2- 172.21.15.33:0/1894535686 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646cb2284a0 0x5646cb233070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:42.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.937+0000 7fcc5655d740 1 -- 172.21.15.33:0/1894535686 >> 172.21.15.33:0/1894535686 conn(0x5646cb224a30 msgr2=0x5646cb22a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:31:42.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.937+0000 7fcc317fa640 0 client.25549 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:31:42.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.940+0000 7fcc5655d740 1 -- 172.21.15.33:0/1894535686 shutdown_connections 2024-09-12T12:31:42.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.940+0000 7fcc5655d740 1 -- 172.21.15.33:0/1894535686 wait complete. 2024-09-12T12:31:42.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.940+0000 7fcc5655d740 20 client.25549 trim_cache size 0 max 16384 2024-09-12T12:31:42.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.974+0000 7fcc5655d740 1 Processor -- start 2024-09-12T12:31:42.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.974+0000 7fcc5655d740 1 -- start start 2024-09-12T12:31:42.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.975+0000 7fcc5655d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646cb2284a0 0x5646cb23f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:42.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.975+0000 7fcc5655d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5646cb228dc0 0x5646cb24a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:42.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.975+0000 7fcc51f20640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646cb2284a0 0x5646cb23f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:42.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.975+0000 7fcc51f20640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646cb2284a0 0x5646cb23f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:43050/0 (socket says 172.21.15.33:43050) 2024-09-12T12:31:42.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.975+0000 7fcc51f20640 1 -- 172.21.15.33:0/2353509952 learned_addr learned my addr 172.21.15.33:0/2353509952 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:31:42.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.975+0000 7fcc5171f640 1 --2- 172.21.15.33:0/2353509952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5646cb228dc0 0x5646cb24a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:42.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.975+0000 7fcc5655d740 1 --2- 172.21.15.33:0/2353509952 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646cb233680 0x5646cb24ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:42.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.975+0000 7fcc5655d740 1 -- 172.21.15.33:0/2353509952 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcc38012530 con 0x5646cb228dc0 2024-09-12T12:31:42.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.975+0000 7fcc5655d740 1 -- 172.21.15.33:0/2353509952 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3800fe00 con 0x5646cb2284a0 2024-09-12T12:31:42.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.975+0000 7fcc5655d740 1 -- 172.21.15.33:0/2353509952 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3800dc50 con 0x5646cb233680 2024-09-12T12:31:42.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.975+0000 7fcc52721640 1 --2- 172.21.15.33:0/2353509952 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646cb233680 0x5646cb24ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:42.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.976+0000 7fcc51f20640 1 -- 172.21.15.33:0/2353509952 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646cb233680 msgr2=0x5646cb24ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:31:42.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.976+0000 7fcc51f20640 1 --2- 172.21.15.33:0/2353509952 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646cb233680 0x5646cb24ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:42.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.976+0000 7fcc51f20640 1 -- 172.21.15.33:0/2353509952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5646cb228dc0 msgr2=0x5646cb24a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:31:42.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.976+0000 7fcc51f20640 1 --2- 172.21.15.33:0/2353509952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5646cb228dc0 0x5646cb24a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:42.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.976+0000 7fcc51f20640 1 -- 172.21.15.33:0/2353509952 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646cb228290 con 0x5646cb2284a0 2024-09-12T12:31:42.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.978+0000 7fcc51f20640 1 --2- 172.21.15.33:0/2353509952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646cb2284a0 0x5646cb23f510 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c034040 tx=0x7fcc3c000f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f98a6cfbf7f1760 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:31:42.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.979+0000 7fcc337fe640 1 -- 172.21.15.33:0/2353509952 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c036040 con 0x5646cb2284a0 2024-09-12T12:31:42.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.979+0000 7fcc337fe640 1 -- 172.21.15.33:0/2353509952 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcc3c003e20 con 0x5646cb2284a0 2024-09-12T12:31:42.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.980+0000 7fcc337fe640 1 -- 172.21.15.33:0/2353509952 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c004590 con 0x5646cb2284a0 2024-09-12T12:31:42.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.982+0000 7fcc5655d740 1 -- 172.21.15.33:0/2353509952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646cb2284a0 msgr2=0x5646cb23f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:42.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.982+0000 7fcc5655d740 1 --2- 172.21.15.33:0/2353509952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646cb2284a0 0x5646cb23f510 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c034040 tx=0x7fcc3c000f40 comp rx=0 tx=0).stop 2024-09-12T12:31:42.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.982+0000 7fcc5655d740 1 -- 172.21.15.33:0/2353509952 shutdown_connections 2024-09-12T12:31:42.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.982+0000 7fcc5655d740 1 --2- 172.21.15.33:0/2353509952 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646cb233680 0x5646cb24ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:42.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.982+0000 7fcc5655d740 1 --2- 172.21.15.33:0/2353509952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5646cb228dc0 0x5646cb24a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:42.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.982+0000 7fcc5655d740 1 --2- 172.21.15.33:0/2353509952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646cb2284a0 0x5646cb23f510 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:42.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.982+0000 7fcc5655d740 1 -- 172.21.15.33:0/2353509952 >> 172.21.15.33:0/2353509952 conn(0x5646cb224a30 msgr2=0x5646cb22b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:31:42.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.984+0000 7fcc5655d740 1 -- 172.21.15.33:0/2353509952 shutdown_connections 2024-09-12T12:31:42.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.984+0000 7fcc5655d740 1 -- 172.21.15.33:0/2353509952 wait complete. 2024-09-12T12:31:42.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.985+0000 7fcc5655d740 1 -- start start 2024-09-12T12:31:42.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.985+0000 7fcc5655d740 1 Processor -- start 2024-09-12T12:31:42.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.985+0000 7fcc5655d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646cb2284a0 0x5646cb237c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:42.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.985+0000 7fcc5655d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646cb228dc0 0x5646cb238140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:42.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.985+0000 7fcc5655d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5646cb233680 0x5646cb2ac910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:42.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.985+0000 7fcc5655d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3800e2c0 con 0x5646cb233680 2024-09-12T12:31:42.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.985+0000 7fcc5655d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3800f730 con 0x5646cb2284a0 2024-09-12T12:31:42.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.985+0000 7fcc5655d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3800e990 con 0x5646cb228dc0 2024-09-12T12:31:42.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.986+0000 7fcc5655d740 10 client.0 _ll_register_callbacks cb 0x7fcc3c008b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:31:42.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.986+0000 7fcc5171f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646cb228dc0 0x5646cb238140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:42.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.986+0000 7fcc5171f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646cb228dc0 0x5646cb238140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:54378/0 (socket says 172.21.15.33:54378) 2024-09-12T12:31:42.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.986+0000 7fcc5171f640 1 -- 172.21.15.33:0/4059486414 learned_addr learned my addr 172.21.15.33:0/4059486414 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:31:42.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.986+0000 7fcc51f20640 1 --2- 172.21.15.33:0/4059486414 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646cb2284a0 0x5646cb237c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:42.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.986+0000 7fcc5171f640 1 -- 172.21.15.33:0/4059486414 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646cb2284a0 msgr2=0x5646cb237c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:31:42.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.986+0000 7fcc5171f640 1 --2- 172.21.15.33:0/4059486414 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646cb2284a0 0x5646cb237c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:42.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.986+0000 7fcc5171f640 1 -- 172.21.15.33:0/4059486414 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5646cb233680 msgr2=0x5646cb2ac910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:31:42.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.986+0000 7fcc5171f640 1 --2- 172.21.15.33:0/4059486414 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5646cb233680 0x5646cb2ac910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:42.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.986+0000 7fcc5171f640 1 -- 172.21.15.33:0/4059486414 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646cb2acf00 con 0x5646cb228dc0 2024-09-12T12:31:42.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.987+0000 7fcc5171f640 1 --2- 172.21.15.33:0/4059486414 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646cb228dc0 0x5646cb238140 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c06f670 tx=0x7fcc400046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e1fb0b80c98f664 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:31:42.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.987+0000 7fcc317fa640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:31:42.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.987+0000 7fcc317fa640 1 -- 172.21.15.33:0/4059486414 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc4001a670 con 0x5646cb228dc0 2024-09-12T12:31:42.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.988+0000 7fcc5655d740 1 -- 172.21.15.33:0/4059486414 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc3c003e20 con 0x5646cb228dc0 2024-09-12T12:31:42.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.988+0000 7fcc317fa640 1 -- 172.21.15.33:0/4059486414 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fcc4001a810 con 0x5646cb228dc0 2024-09-12T12:31:42.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.988+0000 7fcc317fa640 1 -- 172.21.15.33:0/4059486414 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcc4001aa10 con 0x5646cb228dc0 2024-09-12T12:31:42.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.990+0000 7fcc5655d740 10 client.25555 fetch_fsmap learned FSMap version 27 2024-09-12T12:31:42.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.990+0000 7fcc5655d740 1 -- 172.21.15.33:0/4059486414 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5646cb2ae280 con 0x5646cb228dc0 2024-09-12T12:31:42.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.991+0000 7fcc317fa640 1 -- 172.21.15.33:0/4059486414 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcc3c003e20 con 0x5646cb228dc0 2024-09-12T12:31:42.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.991+0000 7fcc317fa640 1 -- 172.21.15.33:0/4059486414 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fcc40017040 con 0x5646cb228dc0 2024-09-12T12:31:42.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.991+0000 7fcc5655d740 10 client.25555 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:31:42.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.991+0000 7fcc5655d740 10 client.25555 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:31:42.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.991+0000 7fcc5655d740 20 client.25555 populate_metadata read hostname 'smithi033' 2024-09-12T12:31:42.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.992+0000 7fcc5655d740 1 --2- 172.21.15.33:0/4059486414 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5646cb2aea60 0x5646cb2b0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:42.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.992+0000 7fcc5655d740 4 client.25555 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:31:42.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.992+0000 7fcc5655d740 1 -- 172.21.15.33:0/4059486414 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5646cb195d60 con 0x5646cb2aea60 2024-09-12T12:31:42.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.992+0000 7fcc51f20640 1 --2- 172.21.15.33:0/4059486414 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5646cb2aea60 0x5646cb2b0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:42.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.993+0000 7fcc51f20640 1 --2- 172.21.15.33:0/4059486414 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5646cb2aea60 0x5646cb2b0e80 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b3960a6bb0dd00a server_cookie=f726c1a7c650c237 in_seq=0 out_seq=0 2024-09-12T12:31:42.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.993+0000 7fcc317fa640 10 client.25555 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:31:42.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.994+0000 7fcc317fa640 1 -- 172.21.15.33:0/4059486414 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5646cb195d60 con 0x5646cb2aea60 2024-09-12T12:31:42.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.994+0000 7fcc317fa640 10 client.25555 handle_command_reply: tid=0 2024-09-12T12:31:42.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.994+0000 7fcc5655d740 1 client.25555 shutdown 2024-09-12T12:31:42.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.995+0000 7fcc5655d740 1 -- 172.21.15.33:0/4059486414 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646cb228dc0 msgr2=0x5646cb238140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:42.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.995+0000 7fcc5655d740 1 --2- 172.21.15.33:0/4059486414 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646cb228dc0 0x5646cb238140 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c06f670 tx=0x7fcc400046c0 comp rx=0 tx=0).stop 2024-09-12T12:31:42.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.995+0000 7fcc5655d740 1 -- 172.21.15.33:0/4059486414 shutdown_connections 2024-09-12T12:31:42.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.995+0000 7fcc5655d740 1 --2- 172.21.15.33:0/4059486414 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5646cb2aea60 0x5646cb2b0e80 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:42.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.995+0000 7fcc5655d740 1 --2- 172.21.15.33:0/4059486414 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5646cb233680 0x5646cb2ac910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:42.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.995+0000 7fcc5655d740 1 --2- 172.21.15.33:0/4059486414 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5646cb228dc0 0x5646cb238140 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:42.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.995+0000 7fcc5655d740 1 --2- 172.21.15.33:0/4059486414 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646cb2284a0 0x5646cb237c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:42.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.995+0000 7fcc5655d740 1 -- 172.21.15.33:0/4059486414 >> 172.21.15.33:0/4059486414 conn(0x5646cb224a30 msgr2=0x5646cb231b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:31:42.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.995+0000 7fcc317fa640 0 client.25555 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:31:42.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.995+0000 7fcc5655d740 1 -- 172.21.15.33:0/4059486414 shutdown_connections 2024-09-12T12:31:42.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:41.995+0000 7fcc5655d740 1 -- 172.21.15.33:0/4059486414 wait complete. 2024-09-12T12:31:42.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:42.001+0000 7fcc5655d740 20 client.25555 trim_cache size 0 max 16384 2024-09-12T12:31:42.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:42.002+0000 7fcc54184640 1 -- 172.21.15.33:0/3712408939 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fcc340a2cc0 msgr2=0x7fcc340a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:42.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:42.002+0000 7fcc54184640 1 --2- 172.21.15.33:0/3712408939 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fcc340a2cc0 0x7fcc340a5180 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x5646cb225890 tx=0x7fcc4000f040 comp rx=0 tx=0).stop 2024-09-12T12:31:42.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:42.002+0000 7fcc54184640 1 -- 172.21.15.33:0/3712408939 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc4c109e00 msgr2=0x7fcc4c076750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:42.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:42.002+0000 7fcc54184640 1 --2- 172.21.15.33:0/3712408939 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc4c109e00 0x7fcc4c076750 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fcc44009fd0 tx=0x7fcc4400b8e0 comp rx=0 tx=0).stop 2024-09-12T12:31:42.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:42.002+0000 7fcc54184640 1 -- 172.21.15.33:0/3712408939 shutdown_connections 2024-09-12T12:31:42.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:42.002+0000 7fcc54184640 1 --2- 172.21.15.33:0/3712408939 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fcc340a2cc0 0x7fcc340a5180 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:42.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:42.002+0000 7fcc54184640 1 --2- 172.21.15.33:0/3712408939 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc4c109e00 0x7fcc4c076750 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:42.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:42.002+0000 7fcc54184640 1 --2- 172.21.15.33:0/3712408939 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc4c109450 0x7fcc4c076210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:42.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:42.002+0000 7fcc54184640 1 --2- 172.21.15.33:0/3712408939 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc4c074990 0x7fcc4c07b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:42.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:42.002+0000 7fcc54184640 1 -- 172.21.15.33:0/3712408939 >> 172.21.15.33:0/3712408939 conn(0x7fcc4c06e140 msgr2=0x7fcc4c072600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:31:42.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:42.004+0000 7fcc54184640 1 -- 172.21.15.33:0/3712408939 shutdown_connections 2024-09-12T12:31:42.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:42.004+0000 7fcc54184640 1 -- 172.21.15.33:0/3712408939 wait complete. 2024-09-12T12:31:43.310 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T12:31:43.310 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:31:43.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:31:43 smithi043 ceph-mon[34144]: pgmap v521: 129 pgs: 129 active+clean; 10 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 43 MiB/s wr, 697 op/s 2024-09-12T12:31:43.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:31:43 smithi102 ceph-mon[34799]: pgmap v521: 129 pgs: 129 active+clean; 10 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 43 MiB/s wr, 697 op/s 2024-09-12T12:31:43.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:31:43 smithi033 ceph-mon[31246]: pgmap v521: 129 pgs: 129 active+clean; 10 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 43 MiB/s wr, 697 op/s 2024-09-12T12:31:44.077 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:31:45.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:31:45 smithi043 ceph-mon[34144]: pgmap v522: 129 pgs: 129 active+clean; 10 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 45 MiB/s wr, 724 op/s 2024-09-12T12:31:45.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:31:45 smithi102 ceph-mon[34799]: pgmap v522: 129 pgs: 129 active+clean; 10 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 45 MiB/s wr, 724 op/s 2024-09-12T12:31:45.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:31:45 smithi033 ceph-mon[31246]: pgmap v522: 129 pgs: 129 active+clean; 10 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 45 MiB/s wr, 724 op/s 2024-09-12T12:31:47.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:31:47 smithi102 ceph-mon[34799]: pgmap v523: 129 pgs: 129 active+clean; 10 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 37 MiB/s wr, 602 op/s 2024-09-12T12:31:47.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:31:47 smithi033 ceph-mon[31246]: pgmap v523: 129 pgs: 129 active+clean; 10 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 37 MiB/s wr, 602 op/s 2024-09-12T12:31:48.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:31:47 smithi043 ceph-mon[34144]: pgmap v523: 129 pgs: 129 active+clean; 10 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 37 MiB/s wr, 602 op/s 2024-09-12T12:31:49.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:31:49 smithi102 ceph-mon[34799]: pgmap v524: 129 pgs: 129 active+clean; 10 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 47 MiB/s wr, 758 op/s 2024-09-12T12:31:49.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:31:49 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/639815598' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:31:49.930 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:31:49 smithi033 ceph-mon[31246]: pgmap v524: 129 pgs: 129 active+clean; 10 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 47 MiB/s wr, 758 op/s 2024-09-12T12:31:49.930 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:31:49 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/639815598' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:31:49.931 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:31:49.931 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":27,"btime":"2024-09-12T12:29:38:065241+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3327066342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3327066342},{"type":"v1","addr":"172.21.15.33:6835","nonce":3327066342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/19516401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":19516401},{"type":"v1","addr":"172.21.15.33:6837","nonce":19516401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1260196118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1260196118},{"type":"v1","addr":"172.21.15.33:6839","nonce":1260196118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/4288248356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4288248356},{"type":"v1","addr":"172.21.15.33:6841","nonce":4288248356}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/3051073141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3051073141},{"type":"v1","addr":"172.21.15.43:6833","nonce":3051073141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3282762800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3282762800},{"type":"v1","addr":"172.21.15.43:6835","nonce":3282762800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:23:46.400609+0000","modified":"2024-09-12T12:29:37.555614+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24490,"mds_2":24478},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3051713000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3051713000},{"type":"v1","addr":"172.21.15.102:6833","nonce":3051713000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6837/2472064883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2472064883},{"type":"v1","addr":"172.21.15.43:6837","nonce":2472064883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/1987408860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":1987408860},{"type":"v1","addr":"172.21.15.43:6839","nonce":1987408860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/4179527539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":4179527539},{"type":"v1","addr":"172.21.15.102:6835","nonce":4179527539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/2409953270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2409953270},{"type":"v1","addr":"172.21.15.102:6837","nonce":2409953270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.102:6839/1553271340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":1553271340},{"type":"v1","addr":"172.21.15.102:6839","nonce":1553271340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24499,"qdb_cluster":[24499,24490,24478]},"id":1}]} 2024-09-12T12:31:49.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.568+0000 7f40ac492640 1 -- 172.21.15.33:0/2777547962 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40a4102790 msgr2=0x7f40a41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:49.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.568+0000 7f40ac492640 1 --2- 172.21.15.33:0/2777547962 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40a4102790 0x7f40a41067e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f4094009900 tx=0x7f409402a410 comp rx=0 tx=0).stop 2024-09-12T12:31:49.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.568+0000 7f40ac492640 1 -- 172.21.15.33:0/2777547962 shutdown_connections 2024-09-12T12:31:49.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.568+0000 7f40ac492640 1 --2- 172.21.15.33:0/2777547962 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40a4106f10 0x7f40a410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:49.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.568+0000 7f40ac492640 1 --2- 172.21.15.33:0/2777547962 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40a4102790 0x7f40a41067e0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:49.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.568+0000 7f40ac492640 1 --2- 172.21.15.33:0/2777547962 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40a4101de0 0x7f40a41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:49.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.568+0000 7f40ac492640 1 -- 172.21.15.33:0/2777547962 >> 172.21.15.33:0/2777547962 conn(0x7f40a40fd8c0 msgr2=0x7f40a40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:31:49.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.568+0000 7f40ac492640 1 -- 172.21.15.33:0/2777547962 shutdown_connections 2024-09-12T12:31:49.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.568+0000 7f40ac492640 1 -- 172.21.15.33:0/2777547962 wait complete. 2024-09-12T12:31:49.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.568+0000 7f40ac492640 1 Processor -- start 2024-09-12T12:31:49.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.569+0000 7f40ac492640 1 -- start start 2024-09-12T12:31:49.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.569+0000 7f40ac492640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40a4101de0 0x7f40a4198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:49.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.569+0000 7f40ac492640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40a4102790 0x7f40a41988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:49.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.569+0000 7f40ac492640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40a4106f10 0x7f40a419cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:49.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.569+0000 7f40ac492640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f40a4111e20 con 0x7f40a4106f10 2024-09-12T12:31:49.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.569+0000 7f40ac492640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f40a4111ca0 con 0x7f40a4102790 2024-09-12T12:31:49.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.569+0000 7f40ac492640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f40a4111fa0 con 0x7f40a4101de0 2024-09-12T12:31:49.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.569+0000 7f40aaa2f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40a4106f10 0x7f40a419cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:49.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.569+0000 7f40aaa2f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40a4106f10 0x7f40a419cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33100/0 (socket says 172.21.15.33:33100) 2024-09-12T12:31:49.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.569+0000 7f40aaa2f640 1 -- 172.21.15.33:0/639815598 learned_addr learned my addr 172.21.15.33:0/639815598 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:31:49.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.569+0000 7f40a9a2d640 1 --2- 172.21.15.33:0/639815598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40a4102790 0x7f40a41988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:49.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.569+0000 7f40aa22e640 1 --2- 172.21.15.33:0/639815598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40a4101de0 0x7f40a4198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:49.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.569+0000 7f40aaa2f640 1 -- 172.21.15.33:0/639815598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40a4101de0 msgr2=0x7f40a4198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:49.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.569+0000 7f40aaa2f640 1 --2- 172.21.15.33:0/639815598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40a4101de0 0x7f40a4198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:49.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.569+0000 7f40aaa2f640 1 -- 172.21.15.33:0/639815598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40a4102790 msgr2=0x7f40a41988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:49.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.569+0000 7f40aaa2f640 1 --2- 172.21.15.33:0/639815598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40a4102790 0x7f40a41988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:49.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.569+0000 7f40aaa2f640 1 -- 172.21.15.33:0/639815598 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40a419d310 con 0x7f40a4106f10 2024-09-12T12:31:49.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.569+0000 7f40a9a2d640 1 --2- 172.21.15.33:0/639815598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40a4102790 0x7f40a41988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:31:49.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.569+0000 7f40aa22e640 1 --2- 172.21.15.33:0/639815598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40a4101de0 0x7f40a4198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:31:49.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.569+0000 7f40aaa2f640 1 --2- 172.21.15.33:0/639815598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40a4106f10 0x7f40a419cc30 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f409c00eaa0 tx=0x7f409c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:31:49.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.570+0000 7f409b7fe640 1 -- 172.21.15.33:0/639815598 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f409c00cdb0 con 0x7f40a4106f10 2024-09-12T12:31:49.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.570+0000 7f409b7fe640 1 -- 172.21.15.33:0/639815598 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f409c005020 con 0x7f40a4106f10 2024-09-12T12:31:49.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.570+0000 7f40ac492640 1 -- 172.21.15.33:0/639815598 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40a419d600 con 0x7f40a4106f10 2024-09-12T12:31:49.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.570+0000 7f409b7fe640 1 -- 172.21.15.33:0/639815598 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f409c0116d0 con 0x7f40a4106f10 2024-09-12T12:31:49.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.570+0000 7f40ac492640 1 -- 172.21.15.33:0/639815598 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40a41a4ee0 con 0x7f40a4106f10 2024-09-12T12:31:49.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.571+0000 7f40ac492640 1 -- 172.21.15.33:0/639815598 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40a41021c0 con 0x7f40a4106f10 2024-09-12T12:31:49.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.572+0000 7f409b7fe640 1 -- 172.21.15.33:0/639815598 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f409c0051d0 con 0x7f40a4106f10 2024-09-12T12:31:49.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.573+0000 7f409b7fe640 1 --2- 172.21.15.33:0/639815598 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f40900a2c00 0x7f40900a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:49.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.573+0000 7f40aa22e640 1 --2- 172.21.15.33:0/639815598 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f40900a2c00 0x7f40900a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:49.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.573+0000 7f409b7fe640 1 -- 172.21.15.33:0/639815598 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f409c0cf5a0 con 0x7f40a4106f10 2024-09-12T12:31:49.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.573+0000 7f40aa22e640 1 --2- 172.21.15.33:0/639815598 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f40900a2c00 0x7f40900a50c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f40a00058c0 tx=0x7f40a0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:31:49.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.577+0000 7f409b7fe640 1 -- 172.21.15.33:0/639815598 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f409c016030 con 0x7f40a4106f10 2024-09-12T12:31:49.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.897+0000 7f40ac492640 1 -- 172.21.15.33:0/639815598 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f40a402d7c0 con 0x7f40a4106f10 2024-09-12T12:31:49.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.902+0000 7f409b7fe640 1 -- 172.21.15.33:0/639815598 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11912 (secure 0 0 0) 0x7f409c09c110 con 0x7f40a4106f10 2024-09-12T12:31:49.935 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 27 2024-09-12T12:31:49.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.912+0000 7f40ac492640 1 -- 172.21.15.33:0/639815598 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f40900a2c00 msgr2=0x7f40900a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:49.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.912+0000 7f40ac492640 1 --2- 172.21.15.33:0/639815598 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f40900a2c00 0x7f40900a50c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f40a00058c0 tx=0x7f40a0005850 comp rx=0 tx=0).stop 2024-09-12T12:31:49.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.912+0000 7f40ac492640 1 -- 172.21.15.33:0/639815598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40a4106f10 msgr2=0x7f40a419cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:49.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.912+0000 7f40ac492640 1 --2- 172.21.15.33:0/639815598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40a4106f10 0x7f40a419cc30 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f409c00eaa0 tx=0x7f409c00ef60 comp rx=0 tx=0).stop 2024-09-12T12:31:49.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.915+0000 7f40ac492640 1 -- 172.21.15.33:0/639815598 shutdown_connections 2024-09-12T12:31:49.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.915+0000 7f40ac492640 1 --2- 172.21.15.33:0/639815598 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f40900a2c00 0x7f40900a50c0 secure :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f40a00058c0 tx=0x7f40a0005850 comp rx=0 tx=0).stop 2024-09-12T12:31:49.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.915+0000 7f40ac492640 1 --2- 172.21.15.33:0/639815598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40a4106f10 0x7f40a419cc30 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:49.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.915+0000 7f40ac492640 1 --2- 172.21.15.33:0/639815598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40a4102790 0x7f40a41988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:49.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.915+0000 7f40ac492640 1 --2- 172.21.15.33:0/639815598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40a4101de0 0x7f40a4198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:49.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.915+0000 7f40ac492640 1 -- 172.21.15.33:0/639815598 >> 172.21.15.33:0/639815598 conn(0x7f40a40fd8c0 msgr2=0x7f40a40fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:31:49.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.917+0000 7f40ac492640 1 -- 172.21.15.33:0/639815598 shutdown_connections 2024-09-12T12:31:49.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:48.917+0000 7f40ac492640 1 -- 172.21.15.33:0/639815598 wait complete. 2024-09-12T12:31:50.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:31:49 smithi043 ceph-mon[34144]: pgmap v524: 129 pgs: 129 active+clean; 10 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 47 MiB/s wr, 758 op/s 2024-09-12T12:31:50.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:31:49 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/639815598' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:31:51.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:31:51 smithi102 ceph-mon[34799]: pgmap v525: 129 pgs: 129 active+clean; 10 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 36 MiB/s wr, 578 op/s 2024-09-12T12:31:51.980 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:31:51 smithi033 ceph-mon[31246]: pgmap v525: 129 pgs: 129 active+clean; 10 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 36 MiB/s wr, 578 op/s 2024-09-12T12:31:52.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:31:51 smithi043 ceph-mon[34144]: pgmap v525: 129 pgs: 129 active+clean; 10 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 36 MiB/s wr, 578 op/s 2024-09-12T12:31:53.835 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T12:31:53.895 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:31:53 smithi033 ceph-mon[31246]: pgmap v526: 129 pgs: 129 active+clean; 10 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 37 MiB/s wr, 599 op/s 2024-09-12T12:31:53.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:31:53 smithi102 ceph-mon[34799]: pgmap v526: 129 pgs: 129 active+clean; 10 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 37 MiB/s wr, 599 op/s 2024-09-12T12:31:54.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:31:53 smithi043 ceph-mon[34144]: pgmap v526: 129 pgs: 129 active+clean; 10 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 37 MiB/s wr, 599 op/s 2024-09-12T12:31:54.605 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:31:55.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.249+0000 7f9530877640 1 -- 172.21.15.33:0/2668503371 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f952c1095d0 msgr2=0x7f952c109a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:55.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.249+0000 7f9530877640 1 --2- 172.21.15.33:0/2668503371 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f952c1095d0 0x7f952c109a10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9524009ca0 tx=0x7f952402a8f0 comp rx=0 tx=0).stop 2024-09-12T12:31:55.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.249+0000 7f9530877640 1 -- 172.21.15.33:0/2668503371 shutdown_connections 2024-09-12T12:31:55.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.249+0000 7f9530877640 1 --2- 172.21.15.33:0/2668503371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f952c11b140 0x7f952c11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:55.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.249+0000 7f9530877640 1 --2- 172.21.15.33:0/2668503371 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f952c1095d0 0x7f952c109a10 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:55.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.249+0000 7f9530877640 1 --2- 172.21.15.33:0/2668503371 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f952c1091f0 0x7f952c110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:55.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.249+0000 7f9530877640 1 -- 172.21.15.33:0/2668503371 >> 172.21.15.33:0/2668503371 conn(0x7f952c073660 msgr2=0x7f952c073a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:31:55.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.253+0000 7f9530877640 1 -- 172.21.15.33:0/2668503371 shutdown_connections 2024-09-12T12:31:55.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.253+0000 7f9530877640 1 -- 172.21.15.33:0/2668503371 wait complete. 2024-09-12T12:31:55.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.254+0000 7f9530877640 1 Processor -- start 2024-09-12T12:31:55.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.254+0000 7f9530877640 1 -- start start 2024-09-12T12:31:55.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.255+0000 7f9530877640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f952c1091f0 0x7f952c1186c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:55.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.255+0000 7f9530877640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f952c1095d0 0x7f952c111750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:55.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.255+0000 7f9530877640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f952c11b140 0x7f952c111c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:55.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.255+0000 7f9530877640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f952c120b60 con 0x7f952c11b140 2024-09-12T12:31:55.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.255+0000 7f9530877640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f952c1209e0 con 0x7f952c1091f0 2024-09-12T12:31:55.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.255+0000 7f9530877640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f952c120ce0 con 0x7f952c1095d0 2024-09-12T12:31:55.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.255+0000 7f952b7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f952c1091f0 0x7f952c1186c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:55.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.255+0000 7f952b7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f952c1091f0 0x7f952c1186c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:51372/0 (socket says 172.21.15.33:51372) 2024-09-12T12:31:55.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.255+0000 7f952b7fe640 1 -- 172.21.15.33:0/4009210377 learned_addr learned my addr 172.21.15.33:0/4009210377 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:31:55.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.255+0000 7f952affd640 1 --2- 172.21.15.33:0/4009210377 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f952c1095d0 0x7f952c111750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:55.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.256+0000 7f952bfff640 1 --2- 172.21.15.33:0/4009210377 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f952c11b140 0x7f952c111c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:55.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.256+0000 7f952b7fe640 1 -- 172.21.15.33:0/4009210377 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f952c1095d0 msgr2=0x7f952c111750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:55.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.256+0000 7f952b7fe640 1 --2- 172.21.15.33:0/4009210377 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f952c1095d0 0x7f952c111750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:55.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.256+0000 7f952b7fe640 1 -- 172.21.15.33:0/4009210377 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f952c11b140 msgr2=0x7f952c111c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:55.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.256+0000 7f952b7fe640 1 --2- 172.21.15.33:0/4009210377 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f952c11b140 0x7f952c111c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:55.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.256+0000 7f952b7fe640 1 -- 172.21.15.33:0/4009210377 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f952c112200 con 0x7f952c1091f0 2024-09-12T12:31:55.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.256+0000 7f952bfff640 1 --2- 172.21.15.33:0/4009210377 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f952c11b140 0x7f952c111c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:31:55.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.256+0000 7f952affd640 1 --2- 172.21.15.33:0/4009210377 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f952c1095d0 0x7f952c111750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:31:55.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.256+0000 7f952b7fe640 1 --2- 172.21.15.33:0/4009210377 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f952c1091f0 0x7f952c1186c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f951c00e9f0 tx=0x7f951c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:31:55.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.256+0000 7f9528ff9640 1 -- 172.21.15.33:0/4009210377 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f951c00cd80 con 0x7f952c1091f0 2024-09-12T12:31:55.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.256+0000 7f9528ff9640 1 -- 172.21.15.33:0/4009210377 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f951c0108e0 con 0x7f952c1091f0 2024-09-12T12:31:55.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.256+0000 7f9530877640 1 -- 172.21.15.33:0/4009210377 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f952c1124f0 con 0x7f952c1091f0 2024-09-12T12:31:55.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.256+0000 7f9528ff9640 1 -- 172.21.15.33:0/4009210377 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f951c018920 con 0x7f952c1091f0 2024-09-12T12:31:55.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.257+0000 7f9530877640 1 -- 172.21.15.33:0/4009210377 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f952c1164d0 con 0x7f952c1091f0 2024-09-12T12:31:55.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.262+0000 7f9528ff9640 1 -- 172.21.15.33:0/4009210377 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f951c010430 con 0x7f952c1091f0 2024-09-12T12:31:55.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.262+0000 7f9533eb2740 1 Processor -- start 2024-09-12T12:31:55.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.262+0000 7f9533eb2740 1 -- start start 2024-09-12T12:31:55.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.262+0000 7f9533eb2740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559a73ab2cf0 0x559a73ab1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:55.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.262+0000 7f9533eb2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a73ab1780 0x559a73ab1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:55.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.262+0000 7f9533eb2740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a73abc520 0x559a73abe910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:55.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.262+0000 7f9533eb2740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x559a73a172f0 con 0x559a73abc520 2024-09-12T12:31:55.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.262+0000 7f9533eb2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559a739becf0 con 0x559a73ab1780 2024-09-12T12:31:55.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.262+0000 7f9533eb2740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x559a73a132b0 con 0x559a73ab2cf0 2024-09-12T12:31:55.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.263+0000 7f9528ff9640 1 --2- 172.21.15.33:0/4009210377 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f95140a2d90 0x7f95140a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:55.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.263+0000 7f952affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a73abc520 0x559a73abe910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:55.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.263+0000 7f952affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a73abc520 0x559a73abe910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34898/0 (socket says 172.21.15.33:34898) 2024-09-12T12:31:55.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.263+0000 7f952affd640 1 -- 172.21.15.33:0/2947599238 learned_addr learned my addr 172.21.15.33:0/2947599238 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:31:55.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.264+0000 7f9528ff9640 1 -- 172.21.15.33:0/4009210377 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f951c0cf700 con 0x7f952c1091f0 2024-09-12T12:31:55.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.264+0000 7f952affd640 1 -- 172.21.15.33:0/2947599238 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559a73ab2cf0 msgr2=0x559a73ab1240 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:31:55.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.264+0000 7f952affd640 1 --2- 172.21.15.33:0/2947599238 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559a73ab2cf0 0x559a73ab1240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:55.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.264+0000 7f952affd640 1 -- 172.21.15.33:0/2947599238 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a73ab1780 msgr2=0x559a73ab1bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:31:55.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.264+0000 7f952affd640 1 --2- 172.21.15.33:0/2947599238 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a73ab1780 0x559a73ab1bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:55.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.264+0000 7f952affd640 1 -- 172.21.15.33:0/2947599238 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a739a33a0 con 0x559a73abc520 2024-09-12T12:31:55.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.264+0000 7f952affd640 1 --2- 172.21.15.33:0/2947599238 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a73abc520 0x559a73abe910 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f9524009ca0 tx=0x7f9524003b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e00b60fa99456c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:31:55.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.268+0000 7f9511ffb640 1 -- 172.21.15.33:0/2947599238 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9524004040 con 0x559a73abc520 2024-09-12T12:31:55.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.268+0000 7f952bfff640 1 --2- 172.21.15.33:0/4009210377 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f95140a2d90 0x7f95140a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:55.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.268+0000 7f9511ffb640 1 -- 172.21.15.33:0/2947599238 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9524036040 con 0x559a73abc520 2024-09-12T12:31:55.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.269+0000 7f9533eb2740 1 -- 172.21.15.33:0/2947599238 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a73abc520 msgr2=0x559a73abe910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:55.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.269+0000 7f9533eb2740 1 --2- 172.21.15.33:0/2947599238 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a73abc520 0x559a73abe910 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f9524009ca0 tx=0x7f9524003b30 comp rx=0 tx=0).stop 2024-09-12T12:31:55.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.270+0000 7f9533eb2740 1 -- 172.21.15.33:0/2947599238 shutdown_connections 2024-09-12T12:31:55.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.270+0000 7f9533eb2740 1 --2- 172.21.15.33:0/2947599238 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a73abc520 0x559a73abe910 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:55.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.270+0000 7f9533eb2740 1 --2- 172.21.15.33:0/2947599238 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a73ab1780 0x559a73ab1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:55.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.270+0000 7f9533eb2740 1 --2- 172.21.15.33:0/2947599238 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559a73ab2cf0 0x559a73ab1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:55.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.270+0000 7f9533eb2740 1 -- 172.21.15.33:0/2947599238 >> 172.21.15.33:0/2947599238 conn(0x559a73a7a310 msgr2=0x559a73aade10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:31:55.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.271+0000 7f9533eb2740 1 -- 172.21.15.33:0/2947599238 shutdown_connections 2024-09-12T12:31:55.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.271+0000 7f9533eb2740 1 -- 172.21.15.33:0/2947599238 wait complete. 2024-09-12T12:31:55.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.271+0000 7f9533eb2740 1 -- start start 2024-09-12T12:31:55.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.271+0000 7f9533eb2740 1 Processor -- start 2024-09-12T12:31:55.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.272+0000 7f952bfff640 1 --2- 172.21.15.33:0/4009210377 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f95140a2d90 0x7f95140a5250 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f952000a860 tx=0x7f9520008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:31:55.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.272+0000 7f9533eb2740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559a73ab1780 0x559a73abbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:55.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.272+0000 7f9533eb2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a73ab2cf0 0x559a73ab90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:55.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.272+0000 7f9533eb2740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a73abc520 0x559a73ab95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:55.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.272+0000 7f9533eb2740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x559a73abf260 con 0x559a73abc520 2024-09-12T12:31:55.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.272+0000 7f9533eb2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559a739d2060 con 0x559a73ab2cf0 2024-09-12T12:31:55.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.272+0000 7f9533eb2740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x559a73abf3e0 con 0x559a73ab1780 2024-09-12T12:31:55.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.272+0000 7f9533eb2740 10 client.0 _ll_register_callbacks cb 0x559a737258c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:31:55.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.273+0000 7f952affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a73ab2cf0 0x559a73ab90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:55.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.273+0000 7f952affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a73ab2cf0 0x559a73ab90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:51390/0 (socket says 172.21.15.33:51390) 2024-09-12T12:31:55.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.273+0000 7f952affd640 1 -- 172.21.15.33:0/1377797976 learned_addr learned my addr 172.21.15.33:0/1377797976 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:31:55.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.273+0000 7f952bfff640 1 --2- 172.21.15.33:0/1377797976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a73abc520 0x559a73ab95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:55.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.273+0000 7f952affd640 1 -- 172.21.15.33:0/1377797976 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559a73ab1780 msgr2=0x559a73abbda0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:31:55.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.273+0000 7f952affd640 1 --2- 172.21.15.33:0/1377797976 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559a73ab1780 0x559a73abbda0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:55.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.273+0000 7f952affd640 1 -- 172.21.15.33:0/1377797976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a73abc520 msgr2=0x559a73ab95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:31:55.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.273+0000 7f952affd640 1 --2- 172.21.15.33:0/1377797976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a73abc520 0x559a73ab95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:55.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.273+0000 7f952affd640 1 -- 172.21.15.33:0/1377797976 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a737883c0 con 0x559a73ab2cf0 2024-09-12T12:31:55.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.274+0000 7f952affd640 1 --2- 172.21.15.33:0/1377797976 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a73ab2cf0 0x559a73ab90a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9524009850 tx=0x7f95240095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2db05ba373dfd9ed server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:31:55.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.274+0000 7f950affd640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:31:55.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.274+0000 7f950affd640 1 -- 172.21.15.33:0/1377797976 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f952404a040 con 0x559a73ab2cf0 2024-09-12T12:31:55.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.275+0000 7f9533eb2740 1 -- 172.21.15.33:0/1377797976 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9524036040 con 0x559a73ab2cf0 2024-09-12T12:31:55.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.275+0000 7f950affd640 1 -- 172.21.15.33:0/1377797976 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f9524031680 con 0x559a73ab2cf0 2024-09-12T12:31:55.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.275+0000 7f950affd640 1 -- 172.21.15.33:0/1377797976 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f952405c050 con 0x559a73ab2cf0 2024-09-12T12:31:55.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.276+0000 7f9533eb2740 10 client.25484 fetch_fsmap learned FSMap version 27 2024-09-12T12:31:55.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.276+0000 7f9533eb2740 1 -- 172.21.15.33:0/1377797976 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559a73acac70 con 0x559a73ab2cf0 2024-09-12T12:31:55.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.276+0000 7f950affd640 1 -- 172.21.15.33:0/1377797976 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9524036040 con 0x559a73ab2cf0 2024-09-12T12:31:55.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.276+0000 7f950affd640 1 -- 172.21.15.33:0/1377797976 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f952404d070 con 0x559a73ab2cf0 2024-09-12T12:31:55.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.276+0000 7f9533eb2740 10 client.25484 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:31:55.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.276+0000 7f9533eb2740 10 client.25484 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-12T12:31:55.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.276+0000 7f9533eb2740 20 client.25484 populate_metadata read hostname 'smithi033' 2024-09-12T12:31:55.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.277+0000 7f9533eb2740 1 --2- 172.21.15.33:0/1377797976 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x559a73acc1c0 0x559a73ace630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:55.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.277+0000 7f9533eb2740 4 client.25484 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:31:55.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.277+0000 7f9533eb2740 1 -- 172.21.15.33:0/1377797976 --> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a73a24860 con 0x559a73acc1c0 2024-09-12T12:31:55.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.279+0000 7f952b7fe640 1 --2- 172.21.15.33:0/1377797976 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x559a73acc1c0 0x559a73ace630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:55.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.279+0000 7f952b7fe640 1 --2- 172.21.15.33:0/1377797976 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x559a73acc1c0 0x559a73ace630 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c76f2768874f3ac4 server_cookie=819fd5df42a73ff7 in_seq=0 out_seq=0 2024-09-12T12:31:55.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.279+0000 7f950affd640 10 client.25484 ms_handle_connect on v2:172.21.15.102:6834/4179527539 2024-09-12T12:31:55.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.280+0000 7f950affd640 1 -- 172.21.15.33:0/1377797976 <== mds.2 v2:172.21.15.102:6834/4179527539 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559a73a24860 con 0x559a73acc1c0 2024-09-12T12:31:55.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.280+0000 7f950affd640 10 client.25484 handle_command_reply: tid=0 2024-09-12T12:31:55.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.280+0000 7f9533eb2740 1 client.25484 shutdown 2024-09-12T12:31:55.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.283+0000 7f9533eb2740 1 -- 172.21.15.33:0/1377797976 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a73ab2cf0 msgr2=0x559a73ab90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:55.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.283+0000 7f9533eb2740 1 --2- 172.21.15.33:0/1377797976 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a73ab2cf0 0x559a73ab90a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9524009850 tx=0x7f95240095c0 comp rx=0 tx=0).stop 2024-09-12T12:31:55.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.283+0000 7f9533eb2740 1 -- 172.21.15.33:0/1377797976 shutdown_connections 2024-09-12T12:31:55.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.283+0000 7f9533eb2740 1 --2- 172.21.15.33:0/1377797976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a73abc520 0x559a73ab95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:55.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.283+0000 7f9533eb2740 1 --2- 172.21.15.33:0/1377797976 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x559a73acc1c0 0x559a73ace630 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:55.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.283+0000 7f9533eb2740 1 --2- 172.21.15.33:0/1377797976 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a73ab2cf0 0x559a73ab90a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:55.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.283+0000 7f9533eb2740 1 --2- 172.21.15.33:0/1377797976 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559a73ab1780 0x559a73abbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:55.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.283+0000 7f9533eb2740 1 -- 172.21.15.33:0/1377797976 >> 172.21.15.33:0/1377797976 conn(0x559a73a7a310 msgr2=0x559a73ab3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:31:55.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.283+0000 7f950affd640 0 client.25484 ms_handle_reset on v2:172.21.15.102:6834/4179527539 2024-09-12T12:31:55.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.283+0000 7f9533eb2740 1 -- 172.21.15.33:0/1377797976 shutdown_connections 2024-09-12T12:31:55.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.283+0000 7f9533eb2740 1 -- 172.21.15.33:0/1377797976 wait complete. 2024-09-12T12:31:55.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.284+0000 7f9533eb2740 20 client.25484 trim_cache size 0 max 16384 2024-09-12T12:31:55.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.310+0000 7f9533eb2740 1 Processor -- start 2024-09-12T12:31:55.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.310+0000 7f9533eb2740 1 -- start start 2024-09-12T12:31:55.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.310+0000 7f9533eb2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a73ab1780 0x559a73abb010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:55.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.310+0000 7f9533eb2740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a73ab2cf0 0x559a73ab42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:55.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.311+0000 7f952b7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a73ab1780 0x559a73abb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:55.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.311+0000 7f952b7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a73ab1780 0x559a73abb010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:51404/0 (socket says 172.21.15.33:51404) 2024-09-12T12:31:55.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.311+0000 7f952affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a73ab2cf0 0x559a73ab42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:55.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.311+0000 7f952affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a73ab2cf0 0x559a73ab42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34922/0 (socket says 172.21.15.33:34922) 2024-09-12T12:31:55.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.311+0000 7f952b7fe640 1 -- 172.21.15.33:0/2665166426 learned_addr learned my addr 172.21.15.33:0/2665166426 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:31:55.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.311+0000 7f9533eb2740 1 --2- 172.21.15.33:0/2665166426 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559a73abc520 0x559a73ab4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:55.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.311+0000 7f9533eb2740 1 -- 172.21.15.33:0/2665166426 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f952c1c8a70 con 0x559a73ab2cf0 2024-09-12T12:31:55.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.311+0000 7f9533eb2740 1 -- 172.21.15.33:0/2665166426 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f952c1c6340 con 0x559a73ab1780 2024-09-12T12:31:55.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.311+0000 7f9533eb2740 1 -- 172.21.15.33:0/2665166426 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f952c1c4190 con 0x559a73abc520 2024-09-12T12:31:55.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.312+0000 7f952bfff640 1 --2- 172.21.15.33:0/2665166426 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559a73abc520 0x559a73ab4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:55.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.312+0000 7f952affd640 1 -- 172.21.15.33:0/2665166426 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559a73abc520 msgr2=0x559a73ab4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:31:55.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.312+0000 7f952affd640 1 --2- 172.21.15.33:0/2665166426 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559a73abc520 0x559a73ab4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:55.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.312+0000 7f952affd640 1 -- 172.21.15.33:0/2665166426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a73ab1780 msgr2=0x559a73abb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:31:55.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.312+0000 7f952affd640 1 --2- 172.21.15.33:0/2665166426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a73ab1780 0x559a73abb010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:55.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.312+0000 7f952affd640 1 -- 172.21.15.33:0/2665166426 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a73ab2730 con 0x559a73ab2cf0 2024-09-12T12:31:55.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.313+0000 7f952affd640 1 --2- 172.21.15.33:0/2665166426 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a73ab2cf0 0x559a73ab42d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f9524009bf0 tx=0x7f9524030610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dadb3e75747d44a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:31:55.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.315+0000 7f95117fa640 1 -- 172.21.15.33:0/2665166426 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9524030920 con 0x559a73ab2cf0 2024-09-12T12:31:55.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.315+0000 7f95117fa640 1 -- 172.21.15.33:0/2665166426 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9524036040 con 0x559a73ab2cf0 2024-09-12T12:31:55.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.315+0000 7f95117fa640 1 -- 172.21.15.33:0/2665166426 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f952404e700 con 0x559a73ab2cf0 2024-09-12T12:31:55.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.316+0000 7f9533eb2740 1 -- 172.21.15.33:0/2665166426 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a73ab2cf0 msgr2=0x559a73ab42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:55.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.316+0000 7f9533eb2740 1 --2- 172.21.15.33:0/2665166426 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a73ab2cf0 0x559a73ab42d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f9524009bf0 tx=0x7f9524030610 comp rx=0 tx=0).stop 2024-09-12T12:31:55.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.316+0000 7f9533eb2740 1 -- 172.21.15.33:0/2665166426 shutdown_connections 2024-09-12T12:31:55.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.316+0000 7f9533eb2740 1 --2- 172.21.15.33:0/2665166426 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559a73abc520 0x559a73ab4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:55.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.316+0000 7f9533eb2740 1 --2- 172.21.15.33:0/2665166426 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a73ab2cf0 0x559a73ab42d0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:55.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.316+0000 7f9533eb2740 1 --2- 172.21.15.33:0/2665166426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a73ab1780 0x559a73abb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:55.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.316+0000 7f9533eb2740 1 -- 172.21.15.33:0/2665166426 >> 172.21.15.33:0/2665166426 conn(0x559a73a7a310 msgr2=0x559a73aba900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:31:55.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.318+0000 7f9533eb2740 1 -- 172.21.15.33:0/2665166426 shutdown_connections 2024-09-12T12:31:55.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.322+0000 7f9533eb2740 1 -- 172.21.15.33:0/2665166426 wait complete. 2024-09-12T12:31:55.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.322+0000 7f9533eb2740 1 -- start start 2024-09-12T12:31:55.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.323+0000 7f9533eb2740 1 Processor -- start 2024-09-12T12:31:55.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.323+0000 7f9533eb2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a73ab1780 0x559a73ac46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:55.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.324+0000 7f9533eb2740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559a73ab2cf0 0x559a73ac4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:55.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.324+0000 7f9533eb2740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a73abc520 0x559a73ab54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:55.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.324+0000 7f9533eb2740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f952c1c4800 con 0x559a73abc520 2024-09-12T12:31:55.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.324+0000 7f9533eb2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f952c1c5c70 con 0x559a73ab1780 2024-09-12T12:31:55.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.324+0000 7f9533eb2740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f952c1c4ed0 con 0x559a73ab2cf0 2024-09-12T12:31:55.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.324+0000 7f952bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a73abc520 0x559a73ab54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:55.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.324+0000 7f9533eb2740 10 client.0 _ll_register_callbacks cb 0x7f9524003a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:31:55.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.326+0000 7f952affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559a73ab2cf0 0x559a73ac4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:55.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.326+0000 7f952affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559a73ab2cf0 0x559a73ac4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:50648/0 (socket says 172.21.15.33:50648) 2024-09-12T12:31:55.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.326+0000 7f952affd640 1 -- 172.21.15.33:0/2888891977 learned_addr learned my addr 172.21.15.33:0/2888891977 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:31:55.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.326+0000 7f952b7fe640 1 --2- 172.21.15.33:0/2888891977 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a73ab1780 0x559a73ac46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:55.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.329+0000 7f952b7fe640 1 -- 172.21.15.33:0/2888891977 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559a73ab2cf0 msgr2=0x559a73ac4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:31:55.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.329+0000 7f952b7fe640 1 --2- 172.21.15.33:0/2888891977 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559a73ab2cf0 0x559a73ac4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:55.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.329+0000 7f952b7fe640 1 -- 172.21.15.33:0/2888891977 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a73abc520 msgr2=0x559a73ab54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:31:55.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.329+0000 7f952b7fe640 1 --2- 172.21.15.33:0/2888891977 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a73abc520 0x559a73ab54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:55.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.329+0000 7f952b7fe640 1 -- 172.21.15.33:0/2888891977 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a73ab59f0 con 0x559a73ab1780 2024-09-12T12:31:55.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.329+0000 7f952affd640 1 --2- 172.21.15.33:0/2888891977 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559a73ab2cf0 0x559a73ac4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:31:55.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.330+0000 7f952b7fe640 1 --2- 172.21.15.33:0/2888891977 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a73ab1780 0x559a73ac46f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f951c09bb00 tx=0x7f951c009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97be814a593ce63b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:31:55.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.332+0000 7f950affd640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:31:55.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.332+0000 7f950affd640 1 -- 172.21.15.33:0/2888891977 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f951c09c270 con 0x559a73ab1780 2024-09-12T12:31:55.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.332+0000 7f9533eb2740 1 -- 172.21.15.33:0/2888891977 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9524036040 con 0x559a73ab1780 2024-09-12T12:31:55.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.332+0000 7f950affd640 1 -- 172.21.15.33:0/2888891977 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f951c010a90 con 0x559a73ab1780 2024-09-12T12:31:55.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.333+0000 7f950affd640 1 -- 172.21.15.33:0/2888891977 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f951c09bb70 con 0x559a73ab1780 2024-09-12T12:31:55.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.336+0000 7f9533eb2740 10 client.25490 fetch_fsmap learned FSMap version 27 2024-09-12T12:31:55.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.336+0000 7f9533eb2740 1 -- 172.21.15.33:0/2888891977 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559a73b36600 con 0x559a73ab1780 2024-09-12T12:31:55.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.337+0000 7f950affd640 1 -- 172.21.15.33:0/2888891977 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9524036040 con 0x559a73ab1780 2024-09-12T12:31:55.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.337+0000 7f950affd640 1 -- 172.21.15.33:0/2888891977 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f951c0cf350 con 0x559a73ab1780 2024-09-12T12:31:55.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.343+0000 7f9533eb2740 10 client.25490 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:31:55.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.343+0000 7f9533eb2740 10 client.25490 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-12T12:31:55.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.343+0000 7f9533eb2740 20 client.25490 populate_metadata read hostname 'smithi033' 2024-09-12T12:31:55.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.343+0000 7f9533eb2740 1 --2- 172.21.15.33:0/2888891977 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x559a73b36cb0 0x559a73b390d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:55.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.343+0000 7f9533eb2740 4 client.25490 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:31:55.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.343+0000 7f9533eb2740 1 -- 172.21.15.33:0/2888891977 --> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559a73a1ed70 con 0x559a73b36cb0 2024-09-12T12:31:55.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.343+0000 7f952affd640 1 --2- 172.21.15.33:0/2888891977 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x559a73b36cb0 0x559a73b390d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:55.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.348+0000 7f952affd640 1 --2- 172.21.15.33:0/2888891977 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x559a73b36cb0 0x559a73b390d0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=257243404b71da35 server_cookie=3b0bdcf5a38080fa in_seq=0 out_seq=0 2024-09-12T12:31:55.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.348+0000 7f950affd640 10 client.25490 ms_handle_connect on v2:172.21.15.102:6834/4179527539 2024-09-12T12:31:55.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.352+0000 7f950affd640 1 -- 172.21.15.33:0/2888891977 <== mds.2 v2:172.21.15.102:6834/4179527539 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559a73a1ed70 con 0x559a73b36cb0 2024-09-12T12:31:55.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.352+0000 7f950affd640 10 client.25490 handle_command_reply: tid=0 2024-09-12T12:31:55.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.352+0000 7f9533eb2740 1 client.25490 shutdown 2024-09-12T12:31:55.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.352+0000 7f9533eb2740 1 -- 172.21.15.33:0/2888891977 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a73ab1780 msgr2=0x559a73ac46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:55.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.352+0000 7f9533eb2740 1 --2- 172.21.15.33:0/2888891977 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a73ab1780 0x559a73ac46f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f951c09bb00 tx=0x7f951c009310 comp rx=0 tx=0).stop 2024-09-12T12:31:55.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.353+0000 7f9533eb2740 1 -- 172.21.15.33:0/2888891977 shutdown_connections 2024-09-12T12:31:55.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.353+0000 7f9533eb2740 1 --2- 172.21.15.33:0/2888891977 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a73abc520 0x559a73ab54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:55.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.353+0000 7f9533eb2740 1 --2- 172.21.15.33:0/2888891977 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559a73ab2cf0 0x559a73ac4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:55.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.353+0000 7f9533eb2740 1 --2- 172.21.15.33:0/2888891977 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x559a73b36cb0 0x559a73b390d0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:55.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.353+0000 7f9533eb2740 1 --2- 172.21.15.33:0/2888891977 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559a73ab1780 0x559a73ac46f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:55.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.353+0000 7f9533eb2740 1 -- 172.21.15.33:0/2888891977 >> 172.21.15.33:0/2888891977 conn(0x559a73a7a310 msgr2=0x559a73abb120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:31:55.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.354+0000 7f950affd640 0 client.25490 ms_handle_reset on v2:172.21.15.102:6834/4179527539 2024-09-12T12:31:55.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.355+0000 7f9533eb2740 1 -- 172.21.15.33:0/2888891977 shutdown_connections 2024-09-12T12:31:55.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.357+0000 7f9533eb2740 1 -- 172.21.15.33:0/2888891977 wait complete. 2024-09-12T12:31:55.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.357+0000 7f9533eb2740 20 client.25490 trim_cache size 0 max 16384 2024-09-12T12:31:55.358 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-09-12T12:31:55.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.359+0000 7f9530877640 1 -- 172.21.15.33:0/4009210377 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f95140a2d90 msgr2=0x7f95140a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:55.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.359+0000 7f9530877640 1 --2- 172.21.15.33:0/4009210377 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f95140a2d90 0x7f95140a5250 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f952000a860 tx=0x7f9520008040 comp rx=0 tx=0).stop 2024-09-12T12:31:55.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.359+0000 7f9530877640 1 -- 172.21.15.33:0/4009210377 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f952c1091f0 msgr2=0x7f952c1186c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:55.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.359+0000 7f9530877640 1 --2- 172.21.15.33:0/4009210377 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f952c1091f0 0x7f952c1186c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f951c00e9f0 tx=0x7f951c00eeb0 comp rx=0 tx=0).stop 2024-09-12T12:31:55.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.359+0000 7f9530877640 1 -- 172.21.15.33:0/4009210377 shutdown_connections 2024-09-12T12:31:55.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.359+0000 7f9530877640 1 --2- 172.21.15.33:0/4009210377 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f95140a2d90 0x7f95140a5250 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:55.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.359+0000 7f9530877640 1 --2- 172.21.15.33:0/4009210377 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f952c11b140 0x7f952c111c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:55.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.359+0000 7f9530877640 1 --2- 172.21.15.33:0/4009210377 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f952c1095d0 0x7f952c111750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:55.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.359+0000 7f9530877640 1 --2- 172.21.15.33:0/4009210377 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f952c1091f0 0x7f952c1186c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:55.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.359+0000 7f9530877640 1 -- 172.21.15.33:0/4009210377 >> 172.21.15.33:0/4009210377 conn(0x7f952c073660 msgr2=0x7f952c11b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:31:55.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.359+0000 7f9530877640 1 -- 172.21.15.33:0/4009210377 shutdown_connections 2024-09-12T12:31:55.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:55.360+0000 7f9530877640 1 -- 172.21.15.33:0/4009210377 wait complete. 2024-09-12T12:31:55.649 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:31:55 smithi033 ceph-mon[31246]: pgmap v527: 129 pgs: 129 active+clean; 10 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 39 MiB/s wr, 633 op/s 2024-09-12T12:31:55.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:31:55 smithi102 ceph-mon[34799]: pgmap v527: 129 pgs: 129 active+clean; 10 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 39 MiB/s wr, 633 op/s 2024-09-12T12:31:56.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:31:55 smithi043 ceph-mon[34144]: pgmap v527: 129 pgs: 129 active+clean; 10 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 39 MiB/s wr, 633 op/s 2024-09-12T12:31:56.256 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T12:31:56.951 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:31:57.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.669+0000 7f5775b5d640 1 -- 172.21.15.33:0/2979369530 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5770109830 msgr2=0x7f5770109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:57.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.669+0000 7f5775b5d640 1 --2- 172.21.15.33:0/2979369530 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5770109830 0x7f5770109c90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5764009860 tx=0x7f576402a360 comp rx=0 tx=0).stop 2024-09-12T12:31:57.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.670+0000 7f5775b5d640 1 -- 172.21.15.33:0/2979369530 shutdown_connections 2024-09-12T12:31:57.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.670+0000 7f5775b5d640 1 --2- 172.21.15.33:0/2979369530 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f577011b140 0x7f577011d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:57.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.670+0000 7f5775b5d640 1 --2- 172.21.15.33:0/2979369530 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5770109830 0x7f5770109c90 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:57.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.670+0000 7f5775b5d640 1 --2- 172.21.15.33:0/2979369530 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5770109450 0x7f5770110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:57.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.670+0000 7f5775b5d640 1 -- 172.21.15.33:0/2979369530 >> 172.21.15.33:0/2979369530 conn(0x7f577006e140 msgr2=0x7f577006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:31:57.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.673+0000 7f5775b5d640 1 -- 172.21.15.33:0/2979369530 shutdown_connections 2024-09-12T12:31:57.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.673+0000 7f5775b5d640 1 -- 172.21.15.33:0/2979369530 wait complete. 2024-09-12T12:31:57.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.674+0000 7f5775b5d640 1 Processor -- start 2024-09-12T12:31:57.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.674+0000 7f5775b5d640 1 -- start start 2024-09-12T12:31:57.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.674+0000 7f5775b5d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5770109450 0x7f57701a7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:57.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.674+0000 7f5775b5d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5770109830 0x7f57701a76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:57.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.674+0000 7f5775b5d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f577011b140 0x7f57701aba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:57.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.674+0000 7f5775b5d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5770120ca0 con 0x7f5770109830 2024-09-12T12:31:57.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.674+0000 7f5775b5d640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5770120b20 con 0x7f577011b140 2024-09-12T12:31:57.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.674+0000 7f5775b5d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5770120e20 con 0x7f5770109450 2024-09-12T12:31:57.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.675+0000 7f576f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5770109450 0x7f57701a7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:57.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.675+0000 7f576f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5770109450 0x7f57701a7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:50664/0 (socket says 172.21.15.33:50664) 2024-09-12T12:31:57.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.675+0000 7f576f7fe640 1 -- 172.21.15.33:0/2930193045 learned_addr learned my addr 172.21.15.33:0/2930193045 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:31:57.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.675+0000 7f576ffff640 1 --2- 172.21.15.33:0/2930193045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f577011b140 0x7f57701aba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:57.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.675+0000 7f576f7fe640 1 -- 172.21.15.33:0/2930193045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f577011b140 msgr2=0x7f57701aba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:57.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.675+0000 7f576f7fe640 1 --2- 172.21.15.33:0/2930193045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f577011b140 0x7f57701aba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:57.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.675+0000 7f576f7fe640 1 -- 172.21.15.33:0/2930193045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5770109830 msgr2=0x7f57701a76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:57.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.675+0000 7f576f7fe640 1 --2- 172.21.15.33:0/2930193045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5770109830 0x7f57701a76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:57.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.675+0000 7f576f7fe640 1 -- 172.21.15.33:0/2930193045 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57701ac150 con 0x7f5770109450 2024-09-12T12:31:57.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.676+0000 7f576f7fe640 1 --2- 172.21.15.33:0/2930193045 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5770109450 0x7f57701a7180 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f576000d950 tx=0x7f576000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:31:57.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.676+0000 7f576cff9640 1 -- 172.21.15.33:0/2930193045 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5760017070 con 0x7f5770109450 2024-09-12T12:31:57.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.676+0000 7f576cff9640 1 -- 172.21.15.33:0/2930193045 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5760009c30 con 0x7f5770109450 2024-09-12T12:31:57.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.677+0000 7f5775b5d640 1 -- 172.21.15.33:0/2930193045 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57701ac440 con 0x7f5770109450 2024-09-12T12:31:57.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.677+0000 7f5775b5d640 1 -- 172.21.15.33:0/2930193045 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5770110920 con 0x7f5770109450 2024-09-12T12:31:57.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.678+0000 7f576cff9640 1 -- 172.21.15.33:0/2930193045 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576000f620 con 0x7f5770109450 2024-09-12T12:31:57.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.687+0000 7f5777f36740 1 Processor -- start 2024-09-12T12:31:57.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.688+0000 7f5777f36740 1 -- start start 2024-09-12T12:31:57.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.688+0000 7f5777f36740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c6ab032b40 0x55c6ab031090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:57.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.688+0000 7f5777f36740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6ab0315d0 0x55c6ab031a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:57.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.688+0000 7f5777f36740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c6ab03c370 0x55c6ab03e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:57.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.688+0000 7f5777f36740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55c6aaf972f0 con 0x55c6ab03c370 2024-09-12T12:31:57.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.688+0000 7f5777f36740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55c6aaf3ecf0 con 0x55c6ab032b40 2024-09-12T12:31:57.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.688+0000 7f5777f36740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55c6aaf932b0 con 0x55c6ab0315d0 2024-09-12T12:31:57.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.688+0000 7f576ffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c6ab032b40 0x55c6ab031090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:57.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.689+0000 7f576ffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c6ab032b40 0x55c6ab031090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:51438/0 (socket says 172.21.15.33:51438) 2024-09-12T12:31:57.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.689+0000 7f576ffff640 1 -- 172.21.15.33:0/492105024 learned_addr learned my addr 172.21.15.33:0/492105024 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:31:57.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.689+0000 7f576ffff640 1 -- 172.21.15.33:0/492105024 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6ab0315d0 msgr2=0x55c6ab031a10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:31:57.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.689+0000 7f576ffff640 1 --2- 172.21.15.33:0/492105024 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6ab0315d0 0x55c6ab031a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:57.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.689+0000 7f576ffff640 1 -- 172.21.15.33:0/492105024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c6ab03c370 msgr2=0x55c6ab03e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:31:57.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.689+0000 7f576ffff640 1 --2- 172.21.15.33:0/492105024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c6ab03c370 0x55c6ab03e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:57.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.689+0000 7f576ffff640 1 -- 172.21.15.33:0/492105024 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6aaf233a0 con 0x55c6ab032b40 2024-09-12T12:31:57.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.689+0000 7f576ffff640 1 --2- 172.21.15.33:0/492105024 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c6ab032b40 0x55c6ab031090 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5768009e80 tx=0x7f57680107e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bb60348264d77b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:31:57.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.691+0000 7f5755ffb640 1 -- 172.21.15.33:0/492105024 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5768003b70 con 0x55c6ab032b40 2024-09-12T12:31:57.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.691+0000 7f5755ffb640 1 -- 172.21.15.33:0/492105024 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5768003d10 con 0x55c6ab032b40 2024-09-12T12:31:57.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.691+0000 7f5755ffb640 1 -- 172.21.15.33:0/492105024 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576800cb80 con 0x55c6ab032b40 2024-09-12T12:31:57.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.691+0000 7f576cff9640 1 -- 172.21.15.33:0/2930193045 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f5760010460 con 0x7f5770109450 2024-09-12T12:31:57.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.693+0000 7f576cff9640 1 --2- 172.21.15.33:0/2930193045 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f57580a2c80 0x7f57580a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:57.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.693+0000 7f576cff9640 1 -- 172.21.15.33:0/2930193045 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f57600cedb0 con 0x7f5770109450 2024-09-12T12:31:57.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.694+0000 7f576f7fe640 1 --2- 172.21.15.33:0/2930193045 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f57580a2c80 0x7f57580a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:57.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.694+0000 7f576f7fe640 1 --2- 172.21.15.33:0/2930193045 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f57580a2c80 0x7f57580a5140 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f576009b230 tx=0x7f576009b070 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:31:57.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.699+0000 7f5777f36740 1 -- 172.21.15.33:0/492105024 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c6ab032b40 msgr2=0x55c6ab031090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:57.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.699+0000 7f5777f36740 1 --2- 172.21.15.33:0/492105024 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c6ab032b40 0x55c6ab031090 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5768009e80 tx=0x7f57680107e0 comp rx=0 tx=0).stop 2024-09-12T12:31:57.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.715+0000 7f5777f36740 1 -- 172.21.15.33:0/492105024 shutdown_connections 2024-09-12T12:31:57.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.715+0000 7f5777f36740 1 --2- 172.21.15.33:0/492105024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c6ab03c370 0x55c6ab03e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:57.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.715+0000 7f5777f36740 1 --2- 172.21.15.33:0/492105024 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6ab0315d0 0x55c6ab031a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:57.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.715+0000 7f5777f36740 1 --2- 172.21.15.33:0/492105024 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c6ab032b40 0x55c6ab031090 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:57.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.715+0000 7f5777f36740 1 -- 172.21.15.33:0/492105024 >> 172.21.15.33:0/492105024 conn(0x55c6aaffa310 msgr2=0x55c6ab02dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:31:57.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.721+0000 7f5777f36740 1 -- 172.21.15.33:0/492105024 shutdown_connections 2024-09-12T12:31:57.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.723+0000 7f5777f36740 1 -- 172.21.15.33:0/492105024 wait complete. 2024-09-12T12:31:57.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.724+0000 7f5777f36740 1 -- start start 2024-09-12T12:31:57.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.724+0000 7f5777f36740 1 Processor -- start 2024-09-12T12:31:57.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.729+0000 7f5777f36740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6ab0315d0 0x55c6ab03bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:57.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.729+0000 7f5777f36740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c6ab032b40 0x55c6ab038fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:57.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.729+0000 7f5777f36740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c6ab03c370 0x55c6ab039570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:57.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.730+0000 7f576ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6ab0315d0 0x55c6ab03bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:57.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.730+0000 7f576ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6ab0315d0 0x55c6ab03bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:50676/0 (socket says 172.21.15.33:50676) 2024-09-12T12:31:57.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.730+0000 7f576ffff640 1 -- 172.21.15.33:0/886624401 learned_addr learned my addr 172.21.15.33:0/886624401 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:31:57.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.730+0000 7f5777f36740 1 -- 172.21.15.33:0/886624401 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55c6ab03f070 con 0x55c6ab03c370 2024-09-12T12:31:57.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.730+0000 7f5777f36740 1 -- 172.21.15.33:0/886624401 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55c6aaf52060 con 0x55c6ab032b40 2024-09-12T12:31:57.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.730+0000 7f5777f36740 1 -- 172.21.15.33:0/886624401 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55c6ab03f1f0 con 0x55c6ab0315d0 2024-09-12T12:31:57.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.730+0000 7f5777f36740 10 client.0 _ll_register_callbacks cb 0x55c6aaca58c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:31:57.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.730+0000 7f576effd640 1 --2- 172.21.15.33:0/886624401 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c6ab032b40 0x55c6ab038fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:57.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.733+0000 7f576ffff640 1 --2- 172.21.15.33:0/886624401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c6ab03c370 0x55c6ab039570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:57.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.734+0000 7f576ffff640 1 -- 172.21.15.33:0/886624401 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c6ab032b40 msgr2=0x55c6ab038fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:31:57.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.734+0000 7f576ffff640 1 --2- 172.21.15.33:0/886624401 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c6ab032b40 0x55c6ab038fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:57.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.734+0000 7f576ffff640 1 -- 172.21.15.33:0/886624401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c6ab03c370 msgr2=0x55c6ab039570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:31:57.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.734+0000 7f576ffff640 1 --2- 172.21.15.33:0/886624401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c6ab03c370 0x55c6ab039570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:57.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.734+0000 7f576ffff640 1 -- 172.21.15.33:0/886624401 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6aad083c0 con 0x55c6ab0315d0 2024-09-12T12:31:57.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.734+0000 7f576ffff640 1 --2- 172.21.15.33:0/886624401 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6ab0315d0 0x55c6ab03bd20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f576800cc60 tx=0x7f576800c720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ae172c342e6ab3e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:31:57.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.735+0000 7f574effd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:31:57.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.736+0000 7f576effd640 1 --2- 172.21.15.33:0/886624401 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c6ab032b40 0x55c6ab038fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:31:57.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.736+0000 7f574effd640 1 -- 172.21.15.33:0/886624401 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5768003ec0 con 0x55c6ab0315d0 2024-09-12T12:31:57.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.736+0000 7f5777f36740 1 -- 172.21.15.33:0/886624401 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5768003d10 con 0x55c6ab0315d0 2024-09-12T12:31:57.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.736+0000 7f574effd640 1 -- 172.21.15.33:0/886624401 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f5768004060 con 0x55c6ab0315d0 2024-09-12T12:31:57.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.737+0000 7f574effd640 1 -- 172.21.15.33:0/886624401 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5768004280 con 0x55c6ab0315d0 2024-09-12T12:31:57.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.737+0000 7f5777f36740 10 client.25582 fetch_fsmap learned FSMap version 27 2024-09-12T12:31:57.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.737+0000 7f5777f36740 1 -- 172.21.15.33:0/886624401 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c6ab04aaf0 con 0x55c6ab0315d0 2024-09-12T12:31:57.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.737+0000 7f574effd640 1 -- 172.21.15.33:0/886624401 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5768003d10 con 0x55c6ab0315d0 2024-09-12T12:31:57.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.740+0000 7f574effd640 1 -- 172.21.15.33:0/886624401 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f5768023040 con 0x55c6ab0315d0 2024-09-12T12:31:57.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.740+0000 7f5777f36740 10 client.25582 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:31:57.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.740+0000 7f5777f36740 10 client.25582 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-12T12:31:57.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.740+0000 7f5777f36740 20 client.25582 populate_metadata read hostname 'smithi033' 2024-09-12T12:31:57.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.741+0000 7f5777f36740 1 --2- 172.21.15.33:0/886624401 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x55c6ab04be40 0x55c6ab04e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:57.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.741+0000 7f5777f36740 4 client.25582 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:31:57.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.741+0000 7f5777f36740 1 -- 172.21.15.33:0/886624401 --> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c6aafa4860 con 0x55c6ab04be40 2024-09-12T12:31:57.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.743+0000 7f576effd640 1 --2- 172.21.15.33:0/886624401 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x55c6ab04be40 0x55c6ab04e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:57.750 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:31:57 smithi033 ceph-mon[31246]: pgmap v528: 129 pgs: 129 active+clean; 10 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 33 MiB/s wr, 537 op/s 2024-09-12T12:31:57.750 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:31:57 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:31:57.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.746+0000 7f576effd640 1 --2- 172.21.15.33:0/886624401 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x55c6ab04be40 0x55c6ab04e230 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5022e5130550494a server_cookie=929abb6a0ea3cc90 in_seq=0 out_seq=0 2024-09-12T12:31:57.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.746+0000 7f574effd640 10 client.25582 ms_handle_connect on v2:172.21.15.102:6836/2409953270 2024-09-12T12:31:57.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.747+0000 7f574effd640 1 -- 172.21.15.33:0/886624401 <== mds.1 v2:172.21.15.102:6836/2409953270 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c6aafa4860 con 0x55c6ab04be40 2024-09-12T12:31:57.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.748+0000 7f574effd640 10 client.25582 handle_command_reply: tid=0 2024-09-12T12:31:57.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.749+0000 7f5777f36740 1 client.25582 shutdown 2024-09-12T12:31:57.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.752+0000 7f5777f36740 1 -- 172.21.15.33:0/886624401 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6ab0315d0 msgr2=0x55c6ab03bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:57.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.752+0000 7f5777f36740 1 --2- 172.21.15.33:0/886624401 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6ab0315d0 0x55c6ab03bd20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f576800cc60 tx=0x7f576800c720 comp rx=0 tx=0).stop 2024-09-12T12:31:57.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.752+0000 7f5777f36740 1 -- 172.21.15.33:0/886624401 shutdown_connections 2024-09-12T12:31:57.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.752+0000 7f5777f36740 1 --2- 172.21.15.33:0/886624401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c6ab03c370 0x55c6ab039570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:57.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.752+0000 7f5777f36740 1 --2- 172.21.15.33:0/886624401 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c6ab032b40 0x55c6ab038fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:57.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.752+0000 7f5777f36740 1 --2- 172.21.15.33:0/886624401 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x55c6ab04be40 0x55c6ab04e230 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:57.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.752+0000 7f5777f36740 1 --2- 172.21.15.33:0/886624401 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6ab0315d0 0x55c6ab03bd20 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:57.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.752+0000 7f5777f36740 1 -- 172.21.15.33:0/886624401 >> 172.21.15.33:0/886624401 conn(0x55c6aaffa310 msgr2=0x55c6ab033960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:31:57.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.752+0000 7f574effd640 0 client.25582 ms_handle_reset on v2:172.21.15.102:6836/2409953270 2024-09-12T12:31:57.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.756+0000 7f5777f36740 1 -- 172.21.15.33:0/886624401 shutdown_connections 2024-09-12T12:31:57.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.760+0000 7f5777f36740 1 -- 172.21.15.33:0/886624401 wait complete. 2024-09-12T12:31:57.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.760+0000 7f5777f36740 20 client.25582 trim_cache size 0 max 16384 2024-09-12T12:31:57.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.792+0000 7f5777f36740 1 Processor -- start 2024-09-12T12:31:57.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.792+0000 7f5777f36740 1 -- start start 2024-09-12T12:31:57.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.792+0000 7f5777f36740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6ab0315d0 0x55c6ab048340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:57.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.792+0000 7f5777f36740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c6ab032b40 0x55c6ab0538b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:57.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.793+0000 7f576ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6ab0315d0 0x55c6ab048340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:57.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.793+0000 7f576ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6ab0315d0 0x55c6ab048340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:50686/0 (socket says 172.21.15.33:50686) 2024-09-12T12:31:57.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.793+0000 7f576ffff640 1 -- 172.21.15.33:0/3591393019 learned_addr learned my addr 172.21.15.33:0/3591393019 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:31:57.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.793+0000 7f5777f36740 1 --2- 172.21.15.33:0/3591393019 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c6ab03c370 0x55c6ab053df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:57.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.793+0000 7f5777f36740 1 -- 172.21.15.33:0/3591393019 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f57701c88b0 con 0x55c6ab03c370 2024-09-12T12:31:57.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.793+0000 7f5777f36740 1 -- 172.21.15.33:0/3591393019 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f57701c6180 con 0x55c6ab032b40 2024-09-12T12:31:57.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.793+0000 7f5777f36740 1 -- 172.21.15.33:0/3591393019 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f57701184a0 con 0x55c6ab0315d0 2024-09-12T12:31:57.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.794+0000 7f576ffff640 1 -- 172.21.15.33:0/3591393019 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c6ab032b40 msgr2=0x55c6ab0538b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:31:57.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.794+0000 7f576ffff640 1 --2- 172.21.15.33:0/3591393019 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c6ab032b40 0x55c6ab0538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:57.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.794+0000 7f576ffff640 1 -- 172.21.15.33:0/3591393019 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c6ab03c370 msgr2=0x55c6ab053df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:31:57.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.794+0000 7f576ffff640 1 --2- 172.21.15.33:0/3591393019 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c6ab03c370 0x55c6ab053df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:57.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.794+0000 7f576ffff640 1 -- 172.21.15.33:0/3591393019 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6ab031d50 con 0x55c6ab0315d0 2024-09-12T12:31:57.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.794+0000 7f576ffff640 1 --2- 172.21.15.33:0/3591393019 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6ab0315d0 0x55c6ab048340 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5768005fd0 tx=0x7f5768009a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5de5e3a4c7f2a39c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:31:57.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.795+0000 7f57557fa640 1 -- 172.21.15.33:0/3591393019 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5768037020 con 0x55c6ab0315d0 2024-09-12T12:31:57.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.795+0000 7f57557fa640 1 -- 172.21.15.33:0/3591393019 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f576802b070 con 0x55c6ab0315d0 2024-09-12T12:31:57.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.795+0000 7f57557fa640 1 -- 172.21.15.33:0/3591393019 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576802f830 con 0x55c6ab0315d0 2024-09-12T12:31:57.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.796+0000 7f5777f36740 1 -- 172.21.15.33:0/3591393019 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6ab0315d0 msgr2=0x55c6ab048340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:57.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.796+0000 7f5777f36740 1 --2- 172.21.15.33:0/3591393019 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6ab0315d0 0x55c6ab048340 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5768005fd0 tx=0x7f5768009a70 comp rx=0 tx=0).stop 2024-09-12T12:31:57.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.796+0000 7f5777f36740 1 -- 172.21.15.33:0/3591393019 shutdown_connections 2024-09-12T12:31:57.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.796+0000 7f5777f36740 1 --2- 172.21.15.33:0/3591393019 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c6ab03c370 0x55c6ab053df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:57.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.796+0000 7f5777f36740 1 --2- 172.21.15.33:0/3591393019 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c6ab032b40 0x55c6ab0538b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:57.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.796+0000 7f5777f36740 1 --2- 172.21.15.33:0/3591393019 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6ab0315d0 0x55c6ab048340 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:57.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.796+0000 7f5777f36740 1 -- 172.21.15.33:0/3591393019 >> 172.21.15.33:0/3591393019 conn(0x55c6aaffa310 msgr2=0x55c6ab0380c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:31:57.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.797+0000 7f5777f36740 1 -- 172.21.15.33:0/3591393019 shutdown_connections 2024-09-12T12:31:57.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.797+0000 7f5777f36740 1 -- 172.21.15.33:0/3591393019 wait complete. 2024-09-12T12:31:57.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.797+0000 7f5777f36740 1 -- start start 2024-09-12T12:31:57.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.798+0000 7f5777f36740 1 Processor -- start 2024-09-12T12:31:57.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.798+0000 7f5777f36740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c6ab0315d0 0x55c6ab0405e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:57.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.799+0000 7f576ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c6ab0315d0 0x55c6ab0405e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:57.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.799+0000 7f5777f36740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6ab032b40 0x55c6ab040b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:57.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.799+0000 7f5777f36740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c6ab03c370 0x55c6ab0b5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:57.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.799+0000 7f5777f36740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5770118a60 con 0x55c6ab0315d0 2024-09-12T12:31:57.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.799+0000 7f5777f36740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f57701c5ab0 con 0x55c6ab03c370 2024-09-12T12:31:57.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.799+0000 7f576ffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c6ab03c370 0x55c6ab0b5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:57.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.799+0000 7f576ffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c6ab03c370 0x55c6ab0b5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:51458/0 (socket says 172.21.15.33:51458) 2024-09-12T12:31:57.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.799+0000 7f576ffff640 1 -- 172.21.15.33:0/2112419799 learned_addr learned my addr 172.21.15.33:0/2112419799 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:31:57.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.800+0000 7f5777f36740 1 -- 172.21.15.33:0/2112419799 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f57701c4d10 con 0x55c6ab032b40 2024-09-12T12:31:57.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.800+0000 7f5777f36740 10 client.0 _ll_register_callbacks cb 0x7f5768009cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:31:57.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.801+0000 7f576effd640 1 --2- 172.21.15.33:0/2112419799 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6ab032b40 0x55c6ab040b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:57.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.805+0000 7f576effd640 1 -- 172.21.15.33:0/2112419799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c6ab03c370 msgr2=0x55c6ab0b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:31:57.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.805+0000 7f576effd640 1 --2- 172.21.15.33:0/2112419799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c6ab03c370 0x55c6ab0b5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:57.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.805+0000 7f576effd640 1 -- 172.21.15.33:0/2112419799 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c6ab0315d0 msgr2=0x55c6ab0405e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:31:57.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.805+0000 7f576effd640 1 --2- 172.21.15.33:0/2112419799 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c6ab0315d0 0x55c6ab0405e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:57.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.805+0000 7f576effd640 1 -- 172.21.15.33:0/2112419799 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6ab0b5dc0 con 0x55c6ab032b40 2024-09-12T12:31:57.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.807+0000 7f576ffff640 1 --2- 172.21.15.33:0/2112419799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c6ab03c370 0x55c6ab0b5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:31:57.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.807+0000 7f576effd640 1 --2- 172.21.15.33:0/2112419799 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6ab032b40 0x55c6ab040b20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5764009780 tx=0x7f5764005870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=756e5bae6ad28ca4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:31:57.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.807+0000 7f574effd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:31:57.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.808+0000 7f574effd640 1 -- 172.21.15.33:0/2112419799 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5764037040 con 0x55c6ab032b40 2024-09-12T12:31:57.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.808+0000 7f5777f36740 1 -- 172.21.15.33:0/2112419799 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f576802b070 con 0x55c6ab032b40 2024-09-12T12:31:57.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.808+0000 7f574effd640 1 -- 172.21.15.33:0/2112419799 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f5764030450 con 0x55c6ab032b40 2024-09-12T12:31:57.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.808+0000 7f574effd640 1 -- 172.21.15.33:0/2112419799 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f57640044c0 con 0x55c6ab032b40 2024-09-12T12:31:57.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.808+0000 7f5777f36740 10 client.25588 fetch_fsmap learned FSMap version 27 2024-09-12T12:31:57.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.808+0000 7f5777f36740 1 -- 172.21.15.33:0/2112419799 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c6ab0b6ff0 con 0x55c6ab032b40 2024-09-12T12:31:57.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.812+0000 7f574effd640 1 -- 172.21.15.33:0/2112419799 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f576802b070 con 0x55c6ab032b40 2024-09-12T12:31:57.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.813+0000 7f574effd640 1 -- 172.21.15.33:0/2112419799 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f57640048b0 con 0x55c6ab032b40 2024-09-12T12:31:57.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.814+0000 7f5777f36740 10 client.25588 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:31:57.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.814+0000 7f5777f36740 10 client.25588 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-12T12:31:57.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.814+0000 7f5777f36740 20 client.25588 populate_metadata read hostname 'smithi033' 2024-09-12T12:31:57.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.814+0000 7f5777f36740 1 --2- 172.21.15.33:0/2112419799 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x55c6ab0b7770 0x55c6ab0b9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:31:57.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.814+0000 7f5777f36740 4 client.25588 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:31:57.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.814+0000 7f5777f36740 1 -- 172.21.15.33:0/2112419799 --> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c6aaf9ed70 con 0x55c6ab0b7770 2024-09-12T12:31:57.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.818+0000 7f576ffff640 1 --2- 172.21.15.33:0/2112419799 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x55c6ab0b7770 0x55c6ab0b9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:31:57.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.831+0000 7f574effd640 10 client.25588 ms_handle_connect on v2:172.21.15.102:6836/2409953270 2024-09-12T12:31:57.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.831+0000 7f576ffff640 1 --2- 172.21.15.33:0/2112419799 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x55c6ab0b7770 0x55c6ab0b9b90 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=302654c30874fe0e server_cookie=f5235d8d751c40fd in_seq=0 out_seq=0 2024-09-12T12:31:57.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.833+0000 7f574effd640 1 -- 172.21.15.33:0/2112419799 <== mds.1 v2:172.21.15.102:6836/2409953270 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c6aaf9ed70 con 0x55c6ab0b7770 2024-09-12T12:31:57.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.833+0000 7f574effd640 10 client.25588 handle_command_reply: tid=0 2024-09-12T12:31:57.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.833+0000 7f5777f36740 1 client.25588 shutdown 2024-09-12T12:31:57.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.834+0000 7f5777f36740 1 -- 172.21.15.33:0/2112419799 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6ab032b40 msgr2=0x55c6ab040b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:57.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.834+0000 7f5777f36740 1 --2- 172.21.15.33:0/2112419799 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6ab032b40 0x55c6ab040b20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5764009780 tx=0x7f5764005870 comp rx=0 tx=0).stop 2024-09-12T12:31:57.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.834+0000 7f5777f36740 1 -- 172.21.15.33:0/2112419799 shutdown_connections 2024-09-12T12:31:57.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.834+0000 7f5777f36740 1 --2- 172.21.15.33:0/2112419799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c6ab03c370 0x55c6ab0b5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:57.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.834+0000 7f5777f36740 1 --2- 172.21.15.33:0/2112419799 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x55c6ab0b7770 0x55c6ab0b9b90 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:57.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.834+0000 7f5777f36740 1 --2- 172.21.15.33:0/2112419799 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6ab032b40 0x55c6ab040b20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:57.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.834+0000 7f5777f36740 1 --2- 172.21.15.33:0/2112419799 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c6ab0315d0 0x55c6ab0405e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:57.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.834+0000 7f5777f36740 1 -- 172.21.15.33:0/2112419799 >> 172.21.15.33:0/2112419799 conn(0x55c6aaffa310 msgr2=0x55c6ab02c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:31:57.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.834+0000 7f574effd640 0 client.25588 ms_handle_reset on v2:172.21.15.102:6836/2409953270 2024-09-12T12:31:57.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.837+0000 7f5777f36740 1 -- 172.21.15.33:0/2112419799 shutdown_connections 2024-09-12T12:31:57.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.837+0000 7f5777f36740 1 -- 172.21.15.33:0/2112419799 wait complete. 2024-09-12T12:31:57.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.837+0000 7f5777f36740 20 client.25588 trim_cache size 0 max 16384 2024-09-12T12:31:57.838 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-09-12T12:31:57.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.838+0000 7f5775b5d640 1 -- 172.21.15.33:0/2930193045 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f57580a2c80 msgr2=0x7f57580a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:57.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.838+0000 7f5775b5d640 1 --2- 172.21.15.33:0/2930193045 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f57580a2c80 0x7f57580a5140 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f576009b230 tx=0x7f576009b070 comp rx=0 tx=0).stop 2024-09-12T12:31:57.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.838+0000 7f5775b5d640 1 -- 172.21.15.33:0/2930193045 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5770109450 msgr2=0x7f57701a7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:31:57.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.838+0000 7f5775b5d640 1 --2- 172.21.15.33:0/2930193045 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5770109450 0x7f57701a7180 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f576000d950 tx=0x7f576000de10 comp rx=0 tx=0).stop 2024-09-12T12:31:57.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.839+0000 7f5775b5d640 1 -- 172.21.15.33:0/2930193045 shutdown_connections 2024-09-12T12:31:57.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.839+0000 7f5775b5d640 1 --2- 172.21.15.33:0/2930193045 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f57580a2c80 0x7f57580a5140 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:57.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.839+0000 7f5775b5d640 1 --2- 172.21.15.33:0/2930193045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f577011b140 0x7f57701aba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:57.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.839+0000 7f5775b5d640 1 --2- 172.21.15.33:0/2930193045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5770109830 0x7f57701a76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:57.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.839+0000 7f5775b5d640 1 --2- 172.21.15.33:0/2930193045 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5770109450 0x7f57701a7180 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:31:57.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.839+0000 7f5775b5d640 1 -- 172.21.15.33:0/2930193045 >> 172.21.15.33:0/2930193045 conn(0x7f577006e140 msgr2=0x7f577011c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:31:57.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.842+0000 7f5775b5d640 1 -- 172.21.15.33:0/2930193045 shutdown_connections 2024-09-12T12:31:57.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:31:57.842+0000 7f5775b5d640 1 -- 172.21.15.33:0/2930193045 wait complete. 2024-09-12T12:31:58.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:31:57 smithi043 ceph-mon[34144]: pgmap v528: 129 pgs: 129 active+clean; 10 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 33 MiB/s wr, 537 op/s 2024-09-12T12:31:58.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:31:57 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:31:58.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:31:57 smithi102 ceph-mon[34799]: pgmap v528: 129 pgs: 129 active+clean; 10 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 33 MiB/s wr, 537 op/s 2024-09-12T12:31:58.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:31:57 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:31:58.731 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T12:31:58.983 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:31:58 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:31:58.983 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:31:58 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:31:58.983 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:31:58 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:31:59.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:31:58 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:31:59.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:31:58 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:31:59.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:31:58 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:31:59.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:31:58 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:31:59.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:31:58 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:31:59.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:31:58 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:31:59.451 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:31:59.964 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:31:59 smithi033 ceph-mon[31246]: pgmap v529: 129 pgs: 129 active+clean; 10 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 781 KiB/s rd, 44 MiB/s wr, 722 op/s 2024-09-12T12:32:00.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:31:59 smithi043 ceph-mon[34144]: pgmap v529: 129 pgs: 129 active+clean; 10 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 781 KiB/s rd, 44 MiB/s wr, 722 op/s 2024-09-12T12:32:00.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:31:59 smithi102 ceph-mon[34799]: pgmap v529: 129 pgs: 129 active+clean; 10 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 781 KiB/s rd, 44 MiB/s wr, 722 op/s 2024-09-12T12:32:00.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.452+0000 7f03c9ce7640 1 -- 172.21.15.33:0/3720904543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03c4109e00 msgr2=0x7f03c40742d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:00.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.452+0000 7f03c9ce7640 1 --2- 172.21.15.33:0/3720904543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03c4109e00 0x7f03c40742d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f03b400b880 tx=0x7f03b4005f90 comp rx=0 tx=0).stop 2024-09-12T12:32:00.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.452+0000 7f03c9ce7640 1 -- 172.21.15.33:0/3720904543 shutdown_connections 2024-09-12T12:32:00.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.452+0000 7f03c9ce7640 1 --2- 172.21.15.33:0/3720904543 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03c4074990 0x7f03c407b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:00.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.452+0000 7f03c9ce7640 1 --2- 172.21.15.33:0/3720904543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03c4109e00 0x7f03c40742d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:00.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.452+0000 7f03c9ce7640 1 --2- 172.21.15.33:0/3720904543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03c4109450 0x7f03c4109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:00.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.452+0000 7f03c9ce7640 1 -- 172.21.15.33:0/3720904543 >> 172.21.15.33:0/3720904543 conn(0x7f03c406e140 msgr2=0x7f03c406e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:32:00.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.458+0000 7f03c9ce7640 1 -- 172.21.15.33:0/3720904543 shutdown_connections 2024-09-12T12:32:00.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.459+0000 7f03c9ce7640 1 -- 172.21.15.33:0/3720904543 wait complete. 2024-09-12T12:32:00.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.460+0000 7f03c9ce7640 1 Processor -- start 2024-09-12T12:32:00.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.460+0000 7f03c9ce7640 1 -- start start 2024-09-12T12:32:00.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.460+0000 7f03c9ce7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03c4074990 0x7f03c4084900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:00.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.460+0000 7f03c9ce7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03c4109450 0x7f03c4084e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:00.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.460+0000 7f03c9ce7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03c407fa70 0x7f03c407ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:00.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.460+0000 7f03c9ce7640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f03c407e630 con 0x7f03c4074990 2024-09-12T12:32:00.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.460+0000 7f03c9ce7640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f03c407e4b0 con 0x7f03c407fa70 2024-09-12T12:32:00.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.460+0000 7f03c9ce7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f03c407e7b0 con 0x7f03c4109450 2024-09-12T12:32:00.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.460+0000 7f03c37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03c4074990 0x7f03c4084900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:00.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.461+0000 7f03c37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03c4074990 0x7f03c4084900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58702/0 (socket says 172.21.15.33:58702) 2024-09-12T12:32:00.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.461+0000 7f03c37fe640 1 -- 172.21.15.33:0/6902019 learned_addr learned my addr 172.21.15.33:0/6902019 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:32:00.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.461+0000 7f03c3fff640 1 --2- 172.21.15.33:0/6902019 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03c407fa70 0x7f03c407ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:00.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.461+0000 7f03c3fff640 1 -- 172.21.15.33:0/6902019 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03c4109450 msgr2=0x7f03c4084e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:00.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.461+0000 7f03c3fff640 1 --2- 172.21.15.33:0/6902019 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03c4109450 0x7f03c4084e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:00.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.461+0000 7f03c3fff640 1 -- 172.21.15.33:0/6902019 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03c4074990 msgr2=0x7f03c4084900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:00.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.461+0000 7f03c3fff640 1 --2- 172.21.15.33:0/6902019 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03c4074990 0x7f03c4084900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:00.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.461+0000 7f03c3fff640 1 -- 172.21.15.33:0/6902019 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03c41bbfa0 con 0x7f03c407fa70 2024-09-12T12:32:00.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.462+0000 7f03c3fff640 1 --2- 172.21.15.33:0/6902019 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03c407fa70 0x7f03c407ff20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f03b8011ae0 tx=0x7f03b800be50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:32:00.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.463+0000 7f03c0ff9640 1 -- 172.21.15.33:0/6902019 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b800fa80 con 0x7f03c407fa70 2024-09-12T12:32:00.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.463+0000 7f03c9ce7640 1 -- 172.21.15.33:0/6902019 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03c41bc170 con 0x7f03c407fa70 2024-09-12T12:32:00.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.463+0000 7f03c9ce7640 1 -- 172.21.15.33:0/6902019 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03c41bc5c0 con 0x7f03c407fa70 2024-09-12T12:32:00.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.463+0000 7f03c0ff9640 1 -- 172.21.15.33:0/6902019 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f03b80054d0 con 0x7f03c407fa70 2024-09-12T12:32:00.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.463+0000 7f03c0ff9640 1 -- 172.21.15.33:0/6902019 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b8004e50 con 0x7f03c407fa70 2024-09-12T12:32:00.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.467+0000 7f03c0ff9640 1 -- 172.21.15.33:0/6902019 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f03b8019480 con 0x7f03c407fa70 2024-09-12T12:32:00.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.468+0000 7f03c0ff9640 1 --2- 172.21.15.33:0/6902019 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f03ac0a2e60 0x7f03ac0a5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:00.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.468+0000 7f03c0ff9640 1 -- 172.21.15.33:0/6902019 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f03b80d2be0 con 0x7f03c407fa70 2024-09-12T12:32:00.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.468+0000 7f03c37fe640 1 --2- 172.21.15.33:0/6902019 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f03ac0a2e60 0x7f03ac0a5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:00.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.469+0000 7f03c37fe640 1 --2- 172.21.15.33:0/6902019 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f03ac0a2e60 0x7f03ac0a5320 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f03bc007e40 tx=0x7f03bc009040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:32:00.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.471+0000 7f03cc0c0740 1 Processor -- start 2024-09-12T12:32:00.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.471+0000 7f03cc0c0740 1 -- start start 2024-09-12T12:32:00.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.474+0000 7f03cc0c0740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56164e2d3b40 0x56164e2d2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:00.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.474+0000 7f03cc0c0740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56164e2d25d0 0x56164e2d2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:00.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.474+0000 7f03cc0c0740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56164e2dd370 0x56164e2df760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:00.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.474+0000 7f03cc0c0740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56164e2382f0 con 0x56164e2dd370 2024-09-12T12:32:00.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.474+0000 7f03cc0c0740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56164e1dfcf0 con 0x56164e2d3b40 2024-09-12T12:32:00.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.474+0000 7f03cc0c0740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56164e2342b0 con 0x56164e2d25d0 2024-09-12T12:32:00.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.474+0000 7f03c37fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56164e2d3b40 0x56164e2d2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:00.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.474+0000 7f03c37fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56164e2d3b40 0x56164e2d2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:42912/0 (socket says 172.21.15.33:42912) 2024-09-12T12:32:00.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.474+0000 7f03c37fe640 1 -- 172.21.15.33:0/1578206675 learned_addr learned my addr 172.21.15.33:0/1578206675 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:32:00.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.475+0000 7f03c37fe640 1 -- 172.21.15.33:0/1578206675 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56164e2d25d0 msgr2=0x56164e2d2a10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:32:00.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.475+0000 7f03c37fe640 1 --2- 172.21.15.33:0/1578206675 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56164e2d25d0 0x56164e2d2a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:00.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.475+0000 7f03c37fe640 1 -- 172.21.15.33:0/1578206675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56164e2dd370 msgr2=0x56164e2df760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:00.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.475+0000 7f03c37fe640 1 --2- 172.21.15.33:0/1578206675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56164e2dd370 0x56164e2df760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:00.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.475+0000 7f03c37fe640 1 -- 172.21.15.33:0/1578206675 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56164e1c43a0 con 0x56164e2d3b40 2024-09-12T12:32:00.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.475+0000 7f03c37fe640 1 --2- 172.21.15.33:0/1578206675 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56164e2d3b40 0x56164e2d2090 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f03bc00ff40 tx=0x7f03bc012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55a908b0425032fc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:32:00.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.476+0000 7f03a9ffb640 1 -- 172.21.15.33:0/1578206675 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03bc026070 con 0x56164e2d3b40 2024-09-12T12:32:00.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.476+0000 7f03a9ffb640 1 -- 172.21.15.33:0/1578206675 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f03bc014c80 con 0x56164e2d3b40 2024-09-12T12:32:00.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.476+0000 7f03a9ffb640 1 -- 172.21.15.33:0/1578206675 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03bc021c50 con 0x56164e2d3b40 2024-09-12T12:32:00.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.479+0000 7f03cc0c0740 1 -- 172.21.15.33:0/1578206675 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56164e2d3b40 msgr2=0x56164e2d2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:00.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.479+0000 7f03cc0c0740 1 --2- 172.21.15.33:0/1578206675 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56164e2d3b40 0x56164e2d2090 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f03bc00ff40 tx=0x7f03bc012000 comp rx=0 tx=0).stop 2024-09-12T12:32:00.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.479+0000 7f03cc0c0740 1 -- 172.21.15.33:0/1578206675 shutdown_connections 2024-09-12T12:32:00.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.479+0000 7f03cc0c0740 1 --2- 172.21.15.33:0/1578206675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56164e2dd370 0x56164e2df760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:00.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.479+0000 7f03cc0c0740 1 --2- 172.21.15.33:0/1578206675 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56164e2d25d0 0x56164e2d2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:00.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.479+0000 7f03cc0c0740 1 --2- 172.21.15.33:0/1578206675 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56164e2d3b40 0x56164e2d2090 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:00.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.479+0000 7f03cc0c0740 1 -- 172.21.15.33:0/1578206675 >> 172.21.15.33:0/1578206675 conn(0x56164e29b310 msgr2=0x56164e2cec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:32:00.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.480+0000 7f03cc0c0740 1 -- 172.21.15.33:0/1578206675 shutdown_connections 2024-09-12T12:32:00.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.481+0000 7f03cc0c0740 1 -- 172.21.15.33:0/1578206675 wait complete. 2024-09-12T12:32:00.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.481+0000 7f03cc0c0740 1 -- start start 2024-09-12T12:32:00.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.482+0000 7f03cc0c0740 1 Processor -- start 2024-09-12T12:32:00.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.482+0000 7f03cc0c0740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56164e2d25d0 0x56164e2dce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:00.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.482+0000 7f03cc0c0740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56164e2d3b40 0x56164e2da0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:00.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.482+0000 7f03cc0c0740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56164e2dd370 0x56164e2da870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:00.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.482+0000 7f03cc0c0740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56164e2e0070 con 0x56164e2dd370 2024-09-12T12:32:00.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.482+0000 7f03cc0c0740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56164e1f3060 con 0x56164e2d25d0 2024-09-12T12:32:00.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.482+0000 7f03cc0c0740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56164e2e01f0 con 0x56164e2d3b40 2024-09-12T12:32:00.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.482+0000 7f03cc0c0740 10 client.0 _ll_register_callbacks cb 0x56164df468c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:32:00.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.483+0000 7f03c37fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56164e2d25d0 0x56164e2dce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:00.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.483+0000 7f03c37fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56164e2d25d0 0x56164e2dce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:42926/0 (socket says 172.21.15.33:42926) 2024-09-12T12:32:00.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.483+0000 7f03c37fe640 1 -- 172.21.15.33:0/3527277211 learned_addr learned my addr 172.21.15.33:0/3527277211 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:32:00.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.483+0000 7f03c2ffd640 1 --2- 172.21.15.33:0/3527277211 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56164e2d3b40 0x56164e2da0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:00.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.484+0000 7f03c37fe640 1 -- 172.21.15.33:0/3527277211 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56164e2d3b40 msgr2=0x56164e2da0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:00.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.484+0000 7f03c37fe640 1 --2- 172.21.15.33:0/3527277211 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56164e2d3b40 0x56164e2da0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:00.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.484+0000 7f03c37fe640 1 -- 172.21.15.33:0/3527277211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56164e2dd370 msgr2=0x56164e2da870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:00.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.484+0000 7f03c37fe640 1 --2- 172.21.15.33:0/3527277211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56164e2dd370 0x56164e2da870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:00.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.484+0000 7f03c37fe640 1 -- 172.21.15.33:0/3527277211 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56164dfa93c0 con 0x56164e2d25d0 2024-09-12T12:32:00.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.484+0000 7f03c37fe640 1 --2- 172.21.15.33:0/3527277211 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56164e2d25d0 0x56164e2dce30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f03bc005bd0 tx=0x7f03bc021ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a675cae264f89af server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:32:00.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.487+0000 7f03a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:32:00.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.487+0000 7f03a2ffd640 1 -- 172.21.15.33:0/3527277211 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03bc031060 con 0x56164e2d25d0 2024-09-12T12:32:00.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.487+0000 7f03a2ffd640 1 -- 172.21.15.33:0/3527277211 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f03bc004c40 con 0x56164e2d25d0 2024-09-12T12:32:00.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.487+0000 7f03cc0c0740 1 -- 172.21.15.33:0/3527277211 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03bc014c80 con 0x56164e2d25d0 2024-09-12T12:32:00.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.488+0000 7f03a2ffd640 1 -- 172.21.15.33:0/3527277211 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f03bc026040 con 0x56164e2d25d0 2024-09-12T12:32:00.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.489+0000 7f03cc0c0740 10 client.25514 fetch_fsmap learned FSMap version 27 2024-09-12T12:32:00.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.489+0000 7f03cc0c0740 1 -- 172.21.15.33:0/3527277211 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56164e2f4480 con 0x56164e2d25d0 2024-09-12T12:32:00.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.489+0000 7f03a2ffd640 1 -- 172.21.15.33:0/3527277211 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f03bc014c80 con 0x56164e2d25d0 2024-09-12T12:32:00.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.489+0000 7f03a2ffd640 1 -- 172.21.15.33:0/3527277211 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f03bc005540 con 0x56164e2d25d0 2024-09-12T12:32:00.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.490+0000 7f03cc0c0740 10 client.25514 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:32:00.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.490+0000 7f03cc0c0740 10 client.25514 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:32:00.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.490+0000 7f03cc0c0740 20 client.25514 populate_metadata read hostname 'smithi033' 2024-09-12T12:32:00.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.491+0000 7f03cc0c0740 1 --2- 172.21.15.33:0/3527277211 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x56164e2f5ba0 0x56164e2f8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:00.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.491+0000 7f03cc0c0740 4 client.25514 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:32:00.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.491+0000 7f03cc0c0740 1 -- 172.21.15.33:0/3527277211 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56164e245860 con 0x56164e2f5ba0 2024-09-12T12:32:00.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.491+0000 7f03c2ffd640 1 --2- 172.21.15.33:0/3527277211 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x56164e2f5ba0 0x56164e2f8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:00.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.493+0000 7f03c2ffd640 1 --2- 172.21.15.33:0/3527277211 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x56164e2f5ba0 0x56164e2f8000 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=174a51d6435cc50c server_cookie=47c0f67a7be93f1c in_seq=0 out_seq=0 2024-09-12T12:32:00.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.494+0000 7f03a2ffd640 10 client.25514 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:32:00.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.494+0000 7f03a2ffd640 1 -- 172.21.15.33:0/3527277211 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56164e245860 con 0x56164e2f5ba0 2024-09-12T12:32:00.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.494+0000 7f03a2ffd640 10 client.25514 handle_command_reply: tid=0 2024-09-12T12:32:00.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.494+0000 7f03cc0c0740 1 client.25514 shutdown 2024-09-12T12:32:00.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.500+0000 7f03cc0c0740 1 -- 172.21.15.33:0/3527277211 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56164e2d25d0 msgr2=0x56164e2dce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:00.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.500+0000 7f03cc0c0740 1 --2- 172.21.15.33:0/3527277211 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56164e2d25d0 0x56164e2dce30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f03bc005bd0 tx=0x7f03bc021ba0 comp rx=0 tx=0).stop 2024-09-12T12:32:00.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.500+0000 7f03cc0c0740 1 -- 172.21.15.33:0/3527277211 shutdown_connections 2024-09-12T12:32:00.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.500+0000 7f03cc0c0740 1 --2- 172.21.15.33:0/3527277211 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x56164e2f5ba0 0x56164e2f8000 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:00.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.500+0000 7f03cc0c0740 1 --2- 172.21.15.33:0/3527277211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56164e2dd370 0x56164e2da870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:00.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.500+0000 7f03cc0c0740 1 --2- 172.21.15.33:0/3527277211 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56164e2d3b40 0x56164e2da0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:00.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.500+0000 7f03cc0c0740 1 --2- 172.21.15.33:0/3527277211 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56164e2d25d0 0x56164e2dce30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:00.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.500+0000 7f03cc0c0740 1 -- 172.21.15.33:0/3527277211 >> 172.21.15.33:0/3527277211 conn(0x56164e29b310 msgr2=0x56164e2d4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:32:00.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.500+0000 7f03a2ffd640 0 client.25514 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:32:00.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.501+0000 7f03cc0c0740 1 -- 172.21.15.33:0/3527277211 shutdown_connections 2024-09-12T12:32:00.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.501+0000 7f03cc0c0740 1 -- 172.21.15.33:0/3527277211 wait complete. 2024-09-12T12:32:00.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.503+0000 7f03cc0c0740 20 client.25514 trim_cache size 0 max 16384 2024-09-12T12:32:00.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.530+0000 7f03cc0c0740 1 Processor -- start 2024-09-12T12:32:00.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.533+0000 7f03cc0c0740 1 -- start start 2024-09-12T12:32:00.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.533+0000 7f03cc0c0740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56164e2d3b40 0x56164e2cee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:00.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.533+0000 7f03cc0c0740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56164e2dd370 0x56164e2d99a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:00.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.533+0000 7f03cc0c0740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56164e2d9ee0 0x56164e2fd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:00.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.533+0000 7f03cc0c0740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f03b0012530 con 0x56164e2d3b40 2024-09-12T12:32:00.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.533+0000 7f03cc0c0740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f03b000fe00 con 0x56164e2dd370 2024-09-12T12:32:00.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.533+0000 7f03cc0c0740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f03b000dc50 con 0x56164e2d9ee0 2024-09-12T12:32:00.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.533+0000 7f03c2ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56164e2dd370 0x56164e2d99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:00.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.533+0000 7f03c2ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56164e2dd370 0x56164e2d99a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:42940/0 (socket says 172.21.15.33:42940) 2024-09-12T12:32:00.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.533+0000 7f03c2ffd640 1 -- 172.21.15.33:0/2099471407 learned_addr learned my addr 172.21.15.33:0/2099471407 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:32:00.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.533+0000 7f03c3fff640 1 --2- 172.21.15.33:0/2099471407 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56164e2d9ee0 0x56164e2fd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:00.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.534+0000 7f03c3fff640 1 -- 172.21.15.33:0/2099471407 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56164e2dd370 msgr2=0x56164e2d99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:00.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.534+0000 7f03c3fff640 1 --2- 172.21.15.33:0/2099471407 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56164e2dd370 0x56164e2d99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:00.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.534+0000 7f03c3fff640 1 -- 172.21.15.33:0/2099471407 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56164e2d3b40 msgr2=0x56164e2cee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:00.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.534+0000 7f03c3fff640 1 --2- 172.21.15.33:0/2099471407 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56164e2d3b40 0x56164e2cee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:00.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.534+0000 7f03c3fff640 1 -- 172.21.15.33:0/2099471407 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56164e2cf960 con 0x56164e2d9ee0 2024-09-12T12:32:00.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.535+0000 7f03c3fff640 1 --2- 172.21.15.33:0/2099471407 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56164e2d9ee0 0x56164e2fd910 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x56164e2d3070 tx=0x7f03b809f890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a97a99ceba413f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:32:00.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.535+0000 7f03a97fa640 1 -- 172.21.15.33:0/2099471407 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b809d0f0 con 0x56164e2d9ee0 2024-09-12T12:32:00.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.536+0000 7f03a97fa640 1 -- 172.21.15.33:0/2099471407 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f03b809d350 con 0x56164e2d9ee0 2024-09-12T12:32:00.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.536+0000 7f03a97fa640 1 -- 172.21.15.33:0/2099471407 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b809f510 con 0x56164e2d9ee0 2024-09-12T12:32:00.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.536+0000 7f03cc0c0740 1 -- 172.21.15.33:0/2099471407 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56164e2d9ee0 msgr2=0x56164e2fd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:00.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.536+0000 7f03cc0c0740 1 --2- 172.21.15.33:0/2099471407 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56164e2d9ee0 0x56164e2fd910 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x56164e2d3070 tx=0x7f03b809f890 comp rx=0 tx=0).stop 2024-09-12T12:32:00.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.539+0000 7f03cc0c0740 1 -- 172.21.15.33:0/2099471407 shutdown_connections 2024-09-12T12:32:00.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.539+0000 7f03cc0c0740 1 --2- 172.21.15.33:0/2099471407 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56164e2d9ee0 0x56164e2fd910 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:00.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.539+0000 7f03cc0c0740 1 --2- 172.21.15.33:0/2099471407 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56164e2dd370 0x56164e2d99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:00.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.539+0000 7f03cc0c0740 1 --2- 172.21.15.33:0/2099471407 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56164e2d3b40 0x56164e2cee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:00.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.539+0000 7f03cc0c0740 1 -- 172.21.15.33:0/2099471407 >> 172.21.15.33:0/2099471407 conn(0x56164e29b310 msgr2=0x56164e2ce700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:32:00.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.541+0000 7f03cc0c0740 1 -- 172.21.15.33:0/2099471407 shutdown_connections 2024-09-12T12:32:00.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.543+0000 7f03cc0c0740 1 -- 172.21.15.33:0/2099471407 wait complete. 2024-09-12T12:32:00.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.544+0000 7f03cc0c0740 1 -- start start 2024-09-12T12:32:00.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.545+0000 7f03cc0c0740 1 Processor -- start 2024-09-12T12:32:00.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.545+0000 7f03cc0c0740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56164e2d3b40 0x56164e2e9520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:00.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.545+0000 7f03cc0c0740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56164e2d9ee0 0x56164e2e9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:00.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.546+0000 7f03c37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56164e2d3b40 0x56164e2e9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:00.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.546+0000 7f03c37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56164e2d3b40 0x56164e2e9520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:37278/0 (socket says 172.21.15.33:37278) 2024-09-12T12:32:00.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.546+0000 7f03c37fe640 1 -- 172.21.15.33:0/3873758342 learned_addr learned my addr 172.21.15.33:0/3873758342 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:32:00.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.546+0000 7f03cc0c0740 1 --2- 172.21.15.33:0/3873758342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56164e2dd370 0x56164e3588a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:00.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.546+0000 7f03cc0c0740 1 -- 172.21.15.33:0/3873758342 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f03b000e2c0 con 0x56164e2d9ee0 2024-09-12T12:32:00.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.546+0000 7f03cc0c0740 1 -- 172.21.15.33:0/3873758342 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f03b000f730 con 0x56164e2dd370 2024-09-12T12:32:00.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.546+0000 7f03c3fff640 1 --2- 172.21.15.33:0/3873758342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56164e2dd370 0x56164e3588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:00.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.546+0000 7f03cc0c0740 1 -- 172.21.15.33:0/3873758342 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f03b000e990 con 0x56164e2d3b40 2024-09-12T12:32:00.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.547+0000 7f03cc0c0740 10 client.0 _ll_register_callbacks cb 0x7f03bc021f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:32:00.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.547+0000 7f03c37fe640 1 -- 172.21.15.33:0/3873758342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56164e2dd370 msgr2=0x56164e3588a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:00.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.547+0000 7f03c37fe640 1 --2- 172.21.15.33:0/3873758342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56164e2dd370 0x56164e3588a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:00.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.547+0000 7f03c37fe640 1 -- 172.21.15.33:0/3873758342 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56164e2d9ee0 msgr2=0x56164e2e9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:00.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.547+0000 7f03c37fe640 1 --2- 172.21.15.33:0/3873758342 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56164e2d9ee0 0x56164e2e9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:00.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.547+0000 7f03c37fe640 1 -- 172.21.15.33:0/3873758342 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56164e358f10 con 0x56164e2d3b40 2024-09-12T12:32:00.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.547+0000 7f03c37fe640 1 --2- 172.21.15.33:0/3873758342 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56164e2d3b40 0x56164e2e9520 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f03bc016c70 tx=0x7f03bc005ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=371e05dfcbb00e96 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:32:00.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.547+0000 7f03a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:32:00.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.547+0000 7f03a2ffd640 1 -- 172.21.15.33:0/3873758342 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03bc031040 con 0x56164e2d3b40 2024-09-12T12:32:00.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.548+0000 7f03a2ffd640 1 -- 172.21.15.33:0/3873758342 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f03bc00fa20 con 0x56164e2d3b40 2024-09-12T12:32:00.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.548+0000 7f03cc0c0740 1 -- 172.21.15.33:0/3873758342 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03b809d350 con 0x56164e2d3b40 2024-09-12T12:32:00.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.548+0000 7f03a2ffd640 1 -- 172.21.15.33:0/3873758342 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f03bc03b080 con 0x56164e2d3b40 2024-09-12T12:32:00.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.548+0000 7f03cc0c0740 10 client.25600 fetch_fsmap learned FSMap version 27 2024-09-12T12:32:00.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.548+0000 7f03cc0c0740 1 -- 172.21.15.33:0/3873758342 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56164e360230 con 0x56164e2d3b40 2024-09-12T12:32:00.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.549+0000 7f03a2ffd640 1 -- 172.21.15.33:0/3873758342 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f03bc02cd00 con 0x56164e2d3b40 2024-09-12T12:32:00.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.549+0000 7f03a2ffd640 1 -- 172.21.15.33:0/3873758342 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f03bc0145d0 con 0x56164e2d3b40 2024-09-12T12:32:00.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.549+0000 7f03cc0c0740 10 client.25600 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:32:00.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.549+0000 7f03cc0c0740 10 client.25600 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:32:00.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.549+0000 7f03cc0c0740 20 client.25600 populate_metadata read hostname 'smithi033' 2024-09-12T12:32:00.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.549+0000 7f03cc0c0740 1 --2- 172.21.15.33:0/3873758342 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x56164e3608f0 0x56164e362d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:00.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.549+0000 7f03cc0c0740 4 client.25600 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:32:00.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.550+0000 7f03cc0c0740 1 -- 172.21.15.33:0/3873758342 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f03b809d350 con 0x56164e3608f0 2024-09-12T12:32:00.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.550+0000 7f03c2ffd640 1 --2- 172.21.15.33:0/3873758342 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x56164e3608f0 0x56164e362d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:00.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.553+0000 7f03c2ffd640 1 --2- 172.21.15.33:0/3873758342 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x56164e3608f0 0x56164e362d10 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2fe4872849397fa2 server_cookie=9163c52714bc52f3 in_seq=0 out_seq=0 2024-09-12T12:32:00.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.553+0000 7f03a2ffd640 10 client.25600 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:32:00.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.553+0000 7f03a2ffd640 1 -- 172.21.15.33:0/3873758342 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f03b809d350 con 0x56164e3608f0 2024-09-12T12:32:00.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.554+0000 7f03a2ffd640 10 client.25600 handle_command_reply: tid=0 2024-09-12T12:32:00.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.554+0000 7f03cc0c0740 1 client.25600 shutdown 2024-09-12T12:32:00.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.557+0000 7f03cc0c0740 1 -- 172.21.15.33:0/3873758342 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56164e2d3b40 msgr2=0x56164e2e9520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:00.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.557+0000 7f03cc0c0740 1 --2- 172.21.15.33:0/3873758342 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56164e2d3b40 0x56164e2e9520 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f03bc016c70 tx=0x7f03bc005ab0 comp rx=0 tx=0).stop 2024-09-12T12:32:00.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.557+0000 7f03cc0c0740 1 -- 172.21.15.33:0/3873758342 shutdown_connections 2024-09-12T12:32:00.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.557+0000 7f03cc0c0740 1 --2- 172.21.15.33:0/3873758342 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x56164e3608f0 0x56164e362d10 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:00.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.557+0000 7f03cc0c0740 1 --2- 172.21.15.33:0/3873758342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56164e2dd370 0x56164e3588a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:00.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.557+0000 7f03cc0c0740 1 --2- 172.21.15.33:0/3873758342 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56164e2d9ee0 0x56164e2e9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:00.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.557+0000 7f03cc0c0740 1 --2- 172.21.15.33:0/3873758342 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56164e2d3b40 0x56164e2e9520 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:00.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.557+0000 7f03cc0c0740 1 -- 172.21.15.33:0/3873758342 >> 172.21.15.33:0/3873758342 conn(0x56164e29b310 msgr2=0x56164e2cdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:32:00.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.558+0000 7f03a2ffd640 0 client.25600 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:32:00.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.558+0000 7f03cc0c0740 1 -- 172.21.15.33:0/3873758342 shutdown_connections 2024-09-12T12:32:00.561 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-09-12T12:32:00.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.558+0000 7f03cc0c0740 1 -- 172.21.15.33:0/3873758342 wait complete. 2024-09-12T12:32:00.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.558+0000 7f03cc0c0740 20 client.25600 trim_cache size 0 max 16384 2024-09-12T12:32:00.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.567+0000 7f03c9ce7640 1 -- 172.21.15.33:0/6902019 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f03ac0a2e60 msgr2=0x7f03ac0a5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:00.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.567+0000 7f03c9ce7640 1 --2- 172.21.15.33:0/6902019 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f03ac0a2e60 0x7f03ac0a5320 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f03bc007e40 tx=0x7f03bc009040 comp rx=0 tx=0).stop 2024-09-12T12:32:00.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.567+0000 7f03c9ce7640 1 -- 172.21.15.33:0/6902019 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03c407fa70 msgr2=0x7f03c407ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:00.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.567+0000 7f03c9ce7640 1 --2- 172.21.15.33:0/6902019 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03c407fa70 0x7f03c407ff20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f03b8011ae0 tx=0x7f03b800be50 comp rx=0 tx=0).stop 2024-09-12T12:32:00.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.567+0000 7f03c9ce7640 1 -- 172.21.15.33:0/6902019 shutdown_connections 2024-09-12T12:32:00.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.567+0000 7f03c9ce7640 1 --2- 172.21.15.33:0/6902019 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f03ac0a2e60 0x7f03ac0a5320 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:00.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.567+0000 7f03c9ce7640 1 --2- 172.21.15.33:0/6902019 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03c407fa70 0x7f03c407ff20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:00.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.567+0000 7f03c9ce7640 1 --2- 172.21.15.33:0/6902019 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03c4109450 0x7f03c4084e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:00.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.567+0000 7f03c9ce7640 1 --2- 172.21.15.33:0/6902019 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03c4074990 0x7f03c4084900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:00.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.567+0000 7f03c9ce7640 1 -- 172.21.15.33:0/6902019 >> 172.21.15.33:0/6902019 conn(0x7f03c406e140 msgr2=0x7f03c40720f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:32:00.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.567+0000 7f03c9ce7640 1 -- 172.21.15.33:0/6902019 shutdown_connections 2024-09-12T12:32:00.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:00.567+0000 7f03c9ce7640 1 -- 172.21.15.33:0/6902019 wait complete. 2024-09-12T12:32:01.681 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:01 smithi033 ceph-mon[31246]: pgmap v530: 129 pgs: 129 active+clean; 10 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 808 KiB/s rd, 36 MiB/s wr, 594 op/s 2024-09-12T12:32:02.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:01 smithi043 ceph-mon[34144]: pgmap v530: 129 pgs: 129 active+clean; 10 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 808 KiB/s rd, 36 MiB/s wr, 594 op/s 2024-09-12T12:32:02.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:01 smithi102 ceph-mon[34799]: pgmap v530: 129 pgs: 129 active+clean; 10 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 808 KiB/s rd, 36 MiB/s wr, 594 op/s 2024-09-12T12:32:02.473 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T12:32:02.473 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T12:32:03.218 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:32:03.686 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:03 smithi033 ceph-mon[31246]: pgmap v531: 129 pgs: 129 active+clean; 10 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 979 KiB/s rd, 39 MiB/s wr, 645 op/s 2024-09-12T12:32:04.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:03 smithi043 ceph-mon[34144]: pgmap v531: 129 pgs: 129 active+clean; 10 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 979 KiB/s rd, 39 MiB/s wr, 645 op/s 2024-09-12T12:32:04.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:03 smithi102 ceph-mon[34799]: pgmap v531: 129 pgs: 129 active+clean; 10 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 979 KiB/s rd, 39 MiB/s wr, 645 op/s 2024-09-12T12:32:05.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:05 smithi033 ceph-mon[31246]: pgmap v532: 129 pgs: 129 active+clean; 10 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 42 MiB/s wr, 702 op/s 2024-09-12T12:32:06.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:05 smithi043 ceph-mon[34144]: pgmap v532: 129 pgs: 129 active+clean; 10 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 42 MiB/s wr, 702 op/s 2024-09-12T12:32:06.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:05 smithi102 ceph-mon[34799]: pgmap v532: 129 pgs: 129 active+clean; 10 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 42 MiB/s wr, 702 op/s 2024-09-12T12:32:07.955 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:07 smithi033 ceph-mon[31246]: pgmap v533: 129 pgs: 129 active+clean; 10 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 37 MiB/s wr, 606 op/s 2024-09-12T12:32:08.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:07 smithi043 ceph-mon[34144]: pgmap v533: 129 pgs: 129 active+clean; 10 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 37 MiB/s wr, 606 op/s 2024-09-12T12:32:08.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:07 smithi102 ceph-mon[34799]: pgmap v533: 129 pgs: 129 active+clean; 10 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 37 MiB/s wr, 606 op/s 2024-09-12T12:32:08.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.954+0000 7f4dc27c5640 1 -- 172.21.15.33:0/4111776910 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4dbc10c170 msgr2=0x7f4dbc10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:08.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.954+0000 7f4dc27c5640 1 --2- 172.21.15.33:0/4111776910 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4dbc10c170 0x7f4dbc10e610 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4db4009ca0 tx=0x7f4db402a950 comp rx=0 tx=0).stop 2024-09-12T12:32:08.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.955+0000 7f4dc27c5640 1 -- 172.21.15.33:0/4111776910 shutdown_connections 2024-09-12T12:32:08.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.955+0000 7f4dc27c5640 1 --2- 172.21.15.33:0/4111776910 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4dbc10c170 0x7f4dbc10e610 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:08.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.955+0000 7f4dc27c5640 1 --2- 172.21.15.33:0/4111776910 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4dbc103660 0x7f4dbc10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:08.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.955+0000 7f4dc27c5640 1 --2- 172.21.15.33:0/4111776910 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4dbc102d40 0x7f4dbc103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:08.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.955+0000 7f4dc27c5640 1 -- 172.21.15.33:0/4111776910 >> 172.21.15.33:0/4111776910 conn(0x7f4dbc0fc7a0 msgr2=0x7f4dbc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:32:08.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.955+0000 7f4dc27c5640 1 -- 172.21.15.33:0/4111776910 shutdown_connections 2024-09-12T12:32:08.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.955+0000 7f4dc27c5640 1 -- 172.21.15.33:0/4111776910 wait complete. 2024-09-12T12:32:08.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.956+0000 7f4dc27c5640 1 Processor -- start 2024-09-12T12:32:08.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.956+0000 7f4dc27c5640 1 -- start start 2024-09-12T12:32:08.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.956+0000 7f4dc27c5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4dbc102d40 0x7f4dbc0739b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:08.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.957+0000 7f4dc27c5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4dbc103660 0x7f4dbc06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:08.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.957+0000 7f4dc27c5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4dbc10c170 0x7f4dbc06cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:08.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.957+0000 7f4dc27c5640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4dbc111e30 con 0x7f4dbc102d40 2024-09-12T12:32:08.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.957+0000 7f4dc27c5640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4dbc111cb0 con 0x7f4dbc10c170 2024-09-12T12:32:08.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.957+0000 7f4dc27c5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4dbc111fb0 con 0x7f4dbc103660 2024-09-12T12:32:08.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.957+0000 7f4dbbfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4dbc102d40 0x7f4dbc0739b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:08.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.957+0000 7f4dbbfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4dbc102d40 0x7f4dbc0739b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58744/0 (socket says 172.21.15.33:58744) 2024-09-12T12:32:08.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.957+0000 7f4dbbfff640 1 -- 172.21.15.33:0/4161440635 learned_addr learned my addr 172.21.15.33:0/4161440635 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:32:08.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.957+0000 7f4dbb7fe640 1 --2- 172.21.15.33:0/4161440635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4dbc103660 0x7f4dbc06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:08.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.958+0000 7f4dbb7fe640 1 -- 172.21.15.33:0/4161440635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4dbc10c170 msgr2=0x7f4dbc06cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:08.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.958+0000 7f4dbb7fe640 1 --2- 172.21.15.33:0/4161440635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4dbc10c170 0x7f4dbc06cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:08.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.958+0000 7f4dbb7fe640 1 -- 172.21.15.33:0/4161440635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4dbc102d40 msgr2=0x7f4dbc0739b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:08.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.958+0000 7f4dbb7fe640 1 --2- 172.21.15.33:0/4161440635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4dbc102d40 0x7f4dbc0739b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:08.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.958+0000 7f4dbb7fe640 1 -- 172.21.15.33:0/4161440635 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dbc06d4f0 con 0x7f4dbc103660 2024-09-12T12:32:08.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.958+0000 7f4dbb7fe640 1 --2- 172.21.15.33:0/4161440635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4dbc103660 0x7f4dbc06ca40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4db0005fd0 tx=0x7f4db000db60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:32:08.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.958+0000 7f4db97fa640 1 -- 172.21.15.33:0/4161440635 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db0004230 con 0x7f4dbc103660 2024-09-12T12:32:08.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.959+0000 7f4db97fa640 1 -- 172.21.15.33:0/4161440635 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4db00043d0 con 0x7f4dbc103660 2024-09-12T12:32:08.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.959+0000 7f4db97fa640 1 -- 172.21.15.33:0/4161440635 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db0003da0 con 0x7f4dbc103660 2024-09-12T12:32:08.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.959+0000 7f4dc27c5640 1 -- 172.21.15.33:0/4161440635 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dbc06d7e0 con 0x7f4dbc103660 2024-09-12T12:32:08.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.959+0000 7f4dc27c5640 1 -- 172.21.15.33:0/4161440635 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dbc071770 con 0x7f4dbc103660 2024-09-12T12:32:08.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.961+0000 7f4db97fa640 1 -- 172.21.15.33:0/4161440635 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4db0010460 con 0x7f4dbc103660 2024-09-12T12:32:08.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.962+0000 7f4dc4b9e740 1 Processor -- start 2024-09-12T12:32:08.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.962+0000 7f4dc4b9e740 1 -- start start 2024-09-12T12:32:08.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.962+0000 7f4dc4b9e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a84a058b60 0x55a84a058f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:08.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.962+0000 7f4dc4b9e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a84a059480 0x55a84a063800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:08.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.962+0000 7f4dc4b9e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a84a063d40 0x55a84a066130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:08.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.962+0000 7f4dc4b9e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a849fbe280 con 0x55a84a063d40 2024-09-12T12:32:08.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.962+0000 7f4dc4b9e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a849f65b10 con 0x55a84a059480 2024-09-12T12:32:08.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.962+0000 7f4dc4b9e740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a849fba240 con 0x55a84a058b60 2024-09-12T12:32:08.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.962+0000 7f4dc0d62640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a84a058b60 0x55a84a058f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:08.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.963+0000 7f4dc0d62640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a84a058b60 0x55a84a058f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:37312/0 (socket says 172.21.15.33:37312) 2024-09-12T12:32:08.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.963+0000 7f4dc0d62640 1 -- 172.21.15.33:0/2396461618 learned_addr learned my addr 172.21.15.33:0/2396461618 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:32:08.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.963+0000 7f4dbbfff640 1 --2- 172.21.15.33:0/2396461618 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a84a059480 0x55a84a063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:08.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.963+0000 7f4dbb7fe640 1 --2- 172.21.15.33:0/2396461618 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a84a063d40 0x55a84a066130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:08.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.963+0000 7f4db97fa640 1 --2- 172.21.15.33:0/4161440635 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f4da40a2d50 0x7f4da40a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:08.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.963+0000 7f4dc0d62640 1 -- 172.21.15.33:0/2396461618 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a84a059480 msgr2=0x55a84a063800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:08.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.963+0000 7f4dc0d62640 1 --2- 172.21.15.33:0/2396461618 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a84a059480 0x55a84a063800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:08.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.963+0000 7f4dc0d62640 1 -- 172.21.15.33:0/2396461618 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a84a063d40 msgr2=0x55a84a066130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:08.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.963+0000 7f4db97fa640 1 -- 172.21.15.33:0/4161440635 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f4db00cec20 con 0x7f4dbc103660 2024-09-12T12:32:08.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.963+0000 7f4dc0d62640 1 --2- 172.21.15.33:0/2396461618 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a84a063d40 0x55a84a066130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:08.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.963+0000 7f4dc0d62640 1 -- 172.21.15.33:0/2396461618 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a849f721f0 con 0x55a84a058b60 2024-09-12T12:32:08.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.963+0000 7f4dbbfff640 1 --2- 172.21.15.33:0/2396461618 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a84a059480 0x55a84a063800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:32:08.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.963+0000 7f4dbb7fe640 1 --2- 172.21.15.33:0/2396461618 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a84a063d40 0x55a84a066130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:32:08.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.964+0000 7f4dc0d62640 1 --2- 172.21.15.33:0/2396461618 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a84a058b60 0x55a84a058f40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4db4009dc0 tx=0x7f4db402f4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e02d941d9ffba11d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:32:08.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.964+0000 7f4dc0d62640 1 --2- 172.21.15.33:0/4161440635 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f4da40a2d50 0x7f4da40a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:08.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.964+0000 7f4da27fc640 1 -- 172.21.15.33:0/2396461618 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db404b070 con 0x55a84a058b60 2024-09-12T12:32:08.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.964+0000 7f4da27fc640 1 -- 172.21.15.33:0/2396461618 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4db4004040 con 0x55a84a058b60 2024-09-12T12:32:08.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.964+0000 7f4da27fc640 1 -- 172.21.15.33:0/2396461618 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db4034040 con 0x55a84a058b60 2024-09-12T12:32:08.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.965+0000 7f4dc4b9e740 1 -- 172.21.15.33:0/2396461618 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a84a058b60 msgr2=0x55a84a058f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:08.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.965+0000 7f4dc0d62640 1 --2- 172.21.15.33:0/4161440635 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f4da40a2d50 0x7f4da40a5210 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4db4048000 tx=0x7f4db404b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:32:08.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.965+0000 7f4dc4b9e740 1 --2- 172.21.15.33:0/2396461618 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a84a058b60 0x55a84a058f40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4db4009dc0 tx=0x7f4db402f4c0 comp rx=0 tx=0).stop 2024-09-12T12:32:08.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.965+0000 7f4dc4b9e740 1 -- 172.21.15.33:0/2396461618 shutdown_connections 2024-09-12T12:32:08.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.965+0000 7f4dc4b9e740 1 --2- 172.21.15.33:0/2396461618 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a84a063d40 0x55a84a066130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:08.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.965+0000 7f4dc4b9e740 1 --2- 172.21.15.33:0/2396461618 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a84a059480 0x55a84a063800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:08.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.965+0000 7f4dc4b9e740 1 --2- 172.21.15.33:0/2396461618 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a84a058b60 0x55a84a058f40 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:08.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.965+0000 7f4dc4b9e740 1 -- 172.21.15.33:0/2396461618 >> 172.21.15.33:0/2396461618 conn(0x55a84a0550f0 msgr2=0x55a84a0554d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:32:08.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.965+0000 7f4dc4b9e740 1 -- 172.21.15.33:0/2396461618 shutdown_connections 2024-09-12T12:32:08.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.965+0000 7f4dc4b9e740 1 -- 172.21.15.33:0/2396461618 wait complete. 2024-09-12T12:32:08.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.965+0000 7f4dc4b9e740 1 -- start start 2024-09-12T12:32:08.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.966+0000 7f4dc4b9e740 1 Processor -- start 2024-09-12T12:32:08.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.966+0000 7f4dc4b9e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a84a058b60 0x55a84a060ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:08.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.966+0000 7f4dc4b9e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a84a059480 0x55a84a0610e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:08.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.966+0000 7f4dc4b9e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a84a063d40 0x55a84a061620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:08.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.966+0000 7f4dc4b9e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a84a066910 con 0x55a84a059480 2024-09-12T12:32:08.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.966+0000 7f4dc4b9e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a849f78f10 con 0x55a84a063d40 2024-09-12T12:32:08.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.966+0000 7f4dc4b9e740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a84a066a90 con 0x55a84a058b60 2024-09-12T12:32:08.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.966+0000 7f4dc4b9e740 10 client.0 _ll_register_callbacks cb 0x55a849f41a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:32:08.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.966+0000 7f4dc0d62640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a84a063d40 0x55a84a061620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:08.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.966+0000 7f4dc0d62640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a84a063d40 0x55a84a061620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:42982/0 (socket says 172.21.15.33:42982) 2024-09-12T12:32:08.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.966+0000 7f4dc0d62640 1 -- 172.21.15.33:0/1423439795 learned_addr learned my addr 172.21.15.33:0/1423439795 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:32:08.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.966+0000 7f4dbb7fe640 1 --2- 172.21.15.33:0/1423439795 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a84a059480 0x55a84a0610e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:08.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.967+0000 7f4dbbfff640 1 --2- 172.21.15.33:0/1423439795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a84a058b60 0x55a84a060ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:08.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.967+0000 7f4dc0d62640 1 -- 172.21.15.33:0/1423439795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a84a058b60 msgr2=0x55a84a060ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:08.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.967+0000 7f4dc0d62640 1 --2- 172.21.15.33:0/1423439795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a84a058b60 0x55a84a060ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:08.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.967+0000 7f4dc0d62640 1 -- 172.21.15.33:0/1423439795 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a84a059480 msgr2=0x55a84a0610e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:08.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.967+0000 7f4dc0d62640 1 --2- 172.21.15.33:0/1423439795 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a84a059480 0x55a84a0610e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:08.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.967+0000 7f4dc0d62640 1 -- 172.21.15.33:0/1423439795 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a849d2f6a0 con 0x55a84a063d40 2024-09-12T12:32:08.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.967+0000 7f4dbb7fe640 1 --2- 172.21.15.33:0/1423439795 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a84a059480 0x55a84a0610e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:32:08.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.967+0000 7f4dc0d62640 1 --2- 172.21.15.33:0/1423439795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a84a063d40 0x55a84a061620 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4db40046c0 tx=0x7f4db4004830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31a9830d991080a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:32:08.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.967+0000 7f4d9b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:32:08.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.967+0000 7f4d9b7fe640 1 -- 172.21.15.33:0/1423439795 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db4057060 con 0x55a84a063d40 2024-09-12T12:32:08.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.967+0000 7f4d9b7fe640 1 -- 172.21.15.33:0/1423439795 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f4db402fa30 con 0x55a84a063d40 2024-09-12T12:32:08.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.967+0000 7f4dc4b9e740 1 -- 172.21.15.33:0/1423439795 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4db4004040 con 0x55a84a063d40 2024-09-12T12:32:08.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.968+0000 7f4d9b7fe640 1 -- 172.21.15.33:0/1423439795 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4db405e050 con 0x55a84a063d40 2024-09-12T12:32:08.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.968+0000 7f4dc4b9e740 10 client.25526 fetch_fsmap learned FSMap version 27 2024-09-12T12:32:08.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.968+0000 7f4dc4b9e740 1 -- 172.21.15.33:0/1423439795 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a84a07ad10 con 0x55a84a063d40 2024-09-12T12:32:08.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.968+0000 7f4d9b7fe640 1 -- 172.21.15.33:0/1423439795 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4db4004040 con 0x55a84a063d40 2024-09-12T12:32:08.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.968+0000 7f4d9b7fe640 1 -- 172.21.15.33:0/1423439795 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f4db4041070 con 0x55a84a063d40 2024-09-12T12:32:08.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.968+0000 7f4dc4b9e740 10 client.25526 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:32:08.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.968+0000 7f4dc4b9e740 10 client.25526 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:32:08.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.968+0000 7f4dc4b9e740 20 client.25526 populate_metadata read hostname 'smithi033' 2024-09-12T12:32:08.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.968+0000 7f4dc4b9e740 1 --2- 172.21.15.33:0/1423439795 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55a84a07c060 0x55a84a07e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:08.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.968+0000 7f4dc4b9e740 4 client.25526 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:32:08.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.968+0000 7f4dc4b9e740 1 -- 172.21.15.33:0/1423439795 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a849fcb7f0 con 0x55a84a07c060 2024-09-12T12:32:08.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.969+0000 7f4dbbfff640 1 --2- 172.21.15.33:0/1423439795 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55a84a07c060 0x55a84a07e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:08.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.969+0000 7f4dbbfff640 1 --2- 172.21.15.33:0/1423439795 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55a84a07c060 0x55a84a07e450 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7968e64246285b81 server_cookie=1547a3decf90d2f1 in_seq=0 out_seq=0 2024-09-12T12:32:08.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.969+0000 7f4d9b7fe640 10 client.25526 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:32:08.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.970+0000 7f4d9b7fe640 1 -- 172.21.15.33:0/1423439795 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a849fcb7f0 con 0x55a84a07c060 2024-09-12T12:32:08.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.970+0000 7f4d9b7fe640 10 client.25526 handle_command_reply: tid=0 2024-09-12T12:32:08.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.970+0000 7f4dc4b9e740 1 client.25526 shutdown 2024-09-12T12:32:08.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.971+0000 7f4dc4b9e740 1 -- 172.21.15.33:0/1423439795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a84a063d40 msgr2=0x55a84a061620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:08.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.971+0000 7f4dc4b9e740 1 --2- 172.21.15.33:0/1423439795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a84a063d40 0x55a84a061620 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4db40046c0 tx=0x7f4db4004830 comp rx=0 tx=0).stop 2024-09-12T12:32:08.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.971+0000 7f4dc4b9e740 1 -- 172.21.15.33:0/1423439795 shutdown_connections 2024-09-12T12:32:08.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.971+0000 7f4dc4b9e740 1 --2- 172.21.15.33:0/1423439795 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55a84a07c060 0x55a84a07e450 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:08.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.971+0000 7f4dc4b9e740 1 --2- 172.21.15.33:0/1423439795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a84a063d40 0x55a84a061620 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:08.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.972+0000 7f4dc4b9e740 1 --2- 172.21.15.33:0/1423439795 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a84a059480 0x55a84a0610e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:08.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.972+0000 7f4d9b7fe640 0 client.25526 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:32:08.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.972+0000 7f4dc4b9e740 1 --2- 172.21.15.33:0/1423439795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a84a058b60 0x55a84a060ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:08.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.972+0000 7f4dc4b9e740 1 -- 172.21.15.33:0/1423439795 >> 172.21.15.33:0/1423439795 conn(0x55a84a0550f0 msgr2=0x55a84a05ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:32:08.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.982+0000 7f4dc4b9e740 1 -- 172.21.15.33:0/1423439795 shutdown_connections 2024-09-12T12:32:08.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.983+0000 7f4dc4b9e740 1 -- 172.21.15.33:0/1423439795 wait complete. 2024-09-12T12:32:08.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:07.983+0000 7f4dc4b9e740 20 client.25526 trim_cache size 0 max 16384 2024-09-12T12:32:08.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.024+0000 7f4dc4b9e740 1 Processor -- start 2024-09-12T12:32:08.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.024+0000 7f4dc4b9e740 1 -- start start 2024-09-12T12:32:08.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.024+0000 7f4dc4b9e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a84a058b60 0x55a84a083a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:08.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.025+0000 7f4dc4b9e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a84a059480 0x55a84a083fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:08.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.025+0000 7f4dc4b9e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a84a063d40 0x55a84a05de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:08.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.025+0000 7f4dbb7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a84a059480 0x55a84a083fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:08.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.025+0000 7f4dc0d62640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a84a063d40 0x55a84a05de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:08.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.025+0000 7f4dc0d62640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a84a063d40 0x55a84a05de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:37334/0 (socket says 172.21.15.33:37334) 2024-09-12T12:32:08.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.025+0000 7f4dc0d62640 1 -- 172.21.15.33:0/3449702223 learned_addr learned my addr 172.21.15.33:0/3449702223 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:32:08.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.025+0000 7f4dbbfff640 1 --2- 172.21.15.33:0/3449702223 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a84a058b60 0x55a84a083a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:08.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.025+0000 7f4dbb7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a84a059480 0x55a84a083fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:42996/0 (socket says 172.21.15.33:42996) 2024-09-12T12:32:08.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.026+0000 7f4dc4b9e740 1 -- 172.21.15.33:0/3449702223 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4da8012450 con 0x55a84a058b60 2024-09-12T12:32:08.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.026+0000 7f4dc4b9e740 1 -- 172.21.15.33:0/3449702223 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4da800fd20 con 0x55a84a059480 2024-09-12T12:32:08.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.026+0000 7f4dc4b9e740 1 -- 172.21.15.33:0/3449702223 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4da800db70 con 0x55a84a063d40 2024-09-12T12:32:08.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.027+0000 7f4dc0d62640 1 -- 172.21.15.33:0/3449702223 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a84a059480 msgr2=0x55a84a083fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:08.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.027+0000 7f4dc0d62640 1 --2- 172.21.15.33:0/3449702223 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a84a059480 0x55a84a083fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:08.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.027+0000 7f4dc0d62640 1 -- 172.21.15.33:0/3449702223 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a84a058b60 msgr2=0x55a84a083a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:08.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.027+0000 7f4dc0d62640 1 --2- 172.21.15.33:0/3449702223 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a84a058b60 0x55a84a083a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:08.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.027+0000 7f4dc0d62640 1 -- 172.21.15.33:0/3449702223 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a84a054f20 con 0x55a84a063d40 2024-09-12T12:32:08.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.030+0000 7f4dbbfff640 1 --2- 172.21.15.33:0/3449702223 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a84a058b60 0x55a84a083a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:32:08.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.030+0000 7f4dbb7fe640 1 --2- 172.21.15.33:0/3449702223 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a84a059480 0x55a84a083fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:32:08.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.030+0000 7f4dc0d62640 1 --2- 172.21.15.33:0/3449702223 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a84a063d40 0x55a84a05de00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4db402ae50 tx=0x7f4db40046f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d93f79ccc7b08b97 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:32:08.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.033+0000 7f4da1ffb640 1 -- 172.21.15.33:0/3449702223 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db4057040 con 0x55a84a063d40 2024-09-12T12:32:08.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.033+0000 7f4da1ffb640 1 -- 172.21.15.33:0/3449702223 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4db402f3a0 con 0x55a84a063d40 2024-09-12T12:32:08.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.033+0000 7f4da1ffb640 1 -- 172.21.15.33:0/3449702223 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db4045c40 con 0x55a84a063d40 2024-09-12T12:32:08.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.034+0000 7f4dc4b9e740 1 -- 172.21.15.33:0/3449702223 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a84a063d40 msgr2=0x55a84a05de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:08.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.034+0000 7f4dc4b9e740 1 --2- 172.21.15.33:0/3449702223 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a84a063d40 0x55a84a05de00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4db402ae50 tx=0x7f4db40046f0 comp rx=0 tx=0).stop 2024-09-12T12:32:08.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.035+0000 7f4dc4b9e740 1 -- 172.21.15.33:0/3449702223 shutdown_connections 2024-09-12T12:32:08.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.035+0000 7f4dc4b9e740 1 --2- 172.21.15.33:0/3449702223 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a84a063d40 0x55a84a05de00 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:08.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.035+0000 7f4dc4b9e740 1 --2- 172.21.15.33:0/3449702223 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a84a059480 0x55a84a083fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:08.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.035+0000 7f4dc4b9e740 1 --2- 172.21.15.33:0/3449702223 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a84a058b60 0x55a84a083a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:08.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.035+0000 7f4dc4b9e740 1 -- 172.21.15.33:0/3449702223 >> 172.21.15.33:0/3449702223 conn(0x55a84a0550f0 msgr2=0x55a84a062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:32:08.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.040+0000 7f4dc4b9e740 1 -- 172.21.15.33:0/3449702223 shutdown_connections 2024-09-12T12:32:08.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.044+0000 7f4dc4b9e740 1 -- 172.21.15.33:0/3449702223 wait complete. 2024-09-12T12:32:08.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.044+0000 7f4dc4b9e740 1 -- start start 2024-09-12T12:32:08.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.045+0000 7f4dc4b9e740 1 Processor -- start 2024-09-12T12:32:08.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.046+0000 7f4dc4b9e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a84a058b60 0x55a84a0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:08.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.046+0000 7f4dc4b9e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a84a059480 0x55a84a074b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:08.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.046+0000 7f4dc4b9e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a84a063d40 0x55a84a06f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:08.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.046+0000 7f4dbbfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a84a058b60 0x55a84a0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:08.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.046+0000 7f4dbbfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a84a058b60 0x55a84a0745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58778/0 (socket says 172.21.15.33:58778) 2024-09-12T12:32:08.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.046+0000 7f4dbbfff640 1 -- 172.21.15.33:0/805690381 learned_addr learned my addr 172.21.15.33:0/805690381 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:32:08.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.047+0000 7f4dc4b9e740 1 -- 172.21.15.33:0/805690381 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4da800e1e0 con 0x55a84a058b60 2024-09-12T12:32:08.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.047+0000 7f4dc4b9e740 1 -- 172.21.15.33:0/805690381 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4da800f650 con 0x55a84a063d40 2024-09-12T12:32:08.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.047+0000 7f4dc4b9e740 1 -- 172.21.15.33:0/805690381 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4da800e8b0 con 0x55a84a059480 2024-09-12T12:32:08.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.047+0000 7f4dc4b9e740 10 client.0 _ll_register_callbacks cb 0x7f4db4049070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:32:08.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.047+0000 7f4dc0d62640 1 --2- 172.21.15.33:0/805690381 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a84a063d40 0x55a84a06f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:08.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.047+0000 7f4dbb7fe640 1 --2- 172.21.15.33:0/805690381 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a84a059480 0x55a84a074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:08.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.048+0000 7f4dc0d62640 1 -- 172.21.15.33:0/805690381 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a84a059480 msgr2=0x55a84a074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:08.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.048+0000 7f4dc0d62640 1 --2- 172.21.15.33:0/805690381 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a84a059480 0x55a84a074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:08.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.048+0000 7f4dc0d62640 1 -- 172.21.15.33:0/805690381 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a84a058b60 msgr2=0x55a84a0745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:08.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.048+0000 7f4dc0d62640 1 --2- 172.21.15.33:0/805690381 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a84a058b60 0x55a84a0745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:08.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.048+0000 7f4dc0d62640 1 -- 172.21.15.33:0/805690381 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a84a075160 con 0x55a84a063d40 2024-09-12T12:32:08.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.049+0000 7f4dc0d62640 1 --2- 172.21.15.33:0/805690381 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a84a063d40 0x55a84a06f590 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4db402f940 tx=0x7f4db40458d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=996500d306a163e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:32:08.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.049+0000 7f4d9b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:32:08.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.050+0000 7f4d9b7fe640 1 -- 172.21.15.33:0/805690381 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db4057070 con 0x55a84a063d40 2024-09-12T12:32:08.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.050+0000 7f4dc4b9e740 1 -- 172.21.15.33:0/805690381 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a849fc5d00 con 0x55a84a063d40 2024-09-12T12:32:08.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.050+0000 7f4d9b7fe640 1 -- 172.21.15.33:0/805690381 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f4db402fa30 con 0x55a84a063d40 2024-09-12T12:32:08.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.050+0000 7f4d9b7fe640 1 -- 172.21.15.33:0/805690381 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4db4074050 con 0x55a84a063d40 2024-09-12T12:32:08.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.050+0000 7f4dc4b9e740 10 client.25529 fetch_fsmap learned FSMap version 27 2024-09-12T12:32:08.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.050+0000 7f4dc4b9e740 1 -- 172.21.15.33:0/805690381 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a84a0e6ef0 con 0x55a84a063d40 2024-09-12T12:32:08.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.050+0000 7f4d9b7fe640 1 -- 172.21.15.33:0/805690381 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55a849fc5d00 con 0x55a84a063d40 2024-09-12T12:32:08.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.050+0000 7f4d9b7fe640 1 -- 172.21.15.33:0/805690381 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f4db4041070 con 0x55a84a063d40 2024-09-12T12:32:08.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.051+0000 7f4dc4b9e740 10 client.25529 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:32:08.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.051+0000 7f4dc4b9e740 10 client.25529 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:32:08.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.051+0000 7f4dc4b9e740 20 client.25529 populate_metadata read hostname 'smithi033' 2024-09-12T12:32:08.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.051+0000 7f4dc4b9e740 1 --2- 172.21.15.33:0/805690381 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55a84a07c060 0x55a84a0e95d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:08.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.051+0000 7f4dc4b9e740 4 client.25529 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T12:32:08.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.051+0000 7f4dc4b9e740 1 -- 172.21.15.33:0/805690381 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a849f42110 con 0x55a84a07c060 2024-09-12T12:32:08.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.052+0000 7f4dbbfff640 1 --2- 172.21.15.33:0/805690381 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55a84a07c060 0x55a84a0e95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:08.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.061+0000 7f4d9b7fe640 10 client.25529 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:32:08.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.061+0000 7f4dbbfff640 1 --2- 172.21.15.33:0/805690381 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55a84a07c060 0x55a84a0e95d0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbb171160e2cc6ab server_cookie=8ba3cef830451677 in_seq=0 out_seq=0 2024-09-12T12:32:08.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.063+0000 7f4d9b7fe640 1 -- 172.21.15.33:0/805690381 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a849f42110 con 0x55a84a07c060 2024-09-12T12:32:08.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.063+0000 7f4d9b7fe640 10 client.25529 handle_command_reply: tid=0 2024-09-12T12:32:08.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.063+0000 7f4dc4b9e740 1 client.25529 shutdown 2024-09-12T12:32:08.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.068+0000 7f4dc4b9e740 1 -- 172.21.15.33:0/805690381 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a84a063d40 msgr2=0x55a84a06f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:08.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.068+0000 7f4dc4b9e740 1 --2- 172.21.15.33:0/805690381 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a84a063d40 0x55a84a06f590 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4db402f940 tx=0x7f4db40458d0 comp rx=0 tx=0).stop 2024-09-12T12:32:08.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.071+0000 7f4dc4b9e740 1 -- 172.21.15.33:0/805690381 shutdown_connections 2024-09-12T12:32:08.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.071+0000 7f4dc4b9e740 1 --2- 172.21.15.33:0/805690381 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55a84a07c060 0x55a84a0e95d0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:08.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.071+0000 7f4dc4b9e740 1 --2- 172.21.15.33:0/805690381 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a84a063d40 0x55a84a06f590 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:08.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.071+0000 7f4dc4b9e740 1 --2- 172.21.15.33:0/805690381 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a84a059480 0x55a84a074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:08.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.071+0000 7f4dc4b9e740 1 --2- 172.21.15.33:0/805690381 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a84a058b60 0x55a84a0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:08.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.071+0000 7f4dc4b9e740 1 -- 172.21.15.33:0/805690381 >> 172.21.15.33:0/805690381 conn(0x55a84a0550f0 msgr2=0x55a84a077450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:32:08.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.071+0000 7f4d9b7fe640 0 client.25529 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:32:08.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.071+0000 7f4dc4b9e740 1 -- 172.21.15.33:0/805690381 shutdown_connections 2024-09-12T12:32:08.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.072+0000 7f4dc4b9e740 1 -- 172.21.15.33:0/805690381 wait complete. 2024-09-12T12:32:08.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.072+0000 7f4dc4b9e740 20 client.25529 trim_cache size 0 max 16384 2024-09-12T12:32:08.602 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:32:08.602 INFO:teuthology.orchestra.run.smithi033.stdout: "return_code": 0, 2024-09-12T12:32:08.602 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_tag": "e0ce731c-a18d-4f54-93f4-dc712b2c709f", 2024-09-12T12:32:08.602 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": "asynchronous" 2024-09-12T12:32:08.602 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:32:08.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.076+0000 7f4dc27c5640 1 -- 172.21.15.33:0/4161440635 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f4da40a2d50 msgr2=0x7f4da40a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:08.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.076+0000 7f4dc27c5640 1 --2- 172.21.15.33:0/4161440635 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f4da40a2d50 0x7f4da40a5210 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4db4048000 tx=0x7f4db404b000 comp rx=0 tx=0).stop 2024-09-12T12:32:08.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.076+0000 7f4dc27c5640 1 -- 172.21.15.33:0/4161440635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4dbc103660 msgr2=0x7f4dbc06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:08.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.076+0000 7f4dc27c5640 1 --2- 172.21.15.33:0/4161440635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4dbc103660 0x7f4dbc06ca40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4db0005fd0 tx=0x7f4db000db60 comp rx=0 tx=0).stop 2024-09-12T12:32:08.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.080+0000 7f4dc27c5640 1 -- 172.21.15.33:0/4161440635 shutdown_connections 2024-09-12T12:32:08.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.080+0000 7f4dc27c5640 1 --2- 172.21.15.33:0/4161440635 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f4da40a2d50 0x7f4da40a5210 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:08.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.080+0000 7f4dc27c5640 1 --2- 172.21.15.33:0/4161440635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4dbc10c170 0x7f4dbc06cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:08.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.080+0000 7f4dc27c5640 1 --2- 172.21.15.33:0/4161440635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4dbc103660 0x7f4dbc06ca40 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:08.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.080+0000 7f4dc27c5640 1 --2- 172.21.15.33:0/4161440635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4dbc102d40 0x7f4dbc0739b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:08.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.080+0000 7f4dc27c5640 1 -- 172.21.15.33:0/4161440635 >> 172.21.15.33:0/4161440635 conn(0x7f4dbc0fc7a0 msgr2=0x7f4dbc0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:32:08.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.081+0000 7f4dc27c5640 1 -- 172.21.15.33:0/4161440635 shutdown_connections 2024-09-12T12:32:08.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:08.081+0000 7f4dc27c5640 1 -- 172.21.15.33:0/4161440635 wait complete. 2024-09-12T12:32:08.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:08 smithi033 ceph-mon[31246]: scrub queued for path: / 2024-09-12T12:32:08.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:08 smithi033 ceph-mon[31246]: scrub summary: idle+waiting paths [/] 2024-09-12T12:32:08.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:08 smithi033 ceph-mon[31246]: scrub summary: active paths [/] 2024-09-12T12:32:08.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:08 smithi033 ceph-mon[31246]: scrub summary: active paths [/] 2024-09-12T12:32:08.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:08 smithi033 ceph-mon[31246]: scrub summary: idle+waiting paths [/] 2024-09-12T12:32:08.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:08 smithi033 ceph-mon[31246]: scrub summary: idle+waiting paths [/] 2024-09-12T12:32:09.047 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:08 smithi102 ceph-mon[34799]: scrub queued for path: / 2024-09-12T12:32:09.047 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:08 smithi102 ceph-mon[34799]: scrub summary: idle+waiting paths [/] 2024-09-12T12:32:09.047 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:08 smithi102 ceph-mon[34799]: scrub summary: active paths [/] 2024-09-12T12:32:09.047 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:08 smithi102 ceph-mon[34799]: scrub summary: active paths [/] 2024-09-12T12:32:09.047 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:08 smithi102 ceph-mon[34799]: scrub summary: idle+waiting paths [/] 2024-09-12T12:32:09.047 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:08 smithi102 ceph-mon[34799]: scrub summary: idle+waiting paths [/] 2024-09-12T12:32:09.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:08 smithi043 ceph-mon[34144]: scrub queued for path: / 2024-09-12T12:32:09.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:08 smithi043 ceph-mon[34144]: scrub summary: idle+waiting paths [/] 2024-09-12T12:32:09.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:08 smithi043 ceph-mon[34144]: scrub summary: active paths [/] 2024-09-12T12:32:09.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:08 smithi043 ceph-mon[34144]: scrub summary: active paths [/] 2024-09-12T12:32:09.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:08 smithi043 ceph-mon[34144]: scrub summary: idle+waiting paths [/] 2024-09-12T12:32:09.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:08 smithi043 ceph-mon[34144]: scrub summary: idle+waiting paths [/] 2024-09-12T12:32:09.393 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T12:32:09.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:09 smithi033 ceph-mon[31246]: pgmap v534: 129 pgs: 129 active+clean; 10 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 46 MiB/s wr, 765 op/s 2024-09-12T12:32:10.105 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:32:10.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:09 smithi043 ceph-mon[34144]: pgmap v534: 129 pgs: 129 active+clean; 10 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 46 MiB/s wr, 765 op/s 2024-09-12T12:32:10.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:09 smithi102 ceph-mon[34799]: pgmap v534: 129 pgs: 129 active+clean; 10 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 46 MiB/s wr, 765 op/s 2024-09-12T12:32:10.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.827+0000 7f0fe5524640 1 -- 172.21.15.33:0/3041138717 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fe0100de0 msgr2=0x7f0fe0104e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:10.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.827+0000 7f0fe5524640 1 --2- 172.21.15.33:0/3041138717 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fe0100de0 0x7f0fe0104e30 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f0fd400a910 tx=0x7f0fd402a640 comp rx=0 tx=0).stop 2024-09-12T12:32:10.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.828+0000 7f0fe5524640 1 -- 172.21.15.33:0/3041138717 shutdown_connections 2024-09-12T12:32:10.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.828+0000 7f0fe5524640 1 --2- 172.21.15.33:0/3041138717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fe0105560 0x7f0fe010d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:10.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.828+0000 7f0fe5524640 1 --2- 172.21.15.33:0/3041138717 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fe0100de0 0x7f0fe0104e30 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:10.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.828+0000 7f0fe5524640 1 --2- 172.21.15.33:0/3041138717 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fe0100430 0x7f0fe0100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:10.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.828+0000 7f0fe5524640 1 -- 172.21.15.33:0/3041138717 >> 172.21.15.33:0/3041138717 conn(0x7f0fe0077230 msgr2=0x7f0fe00fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:32:10.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.828+0000 7f0fe5524640 1 -- 172.21.15.33:0/3041138717 shutdown_connections 2024-09-12T12:32:10.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.829+0000 7f0fe5524640 1 -- 172.21.15.33:0/3041138717 wait complete. 2024-09-12T12:32:10.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.829+0000 7f0fe5524640 1 Processor -- start 2024-09-12T12:32:10.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.836+0000 7f0fe5524640 1 -- start start 2024-09-12T12:32:10.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.836+0000 7f0fe5524640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fe0100430 0x7f0fe010baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:10.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.836+0000 7f0fe5524640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fe0100de0 0x7f0fe010bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:10.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.836+0000 7f0fe5524640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fe0105560 0x7f0fe010c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:10.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.836+0000 7f0fe5524640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe010f280 con 0x7f0fe0100430 2024-09-12T12:32:10.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.836+0000 7f0fe5524640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe010f100 con 0x7f0fe0100de0 2024-09-12T12:32:10.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.836+0000 7f0fe5524640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe010f400 con 0x7f0fe0105560 2024-09-12T12:32:10.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.836+0000 7f0fde7fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fe0100de0 0x7f0fe010bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:10.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.836+0000 7f0fde7fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fe0100de0 0x7f0fe010bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:50664/0 (socket says 172.21.15.33:50664) 2024-09-12T12:32:10.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.836+0000 7f0fde7fc640 1 -- 172.21.15.33:0/1689890175 learned_addr learned my addr 172.21.15.33:0/1689890175 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:32:10.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.837+0000 7f0fdf7fe640 1 --2- 172.21.15.33:0/1689890175 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fe0105560 0x7f0fe010c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:10.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.837+0000 7f0fde7fc640 1 -- 172.21.15.33:0/1689890175 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fe0105560 msgr2=0x7f0fe010c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:10.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.837+0000 7f0fde7fc640 1 --2- 172.21.15.33:0/1689890175 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fe0105560 0x7f0fe010c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:10.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.837+0000 7f0fde7fc640 1 -- 172.21.15.33:0/1689890175 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fe0100430 msgr2=0x7f0fe010baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:10.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.837+0000 7f0fde7fc640 1 --2- 172.21.15.33:0/1689890175 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fe0100430 0x7f0fe010baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:10.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.837+0000 7f0fde7fc640 1 -- 172.21.15.33:0/1689890175 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fe006bd40 con 0x7f0fe0100de0 2024-09-12T12:32:10.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.837+0000 7f0fde7fc640 1 --2- 172.21.15.33:0/1689890175 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fe0100de0 0x7f0fe010bfe0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0fd40058c0 tx=0x7f0fd40048f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:32:10.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.838+0000 7f0fc7fff640 1 -- 172.21.15.33:0/1689890175 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd4063020 con 0x7f0fe0100de0 2024-09-12T12:32:10.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.839+0000 7f0fe5524640 1 -- 172.21.15.33:0/1689890175 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fe006bfd0 con 0x7f0fe0100de0 2024-09-12T12:32:10.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.839+0000 7f0fe5524640 1 -- 172.21.15.33:0/1689890175 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fe006c510 con 0x7f0fe0100de0 2024-09-12T12:32:10.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.839+0000 7f0fc7fff640 1 -- 172.21.15.33:0/1689890175 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0fd402ae40 con 0x7f0fe0100de0 2024-09-12T12:32:10.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.839+0000 7f0fc7fff640 1 -- 172.21.15.33:0/1689890175 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd405f930 con 0x7f0fe0100de0 2024-09-12T12:32:10.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.842+0000 7f0fc7fff640 1 -- 172.21.15.33:0/1689890175 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0fd4066020 con 0x7f0fe0100de0 2024-09-12T12:32:10.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.843+0000 7f0fc7fff640 1 --2- 172.21.15.33:0/1689890175 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0fc80a2dd0 0x7f0fc80a5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:10.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.844+0000 7f0fc7fff640 1 -- 172.21.15.33:0/1689890175 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f0fd4112430 con 0x7f0fe0100de0 2024-09-12T12:32:10.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.845+0000 7f0fdeffd640 1 --2- 172.21.15.33:0/1689890175 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0fc80a2dd0 0x7f0fc80a5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:10.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.846+0000 7f0fe78fd740 1 Processor -- start 2024-09-12T12:32:10.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.847+0000 7f0fdeffd640 1 --2- 172.21.15.33:0/1689890175 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0fc80a2dd0 0x7f0fc80a5290 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0fd000b3c0 tx=0x7f0fd000d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:32:10.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.849+0000 7f0fe78fd740 1 -- start start 2024-09-12T12:32:10.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.850+0000 7f0fe78fd740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5565866c14a0 0x5565866c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:10.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.850+0000 7f0fe78fd740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5565866c1dc0 0x5565866cc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:10.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.850+0000 7f0fe78fd740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5565866cc680 0x5565866cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:10.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.850+0000 7f0fe78fd740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5565866272e0 con 0x5565866c14a0 2024-09-12T12:32:10.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.850+0000 7f0fe78fd740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5565865cece0 con 0x5565866cc680 2024-09-12T12:32:10.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.850+0000 7f0fe78fd740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5565866232a0 con 0x5565866c1dc0 2024-09-12T12:32:10.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.851+0000 7f0fdf7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5565866cc680 0x5565866cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:10.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.851+0000 7f0fde7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5565866c1dc0 0x5565866cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:10.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.851+0000 7f0fde7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5565866c1dc0 0x5565866cc140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:55924/0 (socket says 172.21.15.33:55924) 2024-09-12T12:32:10.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.851+0000 7f0fdf7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5565866cc680 0x5565866cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:50676/0 (socket says 172.21.15.33:50676) 2024-09-12T12:32:10.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.851+0000 7f0fde7fc640 1 -- 172.21.15.33:0/1977042174 learned_addr learned my addr 172.21.15.33:0/1977042174 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:32:10.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.852+0000 7f0fdf7fe640 1 -- 172.21.15.33:0/1977042174 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5565866c1dc0 msgr2=0x5565866cc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:10.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.852+0000 7f0fdf7fe640 1 --2- 172.21.15.33:0/1977042174 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5565866c1dc0 0x5565866cc140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:10.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.852+0000 7f0fdf7fe640 1 -- 172.21.15.33:0/1977042174 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5565866c14a0 msgr2=0x5565866c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:10.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.852+0000 7f0fdf7fe640 1 --2- 172.21.15.33:0/1977042174 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5565866c14a0 0x5565866c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:10.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.852+0000 7f0fdf7fe640 1 -- 172.21.15.33:0/1977042174 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565865b3440 con 0x5565866cc680 2024-09-12T12:32:10.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.853+0000 7f0fdf7fe640 1 --2- 172.21.15.33:0/1977042174 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5565866cc680 0x5565866cea70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0fd800ad50 tx=0x7f0fd800f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3de6a2e4ea4493a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:32:10.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.854+0000 7f0fc57fa640 1 -- 172.21.15.33:0/1977042174 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd8003b70 con 0x5565866cc680 2024-09-12T12:32:10.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.854+0000 7f0fc57fa640 1 -- 172.21.15.33:0/1977042174 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0fd800ae40 con 0x5565866cc680 2024-09-12T12:32:10.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.854+0000 7f0fc57fa640 1 -- 172.21.15.33:0/1977042174 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd80109e0 con 0x5565866cc680 2024-09-12T12:32:10.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.857+0000 7f0fe78fd740 1 -- 172.21.15.33:0/1977042174 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5565866cc680 msgr2=0x5565866cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:10.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.857+0000 7f0fe78fd740 1 --2- 172.21.15.33:0/1977042174 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5565866cc680 0x5565866cea70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0fd800ad50 tx=0x7f0fd800f790 comp rx=0 tx=0).stop 2024-09-12T12:32:10.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.862+0000 7f0fe78fd740 1 -- 172.21.15.33:0/1977042174 shutdown_connections 2024-09-12T12:32:10.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.862+0000 7f0fe78fd740 1 --2- 172.21.15.33:0/1977042174 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5565866cc680 0x5565866cea70 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:10.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.862+0000 7f0fe78fd740 1 --2- 172.21.15.33:0/1977042174 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5565866c1dc0 0x5565866cc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:10.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.862+0000 7f0fe78fd740 1 --2- 172.21.15.33:0/1977042174 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5565866c14a0 0x5565866c1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:10.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.862+0000 7f0fe78fd740 1 -- 172.21.15.33:0/1977042174 >> 172.21.15.33:0/1977042174 conn(0x5565866bda30 msgr2=0x5565866bde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:32:10.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.863+0000 7f0fe78fd740 1 -- 172.21.15.33:0/1977042174 shutdown_connections 2024-09-12T12:32:10.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.863+0000 7f0fe78fd740 1 -- 172.21.15.33:0/1977042174 wait complete. 2024-09-12T12:32:10.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.864+0000 7f0fe78fd740 1 -- start start 2024-09-12T12:32:10.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.864+0000 7f0fe78fd740 1 Processor -- start 2024-09-12T12:32:10.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.864+0000 7f0fe78fd740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5565866c14a0 0x5565866cc010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:10.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.865+0000 7f0fe78fd740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5565866c1dc0 0x5565866c92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:10.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.865+0000 7f0fe78fd740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5565866cc680 0x5565866c9840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:10.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.865+0000 7f0fe78fd740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5565866cf250 con 0x5565866c14a0 2024-09-12T12:32:10.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.865+0000 7f0fdeffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5565866c14a0 0x5565866cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:10.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.865+0000 7f0fdeffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5565866c14a0 0x5565866cc010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43036/0 (socket says 172.21.15.33:43036) 2024-09-12T12:32:10.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.865+0000 7f0fdeffd640 1 -- 172.21.15.33:0/2839801722 learned_addr learned my addr 172.21.15.33:0/2839801722 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:32:10.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.865+0000 7f0fdf7fe640 1 --2- 172.21.15.33:0/2839801722 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5565866cc680 0x5565866c9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:10.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.865+0000 7f0fe78fd740 1 -- 172.21.15.33:0/2839801722 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5565865e2050 con 0x5565866c1dc0 2024-09-12T12:32:10.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.865+0000 7f0fe78fd740 1 -- 172.21.15.33:0/2839801722 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5565866cf3d0 con 0x5565866cc680 2024-09-12T12:32:10.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.865+0000 7f0fde7fc640 1 --2- 172.21.15.33:0/2839801722 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5565866c1dc0 0x5565866c92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:10.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.865+0000 7f0fe78fd740 10 client.0 _ll_register_callbacks cb 0x556586622160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:32:10.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.866+0000 7f0fdf7fe640 1 -- 172.21.15.33:0/2839801722 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5565866c1dc0 msgr2=0x5565866c92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:10.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.866+0000 7f0fdf7fe640 1 --2- 172.21.15.33:0/2839801722 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5565866c1dc0 0x5565866c92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:10.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.866+0000 7f0fdf7fe640 1 -- 172.21.15.33:0/2839801722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5565866c14a0 msgr2=0x5565866cc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:10.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.866+0000 7f0fdf7fe640 1 --2- 172.21.15.33:0/2839801722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5565866c14a0 0x5565866cc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:10.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.866+0000 7f0fdf7fe640 1 -- 172.21.15.33:0/2839801722 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565863983c0 con 0x5565866cc680 2024-09-12T12:32:10.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.866+0000 7f0fdf7fe640 1 --2- 172.21.15.33:0/2839801722 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5565866cc680 0x5565866c9840 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0fd800a2a0 tx=0x7f0fd8010950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cd0058866f82ad1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:32:10.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.867+0000 7f0fc2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:32:10.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.867+0000 7f0fc2ff5640 1 -- 172.21.15.33:0/2839801722 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd8026070 con 0x5565866cc680 2024-09-12T12:32:10.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.867+0000 7f0fc2ff5640 1 -- 172.21.15.33:0/2839801722 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f0fd8005040 con 0x5565866cc680 2024-09-12T12:32:10.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.867+0000 7f0fe78fd740 1 -- 172.21.15.33:0/2839801722 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556586634850 con 0x5565866cc680 2024-09-12T12:32:10.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.867+0000 7f0fc2ff5640 1 -- 172.21.15.33:0/2839801722 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0fd8030050 con 0x5565866cc680 2024-09-12T12:32:10.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.871+0000 7f0fe78fd740 10 client.25630 fetch_fsmap learned FSMap version 27 2024-09-12T12:32:10.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.871+0000 7f0fe78fd740 1 -- 172.21.15.33:0/2839801722 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5565866dacb0 con 0x5565866cc680 2024-09-12T12:32:10.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.872+0000 7f0fc2ff5640 1 -- 172.21.15.33:0/2839801722 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x556586634850 con 0x5565866cc680 2024-09-12T12:32:10.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.872+0000 7f0fc2ff5640 1 -- 172.21.15.33:0/2839801722 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f0fd802b550 con 0x5565866cc680 2024-09-12T12:32:10.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.875+0000 7f0fe78fd740 10 client.25630 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:32:10.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.875+0000 7f0fe78fd740 10 client.25630 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:32:10.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.875+0000 7f0fe78fd740 20 client.25630 populate_metadata read hostname 'smithi033' 2024-09-12T12:32:10.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.875+0000 7f0fe78fd740 1 --2- 172.21.15.33:0/2839801722 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5565866dc110 0x5565866de500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:10.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.875+0000 7f0fe78fd740 4 client.25630 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:32:10.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.875+0000 7f0fe78fd740 1 -- 172.21.15.33:0/2839801722 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55658662ed60 con 0x5565866dc110 2024-09-12T12:32:10.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.879+0000 7f0fdeffd640 1 --2- 172.21.15.33:0/2839801722 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5565866dc110 0x5565866de500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:10.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.887+0000 7f0fc2ff5640 10 client.25630 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:32:10.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.887+0000 7f0fdeffd640 1 --2- 172.21.15.33:0/2839801722 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5565866dc110 0x5565866de500 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7bae386fe7747cc server_cookie=9c37292ae2055336 in_seq=0 out_seq=0 2024-09-12T12:32:10.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.892+0000 7f0fc2ff5640 1 -- 172.21.15.33:0/2839801722 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55658662ed60 con 0x5565866dc110 2024-09-12T12:32:10.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.892+0000 7f0fc2ff5640 10 client.25630 handle_command_reply: tid=0 2024-09-12T12:32:10.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.892+0000 7f0fe78fd740 1 client.25630 shutdown 2024-09-12T12:32:10.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.893+0000 7f0fe78fd740 1 -- 172.21.15.33:0/2839801722 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5565866cc680 msgr2=0x5565866c9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:10.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.893+0000 7f0fe78fd740 1 --2- 172.21.15.33:0/2839801722 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5565866cc680 0x5565866c9840 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0fd800a2a0 tx=0x7f0fd8010950 comp rx=0 tx=0).stop 2024-09-12T12:32:10.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.893+0000 7f0fe78fd740 1 -- 172.21.15.33:0/2839801722 shutdown_connections 2024-09-12T12:32:10.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.893+0000 7f0fe78fd740 1 --2- 172.21.15.33:0/2839801722 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5565866dc110 0x5565866de500 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:10.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.893+0000 7f0fe78fd740 1 --2- 172.21.15.33:0/2839801722 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5565866cc680 0x5565866c9840 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:10.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.893+0000 7f0fe78fd740 1 --2- 172.21.15.33:0/2839801722 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5565866c1dc0 0x5565866c92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:10.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.893+0000 7f0fe78fd740 1 --2- 172.21.15.33:0/2839801722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5565866c14a0 0x5565866cc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:10.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.893+0000 7f0fe78fd740 1 -- 172.21.15.33:0/2839801722 >> 172.21.15.33:0/2839801722 conn(0x5565866bda30 msgr2=0x5565866c3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:32:10.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.893+0000 7f0fc2ff5640 0 client.25630 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:32:10.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.894+0000 7f0fe78fd740 1 -- 172.21.15.33:0/2839801722 shutdown_connections 2024-09-12T12:32:10.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.894+0000 7f0fe78fd740 1 -- 172.21.15.33:0/2839801722 wait complete. 2024-09-12T12:32:10.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.895+0000 7f0fe78fd740 20 client.25630 trim_cache size 0 max 16384 2024-09-12T12:32:10.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.937+0000 7f0fe78fd740 1 Processor -- start 2024-09-12T12:32:10.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.937+0000 7f0fe78fd740 1 -- start start 2024-09-12T12:32:10.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.937+0000 7f0fe78fd740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5565866c14a0 0x5565866bca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:10.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.937+0000 7f0fe78fd740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5565866c1dc0 0x5565866e1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:10.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.938+0000 7f0fde7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5565866c1dc0 0x5565866e1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:10.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.938+0000 7f0fde7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5565866c1dc0 0x5565866e1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43042/0 (socket says 172.21.15.33:43042) 2024-09-12T12:32:10.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.938+0000 7f0fdeffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5565866c14a0 0x5565866bca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:10.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.938+0000 7f0fde7fc640 1 -- 172.21.15.33:0/3362458949 learned_addr learned my addr 172.21.15.33:0/3362458949 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:32:10.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.938+0000 7f0fe78fd740 1 --2- 172.21.15.33:0/3362458949 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5565866cc680 0x5565866e1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:10.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.938+0000 7f0fe78fd740 1 -- 172.21.15.33:0/3362458949 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0fcc012580 con 0x5565866c1dc0 2024-09-12T12:32:10.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.938+0000 7f0fe78fd740 1 -- 172.21.15.33:0/3362458949 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0fcc00fe50 con 0x5565866c14a0 2024-09-12T12:32:10.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.938+0000 7f0fe78fd740 1 -- 172.21.15.33:0/3362458949 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0fcc00dca0 con 0x5565866cc680 2024-09-12T12:32:10.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.939+0000 7f0fdf7fe640 1 --2- 172.21.15.33:0/3362458949 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5565866cc680 0x5565866e1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:10.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.941+0000 7f0fdf7fe640 1 -- 172.21.15.33:0/3362458949 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5565866c14a0 msgr2=0x5565866bca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:10.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.941+0000 7f0fdf7fe640 1 --2- 172.21.15.33:0/3362458949 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5565866c14a0 0x5565866bca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:10.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.941+0000 7f0fdf7fe640 1 -- 172.21.15.33:0/3362458949 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5565866c1dc0 msgr2=0x5565866e1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:10.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.941+0000 7f0fdf7fe640 1 --2- 172.21.15.33:0/3362458949 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5565866c1dc0 0x5565866e1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:10.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.941+0000 7f0fdf7fe640 1 -- 172.21.15.33:0/3362458949 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565866cc380 con 0x5565866cc680 2024-09-12T12:32:10.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.942+0000 7f0fdf7fe640 1 --2- 172.21.15.33:0/3362458949 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5565866cc680 0x5565866e1a60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0fd800fc90 tx=0x7f0fd8010a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d452078459926414 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:32:10.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.943+0000 7f0fc4ff9640 1 -- 172.21.15.33:0/3362458949 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd8026040 con 0x5565866cc680 2024-09-12T12:32:10.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.943+0000 7f0fc4ff9640 1 -- 172.21.15.33:0/3362458949 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0fd800a960 con 0x5565866cc680 2024-09-12T12:32:10.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.943+0000 7f0fc4ff9640 1 -- 172.21.15.33:0/3362458949 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd80188a0 con 0x5565866cc680 2024-09-12T12:32:10.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.945+0000 7f0fe78fd740 1 -- 172.21.15.33:0/3362458949 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5565866cc680 msgr2=0x5565866e1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:10.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.945+0000 7f0fe78fd740 1 --2- 172.21.15.33:0/3362458949 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5565866cc680 0x5565866e1a60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0fd800fc90 tx=0x7f0fd8010a40 comp rx=0 tx=0).stop 2024-09-12T12:32:10.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.947+0000 7f0fe78fd740 1 -- 172.21.15.33:0/3362458949 shutdown_connections 2024-09-12T12:32:10.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.947+0000 7f0fe78fd740 1 --2- 172.21.15.33:0/3362458949 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5565866cc680 0x5565866e1a60 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:10.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.947+0000 7f0fe78fd740 1 --2- 172.21.15.33:0/3362458949 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5565866c1dc0 0x5565866e1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:10.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.947+0000 7f0fe78fd740 1 --2- 172.21.15.33:0/3362458949 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5565866c14a0 0x5565866bca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:10.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.947+0000 7f0fe78fd740 1 -- 172.21.15.33:0/3362458949 >> 172.21.15.33:0/3362458949 conn(0x5565866bda30 msgr2=0x5565866bc350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:32:10.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.949+0000 7f0fe78fd740 1 -- 172.21.15.33:0/3362458949 shutdown_connections 2024-09-12T12:32:10.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.949+0000 7f0fe78fd740 1 -- 172.21.15.33:0/3362458949 wait complete. 2024-09-12T12:32:10.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.950+0000 7f0fe78fd740 1 -- start start 2024-09-12T12:32:10.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.950+0000 7f0fe78fd740 1 Processor -- start 2024-09-12T12:32:10.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.950+0000 7f0fe78fd740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5565866c14a0 0x5565866dec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:10.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.950+0000 7f0fe78fd740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5565866c1dc0 0x5565866df180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:10.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.950+0000 7f0fe78fd740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5565866cc680 0x55658673ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:10.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.950+0000 7f0fe78fd740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0fcc00e310 con 0x5565866c14a0 2024-09-12T12:32:10.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.950+0000 7f0fe78fd740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0fcc00f780 con 0x5565866c1dc0 2024-09-12T12:32:10.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.950+0000 7f0fe78fd740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0fcc00e9e0 con 0x5565866cc680 2024-09-12T12:32:10.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.950+0000 7f0fe78fd740 10 client.0 _ll_register_callbacks cb 0x7f0fd800aba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:32:10.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.951+0000 7f0fde7fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5565866c1dc0 0x5565866df180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:10.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.951+0000 7f0fde7fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5565866c1dc0 0x5565866df180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:50708/0 (socket says 172.21.15.33:50708) 2024-09-12T12:32:10.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.951+0000 7f0fde7fc640 1 -- 172.21.15.33:0/413686894 learned_addr learned my addr 172.21.15.33:0/413686894 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:32:10.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.951+0000 7f0fdf7fe640 1 --2- 172.21.15.33:0/413686894 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5565866cc680 0x55658673ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:10.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.951+0000 7f0fde7fc640 1 -- 172.21.15.33:0/413686894 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5565866cc680 msgr2=0x55658673ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:10.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.951+0000 7f0fde7fc640 1 --2- 172.21.15.33:0/413686894 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5565866cc680 0x55658673ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:10.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.951+0000 7f0fde7fc640 1 -- 172.21.15.33:0/413686894 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5565866c14a0 msgr2=0x5565866dec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:10.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.951+0000 7f0fde7fc640 1 --2- 172.21.15.33:0/413686894 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5565866c14a0 0x5565866dec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:10.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.951+0000 7f0fde7fc640 1 -- 172.21.15.33:0/413686894 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55658673f170 con 0x5565866c1dc0 2024-09-12T12:32:10.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.952+0000 7f0fde7fc640 1 --2- 172.21.15.33:0/413686894 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5565866c1dc0 0x5565866df180 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0fd40dc280 tx=0x7f0fd40ca040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83df04e93dfcf929 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:32:10.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.952+0000 7f0fc2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:32:10.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.952+0000 7f0fc2ff5640 1 -- 172.21.15.33:0/413686894 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd40f7060 con 0x5565866c1dc0 2024-09-12T12:32:10.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.952+0000 7f0fe78fd740 1 -- 172.21.15.33:0/413686894 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0fd800a960 con 0x5565866c1dc0 2024-09-12T12:32:10.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.953+0000 7f0fc2ff5640 1 -- 172.21.15.33:0/413686894 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f0fd40e60b0 con 0x5565866c1dc0 2024-09-12T12:32:10.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.953+0000 7f0fc2ff5640 1 -- 172.21.15.33:0/413686894 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0fd40e8490 con 0x5565866c1dc0 2024-09-12T12:32:10.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.958+0000 7f0fe78fd740 10 client.25544 fetch_fsmap learned FSMap version 27 2024-09-12T12:32:10.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.958+0000 7f0fe78fd740 1 -- 172.21.15.33:0/413686894 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5565867685a0 con 0x5565866c1dc0 2024-09-12T12:32:10.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.963+0000 7f0fc2ff5640 1 -- 172.21.15.33:0/413686894 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0fd800a960 con 0x5565866c1dc0 2024-09-12T12:32:10.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.963+0000 7f0fc2ff5640 1 -- 172.21.15.33:0/413686894 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f0fd400b040 con 0x5565866c1dc0 2024-09-12T12:32:10.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.964+0000 7f0fe78fd740 10 client.25544 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:32:10.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.964+0000 7f0fe78fd740 10 client.25544 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:32:10.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.964+0000 7f0fe78fd740 20 client.25544 populate_metadata read hostname 'smithi033' 2024-09-12T12:32:10.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.964+0000 7f0fe78fd740 1 --2- 172.21.15.33:0/413686894 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x556586768cb0 0x55658676b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:10.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.964+0000 7f0fe78fd740 4 client.25544 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:32:10.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.964+0000 7f0fe78fd740 1 -- 172.21.15.33:0/413686894 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5565865ab210 con 0x556586768cb0 2024-09-12T12:32:10.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.972+0000 7f0fdeffd640 1 --2- 172.21.15.33:0/413686894 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x556586768cb0 0x55658676b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:10.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.981+0000 7f0fc2ff5640 10 client.25544 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:32:10.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.981+0000 7f0fdeffd640 1 --2- 172.21.15.33:0/413686894 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x556586768cb0 0x55658676b0d0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=444b6ca2d665db1f server_cookie=9193a20d209bdfa0 in_seq=0 out_seq=0 2024-09-12T12:32:10.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.982+0000 7f0fc2ff5640 1 -- 172.21.15.33:0/413686894 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5565865ab210 con 0x556586768cb0 2024-09-12T12:32:10.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.982+0000 7f0fc2ff5640 10 client.25544 handle_command_reply: tid=0 2024-09-12T12:32:10.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.982+0000 7f0fe78fd740 1 client.25544 shutdown 2024-09-12T12:32:10.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.984+0000 7f0fe78fd740 1 -- 172.21.15.33:0/413686894 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5565866c1dc0 msgr2=0x5565866df180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:10.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.984+0000 7f0fe78fd740 1 --2- 172.21.15.33:0/413686894 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5565866c1dc0 0x5565866df180 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0fd40dc280 tx=0x7f0fd40ca040 comp rx=0 tx=0).stop 2024-09-12T12:32:10.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.986+0000 7f0fe78fd740 1 -- 172.21.15.33:0/413686894 shutdown_connections 2024-09-12T12:32:10.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.986+0000 7f0fe78fd740 1 --2- 172.21.15.33:0/413686894 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x556586768cb0 0x55658676b0d0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:10.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.986+0000 7f0fe78fd740 1 --2- 172.21.15.33:0/413686894 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5565866cc680 0x55658673ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:10.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.986+0000 7f0fe78fd740 1 --2- 172.21.15.33:0/413686894 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5565866c1dc0 0x5565866df180 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:10.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.986+0000 7f0fe78fd740 1 --2- 172.21.15.33:0/413686894 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5565866c14a0 0x5565866dec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:10.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.986+0000 7f0fe78fd740 1 -- 172.21.15.33:0/413686894 >> 172.21.15.33:0/413686894 conn(0x5565866bda30 msgr2=0x5565866cb340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:32:10.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.986+0000 7f0fc2ff5640 0 client.25544 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:32:10.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.986+0000 7f0fe78fd740 1 -- 172.21.15.33:0/413686894 shutdown_connections 2024-09-12T12:32:10.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.986+0000 7f0fe78fd740 1 -- 172.21.15.33:0/413686894 wait complete. 2024-09-12T12:32:10.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.986+0000 7f0fe78fd740 20 client.25544 trim_cache size 0 max 16384 2024-09-12T12:32:10.987 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:32:10.987 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T12:32:10.988 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": { 2024-09-12T12:32:10.988 INFO:teuthology.orchestra.run.smithi033.stdout: "e0ce731c-a18d-4f54-93f4-dc712b2c709f": { 2024-09-12T12:32:10.988 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-09-12T12:32:10.988 INFO:teuthology.orchestra.run.smithi033.stdout: "tag": "e0ce731c-a18d-4f54-93f4-dc712b2c709f", 2024-09-12T12:32:10.988 INFO:teuthology.orchestra.run.smithi033.stdout: "options": "recursive,force" 2024-09-12T12:32:10.988 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:32:10.988 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:32:10.988 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:32:10.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.988+0000 7f0fe5524640 1 -- 172.21.15.33:0/1689890175 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0fc80a2dd0 msgr2=0x7f0fc80a5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:10.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.988+0000 7f0fe5524640 1 --2- 172.21.15.33:0/1689890175 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0fc80a2dd0 0x7f0fc80a5290 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0fd000b3c0 tx=0x7f0fd000d040 comp rx=0 tx=0).stop 2024-09-12T12:32:10.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.988+0000 7f0fe5524640 1 -- 172.21.15.33:0/1689890175 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fe0100de0 msgr2=0x7f0fe010bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:10.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.988+0000 7f0fe5524640 1 --2- 172.21.15.33:0/1689890175 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fe0100de0 0x7f0fe010bfe0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0fd40058c0 tx=0x7f0fd40048f0 comp rx=0 tx=0).stop 2024-09-12T12:32:10.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.988+0000 7f0fe5524640 1 -- 172.21.15.33:0/1689890175 shutdown_connections 2024-09-12T12:32:10.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.988+0000 7f0fe5524640 1 --2- 172.21.15.33:0/1689890175 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0fc80a2dd0 0x7f0fc80a5290 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:10.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.988+0000 7f0fe5524640 1 --2- 172.21.15.33:0/1689890175 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fe0105560 0x7f0fe010c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:10.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.988+0000 7f0fe5524640 1 --2- 172.21.15.33:0/1689890175 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fe0100de0 0x7f0fe010bfe0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:10.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.988+0000 7f0fe5524640 1 --2- 172.21.15.33:0/1689890175 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fe0100430 0x7f0fe010baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:10.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.988+0000 7f0fe5524640 1 -- 172.21.15.33:0/1689890175 >> 172.21.15.33:0/1689890175 conn(0x7f0fe0077230 msgr2=0x7f0fe0104af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:32:10.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.988+0000 7f0fe5524640 1 -- 172.21.15.33:0/1689890175 shutdown_connections 2024-09-12T12:32:10.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:10.988+0000 7f0fe5524640 1 -- 172.21.15.33:0/1689890175 wait complete. 2024-09-12T12:32:11.717 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:11 smithi033 ceph-mon[31246]: pgmap v535: 129 pgs: 129 active+clean; 10 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 36 MiB/s wr, 599 op/s 2024-09-12T12:32:12.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:11 smithi043 ceph-mon[34144]: pgmap v535: 129 pgs: 129 active+clean; 10 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 36 MiB/s wr, 599 op/s 2024-09-12T12:32:12.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:11 smithi102 ceph-mon[34799]: pgmap v535: 129 pgs: 129 active+clean; 10 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 36 MiB/s wr, 599 op/s 2024-09-12T12:32:13.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:13 smithi033 ceph-mon[31246]: pgmap v536: 129 pgs: 129 active+clean; 10 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 36 MiB/s wr, 601 op/s 2024-09-12T12:32:14.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:13 smithi043 ceph-mon[34144]: pgmap v536: 129 pgs: 129 active+clean; 10 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 36 MiB/s wr, 601 op/s 2024-09-12T12:32:14.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:13 smithi102 ceph-mon[34799]: pgmap v536: 129 pgs: 129 active+clean; 10 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 36 MiB/s wr, 601 op/s 2024-09-12T12:32:15.558 INFO:tasks.cephfs.filesystem:scrub status for tag:e0ce731c-a18d-4f54-93f4-dc712b2c709f - {'path': '/', 'tag': 'e0ce731c-a18d-4f54-93f4-dc712b2c709f', 'options': 'recursive,force'} 2024-09-12T12:32:15.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:15 smithi033 ceph-mon[31246]: pgmap v537: 129 pgs: 129 active+clean; 10 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 40 MiB/s wr, 666 op/s 2024-09-12T12:32:16.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:15 smithi043 ceph-mon[34144]: pgmap v537: 129 pgs: 129 active+clean; 10 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 40 MiB/s wr, 666 op/s 2024-09-12T12:32:16.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:15 smithi102 ceph-mon[34799]: pgmap v537: 129 pgs: 129 active+clean; 10 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 40 MiB/s wr, 666 op/s 2024-09-12T12:32:18.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:17 smithi033 ceph-mon[31246]: pgmap v538: 129 pgs: 129 active+clean; 10 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 33 MiB/s wr, 555 op/s 2024-09-12T12:32:18.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:17 smithi033 ceph-mon[31246]: scrub summary: idle 2024-09-12T12:32:18.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:17 smithi043 ceph-mon[34144]: pgmap v538: 129 pgs: 129 active+clean; 10 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 33 MiB/s wr, 555 op/s 2024-09-12T12:32:18.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:17 smithi043 ceph-mon[34144]: scrub summary: idle 2024-09-12T12:32:18.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:17 smithi102 ceph-mon[34799]: pgmap v538: 129 pgs: 129 active+clean; 10 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 33 MiB/s wr, 555 op/s 2024-09-12T12:32:18.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:17 smithi102 ceph-mon[34799]: scrub summary: idle 2024-09-12T12:32:19.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:18 smithi033 ceph-mon[31246]: scrub summary: idle 2024-09-12T12:32:19.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:18 smithi043 ceph-mon[34144]: scrub summary: idle 2024-09-12T12:32:19.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:18 smithi102 ceph-mon[34799]: scrub summary: idle 2024-09-12T12:32:20.233 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:19 smithi033 ceph-mon[31246]: pgmap v539: 129 pgs: 129 active+clean; 10 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 43 MiB/s wr, 720 op/s 2024-09-12T12:32:20.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:19 smithi043 ceph-mon[34144]: pgmap v539: 129 pgs: 129 active+clean; 10 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 43 MiB/s wr, 720 op/s 2024-09-12T12:32:20.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:19 smithi102 ceph-mon[34799]: pgmap v539: 129 pgs: 129 active+clean; 10 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 43 MiB/s wr, 720 op/s 2024-09-12T12:32:21.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:20 smithi033 ceph-mon[31246]: pgmap v540: 129 pgs: 129 active+clean; 10 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 35 MiB/s wr, 594 op/s 2024-09-12T12:32:21.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:20 smithi043 ceph-mon[34144]: pgmap v540: 129 pgs: 129 active+clean; 10 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 35 MiB/s wr, 594 op/s 2024-09-12T12:32:21.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:20 smithi102 ceph-mon[34799]: pgmap v540: 129 pgs: 129 active+clean; 10 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 35 MiB/s wr, 594 op/s 2024-09-12T12:32:23.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:23 smithi102 ceph-mon[34799]: pgmap v541: 129 pgs: 129 active+clean; 10 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 36 MiB/s wr, 616 op/s 2024-09-12T12:32:23.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:23 smithi033 ceph-mon[31246]: pgmap v541: 129 pgs: 129 active+clean; 10 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 36 MiB/s wr, 616 op/s 2024-09-12T12:32:23.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:23 smithi043 ceph-mon[34144]: pgmap v541: 129 pgs: 129 active+clean; 10 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 36 MiB/s wr, 616 op/s 2024-09-12T12:32:25.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:25 smithi102 ceph-mon[34799]: pgmap v542: 129 pgs: 129 active+clean; 10 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 42 MiB/s wr, 720 op/s 2024-09-12T12:32:25.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:25 smithi033 ceph-mon[31246]: pgmap v542: 129 pgs: 129 active+clean; 10 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 42 MiB/s wr, 720 op/s 2024-09-12T12:32:25.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:25 smithi043 ceph-mon[34144]: pgmap v542: 129 pgs: 129 active+clean; 10 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 42 MiB/s wr, 720 op/s 2024-09-12T12:32:27.397 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:27 smithi102 ceph-mon[34799]: pgmap v543: 129 pgs: 129 active+clean; 10 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 34 MiB/s wr, 585 op/s 2024-09-12T12:32:27.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:27 smithi033 ceph-mon[31246]: pgmap v543: 129 pgs: 129 active+clean; 10 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 34 MiB/s wr, 585 op/s 2024-09-12T12:32:27.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:27 smithi043 ceph-mon[34144]: pgmap v543: 129 pgs: 129 active+clean; 10 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 34 MiB/s wr, 585 op/s 2024-09-12T12:32:29.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:29 smithi033 ceph-mon[31246]: pgmap v544: 129 pgs: 129 active+clean; 10 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 46 MiB/s wr, 787 op/s 2024-09-12T12:32:29.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:29 smithi102 ceph-mon[34799]: pgmap v544: 129 pgs: 129 active+clean; 10 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 46 MiB/s wr, 787 op/s 2024-09-12T12:32:29.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:29 smithi043 ceph-mon[34144]: pgmap v544: 129 pgs: 129 active+clean; 10 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 46 MiB/s wr, 787 op/s 2024-09-12T12:32:31.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:31 smithi102 ceph-mon[34799]: pgmap v545: 129 pgs: 129 active+clean; 10 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 38 MiB/s wr, 652 op/s 2024-09-12T12:32:31.484 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:31 smithi033 ceph-mon[31246]: pgmap v545: 129 pgs: 129 active+clean; 10 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 38 MiB/s wr, 652 op/s 2024-09-12T12:32:31.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:31 smithi043 ceph-mon[34144]: pgmap v545: 129 pgs: 129 active+clean; 10 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 38 MiB/s wr, 652 op/s 2024-09-12T12:32:33.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:33 smithi102 ceph-mon[34799]: pgmap v546: 129 pgs: 129 active+clean; 10 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 39 MiB/s wr, 663 op/s 2024-09-12T12:32:33.482 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:33 smithi033 ceph-mon[31246]: pgmap v546: 129 pgs: 129 active+clean; 10 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 39 MiB/s wr, 663 op/s 2024-09-12T12:32:33.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:33 smithi043 ceph-mon[34144]: pgmap v546: 129 pgs: 129 active+clean; 10 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 39 MiB/s wr, 663 op/s 2024-09-12T12:32:35.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:35 smithi102 ceph-mon[34799]: pgmap v547: 129 pgs: 129 active+clean; 10 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 44 MiB/s wr, 770 op/s 2024-09-12T12:32:35.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:35 smithi033 ceph-mon[31246]: pgmap v547: 129 pgs: 129 active+clean; 10 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 44 MiB/s wr, 770 op/s 2024-09-12T12:32:35.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:35 smithi043 ceph-mon[34144]: pgmap v547: 129 pgs: 129 active+clean; 10 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 44 MiB/s wr, 770 op/s 2024-09-12T12:32:37.417 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:37 smithi043 ceph-mon[34144]: pgmap v548: 129 pgs: 129 active+clean; 10 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 37 MiB/s wr, 636 op/s 2024-09-12T12:32:37.482 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:37 smithi033 ceph-mon[31246]: pgmap v548: 129 pgs: 129 active+clean; 10 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 37 MiB/s wr, 636 op/s 2024-09-12T12:32:37.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:37 smithi102 ceph-mon[34799]: pgmap v548: 129 pgs: 129 active+clean; 10 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 37 MiB/s wr, 636 op/s 2024-09-12T12:32:39.447 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:39 smithi102 ceph-mon[34799]: pgmap v549: 129 pgs: 129 active+clean; 10 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 48 MiB/s wr, 835 op/s 2024-09-12T12:32:39.480 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:39 smithi033 ceph-mon[31246]: pgmap v549: 129 pgs: 129 active+clean; 10 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 48 MiB/s wr, 835 op/s 2024-09-12T12:32:39.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:39 smithi043 ceph-mon[34144]: pgmap v549: 129 pgs: 129 active+clean; 10 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 48 MiB/s wr, 835 op/s 2024-09-12T12:32:41.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:41 smithi033 ceph-mon[31246]: pgmap v550: 129 pgs: 129 active+clean; 10 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 38 MiB/s wr, 664 op/s 2024-09-12T12:32:41.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:41 smithi043 ceph-mon[34144]: pgmap v550: 129 pgs: 129 active+clean; 10 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 38 MiB/s wr, 664 op/s 2024-09-12T12:32:41.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:41 smithi102 ceph-mon[34799]: pgmap v550: 129 pgs: 129 active+clean; 10 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 38 MiB/s wr, 664 op/s 2024-09-12T12:32:43.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:43 smithi033 ceph-mon[31246]: pgmap v551: 129 pgs: 129 active+clean; 10 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 37 MiB/s wr, 652 op/s 2024-09-12T12:32:43.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:43 smithi043 ceph-mon[34144]: pgmap v551: 129 pgs: 129 active+clean; 10 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 37 MiB/s wr, 652 op/s 2024-09-12T12:32:43.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:43 smithi102 ceph-mon[34799]: pgmap v551: 129 pgs: 129 active+clean; 10 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 37 MiB/s wr, 652 op/s 2024-09-12T12:32:45.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:45 smithi033 ceph-mon[31246]: pgmap v552: 129 pgs: 129 active+clean; 10 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 44 MiB/s wr, 765 op/s 2024-09-12T12:32:45.559 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T12:32:45.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:45 smithi043 ceph-mon[34144]: pgmap v552: 129 pgs: 129 active+clean; 10 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 44 MiB/s wr, 765 op/s 2024-09-12T12:32:45.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:45 smithi102 ceph-mon[34799]: pgmap v552: 129 pgs: 129 active+clean; 10 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 44 MiB/s wr, 765 op/s 2024-09-12T12:32:46.285 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:32:46.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.960+0000 7f938879b640 1 -- 172.21.15.33:0/3076556522 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f938010e580 msgr2=0x7f938010e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:46.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.960+0000 7f938879b640 1 --2- 172.21.15.33:0/3076556522 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f938010e580 0x7f938010e960 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f937c009930 tx=0x7f937c02a420 comp rx=0 tx=0).stop 2024-09-12T12:32:46.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.962+0000 7f938879b640 1 -- 172.21.15.33:0/3076556522 shutdown_connections 2024-09-12T12:32:46.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.962+0000 7f938879b640 1 --2- 172.21.15.33:0/3076556522 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f938010d9b0 0x7f9380115510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:46.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.962+0000 7f938879b640 1 --2- 172.21.15.33:0/3076556522 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f938010ef30 0x7f938010d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:46.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.962+0000 7f938879b640 1 --2- 172.21.15.33:0/3076556522 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f938010e580 0x7f938010e960 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:46.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.962+0000 7f938879b640 1 -- 172.21.15.33:0/3076556522 >> 172.21.15.33:0/3076556522 conn(0x7f938006e140 msgr2=0x7f938006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:32:46.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.962+0000 7f938879b640 1 -- 172.21.15.33:0/3076556522 shutdown_connections 2024-09-12T12:32:46.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.965+0000 7f938879b640 1 -- 172.21.15.33:0/3076556522 wait complete. 2024-09-12T12:32:46.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.966+0000 7f938879b640 1 Processor -- start 2024-09-12T12:32:46.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.966+0000 7f938879b640 1 -- start start 2024-09-12T12:32:46.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.967+0000 7f938879b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f938010d9b0 0x7f93801126b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:46.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.967+0000 7f938879b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f938010e580 0x7f9380112bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:46.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.967+0000 7f938879b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f938010ef30 0x7f9380113130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:46.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.967+0000 7f938879b640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9380118100 con 0x7f938010e580 2024-09-12T12:32:46.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.967+0000 7f9386537640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f938010d9b0 0x7f93801126b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:46.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.967+0000 7f9386537640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f938010d9b0 0x7f93801126b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:37432/0 (socket says 172.21.15.33:37432) 2024-09-12T12:32:46.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.967+0000 7f9386537640 1 -- 172.21.15.33:0/3319645053 learned_addr learned my addr 172.21.15.33:0/3319645053 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:32:46.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.967+0000 7f938879b640 1 -- 172.21.15.33:0/3319645053 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9380117f80 con 0x7f938010d9b0 2024-09-12T12:32:46.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.967+0000 7f9386d38640 1 --2- 172.21.15.33:0/3319645053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f938010ef30 0x7f9380113130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:46.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.967+0000 7f938879b640 1 -- 172.21.15.33:0/3319645053 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9380118280 con 0x7f938010ef30 2024-09-12T12:32:46.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.970+0000 7f9385d36640 1 --2- 172.21.15.33:0/3319645053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f938010e580 0x7f9380112bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:46.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.974+0000 7f9385d36640 1 -- 172.21.15.33:0/3319645053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f938010ef30 msgr2=0x7f9380113130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:46.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.974+0000 7f9385d36640 1 --2- 172.21.15.33:0/3319645053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f938010ef30 0x7f9380113130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:46.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.974+0000 7f9385d36640 1 -- 172.21.15.33:0/3319645053 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f938010d9b0 msgr2=0x7f93801126b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:46.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.974+0000 7f9385d36640 1 --2- 172.21.15.33:0/3319645053 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f938010d9b0 0x7f93801126b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:46.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.974+0000 7f9385d36640 1 -- 172.21.15.33:0/3319645053 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9380123fb0 con 0x7f938010e580 2024-09-12T12:32:46.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.974+0000 7f9385d36640 1 --2- 172.21.15.33:0/3319645053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f938010e580 0x7f9380112bf0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f937000e9f0 tx=0x7f937000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:32:46.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.975+0000 7f93777fe640 1 -- 172.21.15.33:0/3319645053 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f937000ccc0 con 0x7f938010e580 2024-09-12T12:32:46.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.975+0000 7f938879b640 1 -- 172.21.15.33:0/3319645053 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93801242a0 con 0x7f938010e580 2024-09-12T12:32:46.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.975+0000 7f938879b640 1 -- 172.21.15.33:0/3319645053 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93801247e0 con 0x7f938010e580 2024-09-12T12:32:46.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.979+0000 7f938ab74740 1 Processor -- start 2024-09-12T12:32:46.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.979+0000 7f93777fe640 1 -- 172.21.15.33:0/3319645053 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f937000ce60 con 0x7f938010e580 2024-09-12T12:32:46.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.979+0000 7f93777fe640 1 -- 172.21.15.33:0/3319645053 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9370004a00 con 0x7f938010e580 2024-09-12T12:32:46.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.980+0000 7f938ab74740 1 -- start start 2024-09-12T12:32:46.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.982+0000 7f938ab74740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557371c424a0 0x557371c42880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:46.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.982+0000 7f938ab74740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557371c42dc0 0x557371c4d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:46.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.982+0000 7f938ab74740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557371c4d680 0x557371c4fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:46.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.982+0000 7f938ab74740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x557371ba82e0 con 0x557371c424a0 2024-09-12T12:32:46.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.982+0000 7f938ab74740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557371b4fce0 con 0x557371c4d680 2024-09-12T12:32:46.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.982+0000 7f938ab74740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557371ba42a0 con 0x557371c42dc0 2024-09-12T12:32:46.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.985+0000 7f9386537640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557371c42dc0 0x557371c4d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:46.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.985+0000 7f9386d38640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557371c424a0 0x557371c42880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:46.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.985+0000 7f9386d38640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557371c424a0 0x557371c42880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39132/0 (socket says 172.21.15.33:39132) 2024-09-12T12:32:46.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.985+0000 7f9386d38640 1 -- 172.21.15.33:0/3942066557 learned_addr learned my addr 172.21.15.33:0/3942066557 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:32:46.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.986+0000 7f9386d38640 1 -- 172.21.15.33:0/3942066557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557371c42dc0 msgr2=0x557371c4d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:46.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.986+0000 7f9386d38640 1 --2- 172.21.15.33:0/3942066557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557371c42dc0 0x557371c4d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:46.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.986+0000 7f9386d38640 1 -- 172.21.15.33:0/3942066557 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557371c4d680 msgr2=0x557371c4fa70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T12:32:46.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.986+0000 7f9386d38640 1 --2- 172.21.15.33:0/3942066557 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557371c4d680 0x557371c4fa70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:46.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.986+0000 7f9386d38640 1 -- 172.21.15.33:0/3942066557 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557371b34440 con 0x557371c424a0 2024-09-12T12:32:46.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.986+0000 7f9386d38640 1 --2- 172.21.15.33:0/3942066557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557371c424a0 0x557371c42880 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f937800aab0 tx=0x7f9378007590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90f22fdbd481c9d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:32:46.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.987+0000 7f93777fe640 1 -- 172.21.15.33:0/3319645053 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9370004020 con 0x7f938010e580 2024-09-12T12:32:46.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.989+0000 7f93777fe640 1 --2- 172.21.15.33:0/3319645053 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f936c0a2d90 0x7f936c0a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:46.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.989+0000 7f9386537640 1 --2- 172.21.15.33:0/3319645053 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f936c0a2d90 0x7f936c0a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:46.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.989+0000 7f93777fe640 1 -- 172.21.15.33:0/3319645053 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f93700ceff0 con 0x7f938010e580 2024-09-12T12:32:46.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:46.989+0000 7f9386537640 1 --2- 172.21.15.33:0/3319645053 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f936c0a2d90 0x7f936c0a5250 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x557371c3f890 tx=0x7f937c009620 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:32:47.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.002+0000 7f9374ff9640 1 -- 172.21.15.33:0/3942066557 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9378003b70 con 0x557371c424a0 2024-09-12T12:32:47.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.002+0000 7f9374ff9640 1 -- 172.21.15.33:0/3942066557 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9378007e20 con 0x557371c424a0 2024-09-12T12:32:47.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.002+0000 7f9374ff9640 1 -- 172.21.15.33:0/3942066557 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93780043b0 con 0x557371c424a0 2024-09-12T12:32:47.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.005+0000 7f938ab74740 1 -- 172.21.15.33:0/3942066557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557371c424a0 msgr2=0x557371c42880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:47.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.005+0000 7f938ab74740 1 --2- 172.21.15.33:0/3942066557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557371c424a0 0x557371c42880 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f937800aab0 tx=0x7f9378007590 comp rx=0 tx=0).stop 2024-09-12T12:32:47.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.006+0000 7f938ab74740 1 -- 172.21.15.33:0/3942066557 shutdown_connections 2024-09-12T12:32:47.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.006+0000 7f938ab74740 1 --2- 172.21.15.33:0/3942066557 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557371c4d680 0x557371c4fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:47.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.006+0000 7f938ab74740 1 --2- 172.21.15.33:0/3942066557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557371c42dc0 0x557371c4d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:47.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.006+0000 7f938ab74740 1 --2- 172.21.15.33:0/3942066557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557371c424a0 0x557371c42880 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:47.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.006+0000 7f938ab74740 1 -- 172.21.15.33:0/3942066557 >> 172.21.15.33:0/3942066557 conn(0x557371c3ea30 msgr2=0x557371c3ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:32:47.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.008+0000 7f938ab74740 1 -- 172.21.15.33:0/3942066557 shutdown_connections 2024-09-12T12:32:47.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.010+0000 7f938ab74740 1 -- 172.21.15.33:0/3942066557 wait complete. 2024-09-12T12:32:47.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.010+0000 7f938ab74740 1 -- start start 2024-09-12T12:32:47.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.011+0000 7f938ab74740 1 Processor -- start 2024-09-12T12:32:47.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.011+0000 7f938ab74740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557371c424a0 0x557371c4d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:47.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.011+0000 7f938ab74740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557371c42dc0 0x557371c4a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:47.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.011+0000 7f938ab74740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557371c4d680 0x557371c4a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:47.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.011+0000 7f938ab74740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x557371c50250 con 0x557371c424a0 2024-09-12T12:32:47.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.011+0000 7f938ab74740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557371b63050 con 0x557371c42dc0 2024-09-12T12:32:47.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.011+0000 7f938ab74740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557371c503d0 con 0x557371c4d680 2024-09-12T12:32:47.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.011+0000 7f938ab74740 10 client.0 _ll_register_callbacks cb 0x557371ba3160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:32:47.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.012+0000 7f9386d38640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557371c4d680 0x557371c4a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:47.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.012+0000 7f9386d38640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557371c4d680 0x557371c4a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:38284/0 (socket says 172.21.15.33:38284) 2024-09-12T12:32:47.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.012+0000 7f9386d38640 1 -- 172.21.15.33:0/1823184525 learned_addr learned my addr 172.21.15.33:0/1823184525 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:32:47.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.012+0000 7f9385d36640 1 --2- 172.21.15.33:0/1823184525 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557371c42dc0 0x557371c4a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:47.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.013+0000 7f9386537640 1 --2- 172.21.15.33:0/1823184525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557371c424a0 0x557371c4d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:47.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.014+0000 7f9386537640 1 -- 172.21.15.33:0/1823184525 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557371c4d680 msgr2=0x557371c4a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:47.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.014+0000 7f9386537640 1 --2- 172.21.15.33:0/1823184525 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557371c4d680 0x557371c4a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:47.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.014+0000 7f9386537640 1 -- 172.21.15.33:0/1823184525 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557371c42dc0 msgr2=0x557371c4a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:47.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.014+0000 7f9386537640 1 --2- 172.21.15.33:0/1823184525 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557371c42dc0 0x557371c4a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:47.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.014+0000 7f9386537640 1 -- 172.21.15.33:0/1823184525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573719193c0 con 0x557371c424a0 2024-09-12T12:32:47.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.027+0000 7f9386537640 1 --2- 172.21.15.33:0/1823184525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557371c424a0 0x557371c4d030 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f937c006010 tx=0x7f937c02a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93c43ad020d6222 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:32:47.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.027+0000 7f9369ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:32:47.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.028+0000 7f9369ffb640 1 -- 172.21.15.33:0/1823184525 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f937c04d020 con 0x557371c424a0 2024-09-12T12:32:47.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.028+0000 7f9369ffb640 1 -- 172.21.15.33:0/1823184525 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f937c004980 con 0x557371c424a0 2024-09-12T12:32:47.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.028+0000 7f938ab74740 1 -- 172.21.15.33:0/1823184525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9378007e20 con 0x557371c424a0 2024-09-12T12:32:47.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.035+0000 7f9369ffb640 1 -- 172.21.15.33:0/1823184525 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f937c035040 con 0x557371c424a0 2024-09-12T12:32:47.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.035+0000 7f938ab74740 10 client.15873 fetch_fsmap learned FSMap version 27 2024-09-12T12:32:47.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.035+0000 7f938ab74740 1 -- 172.21.15.33:0/1823184525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557371c5bcf0 con 0x557371c424a0 2024-09-12T12:32:47.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.047+0000 7f9369ffb640 1 -- 172.21.15.33:0/1823184525 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9378007e20 con 0x557371c424a0 2024-09-12T12:32:47.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.047+0000 7f9369ffb640 1 -- 172.21.15.33:0/1823184525 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f937c0324b0 con 0x557371c424a0 2024-09-12T12:32:47.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.047+0000 7f938ab74740 10 client.15873 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:32:47.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.047+0000 7f938ab74740 10 client.15873 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:32:47.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.047+0000 7f938ab74740 20 client.15873 populate_metadata read hostname 'smithi033' 2024-09-12T12:32:47.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.047+0000 7f938ab74740 1 --2- 172.21.15.33:0/1823184525 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x557371c5d590 0x557371c5f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:47.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.047+0000 7f938ab74740 4 client.15873 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:32:47.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.047+0000 7f938ab74740 1 -- 172.21.15.33:0/1823184525 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557371bb5850 con 0x557371c5d590 2024-09-12T12:32:47.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.054+0000 7f9385d36640 1 --2- 172.21.15.33:0/1823184525 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x557371c5d590 0x557371c5f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:47.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.057+0000 7f9369ffb640 10 client.15873 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:32:47.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.057+0000 7f9385d36640 1 --2- 172.21.15.33:0/1823184525 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x557371c5d590 0x557371c5f9b0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb8345070047ea44 server_cookie=4ed2952e0b3700bf in_seq=0 out_seq=0 2024-09-12T12:32:47.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.058+0000 7f9369ffb640 1 -- 172.21.15.33:0/1823184525 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557371bb5850 con 0x557371c5d590 2024-09-12T12:32:47.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.058+0000 7f9369ffb640 10 client.15873 handle_command_reply: tid=0 2024-09-12T12:32:47.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.058+0000 7f938ab74740 1 client.15873 shutdown 2024-09-12T12:32:47.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.059+0000 7f938ab74740 1 -- 172.21.15.33:0/1823184525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557371c424a0 msgr2=0x557371c4d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:47.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.059+0000 7f938ab74740 1 --2- 172.21.15.33:0/1823184525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557371c424a0 0x557371c4d030 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f937c006010 tx=0x7f937c02a420 comp rx=0 tx=0).stop 2024-09-12T12:32:47.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.063+0000 7f938ab74740 1 -- 172.21.15.33:0/1823184525 shutdown_connections 2024-09-12T12:32:47.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.063+0000 7f938ab74740 1 --2- 172.21.15.33:0/1823184525 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x557371c5d590 0x557371c5f9b0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:47.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.063+0000 7f938ab74740 1 --2- 172.21.15.33:0/1823184525 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557371c4d680 0x557371c4a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:47.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.063+0000 7f938ab74740 1 --2- 172.21.15.33:0/1823184525 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557371c42dc0 0x557371c4a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:47.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.063+0000 7f938ab74740 1 --2- 172.21.15.33:0/1823184525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557371c424a0 0x557371c4d030 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:47.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.063+0000 7f9369ffb640 0 client.15873 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:32:47.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.063+0000 7f938ab74740 1 -- 172.21.15.33:0/1823184525 >> 172.21.15.33:0/1823184525 conn(0x557371c3ea30 msgr2=0x557371c44760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:32:47.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.063+0000 7f938ab74740 1 -- 172.21.15.33:0/1823184525 shutdown_connections 2024-09-12T12:32:47.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.063+0000 7f938ab74740 1 -- 172.21.15.33:0/1823184525 wait complete. 2024-09-12T12:32:47.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.064+0000 7f938ab74740 20 client.15873 trim_cache size 0 max 16384 2024-09-12T12:32:47.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.098+0000 7f938ab74740 1 Processor -- start 2024-09-12T12:32:47.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.098+0000 7f938ab74740 1 -- start start 2024-09-12T12:32:47.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.098+0000 7f938ab74740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557371c424a0 0x557371c59540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:47.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.098+0000 7f938ab74740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557371c42dc0 0x557371c652c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:47.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.098+0000 7f938ab74740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557371c4d680 0x557371c65800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:47.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.099+0000 7f938ab74740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f93640124b0 con 0x557371c4d680 2024-09-12T12:32:47.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.099+0000 7f938ab74740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f936400fd80 con 0x557371c42dc0 2024-09-12T12:32:47.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.099+0000 7f938ab74740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f936400dbd0 con 0x557371c424a0 2024-09-12T12:32:47.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.099+0000 7f9385d36640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557371c42dc0 0x557371c652c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:47.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.099+0000 7f9386d38640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557371c4d680 0x557371c65800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:47.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.099+0000 7f9385d36640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557371c42dc0 0x557371c652c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:37448/0 (socket says 172.21.15.33:37448) 2024-09-12T12:32:47.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.099+0000 7f9385d36640 1 -- 172.21.15.33:0/2457551000 learned_addr learned my addr 172.21.15.33:0/2457551000 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:32:47.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.100+0000 7f9385d36640 1 -- 172.21.15.33:0/2457551000 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557371c424a0 msgr2=0x557371c59540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:47.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.100+0000 7f9385d36640 1 --2- 172.21.15.33:0/2457551000 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557371c424a0 0x557371c59540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:47.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.100+0000 7f9385d36640 1 -- 172.21.15.33:0/2457551000 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557371c4d680 msgr2=0x557371c65800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:47.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.100+0000 7f9385d36640 1 --2- 172.21.15.33:0/2457551000 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557371c4d680 0x557371c65800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:47.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.100+0000 7f9385d36640 1 -- 172.21.15.33:0/2457551000 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557371c4abf0 con 0x557371c42dc0 2024-09-12T12:32:47.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.100+0000 7f9385d36640 1 --2- 172.21.15.33:0/2457551000 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557371c42dc0 0x557371c652c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f937009b160 tx=0x7f93700cc5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2231c67adaf4b548 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:32:47.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.100+0000 7f936bfff640 1 -- 172.21.15.33:0/2457551000 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f937001c040 con 0x557371c42dc0 2024-09-12T12:32:47.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.100+0000 7f936bfff640 1 -- 172.21.15.33:0/2457551000 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f937009b460 con 0x557371c42dc0 2024-09-12T12:32:47.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.101+0000 7f938ab74740 1 -- 172.21.15.33:0/2457551000 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557371c42dc0 msgr2=0x557371c652c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:47.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.101+0000 7f938ab74740 1 --2- 172.21.15.33:0/2457551000 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557371c42dc0 0x557371c652c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f937009b160 tx=0x7f93700cc5d0 comp rx=0 tx=0).stop 2024-09-12T12:32:47.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.105+0000 7f938ab74740 1 -- 172.21.15.33:0/2457551000 shutdown_connections 2024-09-12T12:32:47.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.105+0000 7f938ab74740 1 --2- 172.21.15.33:0/2457551000 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557371c4d680 0x557371c65800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:47.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.105+0000 7f938ab74740 1 --2- 172.21.15.33:0/2457551000 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557371c42dc0 0x557371c652c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:47.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.105+0000 7f938ab74740 1 --2- 172.21.15.33:0/2457551000 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557371c424a0 0x557371c59540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:47.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.105+0000 7f938ab74740 1 -- 172.21.15.33:0/2457551000 >> 172.21.15.33:0/2457551000 conn(0x557371c3ea30 msgr2=0x557371c45900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:32:47.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.106+0000 7f938ab74740 1 -- 172.21.15.33:0/2457551000 shutdown_connections 2024-09-12T12:32:47.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.107+0000 7f938ab74740 1 -- 172.21.15.33:0/2457551000 wait complete. 2024-09-12T12:32:47.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.107+0000 7f938ab74740 1 -- start start 2024-09-12T12:32:47.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.107+0000 7f938ab74740 1 Processor -- start 2024-09-12T12:32:47.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.108+0000 7f938ab74740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557371c424a0 0x557371c556b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:47.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.108+0000 7f938ab74740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557371c42dc0 0x557371c55bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:47.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.108+0000 7f938ab74740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557371c4d680 0x557371c52680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:47.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.108+0000 7f938ab74740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f936400e240 con 0x557371c424a0 2024-09-12T12:32:47.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.108+0000 7f938ab74740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f936400f6b0 con 0x557371c4d680 2024-09-12T12:32:47.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.108+0000 7f938ab74740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f936400e910 con 0x557371c42dc0 2024-09-12T12:32:47.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.108+0000 7f938ab74740 10 client.0 _ll_register_callbacks cb 0x7f937c040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:32:47.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.109+0000 7f9386d38640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557371c4d680 0x557371c52680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:47.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.109+0000 7f9386d38640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557371c4d680 0x557371c52680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:37464/0 (socket says 172.21.15.33:37464) 2024-09-12T12:32:47.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.109+0000 7f9386d38640 1 -- 172.21.15.33:0/3408596847 learned_addr learned my addr 172.21.15.33:0/3408596847 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:32:47.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.109+0000 7f9385d36640 1 --2- 172.21.15.33:0/3408596847 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557371c42dc0 0x557371c55bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:47.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.109+0000 7f9386537640 1 --2- 172.21.15.33:0/3408596847 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557371c424a0 0x557371c556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:47.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.110+0000 7f9385d36640 1 -- 172.21.15.33:0/3408596847 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557371c4d680 msgr2=0x557371c52680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:47.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.110+0000 7f9385d36640 1 --2- 172.21.15.33:0/3408596847 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557371c4d680 0x557371c52680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:47.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.110+0000 7f9385d36640 1 -- 172.21.15.33:0/3408596847 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557371c424a0 msgr2=0x557371c556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:47.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.110+0000 7f9385d36640 1 --2- 172.21.15.33:0/3408596847 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557371c424a0 0x557371c556b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:47.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.110+0000 7f9385d36640 1 -- 172.21.15.33:0/3408596847 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557371c52bc0 con 0x557371c42dc0 2024-09-12T12:32:47.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.110+0000 7f9385d36640 1 --2- 172.21.15.33:0/3408596847 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557371c42dc0 0x557371c55bf0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9370005c20 tx=0x7f9370004580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a49f3ac5112c684 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:32:47.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.110+0000 7f9369ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:32:47.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.110+0000 7f9369ffb640 1 -- 172.21.15.33:0/3408596847 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93700b9060 con 0x557371c42dc0 2024-09-12T12:32:47.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.111+0000 7f938ab74740 1 -- 172.21.15.33:0/3408596847 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f937009b460 con 0x557371c42dc0 2024-09-12T12:32:47.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.111+0000 7f9369ffb640 1 -- 172.21.15.33:0/3408596847 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f9370097ad0 con 0x557371c42dc0 2024-09-12T12:32:47.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.111+0000 7f9369ffb640 1 -- 172.21.15.33:0/3408596847 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f937001c040 con 0x557371c42dc0 2024-09-12T12:32:47.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.121+0000 7f938ab74740 10 client.25648 fetch_fsmap learned FSMap version 27 2024-09-12T12:32:47.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.121+0000 7f938ab74740 1 -- 172.21.15.33:0/3408596847 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557371cc8ad0 con 0x557371c42dc0 2024-09-12T12:32:47.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.122+0000 7f9369ffb640 1 -- 172.21.15.33:0/3408596847 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f937009b460 con 0x557371c42dc0 2024-09-12T12:32:47.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.122+0000 7f9369ffb640 1 -- 172.21.15.33:0/3408596847 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f93700a3d50 con 0x557371c42dc0 2024-09-12T12:32:47.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.126+0000 7f938ab74740 10 client.25648 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:32:47.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.126+0000 7f938ab74740 10 client.25648 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:32:47.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.126+0000 7f938ab74740 20 client.25648 populate_metadata read hostname 'smithi033' 2024-09-12T12:32:47.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.126+0000 7f938ab74740 1 --2- 172.21.15.33:0/3408596847 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x557371cc9070 0x557371ccb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:47.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.126+0000 7f938ab74740 4 client.25648 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:32:47.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.126+0000 7f938ab74740 1 -- 172.21.15.33:0/3408596847 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557371bafd60 con 0x557371cc9070 2024-09-12T12:32:47.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.127+0000 7f9386537640 1 --2- 172.21.15.33:0/3408596847 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x557371cc9070 0x557371ccb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:47.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.130+0000 7f9386537640 1 --2- 172.21.15.33:0/3408596847 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x557371cc9070 0x557371ccb490 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98ee37461b2a8a2 server_cookie=ed9bc10ee2d44133 in_seq=0 out_seq=0 2024-09-12T12:32:47.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.130+0000 7f9369ffb640 10 client.25648 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:32:47.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.133+0000 7f9369ffb640 1 -- 172.21.15.33:0/3408596847 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x557371bafd60 con 0x557371cc9070 2024-09-12T12:32:47.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.133+0000 7f9369ffb640 10 client.25648 handle_command_reply: tid=0 2024-09-12T12:32:47.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.133+0000 7f938ab74740 1 client.25648 shutdown 2024-09-12T12:32:47.135 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:32:47.135 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "no active scrubs running", 2024-09-12T12:32:47.135 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": {} 2024-09-12T12:32:47.135 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:32:47.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.133+0000 7f938ab74740 1 -- 172.21.15.33:0/3408596847 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557371c42dc0 msgr2=0x557371c55bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:47.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.133+0000 7f938ab74740 1 --2- 172.21.15.33:0/3408596847 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557371c42dc0 0x557371c55bf0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9370005c20 tx=0x7f9370004580 comp rx=0 tx=0).stop 2024-09-12T12:32:47.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.133+0000 7f938ab74740 1 -- 172.21.15.33:0/3408596847 shutdown_connections 2024-09-12T12:32:47.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.133+0000 7f938ab74740 1 --2- 172.21.15.33:0/3408596847 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x557371cc9070 0x557371ccb490 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:47.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.133+0000 7f938ab74740 1 --2- 172.21.15.33:0/3408596847 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557371c4d680 0x557371c52680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:47.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.133+0000 7f938ab74740 1 --2- 172.21.15.33:0/3408596847 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557371c42dc0 0x557371c55bf0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:47.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.133+0000 7f938ab74740 1 --2- 172.21.15.33:0/3408596847 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557371c424a0 0x557371c556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:47.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.133+0000 7f938ab74740 1 -- 172.21.15.33:0/3408596847 >> 172.21.15.33:0/3408596847 conn(0x557371c3ea30 msgr2=0x557371c43ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:32:47.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.133+0000 7f9369ffb640 0 client.25648 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:32:47.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.134+0000 7f938ab74740 1 -- 172.21.15.33:0/3408596847 shutdown_connections 2024-09-12T12:32:47.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.134+0000 7f938ab74740 1 -- 172.21.15.33:0/3408596847 wait complete. 2024-09-12T12:32:47.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.134+0000 7f938ab74740 20 client.25648 trim_cache size 0 max 16384 2024-09-12T12:32:47.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.135+0000 7f938879b640 1 -- 172.21.15.33:0/3319645053 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f936c0a2d90 msgr2=0x7f936c0a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:47.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.135+0000 7f938879b640 1 --2- 172.21.15.33:0/3319645053 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f936c0a2d90 0x7f936c0a5250 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x557371c3f890 tx=0x7f937c009620 comp rx=0 tx=0).stop 2024-09-12T12:32:47.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.135+0000 7f938879b640 1 -- 172.21.15.33:0/3319645053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f938010e580 msgr2=0x7f9380112bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:47.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.135+0000 7f938879b640 1 --2- 172.21.15.33:0/3319645053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f938010e580 0x7f9380112bf0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f937000e9f0 tx=0x7f937000edf0 comp rx=0 tx=0).stop 2024-09-12T12:32:47.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.136+0000 7f938879b640 1 -- 172.21.15.33:0/3319645053 shutdown_connections 2024-09-12T12:32:47.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.136+0000 7f938879b640 1 --2- 172.21.15.33:0/3319645053 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f936c0a2d90 0x7f936c0a5250 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:47.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.136+0000 7f938879b640 1 --2- 172.21.15.33:0/3319645053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f938010ef30 0x7f9380113130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:47.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.136+0000 7f938879b640 1 --2- 172.21.15.33:0/3319645053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f938010e580 0x7f9380112bf0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:47.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.136+0000 7f938879b640 1 --2- 172.21.15.33:0/3319645053 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f938010d9b0 0x7f93801126b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:47.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.136+0000 7f938879b640 1 -- 172.21.15.33:0/3319645053 >> 172.21.15.33:0/3319645053 conn(0x7f938006e140 msgr2=0x7f9380109740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:32:47.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.136+0000 7f938879b640 1 -- 172.21.15.33:0/3319645053 shutdown_connections 2024-09-12T12:32:47.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:47.136+0000 7f938879b640 1 -- 172.21.15.33:0/3319645053 wait complete. 2024-09-12T12:32:47.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:47 smithi033 ceph-mon[31246]: pgmap v553: 129 pgs: 129 active+clean; 10 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 36 MiB/s wr, 623 op/s 2024-09-12T12:32:47.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:47 smithi043 ceph-mon[34144]: pgmap v553: 129 pgs: 129 active+clean; 10 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 36 MiB/s wr, 623 op/s 2024-09-12T12:32:47.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:47 smithi102 ceph-mon[34799]: pgmap v553: 129 pgs: 129 active+clean; 10 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 36 MiB/s wr, 623 op/s 2024-09-12T12:32:48.311 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T12:32:48.311 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:32:48.988 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:32:49.482 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:49 smithi033 ceph-mon[31246]: pgmap v554: 129 pgs: 129 active+clean; 10 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 45 MiB/s wr, 793 op/s 2024-09-12T12:32:49.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:49 smithi043 ceph-mon[34144]: pgmap v554: 129 pgs: 129 active+clean; 10 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 45 MiB/s wr, 793 op/s 2024-09-12T12:32:49.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:49 smithi102 ceph-mon[34799]: pgmap v554: 129 pgs: 129 active+clean; 10 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 45 MiB/s wr, 793 op/s 2024-09-12T12:32:49.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:49.805+0000 7f7a22b4a640 1 -- 172.21.15.33:0/1540221589 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a1c11b140 msgr2=0x7f7a1c11d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:49.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:49.805+0000 7f7a22b4a640 1 --2- 172.21.15.33:0/1540221589 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a1c11b140 0x7f7a1c11d530 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7a1401acb0 tx=0x7f7a1403b920 comp rx=0 tx=0).stop 2024-09-12T12:32:49.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:49.808+0000 7f7a22b4a640 1 -- 172.21.15.33:0/1540221589 shutdown_connections 2024-09-12T12:32:49.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:49.808+0000 7f7a22b4a640 1 --2- 172.21.15.33:0/1540221589 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a1c11b140 0x7f7a1c11d530 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:49.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:49.808+0000 7f7a22b4a640 1 --2- 172.21.15.33:0/1540221589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7a1c109830 0x7f7a1c109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:49.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:49.808+0000 7f7a22b4a640 1 --2- 172.21.15.33:0/1540221589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a1c109450 0x7f7a1c110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:49.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:49.808+0000 7f7a22b4a640 1 -- 172.21.15.33:0/1540221589 >> 172.21.15.33:0/1540221589 conn(0x7f7a1c06e140 msgr2=0x7f7a1c06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:32:49.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:49.808+0000 7f7a22b4a640 1 -- 172.21.15.33:0/1540221589 shutdown_connections 2024-09-12T12:32:49.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:49.808+0000 7f7a22b4a640 1 -- 172.21.15.33:0/1540221589 wait complete. 2024-09-12T12:32:49.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:49.809+0000 7f7a22b4a640 1 Processor -- start 2024-09-12T12:32:49.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:49.813+0000 7f7a22b4a640 1 -- start start 2024-09-12T12:32:49.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:49.813+0000 7f7a22b4a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7a1c109450 0x7f7a1c11a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:49.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:49.813+0000 7f7a22b4a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a1c109830 0x7f7a1c116770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:49.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:49.813+0000 7f7a22b4a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a1c11b140 0x7f7a1c116cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:49.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:49.813+0000 7f7a22b4a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1c1131f0 con 0x7f7a1c11b140 2024-09-12T12:32:49.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:49.813+0000 7f7a22b4a640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1c113070 con 0x7f7a1c109830 2024-09-12T12:32:49.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:49.813+0000 7f7a22b4a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1c113370 con 0x7f7a1c109450 2024-09-12T12:32:49.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:49.817+0000 7f7a210e7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a1c11b140 0x7f7a1c116cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:49.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:49.817+0000 7f7a210e7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a1c11b140 0x7f7a1c116cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39198/0 (socket says 172.21.15.33:39198) 2024-09-12T12:32:49.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:49.817+0000 7f7a210e7640 1 -- 172.21.15.33:0/2689692612 learned_addr learned my addr 172.21.15.33:0/2689692612 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:32:49.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:49.817+0000 7f7a208e6640 1 --2- 172.21.15.33:0/2689692612 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7a1c109450 0x7f7a1c11a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:49.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:49.818+0000 7f7a210e7640 1 -- 172.21.15.33:0/2689692612 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7a1c109450 msgr2=0x7f7a1c11a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:49.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:49.818+0000 7f7a210e7640 1 --2- 172.21.15.33:0/2689692612 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7a1c109450 0x7f7a1c11a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:49.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:49.818+0000 7f7a210e7640 1 -- 172.21.15.33:0/2689692612 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a1c109830 msgr2=0x7f7a1c116770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:49.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:49.818+0000 7f7a210e7640 1 --2- 172.21.15.33:0/2689692612 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a1c109830 0x7f7a1c116770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:49.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:49.818+0000 7f7a210e7640 1 -- 172.21.15.33:0/2689692612 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a1c1171f0 con 0x7f7a1c11b140 2024-09-12T12:32:49.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:49.819+0000 7f7a210e7640 1 --2- 172.21.15.33:0/2689692612 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a1c11b140 0x7f7a1c116cb0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7a14005e30 tx=0x7f7a14040610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:32:49.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:49.820+0000 7f7a19ffb640 1 -- 172.21.15.33:0/2689692612 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a14045070 con 0x7f7a1c11b140 2024-09-12T12:32:49.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:49.820+0000 7f7a19ffb640 1 -- 172.21.15.33:0/2689692612 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7a14040d10 con 0x7f7a1c11b140 2024-09-12T12:32:49.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:49.820+0000 7f7a22b4a640 1 -- 172.21.15.33:0/2689692612 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a1c117480 con 0x7f7a1c11b140 2024-09-12T12:32:49.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:49.820+0000 7f7a19ffb640 1 -- 172.21.15.33:0/2689692612 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a140044a0 con 0x7f7a1c11b140 2024-09-12T12:32:49.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:49.820+0000 7f7a22b4a640 1 -- 172.21.15.33:0/2689692612 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a1c1ab3a0 con 0x7f7a1c11b140 2024-09-12T12:32:49.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:49.822+0000 7f7a22b4a640 1 -- 172.21.15.33:0/2689692612 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a08005290 con 0x7f7a1c11b140 2024-09-12T12:32:49.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:49.826+0000 7f7a19ffb640 1 -- 172.21.15.33:0/2689692612 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7a14048020 con 0x7f7a1c11b140 2024-09-12T12:32:49.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:49.827+0000 7f7a19ffb640 1 --2- 172.21.15.33:0/2689692612 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f7a040a2c80 0x7f7a040a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:49.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:49.828+0000 7f7a19ffb640 1 -- 172.21.15.33:0/2689692612 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f7a14100f90 con 0x7f7a1c11b140 2024-09-12T12:32:49.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:49.836+0000 7f7a208e6640 1 --2- 172.21.15.33:0/2689692612 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f7a040a2c80 0x7f7a040a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:49.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:49.837+0000 7f7a208e6640 1 --2- 172.21.15.33:0/2689692612 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f7a040a2c80 0x7f7a040a5140 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c005fd0 tx=0x7f7a0c00a400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:32:49.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:49.838+0000 7f7a19ffb640 1 -- 172.21.15.33:0/2689692612 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7a1403e070 con 0x7f7a1c11b140 2024-09-12T12:32:50.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:50.255+0000 7f7a22b4a640 1 -- 172.21.15.33:0/2689692612 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7a08005580 con 0x7f7a1c11b140 2024-09-12T12:32:50.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:50.258+0000 7f7a19ffb640 1 -- 172.21.15.33:0/2689692612 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11912 (secure 0 0 0) 0x7f7a140cdb00 con 0x7f7a1c11b140 2024-09-12T12:32:50.261 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:32:50.261 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":27,"btime":"2024-09-12T12:29:38:065241+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3327066342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3327066342},{"type":"v1","addr":"172.21.15.33:6835","nonce":3327066342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/19516401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":19516401},{"type":"v1","addr":"172.21.15.33:6837","nonce":19516401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1260196118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1260196118},{"type":"v1","addr":"172.21.15.33:6839","nonce":1260196118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/4288248356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4288248356},{"type":"v1","addr":"172.21.15.33:6841","nonce":4288248356}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/3051073141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3051073141},{"type":"v1","addr":"172.21.15.43:6833","nonce":3051073141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3282762800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3282762800},{"type":"v1","addr":"172.21.15.43:6835","nonce":3282762800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:23:46.400609+0000","modified":"2024-09-12T12:29:37.555614+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24490,"mds_2":24478},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3051713000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3051713000},{"type":"v1","addr":"172.21.15.102:6833","nonce":3051713000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6837/2472064883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2472064883},{"type":"v1","addr":"172.21.15.43:6837","nonce":2472064883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/1987408860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":1987408860},{"type":"v1","addr":"172.21.15.43:6839","nonce":1987408860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/4179527539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":4179527539},{"type":"v1","addr":"172.21.15.102:6835","nonce":4179527539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/2409953270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2409953270},{"type":"v1","addr":"172.21.15.102:6837","nonce":2409953270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.102:6839/1553271340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":1553271340},{"type":"v1","addr":"172.21.15.102:6839","nonce":1553271340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24499,"qdb_cluster":[24499,24490,24478]},"id":1}]} 2024-09-12T12:32:50.262 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 27 2024-09-12T12:32:50.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:50.262+0000 7f7a22b4a640 1 -- 172.21.15.33:0/2689692612 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f7a040a2c80 msgr2=0x7f7a040a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:50.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:50.262+0000 7f7a22b4a640 1 --2- 172.21.15.33:0/2689692612 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f7a040a2c80 0x7f7a040a5140 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c005fd0 tx=0x7f7a0c00a400 comp rx=0 tx=0).stop 2024-09-12T12:32:50.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:50.262+0000 7f7a22b4a640 1 -- 172.21.15.33:0/2689692612 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a1c11b140 msgr2=0x7f7a1c116cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:50.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:50.263+0000 7f7a22b4a640 1 --2- 172.21.15.33:0/2689692612 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a1c11b140 0x7f7a1c116cb0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7a14005e30 tx=0x7f7a14040610 comp rx=0 tx=0).stop 2024-09-12T12:32:50.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:50.263+0000 7f7a22b4a640 1 -- 172.21.15.33:0/2689692612 shutdown_connections 2024-09-12T12:32:50.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:50.263+0000 7f7a22b4a640 1 --2- 172.21.15.33:0/2689692612 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f7a040a2c80 0x7f7a040a5140 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:50.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:50.263+0000 7f7a22b4a640 1 --2- 172.21.15.33:0/2689692612 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a1c11b140 0x7f7a1c116cb0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:50.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:50.263+0000 7f7a22b4a640 1 --2- 172.21.15.33:0/2689692612 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a1c109830 0x7f7a1c116770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:50.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:50.263+0000 7f7a22b4a640 1 --2- 172.21.15.33:0/2689692612 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7a1c109450 0x7f7a1c11a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:50.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:50.263+0000 7f7a22b4a640 1 -- 172.21.15.33:0/2689692612 >> 172.21.15.33:0/2689692612 conn(0x7f7a1c06e140 msgr2=0x7f7a1c070ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:32:50.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:50.266+0000 7f7a22b4a640 1 -- 172.21.15.33:0/2689692612 shutdown_connections 2024-09-12T12:32:50.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:50.266+0000 7f7a22b4a640 1 -- 172.21.15.33:0/2689692612 wait complete. 2024-09-12T12:32:51.080 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T12:32:51.482 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:51 smithi033 ceph-mon[31246]: pgmap v555: 129 pgs: 129 active+clean; 10 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 36 MiB/s wr, 628 op/s 2024-09-12T12:32:51.483 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:51 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/2689692612' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:32:51.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:51 smithi043 ceph-mon[34144]: pgmap v555: 129 pgs: 129 active+clean; 10 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 36 MiB/s wr, 628 op/s 2024-09-12T12:32:51.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:51 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/2689692612' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:32:51.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:51 smithi102 ceph-mon[34799]: pgmap v555: 129 pgs: 129 active+clean; 10 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 36 MiB/s wr, 628 op/s 2024-09-12T12:32:51.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:51 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/2689692612' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:32:51.740 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:32:52.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.526+0000 7f81f148e640 1 -- 172.21.15.33:0/1241748846 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81ec109e00 msgr2=0x7f81ec0742d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:52.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.526+0000 7f81f148e640 1 --2- 172.21.15.33:0/1241748846 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81ec109e00 0x7f81ec0742d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f81e400afd0 tx=0x7f81e40085b0 comp rx=0 tx=0).stop 2024-09-12T12:32:52.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.527+0000 7f81f148e640 1 -- 172.21.15.33:0/1241748846 shutdown_connections 2024-09-12T12:32:52.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.527+0000 7f81f148e640 1 --2- 172.21.15.33:0/1241748846 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81ec074990 0x7f81ec07b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:52.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.527+0000 7f81f148e640 1 --2- 172.21.15.33:0/1241748846 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81ec109e00 0x7f81ec0742d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:52.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.527+0000 7f81f148e640 1 --2- 172.21.15.33:0/1241748846 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81ec109450 0x7f81ec109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:52.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.527+0000 7f81f148e640 1 -- 172.21.15.33:0/1241748846 >> 172.21.15.33:0/1241748846 conn(0x7f81ec06e140 msgr2=0x7f81ec06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:32:52.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.529+0000 7f81f148e640 1 -- 172.21.15.33:0/1241748846 shutdown_connections 2024-09-12T12:32:52.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.531+0000 7f81f148e640 1 -- 172.21.15.33:0/1241748846 wait complete. 2024-09-12T12:32:52.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.531+0000 7f81f148e640 1 Processor -- start 2024-09-12T12:32:52.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.532+0000 7f81f148e640 1 -- start start 2024-09-12T12:32:52.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.532+0000 7f81f148e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81ec074990 0x7f81ec084b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:52.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.532+0000 7f81f148e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81ec109450 0x7f81ec07fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:52.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.532+0000 7f81f148e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81ec109e00 0x7f81ec080140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:52.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.532+0000 7f81f148e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f81ec07e5d0 con 0x7f81ec109e00 2024-09-12T12:32:52.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.532+0000 7f81f148e640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f81ec07e450 con 0x7f81ec074990 2024-09-12T12:32:52.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.532+0000 7f81f148e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f81ec07e750 con 0x7f81ec109450 2024-09-12T12:32:52.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.536+0000 7f81eb7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81ec109e00 0x7f81ec080140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:52.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.536+0000 7f81eb7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81ec109e00 0x7f81ec080140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34374/0 (socket says 172.21.15.33:34374) 2024-09-12T12:32:52.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.536+0000 7f81eb7fe640 1 -- 172.21.15.33:0/1684545945 learned_addr learned my addr 172.21.15.33:0/1684545945 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:32:52.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.538+0000 7f81eb7fe640 1 -- 172.21.15.33:0/1684545945 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81ec109450 msgr2=0x7f81ec07fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:52.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.538+0000 7f81eb7fe640 1 --2- 172.21.15.33:0/1684545945 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81ec109450 0x7f81ec07fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:52.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.538+0000 7f81eb7fe640 1 -- 172.21.15.33:0/1684545945 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81ec074990 msgr2=0x7f81ec084b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:52.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.538+0000 7f81eb7fe640 1 --2- 172.21.15.33:0/1684545945 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81ec074990 0x7f81ec084b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:52.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.538+0000 7f81eb7fe640 1 -- 172.21.15.33:0/1684545945 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81ec0808c0 con 0x7f81ec109e00 2024-09-12T12:32:52.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.538+0000 7f81eb7fe640 1 --2- 172.21.15.33:0/1684545945 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81ec109e00 0x7f81ec080140 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f81e000d750 tx=0x7f81e000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:32:52.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.538+0000 7f81d3fff640 1 -- 172.21.15.33:0/1684545945 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e0017070 con 0x7f81ec109e00 2024-09-12T12:32:52.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.539+0000 7f81f148e640 1 -- 172.21.15.33:0/1684545945 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81ec1bbfa0 con 0x7f81ec109e00 2024-09-12T12:32:52.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.539+0000 7f81f148e640 1 -- 172.21.15.33:0/1684545945 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81ec1bc480 con 0x7f81ec109e00 2024-09-12T12:32:52.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.542+0000 7f81f3867740 1 Processor -- start 2024-09-12T12:32:52.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.542+0000 7f81f3867740 1 -- start start 2024-09-12T12:32:52.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.543+0000 7f81f3867740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbd852eb40 0x55fbd852d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:52.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.543+0000 7f81f3867740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbd852d5d0 0x55fbd852da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:52.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.543+0000 7f81f3867740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fbd8538370 0x55fbd853a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:52.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.543+0000 7f81f3867740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55fbd84932f0 con 0x55fbd8538370 2024-09-12T12:32:52.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.543+0000 7f81f3867740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55fbd843acf0 con 0x55fbd852d5d0 2024-09-12T12:32:52.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.543+0000 7f81f3867740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55fbd848f2b0 con 0x55fbd852eb40 2024-09-12T12:32:52.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.546+0000 7f81eaffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbd852d5d0 0x55fbd852da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:52.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.546+0000 7f81eaffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbd852d5d0 0x55fbd852da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:49466/0 (socket says 172.21.15.33:49466) 2024-09-12T12:32:52.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.546+0000 7f81eaffd640 1 -- 172.21.15.33:0/3902405360 learned_addr learned my addr 172.21.15.33:0/3902405360 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:32:52.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.548+0000 7f81d3fff640 1 -- 172.21.15.33:0/1684545945 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f81e0009bd0 con 0x7f81ec109e00 2024-09-12T12:32:52.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.548+0000 7f81d3fff640 1 -- 172.21.15.33:0/1684545945 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e0020060 con 0x7f81ec109e00 2024-09-12T12:32:52.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.548+0000 7f81d3fff640 1 -- 172.21.15.33:0/1684545945 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f81e000f6e0 con 0x7f81ec109e00 2024-09-12T12:32:52.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.549+0000 7f81eaffd640 1 -- 172.21.15.33:0/3902405360 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbd852eb40 msgr2=0x55fbd852d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:52.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.549+0000 7f81eaffd640 1 --2- 172.21.15.33:0/3902405360 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbd852eb40 0x55fbd852d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:52.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.549+0000 7f81eaffd640 1 -- 172.21.15.33:0/3902405360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fbd8538370 msgr2=0x55fbd853a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:52.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.549+0000 7f81eaffd640 1 --2- 172.21.15.33:0/3902405360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fbd8538370 0x55fbd853a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:52.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.549+0000 7f81eaffd640 1 -- 172.21.15.33:0/3902405360 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbd841f3a0 con 0x55fbd852d5d0 2024-09-12T12:32:52.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.549+0000 7f81eaffd640 1 --2- 172.21.15.33:0/3902405360 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbd852d5d0 0x55fbd852da10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f81dc00ba60 tx=0x7f81dc00bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a13c8fa819073124 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:32:52.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.549+0000 7f81d3fff640 1 --2- 172.21.15.33:0/1684545945 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f81d40a2cf0 0x7f81d40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:52.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.549+0000 7f81d17fa640 1 -- 172.21.15.33:0/3902405360 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81dc00abc0 con 0x55fbd852d5d0 2024-09-12T12:32:52.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.549+0000 7f81d17fa640 1 -- 172.21.15.33:0/3902405360 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f81dc00ad60 con 0x55fbd852d5d0 2024-09-12T12:32:52.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.549+0000 7f81d3fff640 1 -- 172.21.15.33:0/1684545945 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f81e00cfe90 con 0x7f81ec109e00 2024-09-12T12:32:52.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.550+0000 7f81f3867740 1 -- 172.21.15.33:0/3902405360 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbd852d5d0 msgr2=0x55fbd852da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:52.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.550+0000 7f81f3867740 1 --2- 172.21.15.33:0/3902405360 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbd852d5d0 0x55fbd852da10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f81dc00ba60 tx=0x7f81dc00bf20 comp rx=0 tx=0).stop 2024-09-12T12:32:52.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.550+0000 7f81f3867740 1 -- 172.21.15.33:0/3902405360 shutdown_connections 2024-09-12T12:32:52.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.550+0000 7f81f3867740 1 --2- 172.21.15.33:0/3902405360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fbd8538370 0x55fbd853a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:52.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.550+0000 7f81f3867740 1 --2- 172.21.15.33:0/3902405360 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbd852d5d0 0x55fbd852da10 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:52.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.550+0000 7f81f3867740 1 --2- 172.21.15.33:0/3902405360 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbd852eb40 0x55fbd852d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:52.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.550+0000 7f81f3867740 1 -- 172.21.15.33:0/3902405360 >> 172.21.15.33:0/3902405360 conn(0x55fbd84f6310 msgr2=0x55fbd8529c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:32:52.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.553+0000 7f81ea7fc640 1 --2- 172.21.15.33:0/1684545945 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f81d40a2cf0 0x7f81d40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:52.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.555+0000 7f81ea7fc640 1 --2- 172.21.15.33:0/1684545945 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f81d40a2cf0 0x7f81d40a51b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x55fbd852a860 tx=0x7f81e4005ef0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:32:52.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.555+0000 7f81f3867740 1 -- 172.21.15.33:0/3902405360 shutdown_connections 2024-09-12T12:32:52.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.555+0000 7f81f3867740 1 -- 172.21.15.33:0/3902405360 wait complete. 2024-09-12T12:32:52.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.556+0000 7f81f3867740 1 -- start start 2024-09-12T12:32:52.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.556+0000 7f81f3867740 1 Processor -- start 2024-09-12T12:32:52.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.556+0000 7f81f3867740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbd8537c50 0x55fbd8534f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:52.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.556+0000 7f81f3867740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbd8535440 0x55fbd85358c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:52.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.556+0000 7f81f3867740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fbd8542620 0x55fbd8544a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:52.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.556+0000 7f81f3867740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55fbd853b0c0 con 0x55fbd8542620 2024-09-12T12:32:52.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.556+0000 7f81f3867740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55fbd844e060 con 0x55fbd8535440 2024-09-12T12:32:52.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.556+0000 7f81f3867740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55fbd853b240 con 0x55fbd8537c50 2024-09-12T12:32:52.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.556+0000 7f81f3867740 10 client.0 _ll_register_callbacks cb 0x55fbd81a18c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:32:52.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.557+0000 7f81ea7fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbd8535440 0x55fbd85358c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:52.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.557+0000 7f81ea7fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbd8535440 0x55fbd85358c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:49472/0 (socket says 172.21.15.33:49472) 2024-09-12T12:32:52.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.557+0000 7f81ea7fc640 1 -- 172.21.15.33:0/2290862737 learned_addr learned my addr 172.21.15.33:0/2290862737 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:32:52.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.557+0000 7f81eaffd640 1 --2- 172.21.15.33:0/2290862737 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbd8537c50 0x55fbd8534f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:52.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.557+0000 7f81eaffd640 1 -- 172.21.15.33:0/2290862737 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbd8535440 msgr2=0x55fbd85358c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:52.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.557+0000 7f81eaffd640 1 --2- 172.21.15.33:0/2290862737 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbd8535440 0x55fbd85358c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:52.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.557+0000 7f81eaffd640 1 -- 172.21.15.33:0/2290862737 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fbd8542620 msgr2=0x55fbd8544a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:52.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.557+0000 7f81eaffd640 1 --2- 172.21.15.33:0/2290862737 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fbd8542620 0x55fbd8544a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:52.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.557+0000 7f81eaffd640 1 -- 172.21.15.33:0/2290862737 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbd82043c0 con 0x55fbd8537c50 2024-09-12T12:32:52.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.558+0000 7f81eaffd640 1 --2- 172.21.15.33:0/2290862737 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbd8537c50 0x55fbd8534f00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f81dc016040 tx=0x7f81dc0049d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dafe9834957e8f72 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:32:52.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.563+0000 7f81ceff5640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:32:52.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.563+0000 7f81ceff5640 1 -- 172.21.15.33:0/2290862737 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81dc023020 con 0x55fbd8537c50 2024-09-12T12:32:52.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.563+0000 7f81f3867740 1 -- 172.21.15.33:0/2290862737 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fbd84a0860 con 0x55fbd8537c50 2024-09-12T12:32:52.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.563+0000 7f81ceff5640 1 -- 172.21.15.33:0/2290862737 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f81dc01a040 con 0x55fbd8537c50 2024-09-12T12:32:52.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.563+0000 7f81ceff5640 1 -- 172.21.15.33:0/2290862737 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f81dc02e050 con 0x55fbd8537c50 2024-09-12T12:32:52.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.564+0000 7f81f3867740 10 client.25657 fetch_fsmap learned FSMap version 27 2024-09-12T12:32:52.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.564+0000 7f81f3867740 1 -- 172.21.15.33:0/2290862737 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fbd8547720 con 0x55fbd8537c50 2024-09-12T12:32:52.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.565+0000 7f81ceff5640 1 -- 172.21.15.33:0/2290862737 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55fbd84a0860 con 0x55fbd8537c50 2024-09-12T12:32:52.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.565+0000 7f81ceff5640 1 -- 172.21.15.33:0/2290862737 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f81dc014670 con 0x55fbd8537c50 2024-09-12T12:32:52.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.565+0000 7f81f3867740 10 client.25657 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:32:52.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.565+0000 7f81f3867740 10 client.25657 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-12T12:32:52.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.565+0000 7f81f3867740 20 client.25657 populate_metadata read hostname 'smithi033' 2024-09-12T12:32:52.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.565+0000 7f81f3867740 1 --2- 172.21.15.33:0/2290862737 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x55fbd8548f90 0x55fbd854b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:52.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.565+0000 7f81f3867740 4 client.25657 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:32:52.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.565+0000 7f81f3867740 1 -- 172.21.15.33:0/2290862737 --> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fbd849ad70 con 0x55fbd8548f90 2024-09-12T12:32:52.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.565+0000 7f81ea7fc640 1 --2- 172.21.15.33:0/2290862737 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x55fbd8548f90 0x55fbd854b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:52.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.567+0000 7f81ea7fc640 1 --2- 172.21.15.33:0/2290862737 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x55fbd8548f90 0x55fbd854b450 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1d8a70b261b04b0d server_cookie=3db703017d716589 in_seq=0 out_seq=0 2024-09-12T12:32:52.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.567+0000 7f81ceff5640 10 client.25657 ms_handle_connect on v2:172.21.15.102:6834/4179527539 2024-09-12T12:32:52.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.568+0000 7f81ceff5640 1 -- 172.21.15.33:0/2290862737 <== mds.2 v2:172.21.15.102:6834/4179527539 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fbd849ad70 con 0x55fbd8548f90 2024-09-12T12:32:52.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.568+0000 7f81ceff5640 10 client.25657 handle_command_reply: tid=0 2024-09-12T12:32:52.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.568+0000 7f81f3867740 1 client.25657 shutdown 2024-09-12T12:32:52.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.577+0000 7f81f3867740 1 -- 172.21.15.33:0/2290862737 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbd8537c50 msgr2=0x55fbd8534f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:52.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.577+0000 7f81f3867740 1 --2- 172.21.15.33:0/2290862737 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbd8537c50 0x55fbd8534f00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f81dc016040 tx=0x7f81dc0049d0 comp rx=0 tx=0).stop 2024-09-12T12:32:52.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.577+0000 7f81f3867740 1 -- 172.21.15.33:0/2290862737 shutdown_connections 2024-09-12T12:32:52.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.577+0000 7f81f3867740 1 --2- 172.21.15.33:0/2290862737 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fbd8542620 0x55fbd8544a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:52.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.577+0000 7f81f3867740 1 --2- 172.21.15.33:0/2290862737 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x55fbd8548f90 0x55fbd854b450 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:52.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.577+0000 7f81f3867740 1 --2- 172.21.15.33:0/2290862737 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbd8535440 0x55fbd85358c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:52.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.577+0000 7f81f3867740 1 --2- 172.21.15.33:0/2290862737 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbd8537c50 0x55fbd8534f00 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:52.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.577+0000 7f81f3867740 1 -- 172.21.15.33:0/2290862737 >> 172.21.15.33:0/2290862737 conn(0x55fbd84f6310 msgr2=0x55fbd852f990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:32:52.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.577+0000 7f81ceff5640 0 client.25657 ms_handle_reset on v2:172.21.15.102:6834/4179527539 2024-09-12T12:32:52.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.577+0000 7f81f3867740 1 -- 172.21.15.33:0/2290862737 shutdown_connections 2024-09-12T12:32:52.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.577+0000 7f81f3867740 1 -- 172.21.15.33:0/2290862737 wait complete. 2024-09-12T12:32:52.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.577+0000 7f81f3867740 20 client.25657 trim_cache size 0 max 16384 2024-09-12T12:32:52.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.609+0000 7f81f3867740 1 Processor -- start 2024-09-12T12:32:52.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.609+0000 7f81f3867740 1 -- start start 2024-09-12T12:32:52.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.609+0000 7f81f3867740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbd8535440 0x55fbd85337d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:52.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.609+0000 7f81f3867740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbd8537c50 0x55fbd8533d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:52.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.609+0000 7f81eaffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbd8535440 0x55fbd85337d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:52.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.609+0000 7f81eaffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbd8535440 0x55fbd85337d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:49480/0 (socket says 172.21.15.33:49480) 2024-09-12T12:32:52.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.609+0000 7f81f3867740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fbd8542620 0x55fbd8529700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:52.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.609+0000 7f81eaffd640 1 -- 172.21.15.33:0/2017405085 learned_addr learned my addr 172.21.15.33:0/2017405085 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:32:52.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.609+0000 7f81ea7fc640 1 --2- 172.21.15.33:0/2017405085 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbd8537c50 0x55fbd8533d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:52.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.610+0000 7f81f3867740 1 -- 172.21.15.33:0/2017405085 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f81ec1c8d50 con 0x55fbd8542620 2024-09-12T12:32:52.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.610+0000 7f81f3867740 1 -- 172.21.15.33:0/2017405085 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f81ec1c6660 con 0x55fbd8535440 2024-09-12T12:32:52.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.610+0000 7f81f3867740 1 -- 172.21.15.33:0/2017405085 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f81ec081130 con 0x55fbd8537c50 2024-09-12T12:32:52.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.610+0000 7f81eb7fe640 1 --2- 172.21.15.33:0/2017405085 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fbd8542620 0x55fbd8529700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:52.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.610+0000 7f81eaffd640 1 -- 172.21.15.33:0/2017405085 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbd8537c50 msgr2=0x55fbd8533d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:52.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.610+0000 7f81eaffd640 1 --2- 172.21.15.33:0/2017405085 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbd8537c50 0x55fbd8533d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:52.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.610+0000 7f81eaffd640 1 -- 172.21.15.33:0/2017405085 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fbd8542620 msgr2=0x55fbd8529700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:52.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.610+0000 7f81eaffd640 1 --2- 172.21.15.33:0/2017405085 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fbd8542620 0x55fbd8529700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:52.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.610+0000 7f81eaffd640 1 -- 172.21.15.33:0/2017405085 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbd8548cc0 con 0x55fbd8535440 2024-09-12T12:32:52.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.610+0000 7f81eaffd640 1 --2- 172.21.15.33:0/2017405085 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbd8535440 0x55fbd85337d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f81dc014be0 tx=0x7f81dc00b4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b881fe635ac33db6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:32:52.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.610+0000 7f81d0ff9640 1 -- 172.21.15.33:0/2017405085 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81dc037070 con 0x55fbd8535440 2024-09-12T12:32:52.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.611+0000 7f81d0ff9640 1 -- 172.21.15.33:0/2017405085 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f81dc005850 con 0x55fbd8535440 2024-09-12T12:32:52.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.611+0000 7f81f3867740 1 -- 172.21.15.33:0/2017405085 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbd8535440 msgr2=0x55fbd85337d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:52.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.611+0000 7f81f3867740 1 --2- 172.21.15.33:0/2017405085 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbd8535440 0x55fbd85337d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f81dc014be0 tx=0x7f81dc00b4e0 comp rx=0 tx=0).stop 2024-09-12T12:32:52.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.612+0000 7f81f3867740 1 -- 172.21.15.33:0/2017405085 shutdown_connections 2024-09-12T12:32:52.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.612+0000 7f81f3867740 1 --2- 172.21.15.33:0/2017405085 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fbd8542620 0x55fbd8529700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:52.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.612+0000 7f81f3867740 1 --2- 172.21.15.33:0/2017405085 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbd8537c50 0x55fbd8533d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:52.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.612+0000 7f81f3867740 1 --2- 172.21.15.33:0/2017405085 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbd8535440 0x55fbd85337d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:52.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.612+0000 7f81f3867740 1 -- 172.21.15.33:0/2017405085 >> 172.21.15.33:0/2017405085 conn(0x55fbd84f6310 msgr2=0x55fbd852d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:32:52.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.617+0000 7f81f3867740 1 -- 172.21.15.33:0/2017405085 shutdown_connections 2024-09-12T12:32:52.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.617+0000 7f81f3867740 1 -- 172.21.15.33:0/2017405085 wait complete. 2024-09-12T12:32:52.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.617+0000 7f81f3867740 1 -- start start 2024-09-12T12:32:52.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.617+0000 7f81f3867740 1 Processor -- start 2024-09-12T12:32:52.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.618+0000 7f81f3867740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fbd8537c50 0x55fbd8541ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:52.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.618+0000 7f81f3867740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbd8542620 0x55fbd8542020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:52.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.618+0000 7f81f3867740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbd853be00 0x55fbd853c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:52.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.618+0000 7f81f3867740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f81ec1c4b20 con 0x55fbd8537c50 2024-09-12T12:32:52.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.618+0000 7f81f3867740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f81ec1c5f90 con 0x55fbd853be00 2024-09-12T12:32:52.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.618+0000 7f81f3867740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f81ec1c51f0 con 0x55fbd8542620 2024-09-12T12:32:52.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.618+0000 7f81f3867740 10 client.0 _ll_register_callbacks cb 0x7f81dc00b930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:32:52.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.618+0000 7f81eb7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbd853be00 0x55fbd853c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:52.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.618+0000 7f81eb7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbd853be00 0x55fbd853c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:49494/0 (socket says 172.21.15.33:49494) 2024-09-12T12:32:52.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.618+0000 7f81eb7fe640 1 -- 172.21.15.33:0/3636270013 learned_addr learned my addr 172.21.15.33:0/3636270013 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:32:52.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.618+0000 7f81ea7fc640 1 --2- 172.21.15.33:0/3636270013 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbd8542620 0x55fbd8542020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:52.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.618+0000 7f81eaffd640 1 --2- 172.21.15.33:0/3636270013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fbd8537c50 0x55fbd8541ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:52.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.619+0000 7f81eb7fe640 1 -- 172.21.15.33:0/3636270013 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbd8542620 msgr2=0x55fbd8542020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:52.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.619+0000 7f81eb7fe640 1 --2- 172.21.15.33:0/3636270013 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbd8542620 0x55fbd8542020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:52.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.619+0000 7f81eb7fe640 1 -- 172.21.15.33:0/3636270013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fbd8537c50 msgr2=0x55fbd8541ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:52.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.619+0000 7f81eb7fe640 1 --2- 172.21.15.33:0/3636270013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fbd8537c50 0x55fbd8541ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:52.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.619+0000 7f81eb7fe640 1 -- 172.21.15.33:0/3636270013 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbd853ca60 con 0x55fbd853be00 2024-09-12T12:32:52.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.619+0000 7f81eb7fe640 1 --2- 172.21.15.33:0/3636270013 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbd853be00 0x55fbd853c260 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f81e0098d30 tx=0x7f81e009c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16de8c25fe0c4e18 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:32:52.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.621+0000 7f81ceff5640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:32:52.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.621+0000 7f81ceff5640 1 -- 172.21.15.33:0/3636270013 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e00989d0 con 0x55fbd853be00 2024-09-12T12:32:52.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.621+0000 7f81ceff5640 1 -- 172.21.15.33:0/3636270013 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f81e009b7b0 con 0x55fbd853be00 2024-09-12T12:32:52.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.621+0000 7f81f3867740 1 -- 172.21.15.33:0/3636270013 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fbd8417170 con 0x55fbd853be00 2024-09-12T12:32:52.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.621+0000 7f81ceff5640 1 -- 172.21.15.33:0/3636270013 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f81e0098b70 con 0x55fbd853be00 2024-09-12T12:32:52.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.626+0000 7f81f3867740 10 client.25577 fetch_fsmap learned FSMap version 27 2024-09-12T12:32:52.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.626+0000 7f81f3867740 1 -- 172.21.15.33:0/3636270013 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fbd85b2d50 con 0x55fbd853be00 2024-09-12T12:32:52.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.626+0000 7f81ceff5640 1 -- 172.21.15.33:0/3636270013 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55fbd8417170 con 0x55fbd853be00 2024-09-12T12:32:52.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.626+0000 7f81ceff5640 1 -- 172.21.15.33:0/3636270013 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f81e00bc0b0 con 0x55fbd853be00 2024-09-12T12:32:52.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.630+0000 7f81f3867740 10 client.25577 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:32:52.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.630+0000 7f81f3867740 10 client.25577 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-12T12:32:52.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.630+0000 7f81f3867740 20 client.25577 populate_metadata read hostname 'smithi033' 2024-09-12T12:32:52.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.630+0000 7f81f3867740 1 --2- 172.21.15.33:0/3636270013 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x55fbd85b3400 0x55fbd85b5820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:52.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.630+0000 7f81f3867740 4 client.25577 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:32:52.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.630+0000 7f81f3867740 1 -- 172.21.15.33:0/3636270013 --> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fbd84649b0 con 0x55fbd85b3400 2024-09-12T12:32:52.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.631+0000 7f81eaffd640 1 --2- 172.21.15.33:0/3636270013 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x55fbd85b3400 0x55fbd85b5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:52.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.644+0000 7f81eaffd640 1 --2- 172.21.15.33:0/3636270013 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x55fbd85b3400 0x55fbd85b5820 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b484f185b6082918 server_cookie=b928c5cd6307768 in_seq=0 out_seq=0 2024-09-12T12:32:52.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.645+0000 7f81ceff5640 10 client.25577 ms_handle_connect on v2:172.21.15.102:6834/4179527539 2024-09-12T12:32:52.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.652+0000 7f81ceff5640 1 -- 172.21.15.33:0/3636270013 <== mds.2 v2:172.21.15.102:6834/4179527539 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fbd84649b0 con 0x55fbd85b3400 2024-09-12T12:32:52.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.652+0000 7f81ceff5640 10 client.25577 handle_command_reply: tid=0 2024-09-12T12:32:52.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.652+0000 7f81f3867740 1 client.25577 shutdown 2024-09-12T12:32:52.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.653+0000 7f81f3867740 1 -- 172.21.15.33:0/3636270013 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbd853be00 msgr2=0x55fbd853c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:52.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.653+0000 7f81f3867740 1 --2- 172.21.15.33:0/3636270013 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbd853be00 0x55fbd853c260 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f81e0098d30 tx=0x7f81e009c360 comp rx=0 tx=0).stop 2024-09-12T12:32:52.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.653+0000 7f81f3867740 1 -- 172.21.15.33:0/3636270013 shutdown_connections 2024-09-12T12:32:52.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.653+0000 7f81f3867740 1 --2- 172.21.15.33:0/3636270013 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x55fbd85b3400 0x55fbd85b5820 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:52.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.653+0000 7f81f3867740 1 --2- 172.21.15.33:0/3636270013 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbd853be00 0x55fbd853c260 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:52.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.653+0000 7f81f3867740 1 --2- 172.21.15.33:0/3636270013 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbd8542620 0x55fbd8542020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:52.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.653+0000 7f81f3867740 1 --2- 172.21.15.33:0/3636270013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fbd8537c50 0x55fbd8541ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:52.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.653+0000 7f81f3867740 1 -- 172.21.15.33:0/3636270013 >> 172.21.15.33:0/3636270013 conn(0x55fbd84f6310 msgr2=0x55fbd8533750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:32:52.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.653+0000 7f81ceff5640 0 client.25577 ms_handle_reset on v2:172.21.15.102:6834/4179527539 2024-09-12T12:32:52.656 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-09-12T12:32:52.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.655+0000 7f81f3867740 1 -- 172.21.15.33:0/3636270013 shutdown_connections 2024-09-12T12:32:52.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.655+0000 7f81f3867740 1 -- 172.21.15.33:0/3636270013 wait complete. 2024-09-12T12:32:52.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.655+0000 7f81f3867740 20 client.25577 trim_cache size 0 max 16384 2024-09-12T12:32:52.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.659+0000 7f81f148e640 1 -- 172.21.15.33:0/1684545945 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f81d40a2cf0 msgr2=0x7f81d40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:52.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.659+0000 7f81f148e640 1 --2- 172.21.15.33:0/1684545945 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f81d40a2cf0 0x7f81d40a51b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x55fbd852a860 tx=0x7f81e4005ef0 comp rx=0 tx=0).stop 2024-09-12T12:32:52.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.659+0000 7f81f148e640 1 -- 172.21.15.33:0/1684545945 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81ec109e00 msgr2=0x7f81ec080140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:52.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.659+0000 7f81f148e640 1 --2- 172.21.15.33:0/1684545945 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81ec109e00 0x7f81ec080140 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f81e000d750 tx=0x7f81e000dc10 comp rx=0 tx=0).stop 2024-09-12T12:32:52.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.661+0000 7f81f148e640 1 -- 172.21.15.33:0/1684545945 shutdown_connections 2024-09-12T12:32:52.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.661+0000 7f81f148e640 1 --2- 172.21.15.33:0/1684545945 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f81d40a2cf0 0x7f81d40a51b0 secure :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0x55fbd852a860 tx=0x7f81e4005ef0 comp rx=0 tx=0).stop 2024-09-12T12:32:52.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.661+0000 7f81f148e640 1 --2- 172.21.15.33:0/1684545945 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81ec109e00 0x7f81ec080140 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:52.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.661+0000 7f81f148e640 1 --2- 172.21.15.33:0/1684545945 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81ec109450 0x7f81ec07fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:52.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.661+0000 7f81f148e640 1 --2- 172.21.15.33:0/1684545945 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81ec074990 0x7f81ec084b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:52.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.661+0000 7f81f148e640 1 -- 172.21.15.33:0/1684545945 >> 172.21.15.33:0/1684545945 conn(0x7f81ec06e140 msgr2=0x7f81ec072470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:32:52.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.663+0000 7f81f148e640 1 -- 172.21.15.33:0/1684545945 shutdown_connections 2024-09-12T12:32:52.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:52.663+0000 7f81f148e640 1 -- 172.21.15.33:0/1684545945 wait complete. 2024-09-12T12:32:53.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:53 smithi033 ceph-mon[31246]: pgmap v556: 129 pgs: 129 active+clean; 10 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 34 MiB/s wr, 602 op/s 2024-09-12T12:32:53.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:53 smithi043 ceph-mon[34144]: pgmap v556: 129 pgs: 129 active+clean; 10 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 34 MiB/s wr, 602 op/s 2024-09-12T12:32:53.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:53 smithi102 ceph-mon[34799]: pgmap v556: 129 pgs: 129 active+clean; 10 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 34 MiB/s wr, 602 op/s 2024-09-12T12:32:53.680 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T12:32:54.345 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:32:55.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.061+0000 7fcaa0d6b640 1 -- 172.21.15.33:0/1444721985 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca9c109830 msgr2=0x7fca9c109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:55.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.061+0000 7fcaa0d6b640 1 --2- 172.21.15.33:0/1444721985 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca9c109830 0x7fca9c109c90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fca9001a910 tx=0x7fca9003b470 comp rx=0 tx=0).stop 2024-09-12T12:32:55.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.065+0000 7fcaa0d6b640 1 -- 172.21.15.33:0/1444721985 shutdown_connections 2024-09-12T12:32:55.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.065+0000 7fcaa0d6b640 1 --2- 172.21.15.33:0/1444721985 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca9c11b140 0x7fca9c11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:55.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.065+0000 7fcaa0d6b640 1 --2- 172.21.15.33:0/1444721985 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca9c109830 0x7fca9c109c90 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:55.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.065+0000 7fcaa0d6b640 1 --2- 172.21.15.33:0/1444721985 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca9c109450 0x7fca9c110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:55.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.065+0000 7fcaa0d6b640 1 -- 172.21.15.33:0/1444721985 >> 172.21.15.33:0/1444721985 conn(0x7fca9c06e140 msgr2=0x7fca9c06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:32:55.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.068+0000 7fcaa0d6b640 1 -- 172.21.15.33:0/1444721985 shutdown_connections 2024-09-12T12:32:55.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.070+0000 7fcaa0d6b640 1 -- 172.21.15.33:0/1444721985 wait complete. 2024-09-12T12:32:55.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.071+0000 7fcaa0d6b640 1 Processor -- start 2024-09-12T12:32:55.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.071+0000 7fcaa0d6b640 1 -- start start 2024-09-12T12:32:55.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.071+0000 7fcaa0d6b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca9c109450 0x7fca9c11a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:55.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.071+0000 7fcaa0d6b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca9c109830 0x7fca9c116810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:55.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.071+0000 7fcaa0d6b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca9c11b140 0x7fca9c116d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:55.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.071+0000 7fcaa0d6b640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c1131f0 con 0x7fca9c109450 2024-09-12T12:32:55.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.071+0000 7fcaa0d6b640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c113070 con 0x7fca9c11b140 2024-09-12T12:32:55.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.071+0000 7fcaa0d6b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c113370 con 0x7fca9c109830 2024-09-12T12:32:55.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.072+0000 7fca9a59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca9c109450 0x7fca9c11a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:55.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.072+0000 7fca9a59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca9c109450 0x7fca9c11a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34434/0 (socket says 172.21.15.33:34434) 2024-09-12T12:32:55.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.072+0000 7fca9a59c640 1 -- 172.21.15.33:0/863545570 learned_addr learned my addr 172.21.15.33:0/863545570 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:32:55.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.072+0000 7fca9ad9d640 1 --2- 172.21.15.33:0/863545570 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca9c11b140 0x7fca9c116d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:55.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.072+0000 7fca99d9b640 1 --2- 172.21.15.33:0/863545570 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca9c109830 0x7fca9c116810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:55.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.074+0000 7fca9a59c640 1 -- 172.21.15.33:0/863545570 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca9c109830 msgr2=0x7fca9c116810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:55.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.074+0000 7fca9a59c640 1 --2- 172.21.15.33:0/863545570 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca9c109830 0x7fca9c116810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:55.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.074+0000 7fca9a59c640 1 -- 172.21.15.33:0/863545570 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca9c11b140 msgr2=0x7fca9c116d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:55.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.074+0000 7fca9a59c640 1 --2- 172.21.15.33:0/863545570 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca9c11b140 0x7fca9c116d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:55.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.074+0000 7fca9a59c640 1 -- 172.21.15.33:0/863545570 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca9c117310 con 0x7fca9c109450 2024-09-12T12:32:55.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.076+0000 7fca9a59c640 1 --2- 172.21.15.33:0/863545570 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca9c109450 0x7fca9c11a770 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fca9400ba80 tx=0x7fca9400bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:32:55.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.077+0000 7fca8b7fe640 1 -- 172.21.15.33:0/863545570 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca94019070 con 0x7fca9c109450 2024-09-12T12:32:55.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.077+0000 7fca8b7fe640 1 -- 172.21.15.33:0/863545570 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fca9400cc90 con 0x7fca9c109450 2024-09-12T12:32:55.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.078+0000 7fca8b7fe640 1 -- 172.21.15.33:0/863545570 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca94007660 con 0x7fca9c109450 2024-09-12T12:32:55.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.078+0000 7fcaa0d6b640 1 -- 172.21.15.33:0/863545570 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca9c117600 con 0x7fca9c109450 2024-09-12T12:32:55.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.079+0000 7fcaa0d6b640 1 -- 172.21.15.33:0/863545570 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca9c1cd410 con 0x7fca9c109450 2024-09-12T12:32:55.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.086+0000 7fcaa3144740 1 Processor -- start 2024-09-12T12:32:55.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.086+0000 7fca8b7fe640 1 -- 172.21.15.33:0/863545570 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fca94003a10 con 0x7fca9c109450 2024-09-12T12:32:55.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.087+0000 7fcaa3144740 1 -- start start 2024-09-12T12:32:55.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.088+0000 7fcaa3144740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f14e88b40 0x557f14e87090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:55.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.088+0000 7fcaa3144740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f14e875d0 0x557f14e87a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:55.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.088+0000 7fcaa3144740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557f14e92370 0x557f14e94760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:55.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.088+0000 7fcaa3144740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x557f14ded2f0 con 0x557f14e88b40 2024-09-12T12:32:55.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.088+0000 7fcaa3144740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557f14d94cf0 con 0x557f14e875d0 2024-09-12T12:32:55.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.088+0000 7fcaa3144740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557f14de92b0 con 0x557f14e92370 2024-09-12T12:32:55.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.088+0000 7fca9a59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f14e875d0 0x557f14e87a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:55.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.088+0000 7fca9a59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f14e875d0 0x557f14e87a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:49522/0 (socket says 172.21.15.33:49522) 2024-09-12T12:32:55.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.088+0000 7fca9a59c640 1 -- 172.21.15.33:0/3253921106 learned_addr learned my addr 172.21.15.33:0/3253921106 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:32:55.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.091+0000 7fca9a59c640 1 -- 172.21.15.33:0/3253921106 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557f14e92370 msgr2=0x557f14e94760 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:32:55.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.091+0000 7fca9a59c640 1 --2- 172.21.15.33:0/3253921106 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557f14e92370 0x557f14e94760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:55.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.091+0000 7fca9a59c640 1 -- 172.21.15.33:0/3253921106 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f14e88b40 msgr2=0x557f14e87090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:55.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.091+0000 7fca9a59c640 1 --2- 172.21.15.33:0/3253921106 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f14e88b40 0x557f14e87090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:55.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.091+0000 7fca9a59c640 1 -- 172.21.15.33:0/3253921106 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f14d793a0 con 0x557f14e875d0 2024-09-12T12:32:55.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.091+0000 7fca8b7fe640 1 --2- 172.21.15.33:0/863545570 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fca840a2c20 0x7fca840a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:55.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.092+0000 7fca8b7fe640 1 -- 172.21.15.33:0/863545570 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fca940ce820 con 0x7fca9c109450 2024-09-12T12:32:55.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.092+0000 7fca9a59c640 1 --2- 172.21.15.33:0/3253921106 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f14e875d0 0x557f14e87a10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fca940d4a90 tx=0x7fca940d4b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e1a17514d7a350f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:32:55.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.092+0000 7fca88ff9640 1 -- 172.21.15.33:0/3253921106 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca94096fe0 con 0x557f14e875d0 2024-09-12T12:32:55.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.093+0000 7fca88ff9640 1 -- 172.21.15.33:0/3253921106 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fca9400ce40 con 0x557f14e875d0 2024-09-12T12:32:55.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.093+0000 7fca88ff9640 1 -- 172.21.15.33:0/3253921106 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca9409a6a0 con 0x557f14e875d0 2024-09-12T12:32:55.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.094+0000 7fcaa3144740 1 -- 172.21.15.33:0/3253921106 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f14e875d0 msgr2=0x557f14e87a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:55.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.094+0000 7fcaa3144740 1 --2- 172.21.15.33:0/3253921106 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f14e875d0 0x557f14e87a10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fca940d4a90 tx=0x7fca940d4b80 comp rx=0 tx=0).stop 2024-09-12T12:32:55.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.097+0000 7fca9ad9d640 1 --2- 172.21.15.33:0/863545570 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fca840a2c20 0x7fca840a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:55.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.097+0000 7fcaa3144740 1 -- 172.21.15.33:0/3253921106 shutdown_connections 2024-09-12T12:32:55.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.097+0000 7fcaa3144740 1 --2- 172.21.15.33:0/3253921106 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557f14e92370 0x557f14e94760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:55.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.097+0000 7fcaa3144740 1 --2- 172.21.15.33:0/3253921106 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f14e875d0 0x557f14e87a10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:55.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.097+0000 7fcaa3144740 1 --2- 172.21.15.33:0/3253921106 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f14e88b40 0x557f14e87090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:55.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.097+0000 7fcaa3144740 1 -- 172.21.15.33:0/3253921106 >> 172.21.15.33:0/3253921106 conn(0x557f14e50310 msgr2=0x557f14e83c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:32:55.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.100+0000 7fcaa3144740 1 -- 172.21.15.33:0/3253921106 shutdown_connections 2024-09-12T12:32:55.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.104+0000 7fcaa3144740 1 -- 172.21.15.33:0/3253921106 wait complete. 2024-09-12T12:32:55.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.104+0000 7fcaa3144740 1 -- start start 2024-09-12T12:32:55.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.104+0000 7fcaa3144740 1 Processor -- start 2024-09-12T12:32:55.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.105+0000 7fcaa3144740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f14e875d0 0x557f14e91ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:55.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.105+0000 7fcaa3144740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f14e88b40 0x557f14e8ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:55.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.105+0000 7fcaa3144740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557f14e92370 0x557f14e8f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:55.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.105+0000 7fcaa3144740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x557f14e950c0 con 0x557f14e875d0 2024-09-12T12:32:55.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.105+0000 7fcaa3144740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557f14da8060 con 0x557f14e88b40 2024-09-12T12:32:55.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.105+0000 7fcaa3144740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557f14e95240 con 0x557f14e92370 2024-09-12T12:32:55.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.105+0000 7fcaa3144740 10 client.0 _ll_register_callbacks cb 0x557f14afb8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:32:55.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.106+0000 7fca9a59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f14e875d0 0x557f14e91ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:55.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.106+0000 7fca9a59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f14e875d0 0x557f14e91ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34454/0 (socket says 172.21.15.33:34454) 2024-09-12T12:32:55.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.106+0000 7fca9a59c640 1 -- 172.21.15.33:0/1399099107 learned_addr learned my addr 172.21.15.33:0/1399099107 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:32:55.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.106+0000 7fca99d9b640 1 --2- 172.21.15.33:0/1399099107 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f14e88b40 0x557f14e8ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:55.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.106+0000 7fca9ad9d640 1 --2- 172.21.15.33:0/863545570 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fca840a2c20 0x7fca840a50e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fca8c009c20 tx=0x7fca8c0046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:32:55.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.107+0000 7fca9ad9d640 1 --2- 172.21.15.33:0/1399099107 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557f14e92370 0x557f14e8f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:55.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.108+0000 7fca9a59c640 1 -- 172.21.15.33:0/1399099107 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557f14e92370 msgr2=0x557f14e8f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:55.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.108+0000 7fca9a59c640 1 --2- 172.21.15.33:0/1399099107 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557f14e92370 0x557f14e8f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:55.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.108+0000 7fca9a59c640 1 -- 172.21.15.33:0/1399099107 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f14e88b40 msgr2=0x557f14e8ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:55.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.108+0000 7fca9a59c640 1 --2- 172.21.15.33:0/1399099107 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f14e88b40 0x557f14e8ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:55.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.108+0000 7fca9a59c640 1 -- 172.21.15.33:0/1399099107 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f14b5e3c0 con 0x557f14e875d0 2024-09-12T12:32:55.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.109+0000 7fca9a59c640 1 --2- 172.21.15.33:0/1399099107 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f14e875d0 0x557f14e91ce0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fca940a33d0 tx=0x7fca940ceae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbc681e59bddb069 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:32:55.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.109+0000 7fca81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:32:55.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.109+0000 7fca81ffb640 1 -- 172.21.15.33:0/1399099107 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca9409a880 con 0x557f14e875d0 2024-09-12T12:32:55.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.110+0000 7fcaa3144740 1 -- 172.21.15.33:0/1399099107 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557f14dfa860 con 0x557f14e875d0 2024-09-12T12:32:55.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.110+0000 7fca81ffb640 1 -- 172.21.15.33:0/1399099107 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fca940973b0 con 0x557f14e875d0 2024-09-12T12:32:55.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.111+0000 7fca81ffb640 1 -- 172.21.15.33:0/1399099107 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fca9409ab10 con 0x557f14e875d0 2024-09-12T12:32:55.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.112+0000 7fcaa3144740 10 client.15903 fetch_fsmap learned FSMap version 27 2024-09-12T12:32:55.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.112+0000 7fcaa3144740 1 -- 172.21.15.33:0/1399099107 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557f14ea0b10 con 0x557f14e875d0 2024-09-12T12:32:55.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.116+0000 7fca81ffb640 1 -- 172.21.15.33:0/1399099107 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x557f14dfa860 con 0x557f14e875d0 2024-09-12T12:32:55.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.116+0000 7fca81ffb640 1 -- 172.21.15.33:0/1399099107 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fca940cebd0 con 0x557f14e875d0 2024-09-12T12:32:55.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.116+0000 7fcaa3144740 10 client.15903 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:32:55.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.116+0000 7fcaa3144740 10 client.15903 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-12T12:32:55.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.116+0000 7fcaa3144740 20 client.15903 populate_metadata read hostname 'smithi033' 2024-09-12T12:32:55.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.116+0000 7fcaa3144740 1 --2- 172.21.15.33:0/1399099107 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x557f14ea2010 0x557f14ea4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:55.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.116+0000 7fcaa3144740 4 client.15903 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:32:55.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.116+0000 7fcaa3144740 1 -- 172.21.15.33:0/1399099107 --> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f14df4d70 con 0x557f14ea2010 2024-09-12T12:32:55.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.117+0000 7fca99d9b640 1 --2- 172.21.15.33:0/1399099107 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x557f14ea2010 0x557f14ea4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:55.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.124+0000 7fca99d9b640 1 --2- 172.21.15.33:0/1399099107 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x557f14ea2010 0x557f14ea4460 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b9f03207290b1896 server_cookie=4b285f5ee27a8227 in_seq=0 out_seq=0 2024-09-12T12:32:55.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.124+0000 7fca81ffb640 10 client.15903 ms_handle_connect on v2:172.21.15.102:6836/2409953270 2024-09-12T12:32:55.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.125+0000 7fca81ffb640 1 -- 172.21.15.33:0/1399099107 <== mds.1 v2:172.21.15.102:6836/2409953270 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557f14df4d70 con 0x557f14ea2010 2024-09-12T12:32:55.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.125+0000 7fca81ffb640 10 client.15903 handle_command_reply: tid=0 2024-09-12T12:32:55.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.125+0000 7fcaa3144740 1 client.15903 shutdown 2024-09-12T12:32:55.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.131+0000 7fcaa3144740 1 -- 172.21.15.33:0/1399099107 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f14e875d0 msgr2=0x557f14e91ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:55.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.131+0000 7fcaa3144740 1 --2- 172.21.15.33:0/1399099107 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f14e875d0 0x557f14e91ce0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fca940a33d0 tx=0x7fca940ceae0 comp rx=0 tx=0).stop 2024-09-12T12:32:55.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.131+0000 7fcaa3144740 1 -- 172.21.15.33:0/1399099107 shutdown_connections 2024-09-12T12:32:55.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.131+0000 7fcaa3144740 1 --2- 172.21.15.33:0/1399099107 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x557f14ea2010 0x557f14ea4460 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:55.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.131+0000 7fcaa3144740 1 --2- 172.21.15.33:0/1399099107 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557f14e92370 0x557f14e8f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:55.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.131+0000 7fcaa3144740 1 --2- 172.21.15.33:0/1399099107 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f14e88b40 0x557f14e8ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:55.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.131+0000 7fcaa3144740 1 --2- 172.21.15.33:0/1399099107 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f14e875d0 0x557f14e91ce0 secure :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fca940a33d0 tx=0x7fca940ceae0 comp rx=0 tx=0).stop 2024-09-12T12:32:55.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.131+0000 7fcaa3144740 1 -- 172.21.15.33:0/1399099107 >> 172.21.15.33:0/1399099107 conn(0x557f14e50310 msgr2=0x557f14e89930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:32:55.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.131+0000 7fca81ffb640 0 client.15903 ms_handle_reset on v2:172.21.15.102:6836/2409953270 2024-09-12T12:32:55.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.135+0000 7fcaa3144740 1 -- 172.21.15.33:0/1399099107 shutdown_connections 2024-09-12T12:32:55.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.136+0000 7fcaa3144740 1 -- 172.21.15.33:0/1399099107 wait complete. 2024-09-12T12:32:55.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.137+0000 7fcaa3144740 20 client.15903 trim_cache size 0 max 16384 2024-09-12T12:32:55.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.167+0000 7fcaa3144740 1 Processor -- start 2024-09-12T12:32:55.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.167+0000 7fcaa3144740 1 -- start start 2024-09-12T12:32:55.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.167+0000 7fcaa3144740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f14e88b40 0x557f14e9e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:55.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.167+0000 7fcaa3144740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557f14e92370 0x557f14e8a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:55.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.167+0000 7fcaa3144740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f14e8a660 0x557f14ea9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:55.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.167+0000 7fcaa3144740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c1d9860 con 0x557f14e8a660 2024-09-12T12:32:55.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.167+0000 7fcaa3144740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c1d7130 con 0x557f14e88b40 2024-09-12T12:32:55.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.167+0000 7fcaa3144740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c1d4f80 con 0x557f14e92370 2024-09-12T12:32:55.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.167+0000 7fca9ad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f14e8a660 0x557f14ea9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:55.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.167+0000 7fca9ad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f14e8a660 0x557f14ea9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34460/0 (socket says 172.21.15.33:34460) 2024-09-12T12:32:55.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.167+0000 7fca9ad9d640 1 -- 172.21.15.33:0/542406199 learned_addr learned my addr 172.21.15.33:0/542406199 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:32:55.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.167+0000 7fca99d9b640 1 --2- 172.21.15.33:0/542406199 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557f14e92370 0x557f14e8a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:55.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.168+0000 7fca99d9b640 1 -- 172.21.15.33:0/542406199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f14e88b40 msgr2=0x557f14e9e3a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T12:32:55.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.168+0000 7fca99d9b640 1 --2- 172.21.15.33:0/542406199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f14e88b40 0x557f14e9e3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:55.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.168+0000 7fca99d9b640 1 -- 172.21.15.33:0/542406199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f14e8a660 msgr2=0x557f14ea9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:55.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.168+0000 7fca99d9b640 1 --2- 172.21.15.33:0/542406199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f14e8a660 0x557f14ea9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:55.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.168+0000 7fca99d9b640 1 -- 172.21.15.33:0/542406199 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f14e92050 con 0x557f14e92370 2024-09-12T12:32:55.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.168+0000 7fca99d9b640 1 --2- 172.21.15.33:0/542406199 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557f14e92370 0x557f14e8a120 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fca9003b990 tx=0x7fca90000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a54063fbb7c94fe5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:32:55.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.171+0000 7fca83fff640 1 -- 172.21.15.33:0/542406199 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca90040a60 con 0x557f14e92370 2024-09-12T12:32:55.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.172+0000 7fca83fff640 1 -- 172.21.15.33:0/542406199 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fca90040c00 con 0x557f14e92370 2024-09-12T12:32:55.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.172+0000 7fcaa3144740 1 -- 172.21.15.33:0/542406199 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557f14e92370 msgr2=0x557f14e8a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:55.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.173+0000 7fcaa3144740 1 --2- 172.21.15.33:0/542406199 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557f14e92370 0x557f14e8a120 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fca9003b990 tx=0x7fca90000bc0 comp rx=0 tx=0).stop 2024-09-12T12:32:55.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.173+0000 7fcaa3144740 1 -- 172.21.15.33:0/542406199 shutdown_connections 2024-09-12T12:32:55.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.173+0000 7fcaa3144740 1 --2- 172.21.15.33:0/542406199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f14e8a660 0x557f14ea9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:55.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.173+0000 7fcaa3144740 1 --2- 172.21.15.33:0/542406199 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557f14e92370 0x557f14e8a120 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:55.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.173+0000 7fcaa3144740 1 --2- 172.21.15.33:0/542406199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f14e88b40 0x557f14e9e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:55.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.173+0000 7fcaa3144740 1 -- 172.21.15.33:0/542406199 >> 172.21.15.33:0/542406199 conn(0x557f14e50310 msgr2=0x557f14e8e080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:32:55.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.176+0000 7fcaa3144740 1 -- 172.21.15.33:0/542406199 shutdown_connections 2024-09-12T12:32:55.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.176+0000 7fcaa3144740 1 -- 172.21.15.33:0/542406199 wait complete. 2024-09-12T12:32:55.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.176+0000 7fcaa3144740 1 -- start start 2024-09-12T12:32:55.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.177+0000 7fcaa3144740 1 Processor -- start 2024-09-12T12:32:55.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.177+0000 7fcaa3144740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f14e8a660 0x557f14e9aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:55.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.177+0000 7fcaa3144740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f14e92370 0x557f14e8ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:55.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.177+0000 7fcaa3144740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557f14e8bf90 0x557f14e8c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:55.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.177+0000 7fcaa3144740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c1d55f0 con 0x557f14e8a660 2024-09-12T12:32:55.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.177+0000 7fcaa3144740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c1d6a60 con 0x557f14e92370 2024-09-12T12:32:55.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.177+0000 7fcaa3144740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c1d5cc0 con 0x557f14e8bf90 2024-09-12T12:32:55.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.177+0000 7fcaa3144740 10 client.0 _ll_register_callbacks cb 0x7fca940d48e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:32:55.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.180+0000 7fca9a59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f14e8a660 0x557f14e9aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:55.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.180+0000 7fca9a59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f14e8a660 0x557f14e9aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34476/0 (socket says 172.21.15.33:34476) 2024-09-12T12:32:55.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.180+0000 7fca9a59c640 1 -- 172.21.15.33:0/906020085 learned_addr learned my addr 172.21.15.33:0/906020085 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:32:55.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.182+0000 7fca9ad9d640 1 --2- 172.21.15.33:0/906020085 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557f14e8bf90 0x557f14e8c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:55.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.182+0000 7fca99d9b640 1 --2- 172.21.15.33:0/906020085 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f14e92370 0x557f14e8ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:55.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.188+0000 7fca9a59c640 1 -- 172.21.15.33:0/906020085 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557f14e8bf90 msgr2=0x557f14e8c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:55.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.188+0000 7fca9a59c640 1 --2- 172.21.15.33:0/906020085 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557f14e8bf90 0x557f14e8c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:55.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.188+0000 7fca9a59c640 1 -- 172.21.15.33:0/906020085 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f14e92370 msgr2=0x557f14e8ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:55.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.188+0000 7fca9a59c640 1 --2- 172.21.15.33:0/906020085 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f14e92370 0x557f14e8ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:55.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.188+0000 7fca9a59c640 1 -- 172.21.15.33:0/906020085 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f14f0bca0 con 0x557f14e8a660 2024-09-12T12:32:55.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.194+0000 7fca9a59c640 1 --2- 172.21.15.33:0/906020085 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f14e8a660 0x557f14e9aa80 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fca940a3730 tx=0x7fca9409f0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d58cef60d9466ec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:32:55.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.194+0000 7fca81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:32:55.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.195+0000 7fca81ffb640 1 -- 172.21.15.33:0/906020085 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca9409a880 con 0x557f14e8a660 2024-09-12T12:32:55.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.196+0000 7fca81ffb640 1 -- 172.21.15.33:0/906020085 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fca940ceb50 con 0x557f14e8a660 2024-09-12T12:32:55.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.198+0000 7fcaa3144740 1 -- 172.21.15.33:0/906020085 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca90040c00 con 0x557f14e8a660 2024-09-12T12:32:55.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.199+0000 7fca81ffb640 1 -- 172.21.15.33:0/906020085 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fca94096fe0 con 0x557f14e8a660 2024-09-12T12:32:55.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.199+0000 7fcaa3144740 10 client.15909 fetch_fsmap learned FSMap version 27 2024-09-12T12:32:55.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.199+0000 7fcaa3144740 1 -- 172.21.15.33:0/906020085 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557f14f0bca0 con 0x557f14e8a660 2024-09-12T12:32:55.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.200+0000 7fca81ffb640 1 -- 172.21.15.33:0/906020085 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fca90040c00 con 0x557f14e8a660 2024-09-12T12:32:55.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.201+0000 7fca81ffb640 1 -- 172.21.15.33:0/906020085 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fca94096a90 con 0x557f14e8a660 2024-09-12T12:32:55.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.201+0000 7fcaa3144740 10 client.15909 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:32:55.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.201+0000 7fcaa3144740 10 client.15909 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-12T12:32:55.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.201+0000 7fcaa3144740 20 client.15909 populate_metadata read hostname 'smithi033' 2024-09-12T12:32:55.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.201+0000 7fcaa3144740 1 --2- 172.21.15.33:0/906020085 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x557f14f0d1b0 0x557f14f0f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:55.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.201+0000 7fcaa3144740 4 client.15909 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:32:55.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.201+0000 7fcaa3144740 1 -- 172.21.15.33:0/906020085 --> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557f14d71170 con 0x557f14f0d1b0 2024-09-12T12:32:55.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.203+0000 7fca99d9b640 1 --2- 172.21.15.33:0/906020085 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x557f14f0d1b0 0x557f14f0f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:55.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.209+0000 7fca99d9b640 1 --2- 172.21.15.33:0/906020085 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x557f14f0d1b0 0x557f14f0f5d0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1da1a1f3c6990c94 server_cookie=344a6a20b1d2497a in_seq=0 out_seq=0 2024-09-12T12:32:55.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.211+0000 7fca81ffb640 10 client.15909 ms_handle_connect on v2:172.21.15.102:6836/2409953270 2024-09-12T12:32:55.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.211+0000 7fca81ffb640 1 -- 172.21.15.33:0/906020085 <== mds.1 v2:172.21.15.102:6836/2409953270 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557f14d71170 con 0x557f14f0d1b0 2024-09-12T12:32:55.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.211+0000 7fca81ffb640 10 client.15909 handle_command_reply: tid=0 2024-09-12T12:32:55.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.211+0000 7fcaa3144740 1 client.15909 shutdown 2024-09-12T12:32:55.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.211+0000 7fcaa3144740 1 -- 172.21.15.33:0/906020085 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f14e8a660 msgr2=0x557f14e9aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:55.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.211+0000 7fcaa3144740 1 --2- 172.21.15.33:0/906020085 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f14e8a660 0x557f14e9aa80 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fca940a3730 tx=0x7fca9409f0e0 comp rx=0 tx=0).stop 2024-09-12T12:32:55.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.211+0000 7fcaa3144740 1 -- 172.21.15.33:0/906020085 shutdown_connections 2024-09-12T12:32:55.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.211+0000 7fcaa3144740 1 --2- 172.21.15.33:0/906020085 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x557f14f0d1b0 0x557f14f0f5d0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:55.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.211+0000 7fcaa3144740 1 --2- 172.21.15.33:0/906020085 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557f14e8bf90 0x557f14e8c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:55.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.211+0000 7fcaa3144740 1 --2- 172.21.15.33:0/906020085 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f14e92370 0x557f14e8ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:55.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.211+0000 7fcaa3144740 1 --2- 172.21.15.33:0/906020085 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f14e8a660 0x557f14e9aa80 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:55.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.211+0000 7fcaa3144740 1 -- 172.21.15.33:0/906020085 >> 172.21.15.33:0/906020085 conn(0x557f14e50310 msgr2=0x557f14e824e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:32:55.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.211+0000 7fca81ffb640 0 client.15909 ms_handle_reset on v2:172.21.15.102:6836/2409953270 2024-09-12T12:32:55.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.211+0000 7fcaa3144740 1 -- 172.21.15.33:0/906020085 shutdown_connections 2024-09-12T12:32:55.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.211+0000 7fcaa3144740 1 -- 172.21.15.33:0/906020085 wait complete. 2024-09-12T12:32:55.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.212+0000 7fcaa3144740 20 client.15909 trim_cache size 0 max 16384 2024-09-12T12:32:55.213 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-09-12T12:32:55.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.213+0000 7fcaa0d6b640 1 -- 172.21.15.33:0/863545570 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fca840a2c20 msgr2=0x7fca840a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:55.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.213+0000 7fcaa0d6b640 1 --2- 172.21.15.33:0/863545570 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fca840a2c20 0x7fca840a50e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fca8c009c20 tx=0x7fca8c0046c0 comp rx=0 tx=0).stop 2024-09-12T12:32:55.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.213+0000 7fcaa0d6b640 1 -- 172.21.15.33:0/863545570 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca9c109450 msgr2=0x7fca9c11a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:55.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.213+0000 7fcaa0d6b640 1 --2- 172.21.15.33:0/863545570 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca9c109450 0x7fca9c11a770 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fca9400ba80 tx=0x7fca9400bf40 comp rx=0 tx=0).stop 2024-09-12T12:32:55.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.213+0000 7fcaa0d6b640 1 -- 172.21.15.33:0/863545570 shutdown_connections 2024-09-12T12:32:55.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.213+0000 7fcaa0d6b640 1 --2- 172.21.15.33:0/863545570 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fca840a2c20 0x7fca840a50e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:55.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.213+0000 7fcaa0d6b640 1 --2- 172.21.15.33:0/863545570 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca9c11b140 0x7fca9c116d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:55.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.213+0000 7fcaa0d6b640 1 --2- 172.21.15.33:0/863545570 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca9c109830 0x7fca9c116810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:55.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.213+0000 7fcaa0d6b640 1 --2- 172.21.15.33:0/863545570 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca9c109450 0x7fca9c11a770 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:55.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.213+0000 7fcaa0d6b640 1 -- 172.21.15.33:0/863545570 >> 172.21.15.33:0/863545570 conn(0x7fca9c06e140 msgr2=0x7fca9c070ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:32:55.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.214+0000 7fcaa0d6b640 1 -- 172.21.15.33:0/863545570 shutdown_connections 2024-09-12T12:32:55.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:55.214+0000 7fcaa0d6b640 1 -- 172.21.15.33:0/863545570 wait complete. 2024-09-12T12:32:55.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:55 smithi033 ceph-mon[31246]: pgmap v557: 129 pgs: 129 active+clean; 10 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 43 MiB/s wr, 762 op/s 2024-09-12T12:32:55.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:55 smithi043 ceph-mon[34144]: pgmap v557: 129 pgs: 129 active+clean; 10 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 43 MiB/s wr, 762 op/s 2024-09-12T12:32:55.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:55 smithi102 ceph-mon[34799]: pgmap v557: 129 pgs: 129 active+clean; 10 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 43 MiB/s wr, 762 op/s 2024-09-12T12:32:56.219 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T12:32:56.998 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:32:57.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:57 smithi033 ceph-mon[31246]: pgmap v558: 129 pgs: 129 active+clean; 10 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 34 MiB/s wr, 609 op/s 2024-09-12T12:32:57.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:57 smithi043 ceph-mon[34144]: pgmap v558: 129 pgs: 129 active+clean; 10 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 34 MiB/s wr, 609 op/s 2024-09-12T12:32:57.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:57 smithi102 ceph-mon[34799]: pgmap v558: 129 pgs: 129 active+clean; 10 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 34 MiB/s wr, 609 op/s 2024-09-12T12:32:58.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.976+0000 7fac0af94640 1 -- 172.21.15.33:0/1129701530 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac04101230 msgr2=0x7fac041053b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:58.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.976+0000 7fac0af94640 1 --2- 172.21.15.33:0/1129701530 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac04101230 0x7fac041053b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fabfc013490 tx=0x7fabfc032b30 comp rx=0 tx=0).stop 2024-09-12T12:32:58.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.977+0000 7fac0af94640 1 -- 172.21.15.33:0/1129701530 shutdown_connections 2024-09-12T12:32:58.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.977+0000 7fac0af94640 1 --2- 172.21.15.33:0/1129701530 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac04101230 0x7fac041053b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:58.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.977+0000 7fac0af94640 1 --2- 172.21.15.33:0/1129701530 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac04100dd0 0x7fac04104e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:58.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.977+0000 7fac0af94640 1 --2- 172.21.15.33:0/1129701530 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac04069f90 0x7fac04100890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:58.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.977+0000 7fac0af94640 1 -- 172.21.15.33:0/1129701530 >> 172.21.15.33:0/1129701530 conn(0x7fac04075f70 msgr2=0x7fac04076380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:32:58.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.979+0000 7fac0af94640 1 -- 172.21.15.33:0/1129701530 shutdown_connections 2024-09-12T12:32:58.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.981+0000 7fac0af94640 1 -- 172.21.15.33:0/1129701530 wait complete. 2024-09-12T12:32:58.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.982+0000 7fac0af94640 1 Processor -- start 2024-09-12T12:32:58.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.983+0000 7fac0af94640 1 -- start start 2024-09-12T12:32:58.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.983+0000 7fac0af94640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac04069f90 0x7fac041a7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:58.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.983+0000 7fac0af94640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac04100dd0 0x7fac041a7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:58.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.983+0000 7fac0af94640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac04101230 0x7fac041ab8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:58.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.983+0000 7fac0af94640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fac04109cd0 con 0x7fac04100dd0 2024-09-12T12:32:58.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.983+0000 7fac0af94640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fac04109b50 con 0x7fac04069f90 2024-09-12T12:32:58.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.983+0000 7fac0af94640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fac04109e50 con 0x7fac04101230 2024-09-12T12:32:58.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.984+0000 7fac08d30640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac04069f90 0x7fac041a7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:58.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.984+0000 7fac08d30640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac04069f90 0x7fac041a7000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:49566/0 (socket says 172.21.15.33:49566) 2024-09-12T12:32:58.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.984+0000 7fac08d30640 1 -- 172.21.15.33:0/2518711280 learned_addr learned my addr 172.21.15.33:0/2518711280 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:32:58.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.986+0000 7fac09531640 1 --2- 172.21.15.33:0/2518711280 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac04101230 0x7fac041ab8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:58.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.986+0000 7fac03fff640 1 --2- 172.21.15.33:0/2518711280 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac04100dd0 0x7fac041a7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:58.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.986+0000 7fac09531640 1 -- 172.21.15.33:0/2518711280 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac04069f90 msgr2=0x7fac041a7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:58.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.986+0000 7fac09531640 1 --2- 172.21.15.33:0/2518711280 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac04069f90 0x7fac041a7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:58.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.986+0000 7fac09531640 1 -- 172.21.15.33:0/2518711280 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac04100dd0 msgr2=0x7fac041a7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:58.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.986+0000 7fac09531640 1 --2- 172.21.15.33:0/2518711280 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac04100dd0 0x7fac041a7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:58.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.986+0000 7fac09531640 1 -- 172.21.15.33:0/2518711280 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac041abfd0 con 0x7fac04101230 2024-09-12T12:32:58.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.987+0000 7fac09531640 1 --2- 172.21.15.33:0/2518711280 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac04101230 0x7fac041ab8d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fabfc033120 tx=0x7fabfc0110d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:32:58.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.988+0000 7fac01ffb640 1 -- 172.21.15.33:0/2518711280 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabfc0113d0 con 0x7fac04101230 2024-09-12T12:32:58.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.988+0000 7fac01ffb640 1 -- 172.21.15.33:0/2518711280 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fabfc003e20 con 0x7fac04101230 2024-09-12T12:32:58.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.988+0000 7fac0af94640 1 -- 172.21.15.33:0/2518711280 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac041ac260 con 0x7fac04101230 2024-09-12T12:32:58.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.988+0000 7fac0af94640 1 -- 172.21.15.33:0/2518711280 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac041ac710 con 0x7fac04101230 2024-09-12T12:32:58.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.988+0000 7fac01ffb640 1 -- 172.21.15.33:0/2518711280 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabfc0041a0 con 0x7fac04101230 2024-09-12T12:32:58.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.991+0000 7fac0d36d740 1 Processor -- start 2024-09-12T12:32:58.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.992+0000 7fac0d36d740 1 -- start start 2024-09-12T12:32:58.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.992+0000 7fac0d36d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569ec786b40 0x5569ec785090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:58.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.993+0000 7fac0d36d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569ec7855d0 0x5569ec785a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:58.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.993+0000 7fac0d36d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5569ec790370 0x5569ec792760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:58.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.993+0000 7fac0d36d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5569ec6eb2f0 con 0x5569ec7855d0 2024-09-12T12:32:58.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.993+0000 7fac0d36d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5569ec692cf0 con 0x5569ec786b40 2024-09-12T12:32:58.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.993+0000 7fac0d36d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5569ec6e72b0 con 0x5569ec790370 2024-09-12T12:32:58.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.993+0000 7fac08d30640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569ec7855d0 0x5569ec785a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:58.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.993+0000 7fac08d30640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569ec7855d0 0x5569ec785a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34500/0 (socket says 172.21.15.33:34500) 2024-09-12T12:32:58.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.993+0000 7fac08d30640 1 -- 172.21.15.33:0/702854174 learned_addr learned my addr 172.21.15.33:0/702854174 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:32:58.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.994+0000 7fac08d30640 1 -- 172.21.15.33:0/702854174 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5569ec790370 msgr2=0x5569ec792760 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:32:58.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.994+0000 7fac08d30640 1 --2- 172.21.15.33:0/702854174 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5569ec790370 0x5569ec792760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:58.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.994+0000 7fac08d30640 1 -- 172.21.15.33:0/702854174 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569ec786b40 msgr2=0x5569ec785090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:32:58.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.994+0000 7fac08d30640 1 --2- 172.21.15.33:0/702854174 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569ec786b40 0x5569ec785090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:58.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.994+0000 7fac08d30640 1 -- 172.21.15.33:0/702854174 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569ec6773a0 con 0x5569ec7855d0 2024-09-12T12:32:58.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.994+0000 7fac08d30640 1 --2- 172.21.15.33:0/702854174 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569ec7855d0 0x5569ec785a10 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fabf400ae70 tx=0x7fabf400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f12d3c8d5d13b2ed server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:32:58.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.995+0000 7fabeaffd640 1 -- 172.21.15.33:0/702854174 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf401d070 con 0x5569ec7855d0 2024-09-12T12:32:58.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.995+0000 7fabeaffd640 1 -- 172.21.15.33:0/702854174 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fabf4010cf0 con 0x5569ec7855d0 2024-09-12T12:32:58.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.996+0000 7fac0d36d740 1 -- 172.21.15.33:0/702854174 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569ec7855d0 msgr2=0x5569ec785a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:58.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.996+0000 7fac0d36d740 1 --2- 172.21.15.33:0/702854174 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569ec7855d0 0x5569ec785a10 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fabf400ae70 tx=0x7fabf400f790 comp rx=0 tx=0).stop 2024-09-12T12:32:58.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:57.997+0000 7fac01ffb640 1 -- 172.21.15.33:0/2518711280 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fabfc045030 con 0x7fac04101230 2024-09-12T12:32:58.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.016+0000 7fac01ffb640 1 --2- 172.21.15.33:0/2518711280 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fabec0a2f30 0x7fabec0a53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:58.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.016+0000 7fac01ffb640 1 -- 172.21.15.33:0/2518711280 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fabfc0efd70 con 0x7fac04101230 2024-09-12T12:32:58.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.017+0000 7fac0d36d740 1 -- 172.21.15.33:0/702854174 shutdown_connections 2024-09-12T12:32:58.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.017+0000 7fac0d36d740 1 --2- 172.21.15.33:0/702854174 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5569ec790370 0x5569ec792760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:58.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.017+0000 7fac0d36d740 1 --2- 172.21.15.33:0/702854174 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569ec7855d0 0x5569ec785a10 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:58.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.017+0000 7fac0d36d740 1 --2- 172.21.15.33:0/702854174 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569ec786b40 0x5569ec785090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:58.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.017+0000 7fac0d36d740 1 -- 172.21.15.33:0/702854174 >> 172.21.15.33:0/702854174 conn(0x5569ec74e310 msgr2=0x5569ec781c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:32:58.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.018+0000 7fac0d36d740 1 -- 172.21.15.33:0/702854174 shutdown_connections 2024-09-12T12:32:58.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.019+0000 7fac0d36d740 1 -- 172.21.15.33:0/702854174 wait complete. 2024-09-12T12:32:58.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.019+0000 7fac0d36d740 1 -- start start 2024-09-12T12:32:58.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.019+0000 7fac0d36d740 1 Processor -- start 2024-09-12T12:32:58.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.020+0000 7fac0d36d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569ec7855d0 0x5569ec78fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:58.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.020+0000 7fac0d36d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569ec786b40 0x5569ec78cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:58.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.020+0000 7fac0d36d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5569ec790370 0x5569ec78d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:58.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.020+0000 7fac0d36d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5569ec7930c0 con 0x5569ec786b40 2024-09-12T12:32:58.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.020+0000 7fac0d36d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5569ec6a6060 con 0x5569ec7855d0 2024-09-12T12:32:58.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.020+0000 7fac0d36d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5569ec793240 con 0x5569ec790370 2024-09-12T12:32:58.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.020+0000 7fac0d36d740 10 client.0 _ll_register_callbacks cb 0x5569ec3f98c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:32:58.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.021+0000 7fac09531640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5569ec790370 0x5569ec78d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:58.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.021+0000 7fac09531640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5569ec790370 0x5569ec78d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:51880/0 (socket says 172.21.15.33:51880) 2024-09-12T12:32:58.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.021+0000 7fac09531640 1 -- 172.21.15.33:0/145517816 learned_addr learned my addr 172.21.15.33:0/145517816 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:32:58.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.021+0000 7fac08d30640 1 --2- 172.21.15.33:0/145517816 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569ec7855d0 0x5569ec78fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:58.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.023+0000 7fac03fff640 1 --2- 172.21.15.33:0/145517816 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569ec786b40 0x5569ec78cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:58.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.023+0000 7fac03fff640 1 --2- 172.21.15.33:0/2518711280 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fabec0a2f30 0x7fabec0a53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:58.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.023+0000 7fac08d30640 1 -- 172.21.15.33:0/145517816 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5569ec790370 msgr2=0x5569ec78d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:58.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.023+0000 7fac08d30640 1 --2- 172.21.15.33:0/145517816 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5569ec790370 0x5569ec78d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:58.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.023+0000 7fac08d30640 1 -- 172.21.15.33:0/145517816 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569ec786b40 msgr2=0x5569ec78cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:58.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.023+0000 7fac08d30640 1 --2- 172.21.15.33:0/145517816 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569ec786b40 0x5569ec78cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:58.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.023+0000 7fac08d30640 1 -- 172.21.15.33:0/145517816 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569ec45c3c0 con 0x5569ec7855d0 2024-09-12T12:32:58.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.024+0000 7fac03fff640 1 --2- 172.21.15.33:0/2518711280 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fabec0a2f30 0x7fabec0a53f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x5569ec78e4c0 tx=0x7fabf8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:32:58.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.025+0000 7fac08d30640 1 --2- 172.21.15.33:0/145517816 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569ec7855d0 0x5569ec78fc60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x5569ec782ac0 tx=0x7fabf4018670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=173c374f87b604f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:32:58.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.025+0000 7fabe3fff640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:32:58.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.027+0000 7fabe3fff640 1 -- 172.21.15.33:0/145517816 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf401d040 con 0x5569ec7855d0 2024-09-12T12:32:58.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.028+0000 7fac0d36d740 1 -- 172.21.15.33:0/145517816 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fabf4010cf0 con 0x5569ec7855d0 2024-09-12T12:32:58.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.028+0000 7fabe3fff640 1 -- 172.21.15.33:0/145517816 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fabf400a940 con 0x5569ec7855d0 2024-09-12T12:32:58.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.028+0000 7fabe3fff640 1 -- 172.21.15.33:0/145517816 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fabf402e050 con 0x5569ec7855d0 2024-09-12T12:32:58.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.028+0000 7fac0d36d740 10 client.25595 fetch_fsmap learned FSMap version 27 2024-09-12T12:32:58.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.028+0000 7fac0d36d740 1 -- 172.21.15.33:0/145517816 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5569ec79eb60 con 0x5569ec7855d0 2024-09-12T12:32:58.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.030+0000 7fabe3fff640 1 -- 172.21.15.33:0/145517816 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fabf4010cf0 con 0x5569ec7855d0 2024-09-12T12:32:58.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.030+0000 7fabe3fff640 1 -- 172.21.15.33:0/145517816 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fabf4020070 con 0x5569ec7855d0 2024-09-12T12:32:58.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.030+0000 7fac0d36d740 10 client.25595 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:32:58.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.030+0000 7fac0d36d740 10 client.25595 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:32:58.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.030+0000 7fac0d36d740 20 client.25595 populate_metadata read hostname 'smithi033' 2024-09-12T12:32:58.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.030+0000 7fac0d36d740 1 --2- 172.21.15.33:0/145517816 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5569ec7a0490 0x5569ec7a28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:58.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.030+0000 7fac0d36d740 4 client.25595 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:32:58.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.030+0000 7fac0d36d740 1 -- 172.21.15.33:0/145517816 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5569ec6f8860 con 0x5569ec7a0490 2024-09-12T12:32:58.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.031+0000 7fac03fff640 1 --2- 172.21.15.33:0/145517816 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5569ec7a0490 0x5569ec7a28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:58.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.031+0000 7fac03fff640 1 --2- 172.21.15.33:0/145517816 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5569ec7a0490 0x5569ec7a28d0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64cccd5470474791 server_cookie=37f1b6b9dc60bc73 in_seq=0 out_seq=0 2024-09-12T12:32:58.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.031+0000 7fabe3fff640 10 client.25595 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:32:58.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.032+0000 7fabe3fff640 1 -- 172.21.15.33:0/145517816 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5569ec6f8860 con 0x5569ec7a0490 2024-09-12T12:32:58.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.032+0000 7fabe3fff640 10 client.25595 handle_command_reply: tid=0 2024-09-12T12:32:58.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.032+0000 7fac0d36d740 1 client.25595 shutdown 2024-09-12T12:32:58.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.032+0000 7fac0d36d740 1 -- 172.21.15.33:0/145517816 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569ec7855d0 msgr2=0x5569ec78fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:58.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.032+0000 7fac0d36d740 1 --2- 172.21.15.33:0/145517816 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569ec7855d0 0x5569ec78fc60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x5569ec782ac0 tx=0x7fabf4018670 comp rx=0 tx=0).stop 2024-09-12T12:32:58.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.032+0000 7fac0d36d740 1 -- 172.21.15.33:0/145517816 shutdown_connections 2024-09-12T12:32:58.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.032+0000 7fac0d36d740 1 --2- 172.21.15.33:0/145517816 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5569ec7a0490 0x5569ec7a28d0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:58.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.033+0000 7fac0d36d740 1 --2- 172.21.15.33:0/145517816 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5569ec790370 0x5569ec78d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:58.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.033+0000 7fac0d36d740 1 --2- 172.21.15.33:0/145517816 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569ec786b40 0x5569ec78cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:58.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.033+0000 7fac0d36d740 1 --2- 172.21.15.33:0/145517816 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569ec7855d0 0x5569ec78fc60 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:58.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.033+0000 7fac0d36d740 1 -- 172.21.15.33:0/145517816 >> 172.21.15.33:0/145517816 conn(0x5569ec74e310 msgr2=0x5569ec787960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:32:58.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.033+0000 7fabe3fff640 0 client.25595 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:32:58.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.033+0000 7fac0d36d740 1 -- 172.21.15.33:0/145517816 shutdown_connections 2024-09-12T12:32:58.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.033+0000 7fac0d36d740 1 -- 172.21.15.33:0/145517816 wait complete. 2024-09-12T12:32:58.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.033+0000 7fac0d36d740 20 client.25595 trim_cache size 0 max 16384 2024-09-12T12:32:58.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.046+0000 7fac0d36d740 1 Processor -- start 2024-09-12T12:32:58.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.046+0000 7fac0d36d740 1 -- start start 2024-09-12T12:32:58.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.046+0000 7fac0d36d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5569ec7855d0 0x5569ec791760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:58.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.046+0000 7fac0d36d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569ec786b40 0x5569ec791ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:58.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.046+0000 7fac0d36d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569ec790370 0x5569ec78c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:58.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.046+0000 7fac0d36d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fac041c88d0 con 0x5569ec786b40 2024-09-12T12:32:58.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.046+0000 7fac0d36d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fac041c61a0 con 0x5569ec790370 2024-09-12T12:32:58.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.046+0000 7fac0d36d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fac041a8360 con 0x5569ec7855d0 2024-09-12T12:32:58.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.046+0000 7fac03fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569ec786b40 0x5569ec791ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:58.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.046+0000 7fac09531640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569ec790370 0x5569ec78c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:58.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.046+0000 7fac03fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569ec786b40 0x5569ec791ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34518/0 (socket says 172.21.15.33:34518) 2024-09-12T12:32:58.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.046+0000 7fac03fff640 1 -- 172.21.15.33:0/3720702077 learned_addr learned my addr 172.21.15.33:0/3720702077 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:32:58.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.046+0000 7fac08d30640 1 --2- 172.21.15.33:0/3720702077 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5569ec7855d0 0x5569ec791760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:58.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.046+0000 7fac09531640 1 -- 172.21.15.33:0/3720702077 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5569ec7855d0 msgr2=0x5569ec791760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:58.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.046+0000 7fac09531640 1 --2- 172.21.15.33:0/3720702077 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5569ec7855d0 0x5569ec791760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:58.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.046+0000 7fac09531640 1 -- 172.21.15.33:0/3720702077 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569ec786b40 msgr2=0x5569ec791ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:58.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.046+0000 7fac09531640 1 --2- 172.21.15.33:0/3720702077 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569ec786b40 0x5569ec791ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:58.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.047+0000 7fac09531640 1 -- 172.21.15.33:0/3720702077 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569ec78ffd0 con 0x5569ec790370 2024-09-12T12:32:58.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.047+0000 7fac03fff640 1 --2- 172.21.15.33:0/3720702077 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569ec786b40 0x5569ec791ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:32:58.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.047+0000 7fac09531640 1 --2- 172.21.15.33:0/3720702077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569ec790370 0x5569ec78c7d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fabfc0b8680 tx=0x7fabfc0131f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47d90705d3552862 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:32:58.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.047+0000 7fabea7fc640 1 -- 172.21.15.33:0/3720702077 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabfc0d5070 con 0x5569ec790370 2024-09-12T12:32:58.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.047+0000 7fabea7fc640 1 -- 172.21.15.33:0/3720702077 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fabfc0c0620 con 0x5569ec790370 2024-09-12T12:32:58.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.047+0000 7fabea7fc640 1 -- 172.21.15.33:0/3720702077 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabfc0b88e0 con 0x5569ec790370 2024-09-12T12:32:58.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.048+0000 7fac0d36d740 1 -- 172.21.15.33:0/3720702077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569ec790370 msgr2=0x5569ec78c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:58.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.048+0000 7fac0d36d740 1 --2- 172.21.15.33:0/3720702077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569ec790370 0x5569ec78c7d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fabfc0b8680 tx=0x7fabfc0131f0 comp rx=0 tx=0).stop 2024-09-12T12:32:58.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.048+0000 7fac0d36d740 1 -- 172.21.15.33:0/3720702077 shutdown_connections 2024-09-12T12:32:58.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.048+0000 7fac0d36d740 1 --2- 172.21.15.33:0/3720702077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569ec790370 0x5569ec78c7d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:58.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.048+0000 7fac0d36d740 1 --2- 172.21.15.33:0/3720702077 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569ec786b40 0x5569ec791ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:58.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.048+0000 7fac0d36d740 1 --2- 172.21.15.33:0/3720702077 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5569ec7855d0 0x5569ec791760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:58.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.048+0000 7fac0d36d740 1 -- 172.21.15.33:0/3720702077 >> 172.21.15.33:0/3720702077 conn(0x5569ec74e310 msgr2=0x5569ec7922d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:32:58.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.048+0000 7fac0d36d740 1 -- 172.21.15.33:0/3720702077 shutdown_connections 2024-09-12T12:32:58.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.048+0000 7fac0d36d740 1 -- 172.21.15.33:0/3720702077 wait complete. 2024-09-12T12:32:58.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.048+0000 7fac0d36d740 1 -- start start 2024-09-12T12:32:58.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.048+0000 7fac0d36d740 1 Processor -- start 2024-09-12T12:32:58.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.048+0000 7fac0d36d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569ec7855d0 0x5569ec7a73b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:58.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.048+0000 7fac0d36d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5569ec786b40 0x5569ec7a78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:58.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.049+0000 7fac0d36d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569ec790370 0x5569ec797640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:58.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.049+0000 7fac0d36d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fac04073f30 con 0x5569ec790370 2024-09-12T12:32:58.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.049+0000 7fac0d36d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fac041c5ad0 con 0x5569ec7855d0 2024-09-12T12:32:58.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.049+0000 7fac0d36d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fac041c4d30 con 0x5569ec786b40 2024-09-12T12:32:58.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.049+0000 7fac0d36d740 10 client.0 _ll_register_callbacks cb 0x7fabf401b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:32:58.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.049+0000 7fac08d30640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569ec7855d0 0x5569ec7a73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:58.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.049+0000 7fac08d30640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569ec7855d0 0x5569ec7a73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:49602/0 (socket says 172.21.15.33:49602) 2024-09-12T12:32:58.355 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-09-12T12:32:58.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.049+0000 7fac08d30640 1 -- 172.21.15.33:0/321440504 learned_addr learned my addr 172.21.15.33:0/321440504 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:32:58.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.049+0000 7fac03fff640 1 --2- 172.21.15.33:0/321440504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5569ec786b40 0x5569ec7a78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:58.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.049+0000 7fac09531640 1 --2- 172.21.15.33:0/321440504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569ec790370 0x5569ec797640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:58.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.049+0000 7fac03fff640 1 -- 172.21.15.33:0/321440504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569ec7855d0 msgr2=0x5569ec7a73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:58.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.049+0000 7fac03fff640 1 --2- 172.21.15.33:0/321440504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569ec7855d0 0x5569ec7a73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:58.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.049+0000 7fac03fff640 1 -- 172.21.15.33:0/321440504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569ec790370 msgr2=0x5569ec797640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:32:58.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.049+0000 7fac03fff640 1 --2- 172.21.15.33:0/321440504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569ec790370 0x5569ec797640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:58.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.049+0000 7fac03fff640 1 -- 172.21.15.33:0/321440504 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569ec797b80 con 0x5569ec786b40 2024-09-12T12:32:58.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.049+0000 7fac08d30640 1 --2- 172.21.15.33:0/321440504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569ec7855d0 0x5569ec7a73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:32:58.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.049+0000 7fac09531640 1 --2- 172.21.15.33:0/321440504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569ec790370 0x5569ec797640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:32:58.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.049+0000 7fac03fff640 1 --2- 172.21.15.33:0/321440504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5569ec786b40 0x5569ec7a78f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x5569ec786380 tx=0x7fabf80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78ce4f057e146c40 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:32:58.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.049+0000 7fabe3fff640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:32:58.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.049+0000 7fabe3fff640 1 -- 172.21.15.33:0/321440504 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf8004220 con 0x5569ec786b40 2024-09-12T12:32:58.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.049+0000 7fac0d36d740 1 -- 172.21.15.33:0/321440504 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fabfc0c0620 con 0x5569ec786b40 2024-09-12T12:32:58.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.049+0000 7fabe3fff640 1 -- 172.21.15.33:0/321440504 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fabf80043c0 con 0x5569ec786b40 2024-09-12T12:32:58.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.050+0000 7fabe3fff640 1 -- 172.21.15.33:0/321440504 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fabf8005020 con 0x5569ec786b40 2024-09-12T12:32:58.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.050+0000 7fac0d36d740 10 client.25693 fetch_fsmap learned FSMap version 27 2024-09-12T12:32:58.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.050+0000 7fac0d36d740 1 -- 172.21.15.33:0/321440504 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5569ec798e40 con 0x5569ec786b40 2024-09-12T12:32:58.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.050+0000 7fabe3fff640 1 -- 172.21.15.33:0/321440504 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fabfc0c0620 con 0x5569ec786b40 2024-09-12T12:32:58.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.050+0000 7fabe3fff640 1 -- 172.21.15.33:0/321440504 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fabf801c040 con 0x5569ec786b40 2024-09-12T12:32:58.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.050+0000 7fac0d36d740 10 client.25693 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:32:58.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.050+0000 7fac0d36d740 10 client.25693 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:32:58.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.050+0000 7fac0d36d740 20 client.25693 populate_metadata read hostname 'smithi033' 2024-09-12T12:32:58.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.050+0000 7fac0d36d740 1 --2- 172.21.15.33:0/321440504 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5569ec80b270 0x5569ec80d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:32:58.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.050+0000 7fac0d36d740 4 client.25693 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:32:58.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.050+0000 7fac0d36d740 1 -- 172.21.15.33:0/321440504 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5569ec6f2d70 con 0x5569ec80b270 2024-09-12T12:32:58.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.050+0000 7fac08d30640 1 --2- 172.21.15.33:0/321440504 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5569ec80b270 0x5569ec80d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:32:58.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.051+0000 7fac08d30640 1 --2- 172.21.15.33:0/321440504 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5569ec80b270 0x5569ec80d690 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c30a2aac94d4778 server_cookie=bc9c18a8e5c06a82 in_seq=0 out_seq=0 2024-09-12T12:32:58.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.051+0000 7fabe3fff640 10 client.25693 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:32:58.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.051+0000 7fabe3fff640 1 -- 172.21.15.33:0/321440504 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5569ec6f2d70 con 0x5569ec80b270 2024-09-12T12:32:58.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.051+0000 7fabe3fff640 10 client.25693 handle_command_reply: tid=0 2024-09-12T12:32:58.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.051+0000 7fac0d36d740 1 client.25693 shutdown 2024-09-12T12:32:58.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.051+0000 7fac0d36d740 1 -- 172.21.15.33:0/321440504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5569ec786b40 msgr2=0x5569ec7a78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:58.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.051+0000 7fac0d36d740 1 --2- 172.21.15.33:0/321440504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5569ec786b40 0x5569ec7a78f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x5569ec786380 tx=0x7fabf80046c0 comp rx=0 tx=0).stop 2024-09-12T12:32:58.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.051+0000 7fac0d36d740 1 -- 172.21.15.33:0/321440504 shutdown_connections 2024-09-12T12:32:58.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.051+0000 7fac0d36d740 1 --2- 172.21.15.33:0/321440504 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5569ec80b270 0x5569ec80d690 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:58.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.051+0000 7fac0d36d740 1 --2- 172.21.15.33:0/321440504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569ec790370 0x5569ec797640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:58.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.051+0000 7fac0d36d740 1 --2- 172.21.15.33:0/321440504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5569ec786b40 0x5569ec7a78f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:58.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.051+0000 7fac0d36d740 1 --2- 172.21.15.33:0/321440504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569ec7855d0 0x5569ec7a73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:58.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.051+0000 7fac0d36d740 1 -- 172.21.15.33:0/321440504 >> 172.21.15.33:0/321440504 conn(0x5569ec74e310 msgr2=0x5569ec7804e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:32:58.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.051+0000 7fabe3fff640 0 client.25693 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:32:58.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.051+0000 7fac0d36d740 1 -- 172.21.15.33:0/321440504 shutdown_connections 2024-09-12T12:32:58.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.051+0000 7fac0d36d740 1 -- 172.21.15.33:0/321440504 wait complete. 2024-09-12T12:32:58.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.051+0000 7fac0d36d740 20 client.25693 trim_cache size 0 max 16384 2024-09-12T12:32:58.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.052+0000 7fac0af94640 1 -- 172.21.15.33:0/2518711280 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fabec0a2f30 msgr2=0x7fabec0a53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:58.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.052+0000 7fac0af94640 1 --2- 172.21.15.33:0/2518711280 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fabec0a2f30 0x7fabec0a53f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x5569ec78e4c0 tx=0x7fabf8005f90 comp rx=0 tx=0).stop 2024-09-12T12:32:58.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.052+0000 7fac0af94640 1 -- 172.21.15.33:0/2518711280 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac04101230 msgr2=0x7fac041ab8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:32:58.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.052+0000 7fac0af94640 1 --2- 172.21.15.33:0/2518711280 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac04101230 0x7fac041ab8d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fabfc033120 tx=0x7fabfc0110d0 comp rx=0 tx=0).stop 2024-09-12T12:32:58.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.052+0000 7fac0af94640 1 -- 172.21.15.33:0/2518711280 shutdown_connections 2024-09-12T12:32:58.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.052+0000 7fac0af94640 1 --2- 172.21.15.33:0/2518711280 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fabec0a2f30 0x7fabec0a53f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:58.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.052+0000 7fac0af94640 1 --2- 172.21.15.33:0/2518711280 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac04101230 0x7fac041ab8d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:58.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.052+0000 7fac0af94640 1 --2- 172.21.15.33:0/2518711280 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac04100dd0 0x7fac041a7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:58.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.052+0000 7fac0af94640 1 --2- 172.21.15.33:0/2518711280 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac04069f90 0x7fac041a7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:32:58.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.052+0000 7fac0af94640 1 -- 172.21.15.33:0/2518711280 >> 172.21.15.33:0/2518711280 conn(0x7fac04075f70 msgr2=0x7fac040ffec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:32:58.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.052+0000 7fac0af94640 1 -- 172.21.15.33:0/2518711280 shutdown_connections 2024-09-12T12:32:58.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:32:58.052+0000 7fac0af94640 1 -- 172.21.15.33:0/2518711280 wait complete. 2024-09-12T12:32:59.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:59 smithi043 ceph-mon[34144]: pgmap v559: 129 pgs: 129 active+clean; 10 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 44 MiB/s wr, 795 op/s 2024-09-12T12:32:59.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:59 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:32:59.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:59 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:32:59.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:59 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:32:59.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:59 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:32:59.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:59 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:32:59.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:59 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:32:59.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:59 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:32:59.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:59 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:32:59.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:32:59 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:32:59.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:59 smithi102 ceph-mon[34799]: pgmap v559: 129 pgs: 129 active+clean; 10 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 44 MiB/s wr, 795 op/s 2024-09-12T12:32:59.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:59 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:32:59.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:59 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:32:59.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:59 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:32:59.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:59 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:32:59.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:59 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:32:59.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:59 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:32:59.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:59 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:32:59.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:59 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:32:59.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:32:59 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:32:59.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:59 smithi033 ceph-mon[31246]: pgmap v559: 129 pgs: 129 active+clean; 10 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 44 MiB/s wr, 795 op/s 2024-09-12T12:32:59.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:59 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:32:59.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:59 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:32:59.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:59 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:32:59.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:59 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:32:59.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:59 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:32:59.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:59 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:32:59.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:59 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:32:59.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:59 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:32:59.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:32:59 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:33:00.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:00 smithi043 ceph-mon[34144]: Adjusting osd_memory_target on smithi043 to 177.0M 2024-09-12T12:33:00.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:00 smithi043 ceph-mon[34144]: Adjusting osd_memory_target on smithi102 to 176.0M 2024-09-12T12:33:00.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:00 smithi043 ceph-mon[34144]: Unable to set osd_memory_target on smithi043 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-12T12:33:00.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:00 smithi043 ceph-mon[34144]: Unable to set osd_memory_target on smithi102 to 184576716: error parsing value: Value '184576716' is below minimum 939524096 2024-09-12T12:33:00.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:00 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:33:00.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:00 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:33:00.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:00 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:33:00.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:00 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:33:00.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:00 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:33:00.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:00 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:33:00.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:00 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:33:00.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:00 smithi102 ceph-mon[34799]: Adjusting osd_memory_target on smithi043 to 177.0M 2024-09-12T12:33:00.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:00 smithi102 ceph-mon[34799]: Adjusting osd_memory_target on smithi102 to 176.0M 2024-09-12T12:33:00.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:00 smithi102 ceph-mon[34799]: Unable to set osd_memory_target on smithi043 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-12T12:33:00.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:00 smithi102 ceph-mon[34799]: Unable to set osd_memory_target on smithi102 to 184576716: error parsing value: Value '184576716' is below minimum 939524096 2024-09-12T12:33:00.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:00 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:33:00.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:00 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:33:00.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:00 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:33:00.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:00 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:33:00.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:00 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:33:00.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:00 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:33:00.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:00 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:33:00.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:00 smithi033 ceph-mon[31246]: Adjusting osd_memory_target on smithi043 to 177.0M 2024-09-12T12:33:00.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:00 smithi033 ceph-mon[31246]: Adjusting osd_memory_target on smithi102 to 176.0M 2024-09-12T12:33:00.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:00 smithi033 ceph-mon[31246]: Unable to set osd_memory_target on smithi043 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-12T12:33:00.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:00 smithi033 ceph-mon[31246]: Unable to set osd_memory_target on smithi102 to 184576716: error parsing value: Value '184576716' is below minimum 939524096 2024-09-12T12:33:00.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:00 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:33:00.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:00 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:33:00.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:00 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:33:00.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:00 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:33:00.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:00 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:33:00.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:00 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:33:00.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:00 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:33:00.784 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T12:33:00.784 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T12:33:01.524 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:33:01.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:01 smithi043 ceph-mon[34144]: pgmap v560: 129 pgs: 129 active+clean; 10 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 36 MiB/s wr, 647 op/s 2024-09-12T12:33:01.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:01 smithi043 ceph-mon[34144]: Adjusting osd_memory_target on smithi033 to 177.0M 2024-09-12T12:33:01.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:01 smithi043 ceph-mon[34144]: Unable to set osd_memory_target on smithi033 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-12T12:33:01.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:01 smithi102 ceph-mon[34799]: pgmap v560: 129 pgs: 129 active+clean; 10 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 36 MiB/s wr, 647 op/s 2024-09-12T12:33:01.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:01 smithi102 ceph-mon[34799]: Adjusting osd_memory_target on smithi033 to 177.0M 2024-09-12T12:33:01.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:01 smithi102 ceph-mon[34799]: Unable to set osd_memory_target on smithi033 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-12T12:33:01.669 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:01 smithi033 ceph-mon[31246]: pgmap v560: 129 pgs: 129 active+clean; 10 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 36 MiB/s wr, 647 op/s 2024-09-12T12:33:01.669 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:01 smithi033 ceph-mon[31246]: Adjusting osd_memory_target on smithi033 to 177.0M 2024-09-12T12:33:01.669 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:01 smithi033 ceph-mon[31246]: Unable to set osd_memory_target on smithi033 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-12T12:33:03.358 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:33:03.358 INFO:teuthology.orchestra.run.smithi033.stdout: "return_code": 0, 2024-09-12T12:33:03.358 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_tag": "6ed21e96-cb13-4c7d-b14f-c593a24ae87f", 2024-09-12T12:33:03.358 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": "asynchronous" 2024-09-12T12:33:03.358 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:33:03.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.159+0000 7f13d7de5640 1 -- 172.21.15.33:0/3974375897 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13d011b140 msgr2=0x7f13d011d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:03.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.159+0000 7f13d7de5640 1 --2- 172.21.15.33:0/3974375897 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13d011b140 0x7f13d011d530 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f13c801acb0 tx=0x7f13c803b920 comp rx=0 tx=0).stop 2024-09-12T12:33:03.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.163+0000 7f13d7de5640 1 -- 172.21.15.33:0/3974375897 shutdown_connections 2024-09-12T12:33:03.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.163+0000 7f13d7de5640 1 --2- 172.21.15.33:0/3974375897 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13d011b140 0x7f13d011d530 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:03.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.163+0000 7f13d7de5640 1 --2- 172.21.15.33:0/3974375897 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13d0109830 0x7f13d0109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:03.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.163+0000 7f13d7de5640 1 --2- 172.21.15.33:0/3974375897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13d0109450 0x7f13d0110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:03.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.163+0000 7f13d7de5640 1 -- 172.21.15.33:0/3974375897 >> 172.21.15.33:0/3974375897 conn(0x7f13d006e140 msgr2=0x7f13d006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:33:03.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.166+0000 7f13d7de5640 1 -- 172.21.15.33:0/3974375897 shutdown_connections 2024-09-12T12:33:03.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.166+0000 7f13d7de5640 1 -- 172.21.15.33:0/3974375897 wait complete. 2024-09-12T12:33:03.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.167+0000 7f13d7de5640 1 Processor -- start 2024-09-12T12:33:03.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.170+0000 7f13d7de5640 1 -- start start 2024-09-12T12:33:03.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.170+0000 7f13d7de5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13d0109450 0x7f13d011a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:03.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.170+0000 7f13d7de5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13d0109830 0x7f13d011ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:03.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.170+0000 7f13d7de5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13d011b140 0x7f13d0116920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:03.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.170+0000 7f13d7de5640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f13d0113160 con 0x7f13d011b140 2024-09-12T12:33:03.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.170+0000 7f13d7de5640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f13d0112fe0 con 0x7f13d0109450 2024-09-12T12:33:03.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.170+0000 7f13d7de5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f13d01132e0 con 0x7f13d0109830 2024-09-12T12:33:03.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.171+0000 7f13d6382640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13d011b140 0x7f13d0116920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:03.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.171+0000 7f13d6382640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13d011b140 0x7f13d0116920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34074/0 (socket says 172.21.15.33:34074) 2024-09-12T12:33:03.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.171+0000 7f13d6382640 1 -- 172.21.15.33:0/187204827 learned_addr learned my addr 172.21.15.33:0/187204827 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:33:03.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.173+0000 7f13d5380640 1 --2- 172.21.15.33:0/187204827 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13d0109830 0x7f13d011ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:03.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.173+0000 7f13d5b81640 1 --2- 172.21.15.33:0/187204827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13d0109450 0x7f13d011a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:03.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.174+0000 7f13d6382640 1 -- 172.21.15.33:0/187204827 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13d0109830 msgr2=0x7f13d011ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:03.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.174+0000 7f13d6382640 1 --2- 172.21.15.33:0/187204827 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13d0109830 0x7f13d011ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:03.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.174+0000 7f13d6382640 1 -- 172.21.15.33:0/187204827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13d0109450 msgr2=0x7f13d011a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:03.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.174+0000 7f13d6382640 1 --2- 172.21.15.33:0/187204827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13d0109450 0x7f13d011a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:03.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.174+0000 7f13d6382640 1 -- 172.21.15.33:0/187204827 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13d01171e0 con 0x7f13d011b140 2024-09-12T12:33:03.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.175+0000 7f13d5380640 1 --2- 172.21.15.33:0/187204827 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13d0109830 0x7f13d011ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:33:03.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.179+0000 7f13d6382640 1 --2- 172.21.15.33:0/187204827 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13d011b140 0x7f13d0116920 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f13c8006010 tx=0x7f13c80418f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:33:03.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.182+0000 7f13c6ffd640 1 -- 172.21.15.33:0/187204827 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c8045020 con 0x7f13d011b140 2024-09-12T12:33:03.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.182+0000 7f13d7de5640 1 -- 172.21.15.33:0/187204827 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13d0117470 con 0x7f13d011b140 2024-09-12T12:33:03.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.182+0000 7f13c6ffd640 1 -- 172.21.15.33:0/187204827 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f13c8040780 con 0x7f13d011b140 2024-09-12T12:33:03.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.182+0000 7f13c6ffd640 1 -- 172.21.15.33:0/187204827 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c8004590 con 0x7f13d011b140 2024-09-12T12:33:03.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.183+0000 7f13d7de5640 1 -- 172.21.15.33:0/187204827 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13d01ab340 con 0x7f13d011b140 2024-09-12T12:33:03.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.190+0000 7f13c6ffd640 1 -- 172.21.15.33:0/187204827 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f13c8048020 con 0x7f13d011b140 2024-09-12T12:33:03.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.192+0000 7f13c6ffd640 1 --2- 172.21.15.33:0/187204827 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f13bc0a2d50 0x7f13bc0a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:03.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.192+0000 7f13c6ffd640 1 -- 172.21.15.33:0/187204827 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f13c8101170 con 0x7f13d011b140 2024-09-12T12:33:03.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.193+0000 7f13d5b81640 1 --2- 172.21.15.33:0/187204827 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f13bc0a2d50 0x7f13bc0a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:03.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.195+0000 7f13da1be740 1 Processor -- start 2024-09-12T12:33:03.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.196+0000 7f13d5b81640 1 --2- 172.21.15.33:0/187204827 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f13bc0a2d50 0x7f13bc0a5210 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f13cc009b60 tx=0x7f13cc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:33:03.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.199+0000 7f13da1be740 1 -- start start 2024-09-12T12:33:03.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.201+0000 7f13da1be740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f64199b60 0x564f64199f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:03.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.201+0000 7f13da1be740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564f6419a480 0x564f641a4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:03.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.201+0000 7f13da1be740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f641a4d40 0x564f641a7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:03.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.201+0000 7f13da1be740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x564f640ff280 con 0x564f641a4d40 2024-09-12T12:33:03.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.201+0000 7f13da1be740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x564f640a6b10 con 0x564f6419a480 2024-09-12T12:33:03.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.201+0000 7f13da1be740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564f640fb240 con 0x564f64199b60 2024-09-12T12:33:03.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.202+0000 7f13d5b81640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f64199b60 0x564f64199f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:03.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.203+0000 7f13d5b81640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f64199b60 0x564f64199f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:48836/0 (socket says 172.21.15.33:48836) 2024-09-12T12:33:03.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.203+0000 7f13d5b81640 1 -- 172.21.15.33:0/4177555352 learned_addr learned my addr 172.21.15.33:0/4177555352 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:33:03.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.203+0000 7f13d5b81640 1 -- 172.21.15.33:0/4177555352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564f6419a480 msgr2=0x564f641a4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:03.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.203+0000 7f13d5b81640 1 --2- 172.21.15.33:0/4177555352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564f6419a480 0x564f641a4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:03.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.203+0000 7f13d5b81640 1 -- 172.21.15.33:0/4177555352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f641a4d40 msgr2=0x564f641a7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:03.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.203+0000 7f13d5b81640 1 --2- 172.21.15.33:0/4177555352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f641a4d40 0x564f641a7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:03.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.203+0000 7f13d5b81640 1 -- 172.21.15.33:0/4177555352 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f640b31f0 con 0x564f64199b60 2024-09-12T12:33:03.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.204+0000 7f13d5b81640 1 --2- 172.21.15.33:0/4177555352 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f64199b60 0x564f64199f40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f13cc011fa0 tx=0x7f13cc014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5834c82a81b0fcdc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:33:03.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.205+0000 7f13bbfff640 1 -- 172.21.15.33:0/4177555352 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13cc01f620 con 0x564f64199b60 2024-09-12T12:33:03.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.206+0000 7f13bbfff640 1 -- 172.21.15.33:0/4177555352 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f13cc01fc70 con 0x564f64199b60 2024-09-12T12:33:03.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.206+0000 7f13bbfff640 1 -- 172.21.15.33:0/4177555352 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13cc027c50 con 0x564f64199b60 2024-09-12T12:33:03.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.207+0000 7f13da1be740 1 -- 172.21.15.33:0/4177555352 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f64199b60 msgr2=0x564f64199f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:03.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.207+0000 7f13da1be740 1 --2- 172.21.15.33:0/4177555352 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f64199b60 0x564f64199f40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f13cc011fa0 tx=0x7f13cc014000 comp rx=0 tx=0).stop 2024-09-12T12:33:03.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.209+0000 7f13da1be740 1 -- 172.21.15.33:0/4177555352 shutdown_connections 2024-09-12T12:33:03.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.210+0000 7f13da1be740 1 --2- 172.21.15.33:0/4177555352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f641a4d40 0x564f641a7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:03.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.210+0000 7f13da1be740 1 --2- 172.21.15.33:0/4177555352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564f6419a480 0x564f641a4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:03.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.210+0000 7f13da1be740 1 --2- 172.21.15.33:0/4177555352 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f64199b60 0x564f64199f40 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:03.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.210+0000 7f13da1be740 1 -- 172.21.15.33:0/4177555352 >> 172.21.15.33:0/4177555352 conn(0x564f641960f0 msgr2=0x564f641964d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:33:03.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.211+0000 7f13da1be740 1 -- 172.21.15.33:0/4177555352 shutdown_connections 2024-09-12T12:33:03.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.211+0000 7f13da1be740 1 -- 172.21.15.33:0/4177555352 wait complete. 2024-09-12T12:33:03.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.212+0000 7f13da1be740 1 -- start start 2024-09-12T12:33:03.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.212+0000 7f13da1be740 1 Processor -- start 2024-09-12T12:33:03.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.212+0000 7f13da1be740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f64199b60 0x564f641a1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:03.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.212+0000 7f13da1be740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564f6419a480 0x564f641a2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:03.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.212+0000 7f13da1be740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f641a4d40 0x564f641a2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:03.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.212+0000 7f13da1be740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x564f641a7910 con 0x564f64199b60 2024-09-12T12:33:03.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.212+0000 7f13da1be740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x564f640b9f10 con 0x564f6419a480 2024-09-12T12:33:03.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.212+0000 7f13da1be740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564f641a7a90 con 0x564f641a4d40 2024-09-12T12:33:03.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.213+0000 7f13da1be740 10 client.0 _ll_register_callbacks cb 0x564f64082a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:33:03.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.213+0000 7f13d5380640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564f6419a480 0x564f641a2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:03.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.213+0000 7f13d5380640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564f6419a480 0x564f641a2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:39224/0 (socket says 172.21.15.33:39224) 2024-09-12T12:33:03.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.213+0000 7f13d5380640 1 -- 172.21.15.33:0/910290195 learned_addr learned my addr 172.21.15.33:0/910290195 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:33:03.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.214+0000 7f13d6382640 1 --2- 172.21.15.33:0/910290195 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f641a4d40 0x564f641a2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:03.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.214+0000 7f13d5380640 1 -- 172.21.15.33:0/910290195 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f641a4d40 msgr2=0x564f641a2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:03.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.214+0000 7f13d5380640 1 --2- 172.21.15.33:0/910290195 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f641a4d40 0x564f641a2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:03.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.214+0000 7f13d5380640 1 -- 172.21.15.33:0/910290195 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f64199b60 msgr2=0x564f641a1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:03.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.214+0000 7f13d5380640 1 --2- 172.21.15.33:0/910290195 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f64199b60 0x564f641a1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:03.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.214+0000 7f13d5380640 1 -- 172.21.15.33:0/910290195 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f63e706a0 con 0x564f6419a480 2024-09-12T12:33:03.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.215+0000 7f13d5380640 1 --2- 172.21.15.33:0/910290195 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564f6419a480 0x564f641a2240 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f13c0011460 tx=0x7f13c0011920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e6fd03fc3e3b5d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:33:03.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.215+0000 7f13b97fa640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:33:03.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.215+0000 7f13b97fa640 1 -- 172.21.15.33:0/910290195 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c0004440 con 0x564f6419a480 2024-09-12T12:33:03.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.216+0000 7f13da1be740 1 -- 172.21.15.33:0/910290195 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13cc01fc70 con 0x564f6419a480 2024-09-12T12:33:03.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.216+0000 7f13b97fa640 1 -- 172.21.15.33:0/910290195 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f13c00035f0 con 0x564f6419a480 2024-09-12T12:33:03.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.216+0000 7f13b97fa640 1 -- 172.21.15.33:0/910290195 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f13c0025050 con 0x564f6419a480 2024-09-12T12:33:03.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.217+0000 7f13da1be740 10 client.25610 fetch_fsmap learned FSMap version 27 2024-09-12T12:33:03.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.217+0000 7f13da1be740 1 -- 172.21.15.33:0/910290195 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564f641b3650 con 0x564f6419a480 2024-09-12T12:33:03.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.217+0000 7f13b97fa640 1 -- 172.21.15.33:0/910290195 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f13cc01fc70 con 0x564f6419a480 2024-09-12T12:33:03.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.217+0000 7f13b97fa640 1 -- 172.21.15.33:0/910290195 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f13c0012b50 con 0x564f6419a480 2024-09-12T12:33:03.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.218+0000 7f13da1be740 10 client.25610 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:33:03.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.218+0000 7f13da1be740 10 client.25610 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:33:03.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.218+0000 7f13da1be740 20 client.25610 populate_metadata read hostname 'smithi033' 2024-09-12T12:33:03.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.218+0000 7f13da1be740 1 --2- 172.21.15.33:0/910290195 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x564f641b5070 0x564f641b74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:03.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.218+0000 7f13da1be740 4 client.25610 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:33:03.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.218+0000 7f13da1be740 1 -- 172.21.15.33:0/910290195 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f6410c7f0 con 0x564f641b5070 2024-09-12T12:33:03.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.218+0000 7f13d5b81640 1 --2- 172.21.15.33:0/910290195 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x564f641b5070 0x564f641b74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:03.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.232+0000 7f13d5b81640 1 --2- 172.21.15.33:0/910290195 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x564f641b5070 0x564f641b74b0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5b13c66d7274466 server_cookie=cba549adf27eb7ad in_seq=0 out_seq=0 2024-09-12T12:33:03.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.232+0000 7f13b97fa640 10 client.25610 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:33:03.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.233+0000 7f13b97fa640 1 -- 172.21.15.33:0/910290195 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564f6410c7f0 con 0x564f641b5070 2024-09-12T12:33:03.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.233+0000 7f13b97fa640 10 client.25610 handle_command_reply: tid=0 2024-09-12T12:33:03.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.233+0000 7f13da1be740 1 client.25610 shutdown 2024-09-12T12:33:03.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.235+0000 7f13da1be740 1 -- 172.21.15.33:0/910290195 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564f6419a480 msgr2=0x564f641a2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:03.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.235+0000 7f13da1be740 1 --2- 172.21.15.33:0/910290195 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564f6419a480 0x564f641a2240 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f13c0011460 tx=0x7f13c0011920 comp rx=0 tx=0).stop 2024-09-12T12:33:03.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.235+0000 7f13da1be740 1 -- 172.21.15.33:0/910290195 shutdown_connections 2024-09-12T12:33:03.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.235+0000 7f13da1be740 1 --2- 172.21.15.33:0/910290195 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x564f641b5070 0x564f641b74b0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:03.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.235+0000 7f13da1be740 1 --2- 172.21.15.33:0/910290195 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f641a4d40 0x564f641a2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:03.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.235+0000 7f13da1be740 1 --2- 172.21.15.33:0/910290195 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564f6419a480 0x564f641a2240 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:03.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.235+0000 7f13da1be740 1 --2- 172.21.15.33:0/910290195 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f64199b60 0x564f641a1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:03.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.235+0000 7f13b97fa640 0 client.25610 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:33:03.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.235+0000 7f13da1be740 1 -- 172.21.15.33:0/910290195 >> 172.21.15.33:0/910290195 conn(0x564f641960f0 msgr2=0x564f64195270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:33:03.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.235+0000 7f13da1be740 1 -- 172.21.15.33:0/910290195 shutdown_connections 2024-09-12T12:33:03.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.236+0000 7f13da1be740 1 -- 172.21.15.33:0/910290195 wait complete. 2024-09-12T12:33:03.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.236+0000 7f13da1be740 20 client.25610 trim_cache size 0 max 16384 2024-09-12T12:33:03.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.274+0000 7f13da1be740 1 Processor -- start 2024-09-12T12:33:03.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.275+0000 7f13da1be740 1 -- start start 2024-09-12T12:33:03.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.275+0000 7f13da1be740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564f64199b60 0x564f641a25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:03.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.275+0000 7f13da1be740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f6419a480 0x564f641bcd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:03.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.276+0000 7f13da1be740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f641a4d40 0x564f641bd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:03.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.276+0000 7f13da1be740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f13d01b7bd0 con 0x564f6419a480 2024-09-12T12:33:03.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.276+0000 7f13da1be740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f13d01b54a0 con 0x564f64199b60 2024-09-12T12:33:03.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.276+0000 7f13da1be740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f13d01b32f0 con 0x564f641a4d40 2024-09-12T12:33:03.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.276+0000 7f13d5b81640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564f64199b60 0x564f641a25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:03.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.276+0000 7f13d5b81640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564f64199b60 0x564f641a25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:39240/0 (socket says 172.21.15.33:39240) 2024-09-12T12:33:03.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.276+0000 7f13d5b81640 1 -- 172.21.15.33:0/2804459061 learned_addr learned my addr 172.21.15.33:0/2804459061 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:33:03.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.276+0000 7f13d6382640 1 --2- 172.21.15.33:0/2804459061 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f641a4d40 0x564f641bd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:03.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.276+0000 7f13d6382640 1 -- 172.21.15.33:0/2804459061 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564f64199b60 msgr2=0x564f641a25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:03.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.276+0000 7f13d6382640 1 --2- 172.21.15.33:0/2804459061 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564f64199b60 0x564f641a25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:03.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.276+0000 7f13d6382640 1 -- 172.21.15.33:0/2804459061 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f6419a480 msgr2=0x564f641bcd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:03.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.276+0000 7f13d6382640 1 --2- 172.21.15.33:0/2804459061 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f6419a480 0x564f641bcd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:03.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.276+0000 7f13d6382640 1 -- 172.21.15.33:0/2804459061 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f641a45d0 con 0x564f641a4d40 2024-09-12T12:33:03.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.277+0000 7f13d6382640 1 --2- 172.21.15.33:0/2804459061 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f641a4d40 0x564f641bd2c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x564f64197470 tx=0x7f13c8040c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f276e2346c220b85 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:33:03.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.281+0000 7f13bb7fe640 1 -- 172.21.15.33:0/2804459061 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c80cd5e0 con 0x564f641a4d40 2024-09-12T12:33:03.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.281+0000 7f13bb7fe640 1 -- 172.21.15.33:0/2804459061 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f13c80d1990 con 0x564f641a4d40 2024-09-12T12:33:03.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.281+0000 7f13bb7fe640 1 -- 172.21.15.33:0/2804459061 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c80c9c50 con 0x564f641a4d40 2024-09-12T12:33:03.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.282+0000 7f13da1be740 1 -- 172.21.15.33:0/2804459061 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f641a4d40 msgr2=0x564f641bd2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:03.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.282+0000 7f13da1be740 1 --2- 172.21.15.33:0/2804459061 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f641a4d40 0x564f641bd2c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x564f64197470 tx=0x7f13c8040c60 comp rx=0 tx=0).stop 2024-09-12T12:33:03.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.282+0000 7f13da1be740 1 -- 172.21.15.33:0/2804459061 shutdown_connections 2024-09-12T12:33:03.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.282+0000 7f13da1be740 1 --2- 172.21.15.33:0/2804459061 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f641a4d40 0x564f641bd2c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:03.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.282+0000 7f13da1be740 1 --2- 172.21.15.33:0/2804459061 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f6419a480 0x564f641bcd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:03.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.282+0000 7f13da1be740 1 --2- 172.21.15.33:0/2804459061 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564f64199b60 0x564f641a25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:03.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.282+0000 7f13da1be740 1 -- 172.21.15.33:0/2804459061 >> 172.21.15.33:0/2804459061 conn(0x564f641960f0 msgr2=0x564f641a3c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:33:03.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.283+0000 7f13da1be740 1 -- 172.21.15.33:0/2804459061 shutdown_connections 2024-09-12T12:33:03.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.283+0000 7f13da1be740 1 -- 172.21.15.33:0/2804459061 wait complete. 2024-09-12T12:33:03.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.284+0000 7f13da1be740 1 -- start start 2024-09-12T12:33:03.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.284+0000 7f13da1be740 1 Processor -- start 2024-09-12T12:33:03.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.285+0000 7f13da1be740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f64199b60 0x564f641a8e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:03.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.285+0000 7f13da1be740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f6419a480 0x564f641a93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:03.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.285+0000 7f13da1be740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564f641a4d40 0x564f6421ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:03.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.285+0000 7f13d5b81640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f64199b60 0x564f641a8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:03.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.285+0000 7f13da1be740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f13d01b3960 con 0x564f6419a480 2024-09-12T12:33:03.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.285+0000 7f13da1be740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f13d01b4dd0 con 0x564f641a4d40 2024-09-12T12:33:03.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.285+0000 7f13da1be740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f13d01b4030 con 0x564f64199b60 2024-09-12T12:33:03.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.285+0000 7f13d6382640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564f641a4d40 0x564f6421ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:03.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.285+0000 7f13d5b81640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f64199b60 0x564f641a8e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:48868/0 (socket says 172.21.15.33:48868) 2024-09-12T12:33:03.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.285+0000 7f13d5b81640 1 -- 172.21.15.33:0/219812698 learned_addr learned my addr 172.21.15.33:0/219812698 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:33:03.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.286+0000 7f13da1be740 10 client.0 _ll_register_callbacks cb 0x7f13c0009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:33:03.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.286+0000 7f13d5b81640 1 -- 172.21.15.33:0/219812698 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564f641a4d40 msgr2=0x564f6421ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:03.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.286+0000 7f13d5b81640 1 --2- 172.21.15.33:0/219812698 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564f641a4d40 0x564f6421ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:03.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.286+0000 7f13d5b81640 1 -- 172.21.15.33:0/219812698 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f6419a480 msgr2=0x564f641a93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:03.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.286+0000 7f13d5b81640 1 --2- 172.21.15.33:0/219812698 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f6419a480 0x564f641a93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:03.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.286+0000 7f13d5b81640 1 -- 172.21.15.33:0/219812698 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f6421f290 con 0x564f64199b60 2024-09-12T12:33:03.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.287+0000 7f13d5b81640 1 --2- 172.21.15.33:0/219812698 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f64199b60 0x564f641a8e60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f13cc011fa0 tx=0x7f13cc009980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7b91a63d405968d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:33:03.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.287+0000 7f13b97fa640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:33:03.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.287+0000 7f13b97fa640 1 -- 172.21.15.33:0/219812698 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13cc027b00 con 0x564f64199b60 2024-09-12T12:33:03.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.287+0000 7f13b97fa640 1 -- 172.21.15.33:0/219812698 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f13cc027ca0 con 0x564f64199b60 2024-09-12T12:33:03.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.290+0000 7f13da1be740 1 -- 172.21.15.33:0/219812698 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13c80d1990 con 0x564f64199b60 2024-09-12T12:33:03.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.293+0000 7f13b97fa640 1 -- 172.21.15.33:0/219812698 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f13cc005040 con 0x564f64199b60 2024-09-12T12:33:03.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.294+0000 7f13da1be740 10 client.25711 fetch_fsmap learned FSMap version 27 2024-09-12T12:33:03.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.294+0000 7f13da1be740 1 -- 172.21.15.33:0/219812698 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564f642204d0 con 0x564f64199b60 2024-09-12T12:33:03.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.294+0000 7f13b97fa640 1 -- 172.21.15.33:0/219812698 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f13cc004660 con 0x564f64199b60 2024-09-12T12:33:03.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.294+0000 7f13b97fa640 1 -- 172.21.15.33:0/219812698 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f13cc033430 con 0x564f64199b60 2024-09-12T12:33:03.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.295+0000 7f13da1be740 10 client.25711 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:33:03.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.295+0000 7f13da1be740 10 client.25711 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:33:03.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.295+0000 7f13da1be740 20 client.25711 populate_metadata read hostname 'smithi033' 2024-09-12T12:33:03.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.295+0000 7f13da1be740 1 --2- 172.21.15.33:0/219812698 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x564f64220950 0x564f64222d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:03.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.296+0000 7f13da1be740 4 client.25711 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T12:33:03.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.296+0000 7f13da1be740 1 -- 172.21.15.33:0/219812698 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f13c80d1990 con 0x564f64220950 2024-09-12T12:33:03.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.298+0000 7f13d5380640 1 --2- 172.21.15.33:0/219812698 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x564f64220950 0x564f64222d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:03.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.306+0000 7f13b97fa640 10 client.25711 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:33:03.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.306+0000 7f13d5380640 1 --2- 172.21.15.33:0/219812698 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x564f64220950 0x564f64222d90 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a57a7743807c452 server_cookie=5574ed4e893d2272 in_seq=0 out_seq=0 2024-09-12T12:33:03.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.311+0000 7f13b97fa640 1 -- 172.21.15.33:0/219812698 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f13c80d1990 con 0x564f64220950 2024-09-12T12:33:03.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.311+0000 7f13b97fa640 10 client.25711 handle_command_reply: tid=0 2024-09-12T12:33:03.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.312+0000 7f13da1be740 1 client.25711 shutdown 2024-09-12T12:33:03.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.316+0000 7f13da1be740 1 -- 172.21.15.33:0/219812698 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f64199b60 msgr2=0x564f641a8e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:03.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.316+0000 7f13da1be740 1 --2- 172.21.15.33:0/219812698 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f64199b60 0x564f641a8e60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f13cc011fa0 tx=0x7f13cc009980 comp rx=0 tx=0).stop 2024-09-12T12:33:03.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.316+0000 7f13da1be740 1 -- 172.21.15.33:0/219812698 shutdown_connections 2024-09-12T12:33:03.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.316+0000 7f13da1be740 1 --2- 172.21.15.33:0/219812698 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x564f64220950 0x564f64222d90 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:03.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.316+0000 7f13da1be740 1 --2- 172.21.15.33:0/219812698 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564f641a4d40 0x564f6421ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:03.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.316+0000 7f13b97fa640 0 client.25711 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:33:03.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.316+0000 7f13da1be740 1 --2- 172.21.15.33:0/219812698 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f6419a480 0x564f641a93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:03.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.317+0000 7f13da1be740 1 --2- 172.21.15.33:0/219812698 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f64199b60 0x564f641a8e60 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:03.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.317+0000 7f13da1be740 1 -- 172.21.15.33:0/219812698 >> 172.21.15.33:0/219812698 conn(0x564f641960f0 msgr2=0x564f64194a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:33:03.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.317+0000 7f13da1be740 1 -- 172.21.15.33:0/219812698 shutdown_connections 2024-09-12T12:33:03.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.317+0000 7f13da1be740 1 -- 172.21.15.33:0/219812698 wait complete. 2024-09-12T12:33:03.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.317+0000 7f13da1be740 20 client.25711 trim_cache size 0 max 16384 2024-09-12T12:33:03.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.321+0000 7f13d7de5640 1 -- 172.21.15.33:0/187204827 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f13bc0a2d50 msgr2=0x7f13bc0a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:03.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.321+0000 7f13d7de5640 1 --2- 172.21.15.33:0/187204827 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f13bc0a2d50 0x7f13bc0a5210 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f13cc009b60 tx=0x7f13cc005f90 comp rx=0 tx=0).stop 2024-09-12T12:33:03.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.321+0000 7f13d7de5640 1 -- 172.21.15.33:0/187204827 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13d011b140 msgr2=0x7f13d0116920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:03.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.321+0000 7f13d7de5640 1 --2- 172.21.15.33:0/187204827 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13d011b140 0x7f13d0116920 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f13c8006010 tx=0x7f13c80418f0 comp rx=0 tx=0).stop 2024-09-12T12:33:03.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.321+0000 7f13d7de5640 1 -- 172.21.15.33:0/187204827 shutdown_connections 2024-09-12T12:33:03.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.321+0000 7f13d7de5640 1 --2- 172.21.15.33:0/187204827 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f13bc0a2d50 0x7f13bc0a5210 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:03.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.321+0000 7f13d7de5640 1 --2- 172.21.15.33:0/187204827 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13d011b140 0x7f13d0116920 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:03.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.321+0000 7f13d7de5640 1 --2- 172.21.15.33:0/187204827 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13d0109830 0x7f13d011ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:03.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.321+0000 7f13d7de5640 1 --2- 172.21.15.33:0/187204827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13d0109450 0x7f13d011a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:03.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.321+0000 7f13d7de5640 1 -- 172.21.15.33:0/187204827 >> 172.21.15.33:0/187204827 conn(0x7f13d006e140 msgr2=0x7f13d0072390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:33:03.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.321+0000 7f13d7de5640 1 -- 172.21.15.33:0/187204827 shutdown_connections 2024-09-12T12:33:03.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:02.321+0000 7f13d7de5640 1 -- 172.21.15.33:0/187204827 wait complete. 2024-09-12T12:33:03.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:03 smithi043 ceph-mon[34144]: pgmap v561: 129 pgs: 129 active+clean; 10 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 34 MiB/s wr, 616 op/s 2024-09-12T12:33:03.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:03 smithi043 ceph-mon[34144]: scrub queued for path: / 2024-09-12T12:33:03.617 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:03 smithi043 ceph-mon[34144]: scrub summary: idle+waiting paths [/] 2024-09-12T12:33:03.617 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:03 smithi043 ceph-mon[34144]: scrub summary: active paths [/] 2024-09-12T12:33:03.617 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:03 smithi043 ceph-mon[34144]: scrub summary: idle+waiting paths [/] 2024-09-12T12:33:03.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:03 smithi102 ceph-mon[34799]: pgmap v561: 129 pgs: 129 active+clean; 10 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 34 MiB/s wr, 616 op/s 2024-09-12T12:33:03.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:03 smithi102 ceph-mon[34799]: scrub queued for path: / 2024-09-12T12:33:03.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:03 smithi102 ceph-mon[34799]: scrub summary: idle+waiting paths [/] 2024-09-12T12:33:03.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:03 smithi102 ceph-mon[34799]: scrub summary: active paths [/] 2024-09-12T12:33:03.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:03 smithi102 ceph-mon[34799]: scrub summary: idle+waiting paths [/] 2024-09-12T12:33:03.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:03 smithi033 ceph-mon[31246]: pgmap v561: 129 pgs: 129 active+clean; 10 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 34 MiB/s wr, 616 op/s 2024-09-12T12:33:03.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:03 smithi033 ceph-mon[31246]: scrub queued for path: / 2024-09-12T12:33:03.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:03 smithi033 ceph-mon[31246]: scrub summary: idle+waiting paths [/] 2024-09-12T12:33:03.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:03 smithi033 ceph-mon[31246]: scrub summary: active paths [/] 2024-09-12T12:33:03.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:03 smithi033 ceph-mon[31246]: scrub summary: idle+waiting paths [/] 2024-09-12T12:33:04.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:04 smithi043 ceph-mon[34144]: scrub summary: active paths [/] 2024-09-12T12:33:04.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:04 smithi043 ceph-mon[34144]: scrub summary: idle+waiting paths [/] 2024-09-12T12:33:04.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:04 smithi102 ceph-mon[34799]: scrub summary: active paths [/] 2024-09-12T12:33:04.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:04 smithi102 ceph-mon[34799]: scrub summary: idle+waiting paths [/] 2024-09-12T12:33:04.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:04 smithi033 ceph-mon[31246]: scrub summary: active paths [/] 2024-09-12T12:33:04.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:04 smithi033 ceph-mon[31246]: scrub summary: idle+waiting paths [/] 2024-09-12T12:33:05.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:05 smithi043 ceph-mon[34144]: pgmap v562: 129 pgs: 129 active+clean; 10 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 43 MiB/s wr, 776 op/s 2024-09-12T12:33:05.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:05 smithi102 ceph-mon[34799]: pgmap v562: 129 pgs: 129 active+clean; 10 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 43 MiB/s wr, 776 op/s 2024-09-12T12:33:05.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:05 smithi033 ceph-mon[31246]: pgmap v562: 129 pgs: 129 active+clean; 10 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 43 MiB/s wr, 776 op/s 2024-09-12T12:33:07.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:07 smithi043 ceph-mon[34144]: pgmap v563: 129 pgs: 129 active+clean; 10 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 33 MiB/s wr, 595 op/s 2024-09-12T12:33:07.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:07 smithi102 ceph-mon[34799]: pgmap v563: 129 pgs: 129 active+clean; 10 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 33 MiB/s wr, 595 op/s 2024-09-12T12:33:07.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:07 smithi033 ceph-mon[31246]: pgmap v563: 129 pgs: 129 active+clean; 10 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 33 MiB/s wr, 595 op/s 2024-09-12T12:33:08.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:08 smithi043 ceph-mon[34144]: scrub summary: idle 2024-09-12T12:33:08.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:08 smithi102 ceph-mon[34799]: scrub summary: idle 2024-09-12T12:33:08.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:08 smithi033 ceph-mon[31246]: scrub summary: idle 2024-09-12T12:33:09.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:09 smithi043 ceph-mon[34144]: scrub summary: idle 2024-09-12T12:33:09.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:09 smithi043 ceph-mon[34144]: pgmap v564: 129 pgs: 129 active+clean; 10 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 41 MiB/s wr, 743 op/s 2024-09-12T12:33:09.633 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:09 smithi033 ceph-mon[31246]: scrub summary: idle 2024-09-12T12:33:09.633 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:09 smithi033 ceph-mon[31246]: pgmap v564: 129 pgs: 129 active+clean; 10 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 41 MiB/s wr, 743 op/s 2024-09-12T12:33:09.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:09 smithi102 ceph-mon[34799]: scrub summary: idle 2024-09-12T12:33:09.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:09 smithi102 ceph-mon[34799]: pgmap v564: 129 pgs: 129 active+clean; 10 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 41 MiB/s wr, 743 op/s 2024-09-12T12:33:11.151 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T12:33:11.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:11 smithi033 ceph-mon[31246]: pgmap v565: 129 pgs: 129 active+clean; 10 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 31 MiB/s wr, 568 op/s 2024-09-12T12:33:11.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:11 smithi043 ceph-mon[34144]: pgmap v565: 129 pgs: 129 active+clean; 10 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 31 MiB/s wr, 568 op/s 2024-09-12T12:33:11.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:11 smithi102 ceph-mon[34799]: pgmap v565: 129 pgs: 129 active+clean; 10 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 31 MiB/s wr, 568 op/s 2024-09-12T12:33:11.804 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:33:13.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:13 smithi043 ceph-mon[34144]: pgmap v566: 129 pgs: 129 active+clean; 10 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 29 MiB/s wr, 537 op/s 2024-09-12T12:33:13.649 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:13 smithi102 ceph-mon[34799]: pgmap v566: 129 pgs: 129 active+clean; 10 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 29 MiB/s wr, 537 op/s 2024-09-12T12:33:13.730 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:13 smithi033 ceph-mon[31246]: pgmap v566: 129 pgs: 129 active+clean; 10 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 29 MiB/s wr, 537 op/s 2024-09-12T12:33:15.314 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:15 smithi033 ceph-mon[31246]: pgmap v567: 129 pgs: 129 active+clean; 10 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 36 MiB/s wr, 669 op/s 2024-09-12T12:33:15.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:15 smithi043 ceph-mon[34144]: pgmap v567: 129 pgs: 129 active+clean; 10 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 36 MiB/s wr, 669 op/s 2024-09-12T12:33:15.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:15 smithi102 ceph-mon[34799]: pgmap v567: 129 pgs: 129 active+clean; 10 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 36 MiB/s wr, 669 op/s 2024-09-12T12:33:15.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.966+0000 7f87245da640 1 -- 172.21.15.33:0/2581782184 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f871c1091f0 msgr2=0x7f871c1095d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:15.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.966+0000 7f87245da640 1 --2- 172.21.15.33:0/2581782184 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f871c1091f0 0x7f871c1095d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8718009930 tx=0x7f871802a480 comp rx=0 tx=0).stop 2024-09-12T12:33:15.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.966+0000 7f87245da640 1 -- 172.21.15.33:0/2581782184 shutdown_connections 2024-09-12T12:33:15.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.966+0000 7f87245da640 1 --2- 172.21.15.33:0/2581782184 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f871c10e780 0x7f871c10ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:15.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.966+0000 7f87245da640 1 --2- 172.21.15.33:0/2581782184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f871c109b10 0x7f871c10e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:15.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.966+0000 7f87245da640 1 --2- 172.21.15.33:0/2581782184 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f871c1091f0 0x7f871c1095d0 secure :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8718009930 tx=0x7f871802a480 comp rx=0 tx=0).stop 2024-09-12T12:33:15.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.966+0000 7f87245da640 1 -- 172.21.15.33:0/2581782184 >> 172.21.15.33:0/2581782184 conn(0x7f871c06e140 msgr2=0x7f871c06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:33:15.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.971+0000 7f87245da640 1 -- 172.21.15.33:0/2581782184 shutdown_connections 2024-09-12T12:33:15.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.971+0000 7f87245da640 1 -- 172.21.15.33:0/2581782184 wait complete. 2024-09-12T12:33:15.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.971+0000 7f87245da640 1 Processor -- start 2024-09-12T12:33:15.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.972+0000 7f87245da640 1 -- start start 2024-09-12T12:33:15.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.972+0000 7f87245da640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f871c109b10 0x7f871c1a7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:15.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.972+0000 7f87245da640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f871c10e780 0x7f871c1a7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:15.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.972+0000 7f87245da640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f871c1abe20 0x7f871c1ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:15.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.972+0000 7f87245da640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f871c113e90 con 0x7f871c109b10 2024-09-12T12:33:15.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.972+0000 7f87245da640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f871c113d10 con 0x7f871c1abe20 2024-09-12T12:33:15.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.972+0000 7f87245da640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f871c114010 con 0x7f871c10e780 2024-09-12T12:33:15.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.973+0000 7f8722b77640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f871c1abe20 0x7f871c1ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:15.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.973+0000 7f8722b77640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f871c1abe20 0x7f871c1ac2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:53722/0 (socket says 172.21.15.33:53722) 2024-09-12T12:33:15.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.973+0000 7f8722b77640 1 -- 172.21.15.33:0/3579979842 learned_addr learned my addr 172.21.15.33:0/3579979842 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:33:15.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.974+0000 7f8722b77640 1 -- 172.21.15.33:0/3579979842 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f871c10e780 msgr2=0x7f871c1a7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:15.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.974+0000 7f8722b77640 1 --2- 172.21.15.33:0/3579979842 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f871c10e780 0x7f871c1a7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:15.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.974+0000 7f8722b77640 1 -- 172.21.15.33:0/3579979842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f871c109b10 msgr2=0x7f871c1a7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:15.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.974+0000 7f8722b77640 1 --2- 172.21.15.33:0/3579979842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f871c109b10 0x7f871c1a7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:15.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.974+0000 7f8722b77640 1 -- 172.21.15.33:0/3579979842 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f871c1ac8e0 con 0x7f871c1abe20 2024-09-12T12:33:15.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.975+0000 7f8722b77640 1 --2- 172.21.15.33:0/3579979842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f871c1abe20 0x7f871c1ac2d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f871400b990 tx=0x7f871400be50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:33:15.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.976+0000 7f87137fe640 1 -- 172.21.15.33:0/3579979842 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8714019070 con 0x7f871c1abe20 2024-09-12T12:33:15.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.976+0000 7f87245da640 1 -- 172.21.15.33:0/3579979842 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f871c1acbd0 con 0x7f871c1abe20 2024-09-12T12:33:15.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.976+0000 7f87245da640 1 -- 172.21.15.33:0/3579979842 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f871c1b43b0 con 0x7f871c1abe20 2024-09-12T12:33:15.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.976+0000 7f87137fe640 1 -- 172.21.15.33:0/3579979842 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f871400cba0 con 0x7f871c1abe20 2024-09-12T12:33:15.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.976+0000 7f87137fe640 1 -- 172.21.15.33:0/3579979842 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8714007590 con 0x7f871c1abe20 2024-09-12T12:33:15.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.979+0000 7f87269b3740 1 Processor -- start 2024-09-12T12:33:15.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.981+0000 7f87269b3740 1 -- start start 2024-09-12T12:33:15.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.981+0000 7f87269b3740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebd3a3c4a0 0x55ebd3a3c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:15.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.981+0000 7f87269b3740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebd3a3cdc0 0x55ebd3a47140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:15.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.982+0000 7f87269b3740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebd3a47680 0x55ebd3a49a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:15.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.982+0000 7f87269b3740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55ebd39a22e0 con 0x55ebd3a47680 2024-09-12T12:33:15.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.982+0000 7f8721b75640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebd3a3c4a0 0x55ebd3a3c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:15.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.982+0000 7f87269b3740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ebd3949ce0 con 0x55ebd3a3cdc0 2024-09-12T12:33:15.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.982+0000 7f87269b3740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ebd399e2a0 con 0x55ebd3a3c4a0 2024-09-12T12:33:15.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.982+0000 7f8721b75640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebd3a3c4a0 0x55ebd3a3c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:43774/0 (socket says 172.21.15.33:43774) 2024-09-12T12:33:15.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.982+0000 7f8721b75640 1 -- 172.21.15.33:0/4250111565 learned_addr learned my addr 172.21.15.33:0/4250111565 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:33:15.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.982+0000 7f8722376640 1 --2- 172.21.15.33:0/4250111565 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebd3a3cdc0 0x55ebd3a47140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:15.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.982+0000 7f8721b75640 1 --2- 172.21.15.33:0/4250111565 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebd3a47680 0x55ebd3a49a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:15.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.982+0000 7f8722376640 1 -- 172.21.15.33:0/4250111565 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebd3a3c4a0 msgr2=0x55ebd3a3c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:15.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.982+0000 7f8722376640 1 --2- 172.21.15.33:0/4250111565 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebd3a3c4a0 0x55ebd3a3c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:15.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.983+0000 7f8722376640 1 -- 172.21.15.33:0/4250111565 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebd3a47680 msgr2=0x55ebd3a49a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:15.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.983+0000 7f8722376640 1 --2- 172.21.15.33:0/4250111565 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebd3a47680 0x55ebd3a49a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:15.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.983+0000 7f8722376640 1 -- 172.21.15.33:0/4250111565 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebd392e440 con 0x55ebd3a3cdc0 2024-09-12T12:33:15.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.983+0000 7f8722376640 1 --2- 172.21.15.33:0/4250111565 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebd3a3cdc0 0x55ebd3a47140 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8718008000 tx=0x7f8718004310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91a0acb750d63477 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:33:15.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.986+0000 7f87137fe640 1 -- 172.21.15.33:0/3579979842 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f871401c070 con 0x7f871c1abe20 2024-09-12T12:33:15.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.986+0000 7f8710ff9640 1 -- 172.21.15.33:0/4250111565 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8718035040 con 0x55ebd3a3cdc0 2024-09-12T12:33:15.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.986+0000 7f8710ff9640 1 -- 172.21.15.33:0/4250111565 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8718003aa0 con 0x55ebd3a3cdc0 2024-09-12T12:33:15.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.986+0000 7f8710ff9640 1 -- 172.21.15.33:0/4250111565 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8718031a20 con 0x55ebd3a3cdc0 2024-09-12T12:33:15.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.987+0000 7f87137fe640 1 --2- 172.21.15.33:0/3579979842 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f87080a2d90 0x7f87080a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:15.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.987+0000 7f87137fe640 1 -- 172.21.15.33:0/3579979842 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f87140ce8d0 con 0x7f871c1abe20 2024-09-12T12:33:15.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.988+0000 7f87269b3740 1 -- 172.21.15.33:0/4250111565 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebd3a3cdc0 msgr2=0x55ebd3a47140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:15.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.989+0000 7f87269b3740 1 --2- 172.21.15.33:0/4250111565 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebd3a3cdc0 0x55ebd3a47140 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8718008000 tx=0x7f8718004310 comp rx=0 tx=0).stop 2024-09-12T12:33:15.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.989+0000 7f8721b75640 1 --2- 172.21.15.33:0/3579979842 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f87080a2d90 0x7f87080a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:15.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.991+0000 7f8721b75640 1 --2- 172.21.15.33:0/3579979842 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f87080a2d90 0x7f87080a5250 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x55ebd3a39db0 tx=0x7f870c004840 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:33:15.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.994+0000 7f87269b3740 1 -- 172.21.15.33:0/4250111565 shutdown_connections 2024-09-12T12:33:15.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.994+0000 7f87269b3740 1 --2- 172.21.15.33:0/4250111565 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebd3a47680 0x55ebd3a49a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:15.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.994+0000 7f87269b3740 1 --2- 172.21.15.33:0/4250111565 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebd3a3cdc0 0x55ebd3a47140 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:15.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.994+0000 7f87269b3740 1 --2- 172.21.15.33:0/4250111565 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebd3a3c4a0 0x55ebd3a3c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:15.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.994+0000 7f87269b3740 1 -- 172.21.15.33:0/4250111565 >> 172.21.15.33:0/4250111565 conn(0x55ebd3a38a30 msgr2=0x55ebd3a38e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:33:15.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.995+0000 7f87269b3740 1 -- 172.21.15.33:0/4250111565 shutdown_connections 2024-09-12T12:33:15.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.995+0000 7f87269b3740 1 -- 172.21.15.33:0/4250111565 wait complete. 2024-09-12T12:33:15.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.996+0000 7f87269b3740 1 -- start start 2024-09-12T12:33:15.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.996+0000 7f87269b3740 1 Processor -- start 2024-09-12T12:33:15.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.997+0000 7f87269b3740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebd3a3c4a0 0x55ebd3a46f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:15.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.997+0000 7f87269b3740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebd3a3cdc0 0x55ebd3a441e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:15.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.997+0000 7f87269b3740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebd3a47680 0x55ebd3a44720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:15.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.997+0000 7f87269b3740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55ebd3a4a250 con 0x55ebd3a47680 2024-09-12T12:33:15.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.997+0000 7f87269b3740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ebd395d050 con 0x55ebd3a3c4a0 2024-09-12T12:33:15.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.998+0000 7f87269b3740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ebd3a4a3d0 con 0x55ebd3a3cdc0 2024-09-12T12:33:15.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.998+0000 7f87269b3740 10 client.0 _ll_register_callbacks cb 0x55ebd399d160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:33:15.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.998+0000 7f8721b75640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebd3a3cdc0 0x55ebd3a441e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:15.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.998+0000 7f8722376640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebd3a3c4a0 0x55ebd3a46f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:15.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.998+0000 7f8722376640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebd3a3c4a0 0x55ebd3a46f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:53738/0 (socket says 172.21.15.33:53738) 2024-09-12T12:33:15.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.998+0000 7f8721b75640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebd3a3cdc0 0x55ebd3a441e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:43776/0 (socket says 172.21.15.33:43776) 2024-09-12T12:33:15.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.998+0000 7f8722376640 1 -- 172.21.15.33:0/3037058605 learned_addr learned my addr 172.21.15.33:0/3037058605 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:33:15.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.998+0000 7f8722b77640 1 --2- 172.21.15.33:0/3037058605 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebd3a47680 0x55ebd3a44720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:16.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.999+0000 7f8722376640 1 -- 172.21.15.33:0/3037058605 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebd3a3cdc0 msgr2=0x55ebd3a441e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:16.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.999+0000 7f8722376640 1 --2- 172.21.15.33:0/3037058605 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebd3a3cdc0 0x55ebd3a441e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:16.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.999+0000 7f8722376640 1 -- 172.21.15.33:0/3037058605 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebd3a47680 msgr2=0x55ebd3a44720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:16.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.999+0000 7f8722376640 1 --2- 172.21.15.33:0/3037058605 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebd3a47680 0x55ebd3a44720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:16.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.999+0000 7f8722376640 1 -- 172.21.15.33:0/3037058605 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebd37133c0 con 0x55ebd3a3c4a0 2024-09-12T12:33:16.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.999+0000 7f8722376640 1 --2- 172.21.15.33:0/3037058605 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebd3a3c4a0 0x55ebd3a46f30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8718000c00 tx=0x7f87180095b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78e3224eac381c15 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:33:16.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.999+0000 7f8705ffb640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:33:16.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.999+0000 7f8705ffb640 1 -- 172.21.15.33:0/3037058605 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871804a020 con 0x55ebd3a3c4a0 2024-09-12T12:33:16.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:15.999+0000 7f87269b3740 1 -- 172.21.15.33:0/3037058605 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8718003aa0 con 0x55ebd3a3c4a0 2024-09-12T12:33:16.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.000+0000 7f8705ffb640 1 -- 172.21.15.33:0/3037058605 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f87180037f0 con 0x55ebd3a3c4a0 2024-09-12T12:33:16.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.003+0000 7f8705ffb640 1 -- 172.21.15.33:0/3037058605 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8718055050 con 0x55ebd3a3c4a0 2024-09-12T12:33:16.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.006+0000 7f87269b3740 10 client.25628 fetch_fsmap learned FSMap version 27 2024-09-12T12:33:16.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.006+0000 7f87269b3740 1 -- 172.21.15.33:0/3037058605 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ebd3a55bd0 con 0x55ebd3a3c4a0 2024-09-12T12:33:16.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.008+0000 7f8705ffb640 1 -- 172.21.15.33:0/3037058605 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8718003aa0 con 0x55ebd3a3c4a0 2024-09-12T12:33:16.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.008+0000 7f8705ffb640 1 -- 172.21.15.33:0/3037058605 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f871803a3f0 con 0x55ebd3a3c4a0 2024-09-12T12:33:16.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.008+0000 7f87269b3740 10 client.25628 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:33:16.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.008+0000 7f87269b3740 10 client.25628 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:33:16.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.008+0000 7f87269b3740 20 client.25628 populate_metadata read hostname 'smithi033' 2024-09-12T12:33:16.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.008+0000 7f87269b3740 1 --2- 172.21.15.33:0/3037058605 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55ebd3a57160 0x55ebd3a595e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:16.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.008+0000 7f87269b3740 4 client.25628 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:33:16.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.008+0000 7f87269b3740 1 -- 172.21.15.33:0/3037058605 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ebd39af850 con 0x55ebd3a57160 2024-09-12T12:33:16.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.011+0000 7f8721b75640 1 --2- 172.21.15.33:0/3037058605 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55ebd3a57160 0x55ebd3a595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:16.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.013+0000 7f8721b75640 1 --2- 172.21.15.33:0/3037058605 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55ebd3a57160 0x55ebd3a595e0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26703deb0c21d1a8 server_cookie=94ad11c60a21d948 in_seq=0 out_seq=0 2024-09-12T12:33:16.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.013+0000 7f8705ffb640 10 client.25628 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:33:16.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.017+0000 7f8705ffb640 1 -- 172.21.15.33:0/3037058605 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ebd39af850 con 0x55ebd3a57160 2024-09-12T12:33:16.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.017+0000 7f8705ffb640 10 client.25628 handle_command_reply: tid=0 2024-09-12T12:33:16.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.017+0000 7f87269b3740 1 client.25628 shutdown 2024-09-12T12:33:16.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.019+0000 7f87269b3740 1 -- 172.21.15.33:0/3037058605 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebd3a3c4a0 msgr2=0x55ebd3a46f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:16.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.019+0000 7f87269b3740 1 --2- 172.21.15.33:0/3037058605 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebd3a3c4a0 0x55ebd3a46f30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8718000c00 tx=0x7f87180095b0 comp rx=0 tx=0).stop 2024-09-12T12:33:16.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.019+0000 7f87269b3740 1 -- 172.21.15.33:0/3037058605 shutdown_connections 2024-09-12T12:33:16.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.019+0000 7f87269b3740 1 --2- 172.21.15.33:0/3037058605 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55ebd3a57160 0x55ebd3a595e0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:16.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.019+0000 7f87269b3740 1 --2- 172.21.15.33:0/3037058605 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebd3a47680 0x55ebd3a44720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:16.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.019+0000 7f87269b3740 1 --2- 172.21.15.33:0/3037058605 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebd3a3cdc0 0x55ebd3a441e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:16.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.019+0000 7f87269b3740 1 --2- 172.21.15.33:0/3037058605 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebd3a3c4a0 0x55ebd3a46f30 secure :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8718000c00 tx=0x7f87180095b0 comp rx=0 tx=0).stop 2024-09-12T12:33:16.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.019+0000 7f87269b3740 1 -- 172.21.15.33:0/3037058605 >> 172.21.15.33:0/3037058605 conn(0x55ebd3a38a30 msgr2=0x55ebd3a3e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:33:16.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.020+0000 7f8705ffb640 0 client.25628 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:33:16.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.021+0000 7f87269b3740 1 -- 172.21.15.33:0/3037058605 shutdown_connections 2024-09-12T12:33:16.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.021+0000 7f87269b3740 1 -- 172.21.15.33:0/3037058605 wait complete. 2024-09-12T12:33:16.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.021+0000 7f87269b3740 20 client.25628 trim_cache size 0 max 16384 2024-09-12T12:33:16.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.062+0000 7f87269b3740 1 Processor -- start 2024-09-12T12:33:16.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.062+0000 7f87269b3740 1 -- start start 2024-09-12T12:33:16.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.063+0000 7f87269b3740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebd3a3cdc0 0x55ebd3a37a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:16.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.063+0000 7f87269b3740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebd3a47680 0x55ebd3a5eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:16.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.063+0000 7f87269b3740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebd3a432d0 0x55ebd3a5f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:16.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.063+0000 7f87269b3740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8700012580 con 0x55ebd3a432d0 2024-09-12T12:33:16.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.063+0000 7f87269b3740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f870000fe50 con 0x55ebd3a3cdc0 2024-09-12T12:33:16.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.063+0000 7f87269b3740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f870000dca0 con 0x55ebd3a47680 2024-09-12T12:33:16.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.064+0000 7f8722b77640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebd3a432d0 0x55ebd3a5f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:16.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.064+0000 7f8722b77640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebd3a432d0 0x55ebd3a5f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47206/0 (socket says 172.21.15.33:47206) 2024-09-12T12:33:16.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.064+0000 7f8722b77640 1 -- 172.21.15.33:0/2577345303 learned_addr learned my addr 172.21.15.33:0/2577345303 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:33:16.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.064+0000 7f8722376640 1 --2- 172.21.15.33:0/2577345303 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebd3a3cdc0 0x55ebd3a37a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:16.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.066+0000 7f8722b77640 1 -- 172.21.15.33:0/2577345303 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebd3a47680 msgr2=0x55ebd3a5eeb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T12:33:16.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.066+0000 7f8722b77640 1 --2- 172.21.15.33:0/2577345303 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebd3a47680 0x55ebd3a5eeb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:16.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.066+0000 7f8722b77640 1 -- 172.21.15.33:0/2577345303 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebd3a3cdc0 msgr2=0x55ebd3a37a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:16.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.066+0000 7f8722b77640 1 --2- 172.21.15.33:0/2577345303 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebd3a3cdc0 0x55ebd3a37a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:16.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.066+0000 7f8722b77640 1 -- 172.21.15.33:0/2577345303 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebd3a38860 con 0x55ebd3a432d0 2024-09-12T12:33:16.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.074+0000 7f8722b77640 1 --2- 172.21.15.33:0/2577345303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebd3a432d0 0x55ebd3a5f3f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f8714014df0 tx=0x7f87140097a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b608a1628916d5e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:33:16.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.078+0000 7f8707fff640 1 -- 172.21.15.33:0/2577345303 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87140cc0f0 con 0x55ebd3a432d0 2024-09-12T12:33:16.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.078+0000 7f8707fff640 1 -- 172.21.15.33:0/2577345303 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f87140973b0 con 0x55ebd3a432d0 2024-09-12T12:33:16.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.078+0000 7f8707fff640 1 -- 172.21.15.33:0/2577345303 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8714096cf0 con 0x55ebd3a432d0 2024-09-12T12:33:16.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.079+0000 7f87269b3740 1 -- 172.21.15.33:0/2577345303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebd3a432d0 msgr2=0x55ebd3a5f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:16.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.079+0000 7f87269b3740 1 --2- 172.21.15.33:0/2577345303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebd3a432d0 0x55ebd3a5f3f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f8714014df0 tx=0x7f87140097a0 comp rx=0 tx=0).stop 2024-09-12T12:33:16.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.082+0000 7f87269b3740 1 -- 172.21.15.33:0/2577345303 shutdown_connections 2024-09-12T12:33:16.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.082+0000 7f87269b3740 1 --2- 172.21.15.33:0/2577345303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebd3a432d0 0x55ebd3a5f3f0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:16.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.082+0000 7f87269b3740 1 --2- 172.21.15.33:0/2577345303 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebd3a47680 0x55ebd3a5eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:16.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.082+0000 7f87269b3740 1 --2- 172.21.15.33:0/2577345303 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebd3a3cdc0 0x55ebd3a37a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:16.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.082+0000 7f87269b3740 1 -- 172.21.15.33:0/2577345303 >> 172.21.15.33:0/2577345303 conn(0x55ebd3a38a30 msgr2=0x55ebd3a37350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:33:16.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.085+0000 7f87269b3740 1 -- 172.21.15.33:0/2577345303 shutdown_connections 2024-09-12T12:33:16.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.085+0000 7f87269b3740 1 -- 172.21.15.33:0/2577345303 wait complete. 2024-09-12T12:33:16.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.086+0000 7f87269b3740 1 -- start start 2024-09-12T12:33:16.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.086+0000 7f87269b3740 1 Processor -- start 2024-09-12T12:33:16.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.087+0000 7f87269b3740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebd3a3cdc0 0x55ebd3a4fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:16.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.087+0000 7f87269b3740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebd3a432d0 0x55ebd3a4cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:16.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.088+0000 7f87269b3740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebd3a47680 0x55ebd3a4d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:16.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.088+0000 7f87269b3740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f870000e310 con 0x55ebd3a3cdc0 2024-09-12T12:33:16.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.088+0000 7f87269b3740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f870000f780 con 0x55ebd3a432d0 2024-09-12T12:33:16.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.088+0000 7f87269b3740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f870000e9e0 con 0x55ebd3a47680 2024-09-12T12:33:16.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.088+0000 7f87269b3740 10 client.0 _ll_register_callbacks cb 0x7f870c00c040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:33:16.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.089+0000 7f8721b75640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebd3a432d0 0x55ebd3a4cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:16.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.089+0000 7f8721b75640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebd3a432d0 0x55ebd3a4cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:53756/0 (socket says 172.21.15.33:53756) 2024-09-12T12:33:16.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.089+0000 7f8721b75640 1 -- 172.21.15.33:0/444893235 learned_addr learned my addr 172.21.15.33:0/444893235 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:33:16.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.089+0000 7f8722376640 1 --2- 172.21.15.33:0/444893235 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebd3a3cdc0 0x55ebd3a4fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:16.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.092+0000 7f8722b77640 1 --2- 172.21.15.33:0/444893235 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebd3a47680 0x55ebd3a4d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:16.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.093+0000 7f8721b75640 1 -- 172.21.15.33:0/444893235 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebd3a47680 msgr2=0x55ebd3a4d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:16.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.093+0000 7f8721b75640 1 --2- 172.21.15.33:0/444893235 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebd3a47680 0x55ebd3a4d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:16.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.093+0000 7f8721b75640 1 -- 172.21.15.33:0/444893235 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebd3a3cdc0 msgr2=0x55ebd3a4fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:16.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.093+0000 7f8721b75640 1 --2- 172.21.15.33:0/444893235 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebd3a3cdc0 0x55ebd3a4fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:16.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.093+0000 7f8721b75640 1 -- 172.21.15.33:0/444893235 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebd3a4dac0 con 0x55ebd3a432d0 2024-09-12T12:33:16.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.093+0000 7f8721b75640 1 --2- 172.21.15.33:0/444893235 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebd3a432d0 0x55ebd3a4cf40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f870c00bfd0 tx=0x7f870c0047d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a85df4dcbf785721 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:33:16.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.094+0000 7f8705ffb640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:33:16.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.094+0000 7f8705ffb640 1 -- 172.21.15.33:0/444893235 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870c033060 con 0x55ebd3a432d0 2024-09-12T12:33:16.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.094+0000 7f87269b3740 1 -- 172.21.15.33:0/444893235 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87140973b0 con 0x55ebd3a432d0 2024-09-12T12:33:16.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.094+0000 7f8705ffb640 1 -- 172.21.15.33:0/444893235 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f870c0248c0 con 0x55ebd3a432d0 2024-09-12T12:33:16.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.094+0000 7f8705ffb640 1 -- 172.21.15.33:0/444893235 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f870c00f050 con 0x55ebd3a432d0 2024-09-12T12:33:16.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.098+0000 7f87269b3740 10 client.25634 fetch_fsmap learned FSMap version 27 2024-09-12T12:33:16.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.098+0000 7f87269b3740 1 -- 172.21.15.33:0/444893235 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ebd3ac1d40 con 0x55ebd3a432d0 2024-09-12T12:33:16.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.098+0000 7f8705ffb640 1 -- 172.21.15.33:0/444893235 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f87140973b0 con 0x55ebd3a432d0 2024-09-12T12:33:16.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.098+0000 7f8705ffb640 1 -- 172.21.15.33:0/444893235 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f870c006060 con 0x55ebd3a432d0 2024-09-12T12:33:16.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.098+0000 7f87269b3740 10 client.25634 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:33:16.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.098+0000 7f87269b3740 10 client.25634 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:33:16.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.099+0000 7f87269b3740 20 client.25634 populate_metadata read hostname 'smithi033' 2024-09-12T12:33:16.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.099+0000 7f87269b3740 1 --2- 172.21.15.33:0/444893235 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55ebd3ac2450 0x55ebd3ac4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:16.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.099+0000 7f87269b3740 4 client.25634 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:33:16.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.099+0000 7f87269b3740 1 -- 172.21.15.33:0/444893235 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ebd3a44ab0 con 0x55ebd3ac2450 2024-09-12T12:33:16.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.103+0000 7f8722376640 1 --2- 172.21.15.33:0/444893235 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55ebd3ac2450 0x55ebd3ac4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:16.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.106+0000 7f8722376640 1 --2- 172.21.15.33:0/444893235 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55ebd3ac2450 0x55ebd3ac4870 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53895534ec4e1c9b server_cookie=8ad2d88285bfb72a in_seq=0 out_seq=0 2024-09-12T12:33:16.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.107+0000 7f8705ffb640 10 client.25634 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:33:16.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.107+0000 7f8705ffb640 1 -- 172.21.15.33:0/444893235 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ebd3a44ab0 con 0x55ebd3ac2450 2024-09-12T12:33:16.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.107+0000 7f8705ffb640 10 client.25634 handle_command_reply: tid=0 2024-09-12T12:33:16.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.107+0000 7f87269b3740 1 client.25634 shutdown 2024-09-12T12:33:16.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.107+0000 7f87269b3740 1 -- 172.21.15.33:0/444893235 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebd3a432d0 msgr2=0x55ebd3a4cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:16.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.107+0000 7f87269b3740 1 --2- 172.21.15.33:0/444893235 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebd3a432d0 0x55ebd3a4cf40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f870c00bfd0 tx=0x7f870c0047d0 comp rx=0 tx=0).stop 2024-09-12T12:33:16.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.109+0000 7f87269b3740 1 -- 172.21.15.33:0/444893235 shutdown_connections 2024-09-12T12:33:16.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.109+0000 7f87269b3740 1 --2- 172.21.15.33:0/444893235 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55ebd3ac2450 0x55ebd3ac4870 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:16.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.109+0000 7f87269b3740 1 --2- 172.21.15.33:0/444893235 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebd3a47680 0x55ebd3a4d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:16.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.109+0000 7f87269b3740 1 --2- 172.21.15.33:0/444893235 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebd3a432d0 0x55ebd3a4cf40 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:16.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.109+0000 7f87269b3740 1 --2- 172.21.15.33:0/444893235 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebd3a3cdc0 0x55ebd3a4fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:16.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.109+0000 7f87269b3740 1 -- 172.21.15.33:0/444893235 >> 172.21.15.33:0/444893235 conn(0x55ebd3a38a30 msgr2=0x55ebd3a37b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:33:16.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.109+0000 7f8705ffb640 0 client.25634 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:33:16.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.110+0000 7f87269b3740 1 -- 172.21.15.33:0/444893235 shutdown_connections 2024-09-12T12:33:16.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.110+0000 7f87269b3740 1 -- 172.21.15.33:0/444893235 wait complete. 2024-09-12T12:33:16.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.110+0000 7f87269b3740 20 client.25634 trim_cache size 0 max 16384 2024-09-12T12:33:16.112 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:33:16.112 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "no active scrubs running", 2024-09-12T12:33:16.112 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": {} 2024-09-12T12:33:16.112 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:33:16.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.117+0000 7f87245da640 1 -- 172.21.15.33:0/3579979842 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f87080a2d90 msgr2=0x7f87080a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:16.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.117+0000 7f87245da640 1 --2- 172.21.15.33:0/3579979842 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f87080a2d90 0x7f87080a5250 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x55ebd3a39db0 tx=0x7f870c004840 comp rx=0 tx=0).stop 2024-09-12T12:33:16.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.117+0000 7f87245da640 1 -- 172.21.15.33:0/3579979842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f871c1abe20 msgr2=0x7f871c1ac2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:16.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.117+0000 7f87245da640 1 --2- 172.21.15.33:0/3579979842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f871c1abe20 0x7f871c1ac2d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f871400b990 tx=0x7f871400be50 comp rx=0 tx=0).stop 2024-09-12T12:33:16.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.118+0000 7f87245da640 1 -- 172.21.15.33:0/3579979842 shutdown_connections 2024-09-12T12:33:16.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.118+0000 7f87245da640 1 --2- 172.21.15.33:0/3579979842 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f87080a2d90 0x7f87080a5250 secure :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0x55ebd3a39db0 tx=0x7f870c004840 comp rx=0 tx=0).stop 2024-09-12T12:33:16.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.118+0000 7f87245da640 1 --2- 172.21.15.33:0/3579979842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f871c1abe20 0x7f871c1ac2d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:16.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.118+0000 7f87245da640 1 --2- 172.21.15.33:0/3579979842 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f871c10e780 0x7f871c1a7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:16.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.118+0000 7f87245da640 1 --2- 172.21.15.33:0/3579979842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f871c109b10 0x7f871c1a7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:16.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.118+0000 7f87245da640 1 -- 172.21.15.33:0/3579979842 >> 172.21.15.33:0/3579979842 conn(0x7f871c06e140 msgr2=0x7f871c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:33:16.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.119+0000 7f87245da640 1 -- 172.21.15.33:0/3579979842 shutdown_connections 2024-09-12T12:33:16.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:16.119+0000 7f87245da640 1 -- 172.21.15.33:0/3579979842 wait complete. 2024-09-12T12:33:17.105 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T12:33:17.105 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:33:17.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:17 smithi033 ceph-mon[31246]: pgmap v568: 129 pgs: 129 active+clean; 10 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 27 MiB/s wr, 503 op/s 2024-09-12T12:33:17.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:17 smithi043 ceph-mon[34144]: pgmap v568: 129 pgs: 129 active+clean; 10 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 27 MiB/s wr, 503 op/s 2024-09-12T12:33:17.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:17 smithi102 ceph-mon[34799]: pgmap v568: 129 pgs: 129 active+clean; 10 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 27 MiB/s wr, 503 op/s 2024-09-12T12:33:17.747 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:33:18.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.462+0000 7f125f59e640 1 -- 172.21.15.33:0/2355236690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1260108020 msgr2=0x7f1260108440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:18.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.462+0000 7f125f59e640 1 --2- 172.21.15.33:0/2355236690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1260108020 0x7f1260108440 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1254009890 tx=0x7f125402a3b0 comp rx=0 tx=0).stop 2024-09-12T12:33:18.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.462+0000 7f125f59e640 1 -- 172.21.15.33:0/2355236690 shutdown_connections 2024-09-12T12:33:18.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.462+0000 7f125f59e640 1 --2- 172.21.15.33:0/2355236690 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1260108980 0x7f1260114ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:18.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.462+0000 7f125f59e640 1 --2- 172.21.15.33:0/2355236690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1260108020 0x7f1260108440 secure :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1254009890 tx=0x7f125402a3b0 comp rx=0 tx=0).stop 2024-09-12T12:33:18.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.462+0000 7f125f59e640 1 --2- 172.21.15.33:0/2355236690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f126010e060 0x7f126010e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:18.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.462+0000 7f125f59e640 1 -- 172.21.15.33:0/2355236690 >> 172.21.15.33:0/2355236690 conn(0x7f1260077980 msgr2=0x7f1260079da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:33:18.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.463+0000 7f125f59e640 1 -- 172.21.15.33:0/2355236690 shutdown_connections 2024-09-12T12:33:18.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.466+0000 7f125f59e640 1 -- 172.21.15.33:0/2355236690 wait complete. 2024-09-12T12:33:18.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.467+0000 7f125f59e640 1 Processor -- start 2024-09-12T12:33:18.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.467+0000 7f125f59e640 1 -- start start 2024-09-12T12:33:18.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.467+0000 7f125f59e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1260108980 0x7f1260082b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:18.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.467+0000 7f125f59e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f126010e060 0x7f126007ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:18.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.467+0000 7f125f59e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f126007b050 0x7f126007b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:18.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.467+0000 7f125f59e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f12601182e0 con 0x7f1260108980 2024-09-12T12:33:18.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.467+0000 7f125f59e640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1260118160 con 0x7f126010e060 2024-09-12T12:33:18.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.467+0000 7f125f59e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1260118460 con 0x7f126007b050 2024-09-12T12:33:18.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.467+0000 7f125ed9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f126007b050 0x7f126007b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:18.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.467+0000 7f125ed9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f126007b050 0x7f126007b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:43800/0 (socket says 172.21.15.33:43800) 2024-09-12T12:33:18.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.467+0000 7f125ed9d640 1 -- 172.21.15.33:0/3133998263 learned_addr learned my addr 172.21.15.33:0/3133998263 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:33:18.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.469+0000 7f125e59c640 1 --2- 172.21.15.33:0/3133998263 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1260108980 0x7f1260082b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:18.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.470+0000 7f125dd9b640 1 --2- 172.21.15.33:0/3133998263 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f126010e060 0x7f126007ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:18.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.471+0000 7f125ed9d640 1 -- 172.21.15.33:0/3133998263 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f126010e060 msgr2=0x7f126007ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:18.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.471+0000 7f125ed9d640 1 --2- 172.21.15.33:0/3133998263 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f126010e060 0x7f126007ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:18.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.471+0000 7f125ed9d640 1 -- 172.21.15.33:0/3133998263 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1260108980 msgr2=0x7f1260082b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:18.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.471+0000 7f125ed9d640 1 --2- 172.21.15.33:0/3133998263 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1260108980 0x7f1260082b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:18.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.471+0000 7f125ed9d640 1 -- 172.21.15.33:0/3133998263 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12601b3980 con 0x7f126007b050 2024-09-12T12:33:18.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.472+0000 7f125ed9d640 1 --2- 172.21.15.33:0/3133998263 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f126007b050 0x7f126007b500 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f125800b9e0 tx=0x7f125800bde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:33:18.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.472+0000 7f124f7fe640 1 -- 172.21.15.33:0/3133998263 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1258019070 con 0x7f126007b050 2024-09-12T12:33:18.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.472+0000 7f125f59e640 1 -- 172.21.15.33:0/3133998263 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12601b3c70 con 0x7f126007b050 2024-09-12T12:33:18.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.472+0000 7f125f59e640 1 -- 172.21.15.33:0/3133998263 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12601b4180 con 0x7f126007b050 2024-09-12T12:33:18.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.473+0000 7f124f7fe640 1 -- 172.21.15.33:0/3133998263 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1258014440 con 0x7f126007b050 2024-09-12T12:33:18.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.473+0000 7f124f7fe640 1 -- 172.21.15.33:0/3133998263 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12580075d0 con 0x7f126007b050 2024-09-12T12:33:18.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.477+0000 7f124f7fe640 1 -- 172.21.15.33:0/3133998263 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f125801c070 con 0x7f126007b050 2024-09-12T12:33:18.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.484+0000 7f125f59e640 1 -- 172.21.15.33:0/3133998263 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1240005290 con 0x7f126007b050 2024-09-12T12:33:18.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.486+0000 7f124f7fe640 1 --2- 172.21.15.33:0/3133998263 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f12480a2cc0 0x7f12480a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:18.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.486+0000 7f124f7fe640 1 -- 172.21.15.33:0/3133998263 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f12580ce740 con 0x7f126007b050 2024-09-12T12:33:18.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.487+0000 7f125e59c640 1 --2- 172.21.15.33:0/3133998263 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f12480a2cc0 0x7f12480a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:18.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.488+0000 7f125e59c640 1 --2- 172.21.15.33:0/3133998263 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f12480a2cc0 0x7f12480a5180 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1250005fd0 tx=0x7f1250009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:33:18.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.492+0000 7f124f7fe640 1 -- 172.21.15.33:0/3133998263 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f125809ac60 con 0x7f126007b050 2024-09-12T12:33:18.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.931+0000 7f125f59e640 1 -- 172.21.15.33:0/3133998263 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1240005580 con 0x7f126007b050 2024-09-12T12:33:18.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.933+0000 7f124f7fe640 1 -- 172.21.15.33:0/3133998263 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11912 (secure 0 0 0) 0x7f125809ef60 con 0x7f126007b050 2024-09-12T12:33:18.934 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:33:18.934 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":27,"btime":"2024-09-12T12:29:38:065241+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3327066342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3327066342},{"type":"v1","addr":"172.21.15.33:6835","nonce":3327066342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/19516401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":19516401},{"type":"v1","addr":"172.21.15.33:6837","nonce":19516401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1260196118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1260196118},{"type":"v1","addr":"172.21.15.33:6839","nonce":1260196118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/4288248356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4288248356},{"type":"v1","addr":"172.21.15.33:6841","nonce":4288248356}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/3051073141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3051073141},{"type":"v1","addr":"172.21.15.43:6833","nonce":3051073141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3282762800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3282762800},{"type":"v1","addr":"172.21.15.43:6835","nonce":3282762800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:23:46.400609+0000","modified":"2024-09-12T12:29:37.555614+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24490,"mds_2":24478},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3051713000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3051713000},{"type":"v1","addr":"172.21.15.102:6833","nonce":3051713000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6837/2472064883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2472064883},{"type":"v1","addr":"172.21.15.43:6837","nonce":2472064883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/1987408860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":1987408860},{"type":"v1","addr":"172.21.15.43:6839","nonce":1987408860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/4179527539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":4179527539},{"type":"v1","addr":"172.21.15.102:6835","nonce":4179527539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/2409953270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2409953270},{"type":"v1","addr":"172.21.15.102:6837","nonce":2409953270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.102:6839/1553271340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":1553271340},{"type":"v1","addr":"172.21.15.102:6839","nonce":1553271340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24499,"qdb_cluster":[24499,24490,24478]},"id":1}]} 2024-09-12T12:33:18.935 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 27 2024-09-12T12:33:18.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.940+0000 7f125f59e640 1 -- 172.21.15.33:0/3133998263 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f12480a2cc0 msgr2=0x7f12480a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:18.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.940+0000 7f125f59e640 1 --2- 172.21.15.33:0/3133998263 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f12480a2cc0 0x7f12480a5180 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1250005fd0 tx=0x7f1250009260 comp rx=0 tx=0).stop 2024-09-12T12:33:18.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.940+0000 7f125f59e640 1 -- 172.21.15.33:0/3133998263 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f126007b050 msgr2=0x7f126007b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:18.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.940+0000 7f125f59e640 1 --2- 172.21.15.33:0/3133998263 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f126007b050 0x7f126007b500 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f125800b9e0 tx=0x7f125800bde0 comp rx=0 tx=0).stop 2024-09-12T12:33:18.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.941+0000 7f125f59e640 1 -- 172.21.15.33:0/3133998263 shutdown_connections 2024-09-12T12:33:18.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.941+0000 7f125f59e640 1 --2- 172.21.15.33:0/3133998263 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f12480a2cc0 0x7f12480a5180 secure :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1250005fd0 tx=0x7f1250009260 comp rx=0 tx=0).stop 2024-09-12T12:33:18.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.941+0000 7f125f59e640 1 --2- 172.21.15.33:0/3133998263 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f126007b050 0x7f126007b500 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:18.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.941+0000 7f125f59e640 1 --2- 172.21.15.33:0/3133998263 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f126010e060 0x7f126007ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:18.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.941+0000 7f125f59e640 1 --2- 172.21.15.33:0/3133998263 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1260108980 0x7f1260082b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:18.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.941+0000 7f125f59e640 1 -- 172.21.15.33:0/3133998263 >> 172.21.15.33:0/3133998263 conn(0x7f1260077980 msgr2=0x7f12600794c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:33:18.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.944+0000 7f125f59e640 1 -- 172.21.15.33:0/3133998263 shutdown_connections 2024-09-12T12:33:18.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:18.945+0000 7f125f59e640 1 -- 172.21.15.33:0/3133998263 wait complete. 2024-09-12T12:33:19.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:19 smithi043 ceph-mon[34144]: pgmap v569: 129 pgs: 129 active+clean; 10 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 35 MiB/s wr, 658 op/s 2024-09-12T12:33:19.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:19 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/3133998263' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:33:19.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:19 smithi102 ceph-mon[34799]: pgmap v569: 129 pgs: 129 active+clean; 10 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 35 MiB/s wr, 658 op/s 2024-09-12T12:33:19.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:19 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/3133998263' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:33:19.681 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:19 smithi033 ceph-mon[31246]: pgmap v569: 129 pgs: 129 active+clean; 10 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 35 MiB/s wr, 658 op/s 2024-09-12T12:33:19.681 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:19 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/3133998263' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:33:19.767 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T12:33:20.512 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:33:21.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.207+0000 7f0d46c58640 1 -- 172.21.15.33:0/1266596238 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d4010e090 msgr2=0x7f0d4010e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:21.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.207+0000 7f0d46c58640 1 --2- 172.21.15.33:0/1266596238 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d4010e090 0x7f0d4010e470 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c009d50 tx=0x7f0d3c02a890 comp rx=0 tx=0).stop 2024-09-12T12:33:21.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.207+0000 7f0d46c58640 1 -- 172.21.15.33:0/1266596238 shutdown_connections 2024-09-12T12:33:21.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.207+0000 7f0d46c58640 1 --2- 172.21.15.33:0/1266596238 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d4006ee70 0x7f0d4007a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:21.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.207+0000 7f0d46c58640 1 --2- 172.21.15.33:0/1266596238 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d4006e4f0 0x7f0d4006e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:21.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.207+0000 7f0d46c58640 1 --2- 172.21.15.33:0/1266596238 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d4010e090 0x7f0d4010e470 secure :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c009d50 tx=0x7f0d3c02a890 comp rx=0 tx=0).stop 2024-09-12T12:33:21.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.207+0000 7f0d46c58640 1 -- 172.21.15.33:0/1266596238 >> 172.21.15.33:0/1266596238 conn(0x7f0d40073180 msgr2=0x7f0d40073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:33:21.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.209+0000 7f0d46c58640 1 -- 172.21.15.33:0/1266596238 shutdown_connections 2024-09-12T12:33:21.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.209+0000 7f0d46c58640 1 -- 172.21.15.33:0/1266596238 wait complete. 2024-09-12T12:33:21.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.210+0000 7f0d46c58640 1 Processor -- start 2024-09-12T12:33:21.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.210+0000 7f0d46c58640 1 -- start start 2024-09-12T12:33:21.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.211+0000 7f0d46c58640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d4006e4f0 0x7f0d4007f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:21.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.211+0000 7f0d46c58640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d4006ee70 0x7f0d4007f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:21.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.211+0000 7f0d46c58640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d4007fad0 0x7f0d40136e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:21.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.211+0000 7f0d46c58640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0d4007d8b0 con 0x7f0d4006ee70 2024-09-12T12:33:21.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.211+0000 7f0d46c58640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0d4007d730 con 0x7f0d4007fad0 2024-09-12T12:33:21.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.211+0000 7f0d46c58640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0d4007da30 con 0x7f0d4006e4f0 2024-09-12T12:33:21.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.213+0000 7f0d46457640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d4007fad0 0x7f0d40136e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:21.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.215+0000 7f0d46457640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d4007fad0 0x7f0d40136e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:37800/0 (socket says 172.21.15.33:37800) 2024-09-12T12:33:21.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.215+0000 7f0d46457640 1 -- 172.21.15.33:0/4137197005 learned_addr learned my addr 172.21.15.33:0/4137197005 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:33:21.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.220+0000 7f0d45c56640 1 --2- 172.21.15.33:0/4137197005 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d4006e4f0 0x7f0d4007f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:21.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.220+0000 7f0d45455640 1 --2- 172.21.15.33:0/4137197005 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d4006ee70 0x7f0d4007f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:21.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.220+0000 7f0d45c56640 1 -- 172.21.15.33:0/4137197005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d4007fad0 msgr2=0x7f0d40136e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:21.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.220+0000 7f0d45c56640 1 --2- 172.21.15.33:0/4137197005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d4007fad0 0x7f0d40136e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:21.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.220+0000 7f0d45c56640 1 -- 172.21.15.33:0/4137197005 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d4006ee70 msgr2=0x7f0d4007f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:21.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.220+0000 7f0d45c56640 1 --2- 172.21.15.33:0/4137197005 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d4006ee70 0x7f0d4007f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:21.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.220+0000 7f0d45c56640 1 -- 172.21.15.33:0/4137197005 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d401373b0 con 0x7f0d4006e4f0 2024-09-12T12:33:21.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.224+0000 7f0d45c56640 1 --2- 172.21.15.33:0/4137197005 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d4006e4f0 0x7f0d4007f050 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c008000 tx=0x7f0d3c004a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:33:21.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.228+0000 7f0d36ffd640 1 -- 172.21.15.33:0/4137197005 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c035040 con 0x7f0d4006e4f0 2024-09-12T12:33:21.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.228+0000 7f0d36ffd640 1 -- 172.21.15.33:0/4137197005 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0d3c042070 con 0x7f0d4006e4f0 2024-09-12T12:33:21.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.228+0000 7f0d36ffd640 1 -- 172.21.15.33:0/4137197005 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c031420 con 0x7f0d4006e4f0 2024-09-12T12:33:21.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.231+0000 7f0d46c58640 1 -- 172.21.15.33:0/4137197005 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d40137640 con 0x7f0d4006e4f0 2024-09-12T12:33:21.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.231+0000 7f0d46c58640 1 -- 172.21.15.33:0/4137197005 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d40137a40 con 0x7f0d4006e4f0 2024-09-12T12:33:21.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.235+0000 7f0d4a293740 1 Processor -- start 2024-09-12T12:33:21.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.237+0000 7f0d36ffd640 1 -- 172.21.15.33:0/4137197005 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0d3c004ba0 con 0x7f0d4006e4f0 2024-09-12T12:33:21.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.238+0000 7f0d36ffd640 1 --2- 172.21.15.33:0/4137197005 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0d2c0a2d90 0x7f0d2c0a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:21.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.238+0000 7f0d36ffd640 1 -- 172.21.15.33:0/4137197005 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f0d3c0ef240 con 0x7f0d4006e4f0 2024-09-12T12:33:21.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.241+0000 7f0d4a293740 1 -- start start 2024-09-12T12:33:21.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.242+0000 7f0d4a293740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556c94e29cf0 0x556c94e28240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:21.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.242+0000 7f0d4a293740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556c94e28780 0x556c94e28bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:21.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.242+0000 7f0d4a293740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556c94e33520 0x556c94e35910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:21.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.242+0000 7f0d4a293740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x556c94d8e2f0 con 0x556c94e33520 2024-09-12T12:33:21.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.242+0000 7f0d4a293740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556c94d35cf0 con 0x556c94e29cf0 2024-09-12T12:33:21.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.242+0000 7f0d4a293740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556c94d8a2b0 con 0x556c94e28780 2024-09-12T12:33:21.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.242+0000 7f0d45455640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556c94e28780 0x556c94e28bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:21.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.242+0000 7f0d45c56640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556c94e29cf0 0x556c94e28240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:21.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.242+0000 7f0d45c56640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556c94e29cf0 0x556c94e28240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:37808/0 (socket says 172.21.15.33:37808) 2024-09-12T12:33:21.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.242+0000 7f0d45c56640 1 -- 172.21.15.33:0/2704711751 learned_addr learned my addr 172.21.15.33:0/2704711751 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:33:21.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.245+0000 7f0d45c56640 1 -- 172.21.15.33:0/2704711751 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556c94e28780 msgr2=0x556c94e28bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:21.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.245+0000 7f0d45c56640 1 --2- 172.21.15.33:0/2704711751 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556c94e28780 0x556c94e28bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:21.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.245+0000 7f0d45c56640 1 -- 172.21.15.33:0/2704711751 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556c94e33520 msgr2=0x556c94e35910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T12:33:21.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.245+0000 7f0d45c56640 1 --2- 172.21.15.33:0/2704711751 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556c94e33520 0x556c94e35910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:21.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.245+0000 7f0d45c56640 1 -- 172.21.15.33:0/2704711751 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c94d1a3a0 con 0x556c94e29cf0 2024-09-12T12:33:21.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.246+0000 7f0d45c56640 1 --2- 172.21.15.33:0/2704711751 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556c94e29cf0 0x556c94e28240 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c001eb0 tx=0x7f0d3c0bb5e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43f0265f070f00bf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:33:21.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.246+0000 7f0d46457640 1 --2- 172.21.15.33:0/4137197005 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0d2c0a2d90 0x7f0d2c0a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:21.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.248+0000 7f0d2bfff640 1 -- 172.21.15.33:0/2704711751 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c0bb740 con 0x556c94e29cf0 2024-09-12T12:33:21.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.248+0000 7f0d2bfff640 1 -- 172.21.15.33:0/2704711751 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0d3c0bfaf0 con 0x556c94e29cf0 2024-09-12T12:33:21.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.249+0000 7f0d4a293740 1 -- 172.21.15.33:0/2704711751 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556c94e29cf0 msgr2=0x556c94e28240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:21.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.249+0000 7f0d4a293740 1 --2- 172.21.15.33:0/2704711751 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556c94e29cf0 0x556c94e28240 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c001eb0 tx=0x7f0d3c0bb5e0 comp rx=0 tx=0).stop 2024-09-12T12:33:21.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.249+0000 7f0d46457640 1 --2- 172.21.15.33:0/4137197005 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0d2c0a2d90 0x7f0d2c0a5250 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x556c94e29220 tx=0x7f0d38009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:33:21.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.255+0000 7f0d4a293740 1 -- 172.21.15.33:0/2704711751 shutdown_connections 2024-09-12T12:33:21.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.255+0000 7f0d4a293740 1 --2- 172.21.15.33:0/2704711751 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556c94e33520 0x556c94e35910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:21.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.255+0000 7f0d4a293740 1 --2- 172.21.15.33:0/2704711751 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556c94e28780 0x556c94e28bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:21.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.255+0000 7f0d4a293740 1 --2- 172.21.15.33:0/2704711751 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556c94e29cf0 0x556c94e28240 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:21.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.255+0000 7f0d4a293740 1 -- 172.21.15.33:0/2704711751 >> 172.21.15.33:0/2704711751 conn(0x556c94df1310 msgr2=0x556c94e24e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:33:21.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.256+0000 7f0d4a293740 1 -- 172.21.15.33:0/2704711751 shutdown_connections 2024-09-12T12:33:21.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.258+0000 7f0d4a293740 1 -- 172.21.15.33:0/2704711751 wait complete. 2024-09-12T12:33:21.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.259+0000 7f0d4a293740 1 -- start start 2024-09-12T12:33:21.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.259+0000 7f0d4a293740 1 Processor -- start 2024-09-12T12:33:21.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.261+0000 7f0d4a293740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556c94e28780 0x556c94e32e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:21.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.261+0000 7f0d4a293740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556c94e29cf0 0x556c94e30150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:21.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.261+0000 7f0d4a293740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556c94e33520 0x556c94e306d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:21.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.261+0000 7f0d4a293740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x556c94e35fe0 con 0x556c94e33520 2024-09-12T12:33:21.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.261+0000 7f0d4a293740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556c94d49060 con 0x556c94e29cf0 2024-09-12T12:33:21.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.261+0000 7f0d4a293740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556c94e36160 con 0x556c94e28780 2024-09-12T12:33:21.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.261+0000 7f0d4a293740 10 client.0 _ll_register_callbacks cb 0x556c94a9c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:33:21.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.262+0000 7f0d45c56640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556c94e28780 0x556c94e32e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:21.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.262+0000 7f0d45c56640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556c94e28780 0x556c94e32e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:40586/0 (socket says 172.21.15.33:40586) 2024-09-12T12:33:21.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.262+0000 7f0d45c56640 1 -- 172.21.15.33:0/1653154891 learned_addr learned my addr 172.21.15.33:0/1653154891 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:33:21.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.262+0000 7f0d46457640 1 --2- 172.21.15.33:0/1653154891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556c94e33520 0x556c94e306d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:21.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.262+0000 7f0d45455640 1 --2- 172.21.15.33:0/1653154891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556c94e29cf0 0x556c94e30150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:21.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.264+0000 7f0d45c56640 1 -- 172.21.15.33:0/1653154891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556c94e29cf0 msgr2=0x556c94e30150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:21.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.264+0000 7f0d45c56640 1 --2- 172.21.15.33:0/1653154891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556c94e29cf0 0x556c94e30150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:21.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.264+0000 7f0d45c56640 1 -- 172.21.15.33:0/1653154891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556c94e33520 msgr2=0x556c94e306d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:21.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.264+0000 7f0d45c56640 1 --2- 172.21.15.33:0/1653154891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556c94e33520 0x556c94e306d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:21.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.264+0000 7f0d45c56640 1 -- 172.21.15.33:0/1653154891 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c94aff3c0 con 0x556c94e28780 2024-09-12T12:33:21.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.264+0000 7f0d45c56640 1 --2- 172.21.15.33:0/1653154891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556c94e28780 0x556c94e32e50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c02ae50 tx=0x7f0d3c0cfde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e572c1870c37c384 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:33:21.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.264+0000 7f0d297fa640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:33:21.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.264+0000 7f0d297fa640 1 -- 172.21.15.33:0/1653154891 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c0d3070 con 0x556c94e28780 2024-09-12T12:33:21.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.264+0000 7f0d297fa640 1 -- 172.21.15.33:0/1653154891 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f0d3c0bada0 con 0x556c94e28780 2024-09-12T12:33:21.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.264+0000 7f0d4a293740 1 -- 172.21.15.33:0/1653154891 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d3c0bfaf0 con 0x556c94e28780 2024-09-12T12:33:21.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.265+0000 7f0d297fa640 1 -- 172.21.15.33:0/1653154891 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0d3c0c4320 con 0x556c94e28780 2024-09-12T12:33:21.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.267+0000 7f0d4a293740 10 client.25738 fetch_fsmap learned FSMap version 27 2024-09-12T12:33:21.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.267+0000 7f0d4a293740 1 -- 172.21.15.33:0/1653154891 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556c94e35fe0 con 0x556c94e28780 2024-09-12T12:33:21.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.267+0000 7f0d297fa640 1 -- 172.21.15.33:0/1653154891 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0d3c0bfaf0 con 0x556c94e28780 2024-09-12T12:33:21.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.268+0000 7f0d297fa640 1 -- 172.21.15.33:0/1653154891 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f0d3c0db030 con 0x556c94e28780 2024-09-12T12:33:21.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.268+0000 7f0d4a293740 10 client.25738 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:33:21.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.268+0000 7f0d4a293740 10 client.25738 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-12T12:33:21.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.268+0000 7f0d4a293740 20 client.25738 populate_metadata read hostname 'smithi033' 2024-09-12T12:33:21.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.268+0000 7f0d4a293740 1 --2- 172.21.15.33:0/1653154891 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x556c94e42cc0 0x556c94e450d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:21.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.268+0000 7f0d4a293740 4 client.25738 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:33:21.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.268+0000 7f0d4a293740 1 -- 172.21.15.33:0/1653154891 --> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556c94d9b860 con 0x556c94e42cc0 2024-09-12T12:33:21.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.273+0000 7f0d45455640 1 --2- 172.21.15.33:0/1653154891 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x556c94e42cc0 0x556c94e450d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:21.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.274+0000 7f0d45455640 1 --2- 172.21.15.33:0/1653154891 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x556c94e42cc0 0x556c94e450d0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=10f56a2afc45047a server_cookie=351cd1ab99a017da in_seq=0 out_seq=0 2024-09-12T12:33:21.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.274+0000 7f0d297fa640 10 client.25738 ms_handle_connect on v2:172.21.15.102:6834/4179527539 2024-09-12T12:33:21.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.275+0000 7f0d297fa640 1 -- 172.21.15.33:0/1653154891 <== mds.2 v2:172.21.15.102:6834/4179527539 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556c94d9b860 con 0x556c94e42cc0 2024-09-12T12:33:21.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.275+0000 7f0d297fa640 10 client.25738 handle_command_reply: tid=0 2024-09-12T12:33:21.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.275+0000 7f0d4a293740 1 client.25738 shutdown 2024-09-12T12:33:21.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.276+0000 7f0d4a293740 1 -- 172.21.15.33:0/1653154891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556c94e28780 msgr2=0x556c94e32e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:21.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.276+0000 7f0d4a293740 1 --2- 172.21.15.33:0/1653154891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556c94e28780 0x556c94e32e50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c02ae50 tx=0x7f0d3c0cfde0 comp rx=0 tx=0).stop 2024-09-12T12:33:21.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.277+0000 7f0d4a293740 1 -- 172.21.15.33:0/1653154891 shutdown_connections 2024-09-12T12:33:21.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.277+0000 7f0d4a293740 1 --2- 172.21.15.33:0/1653154891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556c94e33520 0x556c94e306d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:21.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.277+0000 7f0d4a293740 1 --2- 172.21.15.33:0/1653154891 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x556c94e42cc0 0x556c94e450d0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:21.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.277+0000 7f0d4a293740 1 --2- 172.21.15.33:0/1653154891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556c94e29cf0 0x556c94e30150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:21.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.277+0000 7f0d4a293740 1 --2- 172.21.15.33:0/1653154891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556c94e28780 0x556c94e32e50 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:21.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.277+0000 7f0d4a293740 1 -- 172.21.15.33:0/1653154891 >> 172.21.15.33:0/1653154891 conn(0x556c94df1310 msgr2=0x556c94e2ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:33:21.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.277+0000 7f0d297fa640 0 client.25738 ms_handle_reset on v2:172.21.15.102:6834/4179527539 2024-09-12T12:33:21.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.277+0000 7f0d4a293740 1 -- 172.21.15.33:0/1653154891 shutdown_connections 2024-09-12T12:33:21.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.278+0000 7f0d4a293740 1 -- 172.21.15.33:0/1653154891 wait complete. 2024-09-12T12:33:21.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.278+0000 7f0d4a293740 20 client.25738 trim_cache size 0 max 16384 2024-09-12T12:33:21.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.305+0000 7f0d4a293740 1 Processor -- start 2024-09-12T12:33:21.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.309+0000 7f0d4a293740 1 -- start start 2024-09-12T12:33:21.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.309+0000 7f0d4a293740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556c94e28780 0x556c94e3f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:21.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.309+0000 7f0d4a293740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556c94e29cf0 0x556c94e2f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:21.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.309+0000 7f0d4a293740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556c94e33520 0x556c94e2b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:21.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.310+0000 7f0d4a293740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0d401d9ef0 con 0x556c94e29cf0 2024-09-12T12:33:21.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.310+0000 7f0d4a293740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0d401d77c0 con 0x556c94e28780 2024-09-12T12:33:21.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.310+0000 7f0d4a293740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0d401d5610 con 0x556c94e33520 2024-09-12T12:33:21.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.310+0000 7f0d45455640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556c94e29cf0 0x556c94e2f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:21.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.310+0000 7f0d45455640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556c94e29cf0 0x556c94e2f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43248/0 (socket says 172.21.15.33:43248) 2024-09-12T12:33:21.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.310+0000 7f0d45455640 1 -- 172.21.15.33:0/1542473520 learned_addr learned my addr 172.21.15.33:0/1542473520 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:33:21.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.311+0000 7f0d45455640 1 -- 172.21.15.33:0/1542473520 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556c94e33520 msgr2=0x556c94e2b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:21.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.311+0000 7f0d45455640 1 --2- 172.21.15.33:0/1542473520 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556c94e33520 0x556c94e2b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:21.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.311+0000 7f0d45455640 1 -- 172.21.15.33:0/1542473520 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556c94e28780 msgr2=0x556c94e3f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:21.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.311+0000 7f0d45455640 1 --2- 172.21.15.33:0/1542473520 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556c94e28780 0x556c94e3f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:21.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.311+0000 7f0d45455640 1 -- 172.21.15.33:0/1542473520 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c94e2f670 con 0x556c94e29cf0 2024-09-12T12:33:21.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.312+0000 7f0d45455640 1 --2- 172.21.15.33:0/1542473520 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556c94e29cf0 0x556c94e2f130 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f0d400808a0 tx=0x7f0d30009110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a79a6086725942 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:33:21.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.312+0000 7f0d2b7fe640 1 -- 172.21.15.33:0/1542473520 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d300158a0 con 0x556c94e29cf0 2024-09-12T12:33:21.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.313+0000 7f0d2b7fe640 1 -- 172.21.15.33:0/1542473520 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0d3001e440 con 0x556c94e29cf0 2024-09-12T12:33:21.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.314+0000 7f0d4a293740 1 -- 172.21.15.33:0/1542473520 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556c94e29cf0 msgr2=0x556c94e2f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:21.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.315+0000 7f0d4a293740 1 --2- 172.21.15.33:0/1542473520 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556c94e29cf0 0x556c94e2f130 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f0d400808a0 tx=0x7f0d30009110 comp rx=0 tx=0).stop 2024-09-12T12:33:21.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.315+0000 7f0d4a293740 1 -- 172.21.15.33:0/1542473520 shutdown_connections 2024-09-12T12:33:21.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.315+0000 7f0d4a293740 1 --2- 172.21.15.33:0/1542473520 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556c94e33520 0x556c94e2b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:21.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.315+0000 7f0d4a293740 1 --2- 172.21.15.33:0/1542473520 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556c94e29cf0 0x556c94e2f130 secure :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f0d400808a0 tx=0x7f0d30009110 comp rx=0 tx=0).stop 2024-09-12T12:33:21.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.315+0000 7f0d4a293740 1 --2- 172.21.15.33:0/1542473520 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556c94e28780 0x556c94e3f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:21.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.315+0000 7f0d4a293740 1 -- 172.21.15.33:0/1542473520 >> 172.21.15.33:0/1542473520 conn(0x556c94df1310 msgr2=0x556c94e2ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:33:21.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.318+0000 7f0d4a293740 1 -- 172.21.15.33:0/1542473520 shutdown_connections 2024-09-12T12:33:21.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.318+0000 7f0d4a293740 1 -- 172.21.15.33:0/1542473520 wait complete. 2024-09-12T12:33:21.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.318+0000 7f0d4a293740 1 -- start start 2024-09-12T12:33:21.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.318+0000 7f0d4a293740 1 Processor -- start 2024-09-12T12:33:21.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.319+0000 7f0d4a293740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556c94e28780 0x556c94e36710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:21.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.319+0000 7f0d4a293740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556c94e33520 0x556c94e36c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:21.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.319+0000 7f0d4a293740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556c94ea9990 0x556c94eabd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:21.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.319+0000 7f0d4a293740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0d401d5c80 con 0x556c94e28780 2024-09-12T12:33:21.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.319+0000 7f0d4a293740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0d401d70f0 con 0x556c94ea9990 2024-09-12T12:33:21.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.319+0000 7f0d4a293740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0d401d6350 con 0x556c94e33520 2024-09-12T12:33:21.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.319+0000 7f0d4a293740 10 client.0 _ll_register_callbacks cb 0x7f0d300093c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:33:21.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.320+0000 7f0d45455640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556c94e33520 0x556c94e36c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:21.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.320+0000 7f0d45455640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556c94e33520 0x556c94e36c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:40606/0 (socket says 172.21.15.33:40606) 2024-09-12T12:33:21.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.320+0000 7f0d45455640 1 -- 172.21.15.33:0/3271208365 learned_addr learned my addr 172.21.15.33:0/3271208365 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:33:21.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.322+0000 7f0d46457640 1 --2- 172.21.15.33:0/3271208365 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556c94ea9990 0x556c94eabd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:21.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.322+0000 7f0d45c56640 1 --2- 172.21.15.33:0/3271208365 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556c94e28780 0x556c94e36710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:21.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.322+0000 7f0d45455640 1 -- 172.21.15.33:0/3271208365 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556c94ea9990 msgr2=0x556c94eabd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:21.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.322+0000 7f0d45455640 1 --2- 172.21.15.33:0/3271208365 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556c94ea9990 0x556c94eabd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:21.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.322+0000 7f0d45455640 1 -- 172.21.15.33:0/3271208365 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556c94e28780 msgr2=0x556c94e36710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:21.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.322+0000 7f0d45455640 1 --2- 172.21.15.33:0/3271208365 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556c94e28780 0x556c94e36710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:21.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.322+0000 7f0d45455640 1 -- 172.21.15.33:0/3271208365 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c94eac2c0 con 0x556c94e33520 2024-09-12T12:33:21.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.322+0000 7f0d46457640 1 --2- 172.21.15.33:0/3271208365 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556c94ea9990 0x556c94eabd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:33:21.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.322+0000 7f0d45455640 1 --2- 172.21.15.33:0/3271208365 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556c94e33520 0x556c94e36c50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0d30021000 tx=0x7f0d30015ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e30f08145382a8e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:33:21.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.323+0000 7f0d297fa640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:33:21.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.323+0000 7f0d297fa640 1 -- 172.21.15.33:0/3271208365 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3001da60 con 0x556c94e33520 2024-09-12T12:33:21.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.324+0000 7f0d297fa640 1 -- 172.21.15.33:0/3271208365 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f0d3001dc00 con 0x556c94e33520 2024-09-12T12:33:21.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.324+0000 7f0d4a293740 1 -- 172.21.15.33:0/3271208365 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556c94d95d70 con 0x556c94e33520 2024-09-12T12:33:21.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.325+0000 7f0d297fa640 1 -- 172.21.15.33:0/3271208365 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0d30032450 con 0x556c94e33520 2024-09-12T12:33:21.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.327+0000 7f0d4a293740 10 client.25741 fetch_fsmap learned FSMap version 27 2024-09-12T12:33:21.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.327+0000 7f0d4a293740 1 -- 172.21.15.33:0/3271208365 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556c94ead620 con 0x556c94e33520 2024-09-12T12:33:21.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.329+0000 7f0d297fa640 1 -- 172.21.15.33:0/3271208365 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x556c94d95d70 con 0x556c94e33520 2024-09-12T12:33:21.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.329+0000 7f0d297fa640 1 -- 172.21.15.33:0/3271208365 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f0d3001e440 con 0x556c94e33520 2024-09-12T12:33:21.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.330+0000 7f0d4a293740 10 client.25741 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:33:21.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.330+0000 7f0d4a293740 10 client.25741 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-12T12:33:21.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.330+0000 7f0d4a293740 20 client.25741 populate_metadata read hostname 'smithi033' 2024-09-12T12:33:21.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.330+0000 7f0d4a293740 1 --2- 172.21.15.33:0/3271208365 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x556c94eadcc0 0x556c94eb00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:21.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.330+0000 7f0d4a293740 4 client.25741 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:33:21.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.330+0000 7f0d4a293740 1 -- 172.21.15.33:0/3271208365 --> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556c94d12170 con 0x556c94eadcc0 2024-09-12T12:33:21.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.332+0000 7f0d45c56640 1 --2- 172.21.15.33:0/3271208365 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x556c94eadcc0 0x556c94eb00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:21.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.333+0000 7f0d45c56640 1 --2- 172.21.15.33:0/3271208365 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x556c94eadcc0 0x556c94eb00e0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d11f47247475a50c server_cookie=9cbef56206c680a7 in_seq=0 out_seq=0 2024-09-12T12:33:21.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.333+0000 7f0d297fa640 10 client.25741 ms_handle_connect on v2:172.21.15.102:6834/4179527539 2024-09-12T12:33:21.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.334+0000 7f0d297fa640 1 -- 172.21.15.33:0/3271208365 <== mds.2 v2:172.21.15.102:6834/4179527539 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556c94d12170 con 0x556c94eadcc0 2024-09-12T12:33:21.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.334+0000 7f0d297fa640 10 client.25741 handle_command_reply: tid=0 2024-09-12T12:33:21.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.334+0000 7f0d4a293740 1 client.25741 shutdown 2024-09-12T12:33:21.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.337+0000 7f0d4a293740 1 -- 172.21.15.33:0/3271208365 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556c94e33520 msgr2=0x556c94e36c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:21.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.337+0000 7f0d4a293740 1 --2- 172.21.15.33:0/3271208365 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556c94e33520 0x556c94e36c50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0d30021000 tx=0x7f0d30015ad0 comp rx=0 tx=0).stop 2024-09-12T12:33:21.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.337+0000 7f0d4a293740 1 -- 172.21.15.33:0/3271208365 shutdown_connections 2024-09-12T12:33:21.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.337+0000 7f0d4a293740 1 --2- 172.21.15.33:0/3271208365 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x556c94eadcc0 0x556c94eb00e0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:21.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.337+0000 7f0d4a293740 1 --2- 172.21.15.33:0/3271208365 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556c94ea9990 0x556c94eabd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:21.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.337+0000 7f0d4a293740 1 --2- 172.21.15.33:0/3271208365 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556c94e33520 0x556c94e36c50 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:21.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.337+0000 7f0d4a293740 1 --2- 172.21.15.33:0/3271208365 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556c94e28780 0x556c94e36710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:21.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.337+0000 7f0d297fa640 0 client.25741 ms_handle_reset on v2:172.21.15.102:6834/4179527539 2024-09-12T12:33:21.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.337+0000 7f0d4a293740 1 -- 172.21.15.33:0/3271208365 >> 172.21.15.33:0/3271208365 conn(0x556c94df1310 msgr2=0x556c94e23690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:33:21.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.337+0000 7f0d4a293740 1 -- 172.21.15.33:0/3271208365 shutdown_connections 2024-09-12T12:33:21.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.337+0000 7f0d4a293740 1 -- 172.21.15.33:0/3271208365 wait complete. 2024-09-12T12:33:21.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.338+0000 7f0d4a293740 20 client.25741 trim_cache size 0 max 16384 2024-09-12T12:33:21.341 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-09-12T12:33:21.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.341+0000 7f0d46c58640 1 -- 172.21.15.33:0/4137197005 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0d2c0a2d90 msgr2=0x7f0d2c0a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:21.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.341+0000 7f0d46c58640 1 --2- 172.21.15.33:0/4137197005 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0d2c0a2d90 0x7f0d2c0a5250 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x556c94e29220 tx=0x7f0d38009500 comp rx=0 tx=0).stop 2024-09-12T12:33:21.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.341+0000 7f0d46c58640 1 -- 172.21.15.33:0/4137197005 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d4006e4f0 msgr2=0x7f0d4007f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:21.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.341+0000 7f0d46c58640 1 --2- 172.21.15.33:0/4137197005 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d4006e4f0 0x7f0d4007f050 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c008000 tx=0x7f0d3c004a30 comp rx=0 tx=0).stop 2024-09-12T12:33:21.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.341+0000 7f0d46c58640 1 -- 172.21.15.33:0/4137197005 shutdown_connections 2024-09-12T12:33:21.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.341+0000 7f0d46c58640 1 --2- 172.21.15.33:0/4137197005 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0d2c0a2d90 0x7f0d2c0a5250 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:21.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.341+0000 7f0d46c58640 1 --2- 172.21.15.33:0/4137197005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d4007fad0 0x7f0d40136e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:21.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.341+0000 7f0d46c58640 1 --2- 172.21.15.33:0/4137197005 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d4006ee70 0x7f0d4007f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:21.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.341+0000 7f0d46c58640 1 --2- 172.21.15.33:0/4137197005 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d4006e4f0 0x7f0d4007f050 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:21.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.341+0000 7f0d46c58640 1 -- 172.21.15.33:0/4137197005 >> 172.21.15.33:0/4137197005 conn(0x7f0d40073180 msgr2=0x7f0d4006d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:33:21.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.341+0000 7f0d46c58640 1 -- 172.21.15.33:0/4137197005 shutdown_connections 2024-09-12T12:33:21.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:21.341+0000 7f0d46c58640 1 -- 172.21.15.33:0/4137197005 wait complete. 2024-09-12T12:33:21.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:21 smithi043 ceph-mon[34144]: pgmap v570: 129 pgs: 129 active+clean; 10 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 28 MiB/s wr, 533 op/s 2024-09-12T12:33:21.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:21 smithi102 ceph-mon[34799]: pgmap v570: 129 pgs: 129 active+clean; 10 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 28 MiB/s wr, 533 op/s 2024-09-12T12:33:21.721 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:21 smithi033 ceph-mon[31246]: pgmap v570: 129 pgs: 129 active+clean; 10 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 28 MiB/s wr, 533 op/s 2024-09-12T12:33:22.072 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T12:33:22.766 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:33:23.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.448+0000 7ff8cc948640 1 -- 172.21.15.33:0/2051784207 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff8c811b140 msgr2=0x7ff8c811d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:23.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.448+0000 7ff8cc948640 1 --2- 172.21.15.33:0/2051784207 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff8c811b140 0x7ff8c811d530 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8009900 tx=0x7ff8b802a410 comp rx=0 tx=0).stop 2024-09-12T12:33:23.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.449+0000 7ff8cc948640 1 -- 172.21.15.33:0/2051784207 shutdown_connections 2024-09-12T12:33:23.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.449+0000 7ff8cc948640 1 --2- 172.21.15.33:0/2051784207 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff8c811b140 0x7ff8c811d530 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:23.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.450+0000 7ff8cc948640 1 --2- 172.21.15.33:0/2051784207 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8c8109830 0x7ff8c8109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:23.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.450+0000 7ff8cc948640 1 --2- 172.21.15.33:0/2051784207 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8c8109450 0x7ff8c8110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:23.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.450+0000 7ff8cc948640 1 -- 172.21.15.33:0/2051784207 >> 172.21.15.33:0/2051784207 conn(0x7ff8c806e140 msgr2=0x7ff8c806e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:33:23.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.456+0000 7ff8cc948640 1 -- 172.21.15.33:0/2051784207 shutdown_connections 2024-09-12T12:33:23.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.456+0000 7ff8cc948640 1 -- 172.21.15.33:0/2051784207 wait complete. 2024-09-12T12:33:23.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.457+0000 7ff8cc948640 1 Processor -- start 2024-09-12T12:33:23.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.457+0000 7ff8cc948640 1 -- start start 2024-09-12T12:33:23.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.458+0000 7ff8cc948640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8c8109450 0x7ff8c81a71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:23.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.458+0000 7ff8cc948640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff8c8109830 0x7ff8c81a76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:23.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.458+0000 7ff8cc948640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8c811b140 0x7ff8c81aba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:23.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.458+0000 7ff8cc948640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c8120c90 con 0x7ff8c8109450 2024-09-12T12:33:23.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.459+0000 7ff8cc948640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c8120b10 con 0x7ff8c8109830 2024-09-12T12:33:23.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.459+0000 7ff8cc948640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c8120e10 con 0x7ff8c811b140 2024-09-12T12:33:23.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.459+0000 7ff8c6d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8c811b140 0x7ff8c81aba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:23.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.459+0000 7ff8c6d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8c811b140 0x7ff8c81aba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:40620/0 (socket says 172.21.15.33:40620) 2024-09-12T12:33:23.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.459+0000 7ff8c6d9d640 1 -- 172.21.15.33:0/582577564 learned_addr learned my addr 172.21.15.33:0/582577564 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:33:23.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.465+0000 7ff8c5d9b640 1 --2- 172.21.15.33:0/582577564 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff8c8109830 0x7ff8c81a76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:23.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.465+0000 7ff8c659c640 1 --2- 172.21.15.33:0/582577564 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8c8109450 0x7ff8c81a71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:23.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.468+0000 7ff8c6d9d640 1 -- 172.21.15.33:0/582577564 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff8c8109830 msgr2=0x7ff8c81a76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:23.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.468+0000 7ff8c6d9d640 1 --2- 172.21.15.33:0/582577564 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff8c8109830 0x7ff8c81a76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:23.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.469+0000 7ff8c6d9d640 1 -- 172.21.15.33:0/582577564 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8c8109450 msgr2=0x7ff8c81a71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:23.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.469+0000 7ff8c6d9d640 1 --2- 172.21.15.33:0/582577564 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8c8109450 0x7ff8c81a71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:23.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.469+0000 7ff8c6d9d640 1 -- 172.21.15.33:0/582577564 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8c81ac160 con 0x7ff8c811b140 2024-09-12T12:33:23.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.472+0000 7ff8c6d9d640 1 --2- 172.21.15.33:0/582577564 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8c811b140 0x7ff8c81aba80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff8b802a980 tx=0x7ff8b8004950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:33:23.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.473+0000 7ff8b77fe640 1 -- 172.21.15.33:0/582577564 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b803f070 con 0x7ff8c811b140 2024-09-12T12:33:23.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.473+0000 7ff8b77fe640 1 -- 172.21.15.33:0/582577564 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff8b8004ed0 con 0x7ff8c811b140 2024-09-12T12:33:23.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.473+0000 7ff8b77fe640 1 -- 172.21.15.33:0/582577564 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b8035030 con 0x7ff8c811b140 2024-09-12T12:33:23.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.474+0000 7ff8cc948640 1 -- 172.21.15.33:0/582577564 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8c81ac3f0 con 0x7ff8c811b140 2024-09-12T12:33:23.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.474+0000 7ff8cc948640 1 -- 172.21.15.33:0/582577564 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8c81ac880 con 0x7ff8c811b140 2024-09-12T12:33:23.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.481+0000 7ff8ced21740 1 Processor -- start 2024-09-12T12:33:23.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.483+0000 7ff8ced21740 1 -- start start 2024-09-12T12:33:23.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.483+0000 7ff8ced21740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586c2dc6b40 0x5586c2dc5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:23.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.483+0000 7ff8ced21740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586c2dc55d0 0x5586c2dc5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:23.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.483+0000 7ff8ced21740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586c2dd0370 0x5586c2dd2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:23.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.483+0000 7ff8ced21740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5586c2d2b2f0 con 0x5586c2dc55d0 2024-09-12T12:33:23.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.483+0000 7ff8ced21740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5586c2cd2cf0 con 0x5586c2dc6b40 2024-09-12T12:33:23.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.483+0000 7ff8ced21740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5586c2d272b0 con 0x5586c2dd0370 2024-09-12T12:33:23.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.484+0000 7ff8c659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586c2dc55d0 0x5586c2dc5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:23.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.485+0000 7ff8c659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586c2dc55d0 0x5586c2dc5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43302/0 (socket says 172.21.15.33:43302) 2024-09-12T12:33:23.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.485+0000 7ff8c659c640 1 -- 172.21.15.33:0/2562802990 learned_addr learned my addr 172.21.15.33:0/2562802990 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:33:23.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.485+0000 7ff8b77fe640 1 -- 172.21.15.33:0/582577564 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ff8b8042070 con 0x7ff8c811b140 2024-09-12T12:33:23.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.485+0000 7ff8c659c640 1 -- 172.21.15.33:0/2562802990 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586c2dd0370 msgr2=0x5586c2dd2760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T12:33:23.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.485+0000 7ff8c659c640 1 --2- 172.21.15.33:0/2562802990 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586c2dd0370 0x5586c2dd2760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:23.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.485+0000 7ff8c659c640 1 -- 172.21.15.33:0/2562802990 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586c2dc6b40 msgr2=0x5586c2dc5090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T12:33:23.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.485+0000 7ff8c659c640 1 --2- 172.21.15.33:0/2562802990 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586c2dc6b40 0x5586c2dc5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:23.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.485+0000 7ff8c659c640 1 -- 172.21.15.33:0/2562802990 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586c2cb73a0 con 0x5586c2dc55d0 2024-09-12T12:33:23.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.486+0000 7ff8c659c640 1 --2- 172.21.15.33:0/2562802990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586c2dc55d0 0x5586c2dc5a10 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ff8c00114f0 tx=0x7ff8c00119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac6c0ebaa2c86f76 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:33:23.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.486+0000 7ff8b4ff9640 1 -- 172.21.15.33:0/2562802990 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c001e070 con 0x5586c2dc55d0 2024-09-12T12:33:23.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.486+0000 7ff8b4ff9640 1 -- 172.21.15.33:0/2562802990 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff8c000fad0 con 0x5586c2dc55d0 2024-09-12T12:33:23.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.487+0000 7ff8b4ff9640 1 -- 172.21.15.33:0/2562802990 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c0019b00 con 0x5586c2dc55d0 2024-09-12T12:33:23.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.487+0000 7ff8b77fe640 1 --2- 172.21.15.33:0/582577564 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff8b00a2d90 0x7ff8b00a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:23.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.487+0000 7ff8b77fe640 1 -- 172.21.15.33:0/582577564 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7ff8b80ef900 con 0x7ff8c811b140 2024-09-12T12:33:23.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.488+0000 7ff8ced21740 1 -- 172.21.15.33:0/2562802990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586c2dc55d0 msgr2=0x5586c2dc5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:23.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.488+0000 7ff8ced21740 1 --2- 172.21.15.33:0/2562802990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586c2dc55d0 0x5586c2dc5a10 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ff8c00114f0 tx=0x7ff8c00119b0 comp rx=0 tx=0).stop 2024-09-12T12:33:23.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.489+0000 7ff8c5d9b640 1 --2- 172.21.15.33:0/582577564 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff8b00a2d90 0x7ff8b00a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:23.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.493+0000 7ff8ced21740 1 -- 172.21.15.33:0/2562802990 shutdown_connections 2024-09-12T12:33:23.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.493+0000 7ff8ced21740 1 --2- 172.21.15.33:0/2562802990 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586c2dd0370 0x5586c2dd2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:23.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.493+0000 7ff8ced21740 1 --2- 172.21.15.33:0/2562802990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586c2dc55d0 0x5586c2dc5a10 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:23.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.493+0000 7ff8ced21740 1 --2- 172.21.15.33:0/2562802990 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586c2dc6b40 0x5586c2dc5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:23.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.493+0000 7ff8ced21740 1 -- 172.21.15.33:0/2562802990 >> 172.21.15.33:0/2562802990 conn(0x5586c2d8e310 msgr2=0x5586c2dc1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:33:23.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.494+0000 7ff8c5d9b640 1 --2- 172.21.15.33:0/582577564 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff8b00a2d90 0x7ff8b00a5250 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc006fd0 tx=0x7ff8bc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:33:23.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.494+0000 7ff8ced21740 1 -- 172.21.15.33:0/2562802990 shutdown_connections 2024-09-12T12:33:23.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.496+0000 7ff8ced21740 1 -- 172.21.15.33:0/2562802990 wait complete. 2024-09-12T12:33:23.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.496+0000 7ff8ced21740 1 -- start start 2024-09-12T12:33:23.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.496+0000 7ff8ced21740 1 Processor -- start 2024-09-12T12:33:23.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.497+0000 7ff8ced21740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586c2dc55d0 0x5586c2dcfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:23.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.497+0000 7ff8ced21740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586c2dc6b40 0x5586c2dccf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:23.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.497+0000 7ff8ced21740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586c2dd0370 0x5586c2dcd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:23.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.497+0000 7ff8ced21740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5586c2dd3070 con 0x5586c2dd0370 2024-09-12T12:33:23.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.497+0000 7ff8ced21740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5586c2ce6060 con 0x5586c2dc55d0 2024-09-12T12:33:23.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.497+0000 7ff8ced21740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5586c2dd31f0 con 0x5586c2dc6b40 2024-09-12T12:33:23.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.497+0000 7ff8ced21740 10 client.0 _ll_register_callbacks cb 0x5586c2a398c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:33:23.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.499+0000 7ff8c659c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586c2dc55d0 0x5586c2dcfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:23.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.499+0000 7ff8c6d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586c2dd0370 0x5586c2dcd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:23.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.499+0000 7ff8c6d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586c2dd0370 0x5586c2dcd490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43312/0 (socket says 172.21.15.33:43312) 2024-09-12T12:33:23.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.499+0000 7ff8c6d9d640 1 -- 172.21.15.33:0/3108939103 learned_addr learned my addr 172.21.15.33:0/3108939103 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:33:23.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.499+0000 7ff8c5d9b640 1 --2- 172.21.15.33:0/3108939103 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586c2dc6b40 0x5586c2dccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:23.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.500+0000 7ff8c659c640 1 -- 172.21.15.33:0/3108939103 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586c2dc6b40 msgr2=0x5586c2dccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:23.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.500+0000 7ff8c659c640 1 --2- 172.21.15.33:0/3108939103 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586c2dc6b40 0x5586c2dccf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:23.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.500+0000 7ff8c659c640 1 -- 172.21.15.33:0/3108939103 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586c2dd0370 msgr2=0x5586c2dcd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:23.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.500+0000 7ff8c659c640 1 --2- 172.21.15.33:0/3108939103 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586c2dd0370 0x5586c2dcd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:23.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.500+0000 7ff8c659c640 1 -- 172.21.15.33:0/3108939103 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586c2a9c3c0 con 0x5586c2dc55d0 2024-09-12T12:33:23.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.501+0000 7ff8c659c640 1 --2- 172.21.15.33:0/3108939103 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586c2dc55d0 0x5586c2dcfca0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff8c0000f80 tx=0x7ff8c000f850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d319cd1b397ded6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:33:23.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.501+0000 7ff8adffb640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:33:23.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.501+0000 7ff8adffb640 1 -- 172.21.15.33:0/3108939103 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c001e040 con 0x5586c2dc55d0 2024-09-12T12:33:23.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.501+0000 7ff8ced21740 1 -- 172.21.15.33:0/3108939103 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8c000fad0 con 0x5586c2dc55d0 2024-09-12T12:33:23.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.501+0000 7ff8adffb640 1 -- 172.21.15.33:0/3108939103 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7ff8c0016040 con 0x5586c2dc55d0 2024-09-12T12:33:23.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.501+0000 7ff8adffb640 1 -- 172.21.15.33:0/3108939103 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff8c0031050 con 0x5586c2dc55d0 2024-09-12T12:33:23.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.503+0000 7ff8ced21740 10 client.25664 fetch_fsmap learned FSMap version 27 2024-09-12T12:33:23.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.503+0000 7ff8ced21740 1 -- 172.21.15.33:0/3108939103 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5586c2ddeb30 con 0x5586c2dc55d0 2024-09-12T12:33:23.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.503+0000 7ff8adffb640 1 -- 172.21.15.33:0/3108939103 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff8c000fad0 con 0x5586c2dc55d0 2024-09-12T12:33:23.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.504+0000 7ff8adffb640 1 -- 172.21.15.33:0/3108939103 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7ff8c0005040 con 0x5586c2dc55d0 2024-09-12T12:33:23.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.505+0000 7ff8ced21740 10 client.25664 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:33:23.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.505+0000 7ff8ced21740 10 client.25664 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-12T12:33:23.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.505+0000 7ff8ced21740 20 client.25664 populate_metadata read hostname 'smithi033' 2024-09-12T12:33:23.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.505+0000 7ff8ced21740 1 --2- 172.21.15.33:0/3108939103 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x5586c2ddfe80 0x5586c2de2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:23.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.505+0000 7ff8ced21740 4 client.25664 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:33:23.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.505+0000 7ff8ced21740 1 -- 172.21.15.33:0/3108939103 --> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5586c2d38860 con 0x5586c2ddfe80 2024-09-12T12:33:23.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.505+0000 7ff8c5d9b640 1 --2- 172.21.15.33:0/3108939103 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x5586c2ddfe80 0x5586c2de2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:23.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.507+0000 7ff8c5d9b640 1 --2- 172.21.15.33:0/3108939103 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x5586c2ddfe80 0x5586c2de2270 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b4f31ea8b6fa1ea7 server_cookie=f4060b13216db8ef in_seq=0 out_seq=0 2024-09-12T12:33:23.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.507+0000 7ff8adffb640 10 client.25664 ms_handle_connect on v2:172.21.15.102:6836/2409953270 2024-09-12T12:33:23.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.509+0000 7ff8adffb640 1 -- 172.21.15.33:0/3108939103 <== mds.1 v2:172.21.15.102:6836/2409953270 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5586c2d38860 con 0x5586c2ddfe80 2024-09-12T12:33:23.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.509+0000 7ff8adffb640 10 client.25664 handle_command_reply: tid=0 2024-09-12T12:33:23.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.509+0000 7ff8ced21740 1 client.25664 shutdown 2024-09-12T12:33:23.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.509+0000 7ff8ced21740 1 -- 172.21.15.33:0/3108939103 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586c2dc55d0 msgr2=0x5586c2dcfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:23.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.509+0000 7ff8ced21740 1 --2- 172.21.15.33:0/3108939103 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586c2dc55d0 0x5586c2dcfca0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff8c0000f80 tx=0x7ff8c000f850 comp rx=0 tx=0).stop 2024-09-12T12:33:23.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.510+0000 7ff8ced21740 1 -- 172.21.15.33:0/3108939103 shutdown_connections 2024-09-12T12:33:23.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.510+0000 7ff8ced21740 1 --2- 172.21.15.33:0/3108939103 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586c2dd0370 0x5586c2dcd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:23.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.510+0000 7ff8ced21740 1 --2- 172.21.15.33:0/3108939103 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x5586c2ddfe80 0x5586c2de2270 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:23.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.510+0000 7ff8ced21740 1 --2- 172.21.15.33:0/3108939103 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586c2dc6b40 0x5586c2dccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:23.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.510+0000 7ff8ced21740 1 --2- 172.21.15.33:0/3108939103 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586c2dc55d0 0x5586c2dcfca0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:23.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.510+0000 7ff8ced21740 1 -- 172.21.15.33:0/3108939103 >> 172.21.15.33:0/3108939103 conn(0x5586c2d8e310 msgr2=0x5586c2dc7930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:33:23.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.510+0000 7ff8adffb640 0 client.25664 ms_handle_reset on v2:172.21.15.102:6836/2409953270 2024-09-12T12:33:23.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.512+0000 7ff8ced21740 1 -- 172.21.15.33:0/3108939103 shutdown_connections 2024-09-12T12:33:23.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.515+0000 7ff8ced21740 1 -- 172.21.15.33:0/3108939103 wait complete. 2024-09-12T12:33:23.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.515+0000 7ff8ced21740 20 client.25664 trim_cache size 0 max 16384 2024-09-12T12:33:23.545 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:23 smithi033 ceph-mon[31246]: pgmap v571: 129 pgs: 129 active+clean; 10 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 29 MiB/s wr, 539 op/s 2024-09-12T12:33:23.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.543+0000 7ff8ced21740 1 Processor -- start 2024-09-12T12:33:23.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.543+0000 7ff8ced21740 1 -- start start 2024-09-12T12:33:23.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.549+0000 7ff8ced21740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586c2dc55d0 0x5586c2ddc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:23.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.549+0000 7ff8ced21740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586c2dc6b40 0x5586c2dd2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:23.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.549+0000 7ff8ced21740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586c2dd0370 0x5586c2dd1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:23.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.549+0000 7ff8ced21740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a8012530 con 0x5586c2dd0370 2024-09-12T12:33:23.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.549+0000 7ff8ced21740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a800fe00 con 0x5586c2dc55d0 2024-09-12T12:33:23.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.549+0000 7ff8c659c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586c2dc55d0 0x5586c2ddc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:23.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.549+0000 7ff8c659c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586c2dc55d0 0x5586c2ddc3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:37882/0 (socket says 172.21.15.33:37882) 2024-09-12T12:33:23.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.549+0000 7ff8c659c640 1 -- 172.21.15.33:0/2353302669 learned_addr learned my addr 172.21.15.33:0/2353302669 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:33:23.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.549+0000 7ff8ced21740 1 -- 172.21.15.33:0/2353302669 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a800dc50 con 0x5586c2dc6b40 2024-09-12T12:33:23.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.549+0000 7ff8c5d9b640 1 --2- 172.21.15.33:0/2353302669 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586c2dc6b40 0x5586c2dd2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:23.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.555+0000 7ff8c5d9b640 1 -- 172.21.15.33:0/2353302669 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586c2dc55d0 msgr2=0x5586c2ddc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:23.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.555+0000 7ff8c5d9b640 1 --2- 172.21.15.33:0/2353302669 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586c2dc55d0 0x5586c2ddc3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:23.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.555+0000 7ff8c5d9b640 1 -- 172.21.15.33:0/2353302669 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586c2dd0370 msgr2=0x5586c2dd1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:23.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.555+0000 7ff8c5d9b640 1 --2- 172.21.15.33:0/2353302669 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586c2dd0370 0x5586c2dd1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:23.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.555+0000 7ff8c5d9b640 1 -- 172.21.15.33:0/2353302669 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586c2de25e0 con 0x5586c2dc6b40 2024-09-12T12:33:23.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.561+0000 7ff8c5d9b640 1 --2- 172.21.15.33:0/2353302669 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586c2dc6b40 0x5586c2dd2330 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x5586c2dce500 tx=0x7ff8bc010000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63b2b80fc5dad17d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:33:23.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.565+0000 7ff8affff640 1 -- 172.21.15.33:0/2353302669 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc041070 con 0x5586c2dc6b40 2024-09-12T12:33:23.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.565+0000 7ff8affff640 1 -- 172.21.15.33:0/2353302669 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff8bc022dd0 con 0x5586c2dc6b40 2024-09-12T12:33:23.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.565+0000 7ff8affff640 1 -- 172.21.15.33:0/2353302669 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc03cb40 con 0x5586c2dc6b40 2024-09-12T12:33:23.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.566+0000 7ff8ced21740 1 -- 172.21.15.33:0/2353302669 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586c2dc6b40 msgr2=0x5586c2dd2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:23.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.566+0000 7ff8ced21740 1 --2- 172.21.15.33:0/2353302669 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586c2dc6b40 0x5586c2dd2330 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x5586c2dce500 tx=0x7ff8bc010000 comp rx=0 tx=0).stop 2024-09-12T12:33:23.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.570+0000 7ff8ced21740 1 -- 172.21.15.33:0/2353302669 shutdown_connections 2024-09-12T12:33:23.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.570+0000 7ff8ced21740 1 --2- 172.21.15.33:0/2353302669 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586c2dd0370 0x5586c2dd1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:23.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.570+0000 7ff8ced21740 1 --2- 172.21.15.33:0/2353302669 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586c2dc6b40 0x5586c2dd2330 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:23.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.570+0000 7ff8ced21740 1 --2- 172.21.15.33:0/2353302669 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586c2dc55d0 0x5586c2ddc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:23.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.570+0000 7ff8ced21740 1 -- 172.21.15.33:0/2353302669 >> 172.21.15.33:0/2353302669 conn(0x5586c2d8e310 msgr2=0x5586c2dcb820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:33:23.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.574+0000 7ff8ced21740 1 -- 172.21.15.33:0/2353302669 shutdown_connections 2024-09-12T12:33:23.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.574+0000 7ff8ced21740 1 -- 172.21.15.33:0/2353302669 wait complete. 2024-09-12T12:33:23.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.574+0000 7ff8ced21740 1 -- start start 2024-09-12T12:33:23.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.574+0000 7ff8ced21740 1 Processor -- start 2024-09-12T12:33:23.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.576+0000 7ff8ced21740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586c2dc55d0 0x5586c2dd8980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:23.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.576+0000 7ff8ced21740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586c2dc6b40 0x5586c2dc9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:23.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.576+0000 7ff8ced21740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586c2dd0370 0x5586c2dc9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:23.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.576+0000 7ff8ced21740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a800e2c0 con 0x5586c2dc6b40 2024-09-12T12:33:23.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.576+0000 7ff8ced21740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a800f730 con 0x5586c2dc55d0 2024-09-12T12:33:23.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.576+0000 7ff8ced21740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a800e990 con 0x5586c2dd0370 2024-09-12T12:33:23.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.576+0000 7ff8ced21740 10 client.0 _ll_register_callbacks cb 0x7ff8c001c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:33:23.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.578+0000 7ff8c6d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586c2dd0370 0x5586c2dc9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:23.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.578+0000 7ff8c6d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586c2dd0370 0x5586c2dc9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:40658/0 (socket says 172.21.15.33:40658) 2024-09-12T12:33:23.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.578+0000 7ff8c6d9d640 1 -- 172.21.15.33:0/1205191565 learned_addr learned my addr 172.21.15.33:0/1205191565 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:33:23.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.578+0000 7ff8c5d9b640 1 --2- 172.21.15.33:0/1205191565 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586c2dc6b40 0x5586c2dc9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:23.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.578+0000 7ff8c659c640 1 --2- 172.21.15.33:0/1205191565 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586c2dc55d0 0x5586c2dd8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:23.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.579+0000 7ff8c5d9b640 1 -- 172.21.15.33:0/1205191565 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586c2dd0370 msgr2=0x5586c2dc9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:23.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.579+0000 7ff8c5d9b640 1 --2- 172.21.15.33:0/1205191565 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586c2dd0370 0x5586c2dc9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:23.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.579+0000 7ff8c5d9b640 1 -- 172.21.15.33:0/1205191565 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586c2dc55d0 msgr2=0x5586c2dd8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:23.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.579+0000 7ff8c5d9b640 1 --2- 172.21.15.33:0/1205191565 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586c2dc55d0 0x5586c2dd8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:23.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.579+0000 7ff8c5d9b640 1 -- 172.21.15.33:0/1205191565 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586c2dca490 con 0x5586c2dc6b40 2024-09-12T12:33:23.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.579+0000 7ff8c5d9b640 1 --2- 172.21.15.33:0/1205191565 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586c2dc6b40 0x5586c2dc9a10 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x5586c2dbd0b0 tx=0x7ff8bc022b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b29f91174961bbb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:33:23.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.581+0000 7ff8adffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:33:23.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.581+0000 7ff8adffb640 1 -- 172.21.15.33:0/1205191565 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc04c060 con 0x5586c2dc6b40 2024-09-12T12:33:23.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.581+0000 7ff8adffb640 1 -- 172.21.15.33:0/1205191565 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7ff8bc03c670 con 0x5586c2dc6b40 2024-09-12T12:33:23.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.582+0000 7ff8ced21740 1 -- 172.21.15.33:0/1205191565 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8bc022dd0 con 0x5586c2dc6b40 2024-09-12T12:33:23.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.588+0000 7ff8adffb640 1 -- 172.21.15.33:0/1205191565 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff8bc041030 con 0x5586c2dc6b40 2024-09-12T12:33:23.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.588+0000 7ff8ced21740 10 client.15972 fetch_fsmap learned FSMap version 27 2024-09-12T12:33:23.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.588+0000 7ff8ced21740 1 -- 172.21.15.33:0/1205191565 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5586c2dd7230 con 0x5586c2dc6b40 2024-09-12T12:33:23.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.592+0000 7ff8adffb640 1 -- 172.21.15.33:0/1205191565 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff8bc022dd0 con 0x5586c2dc6b40 2024-09-12T12:33:23.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.593+0000 7ff8adffb640 1 -- 172.21.15.33:0/1205191565 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7ff8bc013070 con 0x5586c2dc6b40 2024-09-12T12:33:23.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.594+0000 7ff8ced21740 10 client.15972 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:33:23.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.594+0000 7ff8ced21740 10 client.15972 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-12T12:33:23.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.594+0000 7ff8ced21740 20 client.15972 populate_metadata read hostname 'smithi033' 2024-09-12T12:33:23.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.594+0000 7ff8ced21740 1 --2- 172.21.15.33:0/1205191565 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x5586c2e4ad20 0x5586c2e4d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:23.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.594+0000 7ff8ced21740 4 client.15972 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:33:23.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.594+0000 7ff8ced21740 1 -- 172.21.15.33:0/1205191565 --> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5586c2d32d70 con 0x5586c2e4ad20 2024-09-12T12:33:23.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.595+0000 7ff8c659c640 1 --2- 172.21.15.33:0/1205191565 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x5586c2e4ad20 0x5586c2e4d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:23.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.599+0000 7ff8c659c640 1 --2- 172.21.15.33:0/1205191565 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x5586c2e4ad20 0x5586c2e4d140 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2e2a9ccda68f2e8e server_cookie=3f7a10404f9a788e in_seq=0 out_seq=0 2024-09-12T12:33:23.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.599+0000 7ff8adffb640 10 client.15972 ms_handle_connect on v2:172.21.15.102:6836/2409953270 2024-09-12T12:33:23.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.600+0000 7ff8adffb640 1 -- 172.21.15.33:0/1205191565 <== mds.1 v2:172.21.15.102:6836/2409953270 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5586c2d32d70 con 0x5586c2e4ad20 2024-09-12T12:33:23.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.600+0000 7ff8adffb640 10 client.15972 handle_command_reply: tid=0 2024-09-12T12:33:23.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.601+0000 7ff8ced21740 1 client.15972 shutdown 2024-09-12T12:33:23.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.601+0000 7ff8ced21740 1 -- 172.21.15.33:0/1205191565 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586c2dc6b40 msgr2=0x5586c2dc9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:23.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.601+0000 7ff8ced21740 1 --2- 172.21.15.33:0/1205191565 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586c2dc6b40 0x5586c2dc9a10 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x5586c2dbd0b0 tx=0x7ff8bc022b50 comp rx=0 tx=0).stop 2024-09-12T12:33:23.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.601+0000 7ff8ced21740 1 -- 172.21.15.33:0/1205191565 shutdown_connections 2024-09-12T12:33:23.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.601+0000 7ff8ced21740 1 --2- 172.21.15.33:0/1205191565 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x5586c2e4ad20 0x5586c2e4d140 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:23.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.601+0000 7ff8ced21740 1 --2- 172.21.15.33:0/1205191565 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586c2dd0370 0x5586c2dc9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:23.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.601+0000 7ff8ced21740 1 --2- 172.21.15.33:0/1205191565 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586c2dc6b40 0x5586c2dc9a10 secure :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0x5586c2dbd0b0 tx=0x7ff8bc022b50 comp rx=0 tx=0).stop 2024-09-12T12:33:23.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.601+0000 7ff8adffb640 0 client.15972 ms_handle_reset on v2:172.21.15.102:6836/2409953270 2024-09-12T12:33:23.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.601+0000 7ff8ced21740 1 --2- 172.21.15.33:0/1205191565 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586c2dc55d0 0x5586c2dd8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:23.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.601+0000 7ff8ced21740 1 -- 172.21.15.33:0/1205191565 >> 172.21.15.33:0/1205191565 conn(0x5586c2d8e310 msgr2=0x5586c2dc04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:33:23.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.605+0000 7ff8ced21740 1 -- 172.21.15.33:0/1205191565 shutdown_connections 2024-09-12T12:33:23.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.605+0000 7ff8ced21740 1 -- 172.21.15.33:0/1205191565 wait complete. 2024-09-12T12:33:23.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.605+0000 7ff8ced21740 20 client.15972 trim_cache size 0 max 16384 2024-09-12T12:33:23.607 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-09-12T12:33:23.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.608+0000 7ff8cc948640 1 -- 172.21.15.33:0/582577564 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff8b00a2d90 msgr2=0x7ff8b00a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:23.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.608+0000 7ff8cc948640 1 --2- 172.21.15.33:0/582577564 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff8b00a2d90 0x7ff8b00a5250 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc006fd0 tx=0x7ff8bc008040 comp rx=0 tx=0).stop 2024-09-12T12:33:23.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.608+0000 7ff8cc948640 1 -- 172.21.15.33:0/582577564 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8c811b140 msgr2=0x7ff8c81aba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:23.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.608+0000 7ff8cc948640 1 --2- 172.21.15.33:0/582577564 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8c811b140 0x7ff8c81aba80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff8b802a980 tx=0x7ff8b8004950 comp rx=0 tx=0).stop 2024-09-12T12:33:23.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.609+0000 7ff8cc948640 1 -- 172.21.15.33:0/582577564 shutdown_connections 2024-09-12T12:33:23.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.609+0000 7ff8cc948640 1 --2- 172.21.15.33:0/582577564 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ff8b00a2d90 0x7ff8b00a5250 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:23.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.609+0000 7ff8cc948640 1 --2- 172.21.15.33:0/582577564 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8c811b140 0x7ff8c81aba80 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:23.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.609+0000 7ff8cc948640 1 --2- 172.21.15.33:0/582577564 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff8c8109830 0x7ff8c81a76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:23.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.609+0000 7ff8cc948640 1 --2- 172.21.15.33:0/582577564 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8c8109450 0x7ff8c81a71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:23.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.609+0000 7ff8cc948640 1 -- 172.21.15.33:0/582577564 >> 172.21.15.33:0/582577564 conn(0x7ff8c806e140 msgr2=0x7ff8c811c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:33:23.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.609+0000 7ff8cc948640 1 -- 172.21.15.33:0/582577564 shutdown_connections 2024-09-12T12:33:23.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:23.609+0000 7ff8cc948640 1 -- 172.21.15.33:0/582577564 wait complete. 2024-09-12T12:33:23.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:23 smithi043 ceph-mon[34144]: pgmap v571: 129 pgs: 129 active+clean; 10 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 29 MiB/s wr, 539 op/s 2024-09-12T12:33:23.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:23 smithi102 ceph-mon[34799]: pgmap v571: 129 pgs: 129 active+clean; 10 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 29 MiB/s wr, 539 op/s 2024-09-12T12:33:24.457 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T12:33:25.160 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:33:25.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:25 smithi043 ceph-mon[34144]: pgmap v572: 129 pgs: 129 active+clean; 10 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 37 MiB/s wr, 696 op/s 2024-09-12T12:33:25.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:25 smithi102 ceph-mon[34799]: pgmap v572: 129 pgs: 129 active+clean; 10 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 37 MiB/s wr, 696 op/s 2024-09-12T12:33:25.669 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:25 smithi033 ceph-mon[31246]: pgmap v572: 129 pgs: 129 active+clean; 10 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 37 MiB/s wr, 696 op/s 2024-09-12T12:33:25.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.822+0000 7fba459de640 1 -- 172.21.15.33:0/2777270736 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba40109450 msgr2=0x7fba40110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:25.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.822+0000 7fba459de640 1 --2- 172.21.15.33:0/2777270736 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba40109450 0x7fba40110250 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fba38009860 tx=0x7fba3802a360 comp rx=0 tx=0).stop 2024-09-12T12:33:25.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.824+0000 7fba459de640 1 -- 172.21.15.33:0/2777270736 shutdown_connections 2024-09-12T12:33:25.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.824+0000 7fba459de640 1 --2- 172.21.15.33:0/2777270736 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba4011b140 0x7fba4011d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:25.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.824+0000 7fba459de640 1 --2- 172.21.15.33:0/2777270736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba40109830 0x7fba40109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:25.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.824+0000 7fba459de640 1 --2- 172.21.15.33:0/2777270736 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba40109450 0x7fba40110250 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:25.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.824+0000 7fba459de640 1 -- 172.21.15.33:0/2777270736 >> 172.21.15.33:0/2777270736 conn(0x7fba4006e140 msgr2=0x7fba4006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:33:25.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.826+0000 7fba459de640 1 -- 172.21.15.33:0/2777270736 shutdown_connections 2024-09-12T12:33:25.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.829+0000 7fba459de640 1 -- 172.21.15.33:0/2777270736 wait complete. 2024-09-12T12:33:25.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.830+0000 7fba459de640 1 Processor -- start 2024-09-12T12:33:25.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.831+0000 7fba459de640 1 -- start start 2024-09-12T12:33:25.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.831+0000 7fba459de640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba40109450 0x7fba40118770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:25.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.831+0000 7fba459de640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba40109830 0x7fba40111800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:25.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.831+0000 7fba459de640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba4011b140 0x7fba40111d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:25.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.831+0000 7fba459de640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fba40120ca0 con 0x7fba40109450 2024-09-12T12:33:25.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.831+0000 7fba459de640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fba40120b20 con 0x7fba40109830 2024-09-12T12:33:25.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.831+0000 7fba459de640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fba40120e20 con 0x7fba4011b140 2024-09-12T12:33:25.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.831+0000 7fba3f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba4011b140 0x7fba40111d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:25.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.831+0000 7fba3effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba40109450 0x7fba40118770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:25.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.831+0000 7fba3f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba4011b140 0x7fba40111d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:40672/0 (socket says 172.21.15.33:40672) 2024-09-12T12:33:25.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.831+0000 7fba3f7fe640 1 -- 172.21.15.33:0/2595087771 learned_addr learned my addr 172.21.15.33:0/2595087771 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:33:25.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.832+0000 7fba3effd640 1 -- 172.21.15.33:0/2595087771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba4011b140 msgr2=0x7fba40111d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:25.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.832+0000 7fba3effd640 1 --2- 172.21.15.33:0/2595087771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba4011b140 0x7fba40111d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:25.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.832+0000 7fba3effd640 1 -- 172.21.15.33:0/2595087771 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba40109830 msgr2=0x7fba40111800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:25.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.832+0000 7fba3effd640 1 --2- 172.21.15.33:0/2595087771 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba40109830 0x7fba40111800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:25.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.832+0000 7fba3effd640 1 -- 172.21.15.33:0/2595087771 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba40112380 con 0x7fba40109450 2024-09-12T12:33:25.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.832+0000 7fba3effd640 1 --2- 172.21.15.33:0/2595087771 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba40109450 0x7fba40118770 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fba38035040 tx=0x7fba38032df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:33:25.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.833+0000 7fba449dc640 1 -- 172.21.15.33:0/2595087771 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba38037040 con 0x7fba40109450 2024-09-12T12:33:25.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.833+0000 7fba459de640 1 -- 172.21.15.33:0/2595087771 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba40112610 con 0x7fba40109450 2024-09-12T12:33:25.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.833+0000 7fba459de640 1 -- 172.21.15.33:0/2595087771 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba401165d0 con 0x7fba40109450 2024-09-12T12:33:25.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.833+0000 7fba449dc640 1 -- 172.21.15.33:0/2595087771 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fba38030c10 con 0x7fba40109450 2024-09-12T12:33:25.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.833+0000 7fba449dc640 1 -- 172.21.15.33:0/2595087771 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba38005290 con 0x7fba40109450 2024-09-12T12:33:25.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.839+0000 7fba449dc640 1 -- 172.21.15.33:0/2595087771 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fba38043020 con 0x7fba40109450 2024-09-12T12:33:25.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.840+0000 7fba449dc640 1 --2- 172.21.15.33:0/2595087771 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fba2c0a2c40 0x7fba2c0a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:25.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.841+0000 7fba449dc640 1 -- 172.21.15.33:0/2595087771 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fba380eec10 con 0x7fba40109450 2024-09-12T12:33:25.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.841+0000 7fba3e7fc640 1 --2- 172.21.15.33:0/2595087771 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fba2c0a2c40 0x7fba2c0a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:25.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.843+0000 7fba47db7740 1 Processor -- start 2024-09-12T12:33:25.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.844+0000 7fba47db7740 1 -- start start 2024-09-12T12:33:25.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.844+0000 7fba47db7740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bde01beb40 0x55bde01bd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:25.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.844+0000 7fba47db7740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bde01bd5d0 0x55bde01bda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:25.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.844+0000 7fba47db7740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bde01c8370 0x55bde01ca760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:25.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.844+0000 7fba47db7740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55bde01232f0 con 0x55bde01bd5d0 2024-09-12T12:33:25.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.844+0000 7fba47db7740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55bde00cacf0 con 0x55bde01beb40 2024-09-12T12:33:25.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.844+0000 7fba47db7740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55bde011f2b0 con 0x55bde01c8370 2024-09-12T12:33:25.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.844+0000 7fba3f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bde01c8370 0x55bde01ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:25.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.845+0000 7fba3f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bde01c8370 0x55bde01ca760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:40678/0 (socket says 172.21.15.33:40678) 2024-09-12T12:33:25.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.845+0000 7fba3f7fe640 1 -- 172.21.15.33:0/416184063 learned_addr learned my addr 172.21.15.33:0/416184063 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:33:25.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.845+0000 7fba3f7fe640 1 -- 172.21.15.33:0/416184063 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bde01beb40 msgr2=0x55bde01bd090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:33:25.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.845+0000 7fba3f7fe640 1 --2- 172.21.15.33:0/416184063 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bde01beb40 0x55bde01bd090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:25.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.845+0000 7fba3f7fe640 1 -- 172.21.15.33:0/416184063 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bde01bd5d0 msgr2=0x55bde01bda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:25.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.845+0000 7fba3f7fe640 1 --2- 172.21.15.33:0/416184063 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bde01bd5d0 0x55bde01bda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:25.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.845+0000 7fba3f7fe640 1 -- 172.21.15.33:0/416184063 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bde00af3a0 con 0x55bde01c8370 2024-09-12T12:33:25.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.846+0000 7fba3f7fe640 1 --2- 172.21.15.33:0/416184063 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bde01c8370 0x55bde01ca760 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fba30009fa0 tx=0x7fba30011870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b0e44479f11f8d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:33:25.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.846+0000 7fba35ffb640 1 -- 172.21.15.33:0/416184063 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba300127d0 con 0x55bde01c8370 2024-09-12T12:33:25.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.846+0000 7fba35ffb640 1 -- 172.21.15.33:0/416184063 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fba30012e20 con 0x55bde01c8370 2024-09-12T12:33:25.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.846+0000 7fba35ffb640 1 -- 172.21.15.33:0/416184063 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba300127d0 con 0x55bde01c8370 2024-09-12T12:33:25.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.849+0000 7fba47db7740 1 -- 172.21.15.33:0/416184063 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bde01c8370 msgr2=0x55bde01ca760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:25.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.849+0000 7fba47db7740 1 --2- 172.21.15.33:0/416184063 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bde01c8370 0x55bde01ca760 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fba30009fa0 tx=0x7fba30011870 comp rx=0 tx=0).stop 2024-09-12T12:33:25.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.849+0000 7fba47db7740 1 -- 172.21.15.33:0/416184063 shutdown_connections 2024-09-12T12:33:25.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.849+0000 7fba47db7740 1 --2- 172.21.15.33:0/416184063 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bde01c8370 0x55bde01ca760 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:25.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.849+0000 7fba47db7740 1 --2- 172.21.15.33:0/416184063 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bde01bd5d0 0x55bde01bda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:25.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.849+0000 7fba47db7740 1 --2- 172.21.15.33:0/416184063 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bde01beb40 0x55bde01bd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:25.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.849+0000 7fba47db7740 1 -- 172.21.15.33:0/416184063 >> 172.21.15.33:0/416184063 conn(0x55bde0186310 msgr2=0x55bde01b9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:33:25.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.850+0000 7fba47db7740 1 -- 172.21.15.33:0/416184063 shutdown_connections 2024-09-12T12:33:25.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.850+0000 7fba47db7740 1 -- 172.21.15.33:0/416184063 wait complete. 2024-09-12T12:33:25.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.851+0000 7fba47db7740 1 -- start start 2024-09-12T12:33:25.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.851+0000 7fba47db7740 1 Processor -- start 2024-09-12T12:33:25.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.851+0000 7fba47db7740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bde01bd5d0 0x55bde01c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:25.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.851+0000 7fba47db7740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bde01beb40 0x55bde01c4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:25.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.851+0000 7fba47db7740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bde01c8370 0x55bde01c54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:25.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.851+0000 7fba47db7740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55bde01cb070 con 0x55bde01c8370 2024-09-12T12:33:25.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.851+0000 7fba47db7740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55bde00de060 con 0x55bde01bd5d0 2024-09-12T12:33:25.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.851+0000 7fba47db7740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55bde01cb1f0 con 0x55bde01beb40 2024-09-12T12:33:25.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.851+0000 7fba47db7740 10 client.0 _ll_register_callbacks cb 0x55bddfe318c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:33:25.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.852+0000 7fba3effd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bde01bd5d0 0x55bde01c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:25.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.852+0000 7fba3effd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bde01bd5d0 0x55bde01c7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:37924/0 (socket says 172.21.15.33:37924) 2024-09-12T12:33:25.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.852+0000 7fba3effd640 1 -- 172.21.15.33:0/3134251925 learned_addr learned my addr 172.21.15.33:0/3134251925 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:33:25.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.852+0000 7fba3e7fc640 1 --2- 172.21.15.33:0/3134251925 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bde01beb40 0x55bde01c4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:25.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.852+0000 7fba3e7fc640 1 --2- 172.21.15.33:0/2595087771 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fba2c0a2c40 0x7fba2c0a5100 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fba280058c0 tx=0x7fba28005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:33:25.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.853+0000 7fba3e7fc640 1 -- 172.21.15.33:0/3134251925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bde01bd5d0 msgr2=0x55bde01c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:25.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.853+0000 7fba3e7fc640 1 --2- 172.21.15.33:0/3134251925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bde01bd5d0 0x55bde01c7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:25.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.853+0000 7fba3e7fc640 1 -- 172.21.15.33:0/3134251925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bde01c8370 msgr2=0x55bde01c54d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T12:33:25.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.853+0000 7fba3f7fe640 1 --2- 172.21.15.33:0/3134251925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bde01c8370 0x55bde01c54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:25.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.853+0000 7fba3e7fc640 1 --2- 172.21.15.33:0/3134251925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bde01c8370 0x55bde01c54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:25.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.853+0000 7fba3e7fc640 1 -- 172.21.15.33:0/3134251925 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bddfe943c0 con 0x55bde01beb40 2024-09-12T12:33:25.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.853+0000 7fba3f7fe640 1 --2- 172.21.15.33:0/3134251925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bde01c8370 0x55bde01c54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:33:25.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.853+0000 7fba3e7fc640 1 --2- 172.21.15.33:0/3134251925 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bde01beb40 0x55bde01c4f70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fba40112fc0 tx=0x7fba280098d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d91eba377c490cf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:33:25.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.854+0000 7fba1effd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:33:25.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.854+0000 7fba1effd640 1 -- 172.21.15.33:0/3134251925 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba28021070 con 0x55bde01beb40 2024-09-12T12:33:25.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.855+0000 7fba47db7740 1 -- 172.21.15.33:0/3134251925 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba30012e20 con 0x55bde01beb40 2024-09-12T12:33:25.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.855+0000 7fba1effd640 1 -- 172.21.15.33:0/3134251925 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fba28005020 con 0x55bde01beb40 2024-09-12T12:33:25.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.855+0000 7fba1effd640 1 -- 172.21.15.33:0/3134251925 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fba2802c050 con 0x55bde01beb40 2024-09-12T12:33:25.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.855+0000 7fba47db7740 10 client.25765 fetch_fsmap learned FSMap version 27 2024-09-12T12:33:25.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.856+0000 7fba47db7740 1 -- 172.21.15.33:0/3134251925 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55bde01d6ba0 con 0x55bde01beb40 2024-09-12T12:33:25.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.856+0000 7fba1effd640 1 -- 172.21.15.33:0/3134251925 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fba30012e20 con 0x55bde01beb40 2024-09-12T12:33:25.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.856+0000 7fba1effd640 1 -- 172.21.15.33:0/3134251925 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fba2801d670 con 0x55bde01beb40 2024-09-12T12:33:25.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.857+0000 7fba47db7740 10 client.25765 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:33:25.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.857+0000 7fba47db7740 10 client.25765 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:33:25.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.857+0000 7fba47db7740 20 client.25765 populate_metadata read hostname 'smithi033' 2024-09-12T12:33:25.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.857+0000 7fba47db7740 1 --2- 172.21.15.33:0/3134251925 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55bde01d84a0 0x55bde01da8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:25.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.857+0000 7fba47db7740 4 client.25765 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:33:25.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.857+0000 7fba47db7740 1 -- 172.21.15.33:0/3134251925 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bde0130860 con 0x55bde01d84a0 2024-09-12T12:33:25.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.858+0000 7fba3effd640 1 --2- 172.21.15.33:0/3134251925 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55bde01d84a0 0x55bde01da8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:25.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.862+0000 7fba3effd640 1 --2- 172.21.15.33:0/3134251925 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55bde01d84a0 0x55bde01da8c0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fa35064b75a54e5 server_cookie=c6e2e8dd1ac3c361 in_seq=0 out_seq=0 2024-09-12T12:33:25.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.862+0000 7fba1effd640 10 client.25765 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:33:25.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.862+0000 7fba1effd640 1 -- 172.21.15.33:0/3134251925 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bde0130860 con 0x55bde01d84a0 2024-09-12T12:33:25.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.862+0000 7fba1effd640 10 client.25765 handle_command_reply: tid=0 2024-09-12T12:33:25.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.863+0000 7fba47db7740 1 client.25765 shutdown 2024-09-12T12:33:25.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.865+0000 7fba47db7740 1 -- 172.21.15.33:0/3134251925 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bde01beb40 msgr2=0x55bde01c4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:25.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.865+0000 7fba47db7740 1 --2- 172.21.15.33:0/3134251925 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bde01beb40 0x55bde01c4f70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fba40112fc0 tx=0x7fba280098d0 comp rx=0 tx=0).stop 2024-09-12T12:33:25.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.867+0000 7fba47db7740 1 -- 172.21.15.33:0/3134251925 shutdown_connections 2024-09-12T12:33:25.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.867+0000 7fba47db7740 1 --2- 172.21.15.33:0/3134251925 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55bde01d84a0 0x55bde01da8c0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:25.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.867+0000 7fba47db7740 1 --2- 172.21.15.33:0/3134251925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bde01c8370 0x55bde01c54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:25.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.867+0000 7fba47db7740 1 --2- 172.21.15.33:0/3134251925 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bde01beb40 0x55bde01c4f70 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:25.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.867+0000 7fba47db7740 1 --2- 172.21.15.33:0/3134251925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bde01bd5d0 0x55bde01c7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:25.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.867+0000 7fba47db7740 1 -- 172.21.15.33:0/3134251925 >> 172.21.15.33:0/3134251925 conn(0x55bde0186310 msgr2=0x55bde01bf930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:33:25.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.867+0000 7fba1effd640 0 client.25765 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:33:25.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.870+0000 7fba47db7740 1 -- 172.21.15.33:0/3134251925 shutdown_connections 2024-09-12T12:33:25.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.870+0000 7fba47db7740 1 -- 172.21.15.33:0/3134251925 wait complete. 2024-09-12T12:33:25.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.870+0000 7fba47db7740 20 client.25765 trim_cache size 0 max 16384 2024-09-12T12:33:25.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.899+0000 7fba47db7740 1 Processor -- start 2024-09-12T12:33:25.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.900+0000 7fba47db7740 1 -- start start 2024-09-12T12:33:25.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.900+0000 7fba47db7740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bde01bd5d0 0x55bde01b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:25.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.900+0000 7fba47db7740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bde01beb40 0x55bde01c0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:25.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.900+0000 7fba47db7740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bde01c8370 0x55bde01c0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:25.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.900+0000 7fba47db7740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fba20012530 con 0x55bde01beb40 2024-09-12T12:33:25.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.900+0000 7fba3effd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bde01bd5d0 0x55bde01b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:25.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.900+0000 7fba47db7740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fba2000fe00 con 0x55bde01bd5d0 2024-09-12T12:33:25.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.900+0000 7fba47db7740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fba2000dc50 con 0x55bde01c8370 2024-09-12T12:33:25.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.901+0000 7fba3effd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bde01bd5d0 0x55bde01b8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:37932/0 (socket says 172.21.15.33:37932) 2024-09-12T12:33:25.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.901+0000 7fba3effd640 1 -- 172.21.15.33:0/1304825735 learned_addr learned my addr 172.21.15.33:0/1304825735 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:33:25.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.901+0000 7fba3f7fe640 1 --2- 172.21.15.33:0/1304825735 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bde01c8370 0x55bde01c0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:25.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.901+0000 7fba3e7fc640 1 --2- 172.21.15.33:0/1304825735 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bde01beb40 0x55bde01c0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:25.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.901+0000 7fba3effd640 1 -- 172.21.15.33:0/1304825735 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bde01c8370 msgr2=0x55bde01c0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:25.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.901+0000 7fba3effd640 1 --2- 172.21.15.33:0/1304825735 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bde01c8370 0x55bde01c0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:25.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.901+0000 7fba3effd640 1 -- 172.21.15.33:0/1304825735 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bde01beb40 msgr2=0x55bde01c0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:25.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.901+0000 7fba3effd640 1 --2- 172.21.15.33:0/1304825735 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bde01beb40 0x55bde01c0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:25.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.901+0000 7fba3effd640 1 -- 172.21.15.33:0/1304825735 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bde01b9ed0 con 0x55bde01bd5d0 2024-09-12T12:33:25.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.902+0000 7fba3effd640 1 --2- 172.21.15.33:0/1304825735 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bde01bd5d0 0x55bde01b8c10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fba380bade0 tx=0x7fba380ec250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdc12c2a5373e754 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:33:25.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.903+0000 7fba357fa640 1 -- 172.21.15.33:0/1304825735 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba380d4070 con 0x55bde01bd5d0 2024-09-12T12:33:25.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.903+0000 7fba357fa640 1 -- 172.21.15.33:0/1304825735 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fba380bb7e0 con 0x55bde01bd5d0 2024-09-12T12:33:25.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.903+0000 7fba357fa640 1 -- 172.21.15.33:0/1304825735 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba380b9180 con 0x55bde01bd5d0 2024-09-12T12:33:25.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.904+0000 7fba47db7740 1 -- 172.21.15.33:0/1304825735 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bde01bd5d0 msgr2=0x55bde01b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:25.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.904+0000 7fba47db7740 1 --2- 172.21.15.33:0/1304825735 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bde01bd5d0 0x55bde01b8c10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fba380bade0 tx=0x7fba380ec250 comp rx=0 tx=0).stop 2024-09-12T12:33:25.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.904+0000 7fba47db7740 1 -- 172.21.15.33:0/1304825735 shutdown_connections 2024-09-12T12:33:25.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.904+0000 7fba47db7740 1 --2- 172.21.15.33:0/1304825735 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bde01c8370 0x55bde01c0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:25.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.904+0000 7fba47db7740 1 --2- 172.21.15.33:0/1304825735 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bde01beb40 0x55bde01c0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:25.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.904+0000 7fba47db7740 1 --2- 172.21.15.33:0/1304825735 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bde01bd5d0 0x55bde01b8c10 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:25.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.905+0000 7fba47db7740 1 -- 172.21.15.33:0/1304825735 >> 172.21.15.33:0/1304825735 conn(0x55bde0186310 msgr2=0x55bde01b8500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:33:25.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.908+0000 7fba47db7740 1 -- 172.21.15.33:0/1304825735 shutdown_connections 2024-09-12T12:33:25.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.912+0000 7fba47db7740 1 -- 172.21.15.33:0/1304825735 wait complete. 2024-09-12T12:33:25.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.913+0000 7fba47db7740 1 -- start start 2024-09-12T12:33:25.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.913+0000 7fba47db7740 1 Processor -- start 2024-09-12T12:33:25.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.914+0000 7fba47db7740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bde01bd5d0 0x55bde01d0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:25.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.914+0000 7fba47db7740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bde01beb40 0x55bde01d0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:25.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.914+0000 7fba47db7740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bde01c8370 0x55bde01cbe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:25.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.914+0000 7fba47db7740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fba2000e2c0 con 0x55bde01bd5d0 2024-09-12T12:33:25.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.914+0000 7fba47db7740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fba2000f730 con 0x55bde01beb40 2024-09-12T12:33:25.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.914+0000 7fba47db7740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fba2000e990 con 0x55bde01c8370 2024-09-12T12:33:25.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.915+0000 7fba47db7740 10 client.0 _ll_register_callbacks cb 0x7fba28014050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:33:25.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.915+0000 7fba3e7fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bde01beb40 0x55bde01d0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:25.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.915+0000 7fba3e7fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bde01beb40 0x55bde01d0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:37942/0 (socket says 172.21.15.33:37942) 2024-09-12T12:33:25.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.915+0000 7fba3e7fc640 1 -- 172.21.15.33:0/2940794412 learned_addr learned my addr 172.21.15.33:0/2940794412 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:33:25.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.915+0000 7fba3f7fe640 1 --2- 172.21.15.33:0/2940794412 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bde01c8370 0x55bde01cbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:25.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.915+0000 7fba3e7fc640 1 -- 172.21.15.33:0/2940794412 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bde01c8370 msgr2=0x55bde01cbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:25.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.915+0000 7fba3e7fc640 1 --2- 172.21.15.33:0/2940794412 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bde01c8370 0x55bde01cbe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:25.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.915+0000 7fba3e7fc640 1 -- 172.21.15.33:0/2940794412 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bde01bd5d0 msgr2=0x55bde01d0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:25.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.915+0000 7fba3e7fc640 1 --2- 172.21.15.33:0/2940794412 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bde01bd5d0 0x55bde01d0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:25.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.915+0000 7fba3e7fc640 1 -- 172.21.15.33:0/2940794412 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bde01cc670 con 0x55bde01beb40 2024-09-12T12:33:25.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.916+0000 7fba3e7fc640 1 --2- 172.21.15.33:0/2940794412 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bde01beb40 0x55bde01d0db0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x55bde01c65b0 tx=0x7fba2800eb60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=260e1ab337bdfb13 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:33:25.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.916+0000 7fba1effd640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:33:25.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.916+0000 7fba1effd640 1 -- 172.21.15.33:0/2940794412 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba28021040 con 0x55bde01beb40 2024-09-12T12:33:25.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.916+0000 7fba47db7740 1 -- 172.21.15.33:0/2940794412 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba380bb7e0 con 0x55bde01beb40 2024-09-12T12:33:25.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.917+0000 7fba1effd640 1 -- 172.21.15.33:0/2940794412 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fba280049a0 con 0x55bde01beb40 2024-09-12T12:33:25.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.917+0000 7fba1effd640 1 -- 172.21.15.33:0/2940794412 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fba28041050 con 0x55bde01beb40 2024-09-12T12:33:25.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.924+0000 7fba47db7740 10 client.25682 fetch_fsmap learned FSMap version 27 2024-09-12T12:33:25.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.924+0000 7fba47db7740 1 -- 172.21.15.33:0/2940794412 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55bde0242d60 con 0x55bde01beb40 2024-09-12T12:33:25.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.926+0000 7fba1effd640 1 -- 172.21.15.33:0/2940794412 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fba380bb7e0 con 0x55bde01beb40 2024-09-12T12:33:25.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.926+0000 7fba1effd640 1 -- 172.21.15.33:0/2940794412 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fba28030430 con 0x55bde01beb40 2024-09-12T12:33:25.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.926+0000 7fba47db7740 10 client.25682 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:33:25.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.926+0000 7fba47db7740 10 client.25682 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:33:25.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.926+0000 7fba47db7740 20 client.25682 populate_metadata read hostname 'smithi033' 2024-09-12T12:33:25.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.926+0000 7fba47db7740 1 --2- 172.21.15.33:0/2940794412 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55bde0243510 0x55bde0245930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:25.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.926+0000 7fba47db7740 4 client.25682 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:33:25.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.926+0000 7fba47db7740 1 -- 172.21.15.33:0/2940794412 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bde012ad70 con 0x55bde0243510 2024-09-12T12:33:25.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.926+0000 7fba3effd640 1 --2- 172.21.15.33:0/2940794412 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55bde0243510 0x55bde0245930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:25.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.927+0000 7fba3effd640 1 --2- 172.21.15.33:0/2940794412 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55bde0243510 0x55bde0245930 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3646f007fd8c0f8 server_cookie=1aa4d3370bba8fe1 in_seq=0 out_seq=0 2024-09-12T12:33:25.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.927+0000 7fba1effd640 10 client.25682 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:33:25.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.928+0000 7fba1effd640 1 -- 172.21.15.33:0/2940794412 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bde012ad70 con 0x55bde0243510 2024-09-12T12:33:25.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.928+0000 7fba1effd640 10 client.25682 handle_command_reply: tid=0 2024-09-12T12:33:25.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.928+0000 7fba47db7740 1 client.25682 shutdown 2024-09-12T12:33:25.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.937+0000 7fba47db7740 1 -- 172.21.15.33:0/2940794412 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bde01beb40 msgr2=0x55bde01d0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:25.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.937+0000 7fba47db7740 1 --2- 172.21.15.33:0/2940794412 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bde01beb40 0x55bde01d0db0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x55bde01c65b0 tx=0x7fba2800eb60 comp rx=0 tx=0).stop 2024-09-12T12:33:25.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.944+0000 7fba47db7740 1 -- 172.21.15.33:0/2940794412 shutdown_connections 2024-09-12T12:33:25.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.944+0000 7fba47db7740 1 --2- 172.21.15.33:0/2940794412 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55bde0243510 0x55bde0245930 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:25.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.944+0000 7fba47db7740 1 --2- 172.21.15.33:0/2940794412 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bde01c8370 0x55bde01cbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:25.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.944+0000 7fba47db7740 1 --2- 172.21.15.33:0/2940794412 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bde01beb40 0x55bde01d0db0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:25.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.944+0000 7fba47db7740 1 --2- 172.21.15.33:0/2940794412 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bde01bd5d0 0x55bde01d0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:25.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.944+0000 7fba47db7740 1 -- 172.21.15.33:0/2940794412 >> 172.21.15.33:0/2940794412 conn(0x55bde0186310 msgr2=0x55bde01b8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:33:25.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.944+0000 7fba1effd640 0 client.25682 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:33:25.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.944+0000 7fba47db7740 1 -- 172.21.15.33:0/2940794412 shutdown_connections 2024-09-12T12:33:25.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.946+0000 7fba47db7740 1 -- 172.21.15.33:0/2940794412 wait complete. 2024-09-12T12:33:25.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.948+0000 7fba47db7740 20 client.25682 trim_cache size 0 max 16384 2024-09-12T12:33:25.950 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-09-12T12:33:25.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.949+0000 7fba459de640 1 -- 172.21.15.33:0/2595087771 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fba2c0a2c40 msgr2=0x7fba2c0a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:25.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.949+0000 7fba459de640 1 --2- 172.21.15.33:0/2595087771 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fba2c0a2c40 0x7fba2c0a5100 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fba280058c0 tx=0x7fba28005850 comp rx=0 tx=0).stop 2024-09-12T12:33:25.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.950+0000 7fba459de640 1 -- 172.21.15.33:0/2595087771 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba40109450 msgr2=0x7fba40118770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:25.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.950+0000 7fba459de640 1 --2- 172.21.15.33:0/2595087771 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba40109450 0x7fba40118770 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fba38035040 tx=0x7fba38032df0 comp rx=0 tx=0).stop 2024-09-12T12:33:25.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.953+0000 7fba459de640 1 -- 172.21.15.33:0/2595087771 shutdown_connections 2024-09-12T12:33:25.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.953+0000 7fba459de640 1 --2- 172.21.15.33:0/2595087771 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fba2c0a2c40 0x7fba2c0a5100 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:25.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.953+0000 7fba459de640 1 --2- 172.21.15.33:0/2595087771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba4011b140 0x7fba40111d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:25.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.953+0000 7fba459de640 1 --2- 172.21.15.33:0/2595087771 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba40109830 0x7fba40111800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:25.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.953+0000 7fba459de640 1 --2- 172.21.15.33:0/2595087771 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba40109450 0x7fba40118770 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:25.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.953+0000 7fba459de640 1 -- 172.21.15.33:0/2595087771 >> 172.21.15.33:0/2595087771 conn(0x7fba4006e140 msgr2=0x7fba4011c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:33:25.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.960+0000 7fba459de640 1 -- 172.21.15.33:0/2595087771 shutdown_connections 2024-09-12T12:33:25.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:25.962+0000 7fba459de640 1 -- 172.21.15.33:0/2595087771 wait complete. 2024-09-12T12:33:27.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:27 smithi043 ceph-mon[34144]: pgmap v573: 129 pgs: 129 active+clean; 10 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 30 MiB/s wr, 561 op/s 2024-09-12T12:33:27.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:27 smithi102 ceph-mon[34799]: pgmap v573: 129 pgs: 129 active+clean; 10 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 30 MiB/s wr, 561 op/s 2024-09-12T12:33:27.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:27 smithi033 ceph-mon[31246]: pgmap v573: 129 pgs: 129 active+clean; 10 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 30 MiB/s wr, 561 op/s 2024-09-12T12:33:27.777 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T12:33:27.780 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T12:33:28.430 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:33:29.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.125+0000 7f0b767d8640 1 -- 172.21.15.33:0/1229025234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b70109830 msgr2=0x7f0b70109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:29.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.125+0000 7f0b767d8640 1 --2- 172.21.15.33:0/1229025234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b70109830 0x7f0b70109c90 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c009860 tx=0x7f0b5c02a380 comp rx=0 tx=0).stop 2024-09-12T12:33:29.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.126+0000 7f0b767d8640 1 -- 172.21.15.33:0/1229025234 shutdown_connections 2024-09-12T12:33:29.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.126+0000 7f0b767d8640 1 --2- 172.21.15.33:0/1229025234 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b7011b140 0x7f0b7011d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:29.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.126+0000 7f0b767d8640 1 --2- 172.21.15.33:0/1229025234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b70109830 0x7f0b70109c90 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:29.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.126+0000 7f0b767d8640 1 --2- 172.21.15.33:0/1229025234 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b70109450 0x7f0b70110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:29.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.126+0000 7f0b767d8640 1 -- 172.21.15.33:0/1229025234 >> 172.21.15.33:0/1229025234 conn(0x7f0b7006e140 msgr2=0x7f0b7006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:33:29.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.131+0000 7f0b767d8640 1 -- 172.21.15.33:0/1229025234 shutdown_connections 2024-09-12T12:33:29.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.131+0000 7f0b767d8640 1 -- 172.21.15.33:0/1229025234 wait complete. 2024-09-12T12:33:29.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.132+0000 7f0b767d8640 1 Processor -- start 2024-09-12T12:33:29.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.134+0000 7f0b767d8640 1 -- start start 2024-09-12T12:33:29.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.135+0000 7f0b767d8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b70109450 0x7f0b701a71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:29.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.135+0000 7f0b767d8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b70109830 0x7f0b701a7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:29.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.135+0000 7f0b767d8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b7011b140 0x7f0b701aba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:29.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.135+0000 7f0b6f7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b70109830 0x7f0b701a7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:29.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.135+0000 7f0b6f7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b70109830 0x7f0b701a7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:37962/0 (socket says 172.21.15.33:37962) 2024-09-12T12:33:29.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.135+0000 7f0b6f7fe640 1 -- 172.21.15.33:0/2934199002 learned_addr learned my addr 172.21.15.33:0/2934199002 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:33:29.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.136+0000 7f0b767d8640 1 -- 172.21.15.33:0/2934199002 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0b70120ca0 con 0x7f0b70109450 2024-09-12T12:33:29.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.136+0000 7f0b767d8640 1 -- 172.21.15.33:0/2934199002 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0b70120b20 con 0x7f0b70109830 2024-09-12T12:33:29.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.136+0000 7f0b767d8640 1 -- 172.21.15.33:0/2934199002 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0b70120e20 con 0x7f0b7011b140 2024-09-12T12:33:29.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.138+0000 7f0b6f7fe640 1 -- 172.21.15.33:0/2934199002 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b7011b140 msgr2=0x7f0b701aba90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T12:33:29.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.138+0000 7f0b6f7fe640 1 --2- 172.21.15.33:0/2934199002 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b7011b140 0x7f0b701aba90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:29.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.138+0000 7f0b6f7fe640 1 -- 172.21.15.33:0/2934199002 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b70109450 msgr2=0x7f0b701a71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:29.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.138+0000 7f0b6f7fe640 1 --2- 172.21.15.33:0/2934199002 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b70109450 0x7f0b701a71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:29.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.139+0000 7f0b6f7fe640 1 -- 172.21.15.33:0/2934199002 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b701ac170 con 0x7f0b70109830 2024-09-12T12:33:29.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.143+0000 7f0b6f7fe640 1 --2- 172.21.15.33:0/2934199002 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b70109830 0x7f0b701a7700 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c009830 tx=0x7f0b5c032cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:33:29.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.146+0000 7f0b6d7fa640 1 -- 172.21.15.33:0/2934199002 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c037050 con 0x7f0b70109830 2024-09-12T12:33:29.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.147+0000 7f0b6d7fa640 1 -- 172.21.15.33:0/2934199002 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0b5c038040 con 0x7f0b70109830 2024-09-12T12:33:29.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.147+0000 7f0b767d8640 1 -- 172.21.15.33:0/2934199002 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b701ac400 con 0x7f0b70109830 2024-09-12T12:33:29.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.147+0000 7f0b6d7fa640 1 -- 172.21.15.33:0/2934199002 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c0046c0 con 0x7f0b70109830 2024-09-12T12:33:29.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.147+0000 7f0b767d8640 1 -- 172.21.15.33:0/2934199002 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b701b3d40 con 0x7f0b70109830 2024-09-12T12:33:29.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.152+0000 7f0b78bb1740 1 Processor -- start 2024-09-12T12:33:29.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.156+0000 7f0b78bb1740 1 -- start start 2024-09-12T12:33:29.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.157+0000 7f0b78bb1740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cc3ecccb60 0x55cc3ecccf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:29.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.157+0000 7f0b78bb1740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cc3eccd480 0x55cc3ecd7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:29.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.157+0000 7f0b78bb1740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cc3ecd7d40 0x55cc3ecda130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:29.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.157+0000 7f0b78bb1740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55cc3ec32280 con 0x55cc3ecd7d40 2024-09-12T12:33:29.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.157+0000 7f0b78bb1740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55cc3ebd9b10 con 0x55cc3ecccb60 2024-09-12T12:33:29.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.157+0000 7f0b78bb1740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55cc3ec2e240 con 0x55cc3eccd480 2024-09-12T12:33:29.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.158+0000 7f0b6d7fa640 1 -- 172.21.15.33:0/2934199002 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0b5c004860 con 0x7f0b70109830 2024-09-12T12:33:29.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.159+0000 7f0b6d7fa640 1 --2- 172.21.15.33:0/2934199002 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0b540a2d90 0x7f0b540a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:29.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.159+0000 7f0b6d7fa640 1 -- 172.21.15.33:0/2934199002 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f0b5c0efc60 con 0x7f0b70109830 2024-09-12T12:33:29.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.159+0000 7f0b6f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cc3ecd7d40 0x55cc3ecda130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:29.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.159+0000 7f0b6f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cc3ecd7d40 0x55cc3ecda130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43424/0 (socket says 172.21.15.33:43424) 2024-09-12T12:33:29.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.160+0000 7f0b6f7fe640 1 -- 172.21.15.33:0/357920206 learned_addr learned my addr 172.21.15.33:0/357920206 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:33:29.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.160+0000 7f0b6ffff640 1 --2- 172.21.15.33:0/357920206 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cc3eccd480 0x55cc3ecd7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:29.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.160+0000 7f0b74d75640 1 --2- 172.21.15.33:0/357920206 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cc3ecccb60 0x55cc3ecccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:29.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.161+0000 7f0b6ffff640 1 -- 172.21.15.33:0/357920206 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cc3ecccb60 msgr2=0x55cc3ecccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:29.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.161+0000 7f0b6ffff640 1 --2- 172.21.15.33:0/357920206 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cc3ecccb60 0x55cc3ecccf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:29.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.161+0000 7f0b6ffff640 1 -- 172.21.15.33:0/357920206 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cc3ecd7d40 msgr2=0x55cc3ecda130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:29.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.161+0000 7f0b6ffff640 1 --2- 172.21.15.33:0/357920206 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cc3ecd7d40 0x55cc3ecda130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:29.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.161+0000 7f0b6ffff640 1 -- 172.21.15.33:0/357920206 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc3ebe61f0 con 0x55cc3eccd480 2024-09-12T12:33:29.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.163+0000 7f0b74d75640 1 --2- 172.21.15.33:0/2934199002 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0b540a2d90 0x7f0b540a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:29.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.163+0000 7f0b6ffff640 1 --2- 172.21.15.33:0/357920206 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cc3eccd480 0x55cc3ecd7800 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0b60009af0 tx=0x7f0b60009ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b59c4c77fa524a2a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:33:29.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.163+0000 7f0b667fc640 1 -- 172.21.15.33:0/357920206 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b6000ec30 con 0x55cc3eccd480 2024-09-12T12:33:29.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.164+0000 7f0b667fc640 1 -- 172.21.15.33:0/357920206 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0b6000edd0 con 0x55cc3eccd480 2024-09-12T12:33:29.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.165+0000 7f0b78bb1740 1 -- 172.21.15.33:0/357920206 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cc3eccd480 msgr2=0x55cc3ecd7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:29.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.165+0000 7f0b78bb1740 1 --2- 172.21.15.33:0/357920206 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cc3eccd480 0x55cc3ecd7800 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0b60009af0 tx=0x7f0b60009ef0 comp rx=0 tx=0).stop 2024-09-12T12:33:29.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.166+0000 7f0b78bb1740 1 -- 172.21.15.33:0/357920206 shutdown_connections 2024-09-12T12:33:29.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.166+0000 7f0b78bb1740 1 --2- 172.21.15.33:0/357920206 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cc3ecd7d40 0x55cc3ecda130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:29.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.166+0000 7f0b78bb1740 1 --2- 172.21.15.33:0/357920206 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cc3eccd480 0x55cc3ecd7800 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:29.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.166+0000 7f0b78bb1740 1 --2- 172.21.15.33:0/357920206 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cc3ecccb60 0x55cc3ecccf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:29.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.166+0000 7f0b78bb1740 1 -- 172.21.15.33:0/357920206 >> 172.21.15.33:0/357920206 conn(0x55cc3ecc90f0 msgr2=0x55cc3ecc94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:33:29.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.167+0000 7f0b78bb1740 1 -- 172.21.15.33:0/357920206 shutdown_connections 2024-09-12T12:33:29.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.167+0000 7f0b78bb1740 1 -- 172.21.15.33:0/357920206 wait complete. 2024-09-12T12:33:29.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.167+0000 7f0b78bb1740 1 -- start start 2024-09-12T12:33:29.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.168+0000 7f0b78bb1740 1 Processor -- start 2024-09-12T12:33:29.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.168+0000 7f0b78bb1740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cc3ecccb60 0x55cc3ecd7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:29.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.168+0000 7f0b78bb1740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cc3eccd480 0x55cc3ecd4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:29.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.168+0000 7f0b78bb1740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cc3ecd7d40 0x55cc3ecd5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:29.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.168+0000 7f0b78bb1740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55cc3ecda960 con 0x55cc3ecd7d40 2024-09-12T12:33:29.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.168+0000 7f0b78bb1740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55cc3ebecf10 con 0x55cc3ecccb60 2024-09-12T12:33:29.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.168+0000 7f0b78bb1740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55cc3ecdaae0 con 0x55cc3eccd480 2024-09-12T12:33:29.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.168+0000 7f0b78bb1740 10 client.0 _ll_register_callbacks cb 0x55cc3ebb5a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:33:29.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.169+0000 7f0b74d75640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cc3ecd7d40 0x55cc3ecd5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:29.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.169+0000 7f0b74d75640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cc3ecd7d40 0x55cc3ecd5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43426/0 (socket says 172.21.15.33:43426) 2024-09-12T12:33:29.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.169+0000 7f0b74d75640 1 -- 172.21.15.33:0/3858418351 learned_addr learned my addr 172.21.15.33:0/3858418351 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:33:29.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.170+0000 7f0b6f7fe640 1 --2- 172.21.15.33:0/3858418351 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cc3eccd480 0x55cc3ecd4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:29.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.170+0000 7f0b6ffff640 1 --2- 172.21.15.33:0/3858418351 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cc3ecccb60 0x55cc3ecd7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:29.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.170+0000 7f0b74d75640 1 --2- 172.21.15.33:0/2934199002 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0b540a2d90 0x7f0b540a5250 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0b68005fd0 tx=0x7f0b68004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:33:29.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.170+0000 7f0b74d75640 1 -- 172.21.15.33:0/3858418351 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cc3eccd480 msgr2=0x55cc3ecd4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:29.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.170+0000 7f0b74d75640 1 --2- 172.21.15.33:0/3858418351 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cc3eccd480 0x55cc3ecd4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:29.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.170+0000 7f0b74d75640 1 -- 172.21.15.33:0/3858418351 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cc3ecccb60 msgr2=0x55cc3ecd7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:29.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.170+0000 7f0b74d75640 1 --2- 172.21.15.33:0/3858418351 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cc3ecccb60 0x55cc3ecd7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:29.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.171+0000 7f0b74d75640 1 -- 172.21.15.33:0/3858418351 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc3e9a36a0 con 0x55cc3ecd7d40 2024-09-12T12:33:29.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.173+0000 7f0b74d75640 1 --2- 172.21.15.33:0/3858418351 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cc3ecd7d40 0x55cc3ecd5260 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f0b68003ca0 tx=0x7f0b68004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=913fb5b5166885da server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:33:29.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.173+0000 7f0b537fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:33:29.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.174+0000 7f0b6f7fe640 1 --2- 172.21.15.33:0/3858418351 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cc3eccd480 0x55cc3ecd4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:33:29.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.174+0000 7f0b6ffff640 1 --2- 172.21.15.33:0/3858418351 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cc3ecccb60 0x55cc3ecd7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:33:29.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.174+0000 7f0b537fe640 1 -- 172.21.15.33:0/3858418351 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b68020460 con 0x55cc3ecd7d40 2024-09-12T12:33:29.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.174+0000 7f0b537fe640 1 -- 172.21.15.33:0/3858418351 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f0b68020600 con 0x55cc3ecd7d40 2024-09-12T12:33:29.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.175+0000 7f0b78bb1740 1 -- 172.21.15.33:0/3858418351 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cc3ec3f7f0 con 0x55cc3ecd7d40 2024-09-12T12:33:29.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.177+0000 7f0b537fe640 1 -- 172.21.15.33:0/3858418351 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0b68020800 con 0x55cc3ecd7d40 2024-09-12T12:33:29.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.179+0000 7f0b78bb1740 10 client.15990 fetch_fsmap learned FSMap version 27 2024-09-12T12:33:29.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.179+0000 7f0b78bb1740 1 -- 172.21.15.33:0/3858418351 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55cc3ece65b0 con 0x55cc3ecd7d40 2024-09-12T12:33:29.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.184+0000 7f0b537fe640 1 -- 172.21.15.33:0/3858418351 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55cc3ec3f7f0 con 0x55cc3ecd7d40 2024-09-12T12:33:29.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.184+0000 7f0b537fe640 1 -- 172.21.15.33:0/3858418351 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f0b6800f040 con 0x55cc3ecd7d40 2024-09-12T12:33:29.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.187+0000 7f0b78bb1740 10 client.15990 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:33:29.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.187+0000 7f0b78bb1740 10 client.15990 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:33:29.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.187+0000 7f0b78bb1740 20 client.15990 populate_metadata read hostname 'smithi033' 2024-09-12T12:33:29.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.187+0000 7f0b78bb1740 1 --2- 172.21.15.33:0/3858418351 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55cc3ece7a70 0x55cc3ece9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:29.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.187+0000 7f0b78bb1740 4 client.15990 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:33:29.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.187+0000 7f0b78bb1740 1 -- 172.21.15.33:0/3858418351 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc3ec39d00 con 0x55cc3ece7a70 2024-09-12T12:33:29.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.187+0000 7f0b6ffff640 1 --2- 172.21.15.33:0/3858418351 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55cc3ece7a70 0x55cc3ece9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:29.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.194+0000 7f0b6ffff640 1 --2- 172.21.15.33:0/3858418351 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55cc3ece7a70 0x55cc3ece9f10 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fde9435142e400a5 server_cookie=5481582d9d8422ee in_seq=0 out_seq=0 2024-09-12T12:33:29.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.194+0000 7f0b537fe640 10 client.15990 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:33:29.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.194+0000 7f0b537fe640 1 -- 172.21.15.33:0/3858418351 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cc3ec39d00 con 0x55cc3ece7a70 2024-09-12T12:33:29.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.195+0000 7f0b537fe640 10 client.15990 handle_command_reply: tid=0 2024-09-12T12:33:29.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.195+0000 7f0b78bb1740 1 client.15990 shutdown 2024-09-12T12:33:29.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.195+0000 7f0b78bb1740 1 -- 172.21.15.33:0/3858418351 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cc3ecd7d40 msgr2=0x55cc3ecd5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:29.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.195+0000 7f0b78bb1740 1 --2- 172.21.15.33:0/3858418351 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cc3ecd7d40 0x55cc3ecd5260 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f0b68003ca0 tx=0x7f0b68004ab0 comp rx=0 tx=0).stop 2024-09-12T12:33:29.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.199+0000 7f0b78bb1740 1 -- 172.21.15.33:0/3858418351 shutdown_connections 2024-09-12T12:33:29.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.199+0000 7f0b78bb1740 1 --2- 172.21.15.33:0/3858418351 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55cc3ece7a70 0x55cc3ece9f10 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:29.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.199+0000 7f0b78bb1740 1 --2- 172.21.15.33:0/3858418351 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cc3ecd7d40 0x55cc3ecd5260 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:29.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.199+0000 7f0b78bb1740 1 --2- 172.21.15.33:0/3858418351 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cc3eccd480 0x55cc3ecd4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:29.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.199+0000 7f0b78bb1740 1 --2- 172.21.15.33:0/3858418351 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cc3ecccb60 0x55cc3ecd7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:29.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.199+0000 7f0b537fe640 0 client.15990 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:33:29.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.199+0000 7f0b78bb1740 1 -- 172.21.15.33:0/3858418351 >> 172.21.15.33:0/3858418351 conn(0x55cc3ecc90f0 msgr2=0x55cc3eccee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:33:29.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.200+0000 7f0b78bb1740 1 -- 172.21.15.33:0/3858418351 shutdown_connections 2024-09-12T12:33:29.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.201+0000 7f0b78bb1740 1 -- 172.21.15.33:0/3858418351 wait complete. 2024-09-12T12:33:29.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.201+0000 7f0b78bb1740 20 client.15990 trim_cache size 0 max 16384 2024-09-12T12:33:29.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.238+0000 7f0b78bb1740 1 Processor -- start 2024-09-12T12:33:29.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.245+0000 7f0b78bb1740 1 -- start start 2024-09-12T12:33:29.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.245+0000 7f0b78bb1740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cc3ecccb60 0x55cc3ecef7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:29.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.245+0000 7f0b78bb1740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cc3eccd480 0x55cc3ecefd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:29.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.245+0000 7f0b78bb1740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cc3ecd7d40 0x55cc3ecd9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:29.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.245+0000 7f0b78bb1740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0b580125c0 con 0x55cc3ecd7d40 2024-09-12T12:33:29.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.245+0000 7f0b78bb1740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5800fe90 con 0x55cc3eccd480 2024-09-12T12:33:29.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.245+0000 7f0b78bb1740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5800dce0 con 0x55cc3ecccb60 2024-09-12T12:33:29.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.247+0000 7f0b6f7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cc3eccd480 0x55cc3ecefd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:29.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.247+0000 7f0b6f7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cc3eccd480 0x55cc3ecefd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:37998/0 (socket says 172.21.15.33:37998) 2024-09-12T12:33:29.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.247+0000 7f0b6f7fe640 1 -- 172.21.15.33:0/4254909321 learned_addr learned my addr 172.21.15.33:0/4254909321 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:33:29.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.247+0000 7f0b6ffff640 1 --2- 172.21.15.33:0/4254909321 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cc3ecccb60 0x55cc3ecef7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:29.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.248+0000 7f0b6f7fe640 1 -- 172.21.15.33:0/4254909321 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cc3ecccb60 msgr2=0x55cc3ecef7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:29.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.248+0000 7f0b6f7fe640 1 --2- 172.21.15.33:0/4254909321 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cc3ecccb60 0x55cc3ecef7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:29.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.248+0000 7f0b6f7fe640 1 -- 172.21.15.33:0/4254909321 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cc3ecd7d40 msgr2=0x55cc3ecd9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:29.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.248+0000 7f0b6f7fe640 1 --2- 172.21.15.33:0/4254909321 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cc3ecd7d40 0x55cc3ecd9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:29.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.248+0000 7f0b6f7fe640 1 -- 172.21.15.33:0/4254909321 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc3ecc8f20 con 0x55cc3eccd480 2024-09-12T12:33:29.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.252+0000 7f0b6f7fe640 1 --2- 172.21.15.33:0/4254909321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cc3eccd480 0x55cc3ecefd20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c0058c0 tx=0x7f0b5c005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=410623f4f02dcb78 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:33:29.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.254+0000 7f0b65ffb640 1 -- 172.21.15.33:0/4254909321 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c0d4030 con 0x55cc3eccd480 2024-09-12T12:33:29.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.254+0000 7f0b65ffb640 1 -- 172.21.15.33:0/4254909321 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0b5c0bc850 con 0x55cc3eccd480 2024-09-12T12:33:29.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.255+0000 7f0b78bb1740 1 -- 172.21.15.33:0/4254909321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cc3eccd480 msgr2=0x55cc3ecefd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:29.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.255+0000 7f0b78bb1740 1 --2- 172.21.15.33:0/4254909321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cc3eccd480 0x55cc3ecefd20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c0058c0 tx=0x7f0b5c005f90 comp rx=0 tx=0).stop 2024-09-12T12:33:29.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.257+0000 7f0b78bb1740 1 -- 172.21.15.33:0/4254909321 shutdown_connections 2024-09-12T12:33:29.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.257+0000 7f0b78bb1740 1 --2- 172.21.15.33:0/4254909321 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cc3ecd7d40 0x55cc3ecd9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:29.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.257+0000 7f0b78bb1740 1 --2- 172.21.15.33:0/4254909321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cc3eccd480 0x55cc3ecefd20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:29.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.257+0000 7f0b78bb1740 1 --2- 172.21.15.33:0/4254909321 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cc3ecccb60 0x55cc3ecef7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:29.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.257+0000 7f0b78bb1740 1 -- 172.21.15.33:0/4254909321 >> 172.21.15.33:0/4254909321 conn(0x55cc3ecc90f0 msgr2=0x55cc3ecd33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:33:29.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.262+0000 7f0b78bb1740 1 -- 172.21.15.33:0/4254909321 shutdown_connections 2024-09-12T12:33:29.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.262+0000 7f0b78bb1740 1 -- 172.21.15.33:0/4254909321 wait complete. 2024-09-12T12:33:29.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.263+0000 7f0b78bb1740 1 -- start start 2024-09-12T12:33:29.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.263+0000 7f0b78bb1740 1 Processor -- start 2024-09-12T12:33:29.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.264+0000 7f0b78bb1740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cc3ecccb60 0x55cc3ecd8e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:29.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.264+0000 7f0b78bb1740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cc3eccd480 0x55cc3ecd9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:29.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.264+0000 7f0b78bb1740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cc3ecd7d40 0x55cc3ecd98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:29.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.264+0000 7f0b78bb1740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5800e350 con 0x55cc3ecd7d40 2024-09-12T12:33:29.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.264+0000 7f0b78bb1740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5800f7c0 con 0x55cc3eccd480 2024-09-12T12:33:29.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.264+0000 7f0b78bb1740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5800ea20 con 0x55cc3ecccb60 2024-09-12T12:33:29.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.264+0000 7f0b78bb1740 10 client.0 _ll_register_callbacks cb 0x7f0b68003970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:33:29.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.265+0000 7f0b74d75640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cc3ecd7d40 0x55cc3ecd98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:29.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.265+0000 7f0b74d75640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cc3ecd7d40 0x55cc3ecd98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43450/0 (socket says 172.21.15.33:43450) 2024-09-12T12:33:29.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.265+0000 7f0b74d75640 1 -- 172.21.15.33:0/1415380869 learned_addr learned my addr 172.21.15.33:0/1415380869 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:33:29.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.265+0000 7f0b74d75640 1 -- 172.21.15.33:0/1415380869 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cc3ecccb60 msgr2=0x55cc3ecd8e40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T12:33:29.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.265+0000 7f0b74d75640 1 --2- 172.21.15.33:0/1415380869 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cc3ecccb60 0x55cc3ecd8e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:29.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.265+0000 7f0b74d75640 1 -- 172.21.15.33:0/1415380869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cc3eccd480 msgr2=0x55cc3ecd9380 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:33:29.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.265+0000 7f0b74d75640 1 --2- 172.21.15.33:0/1415380869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cc3eccd480 0x55cc3ecd9380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:29.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.265+0000 7f0b74d75640 1 -- 172.21.15.33:0/1415380869 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc3ecde390 con 0x55cc3ecd7d40 2024-09-12T12:33:29.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.266+0000 7f0b74d75640 1 --2- 172.21.15.33:0/1415380869 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cc3ecd7d40 0x55cc3ecd98c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f0b68009560 tx=0x7f0b68012f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aa5cc1feb63bb03 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:33:29.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.266+0000 7f0b537fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:33:29.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.266+0000 7f0b537fe640 1 -- 172.21.15.33:0/1415380869 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b68038020 con 0x55cc3ecd7d40 2024-09-12T12:33:29.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.267+0000 7f0b78bb1740 1 -- 172.21.15.33:0/1415380869 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b5c0bc850 con 0x55cc3ecd7d40 2024-09-12T12:33:29.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.267+0000 7f0b537fe640 1 -- 172.21.15.33:0/1415380869 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f0b68011250 con 0x55cc3ecd7d40 2024-09-12T12:33:29.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.267+0000 7f0b537fe640 1 -- 172.21.15.33:0/1415380869 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0b68043050 con 0x55cc3ecd7d40 2024-09-12T12:33:29.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.268+0000 7f0b78bb1740 10 client.15993 fetch_fsmap learned FSMap version 27 2024-09-12T12:33:29.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.268+0000 7f0b78bb1740 1 -- 172.21.15.33:0/1415380869 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55cc3ed63ac0 con 0x55cc3ecd7d40 2024-09-12T12:33:29.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.268+0000 7f0b537fe640 1 -- 172.21.15.33:0/1415380869 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0b5c0bc850 con 0x55cc3ecd7d40 2024-09-12T12:33:29.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.268+0000 7f0b537fe640 1 -- 172.21.15.33:0/1415380869 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f0b6803f4b0 con 0x55cc3ecd7d40 2024-09-12T12:33:29.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.268+0000 7f0b78bb1740 10 client.15993 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:33:29.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.268+0000 7f0b78bb1740 10 client.15993 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:33:29.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.269+0000 7f0b78bb1740 20 client.15993 populate_metadata read hostname 'smithi033' 2024-09-12T12:33:29.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.269+0000 7f0b78bb1740 1 --2- 172.21.15.33:0/1415380869 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55cc3ed64180 0x55cc3ed66640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:29.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.269+0000 7f0b78bb1740 4 client.15993 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T12:33:29.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.269+0000 7f0b78bb1740 1 -- 172.21.15.33:0/1415380869 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55cc3ebb6110 con 0x55cc3ed64180 2024-09-12T12:33:29.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.274+0000 7f0b6ffff640 1 --2- 172.21.15.33:0/1415380869 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55cc3ed64180 0x55cc3ed66640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:29.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.278+0000 7f0b6ffff640 1 --2- 172.21.15.33:0/1415380869 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55cc3ed64180 0x55cc3ed66640 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=400efb622efb25e server_cookie=62b26f6dd69aeba2 in_seq=0 out_seq=0 2024-09-12T12:33:29.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.278+0000 7f0b537fe640 10 client.15993 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:33:29.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.280+0000 7f0b537fe640 1 -- 172.21.15.33:0/1415380869 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55cc3ebb6110 con 0x55cc3ed64180 2024-09-12T12:33:29.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.280+0000 7f0b537fe640 10 client.15993 handle_command_reply: tid=0 2024-09-12T12:33:29.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.282+0000 7f0b78bb1740 1 client.15993 shutdown 2024-09-12T12:33:29.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.284+0000 7f0b78bb1740 1 -- 172.21.15.33:0/1415380869 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cc3ecd7d40 msgr2=0x55cc3ecd98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:29.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.284+0000 7f0b78bb1740 1 --2- 172.21.15.33:0/1415380869 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cc3ecd7d40 0x55cc3ecd98c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f0b68009560 tx=0x7f0b68012f70 comp rx=0 tx=0).stop 2024-09-12T12:33:29.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.284+0000 7f0b78bb1740 1 -- 172.21.15.33:0/1415380869 shutdown_connections 2024-09-12T12:33:29.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.284+0000 7f0b78bb1740 1 --2- 172.21.15.33:0/1415380869 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55cc3ed64180 0x55cc3ed66640 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:29.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.284+0000 7f0b78bb1740 1 --2- 172.21.15.33:0/1415380869 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cc3ecd7d40 0x55cc3ecd98c0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:29.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.284+0000 7f0b78bb1740 1 --2- 172.21.15.33:0/1415380869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cc3eccd480 0x55cc3ecd9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:29.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.284+0000 7f0b78bb1740 1 --2- 172.21.15.33:0/1415380869 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cc3ecccb60 0x55cc3ecd8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:29.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.284+0000 7f0b78bb1740 1 -- 172.21.15.33:0/1415380869 >> 172.21.15.33:0/1415380869 conn(0x55cc3ecc90f0 msgr2=0x55cc3ecc7a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:33:29.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.284+0000 7f0b537fe640 0 client.15993 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:33:29.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.285+0000 7f0b78bb1740 1 -- 172.21.15.33:0/1415380869 shutdown_connections 2024-09-12T12:33:29.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.285+0000 7f0b78bb1740 1 -- 172.21.15.33:0/1415380869 wait complete. 2024-09-12T12:33:29.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.286+0000 7f0b78bb1740 20 client.15993 trim_cache size 0 max 16384 2024-09-12T12:33:29.288 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:33:29.288 INFO:teuthology.orchestra.run.smithi033.stdout: "return_code": 0, 2024-09-12T12:33:29.289 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_tag": "78721fba-5491-40ef-a156-f860fc3a04c9", 2024-09-12T12:33:29.289 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": "asynchronous" 2024-09-12T12:33:29.289 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:33:29.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.287+0000 7f0b767d8640 1 -- 172.21.15.33:0/2934199002 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0b540a2d90 msgr2=0x7f0b540a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:29.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.287+0000 7f0b767d8640 1 --2- 172.21.15.33:0/2934199002 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0b540a2d90 0x7f0b540a5250 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0b68005fd0 tx=0x7f0b68004a40 comp rx=0 tx=0).stop 2024-09-12T12:33:29.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.287+0000 7f0b767d8640 1 -- 172.21.15.33:0/2934199002 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b70109830 msgr2=0x7f0b701a7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:29.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.287+0000 7f0b767d8640 1 --2- 172.21.15.33:0/2934199002 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b70109830 0x7f0b701a7700 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c009830 tx=0x7f0b5c032cd0 comp rx=0 tx=0).stop 2024-09-12T12:33:29.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.288+0000 7f0b767d8640 1 -- 172.21.15.33:0/2934199002 shutdown_connections 2024-09-12T12:33:29.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.288+0000 7f0b767d8640 1 --2- 172.21.15.33:0/2934199002 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0b540a2d90 0x7f0b540a5250 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:29.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.288+0000 7f0b767d8640 1 --2- 172.21.15.33:0/2934199002 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b7011b140 0x7f0b701aba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:29.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.288+0000 7f0b767d8640 1 --2- 172.21.15.33:0/2934199002 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b70109830 0x7f0b701a7700 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:29.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.288+0000 7f0b767d8640 1 --2- 172.21.15.33:0/2934199002 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b70109450 0x7f0b701a71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:29.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.288+0000 7f0b767d8640 1 -- 172.21.15.33:0/2934199002 >> 172.21.15.33:0/2934199002 conn(0x7f0b7006e140 msgr2=0x7f0b7011c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:33:29.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.289+0000 7f0b767d8640 1 -- 172.21.15.33:0/2934199002 shutdown_connections 2024-09-12T12:33:29.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:29.291+0000 7f0b767d8640 1 -- 172.21.15.33:0/2934199002 wait complete. 2024-09-12T12:33:29.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:29 smithi033 ceph-mon[31246]: pgmap v574: 129 pgs: 129 active+clean; 10 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 40 MiB/s wr, 754 op/s 2024-09-12T12:33:29.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:29 smithi033 ceph-mon[31246]: scrub summary: active paths [/] 2024-09-12T12:33:29.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:29 smithi033 ceph-mon[31246]: scrub summary: idle+waiting paths [/] 2024-09-12T12:33:29.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:29 smithi102 ceph-mon[34799]: pgmap v574: 129 pgs: 129 active+clean; 10 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 40 MiB/s wr, 754 op/s 2024-09-12T12:33:29.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:29 smithi102 ceph-mon[34799]: scrub summary: active paths [/] 2024-09-12T12:33:29.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:29 smithi102 ceph-mon[34799]: scrub summary: idle+waiting paths [/] 2024-09-12T12:33:29.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:29 smithi043 ceph-mon[34144]: pgmap v574: 129 pgs: 129 active+clean; 10 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 40 MiB/s wr, 754 op/s 2024-09-12T12:33:29.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:29 smithi043 ceph-mon[34144]: scrub summary: active paths [/] 2024-09-12T12:33:29.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:29 smithi043 ceph-mon[34144]: scrub summary: idle+waiting paths [/] 2024-09-12T12:33:30.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:30 smithi033 ceph-mon[31246]: scrub queued for path: / 2024-09-12T12:33:30.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:30 smithi033 ceph-mon[31246]: scrub summary: idle+waiting paths [/] 2024-09-12T12:33:30.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:30 smithi033 ceph-mon[31246]: scrub summary: active paths [/] 2024-09-12T12:33:30.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:30 smithi033 ceph-mon[31246]: scrub summary: idle+waiting paths [/] 2024-09-12T12:33:30.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:30 smithi102 ceph-mon[34799]: scrub queued for path: / 2024-09-12T12:33:30.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:30 smithi102 ceph-mon[34799]: scrub summary: idle+waiting paths [/] 2024-09-12T12:33:30.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:30 smithi102 ceph-mon[34799]: scrub summary: active paths [/] 2024-09-12T12:33:30.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:30 smithi102 ceph-mon[34799]: scrub summary: idle+waiting paths [/] 2024-09-12T12:33:30.820 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T12:33:30.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:30 smithi043 ceph-mon[34144]: scrub queued for path: / 2024-09-12T12:33:30.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:30 smithi043 ceph-mon[34144]: scrub summary: idle+waiting paths [/] 2024-09-12T12:33:30.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:30 smithi043 ceph-mon[34144]: scrub summary: active paths [/] 2024-09-12T12:33:30.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:30 smithi043 ceph-mon[34144]: scrub summary: idle+waiting paths [/] 2024-09-12T12:33:31.498 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:33:31.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:31 smithi102 ceph-mon[34799]: pgmap v575: 129 pgs: 129 active+clean; 10 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 33 MiB/s wr, 627 op/s 2024-09-12T12:33:31.656 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:31 smithi033 ceph-mon[31246]: pgmap v575: 129 pgs: 129 active+clean; 10 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 33 MiB/s wr, 627 op/s 2024-09-12T12:33:31.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:31 smithi043 ceph-mon[34144]: pgmap v575: 129 pgs: 129 active+clean; 10 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 33 MiB/s wr, 627 op/s 2024-09-12T12:33:33.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.425+0000 7fedafda3640 1 -- 172.21.15.33:0/2531772243 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feda8109830 msgr2=0x7feda8109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:33.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.425+0000 7fedafda3640 1 --2- 172.21.15.33:0/2531772243 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feda8109830 0x7feda8109c90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7feda001acb0 tx=0x7feda003b920 comp rx=0 tx=0).stop 2024-09-12T12:33:33.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.425+0000 7fedafda3640 1 -- 172.21.15.33:0/2531772243 shutdown_connections 2024-09-12T12:33:33.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.425+0000 7fedafda3640 1 --2- 172.21.15.33:0/2531772243 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feda811b140 0x7feda811d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:33.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.425+0000 7fedafda3640 1 --2- 172.21.15.33:0/2531772243 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feda8109830 0x7feda8109c90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:33.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.425+0000 7fedafda3640 1 --2- 172.21.15.33:0/2531772243 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feda8109450 0x7feda8110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:33.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.425+0000 7fedafda3640 1 -- 172.21.15.33:0/2531772243 >> 172.21.15.33:0/2531772243 conn(0x7feda806e140 msgr2=0x7feda806e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:33:33.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.425+0000 7fedafda3640 1 -- 172.21.15.33:0/2531772243 shutdown_connections 2024-09-12T12:33:33.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.425+0000 7fedafda3640 1 -- 172.21.15.33:0/2531772243 wait complete. 2024-09-12T12:33:33.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.426+0000 7fedafda3640 1 Processor -- start 2024-09-12T12:33:33.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.426+0000 7fedafda3640 1 -- start start 2024-09-12T12:33:33.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.426+0000 7fedafda3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feda8109450 0x7feda80757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:33.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.426+0000 7fedafda3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feda811b140 0x7feda8075d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:33.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.426+0000 7fedafda3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feda8116590 0x7feda8116a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:33.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.426+0000 7fedafda3640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7feda81131d0 con 0x7feda8109450 2024-09-12T12:33:33.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.426+0000 7fedafda3640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7feda8113050 con 0x7feda8116590 2024-09-12T12:33:33.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.426+0000 7fedafda3640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7feda8113350 con 0x7feda811b140 2024-09-12T12:33:33.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.428+0000 7fedadb3f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feda8109450 0x7feda80757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:33.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.428+0000 7fedadb3f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feda8109450 0x7feda80757e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52104/0 (socket says 172.21.15.33:52104) 2024-09-12T12:33:33.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.428+0000 7fedadb3f640 1 -- 172.21.15.33:0/4048535639 learned_addr learned my addr 172.21.15.33:0/4048535639 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:33:33.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.428+0000 7fedad33e640 1 --2- 172.21.15.33:0/4048535639 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feda811b140 0x7feda8075d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:33.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.428+0000 7fedae340640 1 --2- 172.21.15.33:0/4048535639 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feda8116590 0x7feda8116a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:33.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.432+0000 7fedad33e640 1 -- 172.21.15.33:0/4048535639 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feda8116590 msgr2=0x7feda8116a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:33.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.432+0000 7fedad33e640 1 --2- 172.21.15.33:0/4048535639 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feda8116590 0x7feda8116a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:33.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.432+0000 7fedad33e640 1 -- 172.21.15.33:0/4048535639 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feda8109450 msgr2=0x7feda80757e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:33.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.432+0000 7fedad33e640 1 --2- 172.21.15.33:0/4048535639 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feda8109450 0x7feda80757e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:33.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.432+0000 7fedad33e640 1 -- 172.21.15.33:0/4048535639 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda81172d0 con 0x7feda811b140 2024-09-12T12:33:33.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.437+0000 7fedad33e640 1 --2- 172.21.15.33:0/4048535639 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feda811b140 0x7feda8075d20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7feda0000f80 tx=0x7feda0041850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:33:33.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.437+0000 7fed9effd640 1 -- 172.21.15.33:0/4048535639 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda0045040 con 0x7feda811b140 2024-09-12T12:33:33.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.437+0000 7fedafda3640 1 -- 172.21.15.33:0/4048535639 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feda807c590 con 0x7feda811b140 2024-09-12T12:33:33.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.437+0000 7fedafda3640 1 -- 172.21.15.33:0/4048535639 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feda807ca70 con 0x7feda811b140 2024-09-12T12:33:33.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.437+0000 7fed9effd640 1 -- 172.21.15.33:0/4048535639 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feda0041bd0 con 0x7feda811b140 2024-09-12T12:33:33.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.437+0000 7fed9effd640 1 -- 172.21.15.33:0/4048535639 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda0049610 con 0x7feda811b140 2024-09-12T12:33:33.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.441+0000 7fed9effd640 1 -- 172.21.15.33:0/4048535639 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7feda0048020 con 0x7feda811b140 2024-09-12T12:33:33.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.442+0000 7fed9effd640 1 --2- 172.21.15.33:0/4048535639 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fed940a2d90 0x7fed940a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:33.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.443+0000 7fed9effd640 1 -- 172.21.15.33:0/4048535639 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7feda01017a0 con 0x7feda811b140 2024-09-12T12:33:33.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.443+0000 7fedadb3f640 1 --2- 172.21.15.33:0/4048535639 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fed940a2d90 0x7fed940a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:33.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.446+0000 7fedb217c740 1 Processor -- start 2024-09-12T12:33:33.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.447+0000 7fedb217c740 1 -- start start 2024-09-12T12:33:33.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.447+0000 7fedb217c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56081cc36220 0x56081cc36600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:33.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.447+0000 7fedb217c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56081cc36b40 0x56081cc63150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:33.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.447+0000 7fedb217c740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56081cc63690 0x56081cc65a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:33.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.447+0000 7fedb217c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56081cb9c2e0 con 0x56081cc36220 2024-09-12T12:33:33.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.447+0000 7fedb217c740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56081cb43ce0 con 0x56081cc36b40 2024-09-12T12:33:33.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.447+0000 7fedb217c740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56081cb982a0 con 0x56081cc63690 2024-09-12T12:33:33.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.447+0000 7fedadb3f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56081cc36220 0x56081cc36600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:33.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.447+0000 7fedadb3f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56081cc36220 0x56081cc36600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52118/0 (socket says 172.21.15.33:52118) 2024-09-12T12:33:33.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.447+0000 7fedadb3f640 1 -- 172.21.15.33:0/189258908 learned_addr learned my addr 172.21.15.33:0/189258908 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:33:33.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.448+0000 7fedad33e640 1 --2- 172.21.15.33:0/189258908 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56081cc36b40 0x56081cc63150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:33.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.451+0000 7fedadb3f640 1 --2- 172.21.15.33:0/4048535639 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fed940a2d90 0x7fed940a5250 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7feda404d9c0 tx=0x7feda404d1d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:33:33.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.451+0000 7fedae340640 1 --2- 172.21.15.33:0/189258908 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56081cc63690 0x56081cc65a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:33.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.452+0000 7fedadb3f640 1 -- 172.21.15.33:0/189258908 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56081cc63690 msgr2=0x56081cc65a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:33.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.452+0000 7fedadb3f640 1 --2- 172.21.15.33:0/189258908 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56081cc63690 0x56081cc65a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:33.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.452+0000 7fedadb3f640 1 -- 172.21.15.33:0/189258908 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56081cc36b40 msgr2=0x56081cc63150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:33.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.452+0000 7fedadb3f640 1 --2- 172.21.15.33:0/189258908 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56081cc36b40 0x56081cc63150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:33.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.452+0000 7fedadb3f640 1 -- 172.21.15.33:0/189258908 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56081cb28440 con 0x56081cc36220 2024-09-12T12:33:33.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.453+0000 7fedadb3f640 1 --2- 172.21.15.33:0/189258908 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56081cc36220 0x56081cc36600 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7feda4052a80 tx=0x7feda4055000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56c12f64ef19c1c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:33:33.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.454+0000 7fed93fff640 1 -- 172.21.15.33:0/189258908 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda40aa070 con 0x56081cc36220 2024-09-12T12:33:33.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.454+0000 7fed93fff640 1 -- 172.21.15.33:0/189258908 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feda405c070 con 0x56081cc36220 2024-09-12T12:33:33.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.454+0000 7fed93fff640 1 -- 172.21.15.33:0/189258908 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda4058650 con 0x56081cc36220 2024-09-12T12:33:33.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.455+0000 7fedb217c740 1 -- 172.21.15.33:0/189258908 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56081cc36220 msgr2=0x56081cc36600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:33.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.455+0000 7fedb217c740 1 --2- 172.21.15.33:0/189258908 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56081cc36220 0x56081cc36600 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7feda4052a80 tx=0x7feda4055000 comp rx=0 tx=0).stop 2024-09-12T12:33:33.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.456+0000 7fedb217c740 1 -- 172.21.15.33:0/189258908 shutdown_connections 2024-09-12T12:33:33.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.456+0000 7fedb217c740 1 --2- 172.21.15.33:0/189258908 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56081cc63690 0x56081cc65a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:33.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.456+0000 7fedb217c740 1 --2- 172.21.15.33:0/189258908 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56081cc36b40 0x56081cc63150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:33.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.456+0000 7fedb217c740 1 --2- 172.21.15.33:0/189258908 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56081cc36220 0x56081cc36600 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:33.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.456+0000 7fedb217c740 1 -- 172.21.15.33:0/189258908 >> 172.21.15.33:0/189258908 conn(0x56081cc32a30 msgr2=0x56081cc32e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:33:33.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.458+0000 7fedb217c740 1 -- 172.21.15.33:0/189258908 shutdown_connections 2024-09-12T12:33:33.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.462+0000 7fedb217c740 1 -- 172.21.15.33:0/189258908 wait complete. 2024-09-12T12:33:33.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.462+0000 7fedb217c740 1 -- start start 2024-09-12T12:33:33.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.462+0000 7fedb217c740 1 Processor -- start 2024-09-12T12:33:33.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.466+0000 7fedb217c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56081cc36220 0x56081cc435a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:33.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.466+0000 7fedb217c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56081cc36b40 0x56081cc43ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:33.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.466+0000 7fedb217c740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56081cc63690 0x56081cc3e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:33.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.466+0000 7fedb217c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56081cc39320 con 0x56081cc36b40 2024-09-12T12:33:33.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.467+0000 7fedb217c740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56081cb57050 con 0x56081cc36220 2024-09-12T12:33:33.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.467+0000 7fedb217c740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56081cc394a0 con 0x56081cc63690 2024-09-12T12:33:33.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.467+0000 7fedb217c740 10 client.0 _ll_register_callbacks cb 0x56081cb97160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:33:33.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.468+0000 7fedadb3f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56081cc36220 0x56081cc435a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:33.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.468+0000 7fedadb3f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56081cc36220 0x56081cc435a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:44922/0 (socket says 172.21.15.33:44922) 2024-09-12T12:33:33.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.468+0000 7fedadb3f640 1 -- 172.21.15.33:0/3010803929 learned_addr learned my addr 172.21.15.33:0/3010803929 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:33:33.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.468+0000 7fedae340640 1 --2- 172.21.15.33:0/3010803929 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56081cc63690 0x56081cc3e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:33.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.470+0000 7fedad33e640 1 --2- 172.21.15.33:0/3010803929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56081cc36b40 0x56081cc43ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:33.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.471+0000 7fedae340640 1 -- 172.21.15.33:0/3010803929 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56081cc36220 msgr2=0x56081cc435a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:33.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.471+0000 7fedae340640 1 --2- 172.21.15.33:0/3010803929 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56081cc36220 0x56081cc435a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:33.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.471+0000 7fedae340640 1 -- 172.21.15.33:0/3010803929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56081cc36b40 msgr2=0x56081cc43ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:33.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.471+0000 7fedae340640 1 --2- 172.21.15.33:0/3010803929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56081cc36b40 0x56081cc43ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:33.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.471+0000 7fedae340640 1 -- 172.21.15.33:0/3010803929 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56081c90d3c0 con 0x56081cc63690 2024-09-12T12:33:33.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.471+0000 7fedae340640 1 --2- 172.21.15.33:0/3010803929 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56081cc63690 0x56081cc3e8e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fed980134e0 tx=0x7fed980139a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dec2987278461d95 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:33:33.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.471+0000 7fed917fa640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:33:33.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.472+0000 7fed917fa640 1 -- 172.21.15.33:0/3010803929 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed98004220 con 0x56081cc63690 2024-09-12T12:33:33.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.472+0000 7fed917fa640 1 -- 172.21.15.33:0/3010803929 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fed980043c0 con 0x56081cc63690 2024-09-12T12:33:33.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.472+0000 7fedb217c740 1 -- 172.21.15.33:0/3010803929 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feda405c070 con 0x56081cc63690 2024-09-12T12:33:33.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.474+0000 7fed917fa640 1 -- 172.21.15.33:0/3010803929 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fed98005020 con 0x56081cc63690 2024-09-12T12:33:33.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.474+0000 7fedb217c740 10 client.25792 fetch_fsmap learned FSMap version 27 2024-09-12T12:33:33.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.474+0000 7fedb217c740 1 -- 172.21.15.33:0/3010803929 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56081cc4d370 con 0x56081cc63690 2024-09-12T12:33:33.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.475+0000 7fed917fa640 1 -- 172.21.15.33:0/3010803929 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feda405c070 con 0x56081cc63690 2024-09-12T12:33:33.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.475+0000 7fed917fa640 1 -- 172.21.15.33:0/3010803929 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fed98011770 con 0x56081cc63690 2024-09-12T12:33:33.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.475+0000 7fedb217c740 10 client.25792 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:33:33.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.475+0000 7fedb217c740 10 client.25792 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:33:33.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.475+0000 7fedb217c740 20 client.25792 populate_metadata read hostname 'smithi033' 2024-09-12T12:33:33.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.475+0000 7fedb217c740 1 --2- 172.21.15.33:0/3010803929 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x56081cc4ed00 0x56081cc511a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:33.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.475+0000 7fedb217c740 4 client.25792 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:33:33.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.475+0000 7fedb217c740 1 -- 172.21.15.33:0/3010803929 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56081cba9850 con 0x56081cc4ed00 2024-09-12T12:33:33.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.478+0000 7fedadb3f640 1 --2- 172.21.15.33:0/3010803929 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x56081cc4ed00 0x56081cc511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:33.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.480+0000 7fedadb3f640 1 --2- 172.21.15.33:0/3010803929 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x56081cc4ed00 0x56081cc511a0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cb3a62bf9f74e48 server_cookie=3fc329e54cdb518b in_seq=0 out_seq=0 2024-09-12T12:33:33.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.480+0000 7fed917fa640 10 client.25792 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:33:33.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.481+0000 7fed917fa640 1 -- 172.21.15.33:0/3010803929 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56081cba9850 con 0x56081cc4ed00 2024-09-12T12:33:33.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.481+0000 7fed917fa640 10 client.25792 handle_command_reply: tid=0 2024-09-12T12:33:33.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.481+0000 7fedb217c740 1 client.25792 shutdown 2024-09-12T12:33:33.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.482+0000 7fedb217c740 1 -- 172.21.15.33:0/3010803929 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56081cc63690 msgr2=0x56081cc3e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:33.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.482+0000 7fedb217c740 1 --2- 172.21.15.33:0/3010803929 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56081cc63690 0x56081cc3e8e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fed980134e0 tx=0x7fed980139a0 comp rx=0 tx=0).stop 2024-09-12T12:33:33.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.482+0000 7fedb217c740 1 -- 172.21.15.33:0/3010803929 shutdown_connections 2024-09-12T12:33:33.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.482+0000 7fedb217c740 1 --2- 172.21.15.33:0/3010803929 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x56081cc4ed00 0x56081cc511a0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:33.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.482+0000 7fedb217c740 1 --2- 172.21.15.33:0/3010803929 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56081cc63690 0x56081cc3e8e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:33.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.482+0000 7fedb217c740 1 --2- 172.21.15.33:0/3010803929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56081cc36b40 0x56081cc43ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:33.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.482+0000 7fedb217c740 1 --2- 172.21.15.33:0/3010803929 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56081cc36220 0x56081cc435a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:33.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.482+0000 7fed917fa640 0 client.25792 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:33:33.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.483+0000 7fedb217c740 1 -- 172.21.15.33:0/3010803929 >> 172.21.15.33:0/3010803929 conn(0x56081cc32a30 msgr2=0x56081cc38720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:33:33.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.486+0000 7fedb217c740 1 -- 172.21.15.33:0/3010803929 shutdown_connections 2024-09-12T12:33:33.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.486+0000 7fedb217c740 1 -- 172.21.15.33:0/3010803929 wait complete. 2024-09-12T12:33:33.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.487+0000 7fedb217c740 20 client.25792 trim_cache size 0 max 16384 2024-09-12T12:33:33.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.528+0000 7fedb217c740 1 Processor -- start 2024-09-12T12:33:33.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.528+0000 7fedb217c740 1 -- start start 2024-09-12T12:33:33.529 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:33 smithi033 ceph-mon[31246]: pgmap v576: 129 pgs: 129 active+clean; 10 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 33 MiB/s wr, 621 op/s 2024-09-12T12:33:33.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.528+0000 7fedb217c740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56081cc36220 0x56081cc3e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:33.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.529+0000 7fedb217c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56081cc36b40 0x56081cc56ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:33.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.529+0000 7fedadb3f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56081cc36220 0x56081cc3e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:33.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.529+0000 7fedadb3f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56081cc36220 0x56081cc3e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:49374/0 (socket says 172.21.15.33:49374) 2024-09-12T12:33:33.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.530+0000 7fedadb3f640 1 -- 172.21.15.33:0/2753210893 learned_addr learned my addr 172.21.15.33:0/2753210893 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:33:33.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.530+0000 7fedad33e640 1 --2- 172.21.15.33:0/2753210893 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56081cc36b40 0x56081cc56ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:33.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.530+0000 7fedb217c740 1 --2- 172.21.15.33:0/2753210893 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56081cc63690 0x56081cc56ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:33.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.531+0000 7fedb217c740 1 -- 172.21.15.33:0/2753210893 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fed8c012530 con 0x56081cc36b40 2024-09-12T12:33:33.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.531+0000 7fedae340640 1 --2- 172.21.15.33:0/2753210893 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56081cc63690 0x56081cc56ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:33.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.531+0000 7fedb217c740 1 -- 172.21.15.33:0/2753210893 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fed8c00fe00 con 0x56081cc63690 2024-09-12T12:33:33.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.531+0000 7fedb217c740 1 -- 172.21.15.33:0/2753210893 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fed8c00dc50 con 0x56081cc36220 2024-09-12T12:33:33.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.532+0000 7fedad33e640 1 -- 172.21.15.33:0/2753210893 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56081cc36220 msgr2=0x56081cc3e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:33.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.532+0000 7fedad33e640 1 --2- 172.21.15.33:0/2753210893 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56081cc36220 0x56081cc3e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:33.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.532+0000 7fedad33e640 1 -- 172.21.15.33:0/2753210893 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56081cc63690 msgr2=0x56081cc56ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:33.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.532+0000 7fedad33e640 1 --2- 172.21.15.33:0/2753210893 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56081cc63690 0x56081cc56ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:33.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.532+0000 7fedad33e640 1 -- 172.21.15.33:0/2753210893 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56081cc3d870 con 0x56081cc36b40 2024-09-12T12:33:33.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.533+0000 7fedad33e640 1 --2- 172.21.15.33:0/2753210893 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56081cc36b40 0x56081cc56ab0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7feda00cd910 tx=0x7feda00cd630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=959d1d26a55785a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:33:33.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.538+0000 7fed937fe640 1 -- 172.21.15.33:0/2753210893 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda00cdc10 con 0x56081cc36b40 2024-09-12T12:33:33.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.538+0000 7fed937fe640 1 -- 172.21.15.33:0/2753210893 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feda004ae50 con 0x56081cc36b40 2024-09-12T12:33:33.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.539+0000 7fedb217c740 1 -- 172.21.15.33:0/2753210893 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56081cc36b40 msgr2=0x56081cc56ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:33.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.539+0000 7fedb217c740 1 --2- 172.21.15.33:0/2753210893 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56081cc36b40 0x56081cc56ab0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7feda00cd910 tx=0x7feda00cd630 comp rx=0 tx=0).stop 2024-09-12T12:33:33.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.541+0000 7fedb217c740 1 -- 172.21.15.33:0/2753210893 shutdown_connections 2024-09-12T12:33:33.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.541+0000 7fedb217c740 1 --2- 172.21.15.33:0/2753210893 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56081cc63690 0x56081cc56ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:33.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.541+0000 7fedb217c740 1 --2- 172.21.15.33:0/2753210893 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56081cc36b40 0x56081cc56ab0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:33.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.541+0000 7fedb217c740 1 --2- 172.21.15.33:0/2753210893 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56081cc36220 0x56081cc3e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:33.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.541+0000 7fedb217c740 1 -- 172.21.15.33:0/2753210893 >> 172.21.15.33:0/2753210893 conn(0x56081cc32a30 msgr2=0x56081cc3de00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:33:33.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.541+0000 7fedb217c740 1 -- 172.21.15.33:0/2753210893 shutdown_connections 2024-09-12T12:33:33.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.541+0000 7fedb217c740 1 -- 172.21.15.33:0/2753210893 wait complete. 2024-09-12T12:33:33.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.541+0000 7fedb217c740 1 -- start start 2024-09-12T12:33:33.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.541+0000 7fedb217c740 1 Processor -- start 2024-09-12T12:33:33.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.542+0000 7fedb217c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56081cc36220 0x56081cc5e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:33.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.542+0000 7fedb217c740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56081cc36b40 0x56081cc5eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:33.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.542+0000 7fedb217c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56081cc63690 0x56081cc5f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:33.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.542+0000 7fedb217c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fed8c00e2c0 con 0x56081cc36220 2024-09-12T12:33:33.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.542+0000 7fedb217c740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fed8c00f730 con 0x56081cc63690 2024-09-12T12:33:33.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.542+0000 7fedb217c740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fed8c00e990 con 0x56081cc36b40 2024-09-12T12:33:33.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.542+0000 7fedb217c740 10 client.0 _ll_register_callbacks cb 0x7feda8110870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:33:33.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.543+0000 7fedae340640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56081cc63690 0x56081cc5f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:33.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.543+0000 7fedae340640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56081cc63690 0x56081cc5f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:44926/0 (socket says 172.21.15.33:44926) 2024-09-12T12:33:33.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.543+0000 7fedae340640 1 -- 172.21.15.33:0/639232102 learned_addr learned my addr 172.21.15.33:0/639232102 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:33:33.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.543+0000 7fedae340640 1 -- 172.21.15.33:0/639232102 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56081cc36b40 msgr2=0x56081cc5eb40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:33:33.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.544+0000 7fedae340640 1 --2- 172.21.15.33:0/639232102 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56081cc36b40 0x56081cc5eb40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:33.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.544+0000 7fedae340640 1 -- 172.21.15.33:0/639232102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56081cc36220 msgr2=0x56081cc5e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:33:33.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.544+0000 7fedae340640 1 --2- 172.21.15.33:0/639232102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56081cc36220 0x56081cc5e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:33.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.544+0000 7fedae340640 1 -- 172.21.15.33:0/639232102 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56081ccbb3b0 con 0x56081cc63690 2024-09-12T12:33:33.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.544+0000 7fedae340640 1 --2- 172.21.15.33:0/639232102 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56081cc63690 0x56081cc5f080 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fed98011b90 tx=0x7fed98011fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d444c5168cd2a53 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:33:33.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.545+0000 7fed917fa640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:33:33.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.545+0000 7fed917fa640 1 -- 172.21.15.33:0/639232102 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed98003830 con 0x56081cc63690 2024-09-12T12:33:33.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.545+0000 7fedb217c740 1 -- 172.21.15.33:0/639232102 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56081cba3d60 con 0x56081cc63690 2024-09-12T12:33:33.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.545+0000 7fed917fa640 1 -- 172.21.15.33:0/639232102 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fed980039d0 con 0x56081cc63690 2024-09-12T12:33:33.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.548+0000 7fed917fa640 1 -- 172.21.15.33:0/639232102 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fed98003bd0 con 0x56081cc63690 2024-09-12T12:33:33.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.548+0000 7fedb217c740 10 client.25715 fetch_fsmap learned FSMap version 27 2024-09-12T12:33:33.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.548+0000 7fedb217c740 1 -- 172.21.15.33:0/639232102 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56081ccbc790 con 0x56081cc63690 2024-09-12T12:33:33.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.550+0000 7fed917fa640 1 -- 172.21.15.33:0/639232102 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x56081cba3d60 con 0x56081cc63690 2024-09-12T12:33:33.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.550+0000 7fed917fa640 1 -- 172.21.15.33:0/639232102 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fed98012a10 con 0x56081cc63690 2024-09-12T12:33:33.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.550+0000 7fedb217c740 10 client.25715 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:33:33.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.550+0000 7fedb217c740 10 client.25715 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:33:33.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.550+0000 7fedb217c740 20 client.25715 populate_metadata read hostname 'smithi033' 2024-09-12T12:33:33.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.550+0000 7fedb217c740 1 --2- 172.21.15.33:0/639232102 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x56081ccbcf10 0x56081ccbf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:33:33.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.550+0000 7fedb217c740 4 client.25715 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:33:33.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.550+0000 7fedb217c740 1 -- 172.21.15.33:0/639232102 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56081cb20210 con 0x56081ccbcf10 2024-09-12T12:33:33.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.550+0000 7fedadb3f640 1 --2- 172.21.15.33:0/639232102 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x56081ccbcf10 0x56081ccbf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:33:33.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.551+0000 7fed917fa640 10 client.25715 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:33:33.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.551+0000 7fedadb3f640 1 --2- 172.21.15.33:0/639232102 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x56081ccbcf10 0x56081ccbf3b0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bff6ef9159fb86a8 server_cookie=4525feecee704509 in_seq=0 out_seq=0 2024-09-12T12:33:33.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.551+0000 7fed917fa640 1 -- 172.21.15.33:0/639232102 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x56081cb20210 con 0x56081ccbcf10 2024-09-12T12:33:33.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.551+0000 7fed917fa640 10 client.25715 handle_command_reply: tid=0 2024-09-12T12:33:33.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.551+0000 7fedb217c740 1 client.25715 shutdown 2024-09-12T12:33:33.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.553+0000 7fedb217c740 1 -- 172.21.15.33:0/639232102 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56081cc63690 msgr2=0x56081cc5f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:33.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.553+0000 7fedb217c740 1 --2- 172.21.15.33:0/639232102 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56081cc63690 0x56081cc5f080 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fed98011b90 tx=0x7fed98011fd0 comp rx=0 tx=0).stop 2024-09-12T12:33:33.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.555+0000 7fedb217c740 1 -- 172.21.15.33:0/639232102 shutdown_connections 2024-09-12T12:33:33.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.555+0000 7fedb217c740 1 --2- 172.21.15.33:0/639232102 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x56081ccbcf10 0x56081ccbf3b0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:33.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.555+0000 7fedb217c740 1 --2- 172.21.15.33:0/639232102 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56081cc63690 0x56081cc5f080 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:33.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.555+0000 7fedb217c740 1 --2- 172.21.15.33:0/639232102 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56081cc36b40 0x56081cc5eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:33.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.555+0000 7fedb217c740 1 --2- 172.21.15.33:0/639232102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56081cc36220 0x56081cc5e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:33.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.555+0000 7fedb217c740 1 -- 172.21.15.33:0/639232102 >> 172.21.15.33:0/639232102 conn(0x56081cc32a30 msgr2=0x56081cc31b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:33:33.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.556+0000 7fed917fa640 0 client.25715 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:33:33.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.559+0000 7fedb217c740 1 -- 172.21.15.33:0/639232102 shutdown_connections 2024-09-12T12:33:33.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.561+0000 7fedb217c740 1 -- 172.21.15.33:0/639232102 wait complete. 2024-09-12T12:33:33.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.563+0000 7fedb217c740 20 client.25715 trim_cache size 0 max 16384 2024-09-12T12:33:33.568 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:33:33.568 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T12:33:33.569 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": { 2024-09-12T12:33:33.569 INFO:teuthology.orchestra.run.smithi033.stdout: "78721fba-5491-40ef-a156-f860fc3a04c9": { 2024-09-12T12:33:33.569 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-09-12T12:33:33.569 INFO:teuthology.orchestra.run.smithi033.stdout: "tag": "78721fba-5491-40ef-a156-f860fc3a04c9", 2024-09-12T12:33:33.569 INFO:teuthology.orchestra.run.smithi033.stdout: "options": "recursive,force" 2024-09-12T12:33:33.569 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:33:33.569 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:33:33.569 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:33:33.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.571+0000 7fedafda3640 1 -- 172.21.15.33:0/4048535639 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fed940a2d90 msgr2=0x7fed940a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:33.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.571+0000 7fedafda3640 1 --2- 172.21.15.33:0/4048535639 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fed940a2d90 0x7fed940a5250 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7feda404d9c0 tx=0x7feda404d1d0 comp rx=0 tx=0).stop 2024-09-12T12:33:33.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.571+0000 7fedafda3640 1 -- 172.21.15.33:0/4048535639 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feda811b140 msgr2=0x7feda8075d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:33:33.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.571+0000 7fedafda3640 1 --2- 172.21.15.33:0/4048535639 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feda811b140 0x7feda8075d20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7feda0000f80 tx=0x7feda0041850 comp rx=0 tx=0).stop 2024-09-12T12:33:33.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.571+0000 7fedafda3640 1 -- 172.21.15.33:0/4048535639 shutdown_connections 2024-09-12T12:33:33.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.571+0000 7fedafda3640 1 --2- 172.21.15.33:0/4048535639 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fed940a2d90 0x7fed940a5250 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:33.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.571+0000 7fedafda3640 1 --2- 172.21.15.33:0/4048535639 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feda8116590 0x7feda8116a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:33.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.571+0000 7fedafda3640 1 --2- 172.21.15.33:0/4048535639 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feda811b140 0x7feda8075d20 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:33.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.571+0000 7fedafda3640 1 --2- 172.21.15.33:0/4048535639 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feda8109450 0x7feda80757e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:33:33.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.571+0000 7fedafda3640 1 -- 172.21.15.33:0/4048535639 >> 172.21.15.33:0/4048535639 conn(0x7feda806e140 msgr2=0x7feda80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:33:33.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.572+0000 7fedafda3640 1 -- 172.21.15.33:0/4048535639 shutdown_connections 2024-09-12T12:33:33.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:33:33.572+0000 7fedafda3640 1 -- 172.21.15.33:0/4048535639 wait complete. 2024-09-12T12:33:33.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:33 smithi102 ceph-mon[34799]: pgmap v576: 129 pgs: 129 active+clean; 10 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 33 MiB/s wr, 621 op/s 2024-09-12T12:33:33.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:33 smithi043 ceph-mon[34144]: pgmap v576: 129 pgs: 129 active+clean; 10 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 33 MiB/s wr, 621 op/s 2024-09-12T12:33:34.524 INFO:tasks.cephfs.filesystem:scrub status for tag:78721fba-5491-40ef-a156-f860fc3a04c9 - {'path': '/', 'tag': '78721fba-5491-40ef-a156-f860fc3a04c9', 'options': 'recursive,force'} 2024-09-12T12:33:35.730 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:35 smithi033 ceph-mon[31246]: pgmap v577: 129 pgs: 129 active+clean; 10 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 39 MiB/s wr, 743 op/s 2024-09-12T12:33:35.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:35 smithi043 ceph-mon[34144]: pgmap v577: 129 pgs: 129 active+clean; 10 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 39 MiB/s wr, 743 op/s 2024-09-12T12:33:35.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:35 smithi102 ceph-mon[34799]: pgmap v577: 129 pgs: 129 active+clean; 10 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 39 MiB/s wr, 743 op/s 2024-09-12T12:33:37.667 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:37 smithi043 ceph-mon[34144]: pgmap v578: 129 pgs: 129 active+clean; 10 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 31 MiB/s wr, 588 op/s 2024-09-12T12:33:37.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:37 smithi033 ceph-mon[31246]: pgmap v578: 129 pgs: 129 active+clean; 10 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 31 MiB/s wr, 588 op/s 2024-09-12T12:33:37.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:37 smithi102 ceph-mon[34799]: pgmap v578: 129 pgs: 129 active+clean; 10 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 31 MiB/s wr, 588 op/s 2024-09-12T12:33:38.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:38 smithi033 ceph-mon[31246]: scrub summary: idle 2024-09-12T12:33:38.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:38 smithi033 ceph-mon[31246]: scrub summary: idle 2024-09-12T12:33:38.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:38 smithi043 ceph-mon[34144]: scrub summary: idle 2024-09-12T12:33:38.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:38 smithi043 ceph-mon[34144]: scrub summary: idle 2024-09-12T12:33:38.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:38 smithi102 ceph-mon[34799]: scrub summary: idle 2024-09-12T12:33:38.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:38 smithi102 ceph-mon[34799]: scrub summary: idle 2024-09-12T12:33:39.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:39 smithi033 ceph-mon[31246]: pgmap v579: 129 pgs: 129 active+clean; 10 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 41 MiB/s wr, 776 op/s 2024-09-12T12:33:39.797 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:39 smithi102 ceph-mon[34799]: pgmap v579: 129 pgs: 129 active+clean; 10 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 41 MiB/s wr, 776 op/s 2024-09-12T12:33:39.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:39 smithi043 ceph-mon[34144]: pgmap v579: 129 pgs: 129 active+clean; 10 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 41 MiB/s wr, 776 op/s 2024-09-12T12:33:41.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:41 smithi033 ceph-mon[31246]: pgmap v580: 129 pgs: 129 active+clean; 10 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 32 MiB/s wr, 616 op/s 2024-09-12T12:33:41.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:41 smithi043 ceph-mon[34144]: pgmap v580: 129 pgs: 129 active+clean; 10 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 32 MiB/s wr, 616 op/s 2024-09-12T12:33:41.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:41 smithi102 ceph-mon[34799]: pgmap v580: 129 pgs: 129 active+clean; 10 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 32 MiB/s wr, 616 op/s 2024-09-12T12:33:43.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:43 smithi033 ceph-mon[31246]: pgmap v581: 129 pgs: 129 active+clean; 10 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 32 MiB/s wr, 612 op/s 2024-09-12T12:33:43.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:43 smithi043 ceph-mon[34144]: pgmap v581: 129 pgs: 129 active+clean; 10 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 32 MiB/s wr, 612 op/s 2024-09-12T12:33:43.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:43 smithi102 ceph-mon[34799]: pgmap v581: 129 pgs: 129 active+clean; 10 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 32 MiB/s wr, 612 op/s 2024-09-12T12:33:45.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:45 smithi033 ceph-mon[31246]: pgmap v582: 129 pgs: 129 active+clean; 10 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 39 MiB/s wr, 754 op/s 2024-09-12T12:33:45.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:45 smithi043 ceph-mon[34144]: pgmap v582: 129 pgs: 129 active+clean; 10 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 39 MiB/s wr, 754 op/s 2024-09-12T12:33:45.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:45 smithi102 ceph-mon[34799]: pgmap v582: 129 pgs: 129 active+clean; 10 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 39 MiB/s wr, 754 op/s 2024-09-12T12:33:47.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:47 smithi033 ceph-mon[31246]: pgmap v583: 129 pgs: 129 active+clean; 10 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 32 MiB/s wr, 613 op/s 2024-09-12T12:33:47.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:47 smithi043 ceph-mon[34144]: pgmap v583: 129 pgs: 129 active+clean; 10 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 32 MiB/s wr, 613 op/s 2024-09-12T12:33:47.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:47 smithi102 ceph-mon[34799]: pgmap v583: 129 pgs: 129 active+clean; 10 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 32 MiB/s wr, 613 op/s 2024-09-12T12:33:49.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:49 smithi033 ceph-mon[31246]: pgmap v584: 129 pgs: 129 active+clean; 10 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 41 MiB/s wr, 790 op/s 2024-09-12T12:33:49.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:49 smithi043 ceph-mon[34144]: pgmap v584: 129 pgs: 129 active+clean; 10 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 41 MiB/s wr, 790 op/s 2024-09-12T12:33:49.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:49 smithi102 ceph-mon[34799]: pgmap v584: 129 pgs: 129 active+clean; 10 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 41 MiB/s wr, 790 op/s 2024-09-12T12:33:51.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:51 smithi033 ceph-mon[31246]: pgmap v585: 129 pgs: 129 active+clean; 10 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 32 MiB/s wr, 633 op/s 2024-09-12T12:33:51.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:51 smithi043 ceph-mon[34144]: pgmap v585: 129 pgs: 129 active+clean; 10 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 32 MiB/s wr, 633 op/s 2024-09-12T12:33:51.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:51 smithi102 ceph-mon[34799]: pgmap v585: 129 pgs: 129 active+clean; 10 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 32 MiB/s wr, 633 op/s 2024-09-12T12:33:53.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:53 smithi033 ceph-mon[31246]: pgmap v586: 129 pgs: 129 active+clean; 10 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 32 MiB/s wr, 629 op/s 2024-09-12T12:33:53.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:53 smithi043 ceph-mon[34144]: pgmap v586: 129 pgs: 129 active+clean; 10 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 32 MiB/s wr, 629 op/s 2024-09-12T12:33:53.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:53 smithi102 ceph-mon[34799]: pgmap v586: 129 pgs: 129 active+clean; 10 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 32 MiB/s wr, 629 op/s 2024-09-12T12:33:55.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:55 smithi033 ceph-mon[31246]: pgmap v587: 129 pgs: 129 active+clean; 10 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 39 MiB/s wr, 768 op/s 2024-09-12T12:33:55.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:55 smithi043 ceph-mon[34144]: pgmap v587: 129 pgs: 129 active+clean; 10 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 39 MiB/s wr, 768 op/s 2024-09-12T12:33:55.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:55 smithi102 ceph-mon[34799]: pgmap v587: 129 pgs: 129 active+clean; 10 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 39 MiB/s wr, 768 op/s 2024-09-12T12:33:57.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:57 smithi033 ceph-mon[31246]: pgmap v588: 129 pgs: 129 active+clean; 10 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 31 MiB/s wr, 613 op/s 2024-09-12T12:33:57.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:57 smithi043 ceph-mon[34144]: pgmap v588: 129 pgs: 129 active+clean; 10 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 31 MiB/s wr, 613 op/s 2024-09-12T12:33:57.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:57 smithi102 ceph-mon[34799]: pgmap v588: 129 pgs: 129 active+clean; 10 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 31 MiB/s wr, 613 op/s 2024-09-12T12:33:59.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:33:59 smithi033 ceph-mon[31246]: pgmap v589: 129 pgs: 129 active+clean; 10 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 41 MiB/s wr, 802 op/s 2024-09-12T12:33:59.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:33:59 smithi043 ceph-mon[34144]: pgmap v589: 129 pgs: 129 active+clean; 10 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 41 MiB/s wr, 802 op/s 2024-09-12T12:33:59.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:33:59 smithi102 ceph-mon[34799]: pgmap v589: 129 pgs: 129 active+clean; 10 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 41 MiB/s wr, 802 op/s 2024-09-12T12:34:01.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:34:01 smithi033 ceph-mon[31246]: pgmap v590: 129 pgs: 129 active+clean; 10 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 31 MiB/s wr, 619 op/s 2024-09-12T12:34:01.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:34:01 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:34:01.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:34:01 smithi043 ceph-mon[34144]: pgmap v590: 129 pgs: 129 active+clean; 10 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 31 MiB/s wr, 619 op/s 2024-09-12T12:34:01.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:34:01 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:34:01.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:34:01 smithi102 ceph-mon[34799]: pgmap v590: 129 pgs: 129 active+clean; 10 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 31 MiB/s wr, 619 op/s 2024-09-12T12:34:01.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:34:01 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:34:02.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:34:02 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:34:02.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:34:02 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:34:02.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:34:02 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:34:02.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:34:02 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:34:02.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:34:02 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:34:02.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:34:02 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:34:02.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:34:02 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:34:02.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:34:02 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:34:02.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:34:02 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:34:03.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:34:03 smithi043 ceph-mon[34144]: pgmap v591: 129 pgs: 129 active+clean; 10 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 33 MiB/s wr, 652 op/s 2024-09-12T12:34:03.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:34:03 smithi102 ceph-mon[34799]: pgmap v591: 129 pgs: 129 active+clean; 10 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 33 MiB/s wr, 652 op/s 2024-09-12T12:34:03.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:34:03 smithi033 ceph-mon[31246]: pgmap v591: 129 pgs: 129 active+clean; 10 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 33 MiB/s wr, 652 op/s 2024-09-12T12:34:04.526 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T12:34:05.241 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:34:05.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:34:05 smithi033 ceph-mon[31246]: pgmap v592: 129 pgs: 129 active+clean; 10 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 39 MiB/s wr, 781 op/s 2024-09-12T12:34:05.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:34:05 smithi043 ceph-mon[34144]: pgmap v592: 129 pgs: 129 active+clean; 10 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 39 MiB/s wr, 781 op/s 2024-09-12T12:34:05.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:34:05 smithi102 ceph-mon[34799]: pgmap v592: 129 pgs: 129 active+clean; 10 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 39 MiB/s wr, 781 op/s 2024-09-12T12:34:05.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.940+0000 7f2ab14c5640 1 -- 172.21.15.33:0/921210590 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2aac109830 msgr2=0x7f2aac109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:05.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.940+0000 7f2ab14c5640 1 --2- 172.21.15.33:0/921210590 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2aac109830 0x7f2aac109c90 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0009900 tx=0x7f2aa002a440 comp rx=0 tx=0).stop 2024-09-12T12:34:05.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.942+0000 7f2ab14c5640 1 -- 172.21.15.33:0/921210590 shutdown_connections 2024-09-12T12:34:05.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.942+0000 7f2ab14c5640 1 --2- 172.21.15.33:0/921210590 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2aac11b140 0x7f2aac11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:05.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.942+0000 7f2ab14c5640 1 --2- 172.21.15.33:0/921210590 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2aac109830 0x7f2aac109c90 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:05.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.942+0000 7f2ab14c5640 1 --2- 172.21.15.33:0/921210590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2aac109450 0x7f2aac110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:05.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.942+0000 7f2ab14c5640 1 -- 172.21.15.33:0/921210590 >> 172.21.15.33:0/921210590 conn(0x7f2aac06e140 msgr2=0x7f2aac06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:34:05.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.947+0000 7f2ab14c5640 1 -- 172.21.15.33:0/921210590 shutdown_connections 2024-09-12T12:34:05.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.947+0000 7f2ab14c5640 1 -- 172.21.15.33:0/921210590 wait complete. 2024-09-12T12:34:05.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.948+0000 7f2ab14c5640 1 Processor -- start 2024-09-12T12:34:05.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.949+0000 7f2ab14c5640 1 -- start start 2024-09-12T12:34:05.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.949+0000 7f2ab14c5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2aac109450 0x7f2aac118730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:05.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.949+0000 7f2ab14c5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2aac109830 0x7f2aac1117c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:05.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.949+0000 7f2ab14c5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2aac11b140 0x7f2aac111d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:05.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.949+0000 7f2ab14c5640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2aac120ce0 con 0x7f2aac109450 2024-09-12T12:34:05.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.949+0000 7f2ab14c5640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2aac120b60 con 0x7f2aac11b140 2024-09-12T12:34:05.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.949+0000 7f2ab14c5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2aac120e60 con 0x7f2aac109830 2024-09-12T12:34:05.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.950+0000 7f2aaa7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2aac109830 0x7f2aac1117c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:05.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.950+0000 7f2aaa7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2aac109830 0x7f2aac1117c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:43268/0 (socket says 172.21.15.33:43268) 2024-09-12T12:34:05.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.950+0000 7f2aaa7fc640 1 -- 172.21.15.33:0/3959009524 learned_addr learned my addr 172.21.15.33:0/3959009524 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:34:05.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.950+0000 7f2aab7fe640 1 --2- 172.21.15.33:0/3959009524 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2aac11b140 0x7f2aac111d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:05.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.950+0000 7f2aab7fe640 1 -- 172.21.15.33:0/3959009524 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2aac109830 msgr2=0x7f2aac1117c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:05.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.950+0000 7f2aab7fe640 1 --2- 172.21.15.33:0/3959009524 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2aac109830 0x7f2aac1117c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:05.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.950+0000 7f2aab7fe640 1 -- 172.21.15.33:0/3959009524 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2aac109450 msgr2=0x7f2aac118730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:05.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.950+0000 7f2aab7fe640 1 --2- 172.21.15.33:0/3959009524 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2aac109450 0x7f2aac118730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:05.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.950+0000 7f2aab7fe640 1 -- 172.21.15.33:0/3959009524 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aac1122f0 con 0x7f2aac11b140 2024-09-12T12:34:05.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.951+0000 7f2aab7fe640 1 --2- 172.21.15.33:0/3959009524 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2aac11b140 0x7f2aac111d00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2aa400ca00 tx=0x7f2aa400cec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:34:05.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.952+0000 7f2a93fff640 1 -- 172.21.15.33:0/3959009524 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa400ad60 con 0x7f2aac11b140 2024-09-12T12:34:05.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.953+0000 7f2ab14c5640 1 -- 172.21.15.33:0/3959009524 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2aac112580 con 0x7f2aac11b140 2024-09-12T12:34:05.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.953+0000 7f2a93fff640 1 -- 172.21.15.33:0/3959009524 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2aa4005020 con 0x7f2aac11b140 2024-09-12T12:34:05.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.953+0000 7f2a93fff640 1 -- 172.21.15.33:0/3959009524 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa400f6b0 con 0x7f2aac11b140 2024-09-12T12:34:05.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.953+0000 7f2ab14c5640 1 -- 172.21.15.33:0/3959009524 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2aac116540 con 0x7f2aac11b140 2024-09-12T12:34:05.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.957+0000 7f2a93fff640 1 -- 172.21.15.33:0/3959009524 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2aa400f850 con 0x7f2aac11b140 2024-09-12T12:34:05.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.964+0000 7f2ab389e740 1 Processor -- start 2024-09-12T12:34:05.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.964+0000 7f2ab389e740 1 -- start start 2024-09-12T12:34:05.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.964+0000 7f2a93fff640 1 --2- 172.21.15.33:0/3959009524 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2a940a2d90 0x7f2a940a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:05.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.964+0000 7f2ab389e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5571305bc4a0 0x5571305bc880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:05.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.964+0000 7f2ab389e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571305bcdc0 0x5571305c7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:05.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.964+0000 7f2ab389e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5571305c7680 0x5571305c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:05.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.964+0000 7f2ab389e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5571305222e0 con 0x5571305bc4a0 2024-09-12T12:34:05.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.964+0000 7f2ab389e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5571304c9ce0 con 0x5571305bcdc0 2024-09-12T12:34:05.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.964+0000 7f2ab389e740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55713051e2a0 con 0x5571305c7680 2024-09-12T12:34:05.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.965+0000 7f2a93fff640 1 -- 172.21.15.33:0/3959009524 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f2aa40cf200 con 0x7f2aac11b140 2024-09-12T12:34:05.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.967+0000 7f2aaaffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5571305bc4a0 0x5571305bc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:05.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.967+0000 7f2aaaffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5571305bc4a0 0x5571305bc880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33626/0 (socket says 172.21.15.33:33626) 2024-09-12T12:34:05.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.967+0000 7f2aab7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5571305c7680 0x5571305c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:05.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.967+0000 7f2aaaffd640 1 -- 172.21.15.33:0/1335149264 learned_addr learned my addr 172.21.15.33:0/1335149264 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:34:05.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.967+0000 7f2aaaffd640 1 --2- 172.21.15.33:0/3959009524 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2a940a2d90 0x7f2a940a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:05.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.971+0000 7f2aab7fe640 1 -- 172.21.15.33:0/1335149264 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571305bcdc0 msgr2=0x5571305c7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:34:05.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.971+0000 7f2aaa7fc640 1 --2- 172.21.15.33:0/1335149264 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571305bcdc0 0x5571305c7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:05.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.976+0000 7f2aab7fe640 1 --2- 172.21.15.33:0/1335149264 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571305bcdc0 0x5571305c7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:05.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.976+0000 7f2aab7fe640 1 -- 172.21.15.33:0/1335149264 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5571305bc4a0 msgr2=0x5571305bc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:34:05.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.976+0000 7f2aab7fe640 1 --2- 172.21.15.33:0/1335149264 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5571305bc4a0 0x5571305bc880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:05.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.976+0000 7f2aab7fe640 1 -- 172.21.15.33:0/1335149264 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571304ae440 con 0x5571305c7680 2024-09-12T12:34:05.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.976+0000 7f2aaaffd640 1 --2- 172.21.15.33:0/1335149264 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5571305bc4a0 0x5571305bc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:34:05.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.976+0000 7f2aaa7fc640 1 --2- 172.21.15.33:0/1335149264 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571305bcdc0 0x5571305c7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:34:05.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.976+0000 7f2aab7fe640 1 --2- 172.21.15.33:0/1335149264 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5571305c7680 0x5571305c9a70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2aa409b370 tx=0x7f2aa4097a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e501dcba2680fa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:34:05.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.977+0000 7f2aaaffd640 1 --2- 172.21.15.33:0/3959009524 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2a940a2d90 0x7f2a940a5250 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c005d00 tx=0x7f2a9c00a690 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:34:05.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.978+0000 7f2a917fa640 1 -- 172.21.15.33:0/1335149264 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa401d070 con 0x5571305c7680 2024-09-12T12:34:05.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.978+0000 7f2a917fa640 1 -- 172.21.15.33:0/1335149264 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2aa409fa20 con 0x5571305c7680 2024-09-12T12:34:05.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.978+0000 7f2a917fa640 1 -- 172.21.15.33:0/1335149264 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa409aac0 con 0x5571305c7680 2024-09-12T12:34:05.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.979+0000 7f2ab389e740 1 -- 172.21.15.33:0/1335149264 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5571305c7680 msgr2=0x5571305c9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:05.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.979+0000 7f2ab389e740 1 --2- 172.21.15.33:0/1335149264 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5571305c7680 0x5571305c9a70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2aa409b370 tx=0x7f2aa4097a40 comp rx=0 tx=0).stop 2024-09-12T12:34:05.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.980+0000 7f2ab389e740 1 -- 172.21.15.33:0/1335149264 shutdown_connections 2024-09-12T12:34:05.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.980+0000 7f2ab389e740 1 --2- 172.21.15.33:0/1335149264 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5571305c7680 0x5571305c9a70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:05.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.980+0000 7f2ab389e740 1 --2- 172.21.15.33:0/1335149264 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571305bcdc0 0x5571305c7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:05.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.980+0000 7f2ab389e740 1 --2- 172.21.15.33:0/1335149264 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5571305bc4a0 0x5571305bc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:05.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.980+0000 7f2ab389e740 1 -- 172.21.15.33:0/1335149264 >> 172.21.15.33:0/1335149264 conn(0x5571305b8a30 msgr2=0x5571305b8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:34:05.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.980+0000 7f2ab389e740 1 -- 172.21.15.33:0/1335149264 shutdown_connections 2024-09-12T12:34:05.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.983+0000 7f2ab389e740 1 -- 172.21.15.33:0/1335149264 wait complete. 2024-09-12T12:34:05.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.983+0000 7f2ab389e740 1 -- start start 2024-09-12T12:34:05.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.983+0000 7f2ab389e740 1 Processor -- start 2024-09-12T12:34:05.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.984+0000 7f2ab389e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571305bc4a0 0x5571305c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:05.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.984+0000 7f2ab389e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5571305bcdc0 0x5571305c4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:05.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.984+0000 7f2ab389e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5571305c7680 0x5571305c4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:05.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.985+0000 7f2ab389e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5571305ca2a0 con 0x5571305c7680 2024-09-12T12:34:05.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.985+0000 7f2ab389e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5571304dd050 con 0x5571305bc4a0 2024-09-12T12:34:05.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.985+0000 7f2ab389e740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5571305ca420 con 0x5571305bcdc0 2024-09-12T12:34:05.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.985+0000 7f2ab389e740 10 client.0 _ll_register_callbacks cb 0x55713051d160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:34:05.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.985+0000 7f2aaaffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571305bc4a0 0x5571305c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:05.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.985+0000 7f2aaaffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571305bc4a0 0x5571305c6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:60874/0 (socket says 172.21.15.33:60874) 2024-09-12T12:34:05.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.985+0000 7f2aaaffd640 1 -- 172.21.15.33:0/3203021120 learned_addr learned my addr 172.21.15.33:0/3203021120 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:34:05.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.985+0000 7f2aaa7fc640 1 --2- 172.21.15.33:0/3203021120 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5571305bcdc0 0x5571305c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:05.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.986+0000 7f2aab7fe640 1 --2- 172.21.15.33:0/3203021120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5571305c7680 0x5571305c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:05.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.986+0000 7f2aaaffd640 1 -- 172.21.15.33:0/3203021120 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5571305bcdc0 msgr2=0x5571305c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:34:05.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.986+0000 7f2aaaffd640 1 --2- 172.21.15.33:0/3203021120 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5571305bcdc0 0x5571305c4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:05.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.986+0000 7f2aaaffd640 1 -- 172.21.15.33:0/3203021120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5571305c7680 msgr2=0x5571305c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:34:05.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.986+0000 7f2aaaffd640 1 --2- 172.21.15.33:0/3203021120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5571305c7680 0x5571305c4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:05.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.986+0000 7f2aaaffd640 1 -- 172.21.15.33:0/3203021120 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571302933c0 con 0x5571305bc4a0 2024-09-12T12:34:05.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.986+0000 7f2aaaffd640 1 --2- 172.21.15.33:0/3203021120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571305bc4a0 0x5571305c6f70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c00aa80 tx=0x7f2a9c00a3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=178e26f90d0908ca server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:34:05.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.986+0000 7f2a8eff5640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:34:05.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.990+0000 7f2a8eff5640 1 -- 172.21.15.33:0/3203021120 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c022070 con 0x5571305bc4a0 2024-09-12T12:34:05.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.990+0000 7f2ab389e740 1 -- 172.21.15.33:0/3203021120 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2aa409fa20 con 0x5571305bc4a0 2024-09-12T12:34:05.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.990+0000 7f2a8eff5640 1 -- 172.21.15.33:0/3203021120 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f2a9c003800 con 0x5571305bc4a0 2024-09-12T12:34:05.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.990+0000 7f2a8eff5640 1 -- 172.21.15.33:0/3203021120 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2a9c003a00 con 0x5571305bc4a0 2024-09-12T12:34:05.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.990+0000 7f2ab389e740 10 client.25724 fetch_fsmap learned FSMap version 27 2024-09-12T12:34:05.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.990+0000 7f2ab389e740 1 -- 172.21.15.33:0/3203021120 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5571305d5c50 con 0x5571305bc4a0 2024-09-12T12:34:05.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.991+0000 7f2a8eff5640 1 -- 172.21.15.33:0/3203021120 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2aa409fa20 con 0x5571305bc4a0 2024-09-12T12:34:05.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.991+0000 7f2a8eff5640 1 -- 172.21.15.33:0/3203021120 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f2a9c026c60 con 0x5571305bc4a0 2024-09-12T12:34:05.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.991+0000 7f2ab389e740 10 client.25724 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:34:05.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.991+0000 7f2ab389e740 10 client.25724 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:34:05.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.991+0000 7f2ab389e740 20 client.25724 populate_metadata read hostname 'smithi033' 2024-09-12T12:34:05.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.991+0000 7f2ab389e740 1 --2- 172.21.15.33:0/3203021120 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5571305d74a0 0x5571305d9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:05.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.991+0000 7f2ab389e740 4 client.25724 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:34:05.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.991+0000 7f2ab389e740 1 -- 172.21.15.33:0/3203021120 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55713052f850 con 0x5571305d74a0 2024-09-12T12:34:05.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.994+0000 7f2aaa7fc640 1 --2- 172.21.15.33:0/3203021120 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5571305d74a0 0x5571305d9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:05.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.997+0000 7f2aaa7fc640 1 --2- 172.21.15.33:0/3203021120 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5571305d74a0 0x5571305d9920 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34eafd6a0b9b3838 server_cookie=3596657bf368841c in_seq=0 out_seq=0 2024-09-12T12:34:05.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.997+0000 7f2a8eff5640 10 client.25724 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:34:05.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.998+0000 7f2a8eff5640 1 -- 172.21.15.33:0/3203021120 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55713052f850 con 0x5571305d74a0 2024-09-12T12:34:05.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.998+0000 7f2a8eff5640 10 client.25724 handle_command_reply: tid=0 2024-09-12T12:34:05.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.998+0000 7f2ab389e740 1 client.25724 shutdown 2024-09-12T12:34:06.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.999+0000 7f2ab389e740 1 -- 172.21.15.33:0/3203021120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571305bc4a0 msgr2=0x5571305c6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:06.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.999+0000 7f2ab389e740 1 --2- 172.21.15.33:0/3203021120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571305bc4a0 0x5571305c6f70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c00aa80 tx=0x7f2a9c00a3d0 comp rx=0 tx=0).stop 2024-09-12T12:34:06.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.999+0000 7f2ab389e740 1 -- 172.21.15.33:0/3203021120 shutdown_connections 2024-09-12T12:34:06.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:05.999+0000 7f2ab389e740 1 --2- 172.21.15.33:0/3203021120 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5571305d74a0 0x5571305d9920 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:06.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.000+0000 7f2ab389e740 1 --2- 172.21.15.33:0/3203021120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5571305c7680 0x5571305c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:06.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.000+0000 7f2ab389e740 1 --2- 172.21.15.33:0/3203021120 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5571305bcdc0 0x5571305c4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:06.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.000+0000 7f2ab389e740 1 --2- 172.21.15.33:0/3203021120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571305bc4a0 0x5571305c6f70 secure :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c00aa80 tx=0x7f2a9c00a3d0 comp rx=0 tx=0).stop 2024-09-12T12:34:06.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.000+0000 7f2ab389e740 1 -- 172.21.15.33:0/3203021120 >> 172.21.15.33:0/3203021120 conn(0x5571305b8a30 msgr2=0x5571305be760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:34:06.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.000+0000 7f2a8eff5640 0 client.25724 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:34:06.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.001+0000 7f2ab389e740 1 -- 172.21.15.33:0/3203021120 shutdown_connections 2024-09-12T12:34:06.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.001+0000 7f2ab389e740 1 -- 172.21.15.33:0/3203021120 wait complete. 2024-09-12T12:34:06.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.001+0000 7f2ab389e740 20 client.25724 trim_cache size 0 max 16384 2024-09-12T12:34:06.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.037+0000 7f2ab389e740 1 Processor -- start 2024-09-12T12:34:06.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.037+0000 7f2ab389e740 1 -- start start 2024-09-12T12:34:06.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.038+0000 7f2ab389e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571305b8a30 0x5571305d3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:06.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.038+0000 7f2ab389e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5571305bcdc0 0x5571305df230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:06.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.038+0000 7f2aaaffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571305b8a30 0x5571305d3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:06.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.038+0000 7f2aaaffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571305b8a30 0x5571305d3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:60886/0 (socket says 172.21.15.33:60886) 2024-09-12T12:34:06.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.039+0000 7f2aaaffd640 1 -- 172.21.15.33:0/2283714952 learned_addr learned my addr 172.21.15.33:0/2283714952 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:34:06.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.039+0000 7f2ab389e740 1 --2- 172.21.15.33:0/2283714952 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5571305c7680 0x5571305df770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:06.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.039+0000 7f2ab389e740 1 -- 172.21.15.33:0/2283714952 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2a980124c0 con 0x5571305bcdc0 2024-09-12T12:34:06.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.039+0000 7f2ab389e740 1 -- 172.21.15.33:0/2283714952 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9800fd90 con 0x5571305b8a30 2024-09-12T12:34:06.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.039+0000 7f2ab389e740 1 -- 172.21.15.33:0/2283714952 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9800dbe0 con 0x5571305c7680 2024-09-12T12:34:06.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.040+0000 7f2aab7fe640 1 --2- 172.21.15.33:0/2283714952 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5571305c7680 0x5571305df770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:06.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.040+0000 7f2aaaffd640 1 -- 172.21.15.33:0/2283714952 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5571305c7680 msgr2=0x5571305df770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:34:06.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.040+0000 7f2aaaffd640 1 --2- 172.21.15.33:0/2283714952 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5571305c7680 0x5571305df770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:06.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.040+0000 7f2aaaffd640 1 -- 172.21.15.33:0/2283714952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5571305bcdc0 msgr2=0x5571305df230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:34:06.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.040+0000 7f2aaaffd640 1 --2- 172.21.15.33:0/2283714952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5571305bcdc0 0x5571305df230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:06.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.040+0000 7f2aaaffd640 1 -- 172.21.15.33:0/2283714952 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571305bc220 con 0x5571305b8a30 2024-09-12T12:34:06.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.042+0000 7f2aaaffd640 1 --2- 172.21.15.33:0/2283714952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571305b8a30 0x5571305d3580 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c01e5e0 tx=0x7f2a9c005940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad404559f813d8eb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:34:06.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.048+0000 7f2a90ff9640 1 -- 172.21.15.33:0/2283714952 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c022070 con 0x5571305b8a30 2024-09-12T12:34:06.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.048+0000 7f2a90ff9640 1 -- 172.21.15.33:0/2283714952 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2a9c00fd80 con 0x5571305b8a30 2024-09-12T12:34:06.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.048+0000 7f2a90ff9640 1 -- 172.21.15.33:0/2283714952 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c0047a0 con 0x5571305b8a30 2024-09-12T12:34:06.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.049+0000 7f2ab389e740 1 -- 172.21.15.33:0/2283714952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571305b8a30 msgr2=0x5571305d3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:06.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.049+0000 7f2ab389e740 1 --2- 172.21.15.33:0/2283714952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571305b8a30 0x5571305d3580 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c01e5e0 tx=0x7f2a9c005940 comp rx=0 tx=0).stop 2024-09-12T12:34:06.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.051+0000 7f2ab389e740 1 -- 172.21.15.33:0/2283714952 shutdown_connections 2024-09-12T12:34:06.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.051+0000 7f2ab389e740 1 --2- 172.21.15.33:0/2283714952 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5571305c7680 0x5571305df770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:06.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.051+0000 7f2ab389e740 1 --2- 172.21.15.33:0/2283714952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5571305bcdc0 0x5571305df230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:06.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.051+0000 7f2ab389e740 1 --2- 172.21.15.33:0/2283714952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571305b8a30 0x5571305d3580 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:06.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.051+0000 7f2ab389e740 1 -- 172.21.15.33:0/2283714952 >> 172.21.15.33:0/2283714952 conn(0x5571305c48c0 msgr2=0x5571305c2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:34:06.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.055+0000 7f2ab389e740 1 -- 172.21.15.33:0/2283714952 shutdown_connections 2024-09-12T12:34:06.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.056+0000 7f2ab389e740 1 -- 172.21.15.33:0/2283714952 wait complete. 2024-09-12T12:34:06.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.056+0000 7f2ab389e740 1 -- start start 2024-09-12T12:34:06.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.056+0000 7f2ab389e740 1 Processor -- start 2024-09-12T12:34:06.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.057+0000 7f2ab389e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571305b8a30 0x5571305cf940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:06.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.057+0000 7f2ab389e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5571305bcdc0 0x5571305cfe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:06.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.057+0000 7f2ab389e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5571305c7680 0x5571305c0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:06.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.057+0000 7f2ab389e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9800e250 con 0x5571305bcdc0 2024-09-12T12:34:06.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.057+0000 7f2ab389e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9800f6c0 con 0x5571305b8a30 2024-09-12T12:34:06.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.057+0000 7f2ab389e740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9800e920 con 0x5571305c7680 2024-09-12T12:34:06.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.057+0000 7f2ab389e740 10 client.0 _ll_register_callbacks cb 0x7f2a9c00a960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:34:06.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.057+0000 7f2aaaffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571305b8a30 0x5571305cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:06.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.057+0000 7f2aaaffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571305b8a30 0x5571305cf940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:60890/0 (socket says 172.21.15.33:60890) 2024-09-12T12:34:06.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.057+0000 7f2aaaffd640 1 -- 172.21.15.33:0/1757366586 learned_addr learned my addr 172.21.15.33:0/1757366586 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:34:06.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.058+0000 7f2aaa7fc640 1 --2- 172.21.15.33:0/1757366586 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5571305bcdc0 0x5571305cfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:06.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.059+0000 7f2aaa7fc640 1 -- 172.21.15.33:0/1757366586 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5571305c7680 msgr2=0x5571305c0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:34:06.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.059+0000 7f2aab7fe640 1 --2- 172.21.15.33:0/1757366586 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5571305c7680 0x5571305c0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:06.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.059+0000 7f2aaa7fc640 1 --2- 172.21.15.33:0/1757366586 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5571305c7680 0x5571305c0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:06.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.059+0000 7f2aaa7fc640 1 -- 172.21.15.33:0/1757366586 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571305b8a30 msgr2=0x5571305cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:34:06.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.059+0000 7f2aaa7fc640 1 --2- 172.21.15.33:0/1757366586 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571305b8a30 0x5571305cf940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:06.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.059+0000 7f2aaa7fc640 1 -- 172.21.15.33:0/1757366586 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571305c1250 con 0x5571305bcdc0 2024-09-12T12:34:06.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.059+0000 7f2aaaffd640 1 --2- 172.21.15.33:0/1757366586 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571305b8a30 0x5571305cf940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:34:06.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.060+0000 7f2aaa7fc640 1 --2- 172.21.15.33:0/1757366586 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5571305bcdc0 0x5571305cfe80 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0009230 tx=0x7f2aa00042b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a37b56795ee99edb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:34:06.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.061+0000 7f2a8eff5640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:34:06.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.061+0000 7f2a8eff5640 1 -- 172.21.15.33:0/1757366586 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa004a060 con 0x5571305bcdc0 2024-09-12T12:34:06.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.061+0000 7f2ab389e740 1 -- 172.21.15.33:0/1757366586 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a9c00fd80 con 0x5571305bcdc0 2024-09-12T12:34:06.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.061+0000 7f2a8eff5640 1 -- 172.21.15.33:0/1757366586 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f2aa0005590 con 0x5571305bcdc0 2024-09-12T12:34:06.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.062+0000 7f2a8eff5640 1 -- 172.21.15.33:0/1757366586 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2aa0051050 con 0x5571305bcdc0 2024-09-12T12:34:06.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.062+0000 7f2ab389e740 10 client.16017 fetch_fsmap learned FSMap version 27 2024-09-12T12:34:06.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.062+0000 7f2ab389e740 1 -- 172.21.15.33:0/1757366586 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557130641d50 con 0x5571305bcdc0 2024-09-12T12:34:06.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.062+0000 7f2a8eff5640 1 -- 172.21.15.33:0/1757366586 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2a9c00fd80 con 0x5571305bcdc0 2024-09-12T12:34:06.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.062+0000 7f2a8eff5640 1 -- 172.21.15.33:0/1757366586 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f2aa0003af0 con 0x5571305bcdc0 2024-09-12T12:34:06.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.063+0000 7f2ab389e740 10 client.16017 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:34:06.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.063+0000 7f2ab389e740 10 client.16017 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:34:06.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.063+0000 7f2ab389e740 20 client.16017 populate_metadata read hostname 'smithi033' 2024-09-12T12:34:06.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.063+0000 7f2ab389e740 1 --2- 172.21.15.33:0/1757366586 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x557130642570 0x557130644990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:06.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.063+0000 7f2ab389e740 4 client.16017 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:34:06.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.063+0000 7f2ab389e740 1 -- 172.21.15.33:0/1757366586 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557130529d60 con 0x557130642570 2024-09-12T12:34:06.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.063+0000 7f2aaaffd640 1 --2- 172.21.15.33:0/1757366586 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x557130642570 0x557130644990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:06.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.064+0000 7f2aaaffd640 1 --2- 172.21.15.33:0/1757366586 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x557130642570 0x557130644990 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a330c487a0acda40 server_cookie=cd84b46e50b416be in_seq=0 out_seq=0 2024-09-12T12:34:06.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.064+0000 7f2a8eff5640 10 client.16017 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:34:06.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.066+0000 7f2a8eff5640 1 -- 172.21.15.33:0/1757366586 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x557130529d60 con 0x557130642570 2024-09-12T12:34:06.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.066+0000 7f2a8eff5640 10 client.16017 handle_command_reply: tid=0 2024-09-12T12:34:06.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.066+0000 7f2ab389e740 1 client.16017 shutdown 2024-09-12T12:34:06.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.071+0000 7f2ab389e740 1 -- 172.21.15.33:0/1757366586 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5571305bcdc0 msgr2=0x5571305cfe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:06.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.071+0000 7f2ab389e740 1 --2- 172.21.15.33:0/1757366586 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5571305bcdc0 0x5571305cfe80 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0009230 tx=0x7f2aa00042b0 comp rx=0 tx=0).stop 2024-09-12T12:34:06.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.071+0000 7f2ab389e740 1 -- 172.21.15.33:0/1757366586 shutdown_connections 2024-09-12T12:34:06.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.071+0000 7f2ab389e740 1 --2- 172.21.15.33:0/1757366586 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x557130642570 0x557130644990 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:06.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.071+0000 7f2ab389e740 1 --2- 172.21.15.33:0/1757366586 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5571305c7680 0x5571305c0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:06.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.071+0000 7f2ab389e740 1 --2- 172.21.15.33:0/1757366586 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5571305bcdc0 0x5571305cfe80 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:06.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.071+0000 7f2ab389e740 1 --2- 172.21.15.33:0/1757366586 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571305b8a30 0x5571305cf940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:06.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.071+0000 7f2ab389e740 1 -- 172.21.15.33:0/1757366586 >> 172.21.15.33:0/1757366586 conn(0x5571305c48c0 msgr2=0x5571305c2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:34:06.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.071+0000 7f2a8eff5640 0 client.16017 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:34:06.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.071+0000 7f2ab389e740 1 -- 172.21.15.33:0/1757366586 shutdown_connections 2024-09-12T12:34:06.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.071+0000 7f2ab389e740 1 -- 172.21.15.33:0/1757366586 wait complete. 2024-09-12T12:34:06.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.071+0000 7f2ab389e740 20 client.16017 trim_cache size 0 max 16384 2024-09-12T12:34:06.073 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:34:06.073 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "no active scrubs running", 2024-09-12T12:34:06.073 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": {} 2024-09-12T12:34:06.073 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:34:06.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.072+0000 7f2ab14c5640 1 -- 172.21.15.33:0/3959009524 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2a940a2d90 msgr2=0x7f2a940a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:06.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.072+0000 7f2ab14c5640 1 --2- 172.21.15.33:0/3959009524 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2a940a2d90 0x7f2a940a5250 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c005d00 tx=0x7f2a9c00a690 comp rx=0 tx=0).stop 2024-09-12T12:34:06.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.072+0000 7f2ab14c5640 1 -- 172.21.15.33:0/3959009524 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2aac11b140 msgr2=0x7f2aac111d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:06.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.072+0000 7f2ab14c5640 1 --2- 172.21.15.33:0/3959009524 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2aac11b140 0x7f2aac111d00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2aa400ca00 tx=0x7f2aa400cec0 comp rx=0 tx=0).stop 2024-09-12T12:34:06.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.073+0000 7f2ab14c5640 1 -- 172.21.15.33:0/3959009524 shutdown_connections 2024-09-12T12:34:06.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.073+0000 7f2ab14c5640 1 --2- 172.21.15.33:0/3959009524 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2a940a2d90 0x7f2a940a5250 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:06.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.073+0000 7f2ab14c5640 1 --2- 172.21.15.33:0/3959009524 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2aac11b140 0x7f2aac111d00 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:06.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.073+0000 7f2ab14c5640 1 --2- 172.21.15.33:0/3959009524 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2aac109830 0x7f2aac1117c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:06.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.073+0000 7f2ab14c5640 1 --2- 172.21.15.33:0/3959009524 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2aac109450 0x7f2aac118730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:06.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.073+0000 7f2ab14c5640 1 -- 172.21.15.33:0/3959009524 >> 172.21.15.33:0/3959009524 conn(0x7f2aac06e140 msgr2=0x7f2aac11be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:34:06.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.073+0000 7f2ab14c5640 1 -- 172.21.15.33:0/3959009524 shutdown_connections 2024-09-12T12:34:06.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:06.073+0000 7f2ab14c5640 1 -- 172.21.15.33:0/3959009524 wait complete. 2024-09-12T12:34:06.982 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T12:34:06.982 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:34:07.730 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:34:07.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:34:07 smithi043 ceph-mon[34144]: pgmap v593: 129 pgs: 129 active+clean; 10 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 31 MiB/s wr, 621 op/s 2024-09-12T12:34:07.883 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:34:07 smithi033 ceph-mon[31246]: pgmap v593: 129 pgs: 129 active+clean; 10 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 31 MiB/s wr, 621 op/s 2024-09-12T12:34:07.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:34:07 smithi102 ceph-mon[34799]: pgmap v593: 129 pgs: 129 active+clean; 10 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 31 MiB/s wr, 621 op/s 2024-09-12T12:34:08.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.418+0000 7f9224998640 1 -- 172.21.15.33:0/1370372098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9220109450 msgr2=0x7f9220110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:08.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.418+0000 7f9224998640 1 --2- 172.21.15.33:0/1370372098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9220109450 0x7f9220110250 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9210009860 tx=0x7f921002a360 comp rx=0 tx=0).stop 2024-09-12T12:34:08.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.418+0000 7f9224998640 1 -- 172.21.15.33:0/1370372098 shutdown_connections 2024-09-12T12:34:08.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.418+0000 7f9224998640 1 --2- 172.21.15.33:0/1370372098 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f922011b140 0x7f922011d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:08.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.418+0000 7f9224998640 1 --2- 172.21.15.33:0/1370372098 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9220109830 0x7f9220109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:08.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.418+0000 7f9224998640 1 --2- 172.21.15.33:0/1370372098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9220109450 0x7f9220110250 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:08.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.418+0000 7f9224998640 1 -- 172.21.15.33:0/1370372098 >> 172.21.15.33:0/1370372098 conn(0x7f922006e140 msgr2=0x7f922006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:34:08.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.421+0000 7f9224998640 1 -- 172.21.15.33:0/1370372098 shutdown_connections 2024-09-12T12:34:08.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.421+0000 7f9224998640 1 -- 172.21.15.33:0/1370372098 wait complete. 2024-09-12T12:34:08.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.422+0000 7f9224998640 1 Processor -- start 2024-09-12T12:34:08.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.422+0000 7f9224998640 1 -- start start 2024-09-12T12:34:08.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.422+0000 7f9224998640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9220109450 0x7f922011a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:08.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.422+0000 7f9224998640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9220109830 0x7f92201148a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:08.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.422+0000 7f9224998640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f922011b140 0x7f9220114de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:08.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.422+0000 7f9224998640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9220111200 con 0x7f922011b140 2024-09-12T12:34:08.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.422+0000 7f9224998640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9220111080 con 0x7f9220109830 2024-09-12T12:34:08.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.422+0000 7f9224998640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9220111380 con 0x7f9220109450 2024-09-12T12:34:08.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.424+0000 7f921e59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9220109450 0x7f922011a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:08.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.424+0000 7f921e59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9220109450 0x7f922011a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:43340/0 (socket says 172.21.15.33:43340) 2024-09-12T12:34:08.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.424+0000 7f921e59c640 1 -- 172.21.15.33:0/172486817 learned_addr learned my addr 172.21.15.33:0/172486817 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:34:08.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.426+0000 7f921ed9d640 1 --2- 172.21.15.33:0/172486817 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f922011b140 0x7f9220114de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:08.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.427+0000 7f921e59c640 1 -- 172.21.15.33:0/172486817 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9220109830 msgr2=0x7f92201148a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T12:34:08.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.427+0000 7f921e59c640 1 --2- 172.21.15.33:0/172486817 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9220109830 0x7f92201148a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:08.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.427+0000 7f921e59c640 1 -- 172.21.15.33:0/172486817 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f922011b140 msgr2=0x7f9220114de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:08.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.427+0000 7f921e59c640 1 --2- 172.21.15.33:0/172486817 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f922011b140 0x7f9220114de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:08.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.427+0000 7f921e59c640 1 -- 172.21.15.33:0/172486817 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9220115510 con 0x7f9220109450 2024-09-12T12:34:08.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.428+0000 7f921e59c640 1 --2- 172.21.15.33:0/172486817 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9220109450 0x7f922011a820 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f921002a8d0 tx=0x7f9210030d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:34:08.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.429+0000 7f920f7fe640 1 -- 172.21.15.33:0/172486817 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9210037040 con 0x7f9220109450 2024-09-12T12:34:08.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.429+0000 7f920f7fe640 1 -- 172.21.15.33:0/172486817 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9210041070 con 0x7f9220109450 2024-09-12T12:34:08.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.429+0000 7f920f7fe640 1 -- 172.21.15.33:0/172486817 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92100052b0 con 0x7f9220109450 2024-09-12T12:34:08.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.432+0000 7f9224998640 1 -- 172.21.15.33:0/172486817 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92201bc130 con 0x7f9220109450 2024-09-12T12:34:08.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.432+0000 7f9224998640 1 -- 172.21.15.33:0/172486817 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92201bc4d0 con 0x7f9220109450 2024-09-12T12:34:08.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.435+0000 7f920f7fe640 1 -- 172.21.15.33:0/172486817 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9210005450 con 0x7f9220109450 2024-09-12T12:34:08.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.435+0000 7f9224998640 1 -- 172.21.15.33:0/172486817 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9220073b00 con 0x7f9220109450 2024-09-12T12:34:08.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.437+0000 7f920f7fe640 1 --2- 172.21.15.33:0/172486817 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f92080a2d10 0x7f92080a51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:08.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.437+0000 7f920f7fe640 1 -- 172.21.15.33:0/172486817 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f92100eec20 con 0x7f9220109450 2024-09-12T12:34:08.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.441+0000 7f921dd9b640 1 --2- 172.21.15.33:0/172486817 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f92080a2d10 0x7f92080a51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:08.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.443+0000 7f921dd9b640 1 --2- 172.21.15.33:0/172486817 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f92080a2d10 0x7f92080a51d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9220116060 tx=0x7f9214009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:34:08.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.445+0000 7f920f7fe640 1 -- 172.21.15.33:0/172486817 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f921004a060 con 0x7f9220109450 2024-09-12T12:34:08.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.872+0000 7f9224998640 1 -- 172.21.15.33:0/172486817 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9220109c90 con 0x7f9220109450 2024-09-12T12:34:08.877 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:34:08.877 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":27,"btime":"2024-09-12T12:29:38:065241+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3327066342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3327066342},{"type":"v1","addr":"172.21.15.33:6835","nonce":3327066342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/19516401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":19516401},{"type":"v1","addr":"172.21.15.33:6837","nonce":19516401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1260196118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1260196118},{"type":"v1","addr":"172.21.15.33:6839","nonce":1260196118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/4288248356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4288248356},{"type":"v1","addr":"172.21.15.33:6841","nonce":4288248356}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/3051073141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3051073141},{"type":"v1","addr":"172.21.15.43:6833","nonce":3051073141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3282762800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3282762800},{"type":"v1","addr":"172.21.15.43:6835","nonce":3282762800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:23:46.400609+0000","modified":"2024-09-12T12:29:37.555614+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24490,"mds_2":24478},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3051713000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3051713000},{"type":"v1","addr":"172.21.15.102:6833","nonce":3051713000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6837/2472064883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2472064883},{"type":"v1","addr":"172.21.15.43:6837","nonce":2472064883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/1987408860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":1987408860},{"type":"v1","addr":"172.21.15.43:6839","nonce":1987408860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/4179527539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":4179527539},{"type":"v1","addr":"172.21.15.102:6835","nonce":4179527539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/2409953270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2409953270},{"type":"v1","addr":"172.21.15.102:6837","nonce":2409953270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.102:6839/1553271340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":1553271340},{"type":"v1","addr":"172.21.15.102:6839","nonce":1553271340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24499,"qdb_cluster":[24499,24490,24478]},"id":1}]} 2024-09-12T12:34:08.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.874+0000 7f920f7fe640 1 -- 172.21.15.33:0/172486817 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11912 (secure 0 0 0) 0x7f92100328c0 con 0x7f9220109450 2024-09-12T12:34:08.878 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 27 2024-09-12T12:34:08.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.878+0000 7f9224998640 1 -- 172.21.15.33:0/172486817 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f92080a2d10 msgr2=0x7f92080a51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:08.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.878+0000 7f9224998640 1 --2- 172.21.15.33:0/172486817 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f92080a2d10 0x7f92080a51d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9220116060 tx=0x7f9214009260 comp rx=0 tx=0).stop 2024-09-12T12:34:08.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.878+0000 7f9224998640 1 -- 172.21.15.33:0/172486817 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9220109450 msgr2=0x7f922011a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:08.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.878+0000 7f9224998640 1 --2- 172.21.15.33:0/172486817 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9220109450 0x7f922011a820 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f921002a8d0 tx=0x7f9210030d80 comp rx=0 tx=0).stop 2024-09-12T12:34:08.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.881+0000 7f9224998640 1 -- 172.21.15.33:0/172486817 shutdown_connections 2024-09-12T12:34:08.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.881+0000 7f9224998640 1 --2- 172.21.15.33:0/172486817 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f92080a2d10 0x7f92080a51d0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:08.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.882+0000 7f9224998640 1 --2- 172.21.15.33:0/172486817 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f922011b140 0x7f9220114de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:08.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.882+0000 7f9224998640 1 --2- 172.21.15.33:0/172486817 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9220109830 0x7f92201148a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:08.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.882+0000 7f9224998640 1 --2- 172.21.15.33:0/172486817 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9220109450 0x7f922011a820 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:08.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.882+0000 7f9224998640 1 -- 172.21.15.33:0/172486817 >> 172.21.15.33:0/172486817 conn(0x7f922006e140 msgr2=0x7f9220070ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:34:08.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.886+0000 7f9224998640 1 -- 172.21.15.33:0/172486817 shutdown_connections 2024-09-12T12:34:08.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:08.887+0000 7f9224998640 1 -- 172.21.15.33:0/172486817 wait complete. 2024-09-12T12:34:09.684 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T12:34:09.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:34:09 smithi043 ceph-mon[34144]: pgmap v594: 129 pgs: 129 active+clean; 10 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 40 MiB/s wr, 788 op/s 2024-09-12T12:34:09.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:34:09 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/172486817' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:34:09.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:34:09 smithi102 ceph-mon[34799]: pgmap v594: 129 pgs: 129 active+clean; 10 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 40 MiB/s wr, 788 op/s 2024-09-12T12:34:09.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:34:09 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/172486817' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:34:09.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:34:09 smithi033 ceph-mon[31246]: pgmap v594: 129 pgs: 129 active+clean; 10 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 40 MiB/s wr, 788 op/s 2024-09-12T12:34:09.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:34:09 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/172486817' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:34:10.337 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:34:11.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.001+0000 7f691b59e640 1 -- 172.21.15.33:0/1959406037 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f69140952d0 msgr2=0x7f69140a1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:11.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.001+0000 7f691b59e640 1 --2- 172.21.15.33:0/1959406037 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f69140952d0 0x7f69140a1320 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f691c051500 tx=0x7f691c09f7e0 comp rx=0 tx=0).stop 2024-09-12T12:34:11.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.003+0000 7f691b59e640 1 -- 172.21.15.33:0/1959406037 shutdown_connections 2024-09-12T12:34:11.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.003+0000 7f691b59e640 1 --2- 172.21.15.33:0/1959406037 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f69140952d0 0x7f69140a1320 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:11.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.003+0000 7f691b59e640 1 --2- 172.21.15.33:0/1959406037 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6914094930 0x7f6914094d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:11.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.003+0000 7f691b59e640 1 --2- 172.21.15.33:0/1959406037 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f691409a550 0x7f691409a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:11.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.003+0000 7f691b59e640 1 -- 172.21.15.33:0/1959406037 >> 172.21.15.33:0/1959406037 conn(0x7f691400a1f0 msgr2=0x7f691400a600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:34:11.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.006+0000 7f691b59e640 1 -- 172.21.15.33:0/1959406037 shutdown_connections 2024-09-12T12:34:11.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.008+0000 7f691b59e640 1 -- 172.21.15.33:0/1959406037 wait complete. 2024-09-12T12:34:11.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.009+0000 7f691b59e640 1 Processor -- start 2024-09-12T12:34:11.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.011+0000 7f691b59e640 1 -- start start 2024-09-12T12:34:11.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.011+0000 7f691b59e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6914094930 0x7f691409fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:11.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.011+0000 7f691b59e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69140952d0 0x7f69140a0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:11.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.012+0000 7f691b59e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f691409a550 0x7f691413dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:11.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.012+0000 7f691b59e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f69140a3120 con 0x7f69140952d0 2024-09-12T12:34:11.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.012+0000 7f691b59e640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f69140a2fa0 con 0x7f6914094930 2024-09-12T12:34:11.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.012+0000 7f691b59e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f69140a32a0 con 0x7f691409a550 2024-09-12T12:34:11.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.013+0000 7f691ad9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f691409a550 0x7f691413dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:11.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.013+0000 7f691ad9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f691409a550 0x7f691413dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:40720/0 (socket says 172.21.15.33:40720) 2024-09-12T12:34:11.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.013+0000 7f691ad9d640 1 -- 172.21.15.33:0/2930555550 learned_addr learned my addr 172.21.15.33:0/2930555550 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:34:11.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.013+0000 7f6919d9b640 1 --2- 172.21.15.33:0/2930555550 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69140952d0 0x7f69140a0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:11.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.013+0000 7f691ad9d640 1 -- 172.21.15.33:0/2930555550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6914094930 msgr2=0x7f691409fd00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T12:34:11.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.013+0000 7f691ad9d640 1 --2- 172.21.15.33:0/2930555550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6914094930 0x7f691409fd00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:11.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.013+0000 7f691ad9d640 1 -- 172.21.15.33:0/2930555550 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69140952d0 msgr2=0x7f69140a0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:11.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.013+0000 7f691ad9d640 1 --2- 172.21.15.33:0/2930555550 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69140952d0 0x7f69140a0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:11.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.013+0000 7f691ad9d640 1 -- 172.21.15.33:0/2930555550 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f691413e480 con 0x7f691409a550 2024-09-12T12:34:11.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.014+0000 7f691ad9d640 1 --2- 172.21.15.33:0/2930555550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f691409a550 0x7f691413dd80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f691c065a40 tx=0x7f691c0a6d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:34:11.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.014+0000 7f690b7fe640 1 -- 172.21.15.33:0/2930555550 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f691c0b6020 con 0x7f691409a550 2024-09-12T12:34:11.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.015+0000 7f690b7fe640 1 -- 172.21.15.33:0/2930555550 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f691c0a65e0 con 0x7f691409a550 2024-09-12T12:34:11.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.015+0000 7f690b7fe640 1 -- 172.21.15.33:0/2930555550 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f691c06b650 con 0x7f691409a550 2024-09-12T12:34:11.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.017+0000 7f691b59e640 1 -- 172.21.15.33:0/2930555550 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f691413e710 con 0x7f691409a550 2024-09-12T12:34:11.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.017+0000 7f691b59e640 1 -- 172.21.15.33:0/2930555550 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f691413eb70 con 0x7f691409a550 2024-09-12T12:34:11.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.020+0000 7f690b7fe640 1 -- 172.21.15.33:0/2930555550 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f691c0b9020 con 0x7f691409a550 2024-09-12T12:34:11.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.022+0000 7f692313c740 1 Processor -- start 2024-09-12T12:34:11.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.022+0000 7f692313c740 1 -- start start 2024-09-12T12:34:11.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.023+0000 7f692313c740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c0ca075cf0 0x55c0ca074240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:11.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.023+0000 7f692313c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c0ca074780 0x55c0ca074bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:11.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.023+0000 7f692313c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0ca090530 0x55c0ca092920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:11.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.023+0000 7f692313c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55c0c9fda2f0 con 0x55c0ca074780 2024-09-12T12:34:11.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.023+0000 7f692313c740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55c0c9f81cf0 con 0x55c0ca090530 2024-09-12T12:34:11.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.023+0000 7f692313c740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55c0c9fd62b0 con 0x55c0ca075cf0 2024-09-12T12:34:11.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.023+0000 7f691a59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c0ca074780 0x55c0ca074bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:11.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.023+0000 7f691a59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c0ca074780 0x55c0ca074bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54950/0 (socket says 172.21.15.33:54950) 2024-09-12T12:34:11.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.023+0000 7f691a59c640 1 -- 172.21.15.33:0/745834376 learned_addr learned my addr 172.21.15.33:0/745834376 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:34:11.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.024+0000 7f6919d9b640 1 --2- 172.21.15.33:0/745834376 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c0ca075cf0 0x55c0ca074240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:11.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.024+0000 7f6919d9b640 1 --2- 172.21.15.33:0/745834376 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0ca090530 0x55c0ca092920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:11.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.024+0000 7f690b7fe640 1 --2- 172.21.15.33:0/2930555550 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f69040a2ce0 0x7f69040a51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:11.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.025+0000 7f6919d9b640 1 -- 172.21.15.33:0/745834376 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0ca090530 msgr2=0x55c0ca092920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:34:11.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.025+0000 7f6919d9b640 1 --2- 172.21.15.33:0/745834376 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0ca090530 0x55c0ca092920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:11.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.025+0000 7f6919d9b640 1 -- 172.21.15.33:0/745834376 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c0ca074780 msgr2=0x55c0ca074bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:34:11.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.025+0000 7f6919d9b640 1 --2- 172.21.15.33:0/745834376 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c0ca074780 0x55c0ca074bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:11.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.025+0000 7f6919d9b640 1 -- 172.21.15.33:0/745834376 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0c9f663a0 con 0x55c0ca075cf0 2024-09-12T12:34:11.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.025+0000 7f691ad9d640 1 --2- 172.21.15.33:0/2930555550 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f69040a2ce0 0x7f69040a51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:11.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.025+0000 7f690b7fe640 1 -- 172.21.15.33:0/2930555550 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f691c164ed0 con 0x7f691409a550 2024-09-12T12:34:11.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.025+0000 7f691ad9d640 1 --2- 172.21.15.33:0/2930555550 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f69040a2ce0 0x7f69040a51a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f691c051220 tx=0x7f691c0fbf00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:34:11.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.026+0000 7f6919d9b640 1 --2- 172.21.15.33:0/745834376 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c0ca075cf0 0x55c0ca074240 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f69140a15c0 tx=0x7f691000d040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=821502595a4889b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:34:11.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.029+0000 7f6908ff9640 1 -- 172.21.15.33:0/745834376 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f691001f070 con 0x55c0ca075cf0 2024-09-12T12:34:11.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.029+0000 7f6908ff9640 1 -- 172.21.15.33:0/745834376 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6910016e40 con 0x55c0ca075cf0 2024-09-12T12:34:11.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.029+0000 7f6908ff9640 1 -- 172.21.15.33:0/745834376 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f691000add0 con 0x55c0ca075cf0 2024-09-12T12:34:11.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.031+0000 7f692313c740 1 -- 172.21.15.33:0/745834376 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c0ca075cf0 msgr2=0x55c0ca074240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:11.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.031+0000 7f692313c740 1 --2- 172.21.15.33:0/745834376 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c0ca075cf0 0x55c0ca074240 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f69140a15c0 tx=0x7f691000d040 comp rx=0 tx=0).stop 2024-09-12T12:34:11.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.031+0000 7f692313c740 1 -- 172.21.15.33:0/745834376 shutdown_connections 2024-09-12T12:34:11.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.031+0000 7f692313c740 1 --2- 172.21.15.33:0/745834376 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0ca090530 0x55c0ca092920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:11.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.031+0000 7f692313c740 1 --2- 172.21.15.33:0/745834376 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c0ca074780 0x55c0ca074bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:11.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.031+0000 7f692313c740 1 --2- 172.21.15.33:0/745834376 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c0ca075cf0 0x55c0ca074240 secure :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f69140a15c0 tx=0x7f691000d040 comp rx=0 tx=0).stop 2024-09-12T12:34:11.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.031+0000 7f692313c740 1 -- 172.21.15.33:0/745834376 >> 172.21.15.33:0/745834376 conn(0x55c0ca03d310 msgr2=0x55c0ca070e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:34:11.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.033+0000 7f692313c740 1 -- 172.21.15.33:0/745834376 shutdown_connections 2024-09-12T12:34:11.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.033+0000 7f692313c740 1 -- 172.21.15.33:0/745834376 wait complete. 2024-09-12T12:34:11.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.034+0000 7f692313c740 1 -- start start 2024-09-12T12:34:11.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.034+0000 7f692313c740 1 Processor -- start 2024-09-12T12:34:11.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.034+0000 7f692313c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0ca074780 0x55c0ca0817c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:11.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.034+0000 7f692313c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c0ca090530 0x55c0ca081d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:11.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.034+0000 7f692313c740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c0ca07cae0 0x55c0ca07cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:11.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.034+0000 7f692313c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55c0ca077700 con 0x55c0ca090530 2024-09-12T12:34:11.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.034+0000 7f692313c740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55c0c9f95060 con 0x55c0ca074780 2024-09-12T12:34:11.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.034+0000 7f692313c740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55c0ca077880 con 0x55c0ca07cae0 2024-09-12T12:34:11.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.034+0000 7f692313c740 10 client.0 _ll_register_callbacks cb 0x55c0c9ce88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:34:11.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.035+0000 7f6919d9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0ca074780 0x55c0ca0817c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:11.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.035+0000 7f6919d9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0ca074780 0x55c0ca0817c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:38546/0 (socket says 172.21.15.33:38546) 2024-09-12T12:34:11.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.035+0000 7f6919d9b640 1 -- 172.21.15.33:0/3061363224 learned_addr learned my addr 172.21.15.33:0/3061363224 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:34:11.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.035+0000 7f691a59c640 1 --2- 172.21.15.33:0/3061363224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c0ca090530 0x55c0ca081d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:11.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.035+0000 7f6919d9b640 1 --2- 172.21.15.33:0/3061363224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c0ca07cae0 0x55c0ca07cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:11.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.036+0000 7f6919d9b640 1 -- 172.21.15.33:0/3061363224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c0ca07cae0 msgr2=0x55c0ca07cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:34:11.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.036+0000 7f6919d9b640 1 --2- 172.21.15.33:0/3061363224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c0ca07cae0 0x55c0ca07cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:11.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.036+0000 7f6919d9b640 1 -- 172.21.15.33:0/3061363224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c0ca090530 msgr2=0x55c0ca081d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:34:11.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.036+0000 7f6919d9b640 1 --2- 172.21.15.33:0/3061363224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c0ca090530 0x55c0ca081d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:11.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.036+0000 7f6919d9b640 1 -- 172.21.15.33:0/3061363224 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0c9d4b3c0 con 0x55c0ca074780 2024-09-12T12:34:11.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.042+0000 7f6919d9b640 1 --2- 172.21.15.33:0/3061363224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0ca074780 0x55c0ca0817c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6910005780 tx=0x7f6910005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50195b34210151ca server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:34:11.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.042+0000 7f6901ffb640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:34:11.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.042+0000 7f6901ffb640 1 -- 172.21.15.33:0/3061363224 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f691001f070 con 0x55c0ca074780 2024-09-12T12:34:11.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.042+0000 7f692313c740 1 -- 172.21.15.33:0/3061363224 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6910016e40 con 0x55c0ca074780 2024-09-12T12:34:11.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.042+0000 7f6901ffb640 1 -- 172.21.15.33:0/3061363224 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f6910004030 con 0x55c0ca074780 2024-09-12T12:34:11.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.044+0000 7f6901ffb640 1 -- 172.21.15.33:0/3061363224 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6910004230 con 0x55c0ca074780 2024-09-12T12:34:11.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.045+0000 7f692313c740 10 client.25742 fetch_fsmap learned FSMap version 27 2024-09-12T12:34:11.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.045+0000 7f692313c740 1 -- 172.21.15.33:0/3061363224 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c0ca08b860 con 0x55c0ca074780 2024-09-12T12:34:11.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.048+0000 7f6901ffb640 1 -- 172.21.15.33:0/3061363224 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6910016e40 con 0x55c0ca074780 2024-09-12T12:34:11.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.048+0000 7f6901ffb640 1 -- 172.21.15.33:0/3061363224 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f6910034480 con 0x55c0ca074780 2024-09-12T12:34:11.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.048+0000 7f692313c740 10 client.25742 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:34:11.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.048+0000 7f692313c740 10 client.25742 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-12T12:34:11.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.048+0000 7f692313c740 20 client.25742 populate_metadata read hostname 'smithi033' 2024-09-12T12:34:11.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.048+0000 7f692313c740 1 --2- 172.21.15.33:0/3061363224 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x55c0ca08ced0 0x55c0ca08f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:11.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.048+0000 7f692313c740 4 client.25742 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:34:11.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.048+0000 7f692313c740 1 -- 172.21.15.33:0/3061363224 --> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c0c9fe7860 con 0x55c0ca08ced0 2024-09-12T12:34:11.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.050+0000 7f691a59c640 1 --2- 172.21.15.33:0/3061363224 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x55c0ca08ced0 0x55c0ca08f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:11.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.061+0000 7f691a59c640 1 --2- 172.21.15.33:0/3061363224 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x55c0ca08ced0 0x55c0ca08f330 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=68ec1a4da5b6f6c5 server_cookie=9cbcd9bef2061a87 in_seq=0 out_seq=0 2024-09-12T12:34:11.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.061+0000 7f6901ffb640 10 client.25742 ms_handle_connect on v2:172.21.15.102:6834/4179527539 2024-09-12T12:34:11.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.062+0000 7f6901ffb640 1 -- 172.21.15.33:0/3061363224 <== mds.2 v2:172.21.15.102:6834/4179527539 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c0c9fe7860 con 0x55c0ca08ced0 2024-09-12T12:34:11.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.062+0000 7f6901ffb640 10 client.25742 handle_command_reply: tid=0 2024-09-12T12:34:11.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.062+0000 7f692313c740 1 client.25742 shutdown 2024-09-12T12:34:11.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.063+0000 7f692313c740 1 -- 172.21.15.33:0/3061363224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0ca074780 msgr2=0x55c0ca0817c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:11.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.063+0000 7f692313c740 1 --2- 172.21.15.33:0/3061363224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0ca074780 0x55c0ca0817c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6910005780 tx=0x7f6910005850 comp rx=0 tx=0).stop 2024-09-12T12:34:11.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.064+0000 7f692313c740 1 -- 172.21.15.33:0/3061363224 shutdown_connections 2024-09-12T12:34:11.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.064+0000 7f692313c740 1 --2- 172.21.15.33:0/3061363224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c0ca07cae0 0x55c0ca07cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:11.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.064+0000 7f692313c740 1 --2- 172.21.15.33:0/3061363224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c0ca090530 0x55c0ca081d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:11.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.064+0000 7f692313c740 1 --2- 172.21.15.33:0/3061363224 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x55c0ca08ced0 0x55c0ca08f330 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:11.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.064+0000 7f692313c740 1 --2- 172.21.15.33:0/3061363224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0ca074780 0x55c0ca0817c0 secure :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6910005780 tx=0x7f6910005850 comp rx=0 tx=0).stop 2024-09-12T12:34:11.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.064+0000 7f692313c740 1 -- 172.21.15.33:0/3061363224 >> 172.21.15.33:0/3061363224 conn(0x55c0ca03d310 msgr2=0x55c0ca076ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:34:11.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.064+0000 7f6901ffb640 0 client.25742 ms_handle_reset on v2:172.21.15.102:6834/4179527539 2024-09-12T12:34:11.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.064+0000 7f692313c740 1 -- 172.21.15.33:0/3061363224 shutdown_connections 2024-09-12T12:34:11.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.064+0000 7f692313c740 1 -- 172.21.15.33:0/3061363224 wait complete. 2024-09-12T12:34:11.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.064+0000 7f692313c740 20 client.25742 trim_cache size 0 max 16384 2024-09-12T12:34:11.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.092+0000 7f692313c740 1 Processor -- start 2024-09-12T12:34:11.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.092+0000 7f692313c740 1 -- start start 2024-09-12T12:34:11.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.093+0000 7f692313c740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c0ca07cae0 0x55c0ca078210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:11.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.093+0000 7f692313c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c0ca090530 0x55c0ca091920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:11.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.093+0000 7f692313c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0ca081e30 0x55c0ca091e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:11.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.093+0000 7f692313c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6914142ba0 con 0x55c0ca090530 2024-09-12T12:34:11.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.093+0000 7f692313c740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6914140470 con 0x55c0ca081e30 2024-09-12T12:34:11.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.093+0000 7f692313c740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6914094d90 con 0x55c0ca07cae0 2024-09-12T12:34:11.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.093+0000 7f6919d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c0ca07cae0 0x55c0ca078210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:11.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.093+0000 7f6919d9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0ca081e30 0x55c0ca091e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:11.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.093+0000 7f6919d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c0ca07cae0 0x55c0ca078210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:40738/0 (socket says 172.21.15.33:40738) 2024-09-12T12:34:11.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.093+0000 7f6919d9b640 1 -- 172.21.15.33:0/4112188811 learned_addr learned my addr 172.21.15.33:0/4112188811 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:34:11.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.094+0000 7f6919d9b640 1 -- 172.21.15.33:0/4112188811 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0ca081e30 msgr2=0x55c0ca091e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:34:11.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.094+0000 7f6919d9b640 1 --2- 172.21.15.33:0/4112188811 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0ca081e30 0x55c0ca091e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:11.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.094+0000 7f6919d9b640 1 -- 172.21.15.33:0/4112188811 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c0ca090530 msgr2=0x55c0ca091920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:34:11.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.094+0000 7f6919d9b640 1 --2- 172.21.15.33:0/4112188811 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c0ca090530 0x55c0ca091920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:11.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.094+0000 7f6919d9b640 1 -- 172.21.15.33:0/4112188811 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0ca0706a0 con 0x55c0ca07cae0 2024-09-12T12:34:11.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.094+0000 7f6919d9b640 1 --2- 172.21.15.33:0/4112188811 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c0ca07cae0 0x55c0ca078210 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6910005f50 tx=0x7f691000bad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d0d001e6cd2f9f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:34:11.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.095+0000 7f6903fff640 1 -- 172.21.15.33:0/4112188811 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f691001f070 con 0x55c0ca07cae0 2024-09-12T12:34:11.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.095+0000 7f6903fff640 1 -- 172.21.15.33:0/4112188811 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f691003b070 con 0x55c0ca07cae0 2024-09-12T12:34:11.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.095+0000 7f6903fff640 1 -- 172.21.15.33:0/4112188811 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f691000ad60 con 0x55c0ca07cae0 2024-09-12T12:34:11.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.096+0000 7f692313c740 1 -- 172.21.15.33:0/4112188811 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c0ca07cae0 msgr2=0x55c0ca078210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:11.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.096+0000 7f692313c740 1 --2- 172.21.15.33:0/4112188811 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c0ca07cae0 0x55c0ca078210 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6910005f50 tx=0x7f691000bad0 comp rx=0 tx=0).stop 2024-09-12T12:34:11.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.096+0000 7f692313c740 1 -- 172.21.15.33:0/4112188811 shutdown_connections 2024-09-12T12:34:11.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.096+0000 7f692313c740 1 --2- 172.21.15.33:0/4112188811 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0ca081e30 0x55c0ca091e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:11.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.096+0000 7f692313c740 1 --2- 172.21.15.33:0/4112188811 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c0ca090530 0x55c0ca091920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:11.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.096+0000 7f692313c740 1 --2- 172.21.15.33:0/4112188811 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c0ca07cae0 0x55c0ca078210 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:11.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.096+0000 7f692313c740 1 -- 172.21.15.33:0/4112188811 >> 172.21.15.33:0/4112188811 conn(0x55c0ca03d310 msgr2=0x55c0ca077b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:34:11.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.096+0000 7f692313c740 1 -- 172.21.15.33:0/4112188811 shutdown_connections 2024-09-12T12:34:11.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.096+0000 7f692313c740 1 -- 172.21.15.33:0/4112188811 wait complete. 2024-09-12T12:34:11.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.097+0000 7f692313c740 1 -- start start 2024-09-12T12:34:11.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.097+0000 7f692313c740 1 Processor -- start 2024-09-12T12:34:11.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.097+0000 7f692313c740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c0ca07cae0 0x55c0ca0823a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:11.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.097+0000 7f692313c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c0ca081e30 0x55c0ca0828e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:11.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.097+0000 7f692313c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0ca090530 0x55c0ca082e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:11.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.097+0000 7f692313c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f69140aeaf0 con 0x55c0ca081e30 2024-09-12T12:34:11.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.097+0000 7f692313c740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f691413fda0 con 0x55c0ca090530 2024-09-12T12:34:11.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.097+0000 7f692313c740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f691413f000 con 0x55c0ca07cae0 2024-09-12T12:34:11.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.097+0000 7f692313c740 10 client.0 _ll_register_callbacks cb 0x7f691001d070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:34:11.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.098+0000 7f6919d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c0ca07cae0 0x55c0ca0823a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:11.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.098+0000 7f6919d9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0ca090530 0x55c0ca082e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:11.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.098+0000 7f6919d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c0ca07cae0 0x55c0ca0823a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:40742/0 (socket says 172.21.15.33:40742) 2024-09-12T12:34:11.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.098+0000 7f6919d9b640 1 -- 172.21.15.33:0/372005043 learned_addr learned my addr 172.21.15.33:0/372005043 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:34:11.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.098+0000 7f691a59c640 1 --2- 172.21.15.33:0/372005043 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c0ca081e30 0x55c0ca0828e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:11.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.098+0000 7f6919d9b640 1 -- 172.21.15.33:0/372005043 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0ca090530 msgr2=0x55c0ca082e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:34:11.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.098+0000 7f6919d9b640 1 --2- 172.21.15.33:0/372005043 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0ca090530 0x55c0ca082e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:11.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.098+0000 7f6919d9b640 1 -- 172.21.15.33:0/372005043 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c0ca081e30 msgr2=0x55c0ca0828e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:34:11.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.098+0000 7f6919d9b640 1 --2- 172.21.15.33:0/372005043 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c0ca081e30 0x55c0ca0828e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:11.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.098+0000 7f6919d9b640 1 -- 172.21.15.33:0/372005043 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0ca0f8fe0 con 0x55c0ca07cae0 2024-09-12T12:34:11.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.101+0000 7f6919d9b640 1 --2- 172.21.15.33:0/372005043 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c0ca07cae0 0x55c0ca0823a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f691000a620 tx=0x7f69100043d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50a2f36d31ac7dd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:34:11.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.101+0000 7f6901ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:34:11.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.101+0000 7f6901ffb640 1 -- 172.21.15.33:0/372005043 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f691001f070 con 0x55c0ca07cae0 2024-09-12T12:34:11.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.102+0000 7f692313c740 1 -- 172.21.15.33:0/372005043 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f691003b070 con 0x55c0ca07cae0 2024-09-12T12:34:11.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.102+0000 7f6901ffb640 1 -- 172.21.15.33:0/372005043 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f691000a860 con 0x55c0ca07cae0 2024-09-12T12:34:11.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.103+0000 7f6901ffb640 1 -- 172.21.15.33:0/372005043 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f691000b870 con 0x55c0ca07cae0 2024-09-12T12:34:11.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.104+0000 7f692313c740 10 client.25828 fetch_fsmap learned FSMap version 27 2024-09-12T12:34:11.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.104+0000 7f692313c740 1 -- 172.21.15.33:0/372005043 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c0ca0fa210 con 0x55c0ca07cae0 2024-09-12T12:34:11.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.105+0000 7f6901ffb640 1 -- 172.21.15.33:0/372005043 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f691003b070 con 0x55c0ca07cae0 2024-09-12T12:34:11.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.105+0000 7f6901ffb640 1 -- 172.21.15.33:0/372005043 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f691003f070 con 0x55c0ca07cae0 2024-09-12T12:34:11.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.106+0000 7f692313c740 10 client.25828 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:34:11.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.106+0000 7f692313c740 10 client.25828 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-12T12:34:11.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.106+0000 7f692313c740 20 client.25828 populate_metadata read hostname 'smithi033' 2024-09-12T12:34:11.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.106+0000 7f692313c740 1 --2- 172.21.15.33:0/372005043 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x55c0ca0fa780 0x55c0ca0fcb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:11.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.106+0000 7f692313c740 4 client.25828 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:34:11.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.106+0000 7f692313c740 1 -- 172.21.15.33:0/372005043 --> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c0c9fe1d70 con 0x55c0ca0fa780 2024-09-12T12:34:11.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.114+0000 7f691a59c640 1 --2- 172.21.15.33:0/372005043 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x55c0ca0fa780 0x55c0ca0fcb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:11.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.116+0000 7f691a59c640 1 --2- 172.21.15.33:0/372005043 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x55c0ca0fa780 0x55c0ca0fcb70 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7bb5f2a55dc49b7b server_cookie=8edb50d385c3f5b7 in_seq=0 out_seq=0 2024-09-12T12:34:11.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.116+0000 7f6901ffb640 10 client.25828 ms_handle_connect on v2:172.21.15.102:6834/4179527539 2024-09-12T12:34:11.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.116+0000 7f6901ffb640 1 -- 172.21.15.33:0/372005043 <== mds.2 v2:172.21.15.102:6834/4179527539 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c0c9fe1d70 con 0x55c0ca0fa780 2024-09-12T12:34:11.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.116+0000 7f6901ffb640 10 client.25828 handle_command_reply: tid=0 2024-09-12T12:34:11.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.117+0000 7f692313c740 1 client.25828 shutdown 2024-09-12T12:34:11.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.117+0000 7f692313c740 1 -- 172.21.15.33:0/372005043 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c0ca07cae0 msgr2=0x55c0ca0823a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:11.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.117+0000 7f692313c740 1 --2- 172.21.15.33:0/372005043 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c0ca07cae0 0x55c0ca0823a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f691000a620 tx=0x7f69100043d0 comp rx=0 tx=0).stop 2024-09-12T12:34:11.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.117+0000 7f692313c740 1 -- 172.21.15.33:0/372005043 shutdown_connections 2024-09-12T12:34:11.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.117+0000 7f692313c740 1 --2- 172.21.15.33:0/372005043 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x55c0ca0fa780 0x55c0ca0fcb70 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:11.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.117+0000 7f692313c740 1 --2- 172.21.15.33:0/372005043 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c0ca090530 0x55c0ca082e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:11.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.117+0000 7f692313c740 1 --2- 172.21.15.33:0/372005043 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c0ca081e30 0x55c0ca0828e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:11.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.117+0000 7f692313c740 1 --2- 172.21.15.33:0/372005043 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c0ca07cae0 0x55c0ca0823a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:11.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.117+0000 7f6901ffb640 0 client.25828 ms_handle_reset on v2:172.21.15.102:6834/4179527539 2024-09-12T12:34:11.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.117+0000 7f692313c740 1 -- 172.21.15.33:0/372005043 >> 172.21.15.33:0/372005043 conn(0x55c0ca03d310 msgr2=0x55c0ca07b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:34:11.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.119+0000 7f692313c740 1 -- 172.21.15.33:0/372005043 shutdown_connections 2024-09-12T12:34:11.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.120+0000 7f692313c740 1 -- 172.21.15.33:0/372005043 wait complete. 2024-09-12T12:34:11.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.120+0000 7f692313c740 20 client.25828 trim_cache size 0 max 16384 2024-09-12T12:34:11.123 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-09-12T12:34:11.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.125+0000 7f691b59e640 1 -- 172.21.15.33:0/2930555550 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f69040a2ce0 msgr2=0x7f69040a51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:11.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.125+0000 7f691b59e640 1 --2- 172.21.15.33:0/2930555550 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f69040a2ce0 0x7f69040a51a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f691c051220 tx=0x7f691c0fbf00 comp rx=0 tx=0).stop 2024-09-12T12:34:11.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.125+0000 7f691b59e640 1 -- 172.21.15.33:0/2930555550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f691409a550 msgr2=0x7f691413dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:11.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.125+0000 7f691b59e640 1 --2- 172.21.15.33:0/2930555550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f691409a550 0x7f691413dd80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f691c065a40 tx=0x7f691c0a6d80 comp rx=0 tx=0).stop 2024-09-12T12:34:11.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.130+0000 7f691b59e640 1 -- 172.21.15.33:0/2930555550 shutdown_connections 2024-09-12T12:34:11.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.130+0000 7f691b59e640 1 --2- 172.21.15.33:0/2930555550 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f69040a2ce0 0x7f69040a51a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:11.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.130+0000 7f691b59e640 1 --2- 172.21.15.33:0/2930555550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f691409a550 0x7f691413dd80 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:11.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.130+0000 7f691b59e640 1 --2- 172.21.15.33:0/2930555550 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69140952d0 0x7f69140a0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:11.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.130+0000 7f691b59e640 1 --2- 172.21.15.33:0/2930555550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6914094930 0x7f691409fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:11.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.130+0000 7f691b59e640 1 -- 172.21.15.33:0/2930555550 >> 172.21.15.33:0/2930555550 conn(0x7f691400a1f0 msgr2=0x7f69140a5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:34:11.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.131+0000 7f691b59e640 1 -- 172.21.15.33:0/2930555550 shutdown_connections 2024-09-12T12:34:11.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:11.132+0000 7f691b59e640 1 -- 172.21.15.33:0/2930555550 wait complete. 2024-09-12T12:34:11.841 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:34:11 smithi033 ceph-mon[31246]: pgmap v595: 129 pgs: 129 active+clean; 10 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 29 MiB/s wr, 586 op/s 2024-09-12T12:34:11.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:34:11 smithi043 ceph-mon[34144]: pgmap v595: 129 pgs: 129 active+clean; 10 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 29 MiB/s wr, 586 op/s 2024-09-12T12:34:11.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:34:11 smithi102 ceph-mon[34799]: pgmap v595: 129 pgs: 129 active+clean; 10 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 29 MiB/s wr, 586 op/s 2024-09-12T12:34:11.922 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T12:34:12.569 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:34:13.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:34:13 smithi102 ceph-mon[34799]: pgmap v596: 129 pgs: 129 active+clean; 10 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 33 MiB/s wr, 653 op/s 2024-09-12T12:34:13.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:34:13 smithi033 ceph-mon[31246]: pgmap v596: 129 pgs: 129 active+clean; 10 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 33 MiB/s wr, 653 op/s 2024-09-12T12:34:14.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:34:13 smithi043 ceph-mon[34144]: pgmap v596: 129 pgs: 129 active+clean; 10 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 33 MiB/s wr, 653 op/s 2024-09-12T12:34:14.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.643+0000 7efd937cc640 1 -- 172.21.15.33:0/467091769 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd8c109830 msgr2=0x7efd8c109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:14.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.643+0000 7efd937cc640 1 --2- 172.21.15.33:0/467091769 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd8c109830 0x7efd8c109c90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7efd7c009860 tx=0x7efd7c02a380 comp rx=0 tx=0).stop 2024-09-12T12:34:14.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.643+0000 7efd937cc640 1 -- 172.21.15.33:0/467091769 shutdown_connections 2024-09-12T12:34:14.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.643+0000 7efd937cc640 1 --2- 172.21.15.33:0/467091769 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd8c11b140 0x7efd8c11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:14.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.643+0000 7efd937cc640 1 --2- 172.21.15.33:0/467091769 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd8c109830 0x7efd8c109c90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:14.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.643+0000 7efd937cc640 1 --2- 172.21.15.33:0/467091769 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd8c109450 0x7efd8c110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:14.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.643+0000 7efd937cc640 1 -- 172.21.15.33:0/467091769 >> 172.21.15.33:0/467091769 conn(0x7efd8c06e140 msgr2=0x7efd8c06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:34:14.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.647+0000 7efd937cc640 1 -- 172.21.15.33:0/467091769 shutdown_connections 2024-09-12T12:34:14.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.647+0000 7efd937cc640 1 -- 172.21.15.33:0/467091769 wait complete. 2024-09-12T12:34:14.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.648+0000 7efd937cc640 1 Processor -- start 2024-09-12T12:34:14.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.648+0000 7efd937cc640 1 -- start start 2024-09-12T12:34:14.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.648+0000 7efd937cc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd8c109450 0x7efd8c118a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:14.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.648+0000 7efd937cc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd8c109830 0x7efd8c1109f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:14.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.648+0000 7efd937cc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd8c11b140 0x7efd8c110f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:14.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.648+0000 7efd937cc640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7efd8c120ca0 con 0x7efd8c11b140 2024-09-12T12:34:14.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.648+0000 7efd937cc640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7efd8c120b20 con 0x7efd8c109450 2024-09-12T12:34:14.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.648+0000 7efd937cc640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7efd8c120e20 con 0x7efd8c109830 2024-09-12T12:34:14.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.651+0000 7efd90d67640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd8c109830 0x7efd8c1109f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:14.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.651+0000 7efd91d69640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd8c11b140 0x7efd8c110f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:14.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.651+0000 7efd91d69640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd8c11b140 0x7efd8c110f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54994/0 (socket says 172.21.15.33:54994) 2024-09-12T12:34:14.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.651+0000 7efd91d69640 1 -- 172.21.15.33:0/3837604487 learned_addr learned my addr 172.21.15.33:0/3837604487 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:34:14.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.652+0000 7efd91568640 1 --2- 172.21.15.33:0/3837604487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd8c109450 0x7efd8c118a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:14.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.652+0000 7efd90d67640 1 -- 172.21.15.33:0/3837604487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd8c109450 msgr2=0x7efd8c118a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:14.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.652+0000 7efd90d67640 1 --2- 172.21.15.33:0/3837604487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd8c109450 0x7efd8c118a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:14.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.652+0000 7efd90d67640 1 -- 172.21.15.33:0/3837604487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd8c11b140 msgr2=0x7efd8c110f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:14.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.652+0000 7efd90d67640 1 --2- 172.21.15.33:0/3837604487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd8c11b140 0x7efd8c110f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:14.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.652+0000 7efd90d67640 1 -- 172.21.15.33:0/3837604487 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd8c111750 con 0x7efd8c109830 2024-09-12T12:34:14.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.663+0000 7efd90d67640 1 --2- 172.21.15.33:0/3837604487 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd8c109830 0x7efd8c1109f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7efd7c009780 tx=0x7efd7c005270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:34:14.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.666+0000 7efd827fc640 1 -- 172.21.15.33:0/3837604487 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd7c03f030 con 0x7efd8c109830 2024-09-12T12:34:14.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.666+0000 7efd937cc640 1 -- 172.21.15.33:0/3837604487 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd8c1a6f20 con 0x7efd8c109830 2024-09-12T12:34:14.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.666+0000 7efd937cc640 1 -- 172.21.15.33:0/3837604487 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd8c1a73d0 con 0x7efd8c109830 2024-09-12T12:34:14.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.666+0000 7efd827fc640 1 -- 172.21.15.33:0/3837604487 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efd7c0053e0 con 0x7efd8c109830 2024-09-12T12:34:14.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.666+0000 7efd827fc640 1 -- 172.21.15.33:0/3837604487 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd7c037040 con 0x7efd8c109830 2024-09-12T12:34:14.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.672+0000 7efd95ba5740 1 Processor -- start 2024-09-12T12:34:14.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.676+0000 7efd827fc640 1 -- 172.21.15.33:0/3837604487 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7efd7c042070 con 0x7efd8c109830 2024-09-12T12:34:14.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.678+0000 7efd827fc640 1 --2- 172.21.15.33:0/3837604487 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7efd780a2d90 0x7efd780a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:14.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.678+0000 7efd827fc640 1 -- 172.21.15.33:0/3837604487 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7efd7c0ee200 con 0x7efd8c109830 2024-09-12T12:34:14.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.684+0000 7efd95ba5740 1 -- start start 2024-09-12T12:34:14.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.684+0000 7efd95ba5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e45f4db40 0x564e45f4c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:14.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.684+0000 7efd95ba5740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564e45f4c5d0 0x564e45f4ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:14.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.684+0000 7efd95ba5740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e45f57370 0x564e45f59760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:14.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.684+0000 7efd95ba5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x564e45eb22f0 con 0x564e45f4db40 2024-09-12T12:34:14.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.684+0000 7efd95ba5740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x564e45e59cf0 con 0x564e45f4c5d0 2024-09-12T12:34:14.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.684+0000 7efd95ba5740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564e45eae2b0 con 0x564e45f57370 2024-09-12T12:34:14.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.685+0000 7efd91d69640 1 --2- 172.21.15.33:0/3837604487 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7efd780a2d90 0x7efd780a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:14.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.686+0000 7efd91568640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e45f4db40 0x564e45f4c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:14.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.686+0000 7efd91568640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e45f4db40 0x564e45f4c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55008/0 (socket says 172.21.15.33:55008) 2024-09-12T12:34:14.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.686+0000 7efd91568640 1 -- 172.21.15.33:0/411068102 learned_addr learned my addr 172.21.15.33:0/411068102 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:34:14.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.686+0000 7efd91d69640 1 --2- 172.21.15.33:0/411068102 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e45f57370 0x564e45f59760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:14.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.688+0000 7efd91568640 1 -- 172.21.15.33:0/411068102 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e45f57370 msgr2=0x564e45f59760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:34:14.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.688+0000 7efd91568640 1 --2- 172.21.15.33:0/411068102 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e45f57370 0x564e45f59760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:14.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.688+0000 7efd91568640 1 -- 172.21.15.33:0/411068102 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564e45f4c5d0 msgr2=0x564e45f4ca10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:34:14.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.688+0000 7efd91568640 1 --2- 172.21.15.33:0/411068102 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564e45f4c5d0 0x564e45f4ca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:14.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.688+0000 7efd91568640 1 -- 172.21.15.33:0/411068102 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e45e3e3a0 con 0x564e45f4db40 2024-09-12T12:34:14.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.688+0000 7efd91d69640 1 --2- 172.21.15.33:0/3837604487 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7efd780a2d90 0x7efd780a5250 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7efd8402f970 tx=0x7efd8402f3f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:34:14.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.692+0000 7efd91568640 1 --2- 172.21.15.33:0/411068102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e45f4db40 0x564e45f4c090 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7efd8800cbf0 tx=0x7efd8800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0dce70f8a1a6b2d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:34:14.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.703+0000 7efd777fe640 1 -- 172.21.15.33:0/411068102 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd88010630 con 0x564e45f4db40 2024-09-12T12:34:14.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.703+0000 7efd777fe640 1 -- 172.21.15.33:0/411068102 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efd88010c80 con 0x564e45f4db40 2024-09-12T12:34:14.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.704+0000 7efd95ba5740 1 -- 172.21.15.33:0/411068102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e45f4db40 msgr2=0x564e45f4c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:14.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.704+0000 7efd95ba5740 1 --2- 172.21.15.33:0/411068102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e45f4db40 0x564e45f4c090 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7efd8800cbf0 tx=0x7efd8800e720 comp rx=0 tx=0).stop 2024-09-12T12:34:14.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.708+0000 7efd95ba5740 1 -- 172.21.15.33:0/411068102 shutdown_connections 2024-09-12T12:34:14.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.708+0000 7efd95ba5740 1 --2- 172.21.15.33:0/411068102 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e45f57370 0x564e45f59760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:14.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.708+0000 7efd95ba5740 1 --2- 172.21.15.33:0/411068102 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564e45f4c5d0 0x564e45f4ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:14.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.708+0000 7efd95ba5740 1 --2- 172.21.15.33:0/411068102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e45f4db40 0x564e45f4c090 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:14.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.708+0000 7efd95ba5740 1 -- 172.21.15.33:0/411068102 >> 172.21.15.33:0/411068102 conn(0x564e45f15310 msgr2=0x564e45f48c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:34:14.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.712+0000 7efd95ba5740 1 -- 172.21.15.33:0/411068102 shutdown_connections 2024-09-12T12:34:14.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.712+0000 7efd95ba5740 1 -- 172.21.15.33:0/411068102 wait complete. 2024-09-12T12:34:14.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.712+0000 7efd95ba5740 1 -- start start 2024-09-12T12:34:14.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.712+0000 7efd95ba5740 1 Processor -- start 2024-09-12T12:34:14.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.713+0000 7efd95ba5740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564e45f4c5d0 0x564e45f56c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:14.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.713+0000 7efd95ba5740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e45f4db40 0x564e45f53ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:14.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.713+0000 7efd95ba5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e45f57370 0x564e45f54420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:14.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.713+0000 7efd95ba5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x564e45f5a0c0 con 0x564e45f57370 2024-09-12T12:34:14.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.713+0000 7efd95ba5740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x564e45e6d060 con 0x564e45f4c5d0 2024-09-12T12:34:14.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.713+0000 7efd95ba5740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564e45f5a240 con 0x564e45f4db40 2024-09-12T12:34:14.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.713+0000 7efd95ba5740 10 client.0 _ll_register_callbacks cb 0x564e45bc08c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:34:14.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.713+0000 7efd91568640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564e45f4c5d0 0x564e45f56c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:14.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.713+0000 7efd91568640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564e45f4c5d0 0x564e45f56c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:38594/0 (socket says 172.21.15.33:38594) 2024-09-12T12:34:14.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.713+0000 7efd91568640 1 -- 172.21.15.33:0/2313562033 learned_addr learned my addr 172.21.15.33:0/2313562033 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:34:14.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.714+0000 7efd91d69640 1 --2- 172.21.15.33:0/2313562033 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e45f57370 0x564e45f54420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:14.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.715+0000 7efd91568640 1 -- 172.21.15.33:0/2313562033 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e45f4db40 msgr2=0x564e45f53ee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T12:34:14.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.715+0000 7efd91568640 1 --2- 172.21.15.33:0/2313562033 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e45f4db40 0x564e45f53ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:14.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.715+0000 7efd91568640 1 -- 172.21.15.33:0/2313562033 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e45f57370 msgr2=0x564e45f54420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:34:14.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.715+0000 7efd91568640 1 --2- 172.21.15.33:0/2313562033 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e45f57370 0x564e45f54420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:14.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.715+0000 7efd91568640 1 -- 172.21.15.33:0/2313562033 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e45c233c0 con 0x564e45f4c5d0 2024-09-12T12:34:14.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.719+0000 7efd91568640 1 --2- 172.21.15.33:0/2313562033 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564e45f4c5d0 0x564e45f56c30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7efd88019aa0 tx=0x7efd88010b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df2b7debc4051c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:34:14.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.719+0000 7efd74ff9640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:34:14.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.725+0000 7efd74ff9640 1 -- 172.21.15.33:0/2313562033 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd8802a060 con 0x564e45f4c5d0 2024-09-12T12:34:14.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.725+0000 7efd95ba5740 1 -- 172.21.15.33:0/2313562033 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd88010c80 con 0x564e45f4c5d0 2024-09-12T12:34:14.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.725+0000 7efd74ff9640 1 -- 172.21.15.33:0/2313562033 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7efd88005030 con 0x564e45f4c5d0 2024-09-12T12:34:14.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.725+0000 7efd74ff9640 1 -- 172.21.15.33:0/2313562033 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7efd88031050 con 0x564e45f4c5d0 2024-09-12T12:34:14.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.726+0000 7efd95ba5740 10 client.25754 fetch_fsmap learned FSMap version 27 2024-09-12T12:34:14.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.726+0000 7efd95ba5740 1 -- 172.21.15.33:0/2313562033 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564e45f65b30 con 0x564e45f4c5d0 2024-09-12T12:34:14.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.726+0000 7efd74ff9640 1 -- 172.21.15.33:0/2313562033 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efd88010c80 con 0x564e45f4c5d0 2024-09-12T12:34:14.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.726+0000 7efd74ff9640 1 -- 172.21.15.33:0/2313562033 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7efd88024070 con 0x564e45f4c5d0 2024-09-12T12:34:14.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.727+0000 7efd95ba5740 10 client.25754 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:34:14.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.727+0000 7efd95ba5740 10 client.25754 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-12T12:34:14.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.727+0000 7efd95ba5740 20 client.25754 populate_metadata read hostname 'smithi033' 2024-09-12T12:34:14.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.727+0000 7efd95ba5740 1 --2- 172.21.15.33:0/2313562033 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x564e45f66e80 0x564e45f69270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:14.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.727+0000 7efd95ba5740 4 client.25754 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:34:14.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.727+0000 7efd95ba5740 1 -- 172.21.15.33:0/2313562033 --> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e45ebf860 con 0x564e45f66e80 2024-09-12T12:34:14.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.736+0000 7efd90d67640 1 --2- 172.21.15.33:0/2313562033 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x564e45f66e80 0x564e45f69270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:14.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.736+0000 7efd90d67640 1 --2- 172.21.15.33:0/2313562033 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x564e45f66e80 0x564e45f69270 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=902a2eb7421e578 server_cookie=b02cebec69b8f9c4 in_seq=0 out_seq=0 2024-09-12T12:34:14.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.736+0000 7efd74ff9640 10 client.25754 ms_handle_connect on v2:172.21.15.102:6836/2409953270 2024-09-12T12:34:14.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.737+0000 7efd74ff9640 1 -- 172.21.15.33:0/2313562033 <== mds.1 v2:172.21.15.102:6836/2409953270 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564e45ebf860 con 0x564e45f66e80 2024-09-12T12:34:14.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.737+0000 7efd74ff9640 10 client.25754 handle_command_reply: tid=0 2024-09-12T12:34:14.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.737+0000 7efd95ba5740 1 client.25754 shutdown 2024-09-12T12:34:14.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.741+0000 7efd95ba5740 1 -- 172.21.15.33:0/2313562033 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564e45f4c5d0 msgr2=0x564e45f56c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:14.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.741+0000 7efd95ba5740 1 --2- 172.21.15.33:0/2313562033 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564e45f4c5d0 0x564e45f56c30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7efd88019aa0 tx=0x7efd88010b60 comp rx=0 tx=0).stop 2024-09-12T12:34:14.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.741+0000 7efd95ba5740 1 -- 172.21.15.33:0/2313562033 shutdown_connections 2024-09-12T12:34:14.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.741+0000 7efd95ba5740 1 --2- 172.21.15.33:0/2313562033 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e45f57370 0x564e45f54420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:14.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.741+0000 7efd95ba5740 1 --2- 172.21.15.33:0/2313562033 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x564e45f66e80 0x564e45f69270 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:14.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.741+0000 7efd95ba5740 1 --2- 172.21.15.33:0/2313562033 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e45f4db40 0x564e45f53ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:14.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.741+0000 7efd95ba5740 1 --2- 172.21.15.33:0/2313562033 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564e45f4c5d0 0x564e45f56c30 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:14.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.741+0000 7efd95ba5740 1 -- 172.21.15.33:0/2313562033 >> 172.21.15.33:0/2313562033 conn(0x564e45f15310 msgr2=0x564e45f4e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:34:14.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.741+0000 7efd74ff9640 0 client.25754 ms_handle_reset on v2:172.21.15.102:6836/2409953270 2024-09-12T12:34:14.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.742+0000 7efd95ba5740 1 -- 172.21.15.33:0/2313562033 shutdown_connections 2024-09-12T12:34:14.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.742+0000 7efd95ba5740 1 -- 172.21.15.33:0/2313562033 wait complete. 2024-09-12T12:34:14.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.743+0000 7efd95ba5740 20 client.25754 trim_cache size 0 max 16384 2024-09-12T12:34:14.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.772+0000 7efd95ba5740 1 Processor -- start 2024-09-12T12:34:14.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.772+0000 7efd95ba5740 1 -- start start 2024-09-12T12:34:14.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.773+0000 7efd95ba5740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564e45f4c5d0 0x564e45f63440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:14.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.773+0000 7efd95ba5740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e45f4db40 0x564e45f527b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:14.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.773+0000 7efd95ba5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e45f57370 0x564e45f52cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:14.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.773+0000 7efd90d67640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e45f4db40 0x564e45f527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:14.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.773+0000 7efd90d67640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e45f4db40 0x564e45f527b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:40758/0 (socket says 172.21.15.33:40758) 2024-09-12T12:34:14.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.774+0000 7efd91568640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564e45f4c5d0 0x564e45f63440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:14.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.774+0000 7efd91568640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564e45f4c5d0 0x564e45f63440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:38596/0 (socket says 172.21.15.33:38596) 2024-09-12T12:34:14.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.774+0000 7efd90d67640 1 -- 172.21.15.33:0/2306233891 learned_addr learned my addr 172.21.15.33:0/2306233891 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:34:14.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.774+0000 7efd95ba5740 1 -- 172.21.15.33:0/2306233891 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7efd70012570 con 0x564e45f57370 2024-09-12T12:34:14.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.774+0000 7efd95ba5740 1 -- 172.21.15.33:0/2306233891 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7efd7000fe40 con 0x564e45f4c5d0 2024-09-12T12:34:14.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.774+0000 7efd95ba5740 1 -- 172.21.15.33:0/2306233891 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7efd7000dc90 con 0x564e45f4db40 2024-09-12T12:34:14.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.775+0000 7efd91568640 1 -- 172.21.15.33:0/2306233891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e45f4db40 msgr2=0x564e45f527b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:34:14.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.775+0000 7efd91568640 1 --2- 172.21.15.33:0/2306233891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e45f4db40 0x564e45f527b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:14.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.775+0000 7efd91568640 1 -- 172.21.15.33:0/2306233891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e45f57370 msgr2=0x564e45f52cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:34:14.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.775+0000 7efd91568640 1 --2- 172.21.15.33:0/2306233891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e45f57370 0x564e45f52cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:14.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.775+0000 7efd91568640 1 -- 172.21.15.33:0/2306233891 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e45f4fae0 con 0x564e45f4c5d0 2024-09-12T12:34:14.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.775+0000 7efd91568640 1 --2- 172.21.15.33:0/2306233891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564e45f4c5d0 0x564e45f63440 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7efd88004a20 tx=0x7efd880107d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7b63a83faa1504 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:34:14.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.776+0000 7efd76ffd640 1 -- 172.21.15.33:0/2306233891 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd8802a070 con 0x564e45f4c5d0 2024-09-12T12:34:14.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.776+0000 7efd76ffd640 1 -- 172.21.15.33:0/2306233891 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efd8803a070 con 0x564e45f4c5d0 2024-09-12T12:34:14.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.777+0000 7efd95ba5740 1 -- 172.21.15.33:0/2306233891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564e45f4c5d0 msgr2=0x564e45f63440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:14.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.777+0000 7efd95ba5740 1 --2- 172.21.15.33:0/2306233891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564e45f4c5d0 0x564e45f63440 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7efd88004a20 tx=0x7efd880107d0 comp rx=0 tx=0).stop 2024-09-12T12:34:14.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.777+0000 7efd95ba5740 1 -- 172.21.15.33:0/2306233891 shutdown_connections 2024-09-12T12:34:14.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.777+0000 7efd95ba5740 1 --2- 172.21.15.33:0/2306233891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e45f57370 0x564e45f52cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:14.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.777+0000 7efd95ba5740 1 --2- 172.21.15.33:0/2306233891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e45f4db40 0x564e45f527b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:14.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.778+0000 7efd95ba5740 1 --2- 172.21.15.33:0/2306233891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564e45f4c5d0 0x564e45f63440 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:14.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.778+0000 7efd95ba5740 1 -- 172.21.15.33:0/2306233891 >> 172.21.15.33:0/2306233891 conn(0x564e45f15310 msgr2=0x564e45f53ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:34:14.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.780+0000 7efd95ba5740 1 -- 172.21.15.33:0/2306233891 shutdown_connections 2024-09-12T12:34:14.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.780+0000 7efd95ba5740 1 -- 172.21.15.33:0/2306233891 wait complete. 2024-09-12T12:34:14.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.781+0000 7efd95ba5740 1 -- start start 2024-09-12T12:34:14.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.781+0000 7efd95ba5740 1 Processor -- start 2024-09-12T12:34:14.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.782+0000 7efd95ba5740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e45f4db40 0x564e45f5a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:14.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.782+0000 7efd95ba5740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564e45f57370 0x564e45f5aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:14.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.782+0000 7efd95ba5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e45f5afc0 0x564e45fcf860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:14.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.782+0000 7efd90d67640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564e45f57370 0x564e45f5aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:14.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.782+0000 7efd90d67640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564e45f57370 0x564e45f5aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:38598/0 (socket says 172.21.15.33:38598) 2024-09-12T12:34:14.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.783+0000 7efd90d67640 1 -- 172.21.15.33:0/3731863524 learned_addr learned my addr 172.21.15.33:0/3731863524 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:34:14.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.783+0000 7efd95ba5740 1 -- 172.21.15.33:0/3731863524 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7efd7000e300 con 0x564e45f5afc0 2024-09-12T12:34:14.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.783+0000 7efd95ba5740 1 -- 172.21.15.33:0/3731863524 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7efd7000f770 con 0x564e45f57370 2024-09-12T12:34:14.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.783+0000 7efd95ba5740 1 -- 172.21.15.33:0/3731863524 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7efd7000e9d0 con 0x564e45f4db40 2024-09-12T12:34:14.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.783+0000 7efd91d69640 1 --2- 172.21.15.33:0/3731863524 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e45f5afc0 0x564e45fcf860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:14.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.783+0000 7efd95ba5740 10 client.0 _ll_register_callbacks cb 0x7efd88014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:34:14.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.784+0000 7efd91d69640 1 -- 172.21.15.33:0/3731863524 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e45f4db40 msgr2=0x564e45f5a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:34:14.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.784+0000 7efd91d69640 1 --2- 172.21.15.33:0/3731863524 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e45f4db40 0x564e45f5a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:14.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.784+0000 7efd91d69640 1 -- 172.21.15.33:0/3731863524 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564e45f57370 msgr2=0x564e45f5aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:34:14.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.784+0000 7efd91d69640 1 --2- 172.21.15.33:0/3731863524 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564e45f57370 0x564e45f5aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:14.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.784+0000 7efd91d69640 1 -- 172.21.15.33:0/3731863524 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e45fcffa0 con 0x564e45f5afc0 2024-09-12T12:34:14.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.785+0000 7efd91d69640 1 --2- 172.21.15.33:0/3731863524 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e45f5afc0 0x564e45fcf860 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x564e45f49920 tx=0x7efd84004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a635ad638340c0f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:34:14.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.785+0000 7efd74ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:34:14.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.786+0000 7efd74ff9640 1 -- 172.21.15.33:0/3731863524 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd84039040 con 0x564e45f5afc0 2024-09-12T12:34:14.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.786+0000 7efd74ff9640 1 -- 172.21.15.33:0/3731863524 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7efd84040810 con 0x564e45f5afc0 2024-09-12T12:34:14.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.786+0000 7efd95ba5740 1 -- 172.21.15.33:0/3731863524 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564e45eb9d70 con 0x564e45f5afc0 2024-09-12T12:34:14.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.787+0000 7efd74ff9640 1 -- 172.21.15.33:0/3731863524 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7efd84056050 con 0x564e45f5afc0 2024-09-12T12:34:14.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.787+0000 7efd95ba5740 10 client.16050 fetch_fsmap learned FSMap version 27 2024-09-12T12:34:14.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.787+0000 7efd95ba5740 1 -- 172.21.15.33:0/3731863524 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564e45fd1250 con 0x564e45f5afc0 2024-09-12T12:34:14.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.789+0000 7efd74ff9640 1 -- 172.21.15.33:0/3731863524 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x564e45eb9d70 con 0x564e45f5afc0 2024-09-12T12:34:14.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.789+0000 7efd74ff9640 1 -- 172.21.15.33:0/3731863524 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7efd84051030 con 0x564e45f5afc0 2024-09-12T12:34:14.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.789+0000 7efd95ba5740 10 client.16050 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:34:14.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.789+0000 7efd95ba5740 10 client.16050 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-12T12:34:14.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.789+0000 7efd95ba5740 20 client.16050 populate_metadata read hostname 'smithi033' 2024-09-12T12:34:14.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.789+0000 7efd95ba5740 1 --2- 172.21.15.33:0/3731863524 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x564e45fd1970 0x564e45fd3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:14.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.789+0000 7efd95ba5740 4 client.16050 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:34:14.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.789+0000 7efd95ba5740 1 -- 172.21.15.33:0/3731863524 --> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564e45e36170 con 0x564e45fd1970 2024-09-12T12:34:14.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.790+0000 7efd91568640 1 --2- 172.21.15.33:0/3731863524 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x564e45fd1970 0x564e45fd3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:14.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.790+0000 7efd91568640 1 --2- 172.21.15.33:0/3731863524 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x564e45fd1970 0x564e45fd3dd0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=726ea3d331d2119d server_cookie=a2a393ed37fdbd86 in_seq=0 out_seq=0 2024-09-12T12:34:14.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.791+0000 7efd74ff9640 10 client.16050 ms_handle_connect on v2:172.21.15.102:6836/2409953270 2024-09-12T12:34:14.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.791+0000 7efd74ff9640 1 -- 172.21.15.33:0/3731863524 <== mds.1 v2:172.21.15.102:6836/2409953270 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564e45e36170 con 0x564e45fd1970 2024-09-12T12:34:14.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.791+0000 7efd74ff9640 10 client.16050 handle_command_reply: tid=0 2024-09-12T12:34:14.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.791+0000 7efd95ba5740 1 client.16050 shutdown 2024-09-12T12:34:14.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.798+0000 7efd95ba5740 1 -- 172.21.15.33:0/3731863524 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e45f5afc0 msgr2=0x564e45fcf860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:14.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.798+0000 7efd95ba5740 1 --2- 172.21.15.33:0/3731863524 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e45f5afc0 0x564e45fcf860 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x564e45f49920 tx=0x7efd84004a40 comp rx=0 tx=0).stop 2024-09-12T12:34:14.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.798+0000 7efd95ba5740 1 -- 172.21.15.33:0/3731863524 shutdown_connections 2024-09-12T12:34:14.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.798+0000 7efd95ba5740 1 --2- 172.21.15.33:0/3731863524 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e45f5afc0 0x564e45fcf860 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:14.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.798+0000 7efd95ba5740 1 --2- 172.21.15.33:0/3731863524 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564e45f57370 0x564e45f5aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:14.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.798+0000 7efd95ba5740 1 --2- 172.21.15.33:0/3731863524 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x564e45fd1970 0x564e45fd3dd0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:14.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.798+0000 7efd95ba5740 1 --2- 172.21.15.33:0/3731863524 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e45f4db40 0x564e45f5a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:14.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.798+0000 7efd95ba5740 1 -- 172.21.15.33:0/3731863524 >> 172.21.15.33:0/3731863524 conn(0x564e45f15310 msgr2=0x564e45f47500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:34:14.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.798+0000 7efd74ff9640 0 client.16050 ms_handle_reset on v2:172.21.15.102:6836/2409953270 2024-09-12T12:34:14.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.799+0000 7efd95ba5740 1 -- 172.21.15.33:0/3731863524 shutdown_connections 2024-09-12T12:34:14.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.799+0000 7efd95ba5740 1 -- 172.21.15.33:0/3731863524 wait complete. 2024-09-12T12:34:14.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.799+0000 7efd95ba5740 20 client.16050 trim_cache size 0 max 16384 2024-09-12T12:34:14.803 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-09-12T12:34:14.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.803+0000 7efd937cc640 1 -- 172.21.15.33:0/3837604487 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7efd780a2d90 msgr2=0x7efd780a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:14.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.803+0000 7efd937cc640 1 --2- 172.21.15.33:0/3837604487 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7efd780a2d90 0x7efd780a5250 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7efd8402f970 tx=0x7efd8402f3f0 comp rx=0 tx=0).stop 2024-09-12T12:34:14.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.803+0000 7efd937cc640 1 -- 172.21.15.33:0/3837604487 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd8c109830 msgr2=0x7efd8c1109f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:14.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.803+0000 7efd937cc640 1 --2- 172.21.15.33:0/3837604487 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd8c109830 0x7efd8c1109f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7efd7c009780 tx=0x7efd7c005270 comp rx=0 tx=0).stop 2024-09-12T12:34:14.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.803+0000 7efd937cc640 1 -- 172.21.15.33:0/3837604487 shutdown_connections 2024-09-12T12:34:14.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.803+0000 7efd937cc640 1 --2- 172.21.15.33:0/3837604487 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7efd780a2d90 0x7efd780a5250 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:14.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.803+0000 7efd937cc640 1 --2- 172.21.15.33:0/3837604487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd8c11b140 0x7efd8c110f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:14.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.803+0000 7efd937cc640 1 --2- 172.21.15.33:0/3837604487 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd8c109830 0x7efd8c1109f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:14.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.803+0000 7efd937cc640 1 --2- 172.21.15.33:0/3837604487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd8c109450 0x7efd8c118a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:14.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.803+0000 7efd937cc640 1 -- 172.21.15.33:0/3837604487 >> 172.21.15.33:0/3837604487 conn(0x7efd8c06e140 msgr2=0x7efd8c11c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:34:14.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.806+0000 7efd937cc640 1 -- 172.21.15.33:0/3837604487 shutdown_connections 2024-09-12T12:34:14.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:14.806+0000 7efd937cc640 1 -- 172.21.15.33:0/3837604487 wait complete. 2024-09-12T12:34:15.627 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T12:34:15.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:34:15 smithi102 ceph-mon[34799]: pgmap v597: 129 pgs: 129 active+clean; 10 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 37 MiB/s wr, 746 op/s 2024-09-12T12:34:15.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:34:15 smithi033 ceph-mon[31246]: pgmap v597: 129 pgs: 129 active+clean; 10 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 37 MiB/s wr, 746 op/s 2024-09-12T12:34:16.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:34:15 smithi043 ceph-mon[34144]: pgmap v597: 129 pgs: 129 active+clean; 10 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 37 MiB/s wr, 746 op/s 2024-09-12T12:34:16.308 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:34:16.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:16.978+0000 7f6e150e8640 1 -- 172.21.15.33:0/4195814063 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e10074eb0 msgr2=0x7f6e10112650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:16.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:16.978+0000 7f6e150e8640 1 --2- 172.21.15.33:0/4195814063 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e10074eb0 0x7f6e10112650 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6e04009900 tx=0x7f6e0402a490 comp rx=0 tx=0).stop 2024-09-12T12:34:16.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:16.986+0000 7f6e150e8640 1 -- 172.21.15.33:0/4195814063 shutdown_connections 2024-09-12T12:34:16.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:16.986+0000 7f6e150e8640 1 --2- 172.21.15.33:0/4195814063 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e10112b90 0x7f6e10114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:16.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:16.986+0000 7f6e150e8640 1 --2- 172.21.15.33:0/4195814063 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e10074eb0 0x7f6e10112650 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:16.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:16.986+0000 7f6e150e8640 1 --2- 172.21.15.33:0/4195814063 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e10074590 0x7f6e10074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:16.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:16.986+0000 7f6e150e8640 1 -- 172.21.15.33:0/4195814063 >> 172.21.15.33:0/4195814063 conn(0x7f6e100fd8c0 msgr2=0x7f6e100ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:34:16.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:16.986+0000 7f6e150e8640 1 -- 172.21.15.33:0/4195814063 shutdown_connections 2024-09-12T12:34:16.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:16.988+0000 7f6e150e8640 1 -- 172.21.15.33:0/4195814063 wait complete. 2024-09-12T12:34:16.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:16.989+0000 7f6e150e8640 1 Processor -- start 2024-09-12T12:34:16.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:16.989+0000 7f6e150e8640 1 -- start start 2024-09-12T12:34:16.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:16.989+0000 7f6e150e8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e10074590 0x7f6e10073cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:16.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:16.989+0000 7f6e150e8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e10074eb0 0x7f6e10071dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:16.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:16.989+0000 7f6e150e8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e10112b90 0x7f6e10072310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:16.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:16.989+0000 7f6e150e8640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6e1006c0e0 con 0x7f6e10074eb0 2024-09-12T12:34:16.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:16.989+0000 7f6e150e8640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6e1006bf60 con 0x7f6e10074590 2024-09-12T12:34:16.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:16.989+0000 7f6e150e8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6e1006c260 con 0x7f6e10112b90 2024-09-12T12:34:16.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:16.990+0000 7f6e0f59e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e10112b90 0x7f6e10072310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:16.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:16.990+0000 7f6e0f59e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e10112b90 0x7f6e10072310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:40790/0 (socket says 172.21.15.33:40790) 2024-09-12T12:34:16.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:16.990+0000 7f6e0f59e640 1 -- 172.21.15.33:0/3600794236 learned_addr learned my addr 172.21.15.33:0/3600794236 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:34:16.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:16.991+0000 7f6e0f59e640 1 -- 172.21.15.33:0/3600794236 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e10074590 msgr2=0x7f6e10073cc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T12:34:16.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:16.991+0000 7f6e0f59e640 1 --2- 172.21.15.33:0/3600794236 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e10074590 0x7f6e10073cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:16.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:16.991+0000 7f6e0f59e640 1 -- 172.21.15.33:0/3600794236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e10074eb0 msgr2=0x7f6e10071dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:16.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:16.991+0000 7f6e0f59e640 1 --2- 172.21.15.33:0/3600794236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e10074eb0 0x7f6e10071dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:16.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:16.991+0000 7f6e0f59e640 1 -- 172.21.15.33:0/3600794236 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e10072a40 con 0x7f6e10112b90 2024-09-12T12:34:16.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:16.991+0000 7f6e0f59e640 1 --2- 172.21.15.33:0/3600794236 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e10112b90 0x7f6e10072310 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6e0800e9d0 tx=0x7f6e0800ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:34:16.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:16.993+0000 7f6df7fff640 1 -- 172.21.15.33:0/3600794236 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e0800cd80 con 0x7f6e10112b90 2024-09-12T12:34:16.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:16.993+0000 7f6e150e8640 1 -- 172.21.15.33:0/3600794236 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e1010fe90 con 0x7f6e10112b90 2024-09-12T12:34:16.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:16.993+0000 7f6e150e8640 1 -- 172.21.15.33:0/3600794236 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e101103d0 con 0x7f6e10112b90 2024-09-12T12:34:16.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:16.993+0000 7f6df7fff640 1 -- 172.21.15.33:0/3600794236 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6e08005020 con 0x7f6e10112b90 2024-09-12T12:34:16.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:16.994+0000 7f6df7fff640 1 -- 172.21.15.33:0/3600794236 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e080116d0 con 0x7f6e10112b90 2024-09-12T12:34:17.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.000+0000 7f6e174c1740 1 Processor -- start 2024-09-12T12:34:17.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.000+0000 7f6e174c1740 1 -- start start 2024-09-12T12:34:17.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.000+0000 7f6e174c1740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b381f3cb40 0x55b381f3b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:17.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.000+0000 7f6e174c1740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b381f3b5d0 0x55b381f3ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:17.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.000+0000 7f6e174c1740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b381f46370 0x55b381f48760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:17.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.000+0000 7f6e174c1740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55b381ea12f0 con 0x55b381f3b5d0 2024-09-12T12:34:17.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.000+0000 7f6e174c1740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b381e48cf0 con 0x55b381f46370 2024-09-12T12:34:17.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.000+0000 7f6e174c1740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55b381e9d2b0 con 0x55b381f3cb40 2024-09-12T12:34:17.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.000+0000 7f6df7fff640 1 -- 172.21.15.33:0/3600794236 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6e08011870 con 0x7f6e10112b90 2024-09-12T12:34:17.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.002+0000 7f6df7fff640 1 --2- 172.21.15.33:0/3600794236 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f6df80a2d90 0x7f6df80a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:17.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.003+0000 7f6df7fff640 1 -- 172.21.15.33:0/3600794236 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f6e080d0530 con 0x7f6e10112b90 2024-09-12T12:34:17.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.008+0000 7f6e0f59e640 1 --2- 172.21.15.33:0/3600794236 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f6df80a2d90 0x7f6df80a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:17.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.012+0000 7f6e0f59e640 1 --2- 172.21.15.33:0/3600794236 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f6df80a2d90 0x7f6df80a5250 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6e0800c640 tx=0x7f6e080d0780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:34:17.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.014+0000 7f6e0ed9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b381f3b5d0 0x55b381f3ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:17.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.014+0000 7f6e0ed9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b381f3b5d0 0x55b381f3ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55064/0 (socket says 172.21.15.33:55064) 2024-09-12T12:34:17.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.014+0000 7f6e0ed9d640 1 -- 172.21.15.33:0/1030124990 learned_addr learned my addr 172.21.15.33:0/1030124990 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:34:17.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.014+0000 7f6e0ed9d640 1 -- 172.21.15.33:0/1030124990 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b381f3cb40 msgr2=0x55b381f3b090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:34:17.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.014+0000 7f6e0ed9d640 1 --2- 172.21.15.33:0/1030124990 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b381f3cb40 0x55b381f3b090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:17.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.014+0000 7f6e0ed9d640 1 -- 172.21.15.33:0/1030124990 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b381f46370 msgr2=0x55b381f48760 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:34:17.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.014+0000 7f6e0ed9d640 1 --2- 172.21.15.33:0/1030124990 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b381f46370 0x55b381f48760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:17.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.015+0000 7f6e0ed9d640 1 -- 172.21.15.33:0/1030124990 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b381e2d3a0 con 0x55b381f3b5d0 2024-09-12T12:34:17.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.015+0000 7f6e0ed9d640 1 --2- 172.21.15.33:0/1030124990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b381f3b5d0 0x55b381f3ba10 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f6e00009820 tx=0x7f6e00009ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba80037f6ae1ccd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:34:17.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.016+0000 7f6df57fa640 1 -- 172.21.15.33:0/1030124990 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e00015020 con 0x55b381f3b5d0 2024-09-12T12:34:17.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.017+0000 7f6df57fa640 1 -- 172.21.15.33:0/1030124990 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6e00011420 con 0x55b381f3b5d0 2024-09-12T12:34:17.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.018+0000 7f6e174c1740 1 -- 172.21.15.33:0/1030124990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b381f3b5d0 msgr2=0x55b381f3ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:17.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.018+0000 7f6e174c1740 1 --2- 172.21.15.33:0/1030124990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b381f3b5d0 0x55b381f3ba10 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f6e00009820 tx=0x7f6e00009ce0 comp rx=0 tx=0).stop 2024-09-12T12:34:17.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.026+0000 7f6e174c1740 1 -- 172.21.15.33:0/1030124990 shutdown_connections 2024-09-12T12:34:17.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.026+0000 7f6e174c1740 1 --2- 172.21.15.33:0/1030124990 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b381f46370 0x55b381f48760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:17.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.026+0000 7f6e174c1740 1 --2- 172.21.15.33:0/1030124990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b381f3b5d0 0x55b381f3ba10 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:17.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.026+0000 7f6e174c1740 1 --2- 172.21.15.33:0/1030124990 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b381f3cb40 0x55b381f3b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:17.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.026+0000 7f6e174c1740 1 -- 172.21.15.33:0/1030124990 >> 172.21.15.33:0/1030124990 conn(0x55b381f04310 msgr2=0x55b381f37c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:34:17.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.030+0000 7f6e174c1740 1 -- 172.21.15.33:0/1030124990 shutdown_connections 2024-09-12T12:34:17.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.032+0000 7f6e174c1740 1 -- 172.21.15.33:0/1030124990 wait complete. 2024-09-12T12:34:17.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.032+0000 7f6e174c1740 1 -- start start 2024-09-12T12:34:17.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.032+0000 7f6e174c1740 1 Processor -- start 2024-09-12T12:34:17.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.040+0000 7f6e174c1740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b381f3b5d0 0x55b381f45c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:17.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.040+0000 7f6e174c1740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b381f3cb40 0x55b381f42f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:17.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.040+0000 7f6e174c1740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b381f46370 0x55b381f43480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:17.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.040+0000 7f6e174c1740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55b381f490c0 con 0x55b381f46370 2024-09-12T12:34:17.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.040+0000 7f6e174c1740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b381e5c060 con 0x55b381f3cb40 2024-09-12T12:34:17.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.040+0000 7f6e174c1740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55b381f49240 con 0x55b381f3b5d0 2024-09-12T12:34:17.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.040+0000 7f6e174c1740 10 client.0 _ll_register_callbacks cb 0x55b381baf8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:34:17.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.041+0000 7f6e0e59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b381f3b5d0 0x55b381f45c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:17.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.041+0000 7f6e0e59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b381f3b5d0 0x55b381f45c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:40816/0 (socket says 172.21.15.33:40816) 2024-09-12T12:34:17.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.041+0000 7f6e0e59c640 1 -- 172.21.15.33:0/937319598 learned_addr learned my addr 172.21.15.33:0/937319598 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:34:17.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.042+0000 7f6e0ed9d640 1 --2- 172.21.15.33:0/937319598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b381f3cb40 0x55b381f42f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:17.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.042+0000 7f6e0e59c640 1 --2- 172.21.15.33:0/937319598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b381f46370 0x55b381f43480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:17.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.042+0000 7f6e0e59c640 1 -- 172.21.15.33:0/937319598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b381f3cb40 msgr2=0x55b381f42f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:34:17.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.042+0000 7f6e0e59c640 1 --2- 172.21.15.33:0/937319598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b381f3cb40 0x55b381f42f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:17.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.042+0000 7f6e0e59c640 1 -- 172.21.15.33:0/937319598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b381f46370 msgr2=0x55b381f43480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:34:17.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.042+0000 7f6e0e59c640 1 --2- 172.21.15.33:0/937319598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b381f46370 0x55b381f43480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:17.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.042+0000 7f6e0e59c640 1 -- 172.21.15.33:0/937319598 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b381c123c0 con 0x55b381f3b5d0 2024-09-12T12:34:17.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.044+0000 7f6e0e59c640 1 --2- 172.21.15.33:0/937319598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b381f3b5d0 0x55b381f45c90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6e040098d0 tx=0x7f6e04000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=540816e8ee113725 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:34:17.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.046+0000 7f6df2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:34:17.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.046+0000 7f6df2ff5640 1 -- 172.21.15.33:0/937319598 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e04043020 con 0x55b381f3b5d0 2024-09-12T12:34:17.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.046+0000 7f6e174c1740 1 -- 172.21.15.33:0/937319598 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e00011420 con 0x55b381f3b5d0 2024-09-12T12:34:17.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.046+0000 7f6df2ff5640 1 -- 172.21.15.33:0/937319598 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f6e04004450 con 0x55b381f3b5d0 2024-09-12T12:34:17.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.046+0000 7f6df2ff5640 1 -- 172.21.15.33:0/937319598 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6e0404e050 con 0x55b381f3b5d0 2024-09-12T12:34:17.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.046+0000 7f6e174c1740 10 client.25849 fetch_fsmap learned FSMap version 27 2024-09-12T12:34:17.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.046+0000 7f6e174c1740 1 -- 172.21.15.33:0/937319598 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b381f54b90 con 0x55b381f3b5d0 2024-09-12T12:34:17.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.050+0000 7f6df2ff5640 1 -- 172.21.15.33:0/937319598 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6e00011420 con 0x55b381f3b5d0 2024-09-12T12:34:17.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.051+0000 7f6df2ff5640 1 -- 172.21.15.33:0/937319598 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f6e0403e700 con 0x55b381f3b5d0 2024-09-12T12:34:17.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.051+0000 7f6e174c1740 10 client.25849 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:34:17.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.051+0000 7f6e174c1740 10 client.25849 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:34:17.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.051+0000 7f6e174c1740 20 client.25849 populate_metadata read hostname 'smithi033' 2024-09-12T12:34:17.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.051+0000 7f6e174c1740 1 --2- 172.21.15.33:0/937319598 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55b381f564f0 0x55b381f58990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:17.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.051+0000 7f6e174c1740 4 client.25849 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:34:17.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.051+0000 7f6e174c1740 1 -- 172.21.15.33:0/937319598 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b381eae860 con 0x55b381f564f0 2024-09-12T12:34:17.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.051+0000 7f6e0ed9d640 1 --2- 172.21.15.33:0/937319598 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55b381f564f0 0x55b381f58990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:17.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.052+0000 7f6e0ed9d640 1 --2- 172.21.15.33:0/937319598 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55b381f564f0 0x55b381f58990 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87686d46141cbeac server_cookie=5ffc0673b628a296 in_seq=0 out_seq=0 2024-09-12T12:34:17.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.052+0000 7f6df2ff5640 10 client.25849 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:34:17.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.053+0000 7f6df2ff5640 1 -- 172.21.15.33:0/937319598 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b381eae860 con 0x55b381f564f0 2024-09-12T12:34:17.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.053+0000 7f6df2ff5640 10 client.25849 handle_command_reply: tid=0 2024-09-12T12:34:17.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.053+0000 7f6e174c1740 1 client.25849 shutdown 2024-09-12T12:34:17.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.055+0000 7f6e174c1740 1 -- 172.21.15.33:0/937319598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b381f3b5d0 msgr2=0x55b381f45c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:17.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.055+0000 7f6e174c1740 1 --2- 172.21.15.33:0/937319598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b381f3b5d0 0x55b381f45c90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6e040098d0 tx=0x7f6e04000bc0 comp rx=0 tx=0).stop 2024-09-12T12:34:17.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.058+0000 7f6e174c1740 1 -- 172.21.15.33:0/937319598 shutdown_connections 2024-09-12T12:34:17.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.058+0000 7f6e174c1740 1 --2- 172.21.15.33:0/937319598 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55b381f564f0 0x55b381f58990 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:17.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.058+0000 7f6e174c1740 1 --2- 172.21.15.33:0/937319598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b381f46370 0x55b381f43480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:17.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.058+0000 7f6e174c1740 1 --2- 172.21.15.33:0/937319598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b381f3cb40 0x55b381f42f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:17.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.058+0000 7f6e174c1740 1 --2- 172.21.15.33:0/937319598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b381f3b5d0 0x55b381f45c90 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:17.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.058+0000 7f6df2ff5640 0 client.25849 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:34:17.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.058+0000 7f6e174c1740 1 -- 172.21.15.33:0/937319598 >> 172.21.15.33:0/937319598 conn(0x55b381f04310 msgr2=0x55b381f3d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:34:17.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.063+0000 7f6e174c1740 1 -- 172.21.15.33:0/937319598 shutdown_connections 2024-09-12T12:34:17.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.063+0000 7f6e174c1740 1 -- 172.21.15.33:0/937319598 wait complete. 2024-09-12T12:34:17.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.063+0000 7f6e174c1740 20 client.25849 trim_cache size 0 max 16384 2024-09-12T12:34:17.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.093+0000 7f6e174c1740 1 Processor -- start 2024-09-12T12:34:17.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.093+0000 7f6e174c1740 1 -- start start 2024-09-12T12:34:17.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.093+0000 7f6e174c1740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b381f3b5d0 0x55b381f36bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:17.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.093+0000 7f6e174c1740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b381f3cb40 0x55b381f47760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:17.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.093+0000 7f6e174c1740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b381f46370 0x55b381f47ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:17.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.094+0000 7f6e174c1740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6dfc0125c0 con 0x55b381f3cb40 2024-09-12T12:34:17.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.094+0000 7f6e174c1740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6dfc00fe90 con 0x55b381f46370 2024-09-12T12:34:17.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.094+0000 7f6e174c1740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6dfc00dce0 con 0x55b381f3b5d0 2024-09-12T12:34:17.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.094+0000 7f6e0e59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b381f3b5d0 0x55b381f36bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:17.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.094+0000 7f6e0e59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b381f3b5d0 0x55b381f36bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:40818/0 (socket says 172.21.15.33:40818) 2024-09-12T12:34:17.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.094+0000 7f6e0e59c640 1 -- 172.21.15.33:0/671898445 learned_addr learned my addr 172.21.15.33:0/671898445 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:34:17.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.094+0000 7f6e0e59c640 1 --2- 172.21.15.33:0/671898445 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b381f46370 0x55b381f47ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:17.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.094+0000 7f6e0ed9d640 1 --2- 172.21.15.33:0/671898445 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b381f3cb40 0x55b381f47760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:17.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.094+0000 7f6e0e59c640 1 -- 172.21.15.33:0/671898445 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b381f46370 msgr2=0x55b381f47ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:34:17.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.094+0000 7f6e0e59c640 1 --2- 172.21.15.33:0/671898445 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b381f46370 0x55b381f47ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:17.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.094+0000 7f6e0e59c640 1 -- 172.21.15.33:0/671898445 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b381f3cb40 msgr2=0x55b381f47760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:34:17.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.094+0000 7f6e0e59c640 1 --2- 172.21.15.33:0/671898445 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b381f3cb40 0x55b381f47760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:17.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.095+0000 7f6e0e59c640 1 -- 172.21.15.33:0/671898445 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b381f59010 con 0x55b381f3b5d0 2024-09-12T12:34:17.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.098+0000 7f6e0e59c640 1 --2- 172.21.15.33:0/671898445 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b381f3b5d0 0x55b381f36bf0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6e040096c0 tx=0x7f6e04031400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66793a46a7de9d3c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:34:17.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.099+0000 7f6df4ff9640 1 -- 172.21.15.33:0/671898445 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e04043070 con 0x55b381f3b5d0 2024-09-12T12:34:17.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.099+0000 7f6df4ff9640 1 -- 172.21.15.33:0/671898445 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6e0403ee90 con 0x55b381f3b5d0 2024-09-12T12:34:17.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.100+0000 7f6e174c1740 1 -- 172.21.15.33:0/671898445 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b381f3b5d0 msgr2=0x55b381f36bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:17.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.100+0000 7f6e174c1740 1 --2- 172.21.15.33:0/671898445 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b381f3b5d0 0x55b381f36bf0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6e040096c0 tx=0x7f6e04031400 comp rx=0 tx=0).stop 2024-09-12T12:34:17.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.100+0000 7f6e174c1740 1 -- 172.21.15.33:0/671898445 shutdown_connections 2024-09-12T12:34:17.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.100+0000 7f6e174c1740 1 --2- 172.21.15.33:0/671898445 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b381f46370 0x55b381f47ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:17.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.100+0000 7f6e174c1740 1 --2- 172.21.15.33:0/671898445 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b381f3cb40 0x55b381f47760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:17.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.100+0000 7f6e174c1740 1 --2- 172.21.15.33:0/671898445 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b381f3b5d0 0x55b381f36bf0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:17.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.100+0000 7f6e174c1740 1 -- 172.21.15.33:0/671898445 >> 172.21.15.33:0/671898445 conn(0x55b381f04310 msgr2=0x55b381f364e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:34:17.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.102+0000 7f6e174c1740 1 -- 172.21.15.33:0/671898445 shutdown_connections 2024-09-12T12:34:17.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.102+0000 7f6e174c1740 1 -- 172.21.15.33:0/671898445 wait complete. 2024-09-12T12:34:17.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.102+0000 7f6e174c1740 1 -- start start 2024-09-12T12:34:17.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.102+0000 7f6e174c1740 1 Processor -- start 2024-09-12T12:34:17.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.103+0000 7f6e174c1740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b381f3b5d0 0x55b381f4e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:17.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.103+0000 7f6e174c1740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b381f3cb40 0x55b381f4ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:17.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.103+0000 7f6e174c1740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b381f46370 0x55b381f46d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:17.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.103+0000 7f6e174c1740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6dfc00e350 con 0x55b381f3b5d0 2024-09-12T12:34:17.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.103+0000 7f6e174c1740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6dfc00f7c0 con 0x55b381f3cb40 2024-09-12T12:34:17.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.103+0000 7f6e174c1740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6dfc00ea20 con 0x55b381f46370 2024-09-12T12:34:17.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.103+0000 7f6e174c1740 10 client.0 _ll_register_callbacks cb 0x7f6e04009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:34:17.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.103+0000 7f6e0ed9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b381f3cb40 0x55b381f4ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:17.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.103+0000 7f6e0ed9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b381f3cb40 0x55b381f4ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:38640/0 (socket says 172.21.15.33:38640) 2024-09-12T12:34:17.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.103+0000 7f6e0ed9d640 1 -- 172.21.15.33:0/941045028 learned_addr learned my addr 172.21.15.33:0/941045028 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:34:17.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.104+0000 7f6e0ed9d640 1 -- 172.21.15.33:0/941045028 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b381f46370 msgr2=0x55b381f46d40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:34:17.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.104+0000 7f6e0ed9d640 1 --2- 172.21.15.33:0/941045028 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b381f46370 0x55b381f46d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:17.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.104+0000 7f6e0ed9d640 1 -- 172.21.15.33:0/941045028 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b381f3b5d0 msgr2=0x55b381f4e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:34:17.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.104+0000 7f6e0ed9d640 1 --2- 172.21.15.33:0/941045028 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b381f3b5d0 0x55b381f4e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:17.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.104+0000 7f6e0ed9d640 1 -- 172.21.15.33:0/941045028 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b381f47570 con 0x55b381f3cb40 2024-09-12T12:34:17.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.104+0000 7f6e0ed9d640 1 --2- 172.21.15.33:0/941045028 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b381f3cb40 0x55b381f4ed50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6e0000b4b0 tx=0x7f6e00011c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae0510a564fe4008 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:34:17.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.104+0000 7f6df2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:34:17.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.104+0000 7f6df2ff5640 1 -- 172.21.15.33:0/941045028 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e00015040 con 0x55b381f3cb40 2024-09-12T12:34:17.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.105+0000 7f6e174c1740 1 -- 172.21.15.33:0/941045028 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e0403ee90 con 0x55b381f3cb40 2024-09-12T12:34:17.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.105+0000 7f6df2ff5640 1 -- 172.21.15.33:0/941045028 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f6e0000bad0 con 0x55b381f3cb40 2024-09-12T12:34:17.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.105+0000 7f6df2ff5640 1 -- 172.21.15.33:0/941045028 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6e00032050 con 0x55b381f3cb40 2024-09-12T12:34:17.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.105+0000 7f6e174c1740 10 client.25769 fetch_fsmap learned FSMap version 27 2024-09-12T12:34:17.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.105+0000 7f6e174c1740 1 -- 172.21.15.33:0/941045028 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b381f4e130 con 0x55b381f3cb40 2024-09-12T12:34:17.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.105+0000 7f6df2ff5640 1 -- 172.21.15.33:0/941045028 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6e0403ee90 con 0x55b381f3cb40 2024-09-12T12:34:17.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.107+0000 7f6df2ff5640 1 -- 172.21.15.33:0/941045028 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f6e00010810 con 0x55b381f3cb40 2024-09-12T12:34:17.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.107+0000 7f6e174c1740 10 client.25769 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:34:17.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.107+0000 7f6e174c1740 10 client.25769 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:34:17.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.107+0000 7f6e174c1740 20 client.25769 populate_metadata read hostname 'smithi033' 2024-09-12T12:34:17.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.107+0000 7f6e174c1740 1 --2- 172.21.15.33:0/941045028 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55b381fc1390 0x55b381fc37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:17.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.107+0000 7f6e174c1740 4 client.25769 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:34:17.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.107+0000 7f6e174c1740 1 -- 172.21.15.33:0/941045028 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b381ea8d70 con 0x55b381fc1390 2024-09-12T12:34:17.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.107+0000 7f6e0e59c640 1 --2- 172.21.15.33:0/941045028 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55b381fc1390 0x55b381fc37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:17.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.109+0000 7f6e0e59c640 1 --2- 172.21.15.33:0/941045028 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55b381fc1390 0x55b381fc37c0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27886b493c5609f3 server_cookie=17d982ccb2cf1060 in_seq=0 out_seq=0 2024-09-12T12:34:17.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.110+0000 7f6df2ff5640 10 client.25769 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:34:17.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.111+0000 7f6df2ff5640 1 -- 172.21.15.33:0/941045028 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b381ea8d70 con 0x55b381fc1390 2024-09-12T12:34:17.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.111+0000 7f6df2ff5640 10 client.25769 handle_command_reply: tid=0 2024-09-12T12:34:17.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.111+0000 7f6e174c1740 1 client.25769 shutdown 2024-09-12T12:34:17.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.113+0000 7f6e174c1740 1 -- 172.21.15.33:0/941045028 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b381f3cb40 msgr2=0x55b381f4ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:17.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.113+0000 7f6e174c1740 1 --2- 172.21.15.33:0/941045028 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b381f3cb40 0x55b381f4ed50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6e0000b4b0 tx=0x7f6e00011c30 comp rx=0 tx=0).stop 2024-09-12T12:34:17.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.113+0000 7f6e174c1740 1 -- 172.21.15.33:0/941045028 shutdown_connections 2024-09-12T12:34:17.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.113+0000 7f6e174c1740 1 --2- 172.21.15.33:0/941045028 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55b381fc1390 0x55b381fc37c0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:17.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.113+0000 7f6e174c1740 1 --2- 172.21.15.33:0/941045028 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b381f46370 0x55b381f46d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:17.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.113+0000 7f6e174c1740 1 --2- 172.21.15.33:0/941045028 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b381f3cb40 0x55b381f4ed50 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:17.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.113+0000 7f6e174c1740 1 --2- 172.21.15.33:0/941045028 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b381f3b5d0 0x55b381f4e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:17.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.113+0000 7f6e174c1740 1 -- 172.21.15.33:0/941045028 >> 172.21.15.33:0/941045028 conn(0x55b381f04310 msgr2=0x55b381f36d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:34:17.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.113+0000 7f6df2ff5640 0 client.25769 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:34:17.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.114+0000 7f6e174c1740 1 -- 172.21.15.33:0/941045028 shutdown_connections 2024-09-12T12:34:17.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.114+0000 7f6e174c1740 1 -- 172.21.15.33:0/941045028 wait complete. 2024-09-12T12:34:17.117 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-09-12T12:34:17.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.114+0000 7f6e174c1740 20 client.25769 trim_cache size 0 max 16384 2024-09-12T12:34:17.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.118+0000 7f6e150e8640 1 -- 172.21.15.33:0/3600794236 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f6df80a2d90 msgr2=0x7f6df80a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:17.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.118+0000 7f6e150e8640 1 --2- 172.21.15.33:0/3600794236 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f6df80a2d90 0x7f6df80a5250 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6e0800c640 tx=0x7f6e080d0780 comp rx=0 tx=0).stop 2024-09-12T12:34:17.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.118+0000 7f6e150e8640 1 -- 172.21.15.33:0/3600794236 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e10112b90 msgr2=0x7f6e10072310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:17.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.118+0000 7f6e150e8640 1 --2- 172.21.15.33:0/3600794236 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e10112b90 0x7f6e10072310 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6e0800e9d0 tx=0x7f6e0800ee90 comp rx=0 tx=0).stop 2024-09-12T12:34:17.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.118+0000 7f6e150e8640 1 -- 172.21.15.33:0/3600794236 shutdown_connections 2024-09-12T12:34:17.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.118+0000 7f6e150e8640 1 --2- 172.21.15.33:0/3600794236 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f6df80a2d90 0x7f6df80a5250 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:17.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.118+0000 7f6e150e8640 1 --2- 172.21.15.33:0/3600794236 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e10112b90 0x7f6e10072310 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:17.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.118+0000 7f6e150e8640 1 --2- 172.21.15.33:0/3600794236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e10074eb0 0x7f6e10071dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:17.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.118+0000 7f6e150e8640 1 --2- 172.21.15.33:0/3600794236 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e10074590 0x7f6e10073cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:17.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.118+0000 7f6e150e8640 1 -- 172.21.15.33:0/3600794236 >> 172.21.15.33:0/3600794236 conn(0x7f6e100fd8c0 msgr2=0x7f6e100ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:34:17.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.118+0000 7f6e150e8640 1 -- 172.21.15.33:0/3600794236 shutdown_connections 2024-09-12T12:34:17.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:17.118+0000 7f6e150e8640 1 -- 172.21.15.33:0/3600794236 wait complete. 2024-09-12T12:34:17.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:34:17 smithi102 ceph-mon[34799]: pgmap v598: 129 pgs: 129 active+clean; 10 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 30 MiB/s wr, 589 op/s 2024-09-12T12:34:17.983 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:34:17 smithi033 ceph-mon[31246]: pgmap v598: 129 pgs: 129 active+clean; 10 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 30 MiB/s wr, 589 op/s 2024-09-12T12:34:18.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:34:17 smithi043 ceph-mon[34144]: pgmap v598: 129 pgs: 129 active+clean; 10 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 30 MiB/s wr, 589 op/s 2024-09-12T12:34:19.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:34:19 smithi033 ceph-mon[31246]: pgmap v599: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 38 MiB/s wr, 761 op/s 2024-09-12T12:34:20.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:34:19 smithi043 ceph-mon[34144]: pgmap v599: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 38 MiB/s wr, 761 op/s 2024-09-12T12:34:20.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:34:19 smithi102 ceph-mon[34799]: pgmap v599: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 38 MiB/s wr, 761 op/s 2024-09-12T12:34:21.913 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:34:21 smithi033 ceph-mon[31246]: pgmap v600: 129 pgs: 129 active+clean; 10 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 29 MiB/s wr, 578 op/s 2024-09-12T12:34:22.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:34:21 smithi043 ceph-mon[34144]: pgmap v600: 129 pgs: 129 active+clean; 10 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 29 MiB/s wr, 578 op/s 2024-09-12T12:34:22.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:34:21 smithi102 ceph-mon[34799]: pgmap v600: 129 pgs: 129 active+clean; 10 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 29 MiB/s wr, 578 op/s 2024-09-12T12:34:23.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:34:23 smithi033 ceph-mon[31246]: pgmap v601: 129 pgs: 129 active+clean; 10 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 31 MiB/s wr, 624 op/s 2024-09-12T12:34:24.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:34:23 smithi043 ceph-mon[34144]: pgmap v601: 129 pgs: 129 active+clean; 10 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 31 MiB/s wr, 624 op/s 2024-09-12T12:34:24.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:34:23 smithi102 ceph-mon[34799]: pgmap v601: 129 pgs: 129 active+clean; 10 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 31 MiB/s wr, 624 op/s 2024-09-12T12:34:25.324 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T12:34:25.325 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T12:34:25.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:34:25 smithi033 ceph-mon[31246]: pgmap v602: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 34 MiB/s wr, 681 op/s 2024-09-12T12:34:25.993 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:34:26.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:34:25 smithi043 ceph-mon[34144]: pgmap v602: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 34 MiB/s wr, 681 op/s 2024-09-12T12:34:26.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:34:25 smithi102 ceph-mon[34799]: pgmap v602: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 34 MiB/s wr, 681 op/s 2024-09-12T12:34:27.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.642+0000 7f68c0110640 1 -- 172.21.15.33:0/3977755222 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68b8105560 msgr2=0x7f68b810d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:27.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.642+0000 7f68c0110640 1 --2- 172.21.15.33:0/3977755222 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68b8105560 0x7f68b810d0e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f68b400da00 tx=0x7f68b402e6c0 comp rx=0 tx=0).stop 2024-09-12T12:34:27.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.642+0000 7f68c0110640 1 -- 172.21.15.33:0/3977755222 shutdown_connections 2024-09-12T12:34:27.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.642+0000 7f68c0110640 1 --2- 172.21.15.33:0/3977755222 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68b8105560 0x7f68b810d0e0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:27.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.642+0000 7f68c0110640 1 --2- 172.21.15.33:0/3977755222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f68b8100de0 0x7f68b8104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:27.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.642+0000 7f68c0110640 1 --2- 172.21.15.33:0/3977755222 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68b8100430 0x7f68b8100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:27.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.642+0000 7f68c0110640 1 -- 172.21.15.33:0/3977755222 >> 172.21.15.33:0/3977755222 conn(0x7f68b8077230 msgr2=0x7f68b80fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:34:27.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.647+0000 7f68c0110640 1 -- 172.21.15.33:0/3977755222 shutdown_connections 2024-09-12T12:34:27.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.648+0000 7f68c0110640 1 -- 172.21.15.33:0/3977755222 wait complete. 2024-09-12T12:34:27.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.649+0000 7f68c0110640 1 Processor -- start 2024-09-12T12:34:27.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.649+0000 7f68c0110640 1 -- start start 2024-09-12T12:34:27.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.649+0000 7f68c0110640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68b8100430 0x7f68b806d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:27.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.649+0000 7f68c0110640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f68b8100de0 0x7f68b806dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:27.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.649+0000 7f68c0110640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68b8071f90 0x7f68b8072440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:27.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.649+0000 7f68c0110640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f68b806c0e0 con 0x7f68b8071f90 2024-09-12T12:34:27.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.649+0000 7f68c0110640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f68b806bf60 con 0x7f68b8100de0 2024-09-12T12:34:27.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.649+0000 7f68c0110640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f68b806c260 con 0x7f68b8100430 2024-09-12T12:34:27.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.650+0000 7f68bd6ab640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f68b8100de0 0x7f68b806dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:27.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.650+0000 7f68bdeac640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68b8100430 0x7f68b806d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:27.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.650+0000 7f68bd6ab640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f68b8100de0 0x7f68b806dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:48984/0 (socket says 172.21.15.33:48984) 2024-09-12T12:34:27.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.650+0000 7f68bd6ab640 1 -- 172.21.15.33:0/91484464 learned_addr learned my addr 172.21.15.33:0/91484464 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:34:27.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.650+0000 7f68be6ad640 1 --2- 172.21.15.33:0/91484464 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68b8071f90 0x7f68b8072440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:27.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.650+0000 7f68bd6ab640 1 -- 172.21.15.33:0/91484464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68b8100430 msgr2=0x7f68b806d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:27.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.650+0000 7f68bd6ab640 1 --2- 172.21.15.33:0/91484464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68b8100430 0x7f68b806d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:27.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.650+0000 7f68bd6ab640 1 -- 172.21.15.33:0/91484464 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68b8071f90 msgr2=0x7f68b8072440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:27.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.650+0000 7f68bd6ab640 1 --2- 172.21.15.33:0/91484464 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68b8071f90 0x7f68b8072440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:27.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.650+0000 7f68bd6ab640 1 -- 172.21.15.33:0/91484464 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68b8072980 con 0x7f68b8100de0 2024-09-12T12:34:27.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.650+0000 7f68bd6ab640 1 --2- 172.21.15.33:0/91484464 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f68b8100de0 0x7f68b806dc00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f68b000ba80 tx=0x7f68b000bf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:34:27.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.653+0000 7f68aeffd640 1 -- 172.21.15.33:0/91484464 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b0019070 con 0x7f68b8100de0 2024-09-12T12:34:27.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.653+0000 7f68c0110640 1 -- 172.21.15.33:0/91484464 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68b8072c70 con 0x7f68b8100de0 2024-09-12T12:34:27.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.653+0000 7f68c0110640 1 -- 172.21.15.33:0/91484464 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68b81ab7a0 con 0x7f68b8100de0 2024-09-12T12:34:27.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.654+0000 7f68aeffd640 1 -- 172.21.15.33:0/91484464 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f68b000cc00 con 0x7f68b8100de0 2024-09-12T12:34:27.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.654+0000 7f68aeffd640 1 -- 172.21.15.33:0/91484464 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b00075d0 con 0x7f68b8100de0 2024-09-12T12:34:27.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.658+0000 7f68aeffd640 1 -- 172.21.15.33:0/91484464 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f68b001c070 con 0x7f68b8100de0 2024-09-12T12:34:27.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.660+0000 7f68aeffd640 1 --2- 172.21.15.33:0/91484464 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f68a40a2d90 0x7f68a40a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:27.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.660+0000 7f68aeffd640 1 -- 172.21.15.33:0/91484464 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f68b00cf830 con 0x7f68b8100de0 2024-09-12T12:34:27.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.661+0000 7f68c24e9740 1 Processor -- start 2024-09-12T12:34:27.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.661+0000 7f68c24e9740 1 -- start start 2024-09-12T12:34:27.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.662+0000 7f68c24e9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568f2042b60 0x5568f2042f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:27.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.662+0000 7f68c24e9740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568f2043480 0x5568f204d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:27.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.662+0000 7f68c24e9740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568f204dd40 0x5568f2050130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:27.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.662+0000 7f68c24e9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5568f1fa8280 con 0x5568f2042b60 2024-09-12T12:34:27.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.662+0000 7f68c24e9740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5568f1f4fb10 con 0x5568f204dd40 2024-09-12T12:34:27.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.662+0000 7f68be6ad640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568f204dd40 0x5568f2050130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:27.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.662+0000 7f68be6ad640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568f204dd40 0x5568f2050130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:48986/0 (socket says 172.21.15.33:48986) 2024-09-12T12:34:27.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.662+0000 7f68be6ad640 1 -- 172.21.15.33:0/3553522661 learned_addr learned my addr 172.21.15.33:0/3553522661 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:34:27.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.663+0000 7f68bd6ab640 1 --2- 172.21.15.33:0/3553522661 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568f2043480 0x5568f204d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:27.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.662+0000 7f68c24e9740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5568f1fa4240 con 0x5568f2043480 2024-09-12T12:34:27.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.665+0000 7f68be6ad640 1 -- 172.21.15.33:0/3553522661 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568f2043480 msgr2=0x5568f204d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:34:27.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.665+0000 7f68be6ad640 1 --2- 172.21.15.33:0/3553522661 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568f2043480 0x5568f204d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:27.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.665+0000 7f68be6ad640 1 -- 172.21.15.33:0/3553522661 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568f2042b60 msgr2=0x5568f2042f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:34:27.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.665+0000 7f68be6ad640 1 --2- 172.21.15.33:0/3553522661 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568f2042b60 0x5568f2042f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:27.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.665+0000 7f68be6ad640 1 -- 172.21.15.33:0/3553522661 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568f1f5c1f0 con 0x5568f204dd40 2024-09-12T12:34:27.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.665+0000 7f68be6ad640 1 --2- 172.21.15.33:0/3553522661 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568f204dd40 0x5568f2050130 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f68b400da00 tx=0x7f68b400d6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6369c2d35b45f835 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:34:27.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.666+0000 7f68bdeac640 1 --2- 172.21.15.33:0/91484464 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f68a40a2d90 0x7f68a40a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:27.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.666+0000 7f68a3fff640 1 -- 172.21.15.33:0/3553522661 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b4039040 con 0x5568f204dd40 2024-09-12T12:34:27.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.666+0000 7f68a3fff640 1 -- 172.21.15.33:0/3553522661 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f68b4033ec0 con 0x5568f204dd40 2024-09-12T12:34:27.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.667+0000 7f68c24e9740 1 -- 172.21.15.33:0/3553522661 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568f204dd40 msgr2=0x5568f2050130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:27.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.667+0000 7f68c24e9740 1 --2- 172.21.15.33:0/3553522661 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568f204dd40 0x5568f2050130 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f68b400da00 tx=0x7f68b400d6e0 comp rx=0 tx=0).stop 2024-09-12T12:34:27.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.667+0000 7f68c24e9740 1 -- 172.21.15.33:0/3553522661 shutdown_connections 2024-09-12T12:34:27.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.667+0000 7f68c24e9740 1 --2- 172.21.15.33:0/3553522661 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568f204dd40 0x5568f2050130 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:27.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.667+0000 7f68c24e9740 1 --2- 172.21.15.33:0/3553522661 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568f2043480 0x5568f204d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:27.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.667+0000 7f68c24e9740 1 --2- 172.21.15.33:0/3553522661 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568f2042b60 0x5568f2042f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:27.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.667+0000 7f68c24e9740 1 -- 172.21.15.33:0/3553522661 >> 172.21.15.33:0/3553522661 conn(0x5568f203f0f0 msgr2=0x5568f203f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:34:27.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.670+0000 7f68c24e9740 1 -- 172.21.15.33:0/3553522661 shutdown_connections 2024-09-12T12:34:27.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.670+0000 7f68c24e9740 1 -- 172.21.15.33:0/3553522661 wait complete. 2024-09-12T12:34:27.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.670+0000 7f68c24e9740 1 -- start start 2024-09-12T12:34:27.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.670+0000 7f68c24e9740 1 Processor -- start 2024-09-12T12:34:27.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.671+0000 7f68c24e9740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568f2042b60 0x5568f204fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:27.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.671+0000 7f68c24e9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568f2043480 0x5568f204d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:27.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.671+0000 7f68c24e9740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568f204d6b0 0x5568f204db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:27.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.671+0000 7f68c24e9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5568f20509b0 con 0x5568f2043480 2024-09-12T12:34:27.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.671+0000 7f68c24e9740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5568f1f62f10 con 0x5568f2042b60 2024-09-12T12:34:27.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.671+0000 7f68c24e9740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5568f2050b30 con 0x5568f204d6b0 2024-09-12T12:34:27.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.671+0000 7f68c24e9740 10 client.0 _ll_register_callbacks cb 0x5568f1f2ba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:34:27.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.672+0000 7f68be6ad640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568f204d6b0 0x5568f204db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:27.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.672+0000 7f68bdeac640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568f2042b60 0x5568f204fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:27.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.672+0000 7f68bdeac640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568f2042b60 0x5568f204fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:48998/0 (socket says 172.21.15.33:48998) 2024-09-12T12:34:27.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.672+0000 7f68bdeac640 1 -- 172.21.15.33:0/220271017 learned_addr learned my addr 172.21.15.33:0/220271017 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:34:27.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.672+0000 7f68bd6ab640 1 --2- 172.21.15.33:0/220271017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568f2043480 0x5568f204d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:27.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.673+0000 7f68bdeac640 1 --2- 172.21.15.33:0/91484464 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f68a40a2d90 0x7f68a40a5250 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f68a8006fd0 tx=0x7f68a8006d60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:34:27.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.673+0000 7f68bdeac640 1 -- 172.21.15.33:0/220271017 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568f204d6b0 msgr2=0x5568f204db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:34:27.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.673+0000 7f68bdeac640 1 --2- 172.21.15.33:0/220271017 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568f204d6b0 0x5568f204db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:27.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.673+0000 7f68bdeac640 1 -- 172.21.15.33:0/220271017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568f2043480 msgr2=0x5568f204d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:34:27.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.673+0000 7f68bdeac640 1 --2- 172.21.15.33:0/220271017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568f2043480 0x5568f204d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:27.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.673+0000 7f68bdeac640 1 -- 172.21.15.33:0/220271017 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568f1d196a0 con 0x5568f2042b60 2024-09-12T12:34:27.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.673+0000 7f68bdeac640 1 --2- 172.21.15.33:0/220271017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568f2042b60 0x5568f204fec0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f68a800dd50 tx=0x7f68a8006ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=211342d1eac32a48 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:34:27.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.673+0000 7f68a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:34:27.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.673+0000 7f68a17fa640 1 -- 172.21.15.33:0/220271017 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a8021030 con 0x5568f2042b60 2024-09-12T12:34:27.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.674+0000 7f68a17fa640 1 -- 172.21.15.33:0/220271017 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f68a800f040 con 0x5568f2042b60 2024-09-12T12:34:27.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.674+0000 7f68c24e9740 1 -- 172.21.15.33:0/220271017 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5568f1fb57f0 con 0x5568f2042b60 2024-09-12T12:34:27.693 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:34:27 smithi033 ceph-mon[31246]: pgmap v603: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 26 MiB/s wr, 522 op/s 2024-09-12T12:34:27.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.688+0000 7f68a17fa640 1 -- 172.21.15.33:0/220271017 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f68a800dd80 con 0x5568f2042b60 2024-09-12T12:34:27.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.688+0000 7f68c24e9740 10 client.25778 fetch_fsmap learned FSMap version 27 2024-09-12T12:34:27.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.688+0000 7f68c24e9740 1 -- 172.21.15.33:0/220271017 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5568f205c7a0 con 0x5568f2042b60 2024-09-12T12:34:27.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.691+0000 7f68a17fa640 1 -- 172.21.15.33:0/220271017 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x5568f1fb57f0 con 0x5568f2042b60 2024-09-12T12:34:27.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.692+0000 7f68a17fa640 1 -- 172.21.15.33:0/220271017 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f68a80253a0 con 0x5568f2042b60 2024-09-12T12:34:27.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.692+0000 7f68c24e9740 10 client.25778 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:34:27.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.692+0000 7f68c24e9740 10 client.25778 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:34:27.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.692+0000 7f68c24e9740 20 client.25778 populate_metadata read hostname 'smithi033' 2024-09-12T12:34:27.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.692+0000 7f68c24e9740 1 --2- 172.21.15.33:0/220271017 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5568f205e170 0x5568f2060630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:27.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.692+0000 7f68c24e9740 4 client.25778 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:34:27.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.692+0000 7f68c24e9740 1 -- 172.21.15.33:0/220271017 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5568f1fafd00 con 0x5568f205e170 2024-09-12T12:34:27.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.693+0000 7f68bd6ab640 1 --2- 172.21.15.33:0/220271017 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5568f205e170 0x5568f2060630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:27.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.698+0000 7f68bd6ab640 1 --2- 172.21.15.33:0/220271017 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5568f205e170 0x5568f2060630 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba6dd50517c43083 server_cookie=fe2dcd71e9628fd0 in_seq=0 out_seq=0 2024-09-12T12:34:27.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.698+0000 7f68a17fa640 10 client.25778 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:34:27.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.699+0000 7f68a17fa640 1 -- 172.21.15.33:0/220271017 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5568f1fafd00 con 0x5568f205e170 2024-09-12T12:34:27.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.699+0000 7f68a17fa640 10 client.25778 handle_command_reply: tid=0 2024-09-12T12:34:27.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.699+0000 7f68c24e9740 1 client.25778 shutdown 2024-09-12T12:34:27.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.700+0000 7f68c24e9740 1 -- 172.21.15.33:0/220271017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568f2042b60 msgr2=0x5568f204fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:27.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.700+0000 7f68c24e9740 1 --2- 172.21.15.33:0/220271017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568f2042b60 0x5568f204fec0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f68a800dd50 tx=0x7f68a8006ad0 comp rx=0 tx=0).stop 2024-09-12T12:34:27.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.700+0000 7f68c24e9740 1 -- 172.21.15.33:0/220271017 shutdown_connections 2024-09-12T12:34:27.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.700+0000 7f68c24e9740 1 --2- 172.21.15.33:0/220271017 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5568f205e170 0x5568f2060630 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:27.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.700+0000 7f68c24e9740 1 --2- 172.21.15.33:0/220271017 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568f204d6b0 0x5568f204db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:27.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.700+0000 7f68c24e9740 1 --2- 172.21.15.33:0/220271017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568f2043480 0x5568f204d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:27.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.700+0000 7f68c24e9740 1 --2- 172.21.15.33:0/220271017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568f2042b60 0x5568f204fec0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:27.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.700+0000 7f68c24e9740 1 -- 172.21.15.33:0/220271017 >> 172.21.15.33:0/220271017 conn(0x5568f203f0f0 msgr2=0x5568f2044e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:34:27.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.706+0000 7f68a17fa640 0 client.25778 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:34:27.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.706+0000 7f68c24e9740 1 -- 172.21.15.33:0/220271017 shutdown_connections 2024-09-12T12:34:27.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.706+0000 7f68c24e9740 1 -- 172.21.15.33:0/220271017 wait complete. 2024-09-12T12:34:27.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.707+0000 7f68c24e9740 20 client.25778 trim_cache size 0 max 16384 2024-09-12T12:34:27.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.743+0000 7f68c24e9740 1 Processor -- start 2024-09-12T12:34:27.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.746+0000 7f68c24e9740 1 -- start start 2024-09-12T12:34:27.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.747+0000 7f68c24e9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568f2042b60 0x5568f2065f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:27.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.747+0000 7f68c24e9740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568f2043480 0x5568f2066480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:27.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.747+0000 7f68c24e9740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568f204d6b0 0x5568f204a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:27.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.747+0000 7f68c24e9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f689c012360 con 0x5568f2042b60 2024-09-12T12:34:27.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.747+0000 7f68c24e9740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f689c00fc30 con 0x5568f2043480 2024-09-12T12:34:27.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.747+0000 7f68c24e9740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f689c00db30 con 0x5568f204d6b0 2024-09-12T12:34:27.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.748+0000 7f68bdeac640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568f2042b60 0x5568f2065f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:27.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.748+0000 7f68bdeac640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568f2042b60 0x5568f2065f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40288/0 (socket says 172.21.15.33:40288) 2024-09-12T12:34:27.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.748+0000 7f68bdeac640 1 -- 172.21.15.33:0/4182532469 learned_addr learned my addr 172.21.15.33:0/4182532469 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:34:27.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.748+0000 7f68be6ad640 1 --2- 172.21.15.33:0/4182532469 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568f204d6b0 0x5568f204a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:27.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.749+0000 7f68bdeac640 1 -- 172.21.15.33:0/4182532469 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568f204d6b0 msgr2=0x5568f204a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:34:27.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.749+0000 7f68bdeac640 1 --2- 172.21.15.33:0/4182532469 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568f204d6b0 0x5568f204a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:27.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.749+0000 7f68bdeac640 1 -- 172.21.15.33:0/4182532469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568f2043480 msgr2=0x5568f2066480 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:34:27.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.749+0000 7f68bdeac640 1 --2- 172.21.15.33:0/4182532469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568f2043480 0x5568f2066480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:27.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.749+0000 7f68bdeac640 1 -- 172.21.15.33:0/4182532469 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568f20432b0 con 0x5568f2042b60 2024-09-12T12:34:27.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.749+0000 7f68bdeac640 1 --2- 172.21.15.33:0/4182532469 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568f2042b60 0x5568f2065f40 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f68a800c280 tx=0x7f68a800da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c20717ebb7630cf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:34:27.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.750+0000 7f68a37fe640 1 -- 172.21.15.33:0/4182532469 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a8021040 con 0x5568f2042b60 2024-09-12T12:34:27.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.750+0000 7f68a37fe640 1 -- 172.21.15.33:0/4182532469 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f68a8034070 con 0x5568f2042b60 2024-09-12T12:34:27.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.751+0000 7f68c24e9740 1 -- 172.21.15.33:0/4182532469 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568f2042b60 msgr2=0x5568f2065f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:27.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.751+0000 7f68c24e9740 1 --2- 172.21.15.33:0/4182532469 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568f2042b60 0x5568f2065f40 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f68a800c280 tx=0x7f68a800da30 comp rx=0 tx=0).stop 2024-09-12T12:34:27.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.752+0000 7f68c24e9740 1 -- 172.21.15.33:0/4182532469 shutdown_connections 2024-09-12T12:34:27.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.752+0000 7f68c24e9740 1 --2- 172.21.15.33:0/4182532469 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568f204d6b0 0x5568f204a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:27.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.752+0000 7f68c24e9740 1 --2- 172.21.15.33:0/4182532469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568f2043480 0x5568f2066480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:27.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.752+0000 7f68c24e9740 1 --2- 172.21.15.33:0/4182532469 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568f2042b60 0x5568f2065f40 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:27.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.752+0000 7f68c24e9740 1 -- 172.21.15.33:0/4182532469 >> 172.21.15.33:0/4182532469 conn(0x5568f203f0f0 msgr2=0x5568f204ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:34:27.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.755+0000 7f68c24e9740 1 -- 172.21.15.33:0/4182532469 shutdown_connections 2024-09-12T12:34:27.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.756+0000 7f68c24e9740 1 -- 172.21.15.33:0/4182532469 wait complete. 2024-09-12T12:34:27.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.756+0000 7f68c24e9740 1 -- start start 2024-09-12T12:34:27.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.756+0000 7f68c24e9740 1 Processor -- start 2024-09-12T12:34:27.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.757+0000 7f68c24e9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568f2042b60 0x5568f2051f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:27.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.757+0000 7f68c24e9740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568f2043480 0x5568f2052480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:27.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.757+0000 7f68c24e9740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568f204d6b0 0x5568f20c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:27.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.757+0000 7f68c24e9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f689c00e0f0 con 0x5568f2042b60 2024-09-12T12:34:27.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.757+0000 7f68c24e9740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f689c00f560 con 0x5568f2043480 2024-09-12T12:34:27.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.757+0000 7f68c24e9740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f689c00e7c0 con 0x5568f204d6b0 2024-09-12T12:34:27.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.757+0000 7f68c24e9740 10 client.0 _ll_register_callbacks cb 0x7f68a800c440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:34:27.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.757+0000 7f68bd6ab640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568f2043480 0x5568f2052480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:27.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.757+0000 7f68be6ad640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568f204d6b0 0x5568f20c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:27.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.757+0000 7f68be6ad640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568f204d6b0 0x5568f20c7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:39414/0 (socket says 172.21.15.33:39414) 2024-09-12T12:34:27.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.757+0000 7f68be6ad640 1 -- 172.21.15.33:0/3789794009 learned_addr learned my addr 172.21.15.33:0/3789794009 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:34:27.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.758+0000 7f68bd6ab640 1 -- 172.21.15.33:0/3789794009 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568f204d6b0 msgr2=0x5568f20c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:34:27.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.758+0000 7f68bd6ab640 1 --2- 172.21.15.33:0/3789794009 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568f204d6b0 0x5568f20c7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:27.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.758+0000 7f68bd6ab640 1 -- 172.21.15.33:0/3789794009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568f2042b60 msgr2=0x5568f2051f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:34:27.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.758+0000 7f68bd6ab640 1 --2- 172.21.15.33:0/3789794009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568f2042b60 0x5568f2051f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:27.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.758+0000 7f68bd6ab640 1 -- 172.21.15.33:0/3789794009 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568f2050230 con 0x5568f2043480 2024-09-12T12:34:27.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.758+0000 7f68bd6ab640 1 --2- 172.21.15.33:0/3789794009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568f2043480 0x5568f2052480 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f68b009ba50 tx=0x7f68b0098120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e4388cdce89636e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:34:27.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.762+0000 7f68a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:34:27.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.766+0000 7f68a17fa640 1 -- 172.21.15.33:0/3789794009 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b00983c0 con 0x5568f2043480 2024-09-12T12:34:27.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.766+0000 7f68a17fa640 1 -- 172.21.15.33:0/3789794009 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f68b00a4480 con 0x5568f2043480 2024-09-12T12:34:27.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.767+0000 7f68c24e9740 1 -- 172.21.15.33:0/3789794009 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68a8034070 con 0x5568f2043480 2024-09-12T12:34:27.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.767+0000 7f68a17fa640 1 -- 172.21.15.33:0/3789794009 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f68b0098560 con 0x5568f2043480 2024-09-12T12:34:27.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.767+0000 7f68c24e9740 10 client.25781 fetch_fsmap learned FSMap version 27 2024-09-12T12:34:27.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.767+0000 7f68c24e9740 1 -- 172.21.15.33:0/3789794009 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5568f20da4b0 con 0x5568f2043480 2024-09-12T12:34:27.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.772+0000 7f68a17fa640 1 -- 172.21.15.33:0/3789794009 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f68a8034070 con 0x5568f2043480 2024-09-12T12:34:27.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.772+0000 7f68a17fa640 1 -- 172.21.15.33:0/3789794009 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f68b009ac10 con 0x5568f2043480 2024-09-12T12:34:27.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.774+0000 7f68c24e9740 10 client.25781 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:34:27.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.774+0000 7f68c24e9740 10 client.25781 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:34:27.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.774+0000 7f68c24e9740 20 client.25781 populate_metadata read hostname 'smithi033' 2024-09-12T12:34:27.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.774+0000 7f68c24e9740 1 --2- 172.21.15.33:0/3789794009 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5568f20dabe0 0x5568f20dd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:27.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.774+0000 7f68c24e9740 4 client.25781 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T12:34:27.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.774+0000 7f68c24e9740 1 -- 172.21.15.33:0/3789794009 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5568f1f2c110 con 0x5568f20dabe0 2024-09-12T12:34:27.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.774+0000 7f68bdeac640 1 --2- 172.21.15.33:0/3789794009 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5568f20dabe0 0x5568f20dd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:27.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.775+0000 7f68a17fa640 10 client.25781 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:34:27.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.775+0000 7f68bdeac640 1 --2- 172.21.15.33:0/3789794009 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5568f20dabe0 0x5568f20dd000 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c966a40dbdbb16b server_cookie=2b5b0b1d9f01fecc in_seq=0 out_seq=0 2024-09-12T12:34:27.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.778+0000 7f68a17fa640 1 -- 172.21.15.33:0/3789794009 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5568f1f2c110 con 0x5568f20dabe0 2024-09-12T12:34:27.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.778+0000 7f68a17fa640 10 client.25781 handle_command_reply: tid=0 2024-09-12T12:34:27.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.778+0000 7f68c24e9740 1 client.25781 shutdown 2024-09-12T12:34:27.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.784+0000 7f68c24e9740 1 -- 172.21.15.33:0/3789794009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568f2043480 msgr2=0x5568f2052480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:27.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.784+0000 7f68c24e9740 1 --2- 172.21.15.33:0/3789794009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568f2043480 0x5568f2052480 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f68b009ba50 tx=0x7f68b0098120 comp rx=0 tx=0).stop 2024-09-12T12:34:27.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.786+0000 7f68c24e9740 1 -- 172.21.15.33:0/3789794009 shutdown_connections 2024-09-12T12:34:27.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.786+0000 7f68c24e9740 1 --2- 172.21.15.33:0/3789794009 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5568f20dabe0 0x5568f20dd000 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:27.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.786+0000 7f68c24e9740 1 --2- 172.21.15.33:0/3789794009 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568f204d6b0 0x5568f20c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:27.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.786+0000 7f68c24e9740 1 --2- 172.21.15.33:0/3789794009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568f2043480 0x5568f2052480 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:27.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.786+0000 7f68c24e9740 1 --2- 172.21.15.33:0/3789794009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568f2042b60 0x5568f2051f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:27.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.786+0000 7f68c24e9740 1 -- 172.21.15.33:0/3789794009 >> 172.21.15.33:0/3789794009 conn(0x5568f203f0f0 msgr2=0x5568f203e270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:34:27.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.786+0000 7f68a17fa640 0 client.25781 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:34:27.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.786+0000 7f68c24e9740 1 -- 172.21.15.33:0/3789794009 shutdown_connections 2024-09-12T12:34:27.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.786+0000 7f68c24e9740 1 -- 172.21.15.33:0/3789794009 wait complete. 2024-09-12T12:34:27.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.786+0000 7f68c24e9740 20 client.25781 trim_cache size 0 max 16384 2024-09-12T12:34:27.788 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:34:27.788 INFO:teuthology.orchestra.run.smithi033.stdout: "return_code": 0, 2024-09-12T12:34:27.788 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_tag": "43465039-c779-4278-b72f-4242b0657b05", 2024-09-12T12:34:27.788 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": "asynchronous" 2024-09-12T12:34:27.789 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:34:27.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.790+0000 7f68c0110640 1 -- 172.21.15.33:0/91484464 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f68a40a2d90 msgr2=0x7f68a40a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:27.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.790+0000 7f68c0110640 1 --2- 172.21.15.33:0/91484464 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f68a40a2d90 0x7f68a40a5250 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f68a8006fd0 tx=0x7f68a8006d60 comp rx=0 tx=0).stop 2024-09-12T12:34:27.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.790+0000 7f68c0110640 1 -- 172.21.15.33:0/91484464 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f68b8100de0 msgr2=0x7f68b806dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:27.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.790+0000 7f68c0110640 1 --2- 172.21.15.33:0/91484464 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f68b8100de0 0x7f68b806dc00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f68b000ba80 tx=0x7f68b000bf40 comp rx=0 tx=0).stop 2024-09-12T12:34:27.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.790+0000 7f68c0110640 1 -- 172.21.15.33:0/91484464 shutdown_connections 2024-09-12T12:34:27.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.790+0000 7f68c0110640 1 --2- 172.21.15.33:0/91484464 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f68a40a2d90 0x7f68a40a5250 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:27.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.790+0000 7f68c0110640 1 --2- 172.21.15.33:0/91484464 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68b8071f90 0x7f68b8072440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:27.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.790+0000 7f68c0110640 1 --2- 172.21.15.33:0/91484464 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f68b8100de0 0x7f68b806dc00 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:27.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.790+0000 7f68c0110640 1 --2- 172.21.15.33:0/91484464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68b8100430 0x7f68b806d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:27.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.790+0000 7f68c0110640 1 -- 172.21.15.33:0/91484464 >> 172.21.15.33:0/91484464 conn(0x7f68b8077230 msgr2=0x7f68b8103220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:34:27.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.790+0000 7f68c0110640 1 -- 172.21.15.33:0/91484464 shutdown_connections 2024-09-12T12:34:27.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:27.790+0000 7f68c0110640 1 -- 172.21.15.33:0/91484464 wait complete. 2024-09-12T12:34:28.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:34:27 smithi043 ceph-mon[34144]: pgmap v603: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 26 MiB/s wr, 522 op/s 2024-09-12T12:34:28.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:34:27 smithi102 ceph-mon[34799]: pgmap v603: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 26 MiB/s wr, 522 op/s 2024-09-12T12:34:28.605 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T12:34:28.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:34:28 smithi033 ceph-mon[31246]: scrub queued for path: / 2024-09-12T12:34:28.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:34:28 smithi033 ceph-mon[31246]: scrub summary: idle+waiting paths [/] 2024-09-12T12:34:28.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:34:28 smithi033 ceph-mon[31246]: scrub summary: active paths [/] 2024-09-12T12:34:28.983 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:34:28 smithi033 ceph-mon[31246]: scrub summary: active paths [/] 2024-09-12T12:34:28.983 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:34:28 smithi033 ceph-mon[31246]: scrub summary: idle+waiting paths [/] 2024-09-12T12:34:28.983 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:34:28 smithi033 ceph-mon[31246]: scrub summary: idle+waiting paths [/] 2024-09-12T12:34:29.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:34:28 smithi043 ceph-mon[34144]: scrub queued for path: / 2024-09-12T12:34:29.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:34:28 smithi043 ceph-mon[34144]: scrub summary: idle+waiting paths [/] 2024-09-12T12:34:29.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:34:28 smithi043 ceph-mon[34144]: scrub summary: active paths [/] 2024-09-12T12:34:29.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:34:28 smithi043 ceph-mon[34144]: scrub summary: active paths [/] 2024-09-12T12:34:29.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:34:28 smithi043 ceph-mon[34144]: scrub summary: idle+waiting paths [/] 2024-09-12T12:34:29.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:34:28 smithi043 ceph-mon[34144]: scrub summary: idle+waiting paths [/] 2024-09-12T12:34:29.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:34:28 smithi102 ceph-mon[34799]: scrub queued for path: / 2024-09-12T12:34:29.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:34:28 smithi102 ceph-mon[34799]: scrub summary: idle+waiting paths [/] 2024-09-12T12:34:29.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:34:28 smithi102 ceph-mon[34799]: scrub summary: active paths [/] 2024-09-12T12:34:29.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:34:28 smithi102 ceph-mon[34799]: scrub summary: active paths [/] 2024-09-12T12:34:29.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:34:28 smithi102 ceph-mon[34799]: scrub summary: idle+waiting paths [/] 2024-09-12T12:34:29.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:34:28 smithi102 ceph-mon[34799]: scrub summary: idle+waiting paths [/] 2024-09-12T12:34:29.257 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:34:29.689 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:34:29 smithi033 ceph-mon[31246]: pgmap v604: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 35 MiB/s wr, 696 op/s 2024-09-12T12:34:29.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.949+0000 7f4001c41640 1 -- 172.21.15.33:0/3388350340 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ffc109450 msgr2=0x7f3ffc110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:29.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.949+0000 7f4001c41640 1 --2- 172.21.15.33:0/3388350340 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ffc109450 0x7f3ffc110250 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4009ca0 tx=0x7f3ff402a8f0 comp rx=0 tx=0).stop 2024-09-12T12:34:29.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.950+0000 7f4001c41640 1 -- 172.21.15.33:0/3388350340 shutdown_connections 2024-09-12T12:34:29.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.950+0000 7f4001c41640 1 --2- 172.21.15.33:0/3388350340 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ffc11b140 0x7f3ffc11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:29.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.950+0000 7f4001c41640 1 --2- 172.21.15.33:0/3388350340 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ffc109830 0x7f3ffc109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:29.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.950+0000 7f4001c41640 1 --2- 172.21.15.33:0/3388350340 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ffc109450 0x7f3ffc110250 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:29.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.950+0000 7f4001c41640 1 -- 172.21.15.33:0/3388350340 >> 172.21.15.33:0/3388350340 conn(0x7f3ffc06e140 msgr2=0x7f3ffc06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:34:29.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.958+0000 7f4001c41640 1 -- 172.21.15.33:0/3388350340 shutdown_connections 2024-09-12T12:34:29.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.965+0000 7f4001c41640 1 -- 172.21.15.33:0/3388350340 wait complete. 2024-09-12T12:34:29.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.965+0000 7f4001c41640 1 Processor -- start 2024-09-12T12:34:29.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.966+0000 7f4001c41640 1 -- start start 2024-09-12T12:34:29.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.966+0000 7f4001c41640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ffc109450 0x7f3ffc1a7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:29.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.966+0000 7f4001c41640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ffc109830 0x7f3ffc1a78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:29.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.966+0000 7f4001c41640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ffc11b140 0x7f3ffc1abc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:29.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.966+0000 7f4001c41640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3ffc120d80 con 0x7f3ffc109450 2024-09-12T12:34:29.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.966+0000 7f4001c41640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3ffc120c00 con 0x7f3ffc109830 2024-09-12T12:34:29.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.966+0000 7f4001c41640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3ffc120f00 con 0x7f3ffc11b140 2024-09-12T12:34:29.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.966+0000 7f3ffbfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ffc11b140 0x7f3ffc1abc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:29.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.967+0000 7f3ffbfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ffc11b140 0x7f3ffc1abc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:39426/0 (socket says 172.21.15.33:39426) 2024-09-12T12:34:29.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.967+0000 7f3ffbfff640 1 -- 172.21.15.33:0/67152998 learned_addr learned my addr 172.21.15.33:0/67152998 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:34:29.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.970+0000 7f3ffbfff640 1 -- 172.21.15.33:0/67152998 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ffc109830 msgr2=0x7f3ffc1a78d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T12:34:29.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.970+0000 7f3ffbfff640 1 --2- 172.21.15.33:0/67152998 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ffc109830 0x7f3ffc1a78d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:29.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.970+0000 7f3ffbfff640 1 -- 172.21.15.33:0/67152998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ffc109450 msgr2=0x7f3ffc1a7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:29.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.970+0000 7f3ffbfff640 1 --2- 172.21.15.33:0/67152998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ffc109450 0x7f3ffc1a7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:29.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.971+0000 7f3ffbfff640 1 -- 172.21.15.33:0/67152998 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ffc1ac340 con 0x7f3ffc11b140 2024-09-12T12:34:29.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.975+0000 7f3ffbfff640 1 --2- 172.21.15.33:0/67152998 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ffc11b140 0x7f3ffc1abc60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3ff000b3e0 tx=0x7f3ff000b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:34:29.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.978+0000 7f3ff8ff9640 1 -- 172.21.15.33:0/67152998 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff0015020 con 0x7f3ffc11b140 2024-09-12T12:34:29.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.978+0000 7f3ff8ff9640 1 -- 172.21.15.33:0/67152998 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3ff0011ce0 con 0x7f3ffc11b140 2024-09-12T12:34:29.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.978+0000 7f3ff8ff9640 1 -- 172.21.15.33:0/67152998 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff0010e20 con 0x7f3ffc11b140 2024-09-12T12:34:29.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.980+0000 7f4001c41640 1 -- 172.21.15.33:0/67152998 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ffc1ac630 con 0x7f3ffc11b140 2024-09-12T12:34:29.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.980+0000 7f4001c41640 1 -- 172.21.15.33:0/67152998 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ffc1b3f10 con 0x7f3ffc11b140 2024-09-12T12:34:29.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.985+0000 7f400401a740 1 Processor -- start 2024-09-12T12:34:29.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.989+0000 7f400401a740 1 -- start start 2024-09-12T12:34:29.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.989+0000 7f400401a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b8af5f4a0 0x558b8af5f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:29.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.989+0000 7f400401a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558b8af5fdc0 0x558b8af6a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:29.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.989+0000 7f400401a740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b8af6a680 0x558b8af6ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:29.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.989+0000 7f400401a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x558b8aec52e0 con 0x558b8af5fdc0 2024-09-12T12:34:29.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.989+0000 7f400401a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558b8ae6cce0 con 0x558b8af5f4a0 2024-09-12T12:34:29.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.989+0000 7f400401a740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558b8aec12a0 con 0x558b8af6a680 2024-09-12T12:34:29.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.989+0000 7f3ffb7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558b8af5fdc0 0x558b8af6a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:29.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.989+0000 7f3ff8ff9640 1 -- 172.21.15.33:0/67152998 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3ff0018020 con 0x7f3ffc11b140 2024-09-12T12:34:29.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.991+0000 7f3ffb7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558b8af5fdc0 0x558b8af6a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40310/0 (socket says 172.21.15.33:40310) 2024-09-12T12:34:29.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.992+0000 7f3ffb7fe640 1 -- 172.21.15.33:0/2920856032 learned_addr learned my addr 172.21.15.33:0/2920856032 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:34:29.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.992+0000 7f3ff8ff9640 1 --2- 172.21.15.33:0/67152998 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f3fe40a2d90 0x7f3fe40a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:29.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.992+0000 7f3ff8ff9640 1 -- 172.21.15.33:0/67152998 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f3ff00ceb80 con 0x7f3ffc11b140 2024-09-12T12:34:29.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.993+0000 7f3ffb7fe640 1 -- 172.21.15.33:0/2920856032 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b8af6a680 msgr2=0x558b8af6ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:34:29.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.993+0000 7f3ffb7fe640 1 --2- 172.21.15.33:0/2920856032 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b8af6a680 0x558b8af6ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:29.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.993+0000 7f3ffb7fe640 1 -- 172.21.15.33:0/2920856032 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b8af5f4a0 msgr2=0x558b8af5f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:34:29.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.993+0000 7f3ffb7fe640 1 --2- 172.21.15.33:0/2920856032 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b8af5f4a0 0x558b8af5f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:29.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.993+0000 7f3ffb7fe640 1 -- 172.21.15.33:0/2920856032 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b8ae51440 con 0x558b8af5fdc0 2024-09-12T12:34:29.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.993+0000 7f3ffb7fe640 1 --2- 172.21.15.33:0/2920856032 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558b8af5fdc0 0x558b8af6a140 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4009dc0 tx=0x7f3ff402f440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb795f15ecfb15 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:34:29.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:29.997+0000 7f3ffbfff640 1 --2- 172.21.15.33:0/67152998 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f3fe40a2d90 0x7f3fe40a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:30.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.003+0000 7f3fe1ffb640 1 -- 172.21.15.33:0/2920856032 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff4032dd0 con 0x558b8af5fdc0 2024-09-12T12:34:30.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.003+0000 7f3fe1ffb640 1 -- 172.21.15.33:0/2920856032 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3ff4036070 con 0x558b8af5fdc0 2024-09-12T12:34:30.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.003+0000 7f3fe1ffb640 1 -- 172.21.15.33:0/2920856032 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff40042a0 con 0x558b8af5fdc0 2024-09-12T12:34:30.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.005+0000 7f400401a740 1 -- 172.21.15.33:0/2920856032 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558b8af5fdc0 msgr2=0x558b8af6a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:30.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.005+0000 7f400401a740 1 --2- 172.21.15.33:0/2920856032 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558b8af5fdc0 0x558b8af6a140 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4009dc0 tx=0x7f3ff402f440 comp rx=0 tx=0).stop 2024-09-12T12:34:30.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.006+0000 7f3ffbfff640 1 --2- 172.21.15.33:0/67152998 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f3fe40a2d90 0x7f3fe40a5250 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0004850 tx=0x7f3ff00047a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:34:30.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.010+0000 7f400401a740 1 -- 172.21.15.33:0/2920856032 shutdown_connections 2024-09-12T12:34:30.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.010+0000 7f400401a740 1 --2- 172.21.15.33:0/2920856032 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b8af6a680 0x558b8af6ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:30.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.010+0000 7f400401a740 1 --2- 172.21.15.33:0/2920856032 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558b8af5fdc0 0x558b8af6a140 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:30.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.010+0000 7f400401a740 1 --2- 172.21.15.33:0/2920856032 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b8af5f4a0 0x558b8af5f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:30.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.010+0000 7f400401a740 1 -- 172.21.15.33:0/2920856032 >> 172.21.15.33:0/2920856032 conn(0x558b8af5ba30 msgr2=0x558b8af5be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:34:30.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.016+0000 7f400401a740 1 -- 172.21.15.33:0/2920856032 shutdown_connections 2024-09-12T12:34:30.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.018+0000 7f400401a740 1 -- 172.21.15.33:0/2920856032 wait complete. 2024-09-12T12:34:30.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.019+0000 7f400401a740 1 -- start start 2024-09-12T12:34:30.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.019+0000 7f400401a740 1 Processor -- start 2024-09-12T12:34:30.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.020+0000 7f400401a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b8af5f4a0 0x558b8af6a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:30.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.020+0000 7f400401a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558b8af5fdc0 0x558b8af672e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:30.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.020+0000 7f400401a740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b8af6a680 0x558b8af67880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:30.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.020+0000 7f400401a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x558b8af6d250 con 0x558b8af5fdc0 2024-09-12T12:34:30.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.020+0000 7f400401a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558b8ae80050 con 0x558b8af5f4a0 2024-09-12T12:34:30.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.020+0000 7f400401a740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558b8af6d3d0 con 0x558b8af6a680 2024-09-12T12:34:30.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.020+0000 7f400401a740 10 client.0 _ll_register_callbacks cb 0x558b8aec0160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:34:30.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.024+0000 7f3ffb7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558b8af5fdc0 0x558b8af672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:30.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.025+0000 7f3ffb7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558b8af5fdc0 0x558b8af672e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40314/0 (socket says 172.21.15.33:40314) 2024-09-12T12:34:30.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.025+0000 7f3ffb7fe640 1 -- 172.21.15.33:0/1264036936 learned_addr learned my addr 172.21.15.33:0/1264036936 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:34:30.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.025+0000 7f3ffaffd640 1 --2- 172.21.15.33:0/1264036936 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b8af6a680 0x558b8af67880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:30.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.025+0000 7f3ffaffd640 1 --2- 172.21.15.33:0/1264036936 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b8af5f4a0 0x558b8af6a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:30.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.025+0000 7f3ffaffd640 1 -- 172.21.15.33:0/1264036936 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b8af5f4a0 msgr2=0x558b8af6a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:34:30.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.025+0000 7f3ffaffd640 1 --2- 172.21.15.33:0/1264036936 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b8af5f4a0 0x558b8af6a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:30.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.025+0000 7f3ffaffd640 1 -- 172.21.15.33:0/1264036936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558b8af5fdc0 msgr2=0x558b8af672e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:34:30.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.025+0000 7f3ffaffd640 1 --2- 172.21.15.33:0/1264036936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558b8af5fdc0 0x558b8af672e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:30.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.025+0000 7f3ffaffd640 1 -- 172.21.15.33:0/1264036936 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b8ac363c0 con 0x558b8af6a680 2024-09-12T12:34:30.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.026+0000 7f3ffaffd640 1 --2- 172.21.15.33:0/1264036936 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b8af6a680 0x558b8af67880 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc11d930 tx=0x7f3fec00b060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f7c42f4b02f1bc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:34:30.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.026+0000 7f3fdaffd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:34:30.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.027+0000 7f3fdaffd640 1 -- 172.21.15.33:0/1264036936 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fec01d060 con 0x558b8af6a680 2024-09-12T12:34:30.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.027+0000 7f400401a740 1 -- 172.21.15.33:0/1264036936 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ff4036070 con 0x558b8af6a680 2024-09-12T12:34:30.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.027+0000 7f3fdaffd640 1 -- 172.21.15.33:0/1264036936 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f3fec004c50 con 0x558b8af6a680 2024-09-12T12:34:30.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.027+0000 7f3fdaffd640 1 -- 172.21.15.33:0/1264036936 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3fec024050 con 0x558b8af6a680 2024-09-12T12:34:30.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.028+0000 7f400401a740 10 client.25870 fetch_fsmap learned FSMap version 27 2024-09-12T12:34:30.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.028+0000 7f400401a740 1 -- 172.21.15.33:0/1264036936 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558b8af89d60 con 0x558b8af6a680 2024-09-12T12:34:30.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.028+0000 7f3fdaffd640 1 -- 172.21.15.33:0/1264036936 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3ff4036070 con 0x558b8af6a680 2024-09-12T12:34:30.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.028+0000 7f3fdaffd640 1 -- 172.21.15.33:0/1264036936 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f3fec012860 con 0x558b8af6a680 2024-09-12T12:34:30.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.029+0000 7f400401a740 10 client.25870 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:34:30.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.029+0000 7f400401a740 10 client.25870 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:34:30.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.029+0000 7f400401a740 20 client.25870 populate_metadata read hostname 'smithi033' 2024-09-12T12:34:30.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.029+0000 7f400401a740 1 --2- 172.21.15.33:0/1264036936 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x558b8af8b640 0x558b8af8da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:30.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.029+0000 7f400401a740 4 client.25870 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:34:30.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.029+0000 7f400401a740 1 -- 172.21.15.33:0/1264036936 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558b8aed2850 con 0x558b8af8b640 2024-09-12T12:34:30.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.030+0000 7f3ffb7fe640 1 --2- 172.21.15.33:0/1264036936 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x558b8af8b640 0x558b8af8da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:30.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.032+0000 7f3ffb7fe640 1 --2- 172.21.15.33:0/1264036936 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x558b8af8b640 0x558b8af8da60 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d06ce708f9b7c9e2 server_cookie=ef34e9e038fd0240 in_seq=0 out_seq=0 2024-09-12T12:34:30.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.032+0000 7f3fdaffd640 10 client.25870 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:34:30.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.033+0000 7f3fdaffd640 1 -- 172.21.15.33:0/1264036936 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558b8aed2850 con 0x558b8af8b640 2024-09-12T12:34:30.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.033+0000 7f3fdaffd640 10 client.25870 handle_command_reply: tid=0 2024-09-12T12:34:30.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.033+0000 7f400401a740 1 client.25870 shutdown 2024-09-12T12:34:30.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.034+0000 7f400401a740 1 -- 172.21.15.33:0/1264036936 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b8af6a680 msgr2=0x558b8af67880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:30.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.034+0000 7f400401a740 1 --2- 172.21.15.33:0/1264036936 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b8af6a680 0x558b8af67880 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc11d930 tx=0x7f3fec00b060 comp rx=0 tx=0).stop 2024-09-12T12:34:30.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.037+0000 7f400401a740 1 -- 172.21.15.33:0/1264036936 shutdown_connections 2024-09-12T12:34:30.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.037+0000 7f400401a740 1 --2- 172.21.15.33:0/1264036936 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x558b8af8b640 0x558b8af8da60 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:30.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.037+0000 7f400401a740 1 --2- 172.21.15.33:0/1264036936 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b8af6a680 0x558b8af67880 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:30.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.037+0000 7f400401a740 1 --2- 172.21.15.33:0/1264036936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558b8af5fdc0 0x558b8af672e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:30.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.037+0000 7f400401a740 1 --2- 172.21.15.33:0/1264036936 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b8af5f4a0 0x558b8af6a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:30.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.037+0000 7f400401a740 1 -- 172.21.15.33:0/1264036936 >> 172.21.15.33:0/1264036936 conn(0x558b8af5ba30 msgr2=0x558b8af61760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:34:30.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.037+0000 7f3fdaffd640 0 client.25870 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:34:30.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.038+0000 7f400401a740 1 -- 172.21.15.33:0/1264036936 shutdown_connections 2024-09-12T12:34:30.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.038+0000 7f400401a740 1 -- 172.21.15.33:0/1264036936 wait complete. 2024-09-12T12:34:30.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.039+0000 7f400401a740 20 client.25870 trim_cache size 0 max 16384 2024-09-12T12:34:30.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.072+0000 7f400401a740 1 Processor -- start 2024-09-12T12:34:30.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.072+0000 7f400401a740 1 -- start start 2024-09-12T12:34:30.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.072+0000 7f400401a740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b8af5f4a0 0x558b8af93370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:30.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.072+0000 7f400401a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558b8af5fdc0 0x558b8af938b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:30.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.072+0000 7f400401a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b8af6a680 0x558b8af5a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:30.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.072+0000 7f400401a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe8012530 con 0x558b8af5fdc0 2024-09-12T12:34:30.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.072+0000 7f400401a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe800fe00 con 0x558b8af6a680 2024-09-12T12:34:30.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.072+0000 7f400401a740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe800dc50 con 0x558b8af5f4a0 2024-09-12T12:34:30.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.074+0000 7f3ffaffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b8af5f4a0 0x558b8af93370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:30.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.074+0000 7f3ffaffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b8af6a680 0x558b8af5a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:30.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.075+0000 7f3ffaffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b8af5f4a0 0x558b8af93370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:39438/0 (socket says 172.21.15.33:39438) 2024-09-12T12:34:30.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.075+0000 7f3ffaffd640 1 -- 172.21.15.33:0/2058626711 learned_addr learned my addr 172.21.15.33:0/2058626711 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:34:30.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.077+0000 7f3ffb7fe640 1 --2- 172.21.15.33:0/2058626711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558b8af5fdc0 0x558b8af938b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:30.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.077+0000 7f3ffaffd640 1 -- 172.21.15.33:0/2058626711 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b8af6a680 msgr2=0x558b8af5a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:34:30.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.077+0000 7f3ffaffd640 1 --2- 172.21.15.33:0/2058626711 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b8af6a680 0x558b8af5a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:30.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.077+0000 7f3ffaffd640 1 -- 172.21.15.33:0/2058626711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558b8af5fdc0 msgr2=0x558b8af938b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:34:30.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.077+0000 7f3ffaffd640 1 --2- 172.21.15.33:0/2058626711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558b8af5fdc0 0x558b8af938b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:30.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.077+0000 7f3ffaffd640 1 -- 172.21.15.33:0/2058626711 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b8af6a3a0 con 0x558b8af5f4a0 2024-09-12T12:34:30.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.081+0000 7f3ffaffd640 1 --2- 172.21.15.33:0/2058626711 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b8af5f4a0 0x558b8af93370 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3fec014380 tx=0x7f3fec00bb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b3c6741684e13ad server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:34:30.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.081+0000 7f3fe17fa640 1 -- 172.21.15.33:0/2058626711 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fec011040 con 0x558b8af5f4a0 2024-09-12T12:34:30.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.082+0000 7f3fe17fa640 1 -- 172.21.15.33:0/2058626711 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3fec0125c0 con 0x558b8af5f4a0 2024-09-12T12:34:30.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.082+0000 7f3fe17fa640 1 -- 172.21.15.33:0/2058626711 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fec0063a0 con 0x558b8af5f4a0 2024-09-12T12:34:30.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.084+0000 7f400401a740 1 -- 172.21.15.33:0/2058626711 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b8af5f4a0 msgr2=0x558b8af93370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:30.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.084+0000 7f400401a740 1 --2- 172.21.15.33:0/2058626711 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b8af5f4a0 0x558b8af93370 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3fec014380 tx=0x7f3fec00bb90 comp rx=0 tx=0).stop 2024-09-12T12:34:30.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.088+0000 7f400401a740 1 -- 172.21.15.33:0/2058626711 shutdown_connections 2024-09-12T12:34:30.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.088+0000 7f400401a740 1 --2- 172.21.15.33:0/2058626711 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b8af6a680 0x558b8af5a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:30.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.088+0000 7f400401a740 1 --2- 172.21.15.33:0/2058626711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558b8af5fdc0 0x558b8af938b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:30.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.088+0000 7f400401a740 1 --2- 172.21.15.33:0/2058626711 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b8af5f4a0 0x558b8af93370 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:30.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.088+0000 7f400401a740 1 -- 172.21.15.33:0/2058626711 >> 172.21.15.33:0/2058626711 conn(0x558b8af5ba30 msgr2=0x558b8af62900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:34:30.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.091+0000 7f400401a740 1 -- 172.21.15.33:0/2058626711 shutdown_connections 2024-09-12T12:34:30.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.091+0000 7f400401a740 1 -- 172.21.15.33:0/2058626711 wait complete. 2024-09-12T12:34:30.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.092+0000 7f400401a740 1 -- start start 2024-09-12T12:34:30.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.092+0000 7f400401a740 1 Processor -- start 2024-09-12T12:34:30.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.095+0000 7f400401a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558b8af5f4a0 0x558b8afee630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:30.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.095+0000 7f400401a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b8af5fdc0 0x558b8afeeb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:30.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.095+0000 7f400401a740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b8af6a680 0x558b8af6dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:30.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.096+0000 7f3ffaffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558b8af5f4a0 0x558b8afee630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:30.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.096+0000 7f400401a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe800e2c0 con 0x558b8af5f4a0 2024-09-12T12:34:30.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.096+0000 7f400401a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe800f730 con 0x558b8af5fdc0 2024-09-12T12:34:30.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.096+0000 7f400401a740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe800e990 con 0x558b8af6a680 2024-09-12T12:34:30.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.096+0000 7f400401a740 10 client.0 _ll_register_callbacks cb 0x7f3fec00b470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:34:30.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.096+0000 7f3ffb7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b8af5fdc0 0x558b8afeeb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:30.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.096+0000 7f3ffb7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b8af5fdc0 0x558b8afeeb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:49082/0 (socket says 172.21.15.33:49082) 2024-09-12T12:34:30.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.096+0000 7f3ffb7fe640 1 -- 172.21.15.33:0/3673967905 learned_addr learned my addr 172.21.15.33:0/3673967905 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:34:30.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.096+0000 7f3ffaffd640 1 --2- 172.21.15.33:0/3673967905 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b8af6a680 0x558b8af6dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:30.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.098+0000 7f3ffaffd640 1 -- 172.21.15.33:0/3673967905 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b8af5fdc0 msgr2=0x558b8afeeb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:34:30.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.098+0000 7f3ffaffd640 1 --2- 172.21.15.33:0/3673967905 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b8af5fdc0 0x558b8afeeb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:30.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.098+0000 7f3ffaffd640 1 -- 172.21.15.33:0/3673967905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558b8af5f4a0 msgr2=0x558b8afee630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:34:30.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.098+0000 7f3ffaffd640 1 --2- 172.21.15.33:0/3673967905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558b8af5f4a0 0x558b8afee630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:30.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.098+0000 7f3ffaffd640 1 -- 172.21.15.33:0/3673967905 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b8af6e460 con 0x558b8af6a680 2024-09-12T12:34:30.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.099+0000 7f3ffaffd640 1 --2- 172.21.15.33:0/3673967905 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b8af6a680 0x558b8af6dc60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3fec014380 tx=0x7f3fec00bb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea3389cf126e8534 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:34:30.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.099+0000 7f3fdaffd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:34:30.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.100+0000 7f3fdaffd640 1 -- 172.21.15.33:0/3673967905 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fec01d070 con 0x558b8af6a680 2024-09-12T12:34:30.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.101+0000 7f3fdaffd640 1 -- 172.21.15.33:0/3673967905 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f3fec004c50 con 0x558b8af6a680 2024-09-12T12:34:30.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.101+0000 7f400401a740 1 -- 172.21.15.33:0/3673967905 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3fec0125c0 con 0x558b8af6a680 2024-09-12T12:34:30.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.101+0000 7f3fdaffd640 1 -- 172.21.15.33:0/3673967905 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3fec02d040 con 0x558b8af6a680 2024-09-12T12:34:30.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.102+0000 7f400401a740 10 client.25876 fetch_fsmap learned FSMap version 27 2024-09-12T12:34:30.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.102+0000 7f400401a740 1 -- 172.21.15.33:0/3673967905 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558b8aff5e00 con 0x558b8af6a680 2024-09-12T12:34:30.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.106+0000 7f3fdaffd640 1 -- 172.21.15.33:0/3673967905 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3fec004e50 con 0x558b8af6a680 2024-09-12T12:34:30.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.106+0000 7f3fdaffd640 1 -- 172.21.15.33:0/3673967905 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f3fec0060d0 con 0x558b8af6a680 2024-09-12T12:34:30.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.106+0000 7f400401a740 10 client.25876 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:34:30.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.106+0000 7f400401a740 10 client.25876 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:34:30.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.106+0000 7f400401a740 20 client.25876 populate_metadata read hostname 'smithi033' 2024-09-12T12:34:30.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.106+0000 7f400401a740 1 --2- 172.21.15.33:0/3673967905 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x558b8aff64d0 0x558b8aff88f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:34:30.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.106+0000 7f400401a740 4 client.25876 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:34:30.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.106+0000 7f400401a740 1 -- 172.21.15.33:0/3673967905 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f3fec0125c0 con 0x558b8aff64d0 2024-09-12T12:34:30.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.106+0000 7f3ffb7fe640 1 --2- 172.21.15.33:0/3673967905 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x558b8aff64d0 0x558b8aff88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:34:30.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.107+0000 7f3fdaffd640 10 client.25876 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:34:30.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.107+0000 7f3ffb7fe640 1 --2- 172.21.15.33:0/3673967905 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x558b8aff64d0 0x558b8aff88f0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71cd6ad2030c13ae server_cookie=c8cde59b68064fea in_seq=0 out_seq=0 2024-09-12T12:34:30.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.107+0000 7f3fdaffd640 1 -- 172.21.15.33:0/3673967905 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7f3fec0125c0 con 0x558b8aff64d0 2024-09-12T12:34:30.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.107+0000 7f3fdaffd640 10 client.25876 handle_command_reply: tid=0 2024-09-12T12:34:30.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.107+0000 7f400401a740 1 client.25876 shutdown 2024-09-12T12:34:30.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:34:29 smithi043 ceph-mon[34144]: pgmap v604: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 35 MiB/s wr, 696 op/s 2024-09-12T12:34:30.115 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:34:30.115 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T12:34:30.115 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": { 2024-09-12T12:34:30.115 INFO:teuthology.orchestra.run.smithi033.stdout: "43465039-c779-4278-b72f-4242b0657b05": { 2024-09-12T12:34:30.116 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-09-12T12:34:30.116 INFO:teuthology.orchestra.run.smithi033.stdout: "tag": "43465039-c779-4278-b72f-4242b0657b05", 2024-09-12T12:34:30.116 INFO:teuthology.orchestra.run.smithi033.stdout: "options": "recursive,force" 2024-09-12T12:34:30.116 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:34:30.116 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:34:30.116 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:34:30.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.113+0000 7f400401a740 1 -- 172.21.15.33:0/3673967905 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b8af6a680 msgr2=0x558b8af6dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:30.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.113+0000 7f400401a740 1 --2- 172.21.15.33:0/3673967905 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b8af6a680 0x558b8af6dc60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3fec014380 tx=0x7f3fec00bb90 comp rx=0 tx=0).stop 2024-09-12T12:34:30.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.113+0000 7f400401a740 1 -- 172.21.15.33:0/3673967905 shutdown_connections 2024-09-12T12:34:30.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.113+0000 7f400401a740 1 --2- 172.21.15.33:0/3673967905 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x558b8aff64d0 0x558b8aff88f0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:30.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.113+0000 7f400401a740 1 --2- 172.21.15.33:0/3673967905 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b8af6a680 0x558b8af6dc60 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:30.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.113+0000 7f400401a740 1 --2- 172.21.15.33:0/3673967905 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b8af5fdc0 0x558b8afeeb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:30.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.113+0000 7f3fdaffd640 0 client.25876 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:34:30.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.113+0000 7f400401a740 1 --2- 172.21.15.33:0/3673967905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558b8af5f4a0 0x558b8afee630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:30.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.113+0000 7f400401a740 1 -- 172.21.15.33:0/3673967905 >> 172.21.15.33:0/3673967905 conn(0x558b8af5ba30 msgr2=0x558b8af5a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:34:30.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.113+0000 7f400401a740 1 -- 172.21.15.33:0/3673967905 shutdown_connections 2024-09-12T12:34:30.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.113+0000 7f400401a740 1 -- 172.21.15.33:0/3673967905 wait complete. 2024-09-12T12:34:30.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.113+0000 7f400401a740 20 client.25876 trim_cache size 0 max 16384 2024-09-12T12:34:30.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.114+0000 7f4001c41640 1 -- 172.21.15.33:0/67152998 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f3fe40a2d90 msgr2=0x7f3fe40a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:30.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.114+0000 7f4001c41640 1 --2- 172.21.15.33:0/67152998 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f3fe40a2d90 0x7f3fe40a5250 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0004850 tx=0x7f3ff00047a0 comp rx=0 tx=0).stop 2024-09-12T12:34:30.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.114+0000 7f4001c41640 1 -- 172.21.15.33:0/67152998 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ffc11b140 msgr2=0x7f3ffc1abc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:34:30.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.114+0000 7f4001c41640 1 --2- 172.21.15.33:0/67152998 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ffc11b140 0x7f3ffc1abc60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3ff000b3e0 tx=0x7f3ff000b8a0 comp rx=0 tx=0).stop 2024-09-12T12:34:30.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.115+0000 7f4001c41640 1 -- 172.21.15.33:0/67152998 shutdown_connections 2024-09-12T12:34:30.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.115+0000 7f4001c41640 1 --2- 172.21.15.33:0/67152998 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f3fe40a2d90 0x7f3fe40a5250 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:30.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.115+0000 7f4001c41640 1 --2- 172.21.15.33:0/67152998 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ffc11b140 0x7f3ffc1abc60 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:30.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.115+0000 7f4001c41640 1 --2- 172.21.15.33:0/67152998 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ffc109830 0x7f3ffc1a78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:30.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.115+0000 7f4001c41640 1 --2- 172.21.15.33:0/67152998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ffc109450 0x7f3ffc1a7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:34:30.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.115+0000 7f4001c41640 1 -- 172.21.15.33:0/67152998 >> 172.21.15.33:0/67152998 conn(0x7f3ffc06e140 msgr2=0x7f3ffc11beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:34:30.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.115+0000 7f4001c41640 1 -- 172.21.15.33:0/67152998 shutdown_connections 2024-09-12T12:34:30.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:34:30.115+0000 7f4001c41640 1 -- 172.21.15.33:0/67152998 wait complete. 2024-09-12T12:34:30.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:34:29 smithi102 ceph-mon[34799]: pgmap v604: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 35 MiB/s wr, 696 op/s 2024-09-12T12:34:30.959 INFO:tasks.cephfs.filesystem:scrub status for tag:43465039-c779-4278-b72f-4242b0657b05 - {'path': '/', 'tag': '43465039-c779-4278-b72f-4242b0657b05', 'options': 'recursive,force'} 2024-09-12T12:34:31.980 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:34:31 smithi033 ceph-mon[31246]: pgmap v605: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 26 MiB/s wr, 517 op/s 2024-09-12T12:34:32.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:34:31 smithi043 ceph-mon[34144]: pgmap v605: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 26 MiB/s wr, 517 op/s 2024-09-12T12:34:32.148 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:34:31 smithi102 ceph-mon[34799]: pgmap v605: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 26 MiB/s wr, 517 op/s 2024-09-12T12:34:33.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:34:33 smithi033 ceph-mon[31246]: pgmap v606: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 29 MiB/s wr, 585 op/s 2024-09-12T12:34:34.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:34:33 smithi043 ceph-mon[34144]: pgmap v606: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 29 MiB/s wr, 585 op/s 2024-09-12T12:34:34.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:34:33 smithi102 ceph-mon[34799]: pgmap v606: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 29 MiB/s wr, 585 op/s 2024-09-12T12:34:35.983 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:34:35 smithi033 ceph-mon[31246]: pgmap v607: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 35 MiB/s wr, 704 op/s 2024-09-12T12:34:36.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:34:35 smithi043 ceph-mon[34144]: pgmap v607: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 35 MiB/s wr, 704 op/s 2024-09-12T12:34:36.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:34:35 smithi102 ceph-mon[34799]: pgmap v607: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 35 MiB/s wr, 704 op/s 2024-09-12T12:34:37.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:34:37 smithi033 ceph-mon[31246]: pgmap v608: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 29 MiB/s wr, 587 op/s 2024-09-12T12:34:37.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:34:37 smithi033 ceph-mon[31246]: scrub summary: idle 2024-09-12T12:34:38.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:34:37 smithi043 ceph-mon[34144]: pgmap v608: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 29 MiB/s wr, 587 op/s 2024-09-12T12:34:38.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:34:37 smithi043 ceph-mon[34144]: scrub summary: idle 2024-09-12T12:34:38.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:34:37 smithi102 ceph-mon[34799]: pgmap v608: 129 pgs: 129 active+clean; 10 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 29 MiB/s wr, 587 op/s 2024-09-12T12:34:38.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:34:37 smithi102 ceph-mon[34799]: scrub summary: idle 2024-09-12T12:34:38.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:34:38 smithi033 ceph-mon[31246]: scrub summary: idle 2024-09-12T12:34:39.047 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:34:38 smithi102 ceph-mon[34799]: scrub summary: idle 2024-09-12T12:34:39.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:34:38 smithi043 ceph-mon[34144]: scrub summary: idle 2024-09-12T12:34:39.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:34:39 smithi033 ceph-mon[31246]: pgmap v609: 129 pgs: 129 active+clean; 10 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 38 MiB/s wr, 779 op/s 2024-09-12T12:34:40.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:34:39 smithi043 ceph-mon[34144]: pgmap v609: 129 pgs: 129 active+clean; 10 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 38 MiB/s wr, 779 op/s 2024-09-12T12:34:40.148 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:34:39 smithi102 ceph-mon[34799]: pgmap v609: 129 pgs: 129 active+clean; 10 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 38 MiB/s wr, 779 op/s 2024-09-12T12:34:42.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:34:41 smithi043 ceph-mon[34144]: pgmap v610: 129 pgs: 129 active+clean; 10 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 29 MiB/s wr, 600 op/s 2024-09-12T12:34:42.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:34:41 smithi102 ceph-mon[34799]: pgmap v610: 129 pgs: 129 active+clean; 10 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 29 MiB/s wr, 600 op/s 2024-09-12T12:34:42.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:34:41 smithi033 ceph-mon[31246]: pgmap v610: 129 pgs: 129 active+clean; 10 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 29 MiB/s wr, 600 op/s 2024-09-12T12:34:44.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:34:43 smithi043 ceph-mon[34144]: pgmap v611: 129 pgs: 129 active+clean; 10 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 34 MiB/s wr, 681 op/s 2024-09-12T12:34:44.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:34:43 smithi102 ceph-mon[34799]: pgmap v611: 129 pgs: 129 active+clean; 10 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 34 MiB/s wr, 681 op/s 2024-09-12T12:34:44.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:34:43 smithi033 ceph-mon[31246]: pgmap v611: 129 pgs: 129 active+clean; 10 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 34 MiB/s wr, 681 op/s 2024-09-12T12:34:46.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:34:45 smithi043 ceph-mon[34144]: pgmap v612: 129 pgs: 129 active+clean; 10 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 37 MiB/s wr, 758 op/s 2024-09-12T12:34:46.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:34:45 smithi102 ceph-mon[34799]: pgmap v612: 129 pgs: 129 active+clean; 10 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 37 MiB/s wr, 758 op/s 2024-09-12T12:34:46.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:34:45 smithi033 ceph-mon[31246]: pgmap v612: 129 pgs: 129 active+clean; 10 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 37 MiB/s wr, 758 op/s 2024-09-12T12:34:48.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:34:47 smithi043 ceph-mon[34144]: pgmap v613: 129 pgs: 129 active+clean; 10 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 30 MiB/s wr, 601 op/s 2024-09-12T12:34:48.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:34:47 smithi102 ceph-mon[34799]: pgmap v613: 129 pgs: 129 active+clean; 10 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 30 MiB/s wr, 601 op/s 2024-09-12T12:34:48.233 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:34:47 smithi033 ceph-mon[31246]: pgmap v613: 129 pgs: 129 active+clean; 10 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 30 MiB/s wr, 601 op/s 2024-09-12T12:34:50.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:34:49 smithi043 ceph-mon[34144]: pgmap v614: 129 pgs: 129 active+clean; 10 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 39 MiB/s wr, 790 op/s 2024-09-12T12:34:50.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:34:49 smithi102 ceph-mon[34799]: pgmap v614: 129 pgs: 129 active+clean; 10 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 39 MiB/s wr, 790 op/s 2024-09-12T12:34:50.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:34:49 smithi033 ceph-mon[31246]: pgmap v614: 129 pgs: 129 active+clean; 10 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 39 MiB/s wr, 790 op/s 2024-09-12T12:34:51.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:34:51 smithi033 ceph-mon[31246]: pgmap v615: 129 pgs: 129 active+clean; 10 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 29 MiB/s wr, 590 op/s 2024-09-12T12:34:52.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:34:51 smithi043 ceph-mon[34144]: pgmap v615: 129 pgs: 129 active+clean; 10 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 29 MiB/s wr, 590 op/s 2024-09-12T12:34:52.148 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:34:51 smithi102 ceph-mon[34799]: pgmap v615: 129 pgs: 129 active+clean; 10 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 29 MiB/s wr, 590 op/s 2024-09-12T12:34:54.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:34:53 smithi043 ceph-mon[34144]: pgmap v616: 129 pgs: 129 active+clean; 10 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 33 MiB/s wr, 670 op/s 2024-09-12T12:34:54.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:34:53 smithi102 ceph-mon[34799]: pgmap v616: 129 pgs: 129 active+clean; 10 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 33 MiB/s wr, 670 op/s 2024-09-12T12:34:54.233 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:34:53 smithi033 ceph-mon[31246]: pgmap v616: 129 pgs: 129 active+clean; 10 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 33 MiB/s wr, 670 op/s 2024-09-12T12:34:56.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:34:55 smithi043 ceph-mon[34144]: pgmap v617: 129 pgs: 129 active+clean; 10 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 36 MiB/s wr, 730 op/s 2024-09-12T12:34:56.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:34:55 smithi102 ceph-mon[34799]: pgmap v617: 129 pgs: 129 active+clean; 10 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 36 MiB/s wr, 730 op/s 2024-09-12T12:34:56.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:34:55 smithi033 ceph-mon[31246]: pgmap v617: 129 pgs: 129 active+clean; 10 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 36 MiB/s wr, 730 op/s 2024-09-12T12:34:58.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:34:57 smithi043 ceph-mon[34144]: pgmap v618: 129 pgs: 129 active+clean; 10 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 29 MiB/s wr, 597 op/s 2024-09-12T12:34:58.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:34:57 smithi102 ceph-mon[34799]: pgmap v618: 129 pgs: 129 active+clean; 10 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 29 MiB/s wr, 597 op/s 2024-09-12T12:34:58.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:34:57 smithi033 ceph-mon[31246]: pgmap v618: 129 pgs: 129 active+clean; 10 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 29 MiB/s wr, 597 op/s 2024-09-12T12:35:00.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:34:59 smithi043 ceph-mon[34144]: pgmap v619: 129 pgs: 129 active+clean; 10 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 39 MiB/s wr, 780 op/s 2024-09-12T12:35:00.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:34:59 smithi102 ceph-mon[34799]: pgmap v619: 129 pgs: 129 active+clean; 10 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 39 MiB/s wr, 780 op/s 2024-09-12T12:35:00.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:34:59 smithi033 ceph-mon[31246]: pgmap v619: 129 pgs: 129 active+clean; 10 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 39 MiB/s wr, 780 op/s 2024-09-12T12:35:00.960 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T12:35:01.638 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:35:02.063 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:35:01 smithi033 ceph-mon[31246]: pgmap v620: 129 pgs: 129 active+clean; 10 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 29 MiB/s wr, 584 op/s 2024-09-12T12:35:02.063 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:35:01 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:35:02.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:35:01 smithi043 ceph-mon[34144]: pgmap v620: 129 pgs: 129 active+clean; 10 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 29 MiB/s wr, 584 op/s 2024-09-12T12:35:02.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:35:01 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:35:02.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:35:01 smithi102 ceph-mon[34799]: pgmap v620: 129 pgs: 129 active+clean; 10 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 29 MiB/s wr, 584 op/s 2024-09-12T12:35:02.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:35:01 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:35:02.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.385+0000 7fc7787ef640 1 -- 172.21.15.33:0/3659422568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc770109450 msgr2=0x7fc770109830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:02.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.385+0000 7fc7787ef640 1 --2- 172.21.15.33:0/3659422568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc770109450 0x7fc770109830 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fc76c0108e0 tx=0x7fc76c029ee0 comp rx=0 tx=0).stop 2024-09-12T12:35:02.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.386+0000 7fc7787ef640 1 -- 172.21.15.33:0/3659422568 shutdown_connections 2024-09-12T12:35:02.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.386+0000 7fc7787ef640 1 --2- 172.21.15.33:0/3659422568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc770074990 0x7fc77007b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:02.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.386+0000 7fc7787ef640 1 --2- 172.21.15.33:0/3659422568 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc770109e00 0x7fc7700742d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:02.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.386+0000 7fc7787ef640 1 --2- 172.21.15.33:0/3659422568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc770109450 0x7fc770109830 secure :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fc76c0108e0 tx=0x7fc76c029ee0 comp rx=0 tx=0).stop 2024-09-12T12:35:02.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.386+0000 7fc7787ef640 1 -- 172.21.15.33:0/3659422568 >> 172.21.15.33:0/3659422568 conn(0x7fc77006e140 msgr2=0x7fc77006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:35:02.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.386+0000 7fc7787ef640 1 -- 172.21.15.33:0/3659422568 shutdown_connections 2024-09-12T12:35:02.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.386+0000 7fc7787ef640 1 -- 172.21.15.33:0/3659422568 wait complete. 2024-09-12T12:35:02.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.387+0000 7fc7787ef640 1 Processor -- start 2024-09-12T12:35:02.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.387+0000 7fc7787ef640 1 -- start start 2024-09-12T12:35:02.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.387+0000 7fc7787ef640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc770074990 0x7fc770084e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:02.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.387+0000 7fc7787ef640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc770109e00 0x7fc77007ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:02.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.387+0000 7fc7787ef640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7700805f0 0x7fc770136280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:02.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.387+0000 7fc7787ef640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc77007e650 con 0x7fc770109e00 2024-09-12T12:35:02.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.387+0000 7fc7787ef640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc77007e4d0 con 0x7fc770074990 2024-09-12T12:35:02.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.387+0000 7fc7787ef640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc77007e7d0 con 0x7fc7700805f0 2024-09-12T12:35:02.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.388+0000 7fc776d8c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7700805f0 0x7fc770136280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:02.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.388+0000 7fc776d8c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7700805f0 0x7fc770136280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:44776/0 (socket says 172.21.15.33:44776) 2024-09-12T12:35:02.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.388+0000 7fc776d8c640 1 -- 172.21.15.33:0/541549494 learned_addr learned my addr 172.21.15.33:0/541549494 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:35:02.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.388+0000 7fc775d8a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc770109e00 0x7fc77007ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:02.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.388+0000 7fc77658b640 1 --2- 172.21.15.33:0/541549494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc770074990 0x7fc770084e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:02.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.391+0000 7fc776d8c640 1 -- 172.21.15.33:0/541549494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc770074990 msgr2=0x7fc770084e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:02.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.391+0000 7fc776d8c640 1 --2- 172.21.15.33:0/541549494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc770074990 0x7fc770084e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:02.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.391+0000 7fc776d8c640 1 -- 172.21.15.33:0/541549494 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc770109e00 msgr2=0x7fc77007ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:02.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.391+0000 7fc776d8c640 1 --2- 172.21.15.33:0/541549494 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc770109e00 0x7fc77007ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:02.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.391+0000 7fc776d8c640 1 -- 172.21.15.33:0/541549494 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7701367c0 con 0x7fc7700805f0 2024-09-12T12:35:02.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.397+0000 7fc776d8c640 1 --2- 172.21.15.33:0/541549494 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7700805f0 0x7fc770136280 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc76800ae10 tx=0x7fc768004410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:35:02.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.398+0000 7fc7677fe640 1 -- 172.21.15.33:0/541549494 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76800a110 con 0x7fc7700805f0 2024-09-12T12:35:02.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.398+0000 7fc7677fe640 1 -- 172.21.15.33:0/541549494 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc7680087d0 con 0x7fc7700805f0 2024-09-12T12:35:02.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.398+0000 7fc7787ef640 1 -- 172.21.15.33:0/541549494 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc770136ab0 con 0x7fc7700805f0 2024-09-12T12:35:02.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.398+0000 7fc7677fe640 1 -- 172.21.15.33:0/541549494 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7680126c0 con 0x7fc7700805f0 2024-09-12T12:35:02.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.398+0000 7fc7787ef640 1 -- 172.21.15.33:0/541549494 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc770137040 con 0x7fc7700805f0 2024-09-12T12:35:02.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.401+0000 7fc77abc8740 1 Processor -- start 2024-09-12T12:35:02.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.407+0000 7fc77abc8740 1 -- start start 2024-09-12T12:35:02.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.407+0000 7fc77abc8740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e6807aa4a0 0x55e6807aa880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:02.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.407+0000 7fc77abc8740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e6807aadc0 0x55e6807b5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:02.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.407+0000 7fc77abc8740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6807b5680 0x55e6807b7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:02.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.407+0000 7fc77abc8740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e6807102e0 con 0x55e6807b5680 2024-09-12T12:35:02.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.407+0000 7fc77abc8740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e6806b7ce0 con 0x55e6807aa4a0 2024-09-12T12:35:02.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.407+0000 7fc77abc8740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55e68070c2a0 con 0x55e6807aadc0 2024-09-12T12:35:02.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.408+0000 7fc7677fe640 1 -- 172.21.15.33:0/541549494 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc768012070 con 0x7fc7700805f0 2024-09-12T12:35:02.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.409+0000 7fc7677fe640 1 --2- 172.21.15.33:0/541549494 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc75c0a2cc0 0x7fc75c0a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:02.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.409+0000 7fc7677fe640 1 -- 172.21.15.33:0/541549494 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fc7680cf3f0 con 0x7fc7700805f0 2024-09-12T12:35:02.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.409+0000 7fc775d8a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e6807aa4a0 0x55e6807aa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:02.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.409+0000 7fc775d8a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e6807aa4a0 0x55e6807aa880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:43450/0 (socket says 172.21.15.33:43450) 2024-09-12T12:35:02.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.409+0000 7fc775d8a640 1 -- 172.21.15.33:0/2166607568 learned_addr learned my addr 172.21.15.33:0/2166607568 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:35:02.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.410+0000 7fc775d8a640 1 --2- 172.21.15.33:0/2166607568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6807b5680 0x55e6807b7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:02.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.410+0000 7fc77658b640 1 --2- 172.21.15.33:0/2166607568 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e6807aadc0 0x55e6807b5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:02.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.411+0000 7fc775d8a640 1 -- 172.21.15.33:0/2166607568 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e6807aadc0 msgr2=0x55e6807b5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:35:02.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.411+0000 7fc775d8a640 1 --2- 172.21.15.33:0/2166607568 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e6807aadc0 0x55e6807b5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:02.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.411+0000 7fc775d8a640 1 -- 172.21.15.33:0/2166607568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6807b5680 msgr2=0x55e6807b7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:35:02.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.411+0000 7fc775d8a640 1 --2- 172.21.15.33:0/2166607568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6807b5680 0x55e6807b7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:02.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.411+0000 7fc775d8a640 1 -- 172.21.15.33:0/2166607568 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e68069c440 con 0x55e6807aa4a0 2024-09-12T12:35:02.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.412+0000 7fc775d8a640 1 --2- 172.21.15.33:0/2166607568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e6807aa4a0 0x55e6807aa880 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc76000cfc0 tx=0x7fc76000c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=744e9cddd900702 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:35:02.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.412+0000 7fc764ff9640 1 -- 172.21.15.33:0/2166607568 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc760012510 con 0x55e6807aa4a0 2024-09-12T12:35:02.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.412+0000 7fc764ff9640 1 -- 172.21.15.33:0/2166607568 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc760012b60 con 0x55e6807aa4a0 2024-09-12T12:35:02.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.413+0000 7fc77abc8740 1 -- 172.21.15.33:0/2166607568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e6807aa4a0 msgr2=0x55e6807aa880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:02.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.413+0000 7fc77abc8740 1 --2- 172.21.15.33:0/2166607568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e6807aa4a0 0x55e6807aa880 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc76000cfc0 tx=0x7fc76000c3f0 comp rx=0 tx=0).stop 2024-09-12T12:35:02.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.415+0000 7fc77abc8740 1 -- 172.21.15.33:0/2166607568 shutdown_connections 2024-09-12T12:35:02.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.415+0000 7fc77abc8740 1 --2- 172.21.15.33:0/2166607568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6807b5680 0x55e6807b7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:02.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.415+0000 7fc77abc8740 1 --2- 172.21.15.33:0/2166607568 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e6807aadc0 0x55e6807b5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:02.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.415+0000 7fc77abc8740 1 --2- 172.21.15.33:0/2166607568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e6807aa4a0 0x55e6807aa880 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:02.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.415+0000 7fc77abc8740 1 -- 172.21.15.33:0/2166607568 >> 172.21.15.33:0/2166607568 conn(0x55e6807a6a30 msgr2=0x55e6807a6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:35:02.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.416+0000 7fc77abc8740 1 -- 172.21.15.33:0/2166607568 shutdown_connections 2024-09-12T12:35:02.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.418+0000 7fc77abc8740 1 -- 172.21.15.33:0/2166607568 wait complete. 2024-09-12T12:35:02.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.419+0000 7fc77abc8740 1 -- start start 2024-09-12T12:35:02.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.419+0000 7fc77abc8740 1 Processor -- start 2024-09-12T12:35:02.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.420+0000 7fc77abc8740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6807aa4a0 0x55e6807b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:02.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.420+0000 7fc77abc8740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e6807aadc0 0x55e6807b2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:02.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.420+0000 7fc77abc8740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e6807b5680 0x55e6807b27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:02.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.420+0000 7fc77abc8740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e6807b82a0 con 0x55e6807aa4a0 2024-09-12T12:35:02.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.420+0000 7fc77abc8740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e6806cb050 con 0x55e6807b5680 2024-09-12T12:35:02.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.420+0000 7fc77abc8740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55e6807b8420 con 0x55e6807aadc0 2024-09-12T12:35:02.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.420+0000 7fc77abc8740 10 client.0 _ll_register_callbacks cb 0x55e68070b160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:35:02.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.422+0000 7fc77658b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e6807aadc0 0x55e6807b2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:02.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.422+0000 7fc77658b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e6807aadc0 0x55e6807b2290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:44788/0 (socket says 172.21.15.33:44788) 2024-09-12T12:35:02.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.422+0000 7fc77658b640 1 -- 172.21.15.33:0/476787329 learned_addr learned my addr 172.21.15.33:0/476787329 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:35:02.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.424+0000 7fc776d8c640 1 --2- 172.21.15.33:0/541549494 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc75c0a2cc0 0x7fc75c0a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:02.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.425+0000 7fc775d8a640 1 --2- 172.21.15.33:0/476787329 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e6807b5680 0x55e6807b27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:02.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.425+0000 7fc77658b640 1 -- 172.21.15.33:0/476787329 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e6807b5680 msgr2=0x55e6807b27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:35:02.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.425+0000 7fc77658b640 1 --2- 172.21.15.33:0/476787329 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e6807b5680 0x55e6807b27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:02.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.425+0000 7fc77658b640 1 -- 172.21.15.33:0/476787329 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6807aa4a0 msgr2=0x55e6807b4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:35:02.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.425+0000 7fc77658b640 1 --2- 172.21.15.33:0/476787329 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6807aa4a0 0x55e6807b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:02.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.425+0000 7fc77658b640 1 -- 172.21.15.33:0/476787329 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6804813c0 con 0x55e6807aadc0 2024-09-12T12:35:02.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.427+0000 7fc776d8c640 1 --2- 172.21.15.33:0/541549494 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc75c0a2cc0 0x7fc75c0a5180 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc7680a3fa0 tx=0x7fc768013c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:35:02.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.430+0000 7fc77658b640 1 --2- 172.21.15.33:0/476787329 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e6807aadc0 0x55e6807b2290 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc76c035040 tx=0x7fc76c004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=beae584a559675d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:35:02.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.434+0000 7fc759ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:35:02.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.434+0000 7fc759ffb640 1 -- 172.21.15.33:0/476787329 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76c040020 con 0x55e6807aadc0 2024-09-12T12:35:02.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.434+0000 7fc77abc8740 1 -- 172.21.15.33:0/476787329 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e68071d850 con 0x55e6807aadc0 2024-09-12T12:35:02.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.434+0000 7fc759ffb640 1 -- 172.21.15.33:0/476787329 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fc76c005030 con 0x55e6807aadc0 2024-09-12T12:35:02.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.437+0000 7fc759ffb640 1 -- 172.21.15.33:0/476787329 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc76c037040 con 0x55e6807aadc0 2024-09-12T12:35:02.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.438+0000 7fc77abc8740 10 client.25888 fetch_fsmap learned FSMap version 27 2024-09-12T12:35:02.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.438+0000 7fc77abc8740 1 -- 172.21.15.33:0/476787329 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e6807c3db0 con 0x55e6807aadc0 2024-09-12T12:35:02.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.442+0000 7fc759ffb640 1 -- 172.21.15.33:0/476787329 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55e68071d850 con 0x55e6807aadc0 2024-09-12T12:35:02.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.442+0000 7fc759ffb640 1 -- 172.21.15.33:0/476787329 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fc76c004ae0 con 0x55e6807aadc0 2024-09-12T12:35:02.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.442+0000 7fc77abc8740 10 client.25888 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:35:02.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.442+0000 7fc77abc8740 10 client.25888 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:35:02.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.442+0000 7fc77abc8740 20 client.25888 populate_metadata read hostname 'smithi033' 2024-09-12T12:35:02.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.443+0000 7fc77abc8740 1 --2- 172.21.15.33:0/476787329 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55e6807c5260 0x55e6807c76c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:02.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.443+0000 7fc77abc8740 4 client.25888 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:35:02.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.443+0000 7fc77abc8740 1 -- 172.21.15.33:0/476787329 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e680717d60 con 0x55e6807c5260 2024-09-12T12:35:02.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.447+0000 7fc775d8a640 1 --2- 172.21.15.33:0/476787329 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55e6807c5260 0x55e6807c76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:02.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.452+0000 7fc759ffb640 10 client.25888 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:35:02.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.452+0000 7fc775d8a640 1 --2- 172.21.15.33:0/476787329 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55e6807c5260 0x55e6807c76c0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e40b54edb7c3685 server_cookie=3a458ccbef27d60a in_seq=0 out_seq=0 2024-09-12T12:35:02.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.455+0000 7fc759ffb640 1 -- 172.21.15.33:0/476787329 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e680717d60 con 0x55e6807c5260 2024-09-12T12:35:02.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.455+0000 7fc759ffb640 10 client.25888 handle_command_reply: tid=0 2024-09-12T12:35:02.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.455+0000 7fc77abc8740 1 client.25888 shutdown 2024-09-12T12:35:02.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.459+0000 7fc77abc8740 1 -- 172.21.15.33:0/476787329 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e6807aadc0 msgr2=0x55e6807b2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:02.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.459+0000 7fc77abc8740 1 --2- 172.21.15.33:0/476787329 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e6807aadc0 0x55e6807b2290 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc76c035040 tx=0x7fc76c004270 comp rx=0 tx=0).stop 2024-09-12T12:35:02.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.459+0000 7fc77abc8740 1 -- 172.21.15.33:0/476787329 shutdown_connections 2024-09-12T12:35:02.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.459+0000 7fc77abc8740 1 --2- 172.21.15.33:0/476787329 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55e6807c5260 0x55e6807c76c0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:02.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.459+0000 7fc77abc8740 1 --2- 172.21.15.33:0/476787329 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e6807b5680 0x55e6807b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:02.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.459+0000 7fc77abc8740 1 --2- 172.21.15.33:0/476787329 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e6807aadc0 0x55e6807b2290 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:02.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.459+0000 7fc77abc8740 1 --2- 172.21.15.33:0/476787329 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6807aa4a0 0x55e6807b4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:02.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.459+0000 7fc759ffb640 0 client.25888 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:35:02.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.459+0000 7fc77abc8740 1 -- 172.21.15.33:0/476787329 >> 172.21.15.33:0/476787329 conn(0x55e6807a6a30 msgr2=0x55e6807a5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:35:02.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.459+0000 7fc77abc8740 1 -- 172.21.15.33:0/476787329 shutdown_connections 2024-09-12T12:35:02.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.460+0000 7fc77abc8740 1 -- 172.21.15.33:0/476787329 wait complete. 2024-09-12T12:35:02.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.460+0000 7fc77abc8740 20 client.25888 trim_cache size 0 max 16384 2024-09-12T12:35:02.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.499+0000 7fc77abc8740 1 Processor -- start 2024-09-12T12:35:02.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.499+0000 7fc77abc8740 1 -- start start 2024-09-12T12:35:02.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.500+0000 7fc77abc8740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6807aa4a0 0x55e6807c15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:02.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.500+0000 7fc77abc8740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e6807aadc0 0x55e6807ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:02.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.500+0000 7fc77abc8740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e6807b5680 0x55e6807cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:02.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.500+0000 7fc77abc8740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc754012570 con 0x55e6807aa4a0 2024-09-12T12:35:02.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.500+0000 7fc77abc8740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc75400fe40 con 0x55e6807b5680 2024-09-12T12:35:02.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.500+0000 7fc77abc8740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc75400dc90 con 0x55e6807aadc0 2024-09-12T12:35:02.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.503+0000 7fc77658b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e6807aadc0 0x55e6807ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:02.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.503+0000 7fc775d8a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e6807b5680 0x55e6807cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:02.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.503+0000 7fc775d8a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6807aa4a0 0x55e6807c15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:02.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.503+0000 7fc775d8a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6807aa4a0 0x55e6807c15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33420/0 (socket says 172.21.15.33:33420) 2024-09-12T12:35:02.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.503+0000 7fc77658b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e6807aadc0 0x55e6807ccf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:44804/0 (socket says 172.21.15.33:44804) 2024-09-12T12:35:02.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.503+0000 7fc775d8a640 1 -- 172.21.15.33:0/1126752728 learned_addr learned my addr 172.21.15.33:0/1126752728 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:35:02.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.505+0000 7fc77658b640 1 -- 172.21.15.33:0/1126752728 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e6807b5680 msgr2=0x55e6807cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:35:02.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.505+0000 7fc77658b640 1 --2- 172.21.15.33:0/1126752728 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e6807b5680 0x55e6807cd4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:02.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.505+0000 7fc77658b640 1 -- 172.21.15.33:0/1126752728 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6807aa4a0 msgr2=0x55e6807c15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:35:02.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.505+0000 7fc77658b640 1 --2- 172.21.15.33:0/1126752728 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6807aa4a0 0x55e6807c15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:02.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.505+0000 7fc77658b640 1 -- 172.21.15.33:0/1126752728 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6807a7ba0 con 0x55e6807aadc0 2024-09-12T12:35:02.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.506+0000 7fc77658b640 1 --2- 172.21.15.33:0/1126752728 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e6807aadc0 0x55e6807ccf90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc76c047040 tx=0x7fc76c0058d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80ff2fb85f31430c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:35:02.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.510+0000 7fc75bfff640 1 -- 172.21.15.33:0/1126752728 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76c051020 con 0x55e6807aadc0 2024-09-12T12:35:02.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.510+0000 7fc75bfff640 1 -- 172.21.15.33:0/1126752728 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc76c004b70 con 0x55e6807aadc0 2024-09-12T12:35:02.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.511+0000 7fc77abc8740 1 -- 172.21.15.33:0/1126752728 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e6807aadc0 msgr2=0x55e6807ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:02.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.511+0000 7fc77abc8740 1 --2- 172.21.15.33:0/1126752728 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e6807aadc0 0x55e6807ccf90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc76c047040 tx=0x7fc76c0058d0 comp rx=0 tx=0).stop 2024-09-12T12:35:02.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.514+0000 7fc77abc8740 1 -- 172.21.15.33:0/1126752728 shutdown_connections 2024-09-12T12:35:02.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.514+0000 7fc77abc8740 1 --2- 172.21.15.33:0/1126752728 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e6807b5680 0x55e6807cd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:02.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.514+0000 7fc77abc8740 1 --2- 172.21.15.33:0/1126752728 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e6807aadc0 0x55e6807ccf90 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:02.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.514+0000 7fc77abc8740 1 --2- 172.21.15.33:0/1126752728 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6807aa4a0 0x55e6807c15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:02.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.514+0000 7fc77abc8740 1 -- 172.21.15.33:0/1126752728 >> 172.21.15.33:0/1126752728 conn(0x55e6807a6a30 msgr2=0x55e6807b1380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:35:02.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.514+0000 7fc77abc8740 1 -- 172.21.15.33:0/1126752728 shutdown_connections 2024-09-12T12:35:02.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.514+0000 7fc77abc8740 1 -- 172.21.15.33:0/1126752728 wait complete. 2024-09-12T12:35:02.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.515+0000 7fc77abc8740 1 -- start start 2024-09-12T12:35:02.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.515+0000 7fc77abc8740 1 Processor -- start 2024-09-12T12:35:02.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.517+0000 7fc77abc8740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e6807aa4a0 0x55e6807baf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:02.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.517+0000 7fc77abc8740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6807aadc0 0x55e6807bb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:02.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.517+0000 7fc77abc8740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e6807b5680 0x55e680826f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:02.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.517+0000 7fc77abc8740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc75400e300 con 0x55e6807aadc0 2024-09-12T12:35:02.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.517+0000 7fc77abc8740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc75400f770 con 0x55e6807b5680 2024-09-12T12:35:02.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.517+0000 7fc77abc8740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc75400e9d0 con 0x55e6807aa4a0 2024-09-12T12:35:02.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.517+0000 7fc77abc8740 10 client.0 _ll_register_callbacks cb 0x7fc76c035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:35:02.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.519+0000 7fc77658b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6807aadc0 0x55e6807bb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:02.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.519+0000 7fc775d8a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e6807aa4a0 0x55e6807baf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:02.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.519+0000 7fc77658b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6807aadc0 0x55e6807bb4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33426/0 (socket says 172.21.15.33:33426) 2024-09-12T12:35:02.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.519+0000 7fc775d8a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e6807aa4a0 0x55e6807baf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:44814/0 (socket says 172.21.15.33:44814) 2024-09-12T12:35:02.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.519+0000 7fc77658b640 1 -- 172.21.15.33:0/1638345552 learned_addr learned my addr 172.21.15.33:0/1638345552 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:35:02.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.519+0000 7fc775d8a640 1 --2- 172.21.15.33:0/1638345552 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e6807b5680 0x55e680826f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:02.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.520+0000 7fc775d8a640 1 -- 172.21.15.33:0/1638345552 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e6807b5680 msgr2=0x55e680826f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:35:02.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.520+0000 7fc775d8a640 1 --2- 172.21.15.33:0/1638345552 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e6807b5680 0x55e680826f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:02.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.520+0000 7fc775d8a640 1 -- 172.21.15.33:0/1638345552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6807aadc0 msgr2=0x55e6807bb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:35:02.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.520+0000 7fc775d8a640 1 --2- 172.21.15.33:0/1638345552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6807aadc0 0x55e6807bb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:02.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.520+0000 7fc775d8a640 1 -- 172.21.15.33:0/1638345552 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6808275c0 con 0x55e6807aa4a0 2024-09-12T12:35:02.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.520+0000 7fc775d8a640 1 --2- 172.21.15.33:0/1638345552 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e6807aa4a0 0x55e6807baf90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc7600145d0 tx=0x7fc76000cc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f88726ea7fff1059 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:35:02.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.520+0000 7fc759ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:35:02.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.524+0000 7fc759ffb640 1 -- 172.21.15.33:0/1638345552 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7600140b0 con 0x55e6807aa4a0 2024-09-12T12:35:02.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.524+0000 7fc77abc8740 1 -- 172.21.15.33:0/1638345552 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc76c004b70 con 0x55e6807aa4a0 2024-09-12T12:35:02.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.524+0000 7fc759ffb640 1 -- 172.21.15.33:0/1638345552 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fc760014250 con 0x55e6807aa4a0 2024-09-12T12:35:02.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.526+0000 7fc759ffb640 1 -- 172.21.15.33:0/1638345552 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc76000f500 con 0x55e6807aa4a0 2024-09-12T12:35:02.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.531+0000 7fc77abc8740 10 client.25894 fetch_fsmap learned FSMap version 27 2024-09-12T12:35:02.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.531+0000 7fc77abc8740 1 -- 172.21.15.33:0/1638345552 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e68082fb60 con 0x55e6807aa4a0 2024-09-12T12:35:02.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.532+0000 7fc759ffb640 1 -- 172.21.15.33:0/1638345552 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc76c004b70 con 0x55e6807aa4a0 2024-09-12T12:35:02.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.533+0000 7fc759ffb640 1 -- 172.21.15.33:0/1638345552 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fc760003960 con 0x55e6807aa4a0 2024-09-12T12:35:02.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.533+0000 7fc77abc8740 10 client.25894 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:35:02.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.533+0000 7fc77abc8740 10 client.25894 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:35:02.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.533+0000 7fc77abc8740 20 client.25894 populate_metadata read hostname 'smithi033' 2024-09-12T12:35:02.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.533+0000 7fc77abc8740 1 --2- 172.21.15.33:0/1638345552 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55e68082fef0 0x55e6808322e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:02.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.533+0000 7fc77abc8740 4 client.25894 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:35:02.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.533+0000 7fc77abc8740 1 -- 172.21.15.33:0/1638345552 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e680694210 con 0x55e68082fef0 2024-09-12T12:35:02.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.533+0000 7fc77658b640 1 --2- 172.21.15.33:0/1638345552 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55e68082fef0 0x55e6808322e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:02.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.541+0000 7fc759ffb640 10 client.25894 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:35:02.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.541+0000 7fc77658b640 1 --2- 172.21.15.33:0/1638345552 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55e68082fef0 0x55e6808322e0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92a6b05b306fed46 server_cookie=d220dd780ed7d4b7 in_seq=0 out_seq=0 2024-09-12T12:35:02.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.541+0000 7fc759ffb640 1 -- 172.21.15.33:0/1638345552 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55e680694210 con 0x55e68082fef0 2024-09-12T12:35:02.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.541+0000 7fc759ffb640 10 client.25894 handle_command_reply: tid=0 2024-09-12T12:35:02.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.541+0000 7fc77abc8740 1 client.25894 shutdown 2024-09-12T12:35:02.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.542+0000 7fc77abc8740 1 -- 172.21.15.33:0/1638345552 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e6807aa4a0 msgr2=0x55e6807baf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:02.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.542+0000 7fc77abc8740 1 --2- 172.21.15.33:0/1638345552 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e6807aa4a0 0x55e6807baf90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc7600145d0 tx=0x7fc76000cc00 comp rx=0 tx=0).stop 2024-09-12T12:35:02.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.544+0000 7fc77abc8740 1 -- 172.21.15.33:0/1638345552 shutdown_connections 2024-09-12T12:35:02.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.544+0000 7fc77abc8740 1 --2- 172.21.15.33:0/1638345552 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55e68082fef0 0x55e6808322e0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:02.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.544+0000 7fc77abc8740 1 --2- 172.21.15.33:0/1638345552 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e6807b5680 0x55e680826f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:02.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.544+0000 7fc77abc8740 1 --2- 172.21.15.33:0/1638345552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6807aadc0 0x55e6807bb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:02.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.544+0000 7fc77abc8740 1 --2- 172.21.15.33:0/1638345552 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e6807aa4a0 0x55e6807baf90 secure :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc7600145d0 tx=0x7fc76000cc00 comp rx=0 tx=0).stop 2024-09-12T12:35:02.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.544+0000 7fc759ffb640 0 client.25894 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:35:02.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.544+0000 7fc77abc8740 1 -- 172.21.15.33:0/1638345552 >> 172.21.15.33:0/1638345552 conn(0x55e6807a6a30 msgr2=0x55e6807b3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:35:02.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.548+0000 7fc77abc8740 1 -- 172.21.15.33:0/1638345552 shutdown_connections 2024-09-12T12:35:02.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.548+0000 7fc77abc8740 1 -- 172.21.15.33:0/1638345552 wait complete. 2024-09-12T12:35:02.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.548+0000 7fc77abc8740 20 client.25894 trim_cache size 0 max 16384 2024-09-12T12:35:02.550 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:35:02.550 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "no active scrubs running", 2024-09-12T12:35:02.550 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": {} 2024-09-12T12:35:02.550 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:35:02.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.550+0000 7fc7787ef640 1 -- 172.21.15.33:0/541549494 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc75c0a2cc0 msgr2=0x7fc75c0a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:02.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.550+0000 7fc7787ef640 1 --2- 172.21.15.33:0/541549494 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc75c0a2cc0 0x7fc75c0a5180 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc7680a3fa0 tx=0x7fc768013c50 comp rx=0 tx=0).stop 2024-09-12T12:35:02.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.550+0000 7fc7787ef640 1 -- 172.21.15.33:0/541549494 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7700805f0 msgr2=0x7fc770136280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:02.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.550+0000 7fc7787ef640 1 --2- 172.21.15.33:0/541549494 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7700805f0 0x7fc770136280 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc76800ae10 tx=0x7fc768004410 comp rx=0 tx=0).stop 2024-09-12T12:35:02.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.551+0000 7fc7787ef640 1 -- 172.21.15.33:0/541549494 shutdown_connections 2024-09-12T12:35:02.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.551+0000 7fc7787ef640 1 --2- 172.21.15.33:0/541549494 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc75c0a2cc0 0x7fc75c0a5180 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:02.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.551+0000 7fc7787ef640 1 --2- 172.21.15.33:0/541549494 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7700805f0 0x7fc770136280 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:02.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.551+0000 7fc7787ef640 1 --2- 172.21.15.33:0/541549494 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc770109e00 0x7fc77007ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:02.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.551+0000 7fc7787ef640 1 --2- 172.21.15.33:0/541549494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc770074990 0x7fc770084e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:02.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.551+0000 7fc7787ef640 1 -- 172.21.15.33:0/541549494 >> 172.21.15.33:0/541549494 conn(0x7fc77006e140 msgr2=0x7fc7700726e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:35:02.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.551+0000 7fc7787ef640 1 -- 172.21.15.33:0/541549494 shutdown_connections 2024-09-12T12:35:02.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:02.551+0000 7fc7787ef640 1 -- 172.21.15.33:0/541549494 wait complete. 2024-09-12T12:35:03.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:35:02 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:35:03.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:35:02 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:35:03.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:35:02 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:35:03.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:35:02 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:35:03.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:35:02 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:35:03.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:35:02 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:35:03.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:35:02 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:35:03.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:35:02 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:35:03.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:35:02 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:35:03.571 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T12:35:03.572 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:35:04.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:35:03 smithi043 ceph-mon[34144]: pgmap v621: 129 pgs: 129 active+clean; 10 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 33 MiB/s wr, 668 op/s 2024-09-12T12:35:04.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:35:03 smithi102 ceph-mon[34799]: pgmap v621: 129 pgs: 129 active+clean; 10 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 33 MiB/s wr, 668 op/s 2024-09-12T12:35:04.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:35:03 smithi033 ceph-mon[31246]: pgmap v621: 129 pgs: 129 active+clean; 10 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 33 MiB/s wr, 668 op/s 2024-09-12T12:35:04.293 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:35:05.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.232+0000 7fe265159640 1 -- 172.21.15.33:0/2460600720 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe260110220 msgr2=0x7fe26006e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:05.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.232+0000 7fe265159640 1 --2- 172.21.15.33:0/2460600720 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe260110220 0x7fe26006e4f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe258009ca0 tx=0x7fe25802a8d0 comp rx=0 tx=0).stop 2024-09-12T12:35:05.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.237+0000 7fe265159640 1 -- 172.21.15.33:0/2460600720 shutdown_connections 2024-09-12T12:35:05.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.237+0000 7fe265159640 1 --2- 172.21.15.33:0/2460600720 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe26011b140 0x7fe26011d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:05.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.237+0000 7fe265159640 1 --2- 172.21.15.33:0/2460600720 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe26006ea30 0x7fe26006ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:05.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.237+0000 7fe265159640 1 --2- 172.21.15.33:0/2460600720 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe260110220 0x7fe26006e4f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:05.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.237+0000 7fe265159640 1 -- 172.21.15.33:0/2460600720 >> 172.21.15.33:0/2460600720 conn(0x7fe260073210 msgr2=0x7fe260073620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:35:05.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.242+0000 7fe265159640 1 -- 172.21.15.33:0/2460600720 shutdown_connections 2024-09-12T12:35:05.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.244+0000 7fe265159640 1 -- 172.21.15.33:0/2460600720 wait complete. 2024-09-12T12:35:05.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.245+0000 7fe265159640 1 Processor -- start 2024-09-12T12:35:05.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.245+0000 7fe265159640 1 -- start start 2024-09-12T12:35:05.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.246+0000 7fe265159640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe260110220 0x7fe2601187d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:05.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.246+0000 7fe265159640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe26011b140 0x7fe260111860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:05.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.246+0000 7fe265159640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe260111da0 0x7fe260112250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:05.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.246+0000 7fe265159640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe260120c90 con 0x7fe260111da0 2024-09-12T12:35:05.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.246+0000 7fe265159640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe260120b10 con 0x7fe26011b140 2024-09-12T12:35:05.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.246+0000 7fe265159640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe260120e10 con 0x7fe260110220 2024-09-12T12:35:05.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.248+0000 7fe25ed9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe260110220 0x7fe2601187d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:05.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.248+0000 7fe25f59e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe260111da0 0x7fe260112250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:05.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.248+0000 7fe25f59e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe260111da0 0x7fe260112250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33452/0 (socket says 172.21.15.33:33452) 2024-09-12T12:35:05.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.248+0000 7fe25ed9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe260110220 0x7fe2601187d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:44832/0 (socket says 172.21.15.33:44832) 2024-09-12T12:35:05.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.248+0000 7fe25f59e640 1 -- 172.21.15.33:0/3354615939 learned_addr learned my addr 172.21.15.33:0/3354615939 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:35:05.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.250+0000 7fe25f59e640 1 -- 172.21.15.33:0/3354615939 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe260110220 msgr2=0x7fe2601187d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:05.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.251+0000 7fe25f59e640 1 --2- 172.21.15.33:0/3354615939 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe260110220 0x7fe2601187d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:05.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.251+0000 7fe25e59c640 1 --2- 172.21.15.33:0/3354615939 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe26011b140 0x7fe260111860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:05.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.251+0000 7fe25f59e640 1 -- 172.21.15.33:0/3354615939 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe26011b140 msgr2=0x7fe260111860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:05.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.251+0000 7fe25f59e640 1 --2- 172.21.15.33:0/3354615939 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe26011b140 0x7fe260111860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:05.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.251+0000 7fe25f59e640 1 -- 172.21.15.33:0/3354615939 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe260116300 con 0x7fe260111da0 2024-09-12T12:35:05.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.251+0000 7fe25ed9d640 1 --2- 172.21.15.33:0/3354615939 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe260110220 0x7fe2601187d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:35:05.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.252+0000 7fe25f59e640 1 --2- 172.21.15.33:0/3354615939 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe260111da0 0x7fe260112250 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fe25400b3e0 tx=0x7fe254009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:35:05.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.252+0000 7fe247fff640 1 -- 172.21.15.33:0/3354615939 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe254015020 con 0x7fe260111da0 2024-09-12T12:35:05.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.252+0000 7fe247fff640 1 -- 172.21.15.33:0/3354615939 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe254011ce0 con 0x7fe260111da0 2024-09-12T12:35:05.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.252+0000 7fe265159640 1 -- 172.21.15.33:0/3354615939 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2601165f0 con 0x7fe260111da0 2024-09-12T12:35:05.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.252+0000 7fe265159640 1 -- 172.21.15.33:0/3354615939 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe260116ae0 con 0x7fe260111da0 2024-09-12T12:35:05.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.253+0000 7fe247fff640 1 -- 172.21.15.33:0/3354615939 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe254010de0 con 0x7fe260111da0 2024-09-12T12:35:05.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.254+0000 7fe265159640 1 -- 172.21.15.33:0/3354615939 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe260109740 con 0x7fe260111da0 2024-09-12T12:35:05.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.260+0000 7fe247fff640 1 -- 172.21.15.33:0/3354615939 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe254018020 con 0x7fe260111da0 2024-09-12T12:35:05.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.261+0000 7fe247fff640 1 --2- 172.21.15.33:0/3354615939 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe2480a2cd0 0x7fe2480a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:05.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.262+0000 7fe25ed9d640 1 --2- 172.21.15.33:0/3354615939 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe2480a2cd0 0x7fe2480a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:05.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.262+0000 7fe247fff640 1 -- 172.21.15.33:0/3354615939 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fe254099770 con 0x7fe260111da0 2024-09-12T12:35:05.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.263+0000 7fe25ed9d640 1 --2- 172.21.15.33:0/3354615939 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe2480a2cd0 0x7fe2480a5190 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe25802f3b0 tx=0x7fe25802f320 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:35:05.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.269+0000 7fe247fff640 1 -- 172.21.15.33:0/3354615939 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe25401f020 con 0x7fe260111da0 2024-09-12T12:35:05.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.688+0000 7fe265159640 1 -- 172.21.15.33:0/3354615939 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe26006dbf0 con 0x7fe260111da0 2024-09-12T12:35:05.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.690+0000 7fe247fff640 1 -- 172.21.15.33:0/3354615939 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11912 (secure 0 0 0) 0x7fe2540172c0 con 0x7fe260111da0 2024-09-12T12:35:05.693 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:35:05.693 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":27,"btime":"2024-09-12T12:29:38:065241+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3327066342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3327066342},{"type":"v1","addr":"172.21.15.33:6835","nonce":3327066342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/19516401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":19516401},{"type":"v1","addr":"172.21.15.33:6837","nonce":19516401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1260196118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1260196118},{"type":"v1","addr":"172.21.15.33:6839","nonce":1260196118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/4288248356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4288248356},{"type":"v1","addr":"172.21.15.33:6841","nonce":4288248356}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/3051073141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3051073141},{"type":"v1","addr":"172.21.15.43:6833","nonce":3051073141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3282762800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3282762800},{"type":"v1","addr":"172.21.15.43:6835","nonce":3282762800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:23:46.400609+0000","modified":"2024-09-12T12:29:37.555614+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24490,"mds_2":24478},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3051713000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3051713000},{"type":"v1","addr":"172.21.15.102:6833","nonce":3051713000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6837/2472064883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2472064883},{"type":"v1","addr":"172.21.15.43:6837","nonce":2472064883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/1987408860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":1987408860},{"type":"v1","addr":"172.21.15.43:6839","nonce":1987408860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/4179527539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":4179527539},{"type":"v1","addr":"172.21.15.102:6835","nonce":4179527539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/2409953270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2409953270},{"type":"v1","addr":"172.21.15.102:6837","nonce":2409953270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.102:6839/1553271340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":1553271340},{"type":"v1","addr":"172.21.15.102:6839","nonce":1553271340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24499,"qdb_cluster":[24499,24490,24478]},"id":1}]} 2024-09-12T12:35:05.694 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 27 2024-09-12T12:35:05.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.697+0000 7fe265159640 1 -- 172.21.15.33:0/3354615939 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe2480a2cd0 msgr2=0x7fe2480a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:05.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.697+0000 7fe265159640 1 --2- 172.21.15.33:0/3354615939 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe2480a2cd0 0x7fe2480a5190 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe25802f3b0 tx=0x7fe25802f320 comp rx=0 tx=0).stop 2024-09-12T12:35:05.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.697+0000 7fe265159640 1 -- 172.21.15.33:0/3354615939 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe260111da0 msgr2=0x7fe260112250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:05.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.697+0000 7fe265159640 1 --2- 172.21.15.33:0/3354615939 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe260111da0 0x7fe260112250 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fe25400b3e0 tx=0x7fe254009f90 comp rx=0 tx=0).stop 2024-09-12T12:35:05.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.698+0000 7fe265159640 1 -- 172.21.15.33:0/3354615939 shutdown_connections 2024-09-12T12:35:05.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.698+0000 7fe265159640 1 --2- 172.21.15.33:0/3354615939 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe2480a2cd0 0x7fe2480a5190 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:05.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.698+0000 7fe265159640 1 --2- 172.21.15.33:0/3354615939 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe260111da0 0x7fe260112250 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:05.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.698+0000 7fe265159640 1 --2- 172.21.15.33:0/3354615939 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe26011b140 0x7fe260111860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:05.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.698+0000 7fe265159640 1 --2- 172.21.15.33:0/3354615939 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe260110220 0x7fe2601187d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:05.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.698+0000 7fe265159640 1 -- 172.21.15.33:0/3354615939 >> 172.21.15.33:0/3354615939 conn(0x7fe260073210 msgr2=0x7fe260119480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:35:05.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.702+0000 7fe265159640 1 -- 172.21.15.33:0/3354615939 shutdown_connections 2024-09-12T12:35:05.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:05.704+0000 7fe265159640 1 -- 172.21.15.33:0/3354615939 wait complete. 2024-09-12T12:35:05.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:35:05 smithi033 ceph-mon[31246]: pgmap v622: 129 pgs: 129 active+clean; 10 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 36 MiB/s wr, 728 op/s 2024-09-12T12:35:05.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:35:05 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/3354615939' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:35:06.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:35:05 smithi043 ceph-mon[34144]: pgmap v622: 129 pgs: 129 active+clean; 10 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 36 MiB/s wr, 728 op/s 2024-09-12T12:35:06.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:35:05 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/3354615939' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:35:06.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:35:05 smithi102 ceph-mon[34799]: pgmap v622: 129 pgs: 129 active+clean; 10 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 36 MiB/s wr, 728 op/s 2024-09-12T12:35:06.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:35:05 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/3354615939' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:35:06.434 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T12:35:07.114 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:35:07.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:35:07 smithi033 ceph-mon[31246]: pgmap v623: 129 pgs: 129 active+clean; 10 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 29 MiB/s wr, 588 op/s 2024-09-12T12:35:08.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.005+0000 7fb0fe365640 1 -- 172.21.15.33:0/2416439070 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0f00a5400 msgr2=0x7fb0f00ac270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:08.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.005+0000 7fb0fe365640 1 --2- 172.21.15.33:0/2416439070 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0f00a5400 0x7fb0f00ac270 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4009900 tx=0x7fb0f402a420 comp rx=0 tx=0).stop 2024-09-12T12:35:08.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.007+0000 7fb0fe365640 1 -- 172.21.15.33:0/2416439070 shutdown_connections 2024-09-12T12:35:08.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.007+0000 7fb0fe365640 1 --2- 172.21.15.33:0/2416439070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb0f00b7160 0x7fb0f00b9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:08.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.007+0000 7fb0fe365640 1 --2- 172.21.15.33:0/2416439070 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0f00a5400 0x7fb0f00ac270 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:08.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.007+0000 7fb0fe365640 1 --2- 172.21.15.33:0/2416439070 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0f00a4a50 0x7fb0f00a4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:08.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.007+0000 7fb0fe365640 1 -- 172.21.15.33:0/2416439070 >> 172.21.15.33:0/2416439070 conn(0x7fb0f001a0a0 msgr2=0x7fb0f001a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:35:08.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.007+0000 7fb0fe365640 1 -- 172.21.15.33:0/2416439070 shutdown_connections 2024-09-12T12:35:08.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.007+0000 7fb0fe365640 1 -- 172.21.15.33:0/2416439070 wait complete. 2024-09-12T12:35:08.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.008+0000 7fb0fe365640 1 Processor -- start 2024-09-12T12:35:08.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.009+0000 7fb0fe365640 1 -- start start 2024-09-12T12:35:08.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.009+0000 7fb0fe365640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0f00a4a50 0x7fb0f00b6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:08.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.010+0000 7fb0fe365640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0f00a5400 0x7fb0f00af6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:08.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.010+0000 7fb0fe365640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb0f00b7160 0x7fb0f00afc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:08.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.010+0000 7fb0fe365640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f00bce80 con 0x7fb0f00b7160 2024-09-12T12:35:08.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.010+0000 7fb0fe365640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f00bcd00 con 0x7fb0f00a4a50 2024-09-12T12:35:08.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.010+0000 7fb0fe365640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f00bd000 con 0x7fb0f00a5400 2024-09-12T12:35:08.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.010+0000 7fb0fdb64640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb0f00b7160 0x7fb0f00afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:08.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.010+0000 7fb0fdb64640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb0f00b7160 0x7fb0f00afc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33470/0 (socket says 172.21.15.33:33470) 2024-09-12T12:35:08.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.010+0000 7fb0fdb64640 1 -- 172.21.15.33:0/4229169979 learned_addr learned my addr 172.21.15.33:0/4229169979 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:35:08.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.010+0000 7fb0fcb62640 1 --2- 172.21.15.33:0/4229169979 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0f00a5400 0x7fb0f00af6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:08.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.010+0000 7fb0fd363640 1 --2- 172.21.15.33:0/4229169979 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0f00a4a50 0x7fb0f00b6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:08.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.012+0000 7fb0fdb64640 1 -- 172.21.15.33:0/4229169979 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0f00a5400 msgr2=0x7fb0f00af6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:08.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.012+0000 7fb0fdb64640 1 --2- 172.21.15.33:0/4229169979 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0f00a5400 0x7fb0f00af6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:08.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.012+0000 7fb0fdb64640 1 -- 172.21.15.33:0/4229169979 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0f00a4a50 msgr2=0x7fb0f00b6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:08.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.012+0000 7fb0fdb64640 1 --2- 172.21.15.33:0/4229169979 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0f00a4a50 0x7fb0f00b6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:08.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.012+0000 7fb0fdb64640 1 -- 172.21.15.33:0/4229169979 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0f00b0250 con 0x7fb0f00b7160 2024-09-12T12:35:08.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.019+0000 7fb0fdb64640 1 --2- 172.21.15.33:0/4229169979 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb0f00b7160 0x7fb0f00afc10 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fb0e800d750 tx=0x7fb0e800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:35:08.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.021+0000 7fb0ee7fc640 1 -- 172.21.15.33:0/4229169979 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e8017070 con 0x7fb0f00b7160 2024-09-12T12:35:08.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.021+0000 7fb0ee7fc640 1 -- 172.21.15.33:0/4229169979 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb0e80054d0 con 0x7fb0f00b7160 2024-09-12T12:35:08.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.021+0000 7fb0fe365640 1 -- 172.21.15.33:0/4229169979 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0f00b4170 con 0x7fb0f00b7160 2024-09-12T12:35:08.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.021+0000 7fb0fe365640 1 -- 172.21.15.33:0/4229169979 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0f00b4680 con 0x7fb0f00b7160 2024-09-12T12:35:08.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.021+0000 7fb0ee7fc640 1 -- 172.21.15.33:0/4229169979 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e8004c60 con 0x7fb0f00b7160 2024-09-12T12:35:08.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.025+0000 7fb0ee7fc640 1 -- 172.21.15.33:0/4229169979 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fb0e8004e00 con 0x7fb0f00b7160 2024-09-12T12:35:08.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.026+0000 7fb0ee7fc640 1 --2- 172.21.15.33:0/4229169979 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb0e40a2ce0 0x7fb0e40a51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:08.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.026+0000 7fb0ee7fc640 1 -- 172.21.15.33:0/4229169979 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fb0e80991e0 con 0x7fb0f00b7160 2024-09-12T12:35:08.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.027+0000 7fb0fd363640 1 --2- 172.21.15.33:0/4229169979 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb0e40a2ce0 0x7fb0e40a51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:08.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.028+0000 7fb0fd363640 1 --2- 172.21.15.33:0/4229169979 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb0e40a2ce0 0x7fb0e40a51a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8050d60 tx=0x7fb0f806e040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:35:08.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.030+0000 7fb1019a0740 1 Processor -- start 2024-09-12T12:35:08.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.031+0000 7fb1019a0740 1 -- start start 2024-09-12T12:35:08.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.031+0000 7fb1019a0740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e9e3fcd20 0x563e9e3fb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:08.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.031+0000 7fb1019a0740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563e9e3fb7b0 0x563e9e3fbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:08.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.031+0000 7fb1019a0740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563e9e406550 0x563e9e408940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:08.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.031+0000 7fb1019a0740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x563e9e3612f0 con 0x563e9e3fb7b0 2024-09-12T12:35:08.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.031+0000 7fb1019a0740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x563e9e308cf0 con 0x563e9e406550 2024-09-12T12:35:08.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.031+0000 7fb1019a0740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x563e9e35d2b0 con 0x563e9e3fcd20 2024-09-12T12:35:08.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.032+0000 7fb0fdb64640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563e9e406550 0x563e9e408940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:08.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.032+0000 7fb0fdb64640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563e9e406550 0x563e9e408940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:43524/0 (socket says 172.21.15.33:43524) 2024-09-12T12:35:08.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.032+0000 7fb0fdb64640 1 -- 172.21.15.33:0/589699308 learned_addr learned my addr 172.21.15.33:0/589699308 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:35:08.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.033+0000 7fb0fdb64640 1 -- 172.21.15.33:0/589699308 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e9e3fcd20 msgr2=0x563e9e3fb270 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:35:08.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.033+0000 7fb0fdb64640 1 --2- 172.21.15.33:0/589699308 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e9e3fcd20 0x563e9e3fb270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:08.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.033+0000 7fb0fdb64640 1 -- 172.21.15.33:0/589699308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563e9e3fb7b0 msgr2=0x563e9e3fbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:35:08.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.033+0000 7fb0fdb64640 1 --2- 172.21.15.33:0/589699308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563e9e3fb7b0 0x563e9e3fbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:08.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.033+0000 7fb0fdb64640 1 -- 172.21.15.33:0/589699308 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e9e2ed3a0 con 0x563e9e406550 2024-09-12T12:35:08.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.034+0000 7fb0fdb64640 1 --2- 172.21.15.33:0/589699308 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563e9e406550 0x563e9e408940 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8097b10 tx=0x7fb0e800dee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2059f097e01db6c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:35:08.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.034+0000 7fb0e37fe640 1 -- 172.21.15.33:0/589699308 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e80b4070 con 0x563e9e406550 2024-09-12T12:35:08.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.034+0000 7fb0e37fe640 1 -- 172.21.15.33:0/589699308 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb0e80a3db0 con 0x563e9e406550 2024-09-12T12:35:08.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.035+0000 7fb1019a0740 1 -- 172.21.15.33:0/589699308 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563e9e406550 msgr2=0x563e9e408940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:08.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.035+0000 7fb1019a0740 1 --2- 172.21.15.33:0/589699308 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563e9e406550 0x563e9e408940 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8097b10 tx=0x7fb0e800dee0 comp rx=0 tx=0).stop 2024-09-12T12:35:08.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.036+0000 7fb1019a0740 1 -- 172.21.15.33:0/589699308 shutdown_connections 2024-09-12T12:35:08.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.036+0000 7fb1019a0740 1 --2- 172.21.15.33:0/589699308 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563e9e406550 0x563e9e408940 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:08.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.036+0000 7fb1019a0740 1 --2- 172.21.15.33:0/589699308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563e9e3fb7b0 0x563e9e3fbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:08.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.036+0000 7fb1019a0740 1 --2- 172.21.15.33:0/589699308 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e9e3fcd20 0x563e9e3fb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:08.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.036+0000 7fb1019a0740 1 -- 172.21.15.33:0/589699308 >> 172.21.15.33:0/589699308 conn(0x563e9e3c4310 msgr2=0x563e9e3f7e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:35:08.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.042+0000 7fb1019a0740 1 -- 172.21.15.33:0/589699308 shutdown_connections 2024-09-12T12:35:08.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.043+0000 7fb1019a0740 1 -- 172.21.15.33:0/589699308 wait complete. 2024-09-12T12:35:08.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.044+0000 7fb1019a0740 1 -- start start 2024-09-12T12:35:08.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.044+0000 7fb1019a0740 1 Processor -- start 2024-09-12T12:35:08.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.045+0000 7fb1019a0740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e9e406550 0x563e9e405fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:08.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.045+0000 7fb1019a0740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563e9e403290 0x563e9e403710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:08.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.045+0000 7fb1019a0740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563e9e403d60 0x563e9e412840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:08.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.045+0000 7fb1019a0740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x563e9e4092a0 con 0x563e9e403d60 2024-09-12T12:35:08.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.045+0000 7fb1019a0740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x563e9e31c060 con 0x563e9e403290 2024-09-12T12:35:08.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.045+0000 7fb1019a0740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x563e9e409420 con 0x563e9e406550 2024-09-12T12:35:08.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.045+0000 7fb1019a0740 10 client.0 _ll_register_callbacks cb 0x563e9e06f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:35:08.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.046+0000 7fb0fd363640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e9e406550 0x563e9e405fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:08.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.047+0000 7fb0fd363640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e9e406550 0x563e9e405fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:44872/0 (socket says 172.21.15.33:44872) 2024-09-12T12:35:08.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.047+0000 7fb0fd363640 1 -- 172.21.15.33:0/1855260116 learned_addr learned my addr 172.21.15.33:0/1855260116 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:35:08.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.047+0000 7fb0fdb64640 1 --2- 172.21.15.33:0/1855260116 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563e9e403d60 0x563e9e412840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:08.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.047+0000 7fb0fcb62640 1 --2- 172.21.15.33:0/1855260116 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563e9e403290 0x563e9e403710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:08.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.047+0000 7fb0fd363640 1 -- 172.21.15.33:0/1855260116 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563e9e403290 msgr2=0x563e9e403710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:35:08.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.047+0000 7fb0fd363640 1 --2- 172.21.15.33:0/1855260116 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563e9e403290 0x563e9e403710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:08.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.047+0000 7fb0fd363640 1 -- 172.21.15.33:0/1855260116 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563e9e403d60 msgr2=0x563e9e412840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:35:08.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.047+0000 7fb0fd363640 1 --2- 172.21.15.33:0/1855260116 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563e9e403d60 0x563e9e412840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:08.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.047+0000 7fb0fd363640 1 -- 172.21.15.33:0/1855260116 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e9e0d23c0 con 0x563e9e406550 2024-09-12T12:35:08.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.047+0000 7fb0fd363640 1 --2- 172.21.15.33:0/1855260116 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e9e406550 0x563e9e405fe0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8068040 tx=0x7fb0f8067f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=843e1adf01b634a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:35:08.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.048+0000 7fb0e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:35:08.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.050+0000 7fb0e0ff9640 1 -- 172.21.15.33:0/1855260116 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f808a060 con 0x563e9e406550 2024-09-12T12:35:08.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.050+0000 7fb1019a0740 1 -- 172.21.15.33:0/1855260116 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0e80a3db0 con 0x563e9e406550 2024-09-12T12:35:08.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.050+0000 7fb0e0ff9640 1 -- 172.21.15.33:0/1855260116 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fb0f8085400 con 0x563e9e406550 2024-09-12T12:35:08.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.050+0000 7fb0e0ff9640 1 -- 172.21.15.33:0/1855260116 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb0f807ae50 con 0x563e9e406550 2024-09-12T12:35:08.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.050+0000 7fb1019a0740 10 client.25909 fetch_fsmap learned FSMap version 27 2024-09-12T12:35:08.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.051+0000 7fb1019a0740 1 -- 172.21.15.33:0/1855260116 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563e9e415700 con 0x563e9e406550 2024-09-12T12:35:08.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.054+0000 7fb0e0ff9640 1 -- 172.21.15.33:0/1855260116 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb0f8078890 con 0x563e9e406550 2024-09-12T12:35:08.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.054+0000 7fb0e0ff9640 1 -- 172.21.15.33:0/1855260116 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fb0f8079070 con 0x563e9e406550 2024-09-12T12:35:08.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.054+0000 7fb1019a0740 10 client.25909 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:35:08.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.054+0000 7fb1019a0740 10 client.25909 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-12T12:35:08.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.054+0000 7fb1019a0740 20 client.25909 populate_metadata read hostname 'smithi033' 2024-09-12T12:35:08.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.054+0000 7fb1019a0740 1 --2- 172.21.15.33:0/1855260116 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x563e9e416b10 0x563e9e418f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:08.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.054+0000 7fb1019a0740 4 client.25909 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:35:08.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.054+0000 7fb1019a0740 1 -- 172.21.15.33:0/1855260116 --> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fb0e80a3db0 con 0x563e9e416b10 2024-09-12T12:35:08.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.056+0000 7fb0fcb62640 1 --2- 172.21.15.33:0/1855260116 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x563e9e416b10 0x563e9e418f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:08.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.059+0000 7fb0fcb62640 1 --2- 172.21.15.33:0/1855260116 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x563e9e416b10 0x563e9e418f00 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=aadc38d594c06aaa server_cookie=7da75570f31b9db in_seq=0 out_seq=0 2024-09-12T12:35:08.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.059+0000 7fb0e0ff9640 10 client.25909 ms_handle_connect on v2:172.21.15.102:6834/4179527539 2024-09-12T12:35:08.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.065+0000 7fb0e0ff9640 1 -- 172.21.15.33:0/1855260116 <== mds.2 v2:172.21.15.102:6834/4179527539 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fb0e80a3db0 con 0x563e9e416b10 2024-09-12T12:35:08.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.065+0000 7fb0e0ff9640 10 client.25909 handle_command_reply: tid=0 2024-09-12T12:35:08.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.065+0000 7fb1019a0740 1 client.25909 shutdown 2024-09-12T12:35:08.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.069+0000 7fb1019a0740 1 -- 172.21.15.33:0/1855260116 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e9e406550 msgr2=0x563e9e405fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:08.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.069+0000 7fb1019a0740 1 --2- 172.21.15.33:0/1855260116 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e9e406550 0x563e9e405fe0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8068040 tx=0x7fb0f8067f40 comp rx=0 tx=0).stop 2024-09-12T12:35:08.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.069+0000 7fb1019a0740 1 -- 172.21.15.33:0/1855260116 shutdown_connections 2024-09-12T12:35:08.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.069+0000 7fb1019a0740 1 --2- 172.21.15.33:0/1855260116 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563e9e403d60 0x563e9e412840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:08.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.069+0000 7fb1019a0740 1 --2- 172.21.15.33:0/1855260116 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x563e9e416b10 0x563e9e418f00 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:08.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.069+0000 7fb1019a0740 1 --2- 172.21.15.33:0/1855260116 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563e9e403290 0x563e9e403710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:08.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.069+0000 7fb1019a0740 1 --2- 172.21.15.33:0/1855260116 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e9e406550 0x563e9e405fe0 secure :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8068040 tx=0x7fb0f8067f40 comp rx=0 tx=0).stop 2024-09-12T12:35:08.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.069+0000 7fb1019a0740 1 -- 172.21.15.33:0/1855260116 >> 172.21.15.33:0/1855260116 conn(0x563e9e3c4310 msgr2=0x563e9e3fdb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:35:08.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.069+0000 7fb0e0ff9640 0 client.25909 ms_handle_reset on v2:172.21.15.102:6834/4179527539 2024-09-12T12:35:08.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.072+0000 7fb1019a0740 1 -- 172.21.15.33:0/1855260116 shutdown_connections 2024-09-12T12:35:08.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.072+0000 7fb1019a0740 1 -- 172.21.15.33:0/1855260116 wait complete. 2024-09-12T12:35:08.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.072+0000 7fb1019a0740 20 client.25909 trim_cache size 0 max 16384 2024-09-12T12:35:08.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.098+0000 7fb1019a0740 1 Processor -- start 2024-09-12T12:35:08.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.098+0000 7fb1019a0740 1 -- start start 2024-09-12T12:35:08.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.099+0000 7fb1019a0740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e9e403290 0x563e9e412630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:08.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.099+0000 7fb1019a0740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563e9e403d60 0x563e9e3f7790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:08.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.099+0000 7fb1019a0740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563e9e3fec00 0x563e9e3f7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:08.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.099+0000 7fb1019a0740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb0dc0124c0 con 0x563e9e3fec00 2024-09-12T12:35:08.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.099+0000 7fb1019a0740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb0dc00fd90 con 0x563e9e403d60 2024-09-12T12:35:08.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.099+0000 7fb1019a0740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb0dc00dbe0 con 0x563e9e403290 2024-09-12T12:35:08.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.101+0000 7fb0fcb62640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563e9e403d60 0x563e9e3f7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:08.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.101+0000 7fb0fcb62640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563e9e403d60 0x563e9e3f7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:43542/0 (socket says 172.21.15.33:43542) 2024-09-12T12:35:08.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.101+0000 7fb0fcb62640 1 -- 172.21.15.33:0/180386269 learned_addr learned my addr 172.21.15.33:0/180386269 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:35:08.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.101+0000 7fb0fdb64640 1 --2- 172.21.15.33:0/180386269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563e9e3fec00 0x563e9e3f7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:08.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.101+0000 7fb0fd363640 1 --2- 172.21.15.33:0/180386269 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e9e403290 0x563e9e412630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:08.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.102+0000 7fb0fcb62640 1 -- 172.21.15.33:0/180386269 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e9e403290 msgr2=0x563e9e412630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:35:08.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.102+0000 7fb0fcb62640 1 --2- 172.21.15.33:0/180386269 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e9e403290 0x563e9e412630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:08.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.102+0000 7fb0fcb62640 1 -- 172.21.15.33:0/180386269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563e9e3fec00 msgr2=0x563e9e3f7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:35:08.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.102+0000 7fb0fcb62640 1 --2- 172.21.15.33:0/180386269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563e9e3fec00 0x563e9e3f7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:08.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.102+0000 7fb0fcb62640 1 -- 172.21.15.33:0/180386269 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e9e4030c0 con 0x563e9e403d60 2024-09-12T12:35:08.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.102+0000 7fb0fcb62640 1 --2- 172.21.15.33:0/180386269 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563e9e403d60 0x563e9e3f7790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb0f001b150 tx=0x7fb0f4000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8f7f3b1f963e616 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:35:08.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.102+0000 7fb0e2ffd640 1 -- 172.21.15.33:0/180386269 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f4049070 con 0x563e9e403d60 2024-09-12T12:35:08.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.103+0000 7fb0e2ffd640 1 -- 172.21.15.33:0/180386269 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb0f40054f0 con 0x563e9e403d60 2024-09-12T12:35:08.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.103+0000 7fb0e2ffd640 1 -- 172.21.15.33:0/180386269 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f4035040 con 0x563e9e403d60 2024-09-12T12:35:08.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.106+0000 7fb1019a0740 1 -- 172.21.15.33:0/180386269 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563e9e403d60 msgr2=0x563e9e3f7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:08.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.106+0000 7fb1019a0740 1 --2- 172.21.15.33:0/180386269 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563e9e403d60 0x563e9e3f7790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb0f001b150 tx=0x7fb0f4000bc0 comp rx=0 tx=0).stop 2024-09-12T12:35:08.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.109+0000 7fb1019a0740 1 -- 172.21.15.33:0/180386269 shutdown_connections 2024-09-12T12:35:08.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.109+0000 7fb1019a0740 1 --2- 172.21.15.33:0/180386269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563e9e3fec00 0x563e9e3f7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:08.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.109+0000 7fb1019a0740 1 --2- 172.21.15.33:0/180386269 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563e9e403d60 0x563e9e3f7790 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:08.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.109+0000 7fb1019a0740 1 --2- 172.21.15.33:0/180386269 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e9e403290 0x563e9e412630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:08.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.109+0000 7fb1019a0740 1 -- 172.21.15.33:0/180386269 >> 172.21.15.33:0/180386269 conn(0x563e9e3c4310 msgr2=0x563e9e3fe4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:35:08.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.109+0000 7fb1019a0740 1 -- 172.21.15.33:0/180386269 shutdown_connections 2024-09-12T12:35:08.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.110+0000 7fb1019a0740 1 -- 172.21.15.33:0/180386269 wait complete. 2024-09-12T12:35:08.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.111+0000 7fb1019a0740 1 -- start start 2024-09-12T12:35:08.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.111+0000 7fb1019a0740 1 Processor -- start 2024-09-12T12:35:08.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.112+0000 7fb1019a0740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e9e3fec00 0x563e9e40e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:08.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.112+0000 7fb1019a0740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563e9e403290 0x563e9e40ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:08.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.112+0000 7fb0fd363640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e9e3fec00 0x563e9e40e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:08.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.112+0000 7fb0fd363640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e9e3fec00 0x563e9e40e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:44902/0 (socket says 172.21.15.33:44902) 2024-09-12T12:35:08.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.113+0000 7fb0fd363640 1 -- 172.21.15.33:0/2853641619 learned_addr learned my addr 172.21.15.33:0/2853641619 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:35:08.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.113+0000 7fb0fcb62640 1 --2- 172.21.15.33:0/2853641619 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563e9e403290 0x563e9e40ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:08.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.113+0000 7fb1019a0740 1 --2- 172.21.15.33:0/2853641619 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563e9e403d60 0x563e9e3ff540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:08.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.113+0000 7fb1019a0740 1 -- 172.21.15.33:0/2853641619 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb0dc00e250 con 0x563e9e403d60 2024-09-12T12:35:08.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.113+0000 7fb1019a0740 1 -- 172.21.15.33:0/2853641619 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb0dc00f6c0 con 0x563e9e403290 2024-09-12T12:35:08.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.113+0000 7fb1019a0740 1 -- 172.21.15.33:0/2853641619 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb0dc00e920 con 0x563e9e3fec00 2024-09-12T12:35:08.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.113+0000 7fb1019a0740 10 client.0 _ll_register_callbacks cb 0x7fb0f8067a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:35:08.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.113+0000 7fb0fd363640 1 -- 172.21.15.33:0/2853641619 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563e9e403290 msgr2=0x563e9e40ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:35:08.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.114+0000 7fb0fd363640 1 --2- 172.21.15.33:0/2853641619 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563e9e403290 0x563e9e40ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:08.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.114+0000 7fb0fd363640 1 -- 172.21.15.33:0/2853641619 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563e9e403d60 msgr2=0x563e9e3ff540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:35:08.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.114+0000 7fb0fd363640 1 --2- 172.21.15.33:0/2853641619 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563e9e403d60 0x563e9e3ff540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:08.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.114+0000 7fb0fd363640 1 -- 172.21.15.33:0/2853641619 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e9e40f3d0 con 0x563e9e3fec00 2024-09-12T12:35:08.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.114+0000 7fb1019a0740 1 -- 172.21.15.33:0/2853641619 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0f40054f0 con 0x563e9e3fec00 2024-09-12T12:35:08.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.114+0000 7fb0fd363640 1 --2- 172.21.15.33:0/2853641619 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e9e3fec00 0x563e9e40e7a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb0f80797b0 tx=0x7fb0f807a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b905178e16894405 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:35:08.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:35:07 smithi043 ceph-mon[34144]: pgmap v623: 129 pgs: 129 active+clean; 10 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 29 MiB/s wr, 588 op/s 2024-09-12T12:35:08.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.115+0000 7fb0e0ff9640 10 client.25915 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:35:08.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.123+0000 7fb0e0ff9640 1 -- 172.21.15.33:0/2853641619 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f809c070 con 0x563e9e3fec00 2024-09-12T12:35:08.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.123+0000 7fb0e0ff9640 1 -- 172.21.15.33:0/2853641619 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fb0f8079280 con 0x563e9e3fec00 2024-09-12T12:35:08.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.123+0000 7fb0e0ff9640 1 -- 172.21.15.33:0/2853641619 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb0f8079480 con 0x563e9e3fec00 2024-09-12T12:35:08.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.123+0000 7fb1019a0740 10 client.25915 fetch_fsmap learned FSMap version 27 2024-09-12T12:35:08.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.123+0000 7fb1019a0740 1 -- 172.21.15.33:0/2853641619 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({fsmap=27}) -- 0x563e9e400a60 con 0x563e9e3fec00 2024-09-12T12:35:08.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.125+0000 7fb0e0ff9640 1 -- 172.21.15.33:0/2853641619 <== mon.1 v2:172.21.15.102:3300/0 4 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fb0f809f070 con 0x563e9e3fec00 2024-09-12T12:35:08.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.125+0000 7fb1019a0740 10 client.25915 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:35:08.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.125+0000 7fb1019a0740 10 client.25915 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-12T12:35:08.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.125+0000 7fb1019a0740 20 client.25915 populate_metadata read hostname 'smithi033' 2024-09-12T12:35:08.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.125+0000 7fb1019a0740 1 --2- 172.21.15.33:0/2853641619 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x563e9e401050 0x563e9e484800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:08.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.125+0000 7fb1019a0740 4 client.25915 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:35:08.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.125+0000 7fb1019a0740 1 -- 172.21.15.33:0/2853641619 --> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fb0f40054f0 con 0x563e9e401050 2024-09-12T12:35:08.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.125+0000 7fb0fcb62640 1 --2- 172.21.15.33:0/2853641619 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x563e9e401050 0x563e9e484800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:08.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.126+0000 7fb0fcb62640 1 --2- 172.21.15.33:0/2853641619 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x563e9e401050 0x563e9e484800 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e2b6719564dfcec1 server_cookie=5ebfbe2601bbd0c5 in_seq=0 out_seq=0 2024-09-12T12:35:08.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.126+0000 7fb0e0ff9640 10 client.25915 ms_handle_connect on v2:172.21.15.102:6834/4179527539 2024-09-12T12:35:08.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.130+0000 7fb0e0ff9640 1 -- 172.21.15.33:0/2853641619 <== mds.2 v2:172.21.15.102:6834/4179527539 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fb0f40054f0 con 0x563e9e401050 2024-09-12T12:35:08.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.130+0000 7fb0e0ff9640 10 client.25915 handle_command_reply: tid=0 2024-09-12T12:35:08.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.130+0000 7fb1019a0740 1 client.25915 shutdown 2024-09-12T12:35:08.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.131+0000 7fb1019a0740 1 -- 172.21.15.33:0/2853641619 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e9e3fec00 msgr2=0x563e9e40e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:08.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.131+0000 7fb1019a0740 1 --2- 172.21.15.33:0/2853641619 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e9e3fec00 0x563e9e40e7a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb0f80797b0 tx=0x7fb0f807a000 comp rx=0 tx=0).stop 2024-09-12T12:35:08.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.131+0000 7fb1019a0740 1 -- 172.21.15.33:0/2853641619 shutdown_connections 2024-09-12T12:35:08.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.131+0000 7fb1019a0740 1 --2- 172.21.15.33:0/2853641619 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563e9e403d60 0x563e9e3ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:08.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.131+0000 7fb1019a0740 1 --2- 172.21.15.33:0/2853641619 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x563e9e401050 0x563e9e484800 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:08.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.131+0000 7fb1019a0740 1 --2- 172.21.15.33:0/2853641619 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563e9e403290 0x563e9e40ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:08.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.131+0000 7fb0e0ff9640 0 client.25915 ms_handle_reset on v2:172.21.15.102:6834/4179527539 2024-09-12T12:35:08.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.131+0000 7fb1019a0740 1 --2- 172.21.15.33:0/2853641619 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e9e3fec00 0x563e9e40e7a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:08.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.131+0000 7fb1019a0740 1 -- 172.21.15.33:0/2853641619 >> 172.21.15.33:0/2853641619 conn(0x563e9e3c4310 msgr2=0x563e9e3fd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:35:08.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.132+0000 7fb1019a0740 1 -- 172.21.15.33:0/2853641619 shutdown_connections 2024-09-12T12:35:08.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.132+0000 7fb1019a0740 1 -- 172.21.15.33:0/2853641619 wait complete. 2024-09-12T12:35:08.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.137+0000 7fb1019a0740 20 client.25915 trim_cache size 0 max 16384 2024-09-12T12:35:08.139 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-09-12T12:35:08.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.138+0000 7fb0fe365640 1 -- 172.21.15.33:0/4229169979 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb0e40a2ce0 msgr2=0x7fb0e40a51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:08.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.138+0000 7fb0fe365640 1 --2- 172.21.15.33:0/4229169979 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb0e40a2ce0 0x7fb0e40a51a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8050d60 tx=0x7fb0f806e040 comp rx=0 tx=0).stop 2024-09-12T12:35:08.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.138+0000 7fb0fe365640 1 -- 172.21.15.33:0/4229169979 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb0f00b7160 msgr2=0x7fb0f00afc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:08.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.138+0000 7fb0fe365640 1 --2- 172.21.15.33:0/4229169979 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb0f00b7160 0x7fb0f00afc10 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fb0e800d750 tx=0x7fb0e800dc10 comp rx=0 tx=0).stop 2024-09-12T12:35:08.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.139+0000 7fb0fe365640 1 -- 172.21.15.33:0/4229169979 shutdown_connections 2024-09-12T12:35:08.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.139+0000 7fb0fe365640 1 --2- 172.21.15.33:0/4229169979 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb0e40a2ce0 0x7fb0e40a51a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:08.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.139+0000 7fb0fe365640 1 --2- 172.21.15.33:0/4229169979 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb0f00b7160 0x7fb0f00afc10 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:08.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.139+0000 7fb0fe365640 1 --2- 172.21.15.33:0/4229169979 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0f00a5400 0x7fb0f00af6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:08.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.139+0000 7fb0fe365640 1 --2- 172.21.15.33:0/4229169979 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0f00a4a50 0x7fb0f00b6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:08.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.139+0000 7fb0fe365640 1 -- 172.21.15.33:0/4229169979 >> 172.21.15.33:0/4229169979 conn(0x7fb0f001a0a0 msgr2=0x7fb0f00b7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:35:08.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.140+0000 7fb0fe365640 1 -- 172.21.15.33:0/4229169979 shutdown_connections 2024-09-12T12:35:08.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:08.140+0000 7fb0fe365640 1 -- 172.21.15.33:0/4229169979 wait complete. 2024-09-12T12:35:08.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:35:07 smithi102 ceph-mon[34799]: pgmap v623: 129 pgs: 129 active+clean; 10 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 29 MiB/s wr, 588 op/s 2024-09-12T12:35:09.006 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T12:35:09.577 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:35:09.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:35:09 smithi033 ceph-mon[31246]: pgmap v624: 129 pgs: 129 active+clean; 10 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 37 MiB/s wr, 754 op/s 2024-09-12T12:35:10.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:35:09 smithi043 ceph-mon[34144]: pgmap v624: 129 pgs: 129 active+clean; 10 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 37 MiB/s wr, 754 op/s 2024-09-12T12:35:10.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:35:09 smithi102 ceph-mon[34799]: pgmap v624: 129 pgs: 129 active+clean; 10 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 37 MiB/s wr, 754 op/s 2024-09-12T12:35:11.870 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:35:11 smithi033 ceph-mon[31246]: pgmap v625: 129 pgs: 129 active+clean; 10 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 27 MiB/s wr, 563 op/s 2024-09-12T12:35:12.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:35:11 smithi102 ceph-mon[34799]: pgmap v625: 129 pgs: 129 active+clean; 10 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 27 MiB/s wr, 563 op/s 2024-09-12T12:35:12.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.185+0000 7fada7acc640 1 -- 172.21.15.33:0/4261696295 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fada0102ef0 msgr2=0x7fada010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:12.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.185+0000 7fada7acc640 1 --2- 172.21.15.33:0/4261696295 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fada0102ef0 0x7fada010da40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fad9c009930 tx=0x7fad9c02a4d0 comp rx=0 tx=0).stop 2024-09-12T12:35:12.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.185+0000 7fada7acc640 1 -- 172.21.15.33:0/4261696295 shutdown_connections 2024-09-12T12:35:12.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.185+0000 7fada7acc640 1 --2- 172.21.15.33:0/4261696295 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fada0102ef0 0x7fada010da40 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:12.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.185+0000 7fada7acc640 1 --2- 172.21.15.33:0/4261696295 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fada0102570 0x7fada01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:12.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.185+0000 7fada7acc640 1 --2- 172.21.15.33:0/4261696295 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fada0100e20 0x7fada0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:12.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.185+0000 7fada7acc640 1 -- 172.21.15.33:0/4261696295 >> 172.21.15.33:0/4261696295 conn(0x7fada00fc7d0 msgr2=0x7fada00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:35:12.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.186+0000 7fada7acc640 1 -- 172.21.15.33:0/4261696295 shutdown_connections 2024-09-12T12:35:12.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.186+0000 7fada7acc640 1 -- 172.21.15.33:0/4261696295 wait complete. 2024-09-12T12:35:12.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.187+0000 7fada7acc640 1 Processor -- start 2024-09-12T12:35:12.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.187+0000 7fada7acc640 1 -- start start 2024-09-12T12:35:12.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.187+0000 7fada7acc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fada0100e20 0x7fada019e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:12.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.187+0000 7fada7acc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fada0102570 0x7fada0196320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:12.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.187+0000 7fada7acc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fada0102ef0 0x7fada0196860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:12.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.187+0000 7fada7acc640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fada0110e50 con 0x7fada0100e20 2024-09-12T12:35:12.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.187+0000 7fada7acc640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fada0110cd0 con 0x7fada0102570 2024-09-12T12:35:12.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.187+0000 7fada7acc640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fada0110fd0 con 0x7fada0102ef0 2024-09-12T12:35:12.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.187+0000 7fada5868640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fada0100e20 0x7fada019e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:12.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.188+0000 7fada5868640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fada0100e20 0x7fada019e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56442/0 (socket says 172.21.15.33:56442) 2024-09-12T12:35:12.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.188+0000 7fada5868640 1 -- 172.21.15.33:0/2176669038 learned_addr learned my addr 172.21.15.33:0/2176669038 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:35:12.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.188+0000 7fada6069640 1 --2- 172.21.15.33:0/2176669038 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fada0102ef0 0x7fada0196860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:12.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.188+0000 7fada5067640 1 --2- 172.21.15.33:0/2176669038 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fada0102570 0x7fada0196320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:12.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.189+0000 7fada6069640 1 -- 172.21.15.33:0/2176669038 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fada0102570 msgr2=0x7fada0196320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:12.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.189+0000 7fada6069640 1 --2- 172.21.15.33:0/2176669038 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fada0102570 0x7fada0196320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:12.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.189+0000 7fada6069640 1 -- 172.21.15.33:0/2176669038 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fada0100e20 msgr2=0x7fada019e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:12.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.189+0000 7fada6069640 1 --2- 172.21.15.33:0/2176669038 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fada0100e20 0x7fada019e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:12.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.189+0000 7fada6069640 1 -- 172.21.15.33:0/2176669038 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fada0196da0 con 0x7fada0102ef0 2024-09-12T12:35:12.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.189+0000 7fada5067640 1 --2- 172.21.15.33:0/2176669038 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fada0102570 0x7fada0196320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:35:12.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.189+0000 7fada6069640 1 --2- 172.21.15.33:0/2176669038 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fada0102ef0 0x7fada0196860 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fad9c009850 tx=0x7fad9c003cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:35:12.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.190+0000 7fad96ffd640 1 -- 172.21.15.33:0/2176669038 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad9c03f070 con 0x7fada0102ef0 2024-09-12T12:35:12.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.190+0000 7fada7acc640 1 -- 172.21.15.33:0/2176669038 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fada0197030 con 0x7fada0102ef0 2024-09-12T12:35:12.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.190+0000 7fada7acc640 1 -- 172.21.15.33:0/2176669038 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fada006be60 con 0x7fada0102ef0 2024-09-12T12:35:12.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.190+0000 7fad96ffd640 1 -- 172.21.15.33:0/2176669038 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fad9c031b50 con 0x7fada0102ef0 2024-09-12T12:35:12.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.190+0000 7fad96ffd640 1 -- 172.21.15.33:0/2176669038 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad9c035030 con 0x7fada0102ef0 2024-09-12T12:35:12.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.194+0000 7fad96ffd640 1 -- 172.21.15.33:0/2176669038 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fad9c042070 con 0x7fada0102ef0 2024-09-12T12:35:12.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.196+0000 7fad96ffd640 1 --2- 172.21.15.33:0/2176669038 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fad8c0a2c40 0x7fad8c0a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:12.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.197+0000 7fad96ffd640 1 -- 172.21.15.33:0/2176669038 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fad9c0ef8d0 con 0x7fada0102ef0 2024-09-12T12:35:12.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.197+0000 7fada9ea5740 1 Processor -- start 2024-09-12T12:35:12.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.197+0000 7fada9ea5740 1 -- start start 2024-09-12T12:35:12.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.198+0000 7fada5868640 1 --2- 172.21.15.33:0/2176669038 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fad8c0a2c40 0x7fad8c0a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:12.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.199+0000 7fada9ea5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e46619b40 0x564e46618090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:12.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.199+0000 7fada5868640 1 --2- 172.21.15.33:0/2176669038 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fad8c0a2c40 0x7fad8c0a5100 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fad90005fd0 tx=0x7fad9000b480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:35:12.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.199+0000 7fada5868640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e46619b40 0x564e46618090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:12.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.199+0000 7fada5868640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e46619b40 0x564e46618090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56448/0 (socket says 172.21.15.33:56448) 2024-09-12T12:35:12.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.199+0000 7fada5868640 1 -- 172.21.15.33:0/1097855519 learned_addr learned my addr 172.21.15.33:0/1097855519 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:35:12.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.199+0000 7fada9ea5740 1 --2- 172.21.15.33:0/1097855519 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564e466185d0 0x564e46618a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:12.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.199+0000 7fada9ea5740 1 --2- 172.21.15.33:0/1097855519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e46623370 0x564e46625760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:12.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.199+0000 7fada5067640 1 --2- 172.21.15.33:0/1097855519 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564e466185d0 0x564e46618a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:12.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.200+0000 7fada6069640 1 --2- 172.21.15.33:0/1097855519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e46623370 0x564e46625760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:12.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.200+0000 7fada9ea5740 1 -- 172.21.15.33:0/1097855519 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x564e4657e2f0 con 0x564e46619b40 2024-09-12T12:35:12.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.200+0000 7fada9ea5740 1 -- 172.21.15.33:0/1097855519 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x564e46525cf0 con 0x564e466185d0 2024-09-12T12:35:12.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.200+0000 7fada9ea5740 1 -- 172.21.15.33:0/1097855519 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564e4657a2b0 con 0x564e46623370 2024-09-12T12:35:12.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.201+0000 7fada5067640 1 -- 172.21.15.33:0/1097855519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e46623370 msgr2=0x564e46625760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:35:12.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.201+0000 7fada5067640 1 --2- 172.21.15.33:0/1097855519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e46623370 0x564e46625760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:12.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.201+0000 7fada5067640 1 -- 172.21.15.33:0/1097855519 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e46619b40 msgr2=0x564e46618090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:35:12.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.201+0000 7fada5067640 1 --2- 172.21.15.33:0/1097855519 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e46619b40 0x564e46618090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:12.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.201+0000 7fada5067640 1 -- 172.21.15.33:0/1097855519 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e4650a3a0 con 0x564e466185d0 2024-09-12T12:35:12.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.202+0000 7fada5067640 1 --2- 172.21.15.33:0/1097855519 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564e466185d0 0x564e46618a10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fada01978a0 tx=0x7fad980096d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cf547cc82a61e9f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:35:12.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.202+0000 7fad8bfff640 1 -- 172.21.15.33:0/1097855519 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad98018020 con 0x564e466185d0 2024-09-12T12:35:12.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.202+0000 7fad8bfff640 1 -- 172.21.15.33:0/1097855519 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fad9800ae30 con 0x564e466185d0 2024-09-12T12:35:12.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.202+0000 7fad8bfff640 1 -- 172.21.15.33:0/1097855519 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad98013360 con 0x564e466185d0 2024-09-12T12:35:12.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.203+0000 7fada9ea5740 1 -- 172.21.15.33:0/1097855519 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564e466185d0 msgr2=0x564e46618a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:12.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.203+0000 7fada9ea5740 1 --2- 172.21.15.33:0/1097855519 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564e466185d0 0x564e46618a10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fada01978a0 tx=0x7fad980096d0 comp rx=0 tx=0).stop 2024-09-12T12:35:12.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.204+0000 7fada9ea5740 1 -- 172.21.15.33:0/1097855519 shutdown_connections 2024-09-12T12:35:12.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.204+0000 7fada9ea5740 1 --2- 172.21.15.33:0/1097855519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e46623370 0x564e46625760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:12.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.204+0000 7fada9ea5740 1 --2- 172.21.15.33:0/1097855519 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564e466185d0 0x564e46618a10 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:12.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.204+0000 7fada9ea5740 1 --2- 172.21.15.33:0/1097855519 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e46619b40 0x564e46618090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:12.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.204+0000 7fada9ea5740 1 -- 172.21.15.33:0/1097855519 >> 172.21.15.33:0/1097855519 conn(0x564e465e1310 msgr2=0x564e46614c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:35:12.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.204+0000 7fada9ea5740 1 -- 172.21.15.33:0/1097855519 shutdown_connections 2024-09-12T12:35:12.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.204+0000 7fada9ea5740 1 -- 172.21.15.33:0/1097855519 wait complete. 2024-09-12T12:35:12.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.205+0000 7fada9ea5740 1 -- start start 2024-09-12T12:35:12.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.205+0000 7fada9ea5740 1 Processor -- start 2024-09-12T12:35:12.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.206+0000 7fada9ea5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e466185d0 0x564e46622c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:12.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.206+0000 7fada9ea5740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564e46619b40 0x564e4661ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:12.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.207+0000 7fada9ea5740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e46623370 0x564e46620480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:12.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.207+0000 7fada9ea5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x564e46626070 con 0x564e466185d0 2024-09-12T12:35:12.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.207+0000 7fada9ea5740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x564e46539060 con 0x564e46619b40 2024-09-12T12:35:12.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.207+0000 7fada9ea5740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564e466261f0 con 0x564e46623370 2024-09-12T12:35:12.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.207+0000 7fada9ea5740 10 client.0 _ll_register_callbacks cb 0x564e4628c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:35:12.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.207+0000 7fada5067640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564e46619b40 0x564e4661ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:12.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.207+0000 7fada6069640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e46623370 0x564e46620480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:12.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.207+0000 7fada5067640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564e46619b40 0x564e4661ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:42040/0 (socket says 172.21.15.33:42040) 2024-09-12T12:35:12.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.207+0000 7fada5067640 1 -- 172.21.15.33:0/2914441381 learned_addr learned my addr 172.21.15.33:0/2914441381 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:35:12.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.208+0000 7fada6069640 1 -- 172.21.15.33:0/2914441381 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564e46619b40 msgr2=0x564e4661ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:35:12.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.208+0000 7fada6069640 1 --2- 172.21.15.33:0/2914441381 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564e46619b40 0x564e4661ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:12.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.208+0000 7fada6069640 1 -- 172.21.15.33:0/2914441381 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e466185d0 msgr2=0x564e46622c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:35:12.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.208+0000 7fada6069640 1 --2- 172.21.15.33:0/2914441381 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e466185d0 0x564e46622c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:12.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.208+0000 7fada6069640 1 -- 172.21.15.33:0/2914441381 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e462ef3c0 con 0x564e46623370 2024-09-12T12:35:12.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.208+0000 7fada6069640 1 --2- 172.21.15.33:0/2914441381 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e46623370 0x564e46620480 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fad9c0ed090 tx=0x7fad9c0bc560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2be1eef94cea39 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:35:12.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.209+0000 7fad897fa640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:35:12.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.209+0000 7fad897fa640 1 -- 172.21.15.33:0/2914441381 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad9c0c4a10 con 0x564e46623370 2024-09-12T12:35:12.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.209+0000 7fad897fa640 1 -- 172.21.15.33:0/2914441381 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fad9c0b8410 con 0x564e46623370 2024-09-12T12:35:12.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.209+0000 7fada9ea5740 1 -- 172.21.15.33:0/2914441381 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad9800ae30 con 0x564e46623370 2024-09-12T12:35:12.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.210+0000 7fad897fa640 1 -- 172.21.15.33:0/2914441381 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fad9c03b460 con 0x564e46623370 2024-09-12T12:35:12.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.210+0000 7fada9ea5740 10 client.25927 fetch_fsmap learned FSMap version 27 2024-09-12T12:35:12.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.210+0000 7fada9ea5740 1 -- 172.21.15.33:0/2914441381 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564e46626070 con 0x564e46623370 2024-09-12T12:35:12.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.211+0000 7fad897fa640 1 -- 172.21.15.33:0/2914441381 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fad9c03b600 con 0x564e46623370 2024-09-12T12:35:12.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.211+0000 7fad897fa640 1 -- 172.21.15.33:0/2914441381 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fad9c0b7af0 con 0x564e46623370 2024-09-12T12:35:12.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.212+0000 7fada9ea5740 10 client.25927 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:35:12.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.212+0000 7fada9ea5740 10 client.25927 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-12T12:35:12.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.212+0000 7fada9ea5740 20 client.25927 populate_metadata read hostname 'smithi033' 2024-09-12T12:35:12.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.212+0000 7fada9ea5740 1 --2- 172.21.15.33:0/2914441381 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x564e46632f40 0x564e466353c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:12.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.212+0000 7fada9ea5740 4 client.25927 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:35:12.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.212+0000 7fada9ea5740 1 -- 172.21.15.33:0/2914441381 --> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fad9800ae30 con 0x564e46632f40 2024-09-12T12:35:12.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.212+0000 7fada5868640 1 --2- 172.21.15.33:0/2914441381 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x564e46632f40 0x564e466353c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:12.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.218+0000 7fada5868640 1 --2- 172.21.15.33:0/2914441381 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x564e46632f40 0x564e466353c0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bada6c4ac8907b89 server_cookie=719979c0dfacb18f in_seq=0 out_seq=0 2024-09-12T12:35:12.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.219+0000 7fad897fa640 10 client.25927 ms_handle_connect on v2:172.21.15.102:6836/2409953270 2024-09-12T12:35:12.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.219+0000 7fad897fa640 1 -- 172.21.15.33:0/2914441381 <== mds.1 v2:172.21.15.102:6836/2409953270 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fad9800ae30 con 0x564e46632f40 2024-09-12T12:35:12.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.219+0000 7fad897fa640 10 client.25927 handle_command_reply: tid=0 2024-09-12T12:35:12.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.220+0000 7fada9ea5740 1 client.25927 shutdown 2024-09-12T12:35:12.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.225+0000 7fada9ea5740 1 -- 172.21.15.33:0/2914441381 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e46623370 msgr2=0x564e46620480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:12.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.225+0000 7fada9ea5740 1 --2- 172.21.15.33:0/2914441381 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e46623370 0x564e46620480 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fad9c0ed090 tx=0x7fad9c0bc560 comp rx=0 tx=0).stop 2024-09-12T12:35:12.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.229+0000 7fada9ea5740 1 -- 172.21.15.33:0/2914441381 shutdown_connections 2024-09-12T12:35:12.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.229+0000 7fada9ea5740 1 --2- 172.21.15.33:0/2914441381 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x564e46632f40 0x564e466353c0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:12.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.229+0000 7fada9ea5740 1 --2- 172.21.15.33:0/2914441381 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e46623370 0x564e46620480 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:12.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.229+0000 7fad897fa640 0 client.25927 ms_handle_reset on v2:172.21.15.102:6836/2409953270 2024-09-12T12:35:12.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.229+0000 7fada9ea5740 1 --2- 172.21.15.33:0/2914441381 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564e46619b40 0x564e4661ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:12.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.229+0000 7fada9ea5740 1 --2- 172.21.15.33:0/2914441381 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e466185d0 0x564e46622c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:12.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.229+0000 7fada9ea5740 1 -- 172.21.15.33:0/2914441381 >> 172.21.15.33:0/2914441381 conn(0x564e465e1310 msgr2=0x564e4661a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:35:12.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.231+0000 7fada9ea5740 1 -- 172.21.15.33:0/2914441381 shutdown_connections 2024-09-12T12:35:12.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.232+0000 7fada9ea5740 1 -- 172.21.15.33:0/2914441381 wait complete. 2024-09-12T12:35:12.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.232+0000 7fada9ea5740 20 client.25927 trim_cache size 0 max 16384 2024-09-12T12:35:12.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.259+0000 7fada9ea5740 1 Processor -- start 2024-09-12T12:35:12.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.260+0000 7fada9ea5740 1 -- start start 2024-09-12T12:35:12.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.260+0000 7fada9ea5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e466185d0 0x564e4662f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:12.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.260+0000 7fada9ea5740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564e46619b40 0x564e46617bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:12.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.260+0000 7fada9ea5740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e46623370 0x564e46624760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:12.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.260+0000 7fada9ea5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fad84012530 con 0x564e466185d0 2024-09-12T12:35:12.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.260+0000 7fada9ea5740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fad8400fe00 con 0x564e46619b40 2024-09-12T12:35:12.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.260+0000 7fada9ea5740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fad8400dc50 con 0x564e46623370 2024-09-12T12:35:12.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.260+0000 7fada5868640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e466185d0 0x564e4662f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:12.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.260+0000 7fada5868640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e466185d0 0x564e4662f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56462/0 (socket says 172.21.15.33:56462) 2024-09-12T12:35:12.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.260+0000 7fada5868640 1 -- 172.21.15.33:0/2524175171 learned_addr learned my addr 172.21.15.33:0/2524175171 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:35:12.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.261+0000 7fada6069640 1 --2- 172.21.15.33:0/2524175171 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e46623370 0x564e46624760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:12.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.261+0000 7fada5067640 1 --2- 172.21.15.33:0/2524175171 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564e46619b40 0x564e46617bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:12.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.264+0000 7fada5868640 1 -- 172.21.15.33:0/2524175171 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e46623370 msgr2=0x564e46624760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:35:12.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.264+0000 7fada5868640 1 --2- 172.21.15.33:0/2524175171 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e46623370 0x564e46624760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:12.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.264+0000 7fada5868640 1 -- 172.21.15.33:0/2524175171 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564e46619b40 msgr2=0x564e46617bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:35:12.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.264+0000 7fada5868640 1 --2- 172.21.15.33:0/2524175171 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564e46619b40 0x564e46617bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:12.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.264+0000 7fada5868640 1 -- 172.21.15.33:0/2524175171 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e46615960 con 0x564e466185d0 2024-09-12T12:35:12.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.264+0000 7fada5868640 1 --2- 172.21.15.33:0/2524175171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e466185d0 0x564e4662f370 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fad9000baf0 tx=0x7fad90013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67a64e94904a66fd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:35:12.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.269+0000 7fad8b7fe640 1 -- 172.21.15.33:0/2524175171 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad90011e40 con 0x564e466185d0 2024-09-12T12:35:12.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.269+0000 7fad8b7fe640 1 -- 172.21.15.33:0/2524175171 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fad9001fd30 con 0x564e466185d0 2024-09-12T12:35:12.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.269+0000 7fad8b7fe640 1 -- 172.21.15.33:0/2524175171 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad90004a00 con 0x564e466185d0 2024-09-12T12:35:12.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.270+0000 7fada9ea5740 1 -- 172.21.15.33:0/2524175171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e466185d0 msgr2=0x564e4662f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:12.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.270+0000 7fada9ea5740 1 --2- 172.21.15.33:0/2524175171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e466185d0 0x564e4662f370 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fad9000baf0 tx=0x7fad90013000 comp rx=0 tx=0).stop 2024-09-12T12:35:12.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.270+0000 7fada9ea5740 1 -- 172.21.15.33:0/2524175171 shutdown_connections 2024-09-12T12:35:12.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.270+0000 7fada9ea5740 1 --2- 172.21.15.33:0/2524175171 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e46623370 0x564e46624760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:12.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.270+0000 7fada9ea5740 1 --2- 172.21.15.33:0/2524175171 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564e46619b40 0x564e46617bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:12.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.270+0000 7fada9ea5740 1 --2- 172.21.15.33:0/2524175171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e466185d0 0x564e4662f370 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:12.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.270+0000 7fada9ea5740 1 -- 172.21.15.33:0/2524175171 >> 172.21.15.33:0/2524175171 conn(0x564e465e1310 msgr2=0x564e4661e810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:35:12.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.271+0000 7fada9ea5740 1 -- 172.21.15.33:0/2524175171 shutdown_connections 2024-09-12T12:35:12.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.274+0000 7fada9ea5740 1 -- 172.21.15.33:0/2524175171 wait complete. 2024-09-12T12:35:12.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.275+0000 7fada9ea5740 1 -- start start 2024-09-12T12:35:12.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.275+0000 7fada9ea5740 1 Processor -- start 2024-09-12T12:35:12.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.276+0000 7fada9ea5740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e466185d0 0x564e4662b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:12.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.276+0000 7fada9ea5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e46619b40 0x564e4662bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:12.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.276+0000 7fada9ea5740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564e46623370 0x564e466264a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:12.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.276+0000 7fada9ea5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fad8400e2c0 con 0x564e46619b40 2024-09-12T12:35:12.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.276+0000 7fada9ea5740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fad8400f730 con 0x564e46623370 2024-09-12T12:35:12.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.276+0000 7fada9ea5740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fad8400e990 con 0x564e466185d0 2024-09-12T12:35:12.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.276+0000 7fada9ea5740 10 client.0 _ll_register_callbacks cb 0x7fad9c0bbb70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:35:12.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.277+0000 7fada5067640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e46619b40 0x564e4662bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:12.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.277+0000 7fada5067640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e46619b40 0x564e4662bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56468/0 (socket says 172.21.15.33:56468) 2024-09-12T12:35:12.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.277+0000 7fada5067640 1 -- 172.21.15.33:0/152301342 learned_addr learned my addr 172.21.15.33:0/152301342 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:35:12.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.277+0000 7fada5067640 1 -- 172.21.15.33:0/152301342 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e466185d0 msgr2=0x564e4662b6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:35:12.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.277+0000 7fada5067640 1 --2- 172.21.15.33:0/152301342 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e466185d0 0x564e4662b6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:12.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.277+0000 7fada5067640 1 -- 172.21.15.33:0/152301342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564e46623370 msgr2=0x564e466264a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:35:12.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.277+0000 7fada5067640 1 --2- 172.21.15.33:0/152301342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564e46623370 0x564e466264a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:12.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.277+0000 7fada5067640 1 -- 172.21.15.33:0/152301342 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e46626b30 con 0x564e46619b40 2024-09-12T12:35:12.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.278+0000 7fada5067640 1 --2- 172.21.15.33:0/152301342 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e46619b40 0x564e4662bc10 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fad9800a010 tx=0x7fad98014880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a97bdd235ff9d1cd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:35:12.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.280+0000 7fad897fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:35:12.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.280+0000 7fad897fa640 1 -- 172.21.15.33:0/152301342 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad98018040 con 0x564e46619b40 2024-09-12T12:35:12.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.280+0000 7fad897fa640 1 -- 172.21.15.33:0/152301342 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fad9800ec90 con 0x564e46619b40 2024-09-12T12:35:12.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.281+0000 7fada9ea5740 1 -- 172.21.15.33:0/152301342 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad9001fd30 con 0x564e46619b40 2024-09-12T12:35:12.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.284+0000 7fad897fa640 1 -- 172.21.15.33:0/152301342 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fad9800a400 con 0x564e46619b40 2024-09-12T12:35:12.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.284+0000 7fada9ea5740 10 client.16125 fetch_fsmap learned FSMap version 27 2024-09-12T12:35:12.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.284+0000 7fada9ea5740 1 -- 172.21.15.33:0/152301342 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564e4669e5e0 con 0x564e46619b40 2024-09-12T12:35:12.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.285+0000 7fad897fa640 1 -- 172.21.15.33:0/152301342 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fad9001fd30 con 0x564e46619b40 2024-09-12T12:35:12.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.285+0000 7fad897fa640 1 -- 172.21.15.33:0/152301342 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fad9801ece0 con 0x564e46619b40 2024-09-12T12:35:12.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.285+0000 7fada9ea5740 10 client.16125 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:35:12.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.285+0000 7fada9ea5740 10 client.16125 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-12T12:35:12.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.285+0000 7fada9ea5740 20 client.16125 populate_metadata read hostname 'smithi033' 2024-09-12T12:35:12.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.285+0000 7fada9ea5740 1 --2- 172.21.15.33:0/152301342 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x564e4669ec30 0x564e466a1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:12.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.285+0000 7fada9ea5740 4 client.16125 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:35:12.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.285+0000 7fada9ea5740 1 -- 172.21.15.33:0/152301342 --> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564e4658b860 con 0x564e4669ec30 2024-09-12T12:35:12.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.286+0000 7fada5868640 1 --2- 172.21.15.33:0/152301342 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x564e4669ec30 0x564e466a1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:12.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.294+0000 7fad897fa640 10 client.16125 ms_handle_connect on v2:172.21.15.102:6836/2409953270 2024-09-12T12:35:12.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.294+0000 7fada5868640 1 --2- 172.21.15.33:0/152301342 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x564e4669ec30 0x564e466a1050 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f50888a4b267bc2d server_cookie=197e2edcf074feaf in_seq=0 out_seq=0 2024-09-12T12:35:12.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.297+0000 7fad897fa640 1 -- 172.21.15.33:0/152301342 <== mds.1 v2:172.21.15.102:6836/2409953270 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564e4658b860 con 0x564e4669ec30 2024-09-12T12:35:12.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.297+0000 7fad897fa640 10 client.16125 handle_command_reply: tid=0 2024-09-12T12:35:12.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.297+0000 7fada9ea5740 1 client.16125 shutdown 2024-09-12T12:35:12.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.302+0000 7fada9ea5740 1 -- 172.21.15.33:0/152301342 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e46619b40 msgr2=0x564e4662bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:12.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.302+0000 7fada9ea5740 1 --2- 172.21.15.33:0/152301342 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e46619b40 0x564e4662bc10 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fad9800a010 tx=0x7fad98014880 comp rx=0 tx=0).stop 2024-09-12T12:35:12.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.303+0000 7fada9ea5740 1 -- 172.21.15.33:0/152301342 shutdown_connections 2024-09-12T12:35:12.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.303+0000 7fada9ea5740 1 --2- 172.21.15.33:0/152301342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564e46623370 0x564e466264a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:12.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.303+0000 7fada9ea5740 1 --2- 172.21.15.33:0/152301342 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564e46619b40 0x564e4662bc10 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:12.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.303+0000 7fada9ea5740 1 --2- 172.21.15.33:0/152301342 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x564e4669ec30 0x564e466a1050 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:12.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.303+0000 7fada9ea5740 1 --2- 172.21.15.33:0/152301342 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e466185d0 0x564e4662b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:12.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.303+0000 7fada9ea5740 1 -- 172.21.15.33:0/152301342 >> 172.21.15.33:0/152301342 conn(0x564e465e1310 msgr2=0x564e466217a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:35:12.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.303+0000 7fad897fa640 0 client.16125 ms_handle_reset on v2:172.21.15.102:6836/2409953270 2024-09-12T12:35:12.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.304+0000 7fada9ea5740 1 -- 172.21.15.33:0/152301342 shutdown_connections 2024-09-12T12:35:12.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.304+0000 7fada9ea5740 1 -- 172.21.15.33:0/152301342 wait complete. 2024-09-12T12:35:12.307 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-09-12T12:35:12.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.304+0000 7fada9ea5740 20 client.16125 trim_cache size 0 max 16384 2024-09-12T12:35:12.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.307+0000 7fada7acc640 1 -- 172.21.15.33:0/2176669038 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fad8c0a2c40 msgr2=0x7fad8c0a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:12.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.307+0000 7fada7acc640 1 --2- 172.21.15.33:0/2176669038 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fad8c0a2c40 0x7fad8c0a5100 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fad90005fd0 tx=0x7fad9000b480 comp rx=0 tx=0).stop 2024-09-12T12:35:12.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.307+0000 7fada7acc640 1 -- 172.21.15.33:0/2176669038 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fada0102ef0 msgr2=0x7fada0196860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:12.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.307+0000 7fada7acc640 1 --2- 172.21.15.33:0/2176669038 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fada0102ef0 0x7fada0196860 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fad9c009850 tx=0x7fad9c003cd0 comp rx=0 tx=0).stop 2024-09-12T12:35:12.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.308+0000 7fada7acc640 1 -- 172.21.15.33:0/2176669038 shutdown_connections 2024-09-12T12:35:12.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.308+0000 7fada7acc640 1 --2- 172.21.15.33:0/2176669038 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fad8c0a2c40 0x7fad8c0a5100 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:12.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.308+0000 7fada7acc640 1 --2- 172.21.15.33:0/2176669038 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fada0102ef0 0x7fada0196860 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:12.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.308+0000 7fada7acc640 1 --2- 172.21.15.33:0/2176669038 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fada0102570 0x7fada0196320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:12.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.308+0000 7fada7acc640 1 --2- 172.21.15.33:0/2176669038 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fada0100e20 0x7fada019e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:12.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.308+0000 7fada7acc640 1 -- 172.21.15.33:0/2176669038 >> 172.21.15.33:0/2176669038 conn(0x7fada00fc7d0 msgr2=0x7fada0069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:35:12.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.308+0000 7fada7acc640 1 -- 172.21.15.33:0/2176669038 shutdown_connections 2024-09-12T12:35:12.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:12.308+0000 7fada7acc640 1 -- 172.21.15.33:0/2176669038 wait complete. 2024-09-12T12:35:12.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:35:11 smithi043 ceph-mon[34144]: pgmap v625: 129 pgs: 129 active+clean; 10 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 27 MiB/s wr, 563 op/s 2024-09-12T12:35:13.079 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T12:35:13.725 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:35:14.133 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:35:13 smithi033 ceph-mon[31246]: pgmap v626: 129 pgs: 129 active+clean; 10 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 31 MiB/s wr, 640 op/s 2024-09-12T12:35:14.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:35:13 smithi102 ceph-mon[34799]: pgmap v626: 129 pgs: 129 active+clean; 10 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 31 MiB/s wr, 640 op/s 2024-09-12T12:35:14.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:35:13 smithi043 ceph-mon[34144]: pgmap v626: 129 pgs: 129 active+clean; 10 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 31 MiB/s wr, 640 op/s 2024-09-12T12:35:14.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.444+0000 7fe7a8976640 1 -- 172.21.15.33:0/4286340083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7a4100500 msgr2=0x7fe7a41008e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:14.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.444+0000 7fe7a8976640 1 --2- 172.21.15.33:0/4286340083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7a4100500 0x7fe7a41008e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fe798009900 tx=0x7fe79802a4d0 comp rx=0 tx=0).stop 2024-09-12T12:35:14.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.446+0000 7fe7a8976640 1 -- 172.21.15.33:0/4286340083 shutdown_connections 2024-09-12T12:35:14.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.446+0000 7fe7a8976640 1 --2- 172.21.15.33:0/4286340083 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7a4105f60 0x7fe7a41068f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:14.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.446+0000 7fe7a8976640 1 --2- 172.21.15.33:0/4286340083 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7a4100e20 0x7fe7a4105850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:14.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.446+0000 7fe7a8976640 1 --2- 172.21.15.33:0/4286340083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7a4100500 0x7fe7a41008e0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:14.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.446+0000 7fe7a8976640 1 -- 172.21.15.33:0/4286340083 >> 172.21.15.33:0/4286340083 conn(0x7fe7a40fc5c0 msgr2=0x7fe7a40fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:35:14.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.447+0000 7fe7a8976640 1 -- 172.21.15.33:0/4286340083 shutdown_connections 2024-09-12T12:35:14.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.447+0000 7fe7a8976640 1 -- 172.21.15.33:0/4286340083 wait complete. 2024-09-12T12:35:14.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.448+0000 7fe7a8976640 1 Processor -- start 2024-09-12T12:35:14.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.449+0000 7fe7a8976640 1 -- start start 2024-09-12T12:35:14.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.449+0000 7fe7a8976640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7a4100500 0x7fe7a41a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:14.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.449+0000 7fe7a8976640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7a4100e20 0x7fe7a41a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:14.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.449+0000 7fe7a8976640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7a4105f60 0x7fe7a419e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:14.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.449+0000 7fe7a8976640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a41184e0 con 0x7fe7a4100e20 2024-09-12T12:35:14.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.449+0000 7fe7a8976640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a4118360 con 0x7fe7a4105f60 2024-09-12T12:35:14.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.449+0000 7fe7a8976640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a4118660 con 0x7fe7a4100500 2024-09-12T12:35:14.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.449+0000 7fe7a1d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7a4100e20 0x7fe7a41a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:14.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.449+0000 7fe7a1d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7a4100e20 0x7fe7a41a4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56482/0 (socket says 172.21.15.33:56482) 2024-09-12T12:35:14.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.449+0000 7fe7a1d9b640 1 -- 172.21.15.33:0/875868150 learned_addr learned my addr 172.21.15.33:0/875868150 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:35:14.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.450+0000 7fe7a2d9d640 1 --2- 172.21.15.33:0/875868150 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7a4105f60 0x7fe7a419e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:14.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.450+0000 7fe7a1d9b640 1 -- 172.21.15.33:0/875868150 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7a4100500 msgr2=0x7fe7a41a46d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T12:35:14.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.450+0000 7fe7a1d9b640 1 --2- 172.21.15.33:0/875868150 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7a4100500 0x7fe7a41a46d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:14.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.450+0000 7fe7a1d9b640 1 -- 172.21.15.33:0/875868150 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7a4105f60 msgr2=0x7fe7a419e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:14.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.450+0000 7fe7a1d9b640 1 --2- 172.21.15.33:0/875868150 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7a4105f60 0x7fe7a419e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:14.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.450+0000 7fe7a1d9b640 1 -- 172.21.15.33:0/875868150 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7a419eff0 con 0x7fe7a4100e20 2024-09-12T12:35:14.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.451+0000 7fe7a1d9b640 1 --2- 172.21.15.33:0/875868150 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7a4100e20 0x7fe7a41a4c10 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fe79400c890 tx=0x7fe79400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:35:14.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.454+0000 7fe7937fe640 1 -- 172.21.15.33:0/875868150 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe794004220 con 0x7fe7a4100e20 2024-09-12T12:35:14.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.454+0000 7fe7937fe640 1 -- 172.21.15.33:0/875868150 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe7940043c0 con 0x7fe7a4100e20 2024-09-12T12:35:14.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.454+0000 7fe7a8976640 1 -- 172.21.15.33:0/875868150 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7a419f2e0 con 0x7fe7a4100e20 2024-09-12T12:35:14.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.454+0000 7fe7a8976640 1 -- 172.21.15.33:0/875868150 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7a41ab530 con 0x7fe7a4100e20 2024-09-12T12:35:14.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.457+0000 7fe7aad4f740 1 Processor -- start 2024-09-12T12:35:14.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.457+0000 7fe7937fe640 1 -- 172.21.15.33:0/875868150 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe794004a00 con 0x7fe7a4100e20 2024-09-12T12:35:14.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.461+0000 7fe7aad4f740 1 -- start start 2024-09-12T12:35:14.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.462+0000 7fe7aad4f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f3f37ecb40 0x55f3f37eb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:14.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.462+0000 7fe7aad4f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f3f37eb5d0 0x55f3f37eba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:14.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.462+0000 7fe7aad4f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f3f37f6370 0x55f3f37f8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:14.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.462+0000 7fe7aad4f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55f3f37512f0 con 0x55f3f37eb5d0 2024-09-12T12:35:14.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.462+0000 7fe7aad4f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f3f36f8cf0 con 0x55f3f37ecb40 2024-09-12T12:35:14.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.462+0000 7fe7aad4f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55f3f374d2b0 con 0x55f3f37f6370 2024-09-12T12:35:14.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.462+0000 7fe7937fe640 1 -- 172.21.15.33:0/875868150 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe794004ba0 con 0x7fe7a4100e20 2024-09-12T12:35:14.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.462+0000 7fe7a1d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f3f37f6370 0x55f3f37f8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:14.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.462+0000 7fe7a1d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f3f37f6370 0x55f3f37f8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:44238/0 (socket says 172.21.15.33:44238) 2024-09-12T12:35:14.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.462+0000 7fe7a1d9b640 1 -- 172.21.15.33:0/1248428689 learned_addr learned my addr 172.21.15.33:0/1248428689 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:35:14.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.463+0000 7fe7a1d9b640 1 -- 172.21.15.33:0/1248428689 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f3f37ecb40 msgr2=0x55f3f37eb090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T12:35:14.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.463+0000 7fe7a1d9b640 1 --2- 172.21.15.33:0/1248428689 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f3f37ecb40 0x55f3f37eb090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:14.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.463+0000 7fe7a1d9b640 1 -- 172.21.15.33:0/1248428689 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f3f37eb5d0 msgr2=0x55f3f37eba10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T12:35:14.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.463+0000 7fe7a1d9b640 1 --2- 172.21.15.33:0/1248428689 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f3f37eb5d0 0x55f3f37eba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:14.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.463+0000 7fe7a1d9b640 1 -- 172.21.15.33:0/1248428689 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3f36dd3a0 con 0x55f3f37f6370 2024-09-12T12:35:14.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.464+0000 7fe7937fe640 1 --2- 172.21.15.33:0/875868150 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe78c0a2cd0 0x7fe78c0a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:14.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.465+0000 7fe7937fe640 1 -- 172.21.15.33:0/875868150 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fe7940d2460 con 0x7fe7a4100e20 2024-09-12T12:35:14.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.465+0000 7fe7a2d9d640 1 --2- 172.21.15.33:0/875868150 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe78c0a2cd0 0x7fe78c0a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:14.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.466+0000 7fe7a1d9b640 1 --2- 172.21.15.33:0/1248428689 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f3f37f6370 0x55f3f37f8760 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe7940d66f0 tx=0x7fe7940d67e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d00dbf25acccd73d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:35:14.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.466+0000 7fe7a2d9d640 1 --2- 172.21.15.33:0/875868150 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe78c0a2cd0 0x7fe78c0a5190 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe79c009fa0 tx=0x7fe79c00d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:35:14.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.469+0000 7fe790ff9640 1 -- 172.21.15.33:0/1248428689 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe79401d070 con 0x55f3f37f6370 2024-09-12T12:35:14.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.469+0000 7fe790ff9640 1 -- 172.21.15.33:0/1248428689 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe79409be10 con 0x55f3f37f6370 2024-09-12T12:35:14.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.470+0000 7fe7aad4f740 1 -- 172.21.15.33:0/1248428689 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f3f37f6370 msgr2=0x55f3f37f8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:14.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.470+0000 7fe7aad4f740 1 --2- 172.21.15.33:0/1248428689 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f3f37f6370 0x55f3f37f8760 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe7940d66f0 tx=0x7fe7940d67e0 comp rx=0 tx=0).stop 2024-09-12T12:35:14.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.470+0000 7fe7aad4f740 1 -- 172.21.15.33:0/1248428689 shutdown_connections 2024-09-12T12:35:14.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.470+0000 7fe7aad4f740 1 --2- 172.21.15.33:0/1248428689 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f3f37f6370 0x55f3f37f8760 secure :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe7940d66f0 tx=0x7fe7940d67e0 comp rx=0 tx=0).stop 2024-09-12T12:35:14.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.470+0000 7fe7aad4f740 1 --2- 172.21.15.33:0/1248428689 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f3f37eb5d0 0x55f3f37eba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:14.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.470+0000 7fe7aad4f740 1 --2- 172.21.15.33:0/1248428689 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f3f37ecb40 0x55f3f37eb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:14.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.470+0000 7fe7aad4f740 1 -- 172.21.15.33:0/1248428689 >> 172.21.15.33:0/1248428689 conn(0x55f3f37b4310 msgr2=0x55f3f37e7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:35:14.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.471+0000 7fe7aad4f740 1 -- 172.21.15.33:0/1248428689 shutdown_connections 2024-09-12T12:35:14.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.471+0000 7fe7aad4f740 1 -- 172.21.15.33:0/1248428689 wait complete. 2024-09-12T12:35:14.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.471+0000 7fe7aad4f740 1 -- start start 2024-09-12T12:35:14.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.471+0000 7fe7aad4f740 1 Processor -- start 2024-09-12T12:35:14.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.472+0000 7fe7aad4f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f3f37eb5d0 0x55f3f37f3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:14.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.472+0000 7fe7aad4f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f3f37ecb40 0x55f3f37f3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:14.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.472+0000 7fe7aad4f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f3f37f3bc0 0x55f3f3813660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:14.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.472+0000 7fe7aad4f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55f3f380a0d0 con 0x55f3f37eb5d0 2024-09-12T12:35:14.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.472+0000 7fe7aad4f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f3f370c060 con 0x55f3f37ecb40 2024-09-12T12:35:14.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.472+0000 7fe7aad4f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55f3f380a250 con 0x55f3f37f3bc0 2024-09-12T12:35:14.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.472+0000 7fe7aad4f740 10 client.0 _ll_register_callbacks cb 0x55f3f345f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:35:14.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.472+0000 7fe7a1d9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f3f37ecb40 0x55f3f37f3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:14.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.472+0000 7fe7a1d9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f3f37ecb40 0x55f3f37f3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:42088/0 (socket says 172.21.15.33:42088) 2024-09-12T12:35:14.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.472+0000 7fe7a1d9b640 1 -- 172.21.15.33:0/1122171814 learned_addr learned my addr 172.21.15.33:0/1122171814 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:35:14.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.473+0000 7fe7a2d9d640 1 --2- 172.21.15.33:0/1122171814 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f3f37f3bc0 0x55f3f3813660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:14.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.473+0000 7fe7a1d9b640 1 -- 172.21.15.33:0/1122171814 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f3f37f3bc0 msgr2=0x55f3f3813660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:35:14.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.473+0000 7fe7a1d9b640 1 --2- 172.21.15.33:0/1122171814 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f3f37f3bc0 0x55f3f3813660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:14.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.473+0000 7fe7a1d9b640 1 -- 172.21.15.33:0/1122171814 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f3f37eb5d0 msgr2=0x55f3f37f3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:35:14.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.473+0000 7fe7a1d9b640 1 --2- 172.21.15.33:0/1122171814 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f3f37eb5d0 0x55f3f37f3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:14.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.473+0000 7fe7a1d9b640 1 -- 172.21.15.33:0/1122171814 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3f34c23c0 con 0x55f3f37ecb40 2024-09-12T12:35:14.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.473+0000 7fe7a1d9b640 1 --2- 172.21.15.33:0/1122171814 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f3f37ecb40 0x55f3f37f3680 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe79409b6a0 tx=0x7fe7940d26e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e14b046a82f57f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:35:14.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.473+0000 7fe789ffb640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:35:14.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.473+0000 7fe789ffb640 1 -- 172.21.15.33:0/1122171814 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7940b4060 con 0x55f3f37ecb40 2024-09-12T12:35:14.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.473+0000 7fe789ffb640 1 -- 172.21.15.33:0/1122171814 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fe79409b970 con 0x55f3f37ecb40 2024-09-12T12:35:14.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.473+0000 7fe7aad4f740 1 -- 172.21.15.33:0/1122171814 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe79409be10 con 0x55f3f37ecb40 2024-09-12T12:35:14.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.474+0000 7fe789ffb640 1 -- 172.21.15.33:0/1122171814 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe79401d040 con 0x55f3f37ecb40 2024-09-12T12:35:14.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.474+0000 7fe7aad4f740 10 client.25838 fetch_fsmap learned FSMap version 27 2024-09-12T12:35:14.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.474+0000 7fe7aad4f740 1 -- 172.21.15.33:0/1122171814 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f3f3816160 con 0x55f3f37ecb40 2024-09-12T12:35:14.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.474+0000 7fe789ffb640 1 -- 172.21.15.33:0/1122171814 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe79409be10 con 0x55f3f37ecb40 2024-09-12T12:35:14.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.474+0000 7fe789ffb640 1 -- 172.21.15.33:0/1122171814 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fe7940b6ce0 con 0x55f3f37ecb40 2024-09-12T12:35:14.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.474+0000 7fe7aad4f740 10 client.25838 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:35:14.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.474+0000 7fe7aad4f740 10 client.25838 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:35:14.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.474+0000 7fe7aad4f740 20 client.25838 populate_metadata read hostname 'smithi033' 2024-09-12T12:35:14.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.474+0000 7fe7aad4f740 1 --2- 172.21.15.33:0/1122171814 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55f3f3817610 0x55f3f3819a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:14.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.474+0000 7fe7aad4f740 4 client.25838 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:35:14.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.474+0000 7fe7aad4f740 1 -- 172.21.15.33:0/1122171814 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f3f375e860 con 0x55f3f3817610 2024-09-12T12:35:14.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.475+0000 7fe7a259c640 1 --2- 172.21.15.33:0/1122171814 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55f3f3817610 0x55f3f3819a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:14.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.475+0000 7fe7a259c640 1 --2- 172.21.15.33:0/1122171814 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55f3f3817610 0x55f3f3819a90 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38127ac9aa2d9935 server_cookie=45cce7ce87dafb63 in_seq=0 out_seq=0 2024-09-12T12:35:14.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.475+0000 7fe789ffb640 10 client.25838 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:35:14.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.476+0000 7fe789ffb640 1 -- 172.21.15.33:0/1122171814 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f3f375e860 con 0x55f3f3817610 2024-09-12T12:35:14.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.476+0000 7fe789ffb640 10 client.25838 handle_command_reply: tid=0 2024-09-12T12:35:14.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.476+0000 7fe7aad4f740 1 client.25838 shutdown 2024-09-12T12:35:14.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.476+0000 7fe7aad4f740 1 -- 172.21.15.33:0/1122171814 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f3f37ecb40 msgr2=0x55f3f37f3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:14.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.476+0000 7fe7aad4f740 1 --2- 172.21.15.33:0/1122171814 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f3f37ecb40 0x55f3f37f3680 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe79409b6a0 tx=0x7fe7940d26e0 comp rx=0 tx=0).stop 2024-09-12T12:35:14.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.477+0000 7fe7aad4f740 1 -- 172.21.15.33:0/1122171814 shutdown_connections 2024-09-12T12:35:14.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.477+0000 7fe7aad4f740 1 --2- 172.21.15.33:0/1122171814 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55f3f3817610 0x55f3f3819a90 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:14.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.477+0000 7fe7aad4f740 1 --2- 172.21.15.33:0/1122171814 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f3f37f3bc0 0x55f3f3813660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:14.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.477+0000 7fe7aad4f740 1 --2- 172.21.15.33:0/1122171814 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f3f37ecb40 0x55f3f37f3680 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:14.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.477+0000 7fe7aad4f740 1 --2- 172.21.15.33:0/1122171814 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f3f37eb5d0 0x55f3f37f3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:14.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.477+0000 7fe7aad4f740 1 -- 172.21.15.33:0/1122171814 >> 172.21.15.33:0/1122171814 conn(0x55f3f37b4310 msgr2=0x55f3f37ed930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:35:14.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.477+0000 7fe789ffb640 0 client.25838 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:35:14.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.477+0000 7fe7aad4f740 1 -- 172.21.15.33:0/1122171814 shutdown_connections 2024-09-12T12:35:14.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.477+0000 7fe7aad4f740 1 -- 172.21.15.33:0/1122171814 wait complete. 2024-09-12T12:35:14.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.477+0000 7fe7aad4f740 20 client.25838 trim_cache size 0 max 16384 2024-09-12T12:35:14.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.502+0000 7fe7aad4f740 1 Processor -- start 2024-09-12T12:35:14.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.502+0000 7fe7aad4f740 1 -- start start 2024-09-12T12:35:14.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.502+0000 7fe7aad4f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f3f37eb5d0 0x55f3f37e7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:14.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.502+0000 7fe7aad4f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f3f37ecb40 0x55f3f3813450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:14.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.503+0000 7fe7a259c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f3f37eb5d0 0x55f3f37e7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:14.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.503+0000 7fe7a259c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f3f37eb5d0 0x55f3f37e7d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:42096/0 (socket says 172.21.15.33:42096) 2024-09-12T12:35:14.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.503+0000 7fe7a1d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f3f37ecb40 0x55f3f3813450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:14.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.503+0000 7fe7a1d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f3f37ecb40 0x55f3f3813450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56506/0 (socket says 172.21.15.33:56506) 2024-09-12T12:35:14.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.503+0000 7fe7a259c640 1 -- 172.21.15.33:0/3117453621 learned_addr learned my addr 172.21.15.33:0/3117453621 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:35:14.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.503+0000 7fe7aad4f740 1 --2- 172.21.15.33:0/3117453621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f3f37f3bc0 0x55f3f3813990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:14.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.503+0000 7fe7aad4f740 1 -- 172.21.15.33:0/3117453621 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe784012520 con 0x55f3f37ecb40 2024-09-12T12:35:14.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.503+0000 7fe7aad4f740 1 -- 172.21.15.33:0/3117453621 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe78400fdf0 con 0x55f3f37eb5d0 2024-09-12T12:35:14.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.503+0000 7fe7aad4f740 1 -- 172.21.15.33:0/3117453621 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe78400dc40 con 0x55f3f37f3bc0 2024-09-12T12:35:14.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.504+0000 7fe7a2d9d640 1 --2- 172.21.15.33:0/3117453621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f3f37f3bc0 0x55f3f3813990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:14.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.505+0000 7fe7a259c640 1 -- 172.21.15.33:0/3117453621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f3f37f3bc0 msgr2=0x55f3f3813990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:35:14.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.505+0000 7fe7a259c640 1 --2- 172.21.15.33:0/3117453621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f3f37f3bc0 0x55f3f3813990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:14.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.505+0000 7fe7a259c640 1 -- 172.21.15.33:0/3117453621 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f3f37ecb40 msgr2=0x55f3f3813450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:35:14.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.505+0000 7fe7a259c640 1 --2- 172.21.15.33:0/3117453621 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f3f37ecb40 0x55f3f3813450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:14.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.505+0000 7fe7a259c640 1 -- 172.21.15.33:0/3117453621 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3f37f1690 con 0x55f3f37eb5d0 2024-09-12T12:35:14.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.505+0000 7fe7a2d9d640 1 --2- 172.21.15.33:0/3117453621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f3f37f3bc0 0x55f3f3813990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:35:14.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.505+0000 7fe7a259c640 1 --2- 172.21.15.33:0/3117453621 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f3f37eb5d0 0x55f3f37e7d70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x55f3f37e8ac0 tx=0x7fe798004380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=205e4d0b9cafcc53 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:35:14.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.506+0000 7fe78bfff640 1 -- 172.21.15.33:0/3117453621 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe798035040 con 0x55f3f37eb5d0 2024-09-12T12:35:14.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.506+0000 7fe78bfff640 1 -- 172.21.15.33:0/3117453621 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe798040070 con 0x55f3f37eb5d0 2024-09-12T12:35:14.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.506+0000 7fe78bfff640 1 -- 172.21.15.33:0/3117453621 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe798004d80 con 0x55f3f37eb5d0 2024-09-12T12:35:14.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.507+0000 7fe7aad4f740 1 -- 172.21.15.33:0/3117453621 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f3f37eb5d0 msgr2=0x55f3f37e7d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:14.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.507+0000 7fe7aad4f740 1 --2- 172.21.15.33:0/3117453621 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f3f37eb5d0 0x55f3f37e7d70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x55f3f37e8ac0 tx=0x7fe798004380 comp rx=0 tx=0).stop 2024-09-12T12:35:14.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.507+0000 7fe7aad4f740 1 -- 172.21.15.33:0/3117453621 shutdown_connections 2024-09-12T12:35:14.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.507+0000 7fe7aad4f740 1 --2- 172.21.15.33:0/3117453621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f3f37f3bc0 0x55f3f3813990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:14.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.508+0000 7fe7aad4f740 1 --2- 172.21.15.33:0/3117453621 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f3f37ecb40 0x55f3f3813450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:14.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.508+0000 7fe7aad4f740 1 --2- 172.21.15.33:0/3117453621 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f3f37eb5d0 0x55f3f37e7d70 secure :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0x55f3f37e8ac0 tx=0x7fe798004380 comp rx=0 tx=0).stop 2024-09-12T12:35:14.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.508+0000 7fe7aad4f740 1 -- 172.21.15.33:0/3117453621 >> 172.21.15.33:0/3117453621 conn(0x55f3f37b4310 msgr2=0x55f3f37e6d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:35:14.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.508+0000 7fe7aad4f740 1 -- 172.21.15.33:0/3117453621 shutdown_connections 2024-09-12T12:35:14.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.508+0000 7fe7aad4f740 1 -- 172.21.15.33:0/3117453621 wait complete. 2024-09-12T12:35:14.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.509+0000 7fe7aad4f740 1 -- start start 2024-09-12T12:35:14.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.509+0000 7fe7aad4f740 1 Processor -- start 2024-09-12T12:35:14.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.511+0000 7fe7aad4f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f3f37ecb40 0x55f3f380ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:14.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.511+0000 7fe7aad4f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f3f37f3bc0 0x55f3f380b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:14.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.511+0000 7fe7aad4f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f3f387a330 0x55f3f387a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:14.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.511+0000 7fe7aad4f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe78400e2b0 con 0x55f3f37ecb40 2024-09-12T12:35:14.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.511+0000 7fe7aad4f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe78400f720 con 0x55f3f37f3bc0 2024-09-12T12:35:14.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.511+0000 7fe7aad4f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe78400e980 con 0x55f3f387a330 2024-09-12T12:35:14.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.511+0000 7fe7aad4f740 10 client.0 _ll_register_callbacks cb 0x7fe7940d6f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:35:14.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.511+0000 7fe7a2d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f3f387a330 0x55f3f387a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:14.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.511+0000 7fe7a2d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f3f387a330 0x55f3f387a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:44258/0 (socket says 172.21.15.33:44258) 2024-09-12T12:35:14.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.511+0000 7fe7a2d9d640 1 -- 172.21.15.33:0/3605486384 learned_addr learned my addr 172.21.15.33:0/3605486384 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:35:14.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.512+0000 7fe7a2d9d640 1 -- 172.21.15.33:0/3605486384 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f3f37f3bc0 msgr2=0x55f3f380b060 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:35:14.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.512+0000 7fe7a2d9d640 1 --2- 172.21.15.33:0/3605486384 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f3f37f3bc0 0x55f3f380b060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:14.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.512+0000 7fe7a2d9d640 1 -- 172.21.15.33:0/3605486384 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f3f37ecb40 msgr2=0x55f3f380ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:35:14.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.512+0000 7fe7a2d9d640 1 --2- 172.21.15.33:0/3605486384 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f3f37ecb40 0x55f3f380ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:14.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.512+0000 7fe7a2d9d640 1 -- 172.21.15.33:0/3605486384 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3f387ada0 con 0x55f3f387a330 2024-09-12T12:35:14.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.512+0000 7fe7a2d9d640 1 --2- 172.21.15.33:0/3605486384 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f3f387a330 0x55f3f387a7b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe79c016fd0 tx=0x7fe79c004a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf7e42d796b6fe1e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:35:14.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.512+0000 7fe789ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:35:14.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.512+0000 7fe789ffb640 1 -- 172.21.15.33:0/3605486384 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe79c022850 con 0x55f3f387a330 2024-09-12T12:35:14.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.513+0000 7fe7aad4f740 1 -- 172.21.15.33:0/3605486384 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe798040070 con 0x55f3f387a330 2024-09-12T12:35:14.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.513+0000 7fe789ffb640 1 -- 172.21.15.33:0/3605486384 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fe79c0229f0 con 0x55f3f387a330 2024-09-12T12:35:14.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.513+0000 7fe789ffb640 1 -- 172.21.15.33:0/3605486384 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe79c030050 con 0x55f3f387a330 2024-09-12T12:35:14.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.517+0000 7fe7aad4f740 10 client.25936 fetch_fsmap learned FSMap version 27 2024-09-12T12:35:14.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.517+0000 7fe7aad4f740 1 -- 172.21.15.33:0/3605486384 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f3f38821b0 con 0x55f3f387a330 2024-09-12T12:35:14.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.518+0000 7fe789ffb640 1 -- 172.21.15.33:0/3605486384 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe798040070 con 0x55f3f387a330 2024-09-12T12:35:14.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.519+0000 7fe789ffb640 1 -- 172.21.15.33:0/3605486384 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fe79c021a40 con 0x55f3f387a330 2024-09-12T12:35:14.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.519+0000 7fe7aad4f740 10 client.25936 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:35:14.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.519+0000 7fe7aad4f740 10 client.25936 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:35:14.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.519+0000 7fe7aad4f740 20 client.25936 populate_metadata read hostname 'smithi033' 2024-09-12T12:35:14.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.519+0000 7fe7aad4f740 1 --2- 172.21.15.33:0/3605486384 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55f3f38828d0 0x55f3f3884d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:14.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.519+0000 7fe7aad4f740 4 client.25936 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:35:14.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.519+0000 7fe7aad4f740 1 -- 172.21.15.33:0/3605486384 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f3f3758d70 con 0x55f3f38828d0 2024-09-12T12:35:14.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.520+0000 7fe7a259c640 1 --2- 172.21.15.33:0/3605486384 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55f3f38828d0 0x55f3f3884d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:14.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.520+0000 7fe7a259c640 1 --2- 172.21.15.33:0/3605486384 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55f3f38828d0 0x55f3f3884d70 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=281861e89126f322 server_cookie=51dc3b07dbdf82e1 in_seq=0 out_seq=0 2024-09-12T12:35:14.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.520+0000 7fe789ffb640 10 client.25936 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:35:14.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.520+0000 7fe789ffb640 1 -- 172.21.15.33:0/3605486384 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f3f3758d70 con 0x55f3f38828d0 2024-09-12T12:35:14.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.520+0000 7fe789ffb640 10 client.25936 handle_command_reply: tid=0 2024-09-12T12:35:14.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.520+0000 7fe7aad4f740 1 client.25936 shutdown 2024-09-12T12:35:14.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.522+0000 7fe7aad4f740 1 -- 172.21.15.33:0/3605486384 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f3f387a330 msgr2=0x55f3f387a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:14.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.522+0000 7fe7aad4f740 1 --2- 172.21.15.33:0/3605486384 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f3f387a330 0x55f3f387a7b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe79c016fd0 tx=0x7fe79c004a60 comp rx=0 tx=0).stop 2024-09-12T12:35:14.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.533+0000 7fe7aad4f740 1 -- 172.21.15.33:0/3605486384 shutdown_connections 2024-09-12T12:35:14.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.533+0000 7fe7aad4f740 1 --2- 172.21.15.33:0/3605486384 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55f3f38828d0 0x55f3f3884d70 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:14.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.533+0000 7fe7aad4f740 1 --2- 172.21.15.33:0/3605486384 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f3f387a330 0x55f3f387a7b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:14.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.533+0000 7fe7aad4f740 1 --2- 172.21.15.33:0/3605486384 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f3f37f3bc0 0x55f3f380b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:14.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.533+0000 7fe7aad4f740 1 --2- 172.21.15.33:0/3605486384 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f3f37ecb40 0x55f3f380ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:14.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.533+0000 7fe7aad4f740 1 -- 172.21.15.33:0/3605486384 >> 172.21.15.33:0/3605486384 conn(0x55f3f37b4310 msgr2=0x55f3f37f2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:35:14.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.533+0000 7fe789ffb640 0 client.25936 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:35:14.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.533+0000 7fe7aad4f740 1 -- 172.21.15.33:0/3605486384 shutdown_connections 2024-09-12T12:35:14.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.534+0000 7fe7aad4f740 1 -- 172.21.15.33:0/3605486384 wait complete. 2024-09-12T12:35:14.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.537+0000 7fe7aad4f740 20 client.25936 trim_cache size 0 max 16384 2024-09-12T12:35:14.537 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-09-12T12:35:14.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.539+0000 7fe7a8976640 1 -- 172.21.15.33:0/875868150 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe78c0a2cd0 msgr2=0x7fe78c0a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:14.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.539+0000 7fe7a8976640 1 --2- 172.21.15.33:0/875868150 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe78c0a2cd0 0x7fe78c0a5190 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe79c009fa0 tx=0x7fe79c00d040 comp rx=0 tx=0).stop 2024-09-12T12:35:14.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.539+0000 7fe7a8976640 1 -- 172.21.15.33:0/875868150 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7a4100e20 msgr2=0x7fe7a41a4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:14.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.539+0000 7fe7a8976640 1 --2- 172.21.15.33:0/875868150 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7a4100e20 0x7fe7a41a4c10 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fe79400c890 tx=0x7fe79400cd50 comp rx=0 tx=0).stop 2024-09-12T12:35:14.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.539+0000 7fe7a8976640 1 -- 172.21.15.33:0/875868150 shutdown_connections 2024-09-12T12:35:14.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.539+0000 7fe7a8976640 1 --2- 172.21.15.33:0/875868150 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe78c0a2cd0 0x7fe78c0a5190 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:14.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.539+0000 7fe7a8976640 1 --2- 172.21.15.33:0/875868150 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7a4105f60 0x7fe7a419e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:14.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.539+0000 7fe7a8976640 1 --2- 172.21.15.33:0/875868150 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7a4100e20 0x7fe7a41a4c10 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:14.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.539+0000 7fe7a8976640 1 --2- 172.21.15.33:0/875868150 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7a4100500 0x7fe7a41a46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:14.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.539+0000 7fe7a8976640 1 -- 172.21.15.33:0/875868150 >> 172.21.15.33:0/875868150 conn(0x7fe7a40fc5c0 msgr2=0x7fe7a4103820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:35:14.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.539+0000 7fe7a8976640 1 -- 172.21.15.33:0/875868150 shutdown_connections 2024-09-12T12:35:14.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:14.540+0000 7fe7a8976640 1 -- 172.21.15.33:0/875868150 wait complete. 2024-09-12T12:35:16.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:35:15 smithi102 ceph-mon[34799]: pgmap v627: 129 pgs: 129 active+clean; 10 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 33 MiB/s wr, 693 op/s 2024-09-12T12:35:16.235 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:35:15 smithi033 ceph-mon[31246]: pgmap v627: 129 pgs: 129 active+clean; 10 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 33 MiB/s wr, 693 op/s 2024-09-12T12:35:16.315 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T12:35:16.315 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T12:35:16.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:35:15 smithi043 ceph-mon[34144]: pgmap v627: 129 pgs: 129 active+clean; 10 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 33 MiB/s wr, 693 op/s 2024-09-12T12:35:17.054 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:35:18.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:35:17 smithi102 ceph-mon[34799]: pgmap v628: 129 pgs: 129 active+clean; 10 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 27 MiB/s wr, 562 op/s 2024-09-12T12:35:18.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:35:17 smithi033 ceph-mon[31246]: pgmap v628: 129 pgs: 129 active+clean; 10 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 27 MiB/s wr, 562 op/s 2024-09-12T12:35:18.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:35:17 smithi043 ceph-mon[34144]: pgmap v628: 129 pgs: 129 active+clean; 10 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 27 MiB/s wr, 562 op/s 2024-09-12T12:35:20.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:35:19 smithi102 ceph-mon[34799]: pgmap v629: 129 pgs: 129 active+clean; 10 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 36 MiB/s wr, 747 op/s 2024-09-12T12:35:20.179 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:35:19 smithi033 ceph-mon[31246]: pgmap v629: 129 pgs: 129 active+clean; 10 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 36 MiB/s wr, 747 op/s 2024-09-12T12:35:20.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:35:19 smithi043 ceph-mon[34144]: pgmap v629: 129 pgs: 129 active+clean; 10 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 36 MiB/s wr, 747 op/s 2024-09-12T12:35:20.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.755+0000 7f054ecba640 1 -- 172.21.15.33:0/2456395004 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05481008d0 msgr2=0x7f0548100d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:20.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.755+0000 7f054ecba640 1 --2- 172.21.15.33:0/2456395004 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05481008d0 0x7f0548100d30 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f0544009930 tx=0x7f054402a460 comp rx=0 tx=0).stop 2024-09-12T12:35:20.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.755+0000 7f054ecba640 1 -- 172.21.15.33:0/2456395004 shutdown_connections 2024-09-12T12:35:20.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.755+0000 7f054ecba640 1 --2- 172.21.15.33:0/2456395004 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0548101270 0x7f054810d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:20.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.755+0000 7f054ecba640 1 --2- 172.21.15.33:0/2456395004 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05481008d0 0x7f0548100d30 secure :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f0544009930 tx=0x7f054402a460 comp rx=0 tx=0).stop 2024-09-12T12:35:20.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.755+0000 7f054ecba640 1 --2- 172.21.15.33:0/2456395004 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f05481068d0 0x7f0548106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:20.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.755+0000 7f054ecba640 1 -- 172.21.15.33:0/2456395004 >> 172.21.15.33:0/2456395004 conn(0x7f05480fc610 msgr2=0x7f05480fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:35:20.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.758+0000 7f054ecba640 1 -- 172.21.15.33:0/2456395004 shutdown_connections 2024-09-12T12:35:20.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.758+0000 7f054ecba640 1 -- 172.21.15.33:0/2456395004 wait complete. 2024-09-12T12:35:20.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.759+0000 7f054ecba640 1 Processor -- start 2024-09-12T12:35:20.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.760+0000 7f054ecba640 1 -- start start 2024-09-12T12:35:20.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.760+0000 7f054ecba640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0548101270 0x7f05481960e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:20.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.760+0000 7f054ecba640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05481068d0 0x7f0548196620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:20.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.760+0000 7f054ecba640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0548196bb0 0x7f05481a20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:20.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.760+0000 7f054ecba640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0548110c10 con 0x7f05481068d0 2024-09-12T12:35:20.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.760+0000 7f054ecba640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0548110a90 con 0x7f0548196bb0 2024-09-12T12:35:20.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.760+0000 7f054ecba640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0548110d90 con 0x7f0548101270 2024-09-12T12:35:20.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.764+0000 7f054d4b7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05481068d0 0x7f0548196620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:20.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.764+0000 7f054d4b7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05481068d0 0x7f0548196620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47874/0 (socket says 172.21.15.33:47874) 2024-09-12T12:35:20.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.764+0000 7f054d4b7640 1 -- 172.21.15.33:0/1751043218 learned_addr learned my addr 172.21.15.33:0/1751043218 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:35:20.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.770+0000 7f054e4b9640 1 --2- 172.21.15.33:0/1751043218 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0548196bb0 0x7f05481a20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:20.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.770+0000 7f054dcb8640 1 --2- 172.21.15.33:0/1751043218 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0548101270 0x7f05481960e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:20.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.771+0000 7f054d4b7640 1 -- 172.21.15.33:0/1751043218 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0548101270 msgr2=0x7f05481960e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:20.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.771+0000 7f054d4b7640 1 --2- 172.21.15.33:0/1751043218 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0548101270 0x7f05481960e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:20.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.771+0000 7f054d4b7640 1 -- 172.21.15.33:0/1751043218 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0548196bb0 msgr2=0x7f05481a20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:20.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.771+0000 7f054d4b7640 1 --2- 172.21.15.33:0/1751043218 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0548196bb0 0x7f05481a20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:20.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.771+0000 7f054d4b7640 1 -- 172.21.15.33:0/1751043218 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05481a2910 con 0x7f05481068d0 2024-09-12T12:35:20.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.773+0000 7f054d4b7640 1 --2- 172.21.15.33:0/1751043218 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05481068d0 0x7f0548196620 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0544009900 tx=0x7f0544003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:35:20.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.774+0000 7f053effd640 1 -- 172.21.15.33:0/1751043218 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054403f070 con 0x7f05481068d0 2024-09-12T12:35:20.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.774+0000 7f054ecba640 1 -- 172.21.15.33:0/1751043218 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05481a2ba0 con 0x7f05481068d0 2024-09-12T12:35:20.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.774+0000 7f054ecba640 1 -- 172.21.15.33:0/1751043218 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05481a3030 con 0x7f05481068d0 2024-09-12T12:35:20.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.777+0000 7f05522f5740 1 Processor -- start 2024-09-12T12:35:20.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.777+0000 7f053effd640 1 -- 172.21.15.33:0/1751043218 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0544031d60 con 0x7f05481068d0 2024-09-12T12:35:20.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.777+0000 7f053effd640 1 -- 172.21.15.33:0/1751043218 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0544035070 con 0x7f05481068d0 2024-09-12T12:35:20.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.778+0000 7f05522f5740 1 -- start start 2024-09-12T12:35:20.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.778+0000 7f05522f5740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a69a772d70 0x55a69a773150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:20.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.778+0000 7f05522f5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a69a773690 0x55a69a77da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:20.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.778+0000 7f05522f5740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a69a77df50 0x55a69a780340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:20.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.778+0000 7f05522f5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a69a6d8280 con 0x55a69a773690 2024-09-12T12:35:20.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.778+0000 7f05522f5740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a69a67fb10 con 0x55a69a772d70 2024-09-12T12:35:20.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.778+0000 7f05522f5740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a69a6d4240 con 0x55a69a77df50 2024-09-12T12:35:20.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.779+0000 7f054e4b9640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a69a772d70 0x55a69a773150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:20.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.779+0000 7f054e4b9640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a69a772d70 0x55a69a773150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:51572/0 (socket says 172.21.15.33:51572) 2024-09-12T12:35:20.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.779+0000 7f054e4b9640 1 -- 172.21.15.33:0/1857775626 learned_addr learned my addr 172.21.15.33:0/1857775626 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:35:20.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.782+0000 7f054dcb8640 1 --2- 172.21.15.33:0/1857775626 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a69a773690 0x55a69a77da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:20.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.782+0000 7f054e4b9640 1 -- 172.21.15.33:0/1857775626 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a69a77df50 msgr2=0x55a69a780340 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T12:35:20.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.782+0000 7f054e4b9640 1 --2- 172.21.15.33:0/1857775626 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a69a77df50 0x55a69a780340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:20.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.782+0000 7f054e4b9640 1 -- 172.21.15.33:0/1857775626 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a69a773690 msgr2=0x55a69a77da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:35:20.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.782+0000 7f054e4b9640 1 --2- 172.21.15.33:0/1857775626 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a69a773690 0x55a69a77da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:20.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.782+0000 7f054e4b9640 1 -- 172.21.15.33:0/1857775626 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a69a68c1f0 con 0x55a69a772d70 2024-09-12T12:35:20.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.784+0000 7f054e4b9640 1 --2- 172.21.15.33:0/1857775626 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a69a772d70 0x55a69a773150 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0540010370 tx=0x7f0540010830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc7a8546ada0aa0c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:35:20.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.786+0000 7f053effd640 1 -- 172.21.15.33:0/1751043218 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0544043400 con 0x7f05481068d0 2024-09-12T12:35:20.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.787+0000 7f053effd640 1 --2- 172.21.15.33:0/1751043218 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f05340a2d50 0x7f05340a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:20.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.788+0000 7f0533fff640 1 -- 172.21.15.33:0/1857775626 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0540016070 con 0x55a69a772d70 2024-09-12T12:35:20.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.788+0000 7f053effd640 1 -- 172.21.15.33:0/1751043218 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f05440ef960 con 0x7f05481068d0 2024-09-12T12:35:20.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.788+0000 7f0533fff640 1 -- 172.21.15.33:0/1857775626 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0540004d20 con 0x55a69a772d70 2024-09-12T12:35:20.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.788+0000 7f0533fff640 1 -- 172.21.15.33:0/1857775626 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0540005440 con 0x55a69a772d70 2024-09-12T12:35:20.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.788+0000 7f054dcb8640 1 --2- 172.21.15.33:0/1751043218 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f05340a2d50 0x7f05340a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:20.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.789+0000 7f05522f5740 1 -- 172.21.15.33:0/1857775626 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a69a772d70 msgr2=0x55a69a773150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:20.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.789+0000 7f05522f5740 1 --2- 172.21.15.33:0/1857775626 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a69a772d70 0x55a69a773150 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0540010370 tx=0x7f0540010830 comp rx=0 tx=0).stop 2024-09-12T12:35:20.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.792+0000 7f05522f5740 1 -- 172.21.15.33:0/1857775626 shutdown_connections 2024-09-12T12:35:20.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.792+0000 7f05522f5740 1 --2- 172.21.15.33:0/1857775626 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a69a77df50 0x55a69a780340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:20.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.792+0000 7f05522f5740 1 --2- 172.21.15.33:0/1857775626 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a69a773690 0x55a69a77da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:20.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.792+0000 7f05522f5740 1 --2- 172.21.15.33:0/1857775626 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a69a772d70 0x55a69a773150 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:20.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.792+0000 7f05522f5740 1 -- 172.21.15.33:0/1857775626 >> 172.21.15.33:0/1857775626 conn(0x55a69a76f300 msgr2=0x55a69a76f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:35:20.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.794+0000 7f054dcb8640 1 --2- 172.21.15.33:0/1751043218 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f05340a2d50 0x7f05340a5210 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0538006fd0 tx=0x7f0538008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:35:20.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.797+0000 7f05522f5740 1 -- 172.21.15.33:0/1857775626 shutdown_connections 2024-09-12T12:35:20.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.798+0000 7f05522f5740 1 -- 172.21.15.33:0/1857775626 wait complete. 2024-09-12T12:35:20.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.798+0000 7f05522f5740 1 -- start start 2024-09-12T12:35:20.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.798+0000 7f05522f5740 1 Processor -- start 2024-09-12T12:35:20.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.799+0000 7f05522f5740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a69a772d70 0x55a69a77af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:20.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.799+0000 7f05522f5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a69a773690 0x55a69a77b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:20.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.799+0000 7f05522f5740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a69a77df50 0x55a69a77b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:20.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.799+0000 7f05522f5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a69a780b20 con 0x55a69a773690 2024-09-12T12:35:20.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.799+0000 7f05522f5740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a69a692f10 con 0x55a69a77df50 2024-09-12T12:35:20.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.799+0000 7f05522f5740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a69a780ca0 con 0x55a69a772d70 2024-09-12T12:35:20.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.799+0000 7f05522f5740 10 client.0 _ll_register_callbacks cb 0x55a69a65ba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:35:20.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.803+0000 7f054e4b9640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a69a77df50 0x55a69a77b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:20.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.803+0000 7f054e4b9640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a69a77df50 0x55a69a77b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:51586/0 (socket says 172.21.15.33:51586) 2024-09-12T12:35:20.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.803+0000 7f054e4b9640 1 -- 172.21.15.33:0/4018661393 learned_addr learned my addr 172.21.15.33:0/4018661393 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:35:20.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.803+0000 7f054d4b7640 1 --2- 172.21.15.33:0/4018661393 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a69a773690 0x55a69a77b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:20.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.803+0000 7f054dcb8640 1 --2- 172.21.15.33:0/4018661393 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a69a772d70 0x55a69a77af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:20.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.805+0000 7f054dcb8640 1 -- 172.21.15.33:0/4018661393 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a69a77df50 msgr2=0x55a69a77b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:35:20.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.805+0000 7f054dcb8640 1 --2- 172.21.15.33:0/4018661393 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a69a77df50 0x55a69a77b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:20.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.805+0000 7f054dcb8640 1 -- 172.21.15.33:0/4018661393 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a69a773690 msgr2=0x55a69a77b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:35:20.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.805+0000 7f054dcb8640 1 --2- 172.21.15.33:0/4018661393 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a69a773690 0x55a69a77b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:20.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.805+0000 7f054dcb8640 1 -- 172.21.15.33:0/4018661393 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a69a4496a0 con 0x55a69a772d70 2024-09-12T12:35:20.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.807+0000 7f054dcb8640 1 --2- 172.21.15.33:0/4018661393 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a69a772d70 0x55a69a77af30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f05380144b0 tx=0x7f0538004700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bffa31228579ef3b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:35:20.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.808+0000 7f05317fa640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:35:20.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.809+0000 7f05317fa640 1 -- 172.21.15.33:0/4018661393 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053801b050 con 0x55a69a772d70 2024-09-12T12:35:20.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.809+0000 7f05522f5740 1 -- 172.21.15.33:0/4018661393 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0540004d20 con 0x55a69a772d70 2024-09-12T12:35:20.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.809+0000 7f05317fa640 1 -- 172.21.15.33:0/4018661393 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f0538015820 con 0x55a69a772d70 2024-09-12T12:35:20.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.810+0000 7f05317fa640 1 -- 172.21.15.33:0/4018661393 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f053802e050 con 0x55a69a772d70 2024-09-12T12:35:20.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.813+0000 7f05522f5740 10 client.25945 fetch_fsmap learned FSMap version 27 2024-09-12T12:35:20.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.813+0000 7f05522f5740 1 -- 172.21.15.33:0/4018661393 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a69a78c910 con 0x55a69a772d70 2024-09-12T12:35:20.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.817+0000 7f05317fa640 1 -- 172.21.15.33:0/4018661393 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0540004d20 con 0x55a69a772d70 2024-09-12T12:35:20.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.817+0000 7f05317fa640 1 -- 172.21.15.33:0/4018661393 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f0538020c70 con 0x55a69a772d70 2024-09-12T12:35:20.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.818+0000 7f05522f5740 10 client.25945 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:35:20.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.818+0000 7f05522f5740 10 client.25945 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:35:20.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.818+0000 7f05522f5740 20 client.25945 populate_metadata read hostname 'smithi033' 2024-09-12T12:35:20.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.818+0000 7f05522f5740 1 --2- 172.21.15.33:0/4018661393 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55a69a78de20 0x55a69a790240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:20.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.818+0000 7f05522f5740 4 client.25945 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:35:20.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.818+0000 7f05522f5740 1 -- 172.21.15.33:0/4018661393 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a69a6e57f0 con 0x55a69a78de20 2024-09-12T12:35:20.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.819+0000 7f054d4b7640 1 --2- 172.21.15.33:0/4018661393 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55a69a78de20 0x55a69a790240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:20.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.828+0000 7f054d4b7640 1 --2- 172.21.15.33:0/4018661393 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55a69a78de20 0x55a69a790240 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a696b66646e9a38d server_cookie=e090ec1512b6b58e in_seq=0 out_seq=0 2024-09-12T12:35:20.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.829+0000 7f05317fa640 10 client.25945 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:35:20.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.833+0000 7f05317fa640 1 -- 172.21.15.33:0/4018661393 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a69a6e57f0 con 0x55a69a78de20 2024-09-12T12:35:20.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.833+0000 7f05317fa640 10 client.25945 handle_command_reply: tid=0 2024-09-12T12:35:20.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.833+0000 7f05522f5740 1 client.25945 shutdown 2024-09-12T12:35:20.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.836+0000 7f05522f5740 1 -- 172.21.15.33:0/4018661393 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a69a772d70 msgr2=0x55a69a77af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:20.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.836+0000 7f05522f5740 1 --2- 172.21.15.33:0/4018661393 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a69a772d70 0x55a69a77af30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f05380144b0 tx=0x7f0538004700 comp rx=0 tx=0).stop 2024-09-12T12:35:20.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.836+0000 7f05522f5740 1 -- 172.21.15.33:0/4018661393 shutdown_connections 2024-09-12T12:35:20.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.836+0000 7f05522f5740 1 --2- 172.21.15.33:0/4018661393 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55a69a78de20 0x55a69a790240 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:20.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.836+0000 7f05522f5740 1 --2- 172.21.15.33:0/4018661393 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a69a77df50 0x55a69a77b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:20.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.836+0000 7f05522f5740 1 --2- 172.21.15.33:0/4018661393 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a69a773690 0x55a69a77b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:20.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.836+0000 7f05522f5740 1 --2- 172.21.15.33:0/4018661393 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a69a772d70 0x55a69a77af30 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:20.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.836+0000 7f05522f5740 1 -- 172.21.15.33:0/4018661393 >> 172.21.15.33:0/4018661393 conn(0x55a69a76f300 msgr2=0x55a69a775030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:35:20.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.836+0000 7f05317fa640 0 client.25945 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:35:20.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.840+0000 7f05522f5740 1 -- 172.21.15.33:0/4018661393 shutdown_connections 2024-09-12T12:35:20.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.842+0000 7f05522f5740 1 -- 172.21.15.33:0/4018661393 wait complete. 2024-09-12T12:35:20.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.842+0000 7f05522f5740 20 client.25945 trim_cache size 0 max 16384 2024-09-12T12:35:20.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.877+0000 7f05522f5740 1 Processor -- start 2024-09-12T12:35:20.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.878+0000 7f05522f5740 1 -- start start 2024-09-12T12:35:20.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.878+0000 7f05522f5740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a69a772d70 0x55a69a77b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:20.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.878+0000 7f05522f5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a69a773690 0x55a69a795af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:20.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.878+0000 7f05522f5740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a69a77df50 0x55a69a796030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:20.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.878+0000 7f05522f5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f052c012570 con 0x55a69a773690 2024-09-12T12:35:20.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.879+0000 7f054e4b9640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a69a77df50 0x55a69a796030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:20.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.879+0000 7f054e4b9640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a69a77df50 0x55a69a796030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:51590/0 (socket says 172.21.15.33:51590) 2024-09-12T12:35:20.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.879+0000 7f054e4b9640 1 -- 172.21.15.33:0/823968174 learned_addr learned my addr 172.21.15.33:0/823968174 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:35:20.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.879+0000 7f054d4b7640 1 --2- 172.21.15.33:0/823968174 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a69a773690 0x55a69a795af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:20.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.879+0000 7f05522f5740 1 -- 172.21.15.33:0/823968174 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f052c00fe40 con 0x55a69a77df50 2024-09-12T12:35:20.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.879+0000 7f05522f5740 1 -- 172.21.15.33:0/823968174 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f052c00dc90 con 0x55a69a772d70 2024-09-12T12:35:20.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.880+0000 7f054dcb8640 1 --2- 172.21.15.33:0/823968174 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a69a772d70 0x55a69a77b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:20.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.881+0000 7f054e4b9640 1 -- 172.21.15.33:0/823968174 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a69a772d70 msgr2=0x55a69a77b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:35:20.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.881+0000 7f054e4b9640 1 --2- 172.21.15.33:0/823968174 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a69a772d70 0x55a69a77b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:20.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.881+0000 7f054e4b9640 1 -- 172.21.15.33:0/823968174 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a69a773690 msgr2=0x55a69a795af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:35:20.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.881+0000 7f054e4b9640 1 --2- 172.21.15.33:0/823968174 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a69a773690 0x55a69a795af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:20.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.881+0000 7f054e4b9640 1 -- 172.21.15.33:0/823968174 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a69a77d800 con 0x55a69a77df50 2024-09-12T12:35:20.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.881+0000 7f054e4b9640 1 --2- 172.21.15.33:0/823968174 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a69a77df50 0x55a69a796030 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0540003a20 tx=0x7f0540003a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9240e5a17c4666bf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:35:20.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.884+0000 7f05337fe640 1 -- 172.21.15.33:0/823968174 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0540016040 con 0x55a69a77df50 2024-09-12T12:35:20.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.884+0000 7f05337fe640 1 -- 172.21.15.33:0/823968174 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f05400050c0 con 0x55a69a77df50 2024-09-12T12:35:20.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.885+0000 7f05522f5740 1 -- 172.21.15.33:0/823968174 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a69a77df50 msgr2=0x55a69a796030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:20.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.885+0000 7f05522f5740 1 --2- 172.21.15.33:0/823968174 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a69a77df50 0x55a69a796030 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0540003a20 tx=0x7f0540003a50 comp rx=0 tx=0).stop 2024-09-12T12:35:20.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.885+0000 7f05522f5740 1 -- 172.21.15.33:0/823968174 shutdown_connections 2024-09-12T12:35:20.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.885+0000 7f05522f5740 1 --2- 172.21.15.33:0/823968174 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a69a77df50 0x55a69a796030 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:20.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.885+0000 7f05522f5740 1 --2- 172.21.15.33:0/823968174 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a69a773690 0x55a69a795af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:20.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.885+0000 7f05522f5740 1 --2- 172.21.15.33:0/823968174 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a69a772d70 0x55a69a77b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:20.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.885+0000 7f05522f5740 1 -- 172.21.15.33:0/823968174 >> 172.21.15.33:0/823968174 conn(0x55a69a76f300 msgr2=0x55a69a77cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:35:20.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.892+0000 7f05522f5740 1 -- 172.21.15.33:0/823968174 shutdown_connections 2024-09-12T12:35:20.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.893+0000 7f05522f5740 1 -- 172.21.15.33:0/823968174 wait complete. 2024-09-12T12:35:20.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.893+0000 7f05522f5740 1 -- start start 2024-09-12T12:35:20.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.893+0000 7f05522f5740 1 Processor -- start 2024-09-12T12:35:20.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.894+0000 7f05522f5740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a69a772d70 0x55a69a782920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:20.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.894+0000 7f05522f5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a69a773690 0x55a69a782e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:20.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.894+0000 7f05522f5740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a69a77df50 0x55a69a7f0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:20.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.894+0000 7f05522f5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f052c00e300 con 0x55a69a773690 2024-09-12T12:35:20.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.894+0000 7f05522f5740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f052c00f770 con 0x55a69a772d70 2024-09-12T12:35:20.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.894+0000 7f05522f5740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f052c00e9d0 con 0x55a69a77df50 2024-09-12T12:35:20.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.894+0000 7f05522f5740 10 client.0 _ll_register_callbacks cb 0x7f053800fd10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:35:20.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.895+0000 7f054dcb8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a69a772d70 0x55a69a782920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:20.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.895+0000 7f054dcb8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a69a772d70 0x55a69a782920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:51596/0 (socket says 172.21.15.33:51596) 2024-09-12T12:35:20.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.895+0000 7f054dcb8640 1 -- 172.21.15.33:0/2324678015 learned_addr learned my addr 172.21.15.33:0/2324678015 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:35:20.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.895+0000 7f054dcb8640 1 -- 172.21.15.33:0/2324678015 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a69a77df50 msgr2=0x55a69a7f0a80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:35:20.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.895+0000 7f054dcb8640 1 --2- 172.21.15.33:0/2324678015 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a69a77df50 0x55a69a7f0a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:20.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.895+0000 7f054dcb8640 1 -- 172.21.15.33:0/2324678015 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a69a773690 msgr2=0x55a69a782e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:35:20.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.895+0000 7f054dcb8640 1 --2- 172.21.15.33:0/2324678015 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a69a773690 0x55a69a782e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:20.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.895+0000 7f054dcb8640 1 -- 172.21.15.33:0/2324678015 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a69a7f1280 con 0x55a69a772d70 2024-09-12T12:35:20.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.896+0000 7f054dcb8640 1 --2- 172.21.15.33:0/2324678015 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a69a772d70 0x55a69a782920 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f05380047b0 tx=0x7f0538015310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1eedb12a9288e8d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:35:20.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.897+0000 7f05317fa640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:35:20.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.897+0000 7f05317fa640 1 -- 172.21.15.33:0/2324678015 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0538038070 con 0x55a69a772d70 2024-09-12T12:35:20.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.897+0000 7f05522f5740 1 -- 172.21.15.33:0/2324678015 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05400050c0 con 0x55a69a772d70 2024-09-12T12:35:20.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.897+0000 7f05317fa640 1 -- 172.21.15.33:0/2324678015 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f0538013ca0 con 0x55a69a772d70 2024-09-12T12:35:20.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.897+0000 7f05317fa640 1 -- 172.21.15.33:0/2324678015 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f053801b040 con 0x55a69a772d70 2024-09-12T12:35:20.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.898+0000 7f05522f5740 10 client.25856 fetch_fsmap learned FSMap version 27 2024-09-12T12:35:20.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.898+0000 7f05522f5740 1 -- 172.21.15.33:0/2324678015 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a69a7f9720 con 0x55a69a772d70 2024-09-12T12:35:20.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.900+0000 7f05317fa640 1 -- 172.21.15.33:0/2324678015 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f05400050c0 con 0x55a69a772d70 2024-09-12T12:35:20.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.901+0000 7f05317fa640 1 -- 172.21.15.33:0/2324678015 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f0538020460 con 0x55a69a772d70 2024-09-12T12:35:20.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.901+0000 7f05522f5740 10 client.25856 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:35:20.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.901+0000 7f05522f5740 10 client.25856 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:35:20.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.901+0000 7f05522f5740 20 client.25856 populate_metadata read hostname 'smithi033' 2024-09-12T12:35:20.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.901+0000 7f05522f5740 1 --2- 172.21.15.33:0/2324678015 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55a69a7f9de0 0x55a69a7fc240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:20.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.901+0000 7f05522f5740 4 client.25856 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T12:35:20.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.901+0000 7f05522f5740 1 -- 172.21.15.33:0/2324678015 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a69a6dfd00 con 0x55a69a7f9de0 2024-09-12T12:35:20.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.904+0000 7f054d4b7640 1 --2- 172.21.15.33:0/2324678015 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55a69a7f9de0 0x55a69a7fc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:20.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.904+0000 7f054d4b7640 1 --2- 172.21.15.33:0/2324678015 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55a69a7f9de0 0x55a69a7fc240 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8aacfc229b30e47 server_cookie=9a1a5ff80abe0f4d in_seq=0 out_seq=0 2024-09-12T12:35:20.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.904+0000 7f05317fa640 10 client.25856 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:35:20.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.906+0000 7f05317fa640 1 -- 172.21.15.33:0/2324678015 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a69a6dfd00 con 0x55a69a7f9de0 2024-09-12T12:35:20.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.906+0000 7f05317fa640 10 client.25856 handle_command_reply: tid=0 2024-09-12T12:35:20.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.906+0000 7f05522f5740 1 client.25856 shutdown 2024-09-12T12:35:20.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.907+0000 7f05522f5740 1 -- 172.21.15.33:0/2324678015 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a69a772d70 msgr2=0x55a69a782920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:20.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.907+0000 7f05522f5740 1 --2- 172.21.15.33:0/2324678015 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a69a772d70 0x55a69a782920 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f05380047b0 tx=0x7f0538015310 comp rx=0 tx=0).stop 2024-09-12T12:35:20.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.909+0000 7f05522f5740 1 -- 172.21.15.33:0/2324678015 shutdown_connections 2024-09-12T12:35:20.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.909+0000 7f05522f5740 1 --2- 172.21.15.33:0/2324678015 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55a69a7f9de0 0x55a69a7fc240 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:20.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.909+0000 7f05522f5740 1 --2- 172.21.15.33:0/2324678015 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a69a77df50 0x55a69a7f0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:20.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.909+0000 7f05522f5740 1 --2- 172.21.15.33:0/2324678015 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a69a773690 0x55a69a782e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:20.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.909+0000 7f05522f5740 1 --2- 172.21.15.33:0/2324678015 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a69a772d70 0x55a69a782920 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:20.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.909+0000 7f05317fa640 0 client.25856 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:35:20.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.909+0000 7f05522f5740 1 -- 172.21.15.33:0/2324678015 >> 172.21.15.33:0/2324678015 conn(0x55a69a76f300 msgr2=0x55a69a77c480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:35:20.916 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:35:20.916 INFO:teuthology.orchestra.run.smithi033.stdout: "return_code": 0, 2024-09-12T12:35:20.916 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_tag": "5c6303b4-6575-4ac1-87f5-891f88b7ed88", 2024-09-12T12:35:20.916 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": "asynchronous" 2024-09-12T12:35:20.916 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:35:20.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.911+0000 7f05522f5740 1 -- 172.21.15.33:0/2324678015 shutdown_connections 2024-09-12T12:35:20.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.911+0000 7f05522f5740 1 -- 172.21.15.33:0/2324678015 wait complete. 2024-09-12T12:35:20.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.911+0000 7f05522f5740 20 client.25856 trim_cache size 0 max 16384 2024-09-12T12:35:20.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.918+0000 7f054ecba640 1 -- 172.21.15.33:0/1751043218 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f05340a2d50 msgr2=0x7f05340a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:20.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.918+0000 7f054ecba640 1 --2- 172.21.15.33:0/1751043218 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f05340a2d50 0x7f05340a5210 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0538006fd0 tx=0x7f0538008040 comp rx=0 tx=0).stop 2024-09-12T12:35:20.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.918+0000 7f054ecba640 1 -- 172.21.15.33:0/1751043218 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05481068d0 msgr2=0x7f0548196620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:20.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.918+0000 7f054ecba640 1 --2- 172.21.15.33:0/1751043218 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05481068d0 0x7f0548196620 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0544009900 tx=0x7f0544003cd0 comp rx=0 tx=0).stop 2024-09-12T12:35:20.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.918+0000 7f054ecba640 1 -- 172.21.15.33:0/1751043218 shutdown_connections 2024-09-12T12:35:20.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.918+0000 7f054ecba640 1 --2- 172.21.15.33:0/1751043218 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f05340a2d50 0x7f05340a5210 secure :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0538006fd0 tx=0x7f0538008040 comp rx=0 tx=0).stop 2024-09-12T12:35:20.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.918+0000 7f054ecba640 1 --2- 172.21.15.33:0/1751043218 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0548196bb0 0x7f05481a20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:20.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.918+0000 7f054ecba640 1 --2- 172.21.15.33:0/1751043218 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05481068d0 0x7f0548196620 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:20.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.918+0000 7f054ecba640 1 --2- 172.21.15.33:0/1751043218 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0548101270 0x7f05481960e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:20.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.918+0000 7f054ecba640 1 -- 172.21.15.33:0/1751043218 >> 172.21.15.33:0/1751043218 conn(0x7f05480fc610 msgr2=0x7f054806a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:35:20.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.920+0000 7f054ecba640 1 -- 172.21.15.33:0/1751043218 shutdown_connections 2024-09-12T12:35:20.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:20.921+0000 7f054ecba640 1 -- 172.21.15.33:0/1751043218 wait complete. 2024-09-12T12:35:21.809 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T12:35:22.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:35:21 smithi102 ceph-mon[34799]: pgmap v630: 129 pgs: 129 active+clean; 10 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 MiB/s rd, 27 MiB/s wr, 569 op/s 2024-09-12T12:35:22.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:35:21 smithi102 ceph-mon[34799]: scrub queued for path: / 2024-09-12T12:35:22.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:35:21 smithi102 ceph-mon[34799]: scrub summary: idle+waiting paths [/] 2024-09-12T12:35:22.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:35:21 smithi102 ceph-mon[34799]: scrub summary: active paths [/] 2024-09-12T12:35:22.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:35:21 smithi102 ceph-mon[34799]: scrub summary: active paths [/] 2024-09-12T12:35:22.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:35:21 smithi102 ceph-mon[34799]: scrub summary: idle+waiting paths [/] 2024-09-12T12:35:22.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:35:21 smithi102 ceph-mon[34799]: scrub summary: idle+waiting paths [/] 2024-09-12T12:35:22.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:35:21 smithi033 ceph-mon[31246]: pgmap v630: 129 pgs: 129 active+clean; 10 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 MiB/s rd, 27 MiB/s wr, 569 op/s 2024-09-12T12:35:22.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:35:21 smithi033 ceph-mon[31246]: scrub queued for path: / 2024-09-12T12:35:22.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:35:21 smithi033 ceph-mon[31246]: scrub summary: idle+waiting paths [/] 2024-09-12T12:35:22.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:35:21 smithi033 ceph-mon[31246]: scrub summary: active paths [/] 2024-09-12T12:35:22.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:35:21 smithi033 ceph-mon[31246]: scrub summary: active paths [/] 2024-09-12T12:35:22.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:35:21 smithi033 ceph-mon[31246]: scrub summary: idle+waiting paths [/] 2024-09-12T12:35:22.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:35:21 smithi033 ceph-mon[31246]: scrub summary: idle+waiting paths [/] 2024-09-12T12:35:22.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:35:21 smithi043 ceph-mon[34144]: pgmap v630: 129 pgs: 129 active+clean; 10 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 MiB/s rd, 27 MiB/s wr, 569 op/s 2024-09-12T12:35:22.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:35:21 smithi043 ceph-mon[34144]: scrub queued for path: / 2024-09-12T12:35:22.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:35:21 smithi043 ceph-mon[34144]: scrub summary: idle+waiting paths [/] 2024-09-12T12:35:22.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:35:21 smithi043 ceph-mon[34144]: scrub summary: active paths [/] 2024-09-12T12:35:22.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:35:21 smithi043 ceph-mon[34144]: scrub summary: active paths [/] 2024-09-12T12:35:22.366 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:35:21 smithi043 ceph-mon[34144]: scrub summary: idle+waiting paths [/] 2024-09-12T12:35:22.366 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:35:21 smithi043 ceph-mon[34144]: scrub summary: idle+waiting paths [/] 2024-09-12T12:35:22.503 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:35:23.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:35:23 smithi033 ceph-mon[31246]: pgmap v631: 129 pgs: 129 active+clean; 10 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 31 MiB/s wr, 644 op/s 2024-09-12T12:35:24.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:35:23 smithi043 ceph-mon[34144]: pgmap v631: 129 pgs: 129 active+clean; 10 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 31 MiB/s wr, 644 op/s 2024-09-12T12:35:24.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:35:23 smithi102 ceph-mon[34799]: pgmap v631: 129 pgs: 129 active+clean; 10 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 31 MiB/s wr, 644 op/s 2024-09-12T12:35:24.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.441+0000 7fe0aa6a0640 1 -- 172.21.15.33:0/2096800084 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe09c0a6b80 msgr2=0x7fe09c0b2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:24.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.441+0000 7fe0aa6a0640 1 --2- 172.21.15.33:0/2096800084 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe09c0a6b80 0x7fe09c0b2350 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4067960 tx=0x7fe0a408e380 comp rx=0 tx=0).stop 2024-09-12T12:35:24.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.442+0000 7fe0aa6a0640 1 -- 172.21.15.33:0/2096800084 shutdown_connections 2024-09-12T12:35:24.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.442+0000 7fe0aa6a0640 1 --2- 172.21.15.33:0/2096800084 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe09c0a6b80 0x7fe09c0b2350 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:24.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.442+0000 7fe0aa6a0640 1 --2- 172.21.15.33:0/2096800084 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe09c0a61c0 0x7fe09c0a6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:24.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.442+0000 7fe0aa6a0640 1 --2- 172.21.15.33:0/2096800084 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe09c0ab690 0x7fe09c0aba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:24.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.442+0000 7fe0aa6a0640 1 -- 172.21.15.33:0/2096800084 >> 172.21.15.33:0/2096800084 conn(0x7fe09c01a510 msgr2=0x7fe09c01a920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:35:24.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.445+0000 7fe0aa6a0640 1 -- 172.21.15.33:0/2096800084 shutdown_connections 2024-09-12T12:35:24.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.446+0000 7fe0aa6a0640 1 -- 172.21.15.33:0/2096800084 wait complete. 2024-09-12T12:35:24.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.447+0000 7fe0aa6a0640 1 Processor -- start 2024-09-12T12:35:24.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.447+0000 7fe0aa6a0640 1 -- start start 2024-09-12T12:35:24.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.447+0000 7fe0aa6a0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe09c0a61c0 0x7fe09c0bab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:24.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.447+0000 7fe0aa6a0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe09c0a6b80 0x7fe09c0bb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:24.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.447+0000 7fe0aa6a0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe09c0ab690 0x7fe09c0b5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:24.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.447+0000 7fe0aa6a0640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe09c0b4610 con 0x7fe09c0a61c0 2024-09-12T12:35:24.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.447+0000 7fe0aa6a0640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe09c0b4490 con 0x7fe09c0ab690 2024-09-12T12:35:24.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.447+0000 7fe0aa6a0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe09c0b4790 con 0x7fe09c0a6b80 2024-09-12T12:35:24.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.447+0000 7fe0a8e9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe09c0a6b80 0x7fe09c0bb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:24.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.448+0000 7fe0a8e9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe09c0a6b80 0x7fe09c0bb060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:46046/0 (socket says 172.21.15.33:46046) 2024-09-12T12:35:24.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.448+0000 7fe0a8e9d640 1 -- 172.21.15.33:0/3206922186 learned_addr learned my addr 172.21.15.33:0/3206922186 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:35:24.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.449+0000 7fe0a969e640 1 --2- 172.21.15.33:0/3206922186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe09c0a61c0 0x7fe09c0bab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:24.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.449+0000 7fe0a8e9d640 1 -- 172.21.15.33:0/3206922186 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe09c0ab690 msgr2=0x7fe09c0b5c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T12:35:24.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.449+0000 7fe0a8e9d640 1 --2- 172.21.15.33:0/3206922186 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe09c0ab690 0x7fe09c0b5c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:24.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.449+0000 7fe0a8e9d640 1 -- 172.21.15.33:0/3206922186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe09c0a61c0 msgr2=0x7fe09c0bab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:24.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.449+0000 7fe0a8e9d640 1 --2- 172.21.15.33:0/3206922186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe09c0a61c0 0x7fe09c0bab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:24.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.449+0000 7fe0a8e9d640 1 -- 172.21.15.33:0/3206922186 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe09c0b6500 con 0x7fe09c0a6b80 2024-09-12T12:35:24.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.452+0000 7fe0a8e9d640 1 --2- 172.21.15.33:0/3206922186 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe09c0a6b80 0x7fe09c0bb060 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe0a000b450 tx=0x7fe0a000b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:35:24.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.456+0000 7fe09a7fc640 1 -- 172.21.15.33:0/3206922186 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a0015020 con 0x7fe09c0a6b80 2024-09-12T12:35:24.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.456+0000 7fe0aa6a0640 1 -- 172.21.15.33:0/3206922186 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe09c0b67f0 con 0x7fe09c0a6b80 2024-09-12T12:35:24.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.456+0000 7fe0aa6a0640 1 -- 172.21.15.33:0/3206922186 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe09c0c0a10 con 0x7fe09c0a6b80 2024-09-12T12:35:24.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.456+0000 7fe09a7fc640 1 -- 172.21.15.33:0/3206922186 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe0a0011d40 con 0x7fe09c0a6b80 2024-09-12T12:35:24.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.456+0000 7fe09a7fc640 1 -- 172.21.15.33:0/3206922186 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a000f340 con 0x7fe09c0a6b80 2024-09-12T12:35:24.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.461+0000 7fe0adcdb740 1 Processor -- start 2024-09-12T12:35:24.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.462+0000 7fe09a7fc640 1 -- 172.21.15.33:0/3206922186 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe0a0018020 con 0x7fe09c0a6b80 2024-09-12T12:35:24.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.462+0000 7fe0adcdb740 1 -- start start 2024-09-12T12:35:24.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.462+0000 7fe0adcdb740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bd6414670 0x559bd6414a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:24.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.462+0000 7fe0adcdb740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559bd6414f90 0x559bd641f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:24.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.462+0000 7fe0adcdb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559bd641f850 0x559bd6421c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:24.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.462+0000 7fe0adcdb740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x559bd637a2e0 con 0x559bd6414670 2024-09-12T12:35:24.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.462+0000 7fe0adcdb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559bd6321ce0 con 0x559bd641f850 2024-09-12T12:35:24.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.462+0000 7fe0adcdb740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x559bd63762a0 con 0x559bd6414f90 2024-09-12T12:35:24.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.464+0000 7fe09a7fc640 1 --2- 172.21.15.33:0/3206922186 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe0900a2d90 0x7fe0900a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:24.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.464+0000 7fe0a969e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559bd6414f90 0x559bd641f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:24.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.464+0000 7fe0a969e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559bd6414f90 0x559bd641f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:46052/0 (socket says 172.21.15.33:46052) 2024-09-12T12:35:24.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.464+0000 7fe0a969e640 1 -- 172.21.15.33:0/2461653241 learned_addr learned my addr 172.21.15.33:0/2461653241 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:35:24.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.464+0000 7fe09a7fc640 1 -- 172.21.15.33:0/3206922186 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fe0a00ced80 con 0x7fe09c0a6b80 2024-09-12T12:35:24.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.464+0000 7fe0a9e9f640 1 --2- 172.21.15.33:0/3206922186 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe0900a2d90 0x7fe0900a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:24.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.464+0000 7fe0a8e9d640 1 --2- 172.21.15.33:0/2461653241 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559bd641f850 0x559bd6421c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:24.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.465+0000 7fe0a9e9f640 1 --2- 172.21.15.33:0/2461653241 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bd6414670 0x559bd6414a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:24.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.466+0000 7fe0a969e640 1 -- 172.21.15.33:0/2461653241 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559bd641f850 msgr2=0x559bd6421c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:35:24.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.466+0000 7fe0a969e640 1 --2- 172.21.15.33:0/2461653241 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559bd641f850 0x559bd6421c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:24.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.466+0000 7fe0a969e640 1 -- 172.21.15.33:0/2461653241 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bd6414670 msgr2=0x559bd6414a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:35:24.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.466+0000 7fe0a969e640 1 --2- 172.21.15.33:0/2461653241 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bd6414670 0x559bd6414a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:24.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.466+0000 7fe0a969e640 1 -- 172.21.15.33:0/2461653241 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bd6306440 con 0x559bd6414f90 2024-09-12T12:35:24.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.469+0000 7fe0a969e640 1 --2- 172.21.15.33:0/2461653241 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559bd6414f90 0x559bd641f310 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe09400b820 tx=0x7fe09400bce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d195ed744ddca8a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:35:24.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.469+0000 7fe0a9e9f640 1 --2- 172.21.15.33:0/3206922186 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe0900a2d90 0x7fe0900a5250 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe0a408e970 tx=0x7fe0a4068410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:35:24.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.470+0000 7fe08f7fe640 1 -- 172.21.15.33:0/2461653241 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe09400d950 con 0x559bd6414f90 2024-09-12T12:35:24.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.470+0000 7fe08f7fe640 1 -- 172.21.15.33:0/2461653241 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe094019070 con 0x559bd6414f90 2024-09-12T12:35:24.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.470+0000 7fe08f7fe640 1 -- 172.21.15.33:0/2461653241 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0940123e0 con 0x559bd6414f90 2024-09-12T12:35:24.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.471+0000 7fe0adcdb740 1 -- 172.21.15.33:0/2461653241 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559bd6414f90 msgr2=0x559bd641f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:24.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.471+0000 7fe0adcdb740 1 --2- 172.21.15.33:0/2461653241 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559bd6414f90 0x559bd641f310 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe09400b820 tx=0x7fe09400bce0 comp rx=0 tx=0).stop 2024-09-12T12:35:24.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.471+0000 7fe0adcdb740 1 -- 172.21.15.33:0/2461653241 shutdown_connections 2024-09-12T12:35:24.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.471+0000 7fe0adcdb740 1 --2- 172.21.15.33:0/2461653241 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559bd641f850 0x559bd6421c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:24.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.471+0000 7fe0adcdb740 1 --2- 172.21.15.33:0/2461653241 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559bd6414f90 0x559bd641f310 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:24.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.471+0000 7fe0adcdb740 1 --2- 172.21.15.33:0/2461653241 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bd6414670 0x559bd6414a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:24.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.471+0000 7fe0adcdb740 1 -- 172.21.15.33:0/2461653241 >> 172.21.15.33:0/2461653241 conn(0x559bd6410c00 msgr2=0x559bd6410fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:35:24.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.473+0000 7fe0adcdb740 1 -- 172.21.15.33:0/2461653241 shutdown_connections 2024-09-12T12:35:24.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.474+0000 7fe0adcdb740 1 -- 172.21.15.33:0/2461653241 wait complete. 2024-09-12T12:35:24.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.475+0000 7fe0adcdb740 1 -- start start 2024-09-12T12:35:24.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.475+0000 7fe0adcdb740 1 Processor -- start 2024-09-12T12:35:24.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.476+0000 7fe0adcdb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559bd6414670 0x559bd641f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:24.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.476+0000 7fe0adcdb740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559bd6414f90 0x559bd641c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:24.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.476+0000 7fe0adcdb740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bd641f850 0x559bd641c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:24.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.476+0000 7fe0adcdb740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x559bd6422420 con 0x559bd641f850 2024-09-12T12:35:24.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.476+0000 7fe0adcdb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559bd6335050 con 0x559bd6414670 2024-09-12T12:35:24.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.476+0000 7fe0adcdb740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x559bd64225a0 con 0x559bd6414f90 2024-09-12T12:35:24.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.476+0000 7fe0adcdb740 10 client.0 _ll_register_callbacks cb 0x559bd6375160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:35:24.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.477+0000 7fe0a9e9f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bd641f850 0x559bd641c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:24.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.477+0000 7fe0a9e9f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bd641f850 0x559bd641c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47920/0 (socket says 172.21.15.33:47920) 2024-09-12T12:35:24.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.477+0000 7fe0a9e9f640 1 -- 172.21.15.33:0/2166844344 learned_addr learned my addr 172.21.15.33:0/2166844344 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:35:24.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.477+0000 7fe0a969e640 1 --2- 172.21.15.33:0/2166844344 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559bd6414670 0x559bd641f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:24.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.478+0000 7fe0a9e9f640 1 -- 172.21.15.33:0/2166844344 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559bd6414f90 msgr2=0x559bd641c420 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:35:24.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.478+0000 7fe0a9e9f640 1 --2- 172.21.15.33:0/2166844344 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559bd6414f90 0x559bd641c420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:24.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.478+0000 7fe0a9e9f640 1 -- 172.21.15.33:0/2166844344 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559bd6414670 msgr2=0x559bd641f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:35:24.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.478+0000 7fe0a9e9f640 1 --2- 172.21.15.33:0/2166844344 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559bd6414670 0x559bd641f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:24.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.478+0000 7fe0a9e9f640 1 -- 172.21.15.33:0/2166844344 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bd60eb3c0 con 0x559bd641f850 2024-09-12T12:35:24.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.478+0000 7fe0a9e9f640 1 --2- 172.21.15.33:0/2166844344 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bd641f850 0x559bd641c960 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4067ce0 tx=0x7fe0a4050650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ec85eb4ae62c305 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:35:24.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.478+0000 7fe08cff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:35:24.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.479+0000 7fe08cff9640 1 -- 172.21.15.33:0/2166844344 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a4096d70 con 0x559bd641f850 2024-09-12T12:35:24.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.479+0000 7fe08cff9640 1 -- 172.21.15.33:0/2166844344 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fe0a40a6460 con 0x559bd641f850 2024-09-12T12:35:24.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.479+0000 7fe0adcdb740 1 -- 172.21.15.33:0/2166844344 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe094019070 con 0x559bd641f850 2024-09-12T12:35:24.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.486+0000 7fe08cff9640 1 -- 172.21.15.33:0/2166844344 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe0a406eef0 con 0x559bd641f850 2024-09-12T12:35:24.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.486+0000 7fe0adcdb740 10 client.16158 fetch_fsmap learned FSMap version 27 2024-09-12T12:35:24.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.486+0000 7fe0adcdb740 1 -- 172.21.15.33:0/2166844344 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559bd642de30 con 0x559bd641f850 2024-09-12T12:35:24.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.488+0000 7fe08cff9640 1 -- 172.21.15.33:0/2166844344 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe094019070 con 0x559bd641f850 2024-09-12T12:35:24.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.488+0000 7fe08cff9640 1 -- 172.21.15.33:0/2166844344 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fe0a40ad030 con 0x559bd641f850 2024-09-12T12:35:24.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.488+0000 7fe0adcdb740 10 client.16158 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:35:24.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.488+0000 7fe0adcdb740 10 client.16158 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:35:24.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.488+0000 7fe0adcdb740 20 client.16158 populate_metadata read hostname 'smithi033' 2024-09-12T12:35:24.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.488+0000 7fe0adcdb740 1 --2- 172.21.15.33:0/2166844344 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x559bd642f750 0x559bd6431c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:24.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.488+0000 7fe0adcdb740 4 client.16158 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:35:24.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.488+0000 7fe0adcdb740 1 -- 172.21.15.33:0/2166844344 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559bd6387850 con 0x559bd642f750 2024-09-12T12:35:24.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.489+0000 7fe0a969e640 1 --2- 172.21.15.33:0/2166844344 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x559bd642f750 0x559bd6431c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:24.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.498+0000 7fe08cff9640 10 client.16158 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:35:24.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.498+0000 7fe0a969e640 1 --2- 172.21.15.33:0/2166844344 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x559bd642f750 0x559bd6431c10 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c675645e704ebae0 server_cookie=7a11bff75e5ee980 in_seq=0 out_seq=0 2024-09-12T12:35:24.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.499+0000 7fe08cff9640 1 -- 172.21.15.33:0/2166844344 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559bd6387850 con 0x559bd642f750 2024-09-12T12:35:24.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.499+0000 7fe08cff9640 10 client.16158 handle_command_reply: tid=0 2024-09-12T12:35:24.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.499+0000 7fe0adcdb740 1 client.16158 shutdown 2024-09-12T12:35:24.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.499+0000 7fe0adcdb740 1 -- 172.21.15.33:0/2166844344 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bd641f850 msgr2=0x559bd641c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:24.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.499+0000 7fe0adcdb740 1 --2- 172.21.15.33:0/2166844344 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bd641f850 0x559bd641c960 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4067ce0 tx=0x7fe0a4050650 comp rx=0 tx=0).stop 2024-09-12T12:35:24.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.499+0000 7fe0adcdb740 1 -- 172.21.15.33:0/2166844344 shutdown_connections 2024-09-12T12:35:24.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.499+0000 7fe0adcdb740 1 --2- 172.21.15.33:0/2166844344 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x559bd642f750 0x559bd6431c10 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:24.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.499+0000 7fe0adcdb740 1 --2- 172.21.15.33:0/2166844344 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bd641f850 0x559bd641c960 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:24.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.499+0000 7fe0adcdb740 1 --2- 172.21.15.33:0/2166844344 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559bd6414f90 0x559bd641c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:24.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.499+0000 7fe0adcdb740 1 --2- 172.21.15.33:0/2166844344 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559bd6414670 0x559bd641f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:24.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.499+0000 7fe0adcdb740 1 -- 172.21.15.33:0/2166844344 >> 172.21.15.33:0/2166844344 conn(0x559bd6410c00 msgr2=0x559bd6416930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:35:24.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.499+0000 7fe08cff9640 0 client.16158 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:35:24.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.500+0000 7fe0adcdb740 1 -- 172.21.15.33:0/2166844344 shutdown_connections 2024-09-12T12:35:24.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.500+0000 7fe0adcdb740 1 -- 172.21.15.33:0/2166844344 wait complete. 2024-09-12T12:35:24.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.500+0000 7fe0adcdb740 20 client.16158 trim_cache size 0 max 16384 2024-09-12T12:35:24.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.534+0000 7fe0adcdb740 1 Processor -- start 2024-09-12T12:35:24.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.534+0000 7fe0adcdb740 1 -- start start 2024-09-12T12:35:24.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.534+0000 7fe0adcdb740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bd6414670 0x559bd642b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:24.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.534+0000 7fe0adcdb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559bd6414f90 0x559bd64179c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:24.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.534+0000 7fe0adcdb740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559bd641f850 0x559bd6437520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:24.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.534+0000 7fe0adcdb740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe088012580 con 0x559bd6414670 2024-09-12T12:35:24.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.534+0000 7fe0adcdb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe08800fe50 con 0x559bd6414f90 2024-09-12T12:35:24.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.534+0000 7fe0adcdb740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe08800dca0 con 0x559bd641f850 2024-09-12T12:35:24.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.535+0000 7fe0a9e9f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559bd641f850 0x559bd6437520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:24.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.535+0000 7fe0a9e9f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559bd641f850 0x559bd6437520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:46076/0 (socket says 172.21.15.33:46076) 2024-09-12T12:35:24.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.535+0000 7fe0a9e9f640 1 -- 172.21.15.33:0/297538566 learned_addr learned my addr 172.21.15.33:0/297538566 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:35:24.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.536+0000 7fe0a969e640 1 --2- 172.21.15.33:0/297538566 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bd6414670 0x559bd642b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:24.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.536+0000 7fe0a8e9d640 1 --2- 172.21.15.33:0/297538566 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559bd6414f90 0x559bd64179c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:24.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.536+0000 7fe0a9e9f640 1 -- 172.21.15.33:0/297538566 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559bd6414f90 msgr2=0x559bd64179c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:35:24.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.536+0000 7fe0a9e9f640 1 --2- 172.21.15.33:0/297538566 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559bd6414f90 0x559bd64179c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:24.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.536+0000 7fe0a9e9f640 1 -- 172.21.15.33:0/297538566 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bd6414670 msgr2=0x559bd642b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:35:24.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.536+0000 7fe0a9e9f640 1 --2- 172.21.15.33:0/297538566 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bd6414670 0x559bd642b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:24.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.536+0000 7fe0a9e9f640 1 -- 172.21.15.33:0/297538566 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bd641a970 con 0x559bd641f850 2024-09-12T12:35:24.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.536+0000 7fe0a9e9f640 1 --2- 172.21.15.33:0/297538566 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559bd641f850 0x559bd6437520 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4051790 tx=0x7fe0a406f450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5060f9a8dbfecbf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:35:24.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.540+0000 7fe08effd640 1 -- 172.21.15.33:0/297538566 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a406ed10 con 0x559bd641f850 2024-09-12T12:35:24.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.540+0000 7fe08effd640 1 -- 172.21.15.33:0/297538566 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe0a4092070 con 0x559bd641f850 2024-09-12T12:35:24.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.541+0000 7fe0adcdb740 1 -- 172.21.15.33:0/297538566 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559bd641f850 msgr2=0x559bd6437520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:24.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.541+0000 7fe0adcdb740 1 --2- 172.21.15.33:0/297538566 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559bd641f850 0x559bd6437520 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4051790 tx=0x7fe0a406f450 comp rx=0 tx=0).stop 2024-09-12T12:35:24.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.548+0000 7fe0adcdb740 1 -- 172.21.15.33:0/297538566 shutdown_connections 2024-09-12T12:35:24.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.548+0000 7fe0adcdb740 1 --2- 172.21.15.33:0/297538566 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559bd641f850 0x559bd6437520 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:24.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.548+0000 7fe0adcdb740 1 --2- 172.21.15.33:0/297538566 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559bd6414f90 0x559bd64179c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:24.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.548+0000 7fe0adcdb740 1 --2- 172.21.15.33:0/297538566 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bd6414670 0x559bd642b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:24.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.548+0000 7fe0adcdb740 1 -- 172.21.15.33:0/297538566 >> 172.21.15.33:0/297538566 conn(0x559bd6410c00 msgr2=0x559bd64172b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:35:24.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.551+0000 7fe0adcdb740 1 -- 172.21.15.33:0/297538566 shutdown_connections 2024-09-12T12:35:24.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.551+0000 7fe0adcdb740 1 -- 172.21.15.33:0/297538566 wait complete. 2024-09-12T12:35:24.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.551+0000 7fe0adcdb740 1 -- start start 2024-09-12T12:35:24.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.552+0000 7fe0adcdb740 1 Processor -- start 2024-09-12T12:35:24.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.552+0000 7fe0adcdb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559bd6414670 0x559bd6422fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:24.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.552+0000 7fe0adcdb740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bd6414f90 0x559bd64234e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:24.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.552+0000 7fe0adcdb740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559bd641f850 0x559bd64924b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:24.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.553+0000 7fe0adcdb740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe08800e310 con 0x559bd6414f90 2024-09-12T12:35:24.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.553+0000 7fe0adcdb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe08800f780 con 0x559bd6414670 2024-09-12T12:35:24.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.553+0000 7fe0adcdb740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe08800e9e0 con 0x559bd641f850 2024-09-12T12:35:24.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.553+0000 7fe0a8e9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bd6414f90 0x559bd64234e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:24.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.553+0000 7fe0adcdb740 10 client.0 _ll_register_callbacks cb 0x7fe0a4067b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:35:24.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.553+0000 7fe0a8e9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bd6414f90 0x559bd64234e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47940/0 (socket says 172.21.15.33:47940) 2024-09-12T12:35:24.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.554+0000 7fe0a8e9d640 1 -- 172.21.15.33:0/3434758230 learned_addr learned my addr 172.21.15.33:0/3434758230 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:35:24.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.554+0000 7fe0a9e9f640 1 --2- 172.21.15.33:0/3434758230 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559bd641f850 0x559bd64924b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:24.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.554+0000 7fe0a8e9d640 1 -- 172.21.15.33:0/3434758230 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559bd641f850 msgr2=0x559bd64924b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:35:24.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.554+0000 7fe0a8e9d640 1 --2- 172.21.15.33:0/3434758230 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559bd641f850 0x559bd64924b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:24.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.554+0000 7fe0a8e9d640 1 -- 172.21.15.33:0/3434758230 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559bd6414670 msgr2=0x559bd6422fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:35:24.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.554+0000 7fe0a8e9d640 1 --2- 172.21.15.33:0/3434758230 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559bd6414670 0x559bd6422fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:24.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.554+0000 7fe0a8e9d640 1 -- 172.21.15.33:0/3434758230 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bd6492af0 con 0x559bd6414f90 2024-09-12T12:35:24.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.555+0000 7fe0a8e9d640 1 --2- 172.21.15.33:0/3434758230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bd6414f90 0x559bd64234e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fe0a0097bc0 tx=0x7fe0a009ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c14000cd9cf0936 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:35:24.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.555+0000 7fe08cff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:35:24.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.555+0000 7fe08cff9640 1 -- 172.21.15.33:0/3434758230 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a00b4060 con 0x559bd6414f90 2024-09-12T12:35:24.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.555+0000 7fe08cff9640 1 -- 172.21.15.33:0/3434758230 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fe0a009f170 con 0x559bd6414f90 2024-09-12T12:35:24.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.556+0000 7fe0adcdb740 1 -- 172.21.15.33:0/3434758230 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0a4092070 con 0x559bd6414f90 2024-09-12T12:35:24.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.556+0000 7fe08cff9640 1 -- 172.21.15.33:0/3434758230 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe0a00b9050 con 0x559bd6414f90 2024-09-12T12:35:24.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.556+0000 7fe0adcdb740 10 client.16164 fetch_fsmap learned FSMap version 27 2024-09-12T12:35:24.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.556+0000 7fe0adcdb740 1 -- 172.21.15.33:0/3434758230 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559bd6499f10 con 0x559bd6414f90 2024-09-12T12:35:24.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.556+0000 7fe08cff9640 1 -- 172.21.15.33:0/3434758230 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe0a4092070 con 0x559bd6414f90 2024-09-12T12:35:24.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.557+0000 7fe08cff9640 1 -- 172.21.15.33:0/3434758230 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fe0a009b450 con 0x559bd6414f90 2024-09-12T12:35:24.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.557+0000 7fe0adcdb740 10 client.16164 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:35:24.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.557+0000 7fe0adcdb740 10 client.16164 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:35:24.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.557+0000 7fe0adcdb740 20 client.16164 populate_metadata read hostname 'smithi033' 2024-09-12T12:35:24.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.557+0000 7fe0adcdb740 1 --2- 172.21.15.33:0/3434758230 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x559bd649a6c0 0x559bd649cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:24.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.557+0000 7fe0adcdb740 4 client.16164 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:35:24.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.557+0000 7fe0adcdb740 1 -- 172.21.15.33:0/3434758230 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559bd6381d60 con 0x559bd649a6c0 2024-09-12T12:35:24.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.557+0000 7fe0a969e640 1 --2- 172.21.15.33:0/3434758230 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x559bd649a6c0 0x559bd649cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:24.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.558+0000 7fe08cff9640 10 client.16164 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:35:24.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.558+0000 7fe0a969e640 1 --2- 172.21.15.33:0/3434758230 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x559bd649a6c0 0x559bd649cae0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c20a4570d883fb8b server_cookie=bdfa2d17ef6720ff in_seq=0 out_seq=0 2024-09-12T12:35:24.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.558+0000 7fe08cff9640 1 -- 172.21.15.33:0/3434758230 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x559bd6381d60 con 0x559bd649a6c0 2024-09-12T12:35:24.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.558+0000 7fe08cff9640 10 client.16164 handle_command_reply: tid=0 2024-09-12T12:35:24.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.558+0000 7fe0adcdb740 1 client.16164 shutdown 2024-09-12T12:35:24.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.561+0000 7fe0adcdb740 1 -- 172.21.15.33:0/3434758230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bd6414f90 msgr2=0x559bd64234e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:24.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.561+0000 7fe0adcdb740 1 --2- 172.21.15.33:0/3434758230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bd6414f90 0x559bd64234e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fe0a0097bc0 tx=0x7fe0a009ac10 comp rx=0 tx=0).stop 2024-09-12T12:35:24.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.563+0000 7fe0adcdb740 1 -- 172.21.15.33:0/3434758230 shutdown_connections 2024-09-12T12:35:24.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.563+0000 7fe0adcdb740 1 --2- 172.21.15.33:0/3434758230 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x559bd649a6c0 0x559bd649cae0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:24.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.563+0000 7fe08cff9640 0 client.16164 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:35:24.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.563+0000 7fe0adcdb740 1 --2- 172.21.15.33:0/3434758230 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559bd641f850 0x559bd64924b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:24.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.563+0000 7fe0adcdb740 1 --2- 172.21.15.33:0/3434758230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bd6414f90 0x559bd64234e0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:24.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.563+0000 7fe0adcdb740 1 --2- 172.21.15.33:0/3434758230 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559bd6414670 0x559bd6422fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:24.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.563+0000 7fe0adcdb740 1 -- 172.21.15.33:0/3434758230 >> 172.21.15.33:0/3434758230 conn(0x559bd6410c00 msgr2=0x559bd6417ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:35:24.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.567+0000 7fe0adcdb740 1 -- 172.21.15.33:0/3434758230 shutdown_connections 2024-09-12T12:35:24.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.568+0000 7fe0adcdb740 1 -- 172.21.15.33:0/3434758230 wait complete. 2024-09-12T12:35:24.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.572+0000 7fe0adcdb740 20 client.16164 trim_cache size 0 max 16384 2024-09-12T12:35:24.577 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:35:24.577 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T12:35:24.577 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": { 2024-09-12T12:35:24.577 INFO:teuthology.orchestra.run.smithi033.stdout: "5c6303b4-6575-4ac1-87f5-891f88b7ed88": { 2024-09-12T12:35:24.577 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-09-12T12:35:24.578 INFO:teuthology.orchestra.run.smithi033.stdout: "tag": "5c6303b4-6575-4ac1-87f5-891f88b7ed88", 2024-09-12T12:35:24.578 INFO:teuthology.orchestra.run.smithi033.stdout: "options": "recursive,force" 2024-09-12T12:35:24.578 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:35:24.578 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:35:24.578 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:35:24.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.576+0000 7fe0aa6a0640 1 -- 172.21.15.33:0/3206922186 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe0900a2d90 msgr2=0x7fe0900a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:24.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.576+0000 7fe0aa6a0640 1 --2- 172.21.15.33:0/3206922186 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe0900a2d90 0x7fe0900a5250 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe0a408e970 tx=0x7fe0a4068410 comp rx=0 tx=0).stop 2024-09-12T12:35:24.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.576+0000 7fe0aa6a0640 1 -- 172.21.15.33:0/3206922186 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe09c0a6b80 msgr2=0x7fe09c0bb060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:24.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.576+0000 7fe0aa6a0640 1 --2- 172.21.15.33:0/3206922186 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe09c0a6b80 0x7fe09c0bb060 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe0a000b450 tx=0x7fe0a000b910 comp rx=0 tx=0).stop 2024-09-12T12:35:24.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.576+0000 7fe0aa6a0640 1 -- 172.21.15.33:0/3206922186 shutdown_connections 2024-09-12T12:35:24.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.576+0000 7fe0aa6a0640 1 --2- 172.21.15.33:0/3206922186 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe0900a2d90 0x7fe0900a5250 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:24.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.576+0000 7fe0aa6a0640 1 --2- 172.21.15.33:0/3206922186 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe09c0ab690 0x7fe09c0b5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:24.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.576+0000 7fe0aa6a0640 1 --2- 172.21.15.33:0/3206922186 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe09c0a6b80 0x7fe09c0bb060 secure :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe0a000b450 tx=0x7fe0a000b910 comp rx=0 tx=0).stop 2024-09-12T12:35:24.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.576+0000 7fe0aa6a0640 1 --2- 172.21.15.33:0/3206922186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe09c0a61c0 0x7fe09c0bab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:24.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.577+0000 7fe0aa6a0640 1 -- 172.21.15.33:0/3206922186 >> 172.21.15.33:0/3206922186 conn(0x7fe09c01a510 msgr2=0x7fe09c0a37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:35:24.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.579+0000 7fe0aa6a0640 1 -- 172.21.15.33:0/3206922186 shutdown_connections 2024-09-12T12:35:24.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:24.582+0000 7fe0aa6a0640 1 -- 172.21.15.33:0/3206922186 wait complete. 2024-09-12T12:35:25.401 INFO:tasks.cephfs.filesystem:scrub status for tag:5c6303b4-6575-4ac1-87f5-891f88b7ed88 - {'path': '/', 'tag': '5c6303b4-6575-4ac1-87f5-891f88b7ed88', 'options': 'recursive,force'} 2024-09-12T12:35:26.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:35:25 smithi033 ceph-mon[31246]: pgmap v632: 129 pgs: 129 active+clean; 10 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 33 MiB/s wr, 702 op/s 2024-09-12T12:35:26.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:35:25 smithi043 ceph-mon[34144]: pgmap v632: 129 pgs: 129 active+clean; 10 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 33 MiB/s wr, 702 op/s 2024-09-12T12:35:26.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:35:25 smithi102 ceph-mon[34799]: pgmap v632: 129 pgs: 129 active+clean; 10 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 33 MiB/s wr, 702 op/s 2024-09-12T12:35:28.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:35:27 smithi033 ceph-mon[31246]: pgmap v633: 129 pgs: 129 active+clean; 10 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 27 MiB/s wr, 570 op/s 2024-09-12T12:35:28.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:35:27 smithi033 ceph-mon[31246]: scrub summary: idle 2024-09-12T12:35:28.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:35:27 smithi043 ceph-mon[34144]: pgmap v633: 129 pgs: 129 active+clean; 10 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 27 MiB/s wr, 570 op/s 2024-09-12T12:35:28.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:35:27 smithi043 ceph-mon[34144]: scrub summary: idle 2024-09-12T12:35:28.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:35:27 smithi102 ceph-mon[34799]: pgmap v633: 129 pgs: 129 active+clean; 10 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 27 MiB/s wr, 570 op/s 2024-09-12T12:35:28.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:35:27 smithi102 ceph-mon[34799]: scrub summary: idle 2024-09-12T12:35:29.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:35:28 smithi033 ceph-mon[31246]: scrub summary: idle 2024-09-12T12:35:29.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:35:28 smithi043 ceph-mon[34144]: scrub summary: idle 2024-09-12T12:35:29.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:35:28 smithi102 ceph-mon[34799]: scrub summary: idle 2024-09-12T12:35:30.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:35:29 smithi033 ceph-mon[31246]: pgmap v634: 129 pgs: 129 active+clean; 10 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 35 MiB/s wr, 749 op/s 2024-09-12T12:35:30.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:35:29 smithi043 ceph-mon[34144]: pgmap v634: 129 pgs: 129 active+clean; 10 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 35 MiB/s wr, 749 op/s 2024-09-12T12:35:30.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:35:29 smithi102 ceph-mon[34799]: pgmap v634: 129 pgs: 129 active+clean; 10 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 35 MiB/s wr, 749 op/s 2024-09-12T12:35:32.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:35:31 smithi033 ceph-mon[31246]: pgmap v635: 129 pgs: 129 active+clean; 10 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 27 MiB/s wr, 565 op/s 2024-09-12T12:35:32.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:35:31 smithi043 ceph-mon[34144]: pgmap v635: 129 pgs: 129 active+clean; 10 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 27 MiB/s wr, 565 op/s 2024-09-12T12:35:32.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:35:31 smithi102 ceph-mon[34799]: pgmap v635: 129 pgs: 129 active+clean; 10 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 27 MiB/s wr, 565 op/s 2024-09-12T12:35:33.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:35:32 smithi043 ceph-mon[34144]: pgmap v636: 129 pgs: 129 active+clean; 10 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 31 MiB/s wr, 654 op/s 2024-09-12T12:35:33.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:35:32 smithi102 ceph-mon[34799]: pgmap v636: 129 pgs: 129 active+clean; 10 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 31 MiB/s wr, 654 op/s 2024-09-12T12:35:33.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:35:32 smithi033 ceph-mon[31246]: pgmap v636: 129 pgs: 129 active+clean; 10 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 31 MiB/s wr, 654 op/s 2024-09-12T12:35:35.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:35:35 smithi043 ceph-mon[34144]: pgmap v637: 129 pgs: 129 active+clean; 10 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 34 MiB/s wr, 718 op/s 2024-09-12T12:35:35.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:35:35 smithi102 ceph-mon[34799]: pgmap v637: 129 pgs: 129 active+clean; 10 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 34 MiB/s wr, 718 op/s 2024-09-12T12:35:35.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:35:35 smithi033 ceph-mon[31246]: pgmap v637: 129 pgs: 129 active+clean; 10 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 34 MiB/s wr, 718 op/s 2024-09-12T12:35:37.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:35:37 smithi043 ceph-mon[34144]: pgmap v638: 129 pgs: 129 active+clean; 10 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 28 MiB/s wr, 593 op/s 2024-09-12T12:35:37.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:35:37 smithi102 ceph-mon[34799]: pgmap v638: 129 pgs: 129 active+clean; 10 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 28 MiB/s wr, 593 op/s 2024-09-12T12:35:37.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:35:37 smithi033 ceph-mon[31246]: pgmap v638: 129 pgs: 129 active+clean; 10 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 28 MiB/s wr, 593 op/s 2024-09-12T12:35:39.533 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:35:39 smithi033 ceph-mon[31246]: pgmap v639: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 37 MiB/s wr, 779 op/s 2024-09-12T12:35:39.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:35:39 smithi043 ceph-mon[34144]: pgmap v639: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 37 MiB/s wr, 779 op/s 2024-09-12T12:35:39.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:35:39 smithi102 ceph-mon[34799]: pgmap v639: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 37 MiB/s wr, 779 op/s 2024-09-12T12:35:41.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:35:41 smithi033 ceph-mon[31246]: pgmap v640: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 28 MiB/s wr, 590 op/s 2024-09-12T12:35:41.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:35:41 smithi043 ceph-mon[34144]: pgmap v640: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 28 MiB/s wr, 590 op/s 2024-09-12T12:35:41.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:35:41 smithi102 ceph-mon[34799]: pgmap v640: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 28 MiB/s wr, 590 op/s 2024-09-12T12:35:43.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:35:43 smithi043 ceph-mon[34144]: pgmap v641: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 32 MiB/s wr, 665 op/s 2024-09-12T12:35:43.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:35:43 smithi102 ceph-mon[34799]: pgmap v641: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 32 MiB/s wr, 665 op/s 2024-09-12T12:35:43.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:35:43 smithi033 ceph-mon[31246]: pgmap v641: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 32 MiB/s wr, 665 op/s 2024-09-12T12:35:45.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:35:45 smithi043 ceph-mon[34144]: pgmap v642: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 34 MiB/s wr, 714 op/s 2024-09-12T12:35:45.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:35:45 smithi102 ceph-mon[34799]: pgmap v642: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 34 MiB/s wr, 714 op/s 2024-09-12T12:35:45.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:35:45 smithi033 ceph-mon[31246]: pgmap v642: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 34 MiB/s wr, 714 op/s 2024-09-12T12:35:47.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:35:47 smithi043 ceph-mon[34144]: pgmap v643: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 28 MiB/s wr, 584 op/s 2024-09-12T12:35:47.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:35:47 smithi102 ceph-mon[34799]: pgmap v643: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 28 MiB/s wr, 584 op/s 2024-09-12T12:35:47.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:35:47 smithi033 ceph-mon[31246]: pgmap v643: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 28 MiB/s wr, 584 op/s 2024-09-12T12:35:49.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:35:49 smithi043 ceph-mon[34144]: pgmap v644: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 37 MiB/s wr, 756 op/s 2024-09-12T12:35:49.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:35:49 smithi102 ceph-mon[34799]: pgmap v644: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 37 MiB/s wr, 756 op/s 2024-09-12T12:35:49.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:35:49 smithi033 ceph-mon[31246]: pgmap v644: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 37 MiB/s wr, 756 op/s 2024-09-12T12:35:51.612 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:35:51 smithi033 ceph-mon[31246]: pgmap v645: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 28 MiB/s wr, 567 op/s 2024-09-12T12:35:51.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:35:51 smithi043 ceph-mon[34144]: pgmap v645: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 28 MiB/s wr, 567 op/s 2024-09-12T12:35:51.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:35:51 smithi102 ceph-mon[34799]: pgmap v645: 129 pgs: 129 active+clean; 10 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 28 MiB/s wr, 567 op/s 2024-09-12T12:35:53.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:35:53 smithi043 ceph-mon[34144]: pgmap v646: 129 pgs: 129 active+clean; 10 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 33 MiB/s wr, 670 op/s 2024-09-12T12:35:53.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:35:53 smithi102 ceph-mon[34799]: pgmap v646: 129 pgs: 129 active+clean; 10 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 33 MiB/s wr, 670 op/s 2024-09-12T12:35:53.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:35:53 smithi033 ceph-mon[31246]: pgmap v646: 129 pgs: 129 active+clean; 10 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 33 MiB/s wr, 670 op/s 2024-09-12T12:35:55.403 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T12:35:55.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:35:55 smithi043 ceph-mon[34144]: pgmap v647: 129 pgs: 129 active+clean; 10 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 35 MiB/s wr, 700 op/s 2024-09-12T12:35:55.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:35:55 smithi102 ceph-mon[34799]: pgmap v647: 129 pgs: 129 active+clean; 10 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 35 MiB/s wr, 700 op/s 2024-09-12T12:35:55.735 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:35:55 smithi033 ceph-mon[31246]: pgmap v647: 129 pgs: 129 active+clean; 10 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 35 MiB/s wr, 700 op/s 2024-09-12T12:35:56.085 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:35:56.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:56.968+0000 7ffa88198640 1 -- 172.21.15.33:0/877822315 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa800ffe60 msgr2=0x7ffa80100240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:56.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:56.968+0000 7ffa88198640 1 --2- 172.21.15.33:0/877822315 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa800ffe60 0x7ffa80100240 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ffa78009cd0 tx=0x7ffa7802a9c0 comp rx=0 tx=0).stop 2024-09-12T12:35:56.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:56.973+0000 7ffa88198640 1 -- 172.21.15.33:0/877822315 shutdown_connections 2024-09-12T12:35:56.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:56.973+0000 7ffa88198640 1 --2- 172.21.15.33:0/877822315 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa8010a2f0 0x7ffa80110c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:56.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:56.973+0000 7ffa88198640 1 --2- 172.21.15.33:0/877822315 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa80100780 0x7ffa80109be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:56.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:56.973+0000 7ffa88198640 1 --2- 172.21.15.33:0/877822315 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa800ffe60 0x7ffa80100240 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:56.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:56.973+0000 7ffa88198640 1 -- 172.21.15.33:0/877822315 >> 172.21.15.33:0/877822315 conn(0x7ffa800fba90 msgr2=0x7ffa800fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:35:56.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:56.978+0000 7ffa88198640 1 -- 172.21.15.33:0/877822315 shutdown_connections 2024-09-12T12:35:56.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:56.981+0000 7ffa88198640 1 -- 172.21.15.33:0/877822315 wait complete. 2024-09-12T12:35:56.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:56.982+0000 7ffa88198640 1 Processor -- start 2024-09-12T12:35:56.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:56.983+0000 7ffa88198640 1 -- start start 2024-09-12T12:35:56.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:56.983+0000 7ffa88198640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa800ffe60 0x7ffa80103880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:56.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:56.983+0000 7ffa88198640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa80100780 0x7ffa80103dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:56.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:56.983+0000 7ffa88198640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa8010a2f0 0x7ffa80104300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:56.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:56.983+0000 7ffa88198640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ffa801140b0 con 0x7ffa80100780 2024-09-12T12:35:56.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:56.983+0000 7ffa88198640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ffa80113f30 con 0x7ffa8010a2f0 2024-09-12T12:35:56.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:56.983+0000 7ffa88198640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ffa80114230 con 0x7ffa800ffe60 2024-09-12T12:35:56.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:56.984+0000 7ffa85f34640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa800ffe60 0x7ffa80103880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:56.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:56.984+0000 7ffa85f34640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa800ffe60 0x7ffa80103880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:41542/0 (socket says 172.21.15.33:41542) 2024-09-12T12:35:56.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:56.984+0000 7ffa85f34640 1 -- 172.21.15.33:0/802369951 learned_addr learned my addr 172.21.15.33:0/802369951 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:35:56.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:56.984+0000 7ffa85f34640 1 -- 172.21.15.33:0/802369951 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa8010a2f0 msgr2=0x7ffa80104300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:56.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:56.984+0000 7ffa85f34640 1 --2- 172.21.15.33:0/802369951 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa8010a2f0 0x7ffa80104300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:56.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:56.984+0000 7ffa85f34640 1 -- 172.21.15.33:0/802369951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa80100780 msgr2=0x7ffa80103dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:56.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:56.984+0000 7ffa85f34640 1 --2- 172.21.15.33:0/802369951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa80100780 0x7ffa80103dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:56.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:56.984+0000 7ffa85f34640 1 -- 172.21.15.33:0/802369951 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa801aace0 con 0x7ffa800ffe60 2024-09-12T12:35:56.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:56.985+0000 7ffa85f34640 1 --2- 172.21.15.33:0/802369951 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa800ffe60 0x7ffa80103880 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ffa7802af30 tx=0x7ffa78003f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:35:56.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:56.989+0000 7ffa76ffd640 1 -- 172.21.15.33:0/802369951 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa78034050 con 0x7ffa800ffe60 2024-09-12T12:35:56.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:56.989+0000 7ffa76ffd640 1 -- 172.21.15.33:0/802369951 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffa7802f880 con 0x7ffa800ffe60 2024-09-12T12:35:56.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:56.990+0000 7ffa76ffd640 1 -- 172.21.15.33:0/802369951 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa78039420 con 0x7ffa800ffe60 2024-09-12T12:35:56.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:56.992+0000 7ffa88198640 1 -- 172.21.15.33:0/802369951 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa801aaf70 con 0x7ffa800ffe60 2024-09-12T12:35:56.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:56.992+0000 7ffa88198640 1 -- 172.21.15.33:0/802369951 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa801ab310 con 0x7ffa800ffe60 2024-09-12T12:35:56.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:56.996+0000 7ffa8a571740 1 Processor -- start 2024-09-12T12:35:56.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:56.996+0000 7ffa8a571740 1 -- start start 2024-09-12T12:35:56.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:56.997+0000 7ffa8a571740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5654623ad4a0 0x5654623ad880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:56.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:56.997+0000 7ffa8a571740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654623addc0 0x5654623b8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:56.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:56.997+0000 7ffa8a571740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654623b8680 0x5654623baa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:56.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:56.997+0000 7ffa8a571740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5654623132e0 con 0x5654623addc0 2024-09-12T12:35:56.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:56.997+0000 7ffa8a571740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5654622bace0 con 0x5654623b8680 2024-09-12T12:35:56.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:56.997+0000 7ffa8a571740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56546230f2a0 con 0x5654623ad4a0 2024-09-12T12:35:56.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:56.997+0000 7ffa85f34640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654623addc0 0x5654623b8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:56.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:56.997+0000 7ffa85f34640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654623addc0 0x5654623b8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56794/0 (socket says 172.21.15.33:56794) 2024-09-12T12:35:56.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:56.997+0000 7ffa85f34640 1 -- 172.21.15.33:0/2416010621 learned_addr learned my addr 172.21.15.33:0/2416010621 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:35:56.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:56.998+0000 7ffa85733640 1 --2- 172.21.15.33:0/2416010621 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654623b8680 0x5654623baa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:56.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:56.998+0000 7ffa86735640 1 --2- 172.21.15.33:0/2416010621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5654623ad4a0 0x5654623ad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:57.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.001+0000 7ffa85733640 1 -- 172.21.15.33:0/2416010621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5654623ad4a0 msgr2=0x5654623ad880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:35:57.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.001+0000 7ffa85733640 1 --2- 172.21.15.33:0/2416010621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5654623ad4a0 0x5654623ad880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:57.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.001+0000 7ffa85733640 1 -- 172.21.15.33:0/2416010621 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654623addc0 msgr2=0x5654623b8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:35:57.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.001+0000 7ffa85733640 1 --2- 172.21.15.33:0/2416010621 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654623addc0 0x5654623b8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:57.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.001+0000 7ffa85733640 1 -- 172.21.15.33:0/2416010621 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56546229f440 con 0x5654623b8680 2024-09-12T12:35:57.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.001+0000 7ffa76ffd640 1 -- 172.21.15.33:0/802369951 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ffa78037020 con 0x7ffa800ffe60 2024-09-12T12:35:57.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.001+0000 7ffa85733640 1 --2- 172.21.15.33:0/2416010621 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654623b8680 0x5654623baa70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c00ba10 tx=0x7ffa7c00bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a73e444d34f5ddff server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:35:57.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.002+0000 7ffa76ffd640 1 --2- 172.21.15.33:0/802369951 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ffa6c0a2b80 0x7ffa6c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:57.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.002+0000 7ffa76ffd640 1 -- 172.21.15.33:0/802369951 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7ffa780f5fd0 con 0x7ffa800ffe60 2024-09-12T12:35:57.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.003+0000 7ffa86735640 1 --2- 172.21.15.33:0/802369951 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ffa6c0a2b80 0x7ffa6c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:57.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.005+0000 7ffa6bfff640 1 -- 172.21.15.33:0/2416010621 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c00dbe0 con 0x5654623b8680 2024-09-12T12:35:57.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.005+0000 7ffa6bfff640 1 -- 172.21.15.33:0/2416010621 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffa7c00dd80 con 0x5654623b8680 2024-09-12T12:35:57.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.006+0000 7ffa8a571740 1 -- 172.21.15.33:0/2416010621 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654623b8680 msgr2=0x5654623baa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:57.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.006+0000 7ffa8a571740 1 --2- 172.21.15.33:0/2416010621 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654623b8680 0x5654623baa70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c00ba10 tx=0x7ffa7c00bed0 comp rx=0 tx=0).stop 2024-09-12T12:35:57.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.005+0000 7ffa6bfff640 1 -- 172.21.15.33:0/2416010621 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c004a00 con 0x5654623b8680 2024-09-12T12:35:57.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.007+0000 7ffa86735640 1 --2- 172.21.15.33:0/802369951 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ffa6c0a2b80 0x7ffa6c0a5040 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ffa700098e0 tx=0x7ffa70009060 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:35:57.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.007+0000 7ffa8a571740 1 -- 172.21.15.33:0/2416010621 shutdown_connections 2024-09-12T12:35:57.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.007+0000 7ffa8a571740 1 --2- 172.21.15.33:0/2416010621 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654623b8680 0x5654623baa70 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:57.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.007+0000 7ffa8a571740 1 --2- 172.21.15.33:0/2416010621 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654623addc0 0x5654623b8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:57.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.007+0000 7ffa8a571740 1 --2- 172.21.15.33:0/2416010621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5654623ad4a0 0x5654623ad880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:57.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.007+0000 7ffa8a571740 1 -- 172.21.15.33:0/2416010621 >> 172.21.15.33:0/2416010621 conn(0x5654623a9a30 msgr2=0x5654623a9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:35:57.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.009+0000 7ffa8a571740 1 -- 172.21.15.33:0/2416010621 shutdown_connections 2024-09-12T12:35:57.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.013+0000 7ffa8a571740 1 -- 172.21.15.33:0/2416010621 wait complete. 2024-09-12T12:35:57.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.014+0000 7ffa8a571740 1 -- start start 2024-09-12T12:35:57.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.014+0000 7ffa8a571740 1 Processor -- start 2024-09-12T12:35:57.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.014+0000 7ffa8a571740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5654623ad4a0 0x5654623b7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:57.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.014+0000 7ffa8a571740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654623addc0 0x5654623b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:57.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.014+0000 7ffa8a571740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654623b8680 0x5654623b56e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:57.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.014+0000 7ffa8a571740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5654623bb2a0 con 0x5654623b8680 2024-09-12T12:35:57.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.014+0000 7ffa8a571740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5654622ce050 con 0x5654623addc0 2024-09-12T12:35:57.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.014+0000 7ffa8a571740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5654623bb420 con 0x5654623ad4a0 2024-09-12T12:35:57.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.015+0000 7ffa8a571740 10 client.0 _ll_register_callbacks cb 0x56546230e160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:35:57.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.018+0000 7ffa85f34640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5654623ad4a0 0x5654623b7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:57.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.018+0000 7ffa85f34640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5654623ad4a0 0x5654623b7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:41560/0 (socket says 172.21.15.33:41560) 2024-09-12T12:35:57.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.018+0000 7ffa85f34640 1 -- 172.21.15.33:0/3093474568 learned_addr learned my addr 172.21.15.33:0/3093474568 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:35:57.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.019+0000 7ffa86735640 1 --2- 172.21.15.33:0/3093474568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654623b8680 0x5654623b56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:57.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.019+0000 7ffa85f34640 1 -- 172.21.15.33:0/3093474568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654623addc0 msgr2=0x5654623b51a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T12:35:57.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.019+0000 7ffa85f34640 1 --2- 172.21.15.33:0/3093474568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654623addc0 0x5654623b51a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:57.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.019+0000 7ffa85f34640 1 -- 172.21.15.33:0/3093474568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654623b8680 msgr2=0x5654623b56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:35:57.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.019+0000 7ffa85f34640 1 --2- 172.21.15.33:0/3093474568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654623b8680 0x5654623b56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:57.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.019+0000 7ffa85f34640 1 -- 172.21.15.33:0/3093474568 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654620843c0 con 0x5654623ad4a0 2024-09-12T12:35:57.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.021+0000 7ffa85f34640 1 --2- 172.21.15.33:0/3093474568 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5654623ad4a0 0x5654623b7ef0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ffa78009df0 tx=0x7ffa780c0450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f618c2a2cec57ab0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:35:57.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.022+0000 7ffa697fa640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:35:57.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.022+0000 7ffa697fa640 1 -- 172.21.15.33:0/3093474568 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa780c1da0 con 0x5654623ad4a0 2024-09-12T12:35:57.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.022+0000 7ffa8a571740 1 -- 172.21.15.33:0/3093474568 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa7c00dd80 con 0x5654623ad4a0 2024-09-12T12:35:57.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.023+0000 7ffa697fa640 1 -- 172.21.15.33:0/3093474568 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7ffa780f3da0 con 0x5654623ad4a0 2024-09-12T12:35:57.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.024+0000 7ffa697fa640 1 -- 172.21.15.33:0/3093474568 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ffa780c0580 con 0x5654623ad4a0 2024-09-12T12:35:57.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.025+0000 7ffa8a571740 10 client.25975 fetch_fsmap learned FSMap version 27 2024-09-12T12:35:57.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.025+0000 7ffa8a571740 1 -- 172.21.15.33:0/3093474568 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5654623bb2a0 con 0x5654623ad4a0 2024-09-12T12:35:57.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.028+0000 7ffa697fa640 1 -- 172.21.15.33:0/3093474568 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffa7c00dd80 con 0x5654623ad4a0 2024-09-12T12:35:57.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.028+0000 7ffa697fa640 1 -- 172.21.15.33:0/3093474568 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7ffa7804b070 con 0x5654623ad4a0 2024-09-12T12:35:57.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.029+0000 7ffa8a571740 10 client.25975 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:35:57.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.029+0000 7ffa8a571740 10 client.25975 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:35:57.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.029+0000 7ffa8a571740 20 client.25975 populate_metadata read hostname 'smithi033' 2024-09-12T12:35:57.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.029+0000 7ffa8a571740 1 --2- 172.21.15.33:0/3093474568 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5654623d8f30 0x5654623db3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:57.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.029+0000 7ffa8a571740 4 client.25975 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:35:57.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.029+0000 7ffa8a571740 1 -- 172.21.15.33:0/3093474568 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565462320850 con 0x5654623d8f30 2024-09-12T12:35:57.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.030+0000 7ffa85733640 1 --2- 172.21.15.33:0/3093474568 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5654623d8f30 0x5654623db3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:57.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.040+0000 7ffa85733640 1 --2- 172.21.15.33:0/3093474568 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5654623d8f30 0x5654623db3f0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4df404c0e6f97959 server_cookie=6def4ac5ba706699 in_seq=0 out_seq=0 2024-09-12T12:35:57.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.040+0000 7ffa697fa640 10 client.25975 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:35:57.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.042+0000 7ffa697fa640 1 -- 172.21.15.33:0/3093474568 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x565462320850 con 0x5654623d8f30 2024-09-12T12:35:57.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.043+0000 7ffa697fa640 10 client.25975 handle_command_reply: tid=0 2024-09-12T12:35:57.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.043+0000 7ffa8a571740 1 client.25975 shutdown 2024-09-12T12:35:57.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.043+0000 7ffa8a571740 1 -- 172.21.15.33:0/3093474568 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5654623ad4a0 msgr2=0x5654623b7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:57.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.043+0000 7ffa8a571740 1 --2- 172.21.15.33:0/3093474568 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5654623ad4a0 0x5654623b7ef0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ffa78009df0 tx=0x7ffa780c0450 comp rx=0 tx=0).stop 2024-09-12T12:35:57.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.046+0000 7ffa8a571740 1 -- 172.21.15.33:0/3093474568 shutdown_connections 2024-09-12T12:35:57.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.046+0000 7ffa8a571740 1 --2- 172.21.15.33:0/3093474568 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5654623d8f30 0x5654623db3f0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:57.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.046+0000 7ffa8a571740 1 --2- 172.21.15.33:0/3093474568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654623b8680 0x5654623b56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:57.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.046+0000 7ffa8a571740 1 --2- 172.21.15.33:0/3093474568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654623addc0 0x5654623b51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:57.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.046+0000 7ffa8a571740 1 --2- 172.21.15.33:0/3093474568 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5654623ad4a0 0x5654623b7ef0 secure :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ffa78009df0 tx=0x7ffa780c0450 comp rx=0 tx=0).stop 2024-09-12T12:35:57.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.046+0000 7ffa8a571740 1 -- 172.21.15.33:0/3093474568 >> 172.21.15.33:0/3093474568 conn(0x5654623a9a30 msgr2=0x5654623af760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:35:57.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.046+0000 7ffa697fa640 0 client.25975 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:35:57.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.051+0000 7ffa8a571740 1 -- 172.21.15.33:0/3093474568 shutdown_connections 2024-09-12T12:35:57.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.054+0000 7ffa8a571740 1 -- 172.21.15.33:0/3093474568 wait complete. 2024-09-12T12:35:57.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.054+0000 7ffa8a571740 20 client.25975 trim_cache size 0 max 16384 2024-09-12T12:35:57.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.088+0000 7ffa8a571740 1 Processor -- start 2024-09-12T12:35:57.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.088+0000 7ffa8a571740 1 -- start start 2024-09-12T12:35:57.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.088+0000 7ffa8a571740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654623addc0 0x5654623b7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:57.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.089+0000 7ffa8a571740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5654623b8680 0x5654623e0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:57.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.089+0000 7ffa8a571740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654623b4290 0x5654623e1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:57.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.089+0000 7ffa85733640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5654623b8680 0x5654623e0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:57.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.089+0000 7ffa8a571740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ffa801af1f0 con 0x5654623b4290 2024-09-12T12:35:57.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.089+0000 7ffa8a571740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ffa801acac0 con 0x5654623addc0 2024-09-12T12:35:57.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.089+0000 7ffa85733640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5654623b8680 0x5654623e0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:41564/0 (socket says 172.21.15.33:41564) 2024-09-12T12:35:57.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.089+0000 7ffa8a571740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ffa80073840 con 0x5654623b8680 2024-09-12T12:35:57.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.089+0000 7ffa85733640 1 -- 172.21.15.33:0/2313498565 learned_addr learned my addr 172.21.15.33:0/2313498565 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:35:57.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.090+0000 7ffa86735640 1 --2- 172.21.15.33:0/2313498565 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654623b4290 0x5654623e1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:57.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.090+0000 7ffa85733640 1 -- 172.21.15.33:0/2313498565 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654623addc0 msgr2=0x5654623b7110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T12:35:57.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.090+0000 7ffa85733640 1 --2- 172.21.15.33:0/2313498565 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654623addc0 0x5654623b7110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:57.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.090+0000 7ffa85733640 1 -- 172.21.15.33:0/2313498565 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654623b4290 msgr2=0x5654623e1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:35:57.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.090+0000 7ffa85733640 1 --2- 172.21.15.33:0/2313498565 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654623b4290 0x5654623e1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:57.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.090+0000 7ffa85733640 1 -- 172.21.15.33:0/2313498565 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654623ad2d0 con 0x5654623b8680 2024-09-12T12:35:57.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.090+0000 7ffa86735640 1 --2- 172.21.15.33:0/2313498565 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654623b4290 0x5654623e1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:35:57.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.090+0000 7ffa85733640 1 --2- 172.21.15.33:0/2313498565 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5654623b8680 0x5654623e0d00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c005d00 tx=0x7ffa7c005c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b455540acaaeb259 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:35:57.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.091+0000 7ffa6b7fe640 1 -- 172.21.15.33:0/2313498565 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c02b070 con 0x5654623b8680 2024-09-12T12:35:57.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.091+0000 7ffa6b7fe640 1 -- 172.21.15.33:0/2313498565 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffa7c005620 con 0x5654623b8680 2024-09-12T12:35:57.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.091+0000 7ffa6b7fe640 1 -- 172.21.15.33:0/2313498565 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c025ca0 con 0x5654623b8680 2024-09-12T12:35:57.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.092+0000 7ffa8a571740 1 -- 172.21.15.33:0/2313498565 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5654623b8680 msgr2=0x5654623e0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:57.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.092+0000 7ffa8a571740 1 --2- 172.21.15.33:0/2313498565 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5654623b8680 0x5654623e0d00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c005d00 tx=0x7ffa7c005c90 comp rx=0 tx=0).stop 2024-09-12T12:35:57.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.093+0000 7ffa8a571740 1 -- 172.21.15.33:0/2313498565 shutdown_connections 2024-09-12T12:35:57.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.093+0000 7ffa8a571740 1 --2- 172.21.15.33:0/2313498565 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654623b4290 0x5654623e1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:57.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.093+0000 7ffa8a571740 1 --2- 172.21.15.33:0/2313498565 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5654623b8680 0x5654623e0d00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:57.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.093+0000 7ffa8a571740 1 --2- 172.21.15.33:0/2313498565 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654623addc0 0x5654623b7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:57.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.093+0000 7ffa8a571740 1 -- 172.21.15.33:0/2313498565 >> 172.21.15.33:0/2313498565 conn(0x5654623a9a30 msgr2=0x5654623b6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:35:57.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.096+0000 7ffa8a571740 1 -- 172.21.15.33:0/2313498565 shutdown_connections 2024-09-12T12:35:57.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.097+0000 7ffa8a571740 1 -- 172.21.15.33:0/2313498565 wait complete. 2024-09-12T12:35:57.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.098+0000 7ffa8a571740 1 -- start start 2024-09-12T12:35:57.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.098+0000 7ffa8a571740 1 Processor -- start 2024-09-12T12:35:57.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.099+0000 7ffa8a571740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5654623addc0 0x5654623bed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:57.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.099+0000 7ffa8a571740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654623b4290 0x5654623bf270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:57.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.099+0000 7ffa8a571740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654623b8680 0x56546243cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:57.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.099+0000 7ffa85f34640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5654623addc0 0x5654623bed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:57.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.099+0000 7ffa85f34640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5654623addc0 0x5654623bed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:41568/0 (socket says 172.21.15.33:41568) 2024-09-12T12:35:57.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.099+0000 7ffa85f34640 1 -- 172.21.15.33:0/853668009 learned_addr learned my addr 172.21.15.33:0/853668009 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:35:57.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.099+0000 7ffa8a571740 1 -- 172.21.15.33:0/853668009 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ffa80073eb0 con 0x5654623b4290 2024-09-12T12:35:57.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.099+0000 7ffa8a571740 1 -- 172.21.15.33:0/853668009 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ffa801ac3f0 con 0x5654623b8680 2024-09-12T12:35:57.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.099+0000 7ffa8a571740 1 -- 172.21.15.33:0/853668009 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ffa801ab650 con 0x5654623addc0 2024-09-12T12:35:57.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.100+0000 7ffa8a571740 10 client.0 _ll_register_callbacks cb 0x7ffa78004910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:35:57.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.100+0000 7ffa85f34640 1 -- 172.21.15.33:0/853668009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654623b8680 msgr2=0x56546243cd20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:35:57.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.100+0000 7ffa85f34640 1 --2- 172.21.15.33:0/853668009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654623b8680 0x56546243cd20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:57.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.100+0000 7ffa85f34640 1 -- 172.21.15.33:0/853668009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654623b4290 msgr2=0x5654623bf270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:35:57.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.100+0000 7ffa85f34640 1 --2- 172.21.15.33:0/853668009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654623b4290 0x5654623bf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:57.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.100+0000 7ffa85f34640 1 -- 172.21.15.33:0/853668009 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56546243d360 con 0x5654623addc0 2024-09-12T12:35:57.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.100+0000 7ffa85f34640 1 --2- 172.21.15.33:0/853668009 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5654623addc0 0x5654623bed30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ffa780c68e0 tx=0x7ffa7802f5e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccf128fea5b377c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:35:57.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.101+0000 7ffa697fa640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:35:57.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.101+0000 7ffa697fa640 1 -- 172.21.15.33:0/853668009 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa780c1da0 con 0x5654623addc0 2024-09-12T12:35:57.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.101+0000 7ffa697fa640 1 -- 172.21.15.33:0/853668009 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7ffa78004d40 con 0x5654623addc0 2024-09-12T12:35:57.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.101+0000 7ffa8a571740 1 -- 172.21.15.33:0/853668009 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa7c005620 con 0x5654623addc0 2024-09-12T12:35:57.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.102+0000 7ffa697fa640 1 -- 172.21.15.33:0/853668009 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ffa78030b10 con 0x5654623addc0 2024-09-12T12:35:57.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.104+0000 7ffa8a571740 10 client.25981 fetch_fsmap learned FSMap version 27 2024-09-12T12:35:57.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.104+0000 7ffa8a571740 1 -- 172.21.15.33:0/853668009 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56546243d360 con 0x5654623addc0 2024-09-12T12:35:57.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.107+0000 7ffa697fa640 1 -- 172.21.15.33:0/853668009 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffa780c2b40 con 0x5654623addc0 2024-09-12T12:35:57.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.108+0000 7ffa697fa640 1 -- 172.21.15.33:0/853668009 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7ffa7804b070 con 0x5654623addc0 2024-09-12T12:35:57.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.108+0000 7ffa8a571740 10 client.25981 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:35:57.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.108+0000 7ffa8a571740 10 client.25981 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:35:57.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.108+0000 7ffa8a571740 20 client.25981 populate_metadata read hostname 'smithi033' 2024-09-12T12:35:57.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.108+0000 7ffa8a571740 1 --2- 172.21.15.33:0/853668009 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x565462444a20 0x565462446e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:35:57.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.109+0000 7ffa8a571740 4 client.25981 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:35:57.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.109+0000 7ffa8a571740 1 -- 172.21.15.33:0/853668009 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7ffa7c005620 con 0x565462444a20 2024-09-12T12:35:57.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.113+0000 7ffa85733640 1 --2- 172.21.15.33:0/853668009 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x565462444a20 0x565462446e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:35:57.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.120+0000 7ffa697fa640 10 client.25981 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:35:57.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.120+0000 7ffa85733640 1 --2- 172.21.15.33:0/853668009 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x565462444a20 0x565462446e40 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afca1940bb5a0fa6 server_cookie=3e1dfc2dccb73250 in_seq=0 out_seq=0 2024-09-12T12:35:57.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.121+0000 7ffa697fa640 1 -- 172.21.15.33:0/853668009 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7ffa7c005620 con 0x565462444a20 2024-09-12T12:35:57.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.121+0000 7ffa697fa640 10 client.25981 handle_command_reply: tid=0 2024-09-12T12:35:57.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.121+0000 7ffa8a571740 1 client.25981 shutdown 2024-09-12T12:35:57.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.126+0000 7ffa8a571740 1 -- 172.21.15.33:0/853668009 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5654623addc0 msgr2=0x5654623bed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:57.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.126+0000 7ffa8a571740 1 --2- 172.21.15.33:0/853668009 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5654623addc0 0x5654623bed30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ffa780c68e0 tx=0x7ffa7802f5e0 comp rx=0 tx=0).stop 2024-09-12T12:35:57.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.126+0000 7ffa8a571740 1 -- 172.21.15.33:0/853668009 shutdown_connections 2024-09-12T12:35:57.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.126+0000 7ffa8a571740 1 --2- 172.21.15.33:0/853668009 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x565462444a20 0x565462446e40 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:57.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.126+0000 7ffa8a571740 1 --2- 172.21.15.33:0/853668009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654623b8680 0x56546243cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:57.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.126+0000 7ffa8a571740 1 --2- 172.21.15.33:0/853668009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654623b4290 0x5654623bf270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:57.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.127+0000 7ffa8a571740 1 --2- 172.21.15.33:0/853668009 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5654623addc0 0x5654623bed30 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:57.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.127+0000 7ffa8a571740 1 -- 172.21.15.33:0/853668009 >> 172.21.15.33:0/853668009 conn(0x5654623a9a30 msgr2=0x5654623b7220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:35:57.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.127+0000 7ffa697fa640 0 client.25981 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:35:57.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.132+0000 7ffa8a571740 1 -- 172.21.15.33:0/853668009 shutdown_connections 2024-09-12T12:35:57.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.134+0000 7ffa8a571740 1 -- 172.21.15.33:0/853668009 wait complete. 2024-09-12T12:35:57.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.137+0000 7ffa8a571740 20 client.25981 trim_cache size 0 max 16384 2024-09-12T12:35:57.138 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:35:57.139 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "no active scrubs running", 2024-09-12T12:35:57.139 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": {} 2024-09-12T12:35:57.139 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:35:57.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.138+0000 7ffa88198640 1 -- 172.21.15.33:0/802369951 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ffa6c0a2b80 msgr2=0x7ffa6c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:57.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.138+0000 7ffa88198640 1 --2- 172.21.15.33:0/802369951 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ffa6c0a2b80 0x7ffa6c0a5040 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ffa700098e0 tx=0x7ffa70009060 comp rx=0 tx=0).stop 2024-09-12T12:35:57.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.138+0000 7ffa88198640 1 -- 172.21.15.33:0/802369951 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa800ffe60 msgr2=0x7ffa80103880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:35:57.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.138+0000 7ffa88198640 1 --2- 172.21.15.33:0/802369951 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa800ffe60 0x7ffa80103880 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ffa7802af30 tx=0x7ffa78003f10 comp rx=0 tx=0).stop 2024-09-12T12:35:57.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.138+0000 7ffa88198640 1 -- 172.21.15.33:0/802369951 shutdown_connections 2024-09-12T12:35:57.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.138+0000 7ffa88198640 1 --2- 172.21.15.33:0/802369951 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7ffa6c0a2b80 0x7ffa6c0a5040 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:57.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.138+0000 7ffa88198640 1 --2- 172.21.15.33:0/802369951 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa8010a2f0 0x7ffa80104300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:57.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.138+0000 7ffa88198640 1 --2- 172.21.15.33:0/802369951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa80100780 0x7ffa80103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:57.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.138+0000 7ffa88198640 1 --2- 172.21.15.33:0/802369951 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa800ffe60 0x7ffa80103880 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:35:57.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.138+0000 7ffa88198640 1 -- 172.21.15.33:0/802369951 >> 172.21.15.33:0/802369951 conn(0x7ffa800fba90 msgr2=0x7ffa80107f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:35:57.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.139+0000 7ffa88198640 1 -- 172.21.15.33:0/802369951 shutdown_connections 2024-09-12T12:35:57.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:35:57.139+0000 7ffa88198640 1 -- 172.21.15.33:0/802369951 wait complete. 2024-09-12T12:35:57.579 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:35:57 smithi033 ceph-mon[31246]: pgmap v648: 129 pgs: 129 active+clean; 10 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 28 MiB/s wr, 573 op/s 2024-09-12T12:35:57.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:35:57 smithi043 ceph-mon[34144]: pgmap v648: 129 pgs: 129 active+clean; 10 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 28 MiB/s wr, 573 op/s 2024-09-12T12:35:57.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:35:57 smithi102 ceph-mon[34799]: pgmap v648: 129 pgs: 129 active+clean; 10 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 28 MiB/s wr, 573 op/s 2024-09-12T12:35:58.063 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T12:35:58.063 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:35:58.695 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:35:59.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:35:59 smithi033 ceph-mon[31246]: pgmap v649: 129 pgs: 129 active+clean; 10 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 37 MiB/s wr, 742 op/s 2024-09-12T12:35:59.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:35:59 smithi043 ceph-mon[34144]: pgmap v649: 129 pgs: 129 active+clean; 10 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 37 MiB/s wr, 742 op/s 2024-09-12T12:35:59.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:35:59 smithi102 ceph-mon[34799]: pgmap v649: 129 pgs: 129 active+clean; 10 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 37 MiB/s wr, 742 op/s 2024-09-12T12:36:01.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:01 smithi043 ceph-mon[34144]: pgmap v650: 129 pgs: 129 active+clean; 10 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 27 MiB/s wr, 555 op/s 2024-09-12T12:36:01.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:01 smithi102 ceph-mon[34799]: pgmap v650: 129 pgs: 129 active+clean; 10 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 27 MiB/s wr, 555 op/s 2024-09-12T12:36:01.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:01 smithi033 ceph-mon[31246]: pgmap v650: 129 pgs: 129 active+clean; 10 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 27 MiB/s wr, 555 op/s 2024-09-12T12:36:03.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:03 smithi043 ceph-mon[34144]: pgmap v651: 129 pgs: 129 active+clean; 10 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 MiB/s rd, 31 MiB/s wr, 627 op/s 2024-09-12T12:36:03.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:03 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:36:03.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:03 smithi102 ceph-mon[34799]: pgmap v651: 129 pgs: 129 active+clean; 10 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 MiB/s rd, 31 MiB/s wr, 627 op/s 2024-09-12T12:36:03.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:03 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:36:03.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:03 smithi033 ceph-mon[31246]: pgmap v651: 129 pgs: 129 active+clean; 10 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 MiB/s rd, 31 MiB/s wr, 627 op/s 2024-09-12T12:36:03.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:03 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:36:04.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:04 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/1721451216' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:36:04.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:04 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/1721451216' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:36:04.730 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:04 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/1721451216' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:36:04.967 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:36:04.968 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":27,"btime":"2024-09-12T12:29:38:065241+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3327066342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3327066342},{"type":"v1","addr":"172.21.15.33:6835","nonce":3327066342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/19516401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":19516401},{"type":"v1","addr":"172.21.15.33:6837","nonce":19516401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1260196118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1260196118},{"type":"v1","addr":"172.21.15.33:6839","nonce":1260196118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/4288248356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4288248356},{"type":"v1","addr":"172.21.15.33:6841","nonce":4288248356}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/3051073141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3051073141},{"type":"v1","addr":"172.21.15.43:6833","nonce":3051073141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3282762800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3282762800},{"type":"v1","addr":"172.21.15.43:6835","nonce":3282762800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:23:46.400609+0000","modified":"2024-09-12T12:29:37.555614+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24490,"mds_2":24478},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3051713000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3051713000},{"type":"v1","addr":"172.21.15.102:6833","nonce":3051713000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6837/2472064883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2472064883},{"type":"v1","addr":"172.21.15.43:6837","nonce":2472064883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/1987408860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":1987408860},{"type":"v1","addr":"172.21.15.43:6839","nonce":1987408860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/4179527539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":4179527539},{"type":"v1","addr":"172.21.15.102:6835","nonce":4179527539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/2409953270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2409953270},{"type":"v1","addr":"172.21.15.102:6837","nonce":2409953270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.102:6839/1553271340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":1553271340},{"type":"v1","addr":"172.21.15.102:6839","nonce":1553271340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24499,"qdb_cluster":[24499,24490,24478]},"id":1}]} 2024-09-12T12:36:04.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.542+0000 7f7f13bef640 1 -- 172.21.15.33:0/134499784 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f0c109450 msgr2=0x7f7f0c110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:04.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.542+0000 7f7f13bef640 1 --2- 172.21.15.33:0/134499784 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f0c109450 0x7f7f0c110250 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7f08009860 tx=0x7f7f0802a380 comp rx=0 tx=0).stop 2024-09-12T12:36:04.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.542+0000 7f7f13bef640 1 -- 172.21.15.33:0/134499784 shutdown_connections 2024-09-12T12:36:04.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.542+0000 7f7f13bef640 1 --2- 172.21.15.33:0/134499784 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f0c11b140 0x7f7f0c11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:04.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.542+0000 7f7f13bef640 1 --2- 172.21.15.33:0/134499784 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f0c109830 0x7f7f0c109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:04.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.542+0000 7f7f13bef640 1 --2- 172.21.15.33:0/134499784 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f0c109450 0x7f7f0c110250 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:04.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.542+0000 7f7f13bef640 1 -- 172.21.15.33:0/134499784 >> 172.21.15.33:0/134499784 conn(0x7f7f0c06e140 msgr2=0x7f7f0c06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:36:04.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.543+0000 7f7f13bef640 1 -- 172.21.15.33:0/134499784 shutdown_connections 2024-09-12T12:36:04.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.543+0000 7f7f13bef640 1 -- 172.21.15.33:0/134499784 wait complete. 2024-09-12T12:36:04.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.544+0000 7f7f13bef640 1 Processor -- start 2024-09-12T12:36:04.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.545+0000 7f7f13bef640 1 -- start start 2024-09-12T12:36:04.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.545+0000 7f7f13bef640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f0c109450 0x7f7f0c11a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:04.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.545+0000 7f7f13bef640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f0c109830 0x7f7f0c1167f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:04.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.545+0000 7f7f13bef640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f0c11b140 0x7f7f0c116d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:04.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.545+0000 7f7f13bef640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0c113160 con 0x7f7f0c109830 2024-09-12T12:36:04.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.545+0000 7f7f13bef640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0c112fe0 con 0x7f7f0c11b140 2024-09-12T12:36:04.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.545+0000 7f7f13bef640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0c1132e0 con 0x7f7f0c109450 2024-09-12T12:36:04.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.546+0000 7f7f1118a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f0c109830 0x7f7f0c1167f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:04.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.546+0000 7f7f1118a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f0c109830 0x7f7f0c1167f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41232/0 (socket says 172.21.15.33:41232) 2024-09-12T12:36:04.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.546+0000 7f7f1118a640 1 -- 172.21.15.33:0/1721451216 learned_addr learned my addr 172.21.15.33:0/1721451216 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:36:04.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.546+0000 7f7f1198b640 1 --2- 172.21.15.33:0/1721451216 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f0c109450 0x7f7f0c11a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:04.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.546+0000 7f7f1118a640 1 -- 172.21.15.33:0/1721451216 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f0c109450 msgr2=0x7f7f0c11a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:04.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.546+0000 7f7f1118a640 1 --2- 172.21.15.33:0/1721451216 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f0c109450 0x7f7f0c11a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:04.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.546+0000 7f7f1118a640 1 -- 172.21.15.33:0/1721451216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f0c11b140 msgr2=0x7f7f0c116d30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T12:36:04.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.546+0000 7f7f1118a640 1 --2- 172.21.15.33:0/1721451216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f0c11b140 0x7f7f0c116d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:04.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.546+0000 7f7f1118a640 1 -- 172.21.15.33:0/1721451216 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f0c1172f0 con 0x7f7f0c109830 2024-09-12T12:36:04.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.547+0000 7f7f1118a640 1 --2- 172.21.15.33:0/1721451216 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f0c109830 0x7f7f0c1167f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00e9f0 tx=0x7f7efc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:36:04.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.548+0000 7f7f02ffd640 1 -- 172.21.15.33:0/1721451216 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc00cd80 con 0x7f7f0c109830 2024-09-12T12:36:04.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.548+0000 7f7f13bef640 1 -- 172.21.15.33:0/1721451216 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f0c1175e0 con 0x7f7f0c109830 2024-09-12T12:36:04.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.548+0000 7f7f13bef640 1 -- 172.21.15.33:0/1721451216 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f0c1ab460 con 0x7f7f0c109830 2024-09-12T12:36:04.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.548+0000 7f7f02ffd640 1 -- 172.21.15.33:0/1721451216 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7efc0108e0 con 0x7f7f0c109830 2024-09-12T12:36:04.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.549+0000 7f7f02ffd640 1 -- 172.21.15.33:0/1721451216 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc018850 con 0x7f7f0c109830 2024-09-12T12:36:04.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.551+0000 7f7f13bef640 1 -- 172.21.15.33:0/1721451216 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ef0005290 con 0x7f7f0c109830 2024-09-12T12:36:04.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.556+0000 7f7f02ffd640 1 -- 172.21.15.33:0/1721451216 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7efc010430 con 0x7f7f0c109830 2024-09-12T12:36:04.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.557+0000 7f7f02ffd640 1 --2- 172.21.15.33:0/1721451216 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f7ef80a2c20 0x7f7ef80a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:04.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.557+0000 7f7f02ffd640 1 -- 172.21.15.33:0/1721451216 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f7efc0cfc10 con 0x7f7f0c109830 2024-09-12T12:36:04.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.563+0000 7f7f1198b640 1 --2- 172.21.15.33:0/1721451216 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f7ef80a2c20 0x7f7ef80a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:04.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.564+0000 7f7f02ffd640 1 -- 172.21.15.33:0/1721451216 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7efc09c800 con 0x7f7f0c109830 2024-09-12T12:36:04.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.574+0000 7f7f1198b640 1 --2- 172.21.15.33:0/1721451216 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f7ef80a2c20 0x7f7ef80a50e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7f08009780 tx=0x7f7f08030c60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:36:04.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.917+0000 7f7f13bef640 1 -- 172.21.15.33:0/1721451216 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7ef0005580 con 0x7f7f0c109830 2024-09-12T12:36:04.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.917+0000 7f7f02ffd640 1 -- 172.21.15.33:0/1721451216 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11912 (secure 0 0 0) 0x7f7efc09c100 con 0x7f7f0c109830 2024-09-12T12:36:04.974 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 27 2024-09-12T12:36:04.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.919+0000 7f7f13bef640 1 -- 172.21.15.33:0/1721451216 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f7ef80a2c20 msgr2=0x7f7ef80a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:04.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.919+0000 7f7f13bef640 1 --2- 172.21.15.33:0/1721451216 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f7ef80a2c20 0x7f7ef80a50e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7f08009780 tx=0x7f7f08030c60 comp rx=0 tx=0).stop 2024-09-12T12:36:04.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.919+0000 7f7f13bef640 1 -- 172.21.15.33:0/1721451216 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f0c109830 msgr2=0x7f7f0c1167f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:04.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.919+0000 7f7f13bef640 1 --2- 172.21.15.33:0/1721451216 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f0c109830 0x7f7f0c1167f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00e9f0 tx=0x7f7efc00eeb0 comp rx=0 tx=0).stop 2024-09-12T12:36:04.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.920+0000 7f7f13bef640 1 -- 172.21.15.33:0/1721451216 shutdown_connections 2024-09-12T12:36:04.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.920+0000 7f7f13bef640 1 --2- 172.21.15.33:0/1721451216 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f7ef80a2c20 0x7f7ef80a50e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:04.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.920+0000 7f7f13bef640 1 --2- 172.21.15.33:0/1721451216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f0c11b140 0x7f7f0c116d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:04.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.920+0000 7f7f13bef640 1 --2- 172.21.15.33:0/1721451216 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f0c109830 0x7f7f0c1167f0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:04.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.920+0000 7f7f13bef640 1 --2- 172.21.15.33:0/1721451216 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f0c109450 0x7f7f0c11a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:04.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.920+0000 7f7f13bef640 1 -- 172.21.15.33:0/1721451216 >> 172.21.15.33:0/1721451216 conn(0x7f7f0c06e140 msgr2=0x7f7f0c10ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:36:04.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.920+0000 7f7f13bef640 1 -- 172.21.15.33:0/1721451216 shutdown_connections 2024-09-12T12:36:04.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:03.920+0000 7f7f13bef640 1 -- 172.21.15.33:0/1721451216 wait complete. 2024-09-12T12:36:05.983 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:05 smithi033 ceph-mon[31246]: pgmap v652: 129 pgs: 129 active+clean; 10 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 31 MiB/s wr, 621 op/s 2024-09-12T12:36:05.983 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:05 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:36:05.983 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:05 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:36:05.983 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:05 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:36:05.983 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:05 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:36:06.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:05 smithi043 ceph-mon[34144]: pgmap v652: 129 pgs: 129 active+clean; 10 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 31 MiB/s wr, 621 op/s 2024-09-12T12:36:06.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:05 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:36:06.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:05 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:36:06.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:05 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:36:06.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:05 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:36:06.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:05 smithi102 ceph-mon[34799]: pgmap v652: 129 pgs: 129 active+clean; 10 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 31 MiB/s wr, 621 op/s 2024-09-12T12:36:06.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:05 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:36:06.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:05 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:36:06.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:05 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:36:06.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:05 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:36:07.489 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T12:36:07.687 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:07 smithi033 ceph-mon[31246]: pgmap v653: 129 pgs: 129 active+clean; 10 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 24 MiB/s wr, 485 op/s 2024-09-12T12:36:08.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:07 smithi043 ceph-mon[34144]: pgmap v653: 129 pgs: 129 active+clean; 10 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 24 MiB/s wr, 485 op/s 2024-09-12T12:36:08.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:07 smithi102 ceph-mon[34799]: pgmap v653: 129 pgs: 129 active+clean; 10 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 24 MiB/s wr, 485 op/s 2024-09-12T12:36:08.959 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:36:09.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:09 smithi043 ceph-mon[34144]: pgmap v654: 129 pgs: 129 active+clean; 10 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 32 MiB/s wr, 643 op/s 2024-09-12T12:36:09.947 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:09 smithi102 ceph-mon[34799]: pgmap v654: 129 pgs: 129 active+clean; 10 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 32 MiB/s wr, 643 op/s 2024-09-12T12:36:09.953 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:09 smithi033 ceph-mon[31246]: pgmap v654: 129 pgs: 129 active+clean; 10 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 32 MiB/s wr, 643 op/s 2024-09-12T12:36:10.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.571+0000 7fe0df59e640 1 -- 172.21.15.33:0/888469840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0e011b140 msgr2=0x7fe0e011d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:10.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.571+0000 7fe0df59e640 1 --2- 172.21.15.33:0/888469840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0e011b140 0x7fe0e011d530 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8009ca0 tx=0x7fe0d802a8f0 comp rx=0 tx=0).stop 2024-09-12T12:36:10.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.573+0000 7fe0df59e640 1 -- 172.21.15.33:0/888469840 shutdown_connections 2024-09-12T12:36:10.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.573+0000 7fe0df59e640 1 --2- 172.21.15.33:0/888469840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0e011b140 0x7fe0e011d530 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:10.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.573+0000 7fe0df59e640 1 --2- 172.21.15.33:0/888469840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0e006ea30 0x7fe0e006ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:10.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.573+0000 7fe0df59e640 1 --2- 172.21.15.33:0/888469840 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0e0110190 0x7fe0e006e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:10.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.573+0000 7fe0df59e640 1 -- 172.21.15.33:0/888469840 >> 172.21.15.33:0/888469840 conn(0x7fe0e0073180 msgr2=0x7fe0e0073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:36:10.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.590+0000 7fe0df59e640 1 -- 172.21.15.33:0/888469840 shutdown_connections 2024-09-12T12:36:10.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.591+0000 7fe0df59e640 1 -- 172.21.15.33:0/888469840 wait complete. 2024-09-12T12:36:10.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.592+0000 7fe0df59e640 1 Processor -- start 2024-09-12T12:36:10.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.592+0000 7fe0df59e640 1 -- start start 2024-09-12T12:36:10.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.592+0000 7fe0df59e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0e006ea30 0x7fe0e01a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:10.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.592+0000 7fe0df59e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0e0110190 0x7fe0e01a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:10.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.592+0000 7fe0df59e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0e011b140 0x7fe0e01ab880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:10.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.592+0000 7fe0df59e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e0120a40 con 0x7fe0e0110190 2024-09-12T12:36:10.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.592+0000 7fe0df59e640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e01208c0 con 0x7fe0e011b140 2024-09-12T12:36:10.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.592+0000 7fe0df59e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e0120bc0 con 0x7fe0e006ea30 2024-09-12T12:36:10.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.593+0000 7fe0de59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0e006ea30 0x7fe0e01a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:10.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.593+0000 7fe0de59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0e006ea30 0x7fe0e01a6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:53800/0 (socket says 172.21.15.33:53800) 2024-09-12T12:36:10.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.593+0000 7fe0de59c640 1 -- 172.21.15.33:0/1832146359 learned_addr learned my addr 172.21.15.33:0/1832146359 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:36:10.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.593+0000 7fe0ded9d640 1 --2- 172.21.15.33:0/1832146359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0e011b140 0x7fe0e01ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:10.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.595+0000 7fe0ddd9b640 1 --2- 172.21.15.33:0/1832146359 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0e0110190 0x7fe0e01a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:10.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.599+0000 7fe0ded9d640 1 -- 172.21.15.33:0/1832146359 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0e006ea30 msgr2=0x7fe0e01a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:10.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.599+0000 7fe0ded9d640 1 --2- 172.21.15.33:0/1832146359 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0e006ea30 0x7fe0e01a6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:10.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.599+0000 7fe0ded9d640 1 -- 172.21.15.33:0/1832146359 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0e0110190 msgr2=0x7fe0e01a74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:10.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.599+0000 7fe0ded9d640 1 --2- 172.21.15.33:0/1832146359 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0e0110190 0x7fe0e01a74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:10.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.599+0000 7fe0ded9d640 1 -- 172.21.15.33:0/1832146359 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0e01abf80 con 0x7fe0e011b140 2024-09-12T12:36:10.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.601+0000 7fe0ded9d640 1 --2- 172.21.15.33:0/1832146359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0e011b140 0x7fe0e01ab880 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8006010 tx=0x7fe0d8033000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:36:10.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.605+0000 7fe0cf7fe640 1 -- 172.21.15.33:0/1832146359 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d8003b70 con 0x7fe0e011b140 2024-09-12T12:36:10.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.605+0000 7fe0cf7fe640 1 -- 172.21.15.33:0/1832146359 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe0d802d070 con 0x7fe0e011b140 2024-09-12T12:36:10.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.605+0000 7fe0df59e640 1 -- 172.21.15.33:0/1832146359 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0e01ac210 con 0x7fe0e011b140 2024-09-12T12:36:10.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.605+0000 7fe0df59e640 1 -- 172.21.15.33:0/1832146359 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0e0110920 con 0x7fe0e011b140 2024-09-12T12:36:10.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.605+0000 7fe0cf7fe640 1 -- 172.21.15.33:0/1832146359 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d80308e0 con 0x7fe0e011b140 2024-09-12T12:36:10.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.611+0000 7fe0e71ae740 1 Processor -- start 2024-09-12T12:36:10.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.613+0000 7fe0e71ae740 1 -- start start 2024-09-12T12:36:10.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.613+0000 7fe0e71ae740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556a9ff4ccf0 0x556a9ff4b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:10.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.613+0000 7fe0e71ae740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a9ff4b780 0x556a9ff4bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:10.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.613+0000 7fe0cf7fe640 1 -- 172.21.15.33:0/1832146359 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe0d8030a80 con 0x7fe0e011b140 2024-09-12T12:36:10.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.614+0000 7fe0de59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a9ff4b780 0x556a9ff4bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:10.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.614+0000 7fe0de59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a9ff4b780 0x556a9ff4bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47088/0 (socket says 172.21.15.33:47088) 2024-09-12T12:36:10.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.617+0000 7fe0e71ae740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a9ff56520 0x556a9ff58910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:10.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.617+0000 7fe0e71ae740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x556a9feb12f0 con 0x556a9ff4b780 2024-09-12T12:36:10.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.617+0000 7fe0e71ae740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556a9fe58cf0 con 0x556a9ff56520 2024-09-12T12:36:10.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.617+0000 7fe0e71ae740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556a9fead2b0 con 0x556a9ff4ccf0 2024-09-12T12:36:10.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.617+0000 7fe0de59c640 1 -- 172.21.15.33:0/3781378188 learned_addr learned my addr 172.21.15.33:0/3781378188 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:36:10.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.618+0000 7fe0ddd9b640 1 --2- 172.21.15.33:0/3781378188 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556a9ff4ccf0 0x556a9ff4b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:10.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.618+0000 7fe0cf7fe640 1 --2- 172.21.15.33:0/1832146359 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe0c80a2d90 0x7fe0c80a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:10.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.619+0000 7fe0cf7fe640 1 -- 172.21.15.33:0/1832146359 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fe0d80f06b0 con 0x7fe0e011b140 2024-09-12T12:36:10.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.619+0000 7fe0ddd9b640 1 --2- 172.21.15.33:0/3781378188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a9ff56520 0x556a9ff58910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:10.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.621+0000 7fe0ded9d640 1 --2- 172.21.15.33:0/1832146359 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe0c80a2d90 0x7fe0c80a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:10.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.622+0000 7fe0ddd9b640 1 -- 172.21.15.33:0/3781378188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a9ff56520 msgr2=0x556a9ff58910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:36:10.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.622+0000 7fe0ddd9b640 1 --2- 172.21.15.33:0/3781378188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a9ff56520 0x556a9ff58910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:10.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.622+0000 7fe0ddd9b640 1 -- 172.21.15.33:0/3781378188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a9ff4b780 msgr2=0x556a9ff4bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:36:10.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.622+0000 7fe0ddd9b640 1 --2- 172.21.15.33:0/3781378188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a9ff4b780 0x556a9ff4bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:10.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.622+0000 7fe0ddd9b640 1 -- 172.21.15.33:0/3781378188 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a9fe3d3a0 con 0x556a9ff4ccf0 2024-09-12T12:36:10.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.624+0000 7fe0ddd9b640 1 --2- 172.21.15.33:0/3781378188 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556a9ff4ccf0 0x556a9ff4b240 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe0d00058a0 tx=0x7fe0d000b760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3316b090e0e9f49e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:36:10.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.627+0000 7fe0ccff9640 1 -- 172.21.15.33:0/3781378188 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d00120d0 con 0x556a9ff4ccf0 2024-09-12T12:36:10.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.627+0000 7fe0ccff9640 1 -- 172.21.15.33:0/3781378188 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe0d0005020 con 0x556a9ff4ccf0 2024-09-12T12:36:10.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.628+0000 7fe0e71ae740 1 -- 172.21.15.33:0/3781378188 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556a9ff4ccf0 msgr2=0x556a9ff4b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:10.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.628+0000 7fe0e71ae740 1 --2- 172.21.15.33:0/3781378188 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556a9ff4ccf0 0x556a9ff4b240 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe0d00058a0 tx=0x7fe0d000b760 comp rx=0 tx=0).stop 2024-09-12T12:36:10.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.628+0000 7fe0ded9d640 1 --2- 172.21.15.33:0/1832146359 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe0c80a2d90 0x7fe0c80a5250 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe0d80bcab0 tx=0x7fe0d804afb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:36:10.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.629+0000 7fe0e71ae740 1 -- 172.21.15.33:0/3781378188 shutdown_connections 2024-09-12T12:36:10.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.629+0000 7fe0e71ae740 1 --2- 172.21.15.33:0/3781378188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a9ff56520 0x556a9ff58910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:10.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.629+0000 7fe0e71ae740 1 --2- 172.21.15.33:0/3781378188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a9ff4b780 0x556a9ff4bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:10.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.629+0000 7fe0e71ae740 1 --2- 172.21.15.33:0/3781378188 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556a9ff4ccf0 0x556a9ff4b240 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:10.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.629+0000 7fe0e71ae740 1 -- 172.21.15.33:0/3781378188 >> 172.21.15.33:0/3781378188 conn(0x556a9ff14310 msgr2=0x556a9ff47e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:36:10.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.629+0000 7fe0e71ae740 1 -- 172.21.15.33:0/3781378188 shutdown_connections 2024-09-12T12:36:10.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.629+0000 7fe0e71ae740 1 -- 172.21.15.33:0/3781378188 wait complete. 2024-09-12T12:36:10.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.629+0000 7fe0e71ae740 1 -- start start 2024-09-12T12:36:10.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.629+0000 7fe0e71ae740 1 Processor -- start 2024-09-12T12:36:10.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.630+0000 7fe0e71ae740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a9ff4b780 0x556a9ff55e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:10.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.630+0000 7fe0e71ae740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a9ff4ccf0 0x556a9ff530b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:10.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.630+0000 7fe0e71ae740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556a9ff56520 0x556a9ff535f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:10.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.630+0000 7fe0e71ae740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x556a9ff59210 con 0x556a9ff4ccf0 2024-09-12T12:36:10.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.630+0000 7fe0e71ae740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556a9fe6c060 con 0x556a9ff4b780 2024-09-12T12:36:10.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.630+0000 7fe0e71ae740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556a9ff59390 con 0x556a9ff56520 2024-09-12T12:36:10.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.630+0000 7fe0e71ae740 10 client.0 _ll_register_callbacks cb 0x556a9fbbf8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:36:10.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.630+0000 7fe0ddd9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a9ff4b780 0x556a9ff55e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:10.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.630+0000 7fe0ddd9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a9ff4b780 0x556a9ff55e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:44402/0 (socket says 172.21.15.33:44402) 2024-09-12T12:36:10.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.630+0000 7fe0ddd9b640 1 -- 172.21.15.33:0/86260884 learned_addr learned my addr 172.21.15.33:0/86260884 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:36:10.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.633+0000 7fe0de59c640 1 --2- 172.21.15.33:0/86260884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a9ff4ccf0 0x556a9ff530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:10.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.633+0000 7fe0ddd9b640 1 -- 172.21.15.33:0/86260884 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556a9ff56520 msgr2=0x556a9ff535f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:36:10.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.633+0000 7fe0ddd9b640 1 --2- 172.21.15.33:0/86260884 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556a9ff56520 0x556a9ff535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:10.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.633+0000 7fe0ddd9b640 1 -- 172.21.15.33:0/86260884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a9ff4ccf0 msgr2=0x556a9ff530b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:36:10.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.633+0000 7fe0ddd9b640 1 --2- 172.21.15.33:0/86260884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a9ff4ccf0 0x556a9ff530b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:10.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.633+0000 7fe0ddd9b640 1 -- 172.21.15.33:0/86260884 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a9fc223c0 con 0x556a9ff4b780 2024-09-12T12:36:10.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.634+0000 7fe0ddd9b640 1 --2- 172.21.15.33:0/86260884 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a9ff4b780 0x556a9ff55e00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe0d0005c20 tx=0x7fe0d0004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63ddf2d8716eaac4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:36:10.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.634+0000 7fe0c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:36:10.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.634+0000 7fe0c5ffb640 1 -- 172.21.15.33:0/86260884 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d0026070 con 0x556a9ff4b780 2024-09-12T12:36:10.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.634+0000 7fe0c5ffb640 1 -- 172.21.15.33:0/86260884 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fe0d0004ac0 con 0x556a9ff4b780 2024-09-12T12:36:10.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.634+0000 7fe0e71ae740 1 -- 172.21.15.33:0/86260884 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0d0005020 con 0x556a9ff4b780 2024-09-12T12:36:10.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.635+0000 7fe0c5ffb640 1 -- 172.21.15.33:0/86260884 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe0d0032050 con 0x556a9ff4b780 2024-09-12T12:36:10.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.635+0000 7fe0e71ae740 10 client.25880 fetch_fsmap learned FSMap version 27 2024-09-12T12:36:10.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.635+0000 7fe0e71ae740 1 -- 172.21.15.33:0/86260884 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556a9ff64ca0 con 0x556a9ff4b780 2024-09-12T12:36:10.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.636+0000 7fe0c5ffb640 1 -- 172.21.15.33:0/86260884 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe0d0005020 con 0x556a9ff4b780 2024-09-12T12:36:10.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.636+0000 7fe0c5ffb640 1 -- 172.21.15.33:0/86260884 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fe0d0010460 con 0x556a9ff4b780 2024-09-12T12:36:10.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.636+0000 7fe0e71ae740 10 client.25880 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:36:10.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.636+0000 7fe0e71ae740 10 client.25880 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-12T12:36:10.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.636+0000 7fe0e71ae740 20 client.25880 populate_metadata read hostname 'smithi033' 2024-09-12T12:36:10.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.636+0000 7fe0e71ae740 1 --2- 172.21.15.33:0/86260884 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x556a9ff65ff0 0x556a9ff683e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:10.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.636+0000 7fe0e71ae740 4 client.25880 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:36:10.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.636+0000 7fe0e71ae740 1 -- 172.21.15.33:0/86260884 --> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556a9febe860 con 0x556a9ff65ff0 2024-09-12T12:36:10.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.638+0000 7fe0de59c640 1 --2- 172.21.15.33:0/86260884 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x556a9ff65ff0 0x556a9ff683e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:10.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.645+0000 7fe0de59c640 1 --2- 172.21.15.33:0/86260884 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x556a9ff65ff0 0x556a9ff683e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bf37b5f8c83d604 server_cookie=9a7ad496024c9f5c in_seq=0 out_seq=0 2024-09-12T12:36:10.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.645+0000 7fe0c5ffb640 10 client.25880 ms_handle_connect on v2:172.21.15.102:6834/4179527539 2024-09-12T12:36:10.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.647+0000 7fe0c5ffb640 1 -- 172.21.15.33:0/86260884 <== mds.2 v2:172.21.15.102:6834/4179527539 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556a9febe860 con 0x556a9ff65ff0 2024-09-12T12:36:10.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.647+0000 7fe0c5ffb640 10 client.25880 handle_command_reply: tid=0 2024-09-12T12:36:10.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.647+0000 7fe0e71ae740 1 client.25880 shutdown 2024-09-12T12:36:10.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.647+0000 7fe0e71ae740 1 -- 172.21.15.33:0/86260884 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a9ff4b780 msgr2=0x556a9ff55e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:10.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.647+0000 7fe0e71ae740 1 --2- 172.21.15.33:0/86260884 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a9ff4b780 0x556a9ff55e00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe0d0005c20 tx=0x7fe0d0004730 comp rx=0 tx=0).stop 2024-09-12T12:36:10.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.648+0000 7fe0e71ae740 1 -- 172.21.15.33:0/86260884 shutdown_connections 2024-09-12T12:36:10.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.648+0000 7fe0e71ae740 1 --2- 172.21.15.33:0/86260884 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556a9ff56520 0x556a9ff535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:10.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.648+0000 7fe0e71ae740 1 --2- 172.21.15.33:0/86260884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a9ff4ccf0 0x556a9ff530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:10.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.648+0000 7fe0e71ae740 1 --2- 172.21.15.33:0/86260884 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x556a9ff65ff0 0x556a9ff683e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:10.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.648+0000 7fe0e71ae740 1 --2- 172.21.15.33:0/86260884 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a9ff4b780 0x556a9ff55e00 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:10.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.648+0000 7fe0e71ae740 1 -- 172.21.15.33:0/86260884 >> 172.21.15.33:0/86260884 conn(0x556a9ff14310 msgr2=0x556a9ff4dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:36:10.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.648+0000 7fe0c5ffb640 0 client.25880 ms_handle_reset on v2:172.21.15.102:6834/4179527539 2024-09-12T12:36:10.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.648+0000 7fe0e71ae740 1 -- 172.21.15.33:0/86260884 shutdown_connections 2024-09-12T12:36:10.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.648+0000 7fe0e71ae740 1 -- 172.21.15.33:0/86260884 wait complete. 2024-09-12T12:36:10.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.648+0000 7fe0e71ae740 20 client.25880 trim_cache size 0 max 16384 2024-09-12T12:36:10.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.699+0000 7fe0e71ae740 1 Processor -- start 2024-09-12T12:36:10.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.699+0000 7fe0e71ae740 1 -- start start 2024-09-12T12:36:10.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.700+0000 7fe0e71ae740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a9ff4b780 0x556a9ff46da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:10.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.700+0000 7fe0e71ae740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a9ff4ccf0 0x556a9ff4e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:10.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.700+0000 7fe0e71ae740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556a9ff56520 0x556a9ff4e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:10.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.700+0000 7fe0e71ae740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c0012570 con 0x556a9ff4b780 2024-09-12T12:36:10.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.700+0000 7fe0e71ae740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c000fe40 con 0x556a9ff4ccf0 2024-09-12T12:36:10.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.700+0000 7fe0e71ae740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c000dc90 con 0x556a9ff56520 2024-09-12T12:36:10.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.700+0000 7fe0de59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a9ff4ccf0 0x556a9ff4e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:10.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.704+0000 7fe0de59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a9ff4ccf0 0x556a9ff4e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:44406/0 (socket says 172.21.15.33:44406) 2024-09-12T12:36:10.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.704+0000 7fe0de59c640 1 -- 172.21.15.33:0/3203176235 learned_addr learned my addr 172.21.15.33:0/3203176235 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:36:10.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.704+0000 7fe0ddd9b640 1 --2- 172.21.15.33:0/3203176235 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556a9ff56520 0x556a9ff4e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:10.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.704+0000 7fe0ddd9b640 1 --2- 172.21.15.33:0/3203176235 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a9ff4b780 0x556a9ff46da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:10.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.704+0000 7fe0de59c640 1 -- 172.21.15.33:0/3203176235 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556a9ff56520 msgr2=0x556a9ff4e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:36:10.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.704+0000 7fe0de59c640 1 --2- 172.21.15.33:0/3203176235 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556a9ff56520 0x556a9ff4e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:10.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.704+0000 7fe0de59c640 1 -- 172.21.15.33:0/3203176235 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a9ff4b780 msgr2=0x556a9ff46da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:36:10.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.704+0000 7fe0de59c640 1 --2- 172.21.15.33:0/3203176235 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a9ff4b780 0x556a9ff46da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:10.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.704+0000 7fe0de59c640 1 -- 172.21.15.33:0/3203176235 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a9ff59430 con 0x556a9ff4ccf0 2024-09-12T12:36:10.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.717+0000 7fe0de59c640 1 --2- 172.21.15.33:0/3203176235 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a9ff4ccf0 0x556a9ff4e2a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x556a9ff52940 tx=0x7fe0d40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=142609d34a0667f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:36:10.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.720+0000 7fe0c7fff640 1 -- 172.21.15.33:0/3203176235 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d4003de0 con 0x556a9ff4ccf0 2024-09-12T12:36:10.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.720+0000 7fe0c7fff640 1 -- 172.21.15.33:0/3203176235 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe0d40054e0 con 0x556a9ff4ccf0 2024-09-12T12:36:10.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.721+0000 7fe0e71ae740 1 -- 172.21.15.33:0/3203176235 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a9ff4ccf0 msgr2=0x556a9ff4e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:10.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.721+0000 7fe0e71ae740 1 --2- 172.21.15.33:0/3203176235 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a9ff4ccf0 0x556a9ff4e2a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x556a9ff52940 tx=0x7fe0d40046c0 comp rx=0 tx=0).stop 2024-09-12T12:36:10.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.722+0000 7fe0e71ae740 1 -- 172.21.15.33:0/3203176235 shutdown_connections 2024-09-12T12:36:10.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.722+0000 7fe0e71ae740 1 --2- 172.21.15.33:0/3203176235 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556a9ff56520 0x556a9ff4e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:10.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.722+0000 7fe0e71ae740 1 --2- 172.21.15.33:0/3203176235 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a9ff4ccf0 0x556a9ff4e2a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:10.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.722+0000 7fe0e71ae740 1 --2- 172.21.15.33:0/3203176235 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a9ff4b780 0x556a9ff46da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:10.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.722+0000 7fe0e71ae740 1 -- 172.21.15.33:0/3203176235 >> 172.21.15.33:0/3203176235 conn(0x556a9ff14310 msgr2=0x556a9ff46690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:36:10.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.723+0000 7fe0e71ae740 1 -- 172.21.15.33:0/3203176235 shutdown_connections 2024-09-12T12:36:10.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.723+0000 7fe0e71ae740 1 -- 172.21.15.33:0/3203176235 wait complete. 2024-09-12T12:36:10.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.723+0000 7fe0e71ae740 1 -- start start 2024-09-12T12:36:10.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.723+0000 7fe0e71ae740 1 Processor -- start 2024-09-12T12:36:10.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.724+0000 7fe0e71ae740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a9ff4b780 0x556a9ff5eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:10.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.724+0000 7fe0e71ae740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a9ff4ccf0 0x556a9ff59eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:10.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.724+0000 7fe0ddd9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a9ff4b780 0x556a9ff5eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:10.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.724+0000 7fe0e71ae740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556a9ff56520 0x556a9ff5a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:10.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.724+0000 7fe0de59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a9ff4ccf0 0x556a9ff59eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:10.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.724+0000 7fe0de59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a9ff4ccf0 0x556a9ff59eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:44420/0 (socket says 172.21.15.33:44420) 2024-09-12T12:36:10.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.724+0000 7fe0de59c640 1 -- 172.21.15.33:0/3828941711 learned_addr learned my addr 172.21.15.33:0/3828941711 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:36:10.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.724+0000 7fe0e71ae740 1 -- 172.21.15.33:0/3828941711 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c000e300 con 0x556a9ff4b780 2024-09-12T12:36:10.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.724+0000 7fe0e71ae740 1 -- 172.21.15.33:0/3828941711 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c000f770 con 0x556a9ff4ccf0 2024-09-12T12:36:10.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.724+0000 7fe0e71ae740 1 -- 172.21.15.33:0/3828941711 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c000e9d0 con 0x556a9ff56520 2024-09-12T12:36:10.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.724+0000 7fe0e71ae740 10 client.0 _ll_register_callbacks cb 0x7fe0d4009550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:36:10.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.730+0000 7fe0ddd9b640 1 --2- 172.21.15.33:0/3828941711 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556a9ff56520 0x556a9ff5a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:10.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.733+0000 7fe0de59c640 1 -- 172.21.15.33:0/3828941711 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556a9ff56520 msgr2=0x556a9ff5a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:36:10.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.733+0000 7fe0de59c640 1 --2- 172.21.15.33:0/3828941711 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556a9ff56520 0x556a9ff5a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:10.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.733+0000 7fe0de59c640 1 -- 172.21.15.33:0/3828941711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a9ff4b780 msgr2=0x556a9ff5eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:36:10.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.733+0000 7fe0de59c640 1 --2- 172.21.15.33:0/3828941711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a9ff4b780 0x556a9ff5eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:10.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.733+0000 7fe0de59c640 1 -- 172.21.15.33:0/3828941711 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a9ff5a930 con 0x556a9ff4ccf0 2024-09-12T12:36:10.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.736+0000 7fe0de59c640 1 --2- 172.21.15.33:0/3828941711 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a9ff4ccf0 0x556a9ff59eb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4004b90 tx=0x7fe0d4009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1779bf84166a6af server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:36:10.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.736+0000 7fe0c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:36:10.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.736+0000 7fe0c5ffb640 1 -- 172.21.15.33:0/3828941711 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d4033060 con 0x556a9ff4ccf0 2024-09-12T12:36:10.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.736+0000 7fe0e71ae740 1 -- 172.21.15.33:0/3828941711 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0d40054e0 con 0x556a9ff4ccf0 2024-09-12T12:36:10.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.736+0000 7fe0c5ffb640 1 -- 172.21.15.33:0/3828941711 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fe0d4003de0 con 0x556a9ff4ccf0 2024-09-12T12:36:10.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.737+0000 7fe0c5ffb640 1 -- 172.21.15.33:0/3828941711 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe0d403a050 con 0x556a9ff4ccf0 2024-09-12T12:36:10.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.737+0000 7fe0e71ae740 10 client.25886 fetch_fsmap learned FSMap version 27 2024-09-12T12:36:10.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.737+0000 7fe0e71ae740 1 -- 172.21.15.33:0/3828941711 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556a9ffd0830 con 0x556a9ff4ccf0 2024-09-12T12:36:10.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.741+0000 7fe0c5ffb640 1 -- 172.21.15.33:0/3828941711 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe0d40054e0 con 0x556a9ff4ccf0 2024-09-12T12:36:10.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.741+0000 7fe0c5ffb640 1 -- 172.21.15.33:0/3828941711 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fe0d4027070 con 0x556a9ff4ccf0 2024-09-12T12:36:10.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.742+0000 7fe0e71ae740 10 client.25886 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:36:10.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.742+0000 7fe0e71ae740 10 client.25886 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-12T12:36:10.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.742+0000 7fe0e71ae740 20 client.25886 populate_metadata read hostname 'smithi033' 2024-09-12T12:36:10.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.742+0000 7fe0e71ae740 1 --2- 172.21.15.33:0/3828941711 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x556a9ffd0ed0 0x556a9ffd32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:10.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.742+0000 7fe0e71ae740 4 client.25886 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:36:10.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.742+0000 7fe0e71ae740 1 -- 172.21.15.33:0/3828941711 --> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556a9feb8d70 con 0x556a9ffd0ed0 2024-09-12T12:36:10.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.748+0000 7fe0ddd9b640 1 --2- 172.21.15.33:0/3828941711 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x556a9ffd0ed0 0x556a9ffd32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:10.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.755+0000 7fe0ddd9b640 1 --2- 172.21.15.33:0/3828941711 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x556a9ffd0ed0 0x556a9ffd32f0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=37737a549efb561a server_cookie=f769a3c11358e8b5 in_seq=0 out_seq=0 2024-09-12T12:36:10.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.755+0000 7fe0c5ffb640 10 client.25886 ms_handle_connect on v2:172.21.15.102:6834/4179527539 2024-09-12T12:36:10.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.759+0000 7fe0c5ffb640 1 -- 172.21.15.33:0/3828941711 <== mds.2 v2:172.21.15.102:6834/4179527539 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556a9feb8d70 con 0x556a9ffd0ed0 2024-09-12T12:36:10.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.759+0000 7fe0c5ffb640 10 client.25886 handle_command_reply: tid=0 2024-09-12T12:36:10.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.759+0000 7fe0e71ae740 1 client.25886 shutdown 2024-09-12T12:36:10.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.760+0000 7fe0e71ae740 1 -- 172.21.15.33:0/3828941711 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a9ff4ccf0 msgr2=0x556a9ff59eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:10.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.760+0000 7fe0e71ae740 1 --2- 172.21.15.33:0/3828941711 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a9ff4ccf0 0x556a9ff59eb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4004b90 tx=0x7fe0d4009bd0 comp rx=0 tx=0).stop 2024-09-12T12:36:10.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.768+0000 7fe0e71ae740 1 -- 172.21.15.33:0/3828941711 shutdown_connections 2024-09-12T12:36:10.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.768+0000 7fe0e71ae740 1 --2- 172.21.15.33:0/3828941711 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556a9ff56520 0x556a9ff5a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:10.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.768+0000 7fe0e71ae740 1 --2- 172.21.15.33:0/3828941711 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x556a9ffd0ed0 0x556a9ffd32f0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:10.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.768+0000 7fe0e71ae740 1 --2- 172.21.15.33:0/3828941711 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a9ff4ccf0 0x556a9ff59eb0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:10.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.768+0000 7fe0e71ae740 1 --2- 172.21.15.33:0/3828941711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a9ff4b780 0x556a9ff5eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:10.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.768+0000 7fe0e71ae740 1 -- 172.21.15.33:0/3828941711 >> 172.21.15.33:0/3828941711 conn(0x556a9ff14310 msgr2=0x556a9ff46eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:36:10.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.770+0000 7fe0c5ffb640 0 client.25886 ms_handle_reset on v2:172.21.15.102:6834/4179527539 2024-09-12T12:36:10.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.770+0000 7fe0e71ae740 1 -- 172.21.15.33:0/3828941711 shutdown_connections 2024-09-12T12:36:10.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.774+0000 7fe0e71ae740 1 -- 172.21.15.33:0/3828941711 wait complete. 2024-09-12T12:36:10.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.776+0000 7fe0e71ae740 20 client.25886 trim_cache size 0 max 16384 2024-09-12T12:36:10.779 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-09-12T12:36:10.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.786+0000 7fe0df59e640 1 -- 172.21.15.33:0/1832146359 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe0c80a2d90 msgr2=0x7fe0c80a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:10.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.786+0000 7fe0df59e640 1 --2- 172.21.15.33:0/1832146359 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe0c80a2d90 0x7fe0c80a5250 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe0d80bcab0 tx=0x7fe0d804afb0 comp rx=0 tx=0).stop 2024-09-12T12:36:10.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.786+0000 7fe0df59e640 1 -- 172.21.15.33:0/1832146359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0e011b140 msgr2=0x7fe0e01ab880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:10.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.786+0000 7fe0df59e640 1 --2- 172.21.15.33:0/1832146359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0e011b140 0x7fe0e01ab880 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8006010 tx=0x7fe0d8033000 comp rx=0 tx=0).stop 2024-09-12T12:36:10.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.787+0000 7fe0df59e640 1 -- 172.21.15.33:0/1832146359 shutdown_connections 2024-09-12T12:36:10.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.787+0000 7fe0df59e640 1 --2- 172.21.15.33:0/1832146359 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fe0c80a2d90 0x7fe0c80a5250 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:10.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.787+0000 7fe0df59e640 1 --2- 172.21.15.33:0/1832146359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0e011b140 0x7fe0e01ab880 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:10.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.787+0000 7fe0df59e640 1 --2- 172.21.15.33:0/1832146359 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0e0110190 0x7fe0e01a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:10.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.787+0000 7fe0df59e640 1 --2- 172.21.15.33:0/1832146359 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0e006ea30 0x7fe0e01a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:10.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.787+0000 7fe0df59e640 1 -- 172.21.15.33:0/1832146359 >> 172.21.15.33:0/1832146359 conn(0x7fe0e0073180 msgr2=0x7fe0e01194d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:36:10.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.796+0000 7fe0df59e640 1 -- 172.21.15.33:0/1832146359 shutdown_connections 2024-09-12T12:36:10.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:10.799+0000 7fe0df59e640 1 -- 172.21.15.33:0/1832146359 wait complete. 2024-09-12T12:36:11.773 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T12:36:11.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:11 smithi033 ceph-mon[31246]: pgmap v655: 129 pgs: 129 active+clean; 10 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 23 MiB/s wr, 461 op/s 2024-09-12T12:36:12.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:11 smithi043 ceph-mon[34144]: pgmap v655: 129 pgs: 129 active+clean; 10 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 23 MiB/s wr, 461 op/s 2024-09-12T12:36:12.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:11 smithi102 ceph-mon[34799]: pgmap v655: 129 pgs: 129 active+clean; 10 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 23 MiB/s wr, 461 op/s 2024-09-12T12:36:12.535 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:36:13.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.796+0000 7fbbe4290640 1 -- 172.21.15.33:0/283341709 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbdc109830 msgr2=0x7fbbdc109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:13.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.796+0000 7fbbe4290640 1 --2- 172.21.15.33:0/283341709 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbdc109830 0x7fbbdc109c90 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4009ca0 tx=0x7fbbd402a8d0 comp rx=0 tx=0).stop 2024-09-12T12:36:13.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.805+0000 7fbbe4290640 1 -- 172.21.15.33:0/283341709 shutdown_connections 2024-09-12T12:36:13.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.805+0000 7fbbe4290640 1 --2- 172.21.15.33:0/283341709 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbbdc11b140 0x7fbbdc11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:13.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.805+0000 7fbbe4290640 1 --2- 172.21.15.33:0/283341709 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbdc109830 0x7fbbdc109c90 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:13.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.805+0000 7fbbe4290640 1 --2- 172.21.15.33:0/283341709 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbbdc109450 0x7fbbdc110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:13.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.805+0000 7fbbe4290640 1 -- 172.21.15.33:0/283341709 >> 172.21.15.33:0/283341709 conn(0x7fbbdc06e140 msgr2=0x7fbbdc06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:36:13.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.809+0000 7fbbe4290640 1 -- 172.21.15.33:0/283341709 shutdown_connections 2024-09-12T12:36:13.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.809+0000 7fbbe4290640 1 -- 172.21.15.33:0/283341709 wait complete. 2024-09-12T12:36:13.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.810+0000 7fbbe4290640 1 Processor -- start 2024-09-12T12:36:13.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.815+0000 7fbbe4290640 1 -- start start 2024-09-12T12:36:13.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.816+0000 7fbbe4290640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbbdc109450 0x7fbbdc118680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:13.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.816+0000 7fbbe4290640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbdc109830 0x7fbbdc118bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:13.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.816+0000 7fbbe4290640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbbdc11b140 0x7fbbdc1118c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:13.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.816+0000 7fbbe4290640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fbbdc120ca0 con 0x7fbbdc109830 2024-09-12T12:36:13.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.816+0000 7fbbe4290640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbbdc120b20 con 0x7fbbdc11b140 2024-09-12T12:36:13.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.816+0000 7fbbe4290640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbbdc120e20 con 0x7fbbdc109450 2024-09-12T12:36:13.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.816+0000 7fbbe202c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbbdc109450 0x7fbbdc118680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:13.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.816+0000 7fbbe202c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbbdc109450 0x7fbbdc118680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:53860/0 (socket says 172.21.15.33:53860) 2024-09-12T12:36:13.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.816+0000 7fbbe202c640 1 -- 172.21.15.33:0/1116237190 learned_addr learned my addr 172.21.15.33:0/1116237190 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:36:13.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.816+0000 7fbbe202c640 1 -- 172.21.15.33:0/1116237190 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbbdc11b140 msgr2=0x7fbbdc1118c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T12:36:13.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.816+0000 7fbbe202c640 1 --2- 172.21.15.33:0/1116237190 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbbdc11b140 0x7fbbdc1118c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:13.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.816+0000 7fbbe202c640 1 -- 172.21.15.33:0/1116237190 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbdc109830 msgr2=0x7fbbdc118bc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T12:36:13.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.816+0000 7fbbe202c640 1 --2- 172.21.15.33:0/1116237190 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbdc109830 0x7fbbdc118bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:13.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.816+0000 7fbbe202c640 1 -- 172.21.15.33:0/1116237190 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbdc112180 con 0x7fbbdc109450 2024-09-12T12:36:13.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.817+0000 7fbbe202c640 1 --2- 172.21.15.33:0/1116237190 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbbdc109450 0x7fbbdc118680 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc00e9f0 tx=0x7fbbcc00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:36:13.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.817+0000 7fbbd37fe640 1 -- 172.21.15.33:0/1116237190 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc00cd80 con 0x7fbbdc109450 2024-09-12T12:36:13.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.817+0000 7fbbe4290640 1 -- 172.21.15.33:0/1116237190 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbdc112470 con 0x7fbbdc109450 2024-09-12T12:36:13.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.817+0000 7fbbe4290640 1 -- 172.21.15.33:0/1116237190 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbdc116440 con 0x7fbbdc109450 2024-09-12T12:36:13.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.822+0000 7fbbe6669740 1 Processor -- start 2024-09-12T12:36:13.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:13 smithi033 ceph-mon[31246]: pgmap v656: 129 pgs: 129 active+clean; 10 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 28 MiB/s wr, 549 op/s 2024-09-12T12:36:13.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:13 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:36:13.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:13 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:36:13.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.823+0000 7fbbd37fe640 1 -- 172.21.15.33:0/1116237190 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbbcc0108e0 con 0x7fbbdc109450 2024-09-12T12:36:13.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.831+0000 7fbbd37fe640 1 -- 172.21.15.33:0/1116237190 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc0188e0 con 0x7fbbdc109450 2024-09-12T12:36:13.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.831+0000 7fbbd37fe640 1 -- 172.21.15.33:0/1116237190 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fbbcc018b60 con 0x7fbbdc109450 2024-09-12T12:36:13.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.832+0000 7fbbd37fe640 1 --2- 172.21.15.33:0/1116237190 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fbbc80a2d00 0x7fbbc80a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:13.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.832+0000 7fbbd37fe640 1 -- 172.21.15.33:0/1116237190 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fbbcc0d07d0 con 0x7fbbdc109450 2024-09-12T12:36:13.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.833+0000 7fbbe6669740 1 -- start start 2024-09-12T12:36:13.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.833+0000 7fbbe6669740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb3a68b40 0x557bb3a67090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:13.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.833+0000 7fbbe6669740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb3a675d0 0x557bb3a67a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:13.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.833+0000 7fbbe6669740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557bb3a72370 0x557bb3a74760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:13.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.833+0000 7fbbe6669740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x557bb39cd2f0 con 0x557bb3a72370 2024-09-12T12:36:13.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.833+0000 7fbbe6669740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557bb3974cf0 con 0x557bb3a675d0 2024-09-12T12:36:13.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.833+0000 7fbbe6669740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557bb39c92b0 con 0x557bb3a68b40 2024-09-12T12:36:13.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.833+0000 7fbbe202c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb3a68b40 0x557bb3a67090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:13.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.833+0000 7fbbe202c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb3a68b40 0x557bb3a67090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:53874/0 (socket says 172.21.15.33:53874) 2024-09-12T12:36:13.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.833+0000 7fbbe202c640 1 -- 172.21.15.33:0/1862530501 learned_addr learned my addr 172.21.15.33:0/1862530501 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:36:13.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.834+0000 7fbbe202c640 1 -- 172.21.15.33:0/1862530501 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb3a675d0 msgr2=0x557bb3a67a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T12:36:13.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.834+0000 7fbbe202c640 1 --2- 172.21.15.33:0/1862530501 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb3a675d0 0x557bb3a67a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:13.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.834+0000 7fbbe202c640 1 -- 172.21.15.33:0/1862530501 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557bb3a72370 msgr2=0x557bb3a74760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T12:36:13.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.834+0000 7fbbe202c640 1 --2- 172.21.15.33:0/1862530501 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557bb3a72370 0x557bb3a74760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:13.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.834+0000 7fbbe202c640 1 -- 172.21.15.33:0/1862530501 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557bb39593a0 con 0x557bb3a68b40 2024-09-12T12:36:13.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.834+0000 7fbbe202c640 1 --2- 172.21.15.33:0/1862530501 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb3a68b40 0x557bb3a67090 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc099690 tx=0x7fbbcc09ce00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b980be44809bb82 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:36:13.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.835+0000 7fbbd0dea640 1 -- 172.21.15.33:0/1862530501 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc099330 con 0x557bb3a68b40 2024-09-12T12:36:13.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.835+0000 7fbbd0dea640 1 -- 172.21.15.33:0/1862530501 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbbcc09c110 con 0x557bb3a68b40 2024-09-12T12:36:13.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.836+0000 7fbbe6669740 1 -- 172.21.15.33:0/1862530501 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb3a68b40 msgr2=0x557bb3a67090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:13.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.836+0000 7fbbe6669740 1 --2- 172.21.15.33:0/1862530501 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb3a68b40 0x557bb3a67090 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc099690 tx=0x7fbbcc09ce00 comp rx=0 tx=0).stop 2024-09-12T12:36:13.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.836+0000 7fbbe6669740 1 -- 172.21.15.33:0/1862530501 shutdown_connections 2024-09-12T12:36:13.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.836+0000 7fbbe6669740 1 --2- 172.21.15.33:0/1862530501 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557bb3a72370 0x557bb3a74760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:13.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.836+0000 7fbbe6669740 1 --2- 172.21.15.33:0/1862530501 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb3a675d0 0x557bb3a67a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:13.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.836+0000 7fbbe6669740 1 --2- 172.21.15.33:0/1862530501 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb3a68b40 0x557bb3a67090 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:13.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.836+0000 7fbbe6669740 1 -- 172.21.15.33:0/1862530501 >> 172.21.15.33:0/1862530501 conn(0x557bb3a30310 msgr2=0x557bb3a63c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:36:13.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.837+0000 7fbbe6669740 1 -- 172.21.15.33:0/1862530501 shutdown_connections 2024-09-12T12:36:13.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.837+0000 7fbbe6669740 1 -- 172.21.15.33:0/1862530501 wait complete. 2024-09-12T12:36:13.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.837+0000 7fbbe6669740 1 -- start start 2024-09-12T12:36:13.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.837+0000 7fbbe6669740 1 Processor -- start 2024-09-12T12:36:13.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.837+0000 7fbbe6669740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb3a675d0 0x557bb3a71b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:13.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.837+0000 7fbbe6669740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557bb3a72370 0x557bb3a6ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:13.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.837+0000 7fbbe6669740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb3a6f350 0x557bb3a6f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:13.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.837+0000 7fbbe6669740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x557bb3a750c0 con 0x557bb3a72370 2024-09-12T12:36:13.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.837+0000 7fbbe6669740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557bb3988060 con 0x557bb3a6f350 2024-09-12T12:36:13.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.837+0000 7fbbe6669740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557bb3a75240 con 0x557bb3a675d0 2024-09-12T12:36:13.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.838+0000 7fbbe6669740 10 client.0 _ll_register_callbacks cb 0x557bb36db8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:36:13.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.839+0000 7fbbe202c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb3a675d0 0x557bb3a71b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:13.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.839+0000 7fbbe282d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb3a6f350 0x557bb3a6f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:13.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.839+0000 7fbbe202c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb3a675d0 0x557bb3a71b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:53886/0 (socket says 172.21.15.33:53886) 2024-09-12T12:36:13.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.839+0000 7fbbe202c640 1 -- 172.21.15.33:0/3765041076 learned_addr learned my addr 172.21.15.33:0/3765041076 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:36:13.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.845+0000 7fbbe182b640 1 --2- 172.21.15.33:0/3765041076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557bb3a72370 0x557bb3a6ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:13.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.845+0000 7fbbe282d640 1 -- 172.21.15.33:0/3765041076 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb3a675d0 msgr2=0x557bb3a71b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:36:13.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.845+0000 7fbbe282d640 1 --2- 172.21.15.33:0/3765041076 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb3a675d0 0x557bb3a71b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:13.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.845+0000 7fbbe282d640 1 -- 172.21.15.33:0/3765041076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557bb3a72370 msgr2=0x557bb3a6ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:36:13.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.845+0000 7fbbe282d640 1 --2- 172.21.15.33:0/3765041076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557bb3a72370 0x557bb3a6ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:13.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.845+0000 7fbbe282d640 1 -- 172.21.15.33:0/3765041076 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557bb373e3c0 con 0x557bb3a6f350 2024-09-12T12:36:13.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.845+0000 7fbbe282d640 1 --2- 172.21.15.33:0/1116237190 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fbbc80a2d00 0x7fbbc80a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:13.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.845+0000 7fbbe182b640 1 --2- 172.21.15.33:0/3765041076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557bb3a72370 0x557bb3a6ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:36:13.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.846+0000 7fbbe282d640 1 --2- 172.21.15.33:0/3765041076 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb3a6f350 0x557bb3a6f7d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8009f90 tx=0x7fbbd8010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=870a87036c242793 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:36:13.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.846+0000 7fbbc5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:36:13.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.846+0000 7fbbc5ffb640 1 -- 172.21.15.33:0/3765041076 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd8021060 con 0x557bb3a6f350 2024-09-12T12:36:13.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.846+0000 7fbbc5ffb640 1 -- 172.21.15.33:0/3765041076 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fbbd8011810 con 0x557bb3a6f350 2024-09-12T12:36:13.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.846+0000 7fbbe6669740 1 -- 172.21.15.33:0/3765041076 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557bb39da860 con 0x557bb3a6f350 2024-09-12T12:36:13.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.846+0000 7fbbc5ffb640 1 -- 172.21.15.33:0/3765041076 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbbd802a050 con 0x557bb3a6f350 2024-09-12T12:36:13.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.846+0000 7fbbe6669740 10 client.25892 fetch_fsmap learned FSMap version 27 2024-09-12T12:36:13.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.847+0000 7fbbe6669740 1 -- 172.21.15.33:0/3765041076 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557bb3aa2ed0 con 0x557bb3a6f350 2024-09-12T12:36:13.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.847+0000 7fbbe282d640 1 --2- 172.21.15.33:0/1116237190 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fbbc80a2d00 0x7fbbc80a51c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x557bb3a703c0 tx=0x7fbbd801b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:36:13.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.850+0000 7fbbc5ffb640 1 -- 172.21.15.33:0/3765041076 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x557bb39da860 con 0x557bb3a6f350 2024-09-12T12:36:13.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.850+0000 7fbbc5ffb640 1 -- 172.21.15.33:0/3765041076 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fbbd80048f0 con 0x557bb3a6f350 2024-09-12T12:36:13.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.850+0000 7fbbe6669740 10 client.25892 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:36:13.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.850+0000 7fbbe6669740 10 client.25892 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-12T12:36:13.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.850+0000 7fbbe6669740 20 client.25892 populate_metadata read hostname 'smithi033' 2024-09-12T12:36:13.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.850+0000 7fbbe6669740 1 --2- 172.21.15.33:0/3765041076 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x557bb3aa4430 0x557bb3aa6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:13.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.850+0000 7fbbe6669740 4 client.25892 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:36:13.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.850+0000 7fbbe6669740 1 -- 172.21.15.33:0/3765041076 --> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557bb39d4d70 con 0x557bb3aa4430 2024-09-12T12:36:13.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.852+0000 7fbbe202c640 1 --2- 172.21.15.33:0/3765041076 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x557bb3aa4430 0x557bb3aa6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:13.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.853+0000 7fbbe202c640 1 --2- 172.21.15.33:0/3765041076 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x557bb3aa4430 0x557bb3aa6850 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a25309c7ea049ddc server_cookie=870c43b750348df7 in_seq=0 out_seq=0 2024-09-12T12:36:13.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.853+0000 7fbbc5ffb640 10 client.25892 ms_handle_connect on v2:172.21.15.102:6836/2409953270 2024-09-12T12:36:13.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.856+0000 7fbbc5ffb640 1 -- 172.21.15.33:0/3765041076 <== mds.1 v2:172.21.15.102:6836/2409953270 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557bb39d4d70 con 0x557bb3aa4430 2024-09-12T12:36:13.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.856+0000 7fbbc5ffb640 10 client.25892 handle_command_reply: tid=0 2024-09-12T12:36:13.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.856+0000 7fbbe6669740 1 client.25892 shutdown 2024-09-12T12:36:13.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.856+0000 7fbbe6669740 1 -- 172.21.15.33:0/3765041076 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb3a6f350 msgr2=0x557bb3a6f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:13.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.856+0000 7fbbe6669740 1 --2- 172.21.15.33:0/3765041076 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb3a6f350 0x557bb3a6f7d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8009f90 tx=0x7fbbd8010860 comp rx=0 tx=0).stop 2024-09-12T12:36:13.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.859+0000 7fbbe6669740 1 -- 172.21.15.33:0/3765041076 shutdown_connections 2024-09-12T12:36:13.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.859+0000 7fbbe6669740 1 --2- 172.21.15.33:0/3765041076 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb3a6f350 0x557bb3a6f7d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:13.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.859+0000 7fbbe6669740 1 --2- 172.21.15.33:0/3765041076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557bb3a72370 0x557bb3a6ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:13.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.859+0000 7fbbe6669740 1 --2- 172.21.15.33:0/3765041076 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x557bb3aa4430 0x557bb3aa6850 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:13.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.859+0000 7fbbe6669740 1 --2- 172.21.15.33:0/3765041076 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb3a675d0 0x557bb3a71b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:13.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.859+0000 7fbbe6669740 1 -- 172.21.15.33:0/3765041076 >> 172.21.15.33:0/3765041076 conn(0x557bb3a30310 msgr2=0x557bb3a699c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:36:13.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.859+0000 7fbbc5ffb640 0 client.25892 ms_handle_reset on v2:172.21.15.102:6836/2409953270 2024-09-12T12:36:13.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.863+0000 7fbbe6669740 1 -- 172.21.15.33:0/3765041076 shutdown_connections 2024-09-12T12:36:13.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.863+0000 7fbbe6669740 1 -- 172.21.15.33:0/3765041076 wait complete. 2024-09-12T12:36:13.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.863+0000 7fbbe6669740 20 client.25892 trim_cache size 0 max 16384 2024-09-12T12:36:13.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:13 smithi043 ceph-mon[34144]: pgmap v656: 129 pgs: 129 active+clean; 10 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 28 MiB/s wr, 549 op/s 2024-09-12T12:36:13.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:13 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:36:13.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:13 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:36:13.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.889+0000 7fbbe6669740 1 Processor -- start 2024-09-12T12:36:13.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.889+0000 7fbbe6669740 1 -- start start 2024-09-12T12:36:13.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.889+0000 7fbbe6669740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb3a675d0 0x557bb3a74800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:13.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.889+0000 7fbbe6669740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557bb3a6f350 0x557bb3a6ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:13.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.890+0000 7fbbe202c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb3a675d0 0x557bb3a74800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:13.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.890+0000 7fbbe202c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb3a675d0 0x557bb3a74800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:44448/0 (socket says 172.21.15.33:44448) 2024-09-12T12:36:13.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.890+0000 7fbbe182b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557bb3a6f350 0x557bb3a6ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:13.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.890+0000 7fbbe182b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557bb3a6f350 0x557bb3a6ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47144/0 (socket says 172.21.15.33:47144) 2024-09-12T12:36:13.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.890+0000 7fbbe202c640 1 -- 172.21.15.33:0/3763382124 learned_addr learned my addr 172.21.15.33:0/3763382124 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:36:13.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.890+0000 7fbbe6669740 1 --2- 172.21.15.33:0/3763382124 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb3a72370 0x557bb3a73760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:13.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.890+0000 7fbbe6669740 1 -- 172.21.15.33:0/3763382124 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc00125c0 con 0x557bb3a6f350 2024-09-12T12:36:13.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.890+0000 7fbbe6669740 1 -- 172.21.15.33:0/3763382124 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc000fe90 con 0x557bb3a675d0 2024-09-12T12:36:13.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.890+0000 7fbbe6669740 1 -- 172.21.15.33:0/3763382124 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc000dce0 con 0x557bb3a72370 2024-09-12T12:36:13.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.892+0000 7fbbe282d640 1 --2- 172.21.15.33:0/3763382124 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb3a72370 0x557bb3a73760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:13.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.892+0000 7fbbe202c640 1 -- 172.21.15.33:0/3763382124 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb3a72370 msgr2=0x557bb3a73760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:36:13.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.892+0000 7fbbe202c640 1 --2- 172.21.15.33:0/3763382124 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb3a72370 0x557bb3a73760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:13.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.892+0000 7fbbe202c640 1 -- 172.21.15.33:0/3763382124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557bb3a6f350 msgr2=0x557bb3a6ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:36:13.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.892+0000 7fbbe202c640 1 --2- 172.21.15.33:0/3763382124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557bb3a6f350 0x557bb3a6ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:13.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.892+0000 7fbbe202c640 1 -- 172.21.15.33:0/3763382124 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557bb3a641a0 con 0x557bb3a675d0 2024-09-12T12:36:13.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.895+0000 7fbbe202c640 1 --2- 172.21.15.33:0/3763382124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb3a675d0 0x557bb3a74800 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc01a010 tx=0x7fbbcc01a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6786cd74e81bf542 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:36:13.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.896+0000 7fbbc7fff640 1 -- 172.21.15.33:0/3763382124 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc0aa070 con 0x557bb3a675d0 2024-09-12T12:36:13.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.896+0000 7fbbc7fff640 1 -- 172.21.15.33:0/3763382124 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbbcc0bb070 con 0x557bb3a675d0 2024-09-12T12:36:13.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.896+0000 7fbbc7fff640 1 -- 172.21.15.33:0/3763382124 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc09c110 con 0x557bb3a675d0 2024-09-12T12:36:13.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:13 smithi102 ceph-mon[34799]: pgmap v656: 129 pgs: 129 active+clean; 10 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 28 MiB/s wr, 549 op/s 2024-09-12T12:36:13.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:13 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:36:13.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:13 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:36:13.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.897+0000 7fbbe6669740 1 -- 172.21.15.33:0/3763382124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb3a675d0 msgr2=0x557bb3a74800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:13.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.897+0000 7fbbe6669740 1 --2- 172.21.15.33:0/3763382124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb3a675d0 0x557bb3a74800 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc01a010 tx=0x7fbbcc01a040 comp rx=0 tx=0).stop 2024-09-12T12:36:13.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.899+0000 7fbbe6669740 1 -- 172.21.15.33:0/3763382124 shutdown_connections 2024-09-12T12:36:13.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.899+0000 7fbbe6669740 1 --2- 172.21.15.33:0/3763382124 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb3a72370 0x557bb3a73760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:13.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.899+0000 7fbbe6669740 1 --2- 172.21.15.33:0/3763382124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557bb3a6f350 0x557bb3a6ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:13.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.899+0000 7fbbe6669740 1 --2- 172.21.15.33:0/3763382124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb3a675d0 0x557bb3a74800 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:13.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.899+0000 7fbbe6669740 1 -- 172.21.15.33:0/3763382124 >> 172.21.15.33:0/3763382124 conn(0x557bb3a30310 msgr2=0x557bb3a6d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:36:13.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.903+0000 7fbbe6669740 1 -- 172.21.15.33:0/3763382124 shutdown_connections 2024-09-12T12:36:13.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.903+0000 7fbbe6669740 1 -- 172.21.15.33:0/3763382124 wait complete. 2024-09-12T12:36:13.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.904+0000 7fbbe6669740 1 -- start start 2024-09-12T12:36:13.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.904+0000 7fbbe6669740 1 Processor -- start 2024-09-12T12:36:13.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.904+0000 7fbbe6669740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb3a675d0 0x557bb3a7a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:13.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.905+0000 7fbbe6669740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb3a6f350 0x557bb3a7ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:13.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.905+0000 7fbbe6669740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557bb3a72370 0x557bb3a6c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:13.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.905+0000 7fbbe182b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb3a6f350 0x557bb3a7ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:13.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.905+0000 7fbbe182b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb3a6f350 0x557bb3a7ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:53900/0 (socket says 172.21.15.33:53900) 2024-09-12T12:36:13.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.905+0000 7fbbe182b640 1 -- 172.21.15.33:0/651129746 learned_addr learned my addr 172.21.15.33:0/651129746 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:36:13.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.905+0000 7fbbe6669740 1 -- 172.21.15.33:0/651129746 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc000e350 con 0x557bb3a72370 2024-09-12T12:36:13.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.905+0000 7fbbe6669740 1 -- 172.21.15.33:0/651129746 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc000f7c0 con 0x557bb3a675d0 2024-09-12T12:36:13.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.905+0000 7fbbe6669740 1 -- 172.21.15.33:0/651129746 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc000ea20 con 0x557bb3a6f350 2024-09-12T12:36:13.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.906+0000 7fbbe202c640 1 --2- 172.21.15.33:0/651129746 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb3a675d0 0x557bb3a7a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:13.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.906+0000 7fbbe282d640 1 --2- 172.21.15.33:0/651129746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557bb3a72370 0x557bb3a6c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:13.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.906+0000 7fbbe6669740 10 client.0 _ll_register_callbacks cb 0x7fbbdc110870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:36:13.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.906+0000 7fbbe182b640 1 -- 172.21.15.33:0/651129746 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb3a675d0 msgr2=0x557bb3a7a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:36:13.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.906+0000 7fbbe182b640 1 --2- 172.21.15.33:0/651129746 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb3a675d0 0x557bb3a7a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:13.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.906+0000 7fbbe182b640 1 -- 172.21.15.33:0/651129746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557bb3a72370 msgr2=0x557bb3a6c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:36:13.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.906+0000 7fbbe182b640 1 --2- 172.21.15.33:0/651129746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557bb3a72370 0x557bb3a6c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:13.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.906+0000 7fbbe182b640 1 -- 172.21.15.33:0/651129746 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557bb3a6c5d0 con 0x557bb3a6f350 2024-09-12T12:36:13.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.906+0000 7fbbe6669740 1 -- 172.21.15.33:0/651129746 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbcc0bb070 con 0x557bb3a6f350 2024-09-12T12:36:13.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.906+0000 7fbbe182b640 1 --2- 172.21.15.33:0/651129746 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb3a6f350 0x557bb3a7ab00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbbd402aec0 tx=0x7fbbd4031e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17116d7d1610f672 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:36:13.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.911+0000 7fbbc5ffb640 10 client.26017 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:36:13.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.911+0000 7fbbc5ffb640 1 -- 172.21.15.33:0/651129746 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd4031670 con 0x557bb3a6f350 2024-09-12T12:36:13.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.911+0000 7fbbc5ffb640 1 -- 172.21.15.33:0/651129746 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fbbd4031810 con 0x557bb3a6f350 2024-09-12T12:36:13.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.911+0000 7fbbc5ffb640 1 -- 172.21.15.33:0/651129746 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbbd4004b40 con 0x557bb3a6f350 2024-09-12T12:36:13.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.912+0000 7fbbe6669740 10 client.26017 fetch_fsmap learned FSMap version 27 2024-09-12T12:36:13.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.912+0000 7fbbe6669740 1 -- 172.21.15.33:0/651129746 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({fsmap=27}) -- 0x557bb3aab7f0 con 0x557bb3a6f350 2024-09-12T12:36:13.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.915+0000 7fbbc5ffb640 1 -- 172.21.15.33:0/651129746 <== mon.1 v2:172.21.15.102:3300/0 4 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fbbd4003970 con 0x557bb3a6f350 2024-09-12T12:36:13.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.915+0000 7fbbe6669740 10 client.26017 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:36:13.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.915+0000 7fbbe6669740 10 client.26017 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-12T12:36:13.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.915+0000 7fbbe6669740 20 client.26017 populate_metadata read hostname 'smithi033' 2024-09-12T12:36:13.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.915+0000 7fbbe6669740 1 --2- 172.21.15.33:0/651129746 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x557bb3b0f110 0x557bb3b11500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:13.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.916+0000 7fbbe6669740 4 client.26017 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:36:13.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.916+0000 7fbbe6669740 1 -- 172.21.15.33:0/651129746 --> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557bb3951170 con 0x557bb3b0f110 2024-09-12T12:36:13.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.916+0000 7fbbe202c640 1 --2- 172.21.15.33:0/651129746 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x557bb3b0f110 0x557bb3b11500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:13.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.916+0000 7fbbe202c640 1 --2- 172.21.15.33:0/651129746 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x557bb3b0f110 0x557bb3b11500 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=11f69ceb639632a7 server_cookie=374333c7dced0bcc in_seq=0 out_seq=0 2024-09-12T12:36:13.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.916+0000 7fbbc5ffb640 10 client.26017 ms_handle_connect on v2:172.21.15.102:6836/2409953270 2024-09-12T12:36:13.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.917+0000 7fbbc5ffb640 1 -- 172.21.15.33:0/651129746 <== mds.1 v2:172.21.15.102:6836/2409953270 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557bb3951170 con 0x557bb3b0f110 2024-09-12T12:36:13.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.918+0000 7fbbc5ffb640 10 client.26017 handle_command_reply: tid=0 2024-09-12T12:36:13.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.918+0000 7fbbe6669740 1 client.26017 shutdown 2024-09-12T12:36:13.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.920+0000 7fbbe6669740 1 -- 172.21.15.33:0/651129746 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb3a6f350 msgr2=0x557bb3a7ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:13.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.920+0000 7fbbe6669740 1 --2- 172.21.15.33:0/651129746 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb3a6f350 0x557bb3a7ab00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbbd402aec0 tx=0x7fbbd4031e00 comp rx=0 tx=0).stop 2024-09-12T12:36:13.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.920+0000 7fbbe6669740 1 -- 172.21.15.33:0/651129746 shutdown_connections 2024-09-12T12:36:13.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.920+0000 7fbbe6669740 1 --2- 172.21.15.33:0/651129746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557bb3a72370 0x557bb3a6c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:13.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.920+0000 7fbbe6669740 1 --2- 172.21.15.33:0/651129746 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x557bb3b0f110 0x557bb3b11500 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:13.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.920+0000 7fbbe6669740 1 --2- 172.21.15.33:0/651129746 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bb3a6f350 0x557bb3a7ab00 secure :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbbd402aec0 tx=0x7fbbd4031e00 comp rx=0 tx=0).stop 2024-09-12T12:36:13.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.920+0000 7fbbe6669740 1 --2- 172.21.15.33:0/651129746 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb3a675d0 0x557bb3a7a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:13.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.920+0000 7fbbe6669740 1 -- 172.21.15.33:0/651129746 >> 172.21.15.33:0/651129746 conn(0x557bb3a30310 msgr2=0x557bb3a6df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:36:13.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.921+0000 7fbbc5ffb640 0 client.26017 ms_handle_reset on v2:172.21.15.102:6836/2409953270 2024-09-12T12:36:13.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.921+0000 7fbbe6669740 1 -- 172.21.15.33:0/651129746 shutdown_connections 2024-09-12T12:36:13.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.921+0000 7fbbe6669740 1 -- 172.21.15.33:0/651129746 wait complete. 2024-09-12T12:36:13.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.921+0000 7fbbe6669740 20 client.26017 trim_cache size 0 max 16384 2024-09-12T12:36:13.924 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-09-12T12:36:13.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.925+0000 7fbbe4290640 1 -- 172.21.15.33:0/1116237190 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fbbc80a2d00 msgr2=0x7fbbc80a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:13.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.925+0000 7fbbe4290640 1 --2- 172.21.15.33:0/1116237190 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fbbc80a2d00 0x7fbbc80a51c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x557bb3a703c0 tx=0x7fbbd801b000 comp rx=0 tx=0).stop 2024-09-12T12:36:13.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.925+0000 7fbbe4290640 1 -- 172.21.15.33:0/1116237190 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbbdc109450 msgr2=0x7fbbdc118680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:13.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.925+0000 7fbbe4290640 1 --2- 172.21.15.33:0/1116237190 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbbdc109450 0x7fbbdc118680 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc00e9f0 tx=0x7fbbcc00eeb0 comp rx=0 tx=0).stop 2024-09-12T12:36:13.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.925+0000 7fbbe4290640 1 -- 172.21.15.33:0/1116237190 shutdown_connections 2024-09-12T12:36:13.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.925+0000 7fbbe4290640 1 --2- 172.21.15.33:0/1116237190 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fbbc80a2d00 0x7fbbc80a51c0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:13.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.925+0000 7fbbe4290640 1 --2- 172.21.15.33:0/1116237190 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbbdc11b140 0x7fbbdc1118c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:13.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.925+0000 7fbbe4290640 1 --2- 172.21.15.33:0/1116237190 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbdc109830 0x7fbbdc118bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:13.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.925+0000 7fbbe4290640 1 --2- 172.21.15.33:0/1116237190 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbbdc109450 0x7fbbdc118680 secure :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc00e9f0 tx=0x7fbbcc00eeb0 comp rx=0 tx=0).stop 2024-09-12T12:36:13.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.925+0000 7fbbe4290640 1 -- 172.21.15.33:0/1116237190 >> 172.21.15.33:0/1116237190 conn(0x7fbbdc06e140 msgr2=0x7fbbdc11c230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:36:13.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.928+0000 7fbbe4290640 1 -- 172.21.15.33:0/1116237190 shutdown_connections 2024-09-12T12:36:13.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:13.928+0000 7fbbe4290640 1 -- 172.21.15.33:0/1116237190 wait complete. 2024-09-12T12:36:14.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:14 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:36:14.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:14 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:36:14.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:14 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:36:14.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:14 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:36:14.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:14 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:36:14.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:14 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:36:14.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:14 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:36:14.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:14 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:36:14.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:14 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:36:16.079 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T12:36:16.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:15 smithi033 ceph-mon[31246]: pgmap v657: 129 pgs: 129 active+clean; 10 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 29 MiB/s wr, 587 op/s 2024-09-12T12:36:16.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:15 smithi043 ceph-mon[34144]: pgmap v657: 129 pgs: 129 active+clean; 10 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 29 MiB/s wr, 587 op/s 2024-09-12T12:36:16.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:15 smithi102 ceph-mon[34799]: pgmap v657: 129 pgs: 129 active+clean; 10 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 29 MiB/s wr, 587 op/s 2024-09-12T12:36:16.757 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:36:17.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.415+0000 7f6adeb9d640 1 -- 172.21.15.33:0/2236848871 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ad8074590 msgr2=0x7f6ad8074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:17.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.415+0000 7f6adeb9d640 1 --2- 172.21.15.33:0/2236848871 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ad8074590 0x7f6ad8074970 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0009ca0 tx=0x7f6ad002a8f0 comp rx=0 tx=0).stop 2024-09-12T12:36:17.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.420+0000 7f6adeb9d640 1 -- 172.21.15.33:0/2236848871 shutdown_connections 2024-09-12T12:36:17.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.420+0000 7f6adeb9d640 1 --2- 172.21.15.33:0/2236848871 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ad8112bc0 0x7f6ad8114fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:17.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.420+0000 7f6adeb9d640 1 --2- 172.21.15.33:0/2236848871 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ad8074eb0 0x7f6ad8112680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:17.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.420+0000 7f6adeb9d640 1 --2- 172.21.15.33:0/2236848871 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ad8074590 0x7f6ad8074970 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:17.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.420+0000 7f6adeb9d640 1 -- 172.21.15.33:0/2236848871 >> 172.21.15.33:0/2236848871 conn(0x7f6ad80fd8d0 msgr2=0x7f6ad80ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:36:17.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.424+0000 7f6adeb9d640 1 -- 172.21.15.33:0/2236848871 shutdown_connections 2024-09-12T12:36:17.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.427+0000 7f6adeb9d640 1 -- 172.21.15.33:0/2236848871 wait complete. 2024-09-12T12:36:17.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.428+0000 7f6adeb9d640 1 Processor -- start 2024-09-12T12:36:17.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.432+0000 7f6adeb9d640 1 -- start start 2024-09-12T12:36:17.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.432+0000 7f6adeb9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ad8074590 0x7f6ad81120f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:17.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.432+0000 7f6adeb9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ad8074eb0 0x7f6ad8112630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:17.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.432+0000 7f6adeb9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ad8112bc0 0x7f6ad810b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:17.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.432+0000 7f6adeb9d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad8118610 con 0x7f6ad8074590 2024-09-12T12:36:17.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.432+0000 7f6adeb9d640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad8118490 con 0x7f6ad8112bc0 2024-09-12T12:36:17.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.432+0000 7f6adeb9d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad8118790 con 0x7f6ad8074eb0 2024-09-12T12:36:17.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.433+0000 7f6ad7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ad8074eb0 0x7f6ad8112630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:17.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.433+0000 7f6add13a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ad8112bc0 0x7f6ad810b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:17.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.433+0000 7f6adc939640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ad8074590 0x7f6ad81120f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:17.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.433+0000 7f6adc939640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ad8074590 0x7f6ad81120f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47174/0 (socket says 172.21.15.33:47174) 2024-09-12T12:36:17.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.433+0000 7f6add13a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ad8112bc0 0x7f6ad810b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:44488/0 (socket says 172.21.15.33:44488) 2024-09-12T12:36:17.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.433+0000 7f6adc939640 1 -- 172.21.15.33:0/2925604330 learned_addr learned my addr 172.21.15.33:0/2925604330 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:36:17.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.434+0000 7f6add13a640 1 -- 172.21.15.33:0/2925604330 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ad8074eb0 msgr2=0x7f6ad8112630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:17.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.434+0000 7f6add13a640 1 --2- 172.21.15.33:0/2925604330 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ad8074eb0 0x7f6ad8112630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:17.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.434+0000 7f6add13a640 1 -- 172.21.15.33:0/2925604330 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ad8074590 msgr2=0x7f6ad81120f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:17.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.434+0000 7f6add13a640 1 --2- 172.21.15.33:0/2925604330 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ad8074590 0x7f6ad81120f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:17.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.434+0000 7f6add13a640 1 -- 172.21.15.33:0/2925604330 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ad810bbd0 con 0x7f6ad8112bc0 2024-09-12T12:36:17.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.434+0000 7f6adc939640 1 --2- 172.21.15.33:0/2925604330 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ad8074590 0x7f6ad81120f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:36:17.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.434+0000 7f6ad7fff640 1 --2- 172.21.15.33:0/2925604330 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ad8074eb0 0x7f6ad8112630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:36:17.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.435+0000 7f6add13a640 1 --2- 172.21.15.33:0/2925604330 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ad8112bc0 0x7f6ad810b310 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6ac800b3e0 tx=0x7f6ac800b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:36:17.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.439+0000 7f6ad5ffb640 1 -- 172.21.15.33:0/2925604330 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac8015020 con 0x7f6ad8112bc0 2024-09-12T12:36:17.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.439+0000 7f6ad5ffb640 1 -- 172.21.15.33:0/2925604330 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6ac8011ce0 con 0x7f6ad8112bc0 2024-09-12T12:36:17.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.439+0000 7f6ad5ffb640 1 -- 172.21.15.33:0/2925604330 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac8010e00 con 0x7f6ad8112bc0 2024-09-12T12:36:17.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.439+0000 7f6adeb9d640 1 -- 172.21.15.33:0/2925604330 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ad810bec0 con 0x7f6ad8112bc0 2024-09-12T12:36:17.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.439+0000 7f6adeb9d640 1 -- 172.21.15.33:0/2925604330 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ad810fea0 con 0x7f6ad8112bc0 2024-09-12T12:36:17.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.444+0000 7f6ad5ffb640 1 -- 172.21.15.33:0/2925604330 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6ac8018020 con 0x7f6ad8112bc0 2024-09-12T12:36:17.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.446+0000 7f6ad5ffb640 1 --2- 172.21.15.33:0/2925604330 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f6ac00a2da0 0x7f6ac00a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:17.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.447+0000 7f6ad5ffb640 1 -- 172.21.15.33:0/2925604330 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f6ac80ceba0 con 0x7f6ad8112bc0 2024-09-12T12:36:17.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.447+0000 7f6adc939640 1 --2- 172.21.15.33:0/2925604330 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f6ac00a2da0 0x7f6ac00a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:17.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.449+0000 7f6ae0f76740 1 Processor -- start 2024-09-12T12:36:17.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.451+0000 7f6ae0f76740 1 -- start start 2024-09-12T12:36:17.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.451+0000 7f6ae0f76740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5576c2281b40 0x5576c2280090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:17.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.451+0000 7f6ae0f76740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5576c22805d0 0x5576c2280a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:17.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.451+0000 7f6ae0f76740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c228b370 0x5576c228d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:17.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.451+0000 7f6ae0f76740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5576c21e62f0 con 0x5576c2281b40 2024-09-12T12:36:17.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.451+0000 7f6ae0f76740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5576c218dcf0 con 0x5576c22805d0 2024-09-12T12:36:17.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.451+0000 7f6ae0f76740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5576c21e22b0 con 0x5576c228b370 2024-09-12T12:36:17.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.452+0000 7f6adc939640 1 --2- 172.21.15.33:0/2925604330 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f6ac00a2da0 0x7f6ac00a5260 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0005fa0 tx=0x7f6ad0005ef0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:36:17.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.452+0000 7f6add13a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c228b370 0x5576c228d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:17.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.452+0000 7f6add13a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c228b370 0x5576c228d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:53942/0 (socket says 172.21.15.33:53942) 2024-09-12T12:36:17.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.452+0000 7f6add13a640 1 -- 172.21.15.33:0/1656073866 learned_addr learned my addr 172.21.15.33:0/1656073866 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:36:17.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.455+0000 7f6adc939640 1 --2- 172.21.15.33:0/1656073866 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5576c2281b40 0x5576c2280090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:17.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.456+0000 7f6ad7fff640 1 --2- 172.21.15.33:0/1656073866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5576c22805d0 0x5576c2280a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:17.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.456+0000 7f6ad7fff640 1 -- 172.21.15.33:0/1656073866 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c228b370 msgr2=0x5576c228d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:36:17.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.456+0000 7f6ad7fff640 1 --2- 172.21.15.33:0/1656073866 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c228b370 0x5576c228d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:17.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.456+0000 7f6ad7fff640 1 -- 172.21.15.33:0/1656073866 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5576c2281b40 msgr2=0x5576c2280090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:36:17.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.456+0000 7f6ad7fff640 1 --2- 172.21.15.33:0/1656073866 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5576c2281b40 0x5576c2280090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:17.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.456+0000 7f6ad7fff640 1 -- 172.21.15.33:0/1656073866 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576c21723a0 con 0x5576c22805d0 2024-09-12T12:36:17.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.457+0000 7f6ad7fff640 1 --2- 172.21.15.33:0/1656073866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5576c22805d0 0x5576c2280a10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6ad810c9d0 tx=0x7f6acc00e5a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49f3e2c92d8dbb8e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:36:17.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.457+0000 7f6abeffd640 1 -- 172.21.15.33:0/1656073866 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6acc017070 con 0x5576c22805d0 2024-09-12T12:36:17.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.457+0000 7f6abeffd640 1 -- 172.21.15.33:0/1656073866 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6acc00ee90 con 0x5576c22805d0 2024-09-12T12:36:17.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.458+0000 7f6ae0f76740 1 -- 172.21.15.33:0/1656073866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5576c22805d0 msgr2=0x5576c2280a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:17.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.458+0000 7f6ae0f76740 1 --2- 172.21.15.33:0/1656073866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5576c22805d0 0x5576c2280a10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6ad810c9d0 tx=0x7f6acc00e5a0 comp rx=0 tx=0).stop 2024-09-12T12:36:17.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.464+0000 7f6ae0f76740 1 -- 172.21.15.33:0/1656073866 shutdown_connections 2024-09-12T12:36:17.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.464+0000 7f6ae0f76740 1 --2- 172.21.15.33:0/1656073866 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c228b370 0x5576c228d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:17.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.464+0000 7f6ae0f76740 1 --2- 172.21.15.33:0/1656073866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5576c22805d0 0x5576c2280a10 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:17.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.464+0000 7f6ae0f76740 1 --2- 172.21.15.33:0/1656073866 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5576c2281b40 0x5576c2280090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:17.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.464+0000 7f6ae0f76740 1 -- 172.21.15.33:0/1656073866 >> 172.21.15.33:0/1656073866 conn(0x5576c2249310 msgr2=0x5576c227cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:36:17.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.464+0000 7f6ae0f76740 1 -- 172.21.15.33:0/1656073866 shutdown_connections 2024-09-12T12:36:17.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.464+0000 7f6ae0f76740 1 -- 172.21.15.33:0/1656073866 wait complete. 2024-09-12T12:36:17.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.465+0000 7f6ae0f76740 1 -- start start 2024-09-12T12:36:17.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.465+0000 7f6ae0f76740 1 Processor -- start 2024-09-12T12:36:17.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.468+0000 7f6ae0f76740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5576c22805d0 0x5576c228abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:17.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.468+0000 7f6ae0f76740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c2281b40 0x5576c2287e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:17.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.468+0000 7f6ae0f76740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5576c228b370 0x5576c22883b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:17.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.468+0000 7f6ae0f76740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5576c229f0d0 con 0x5576c228b370 2024-09-12T12:36:17.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.468+0000 7f6ae0f76740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5576c21a1060 con 0x5576c22805d0 2024-09-12T12:36:17.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.468+0000 7f6ae0f76740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5576c229f250 con 0x5576c2281b40 2024-09-12T12:36:17.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.468+0000 7f6ae0f76740 10 client.0 _ll_register_callbacks cb 0x5576c1ef48c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:36:17.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.469+0000 7f6add13a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5576c228b370 0x5576c22883b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:17.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.469+0000 7f6add13a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5576c228b370 0x5576c22883b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47206/0 (socket says 172.21.15.33:47206) 2024-09-12T12:36:17.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.469+0000 7f6add13a640 1 -- 172.21.15.33:0/454490314 learned_addr learned my addr 172.21.15.33:0/454490314 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:36:17.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.469+0000 7f6add13a640 1 -- 172.21.15.33:0/454490314 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c2281b40 msgr2=0x5576c2287e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:36:17.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.469+0000 7f6add13a640 1 --2- 172.21.15.33:0/454490314 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c2281b40 0x5576c2287e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:17.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.469+0000 7f6add13a640 1 -- 172.21.15.33:0/454490314 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5576c22805d0 msgr2=0x5576c228abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:36:17.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.469+0000 7f6add13a640 1 --2- 172.21.15.33:0/454490314 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5576c22805d0 0x5576c228abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:17.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.469+0000 7f6add13a640 1 -- 172.21.15.33:0/454490314 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576c1f573c0 con 0x5576c228b370 2024-09-12T12:36:17.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.470+0000 7f6add13a640 1 --2- 172.21.15.33:0/454490314 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5576c228b370 0x5576c22883b0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f6ac809ad10 tx=0x7f6ac809ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a59789e8697aea6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:36:17.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.470+0000 7f6ab7fff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:36:17.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.470+0000 7f6ab7fff640 1 -- 172.21.15.33:0/454490314 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac809b010 con 0x5576c228b370 2024-09-12T12:36:17.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.470+0000 7f6ae0f76740 1 -- 172.21.15.33:0/454490314 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6acc00ee90 con 0x5576c228b370 2024-09-12T12:36:17.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.470+0000 7f6ab7fff640 1 -- 172.21.15.33:0/454490314 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f6ac8097680 con 0x5576c228b370 2024-09-12T12:36:17.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.471+0000 7f6ab7fff640 1 -- 172.21.15.33:0/454490314 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6ac80ab050 con 0x5576c228b370 2024-09-12T12:36:17.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.471+0000 7f6ae0f76740 10 client.16212 fetch_fsmap learned FSMap version 27 2024-09-12T12:36:17.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.471+0000 7f6ae0f76740 1 -- 172.21.15.33:0/454490314 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5576c22aab30 con 0x5576c228b370 2024-09-12T12:36:17.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.471+0000 7f6ab7fff640 1 -- 172.21.15.33:0/454490314 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6acc00ee90 con 0x5576c228b370 2024-09-12T12:36:17.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.472+0000 7f6ab7fff640 1 -- 172.21.15.33:0/454490314 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f6ac8096d60 con 0x5576c228b370 2024-09-12T12:36:17.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.473+0000 7f6ae0f76740 10 client.16212 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:36:17.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.473+0000 7f6ae0f76740 10 client.16212 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:36:17.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.473+0000 7f6ae0f76740 20 client.16212 populate_metadata read hostname 'smithi033' 2024-09-12T12:36:17.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.473+0000 7f6ae0f76740 1 --2- 172.21.15.33:0/454490314 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5576c22ac510 0x5576c22ae9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:17.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.473+0000 7f6ae0f76740 4 client.16212 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:36:17.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.473+0000 7f6ae0f76740 1 -- 172.21.15.33:0/454490314 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5576c21f3860 con 0x5576c22ac510 2024-09-12T12:36:17.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.487+0000 7f6adc939640 1 --2- 172.21.15.33:0/454490314 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5576c22ac510 0x5576c22ae9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:17.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.494+0000 7f6ab7fff640 10 client.16212 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:36:17.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.494+0000 7f6adc939640 1 --2- 172.21.15.33:0/454490314 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5576c22ac510 0x5576c22ae9d0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34b691bda95ad2a5 server_cookie=6162f7b7cb602dae in_seq=0 out_seq=0 2024-09-12T12:36:17.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.495+0000 7f6ab7fff640 1 -- 172.21.15.33:0/454490314 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5576c21f3860 con 0x5576c22ac510 2024-09-12T12:36:17.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.495+0000 7f6ab7fff640 10 client.16212 handle_command_reply: tid=0 2024-09-12T12:36:17.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.495+0000 7f6ae0f76740 1 client.16212 shutdown 2024-09-12T12:36:17.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.495+0000 7f6ae0f76740 1 -- 172.21.15.33:0/454490314 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5576c228b370 msgr2=0x5576c22883b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:17.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.495+0000 7f6ae0f76740 1 --2- 172.21.15.33:0/454490314 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5576c228b370 0x5576c22883b0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f6ac809ad10 tx=0x7f6ac809ac10 comp rx=0 tx=0).stop 2024-09-12T12:36:17.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.496+0000 7f6ae0f76740 1 -- 172.21.15.33:0/454490314 shutdown_connections 2024-09-12T12:36:17.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.496+0000 7f6ae0f76740 1 --2- 172.21.15.33:0/454490314 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5576c22ac510 0x5576c22ae9d0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:17.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.496+0000 7f6ae0f76740 1 --2- 172.21.15.33:0/454490314 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5576c228b370 0x5576c22883b0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:17.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.496+0000 7f6ae0f76740 1 --2- 172.21.15.33:0/454490314 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c2281b40 0x5576c2287e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:17.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.496+0000 7f6ae0f76740 1 --2- 172.21.15.33:0/454490314 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5576c22805d0 0x5576c228abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:17.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.496+0000 7f6ae0f76740 1 -- 172.21.15.33:0/454490314 >> 172.21.15.33:0/454490314 conn(0x5576c2249310 msgr2=0x5576c2282960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:36:17.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.496+0000 7f6ab7fff640 0 client.16212 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:36:17.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.496+0000 7f6ae0f76740 1 -- 172.21.15.33:0/454490314 shutdown_connections 2024-09-12T12:36:17.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.496+0000 7f6ae0f76740 1 -- 172.21.15.33:0/454490314 wait complete. 2024-09-12T12:36:17.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.496+0000 7f6ae0f76740 20 client.16212 trim_cache size 0 max 16384 2024-09-12T12:36:17.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.527+0000 7f6ae0f76740 1 Processor -- start 2024-09-12T12:36:17.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.528+0000 7f6ae0f76740 1 -- start start 2024-09-12T12:36:17.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.528+0000 7f6ae0f76740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c22805d0 0x5576c22a8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:17.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.528+0000 7f6ae0f76740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5576c2281b40 0x5576c227bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:17.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.528+0000 7f6ae0f76740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5576c228b370 0x5576c228c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:17.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.529+0000 7f6ad7fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5576c2281b40 0x5576c227bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:17.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.529+0000 7f6ad7fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5576c2281b40 0x5576c227bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:44510/0 (socket says 172.21.15.33:44510) 2024-09-12T12:36:17.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.529+0000 7f6adc939640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c22805d0 0x5576c22a8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:17.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.529+0000 7f6adc939640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c22805d0 0x5576c22a8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:53960/0 (socket says 172.21.15.33:53960) 2024-09-12T12:36:17.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.529+0000 7f6ad7fff640 1 -- 172.21.15.33:0/786978046 learned_addr learned my addr 172.21.15.33:0/786978046 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:36:17.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.529+0000 7f6ae0f76740 1 -- 172.21.15.33:0/786978046 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad81b7b60 con 0x5576c228b370 2024-09-12T12:36:17.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.529+0000 7f6ae0f76740 1 -- 172.21.15.33:0/786978046 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad81b5430 con 0x5576c2281b40 2024-09-12T12:36:17.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.529+0000 7f6ae0f76740 1 -- 172.21.15.33:0/786978046 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad8072b80 con 0x5576c22805d0 2024-09-12T12:36:17.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.531+0000 7f6add13a640 1 --2- 172.21.15.33:0/786978046 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5576c228b370 0x5576c228c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:17.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.531+0000 7f6adc939640 1 -- 172.21.15.33:0/786978046 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5576c2281b40 msgr2=0x5576c227bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:36:17.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.531+0000 7f6adc939640 1 --2- 172.21.15.33:0/786978046 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5576c2281b40 0x5576c227bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:17.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.531+0000 7f6adc939640 1 -- 172.21.15.33:0/786978046 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5576c228b370 msgr2=0x5576c228c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:36:17.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.531+0000 7f6adc939640 1 --2- 172.21.15.33:0/786978046 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5576c228b370 0x5576c228c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:17.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.531+0000 7f6adc939640 1 -- 172.21.15.33:0/786978046 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576c22af050 con 0x5576c22805d0 2024-09-12T12:36:17.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.533+0000 7f6adc939640 1 --2- 172.21.15.33:0/786978046 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c22805d0 0x5576c22a8430 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x5576c22af220 tx=0x7f6ad003e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2bfd858572c97a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:36:17.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.535+0000 7f6abe7fc640 1 -- 172.21.15.33:0/786978046 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad0031740 con 0x5576c22805d0 2024-09-12T12:36:17.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.536+0000 7f6abe7fc640 1 -- 172.21.15.33:0/786978046 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6ad0059070 con 0x5576c22805d0 2024-09-12T12:36:17.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.536+0000 7f6abe7fc640 1 -- 172.21.15.33:0/786978046 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad0004400 con 0x5576c22805d0 2024-09-12T12:36:17.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.537+0000 7f6ae0f76740 1 -- 172.21.15.33:0/786978046 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c22805d0 msgr2=0x5576c22a8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:17.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.537+0000 7f6ae0f76740 1 --2- 172.21.15.33:0/786978046 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c22805d0 0x5576c22a8430 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x5576c22af220 tx=0x7f6ad003e000 comp rx=0 tx=0).stop 2024-09-12T12:36:17.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.537+0000 7f6ae0f76740 1 -- 172.21.15.33:0/786978046 shutdown_connections 2024-09-12T12:36:17.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.537+0000 7f6ae0f76740 1 --2- 172.21.15.33:0/786978046 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5576c228b370 0x5576c228c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:17.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.537+0000 7f6ae0f76740 1 --2- 172.21.15.33:0/786978046 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5576c2281b40 0x5576c227bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:17.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.537+0000 7f6ae0f76740 1 --2- 172.21.15.33:0/786978046 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c22805d0 0x5576c22a8430 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:17.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.537+0000 7f6ae0f76740 1 -- 172.21.15.33:0/786978046 >> 172.21.15.33:0/786978046 conn(0x5576c2249310 msgr2=0x5576c227b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:36:17.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.540+0000 7f6ae0f76740 1 -- 172.21.15.33:0/786978046 shutdown_connections 2024-09-12T12:36:17.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.540+0000 7f6ae0f76740 1 -- 172.21.15.33:0/786978046 wait complete. 2024-09-12T12:36:17.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.540+0000 7f6ae0f76740 1 -- start start 2024-09-12T12:36:17.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.540+0000 7f6ae0f76740 1 Processor -- start 2024-09-12T12:36:17.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.541+0000 7f6ae0f76740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5576c22805d0 0x5576c22a4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:17.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.541+0000 7f6ae0f76740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5576c2281b40 0x5576c22b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:17.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.541+0000 7f6ae0f76740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c228b370 0x5576c22b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:17.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.541+0000 7f6ae0f76740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad80731f0 con 0x5576c2281b40 2024-09-12T12:36:17.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.541+0000 7f6ae0f76740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad81b4d60 con 0x5576c22805d0 2024-09-12T12:36:17.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.541+0000 7f6ae0f76740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad80738c0 con 0x5576c228b370 2024-09-12T12:36:17.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.541+0000 7f6ae0f76740 10 client.0 _ll_register_callbacks cb 0x7f6ac8096c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:36:17.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.543+0000 7f6adc939640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5576c22805d0 0x5576c22a4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:17.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.543+0000 7f6adc939640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5576c22805d0 0x5576c22a4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:44518/0 (socket says 172.21.15.33:44518) 2024-09-12T12:36:17.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.543+0000 7f6adc939640 1 -- 172.21.15.33:0/2690028987 learned_addr learned my addr 172.21.15.33:0/2690028987 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:36:17.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.543+0000 7f6add13a640 1 --2- 172.21.15.33:0/2690028987 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c228b370 0x5576c22b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:17.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.545+0000 7f6ad7fff640 1 --2- 172.21.15.33:0/2690028987 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5576c2281b40 0x5576c22b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:17.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.545+0000 7f6adc939640 1 -- 172.21.15.33:0/2690028987 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c228b370 msgr2=0x5576c22b3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:36:17.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.545+0000 7f6adc939640 1 --2- 172.21.15.33:0/2690028987 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c228b370 0x5576c22b3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:17.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.545+0000 7f6adc939640 1 -- 172.21.15.33:0/2690028987 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5576c2281b40 msgr2=0x5576c22b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:36:17.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.545+0000 7f6adc939640 1 --2- 172.21.15.33:0/2690028987 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5576c2281b40 0x5576c22b38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:17.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.545+0000 7f6adc939640 1 -- 172.21.15.33:0/2690028987 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576c227d1a0 con 0x5576c22805d0 2024-09-12T12:36:17.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.547+0000 7f6adc939640 1 --2- 172.21.15.33:0/2690028987 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5576c22805d0 0x5576c22a4a20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0009a00 tx=0x7f6ad0004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f00b2acc1a248b54 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:36:17.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.547+0000 7f6ab7fff640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:36:17.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.548+0000 7f6ab7fff640 1 -- 172.21.15.33:0/2690028987 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad0062070 con 0x5576c22805d0 2024-09-12T12:36:17.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.548+0000 7f6ae0f76740 1 -- 172.21.15.33:0/2690028987 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ad0059070 con 0x5576c22805d0 2024-09-12T12:36:17.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.548+0000 7f6ab7fff640 1 -- 172.21.15.33:0/2690028987 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f6ad0031740 con 0x5576c22805d0 2024-09-12T12:36:17.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.548+0000 7f6ab7fff640 1 -- 172.21.15.33:0/2690028987 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6ad0004140 con 0x5576c22805d0 2024-09-12T12:36:17.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.549+0000 7f6ae0f76740 10 client.25907 fetch_fsmap learned FSMap version 27 2024-09-12T12:36:17.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.549+0000 7f6ae0f76740 1 -- 172.21.15.33:0/2690028987 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5576c22a30f0 con 0x5576c22805d0 2024-09-12T12:36:17.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.553+0000 7f6ab7fff640 1 -- 172.21.15.33:0/2690028987 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6ad0059070 con 0x5576c22805d0 2024-09-12T12:36:17.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.553+0000 7f6ab7fff640 1 -- 172.21.15.33:0/2690028987 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f6ad0030ad0 con 0x5576c22805d0 2024-09-12T12:36:17.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.553+0000 7f6ae0f76740 10 client.25907 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:36:17.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.553+0000 7f6ae0f76740 10 client.25907 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:36:17.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.553+0000 7f6ae0f76740 20 client.25907 populate_metadata read hostname 'smithi033' 2024-09-12T12:36:17.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.553+0000 7f6ae0f76740 1 --2- 172.21.15.33:0/2690028987 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5576c23175b0 0x5576c23199d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:17.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.553+0000 7f6ae0f76740 4 client.25907 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:36:17.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.553+0000 7f6ae0f76740 1 -- 172.21.15.33:0/2690028987 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5576c21edd70 con 0x5576c23175b0 2024-09-12T12:36:17.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.554+0000 7f6ad7fff640 1 --2- 172.21.15.33:0/2690028987 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5576c23175b0 0x5576c23199d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:17.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.554+0000 7f6ad7fff640 1 --2- 172.21.15.33:0/2690028987 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5576c23175b0 0x5576c23199d0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a9d5c059795c3d1 server_cookie=aae0ed70fe883222 in_seq=0 out_seq=0 2024-09-12T12:36:17.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.554+0000 7f6ab7fff640 10 client.25907 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:36:17.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.555+0000 7f6ab7fff640 1 -- 172.21.15.33:0/2690028987 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5576c21edd70 con 0x5576c23175b0 2024-09-12T12:36:17.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.555+0000 7f6ab7fff640 10 client.25907 handle_command_reply: tid=0 2024-09-12T12:36:17.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.557+0000 7f6ae0f76740 1 client.25907 shutdown 2024-09-12T12:36:17.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.561+0000 7f6ae0f76740 1 -- 172.21.15.33:0/2690028987 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5576c22805d0 msgr2=0x5576c22a4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:17.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.561+0000 7f6ae0f76740 1 --2- 172.21.15.33:0/2690028987 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5576c22805d0 0x5576c22a4a20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0009a00 tx=0x7f6ad0004b40 comp rx=0 tx=0).stop 2024-09-12T12:36:17.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.562+0000 7f6ae0f76740 1 -- 172.21.15.33:0/2690028987 shutdown_connections 2024-09-12T12:36:17.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.562+0000 7f6ae0f76740 1 --2- 172.21.15.33:0/2690028987 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x5576c23175b0 0x5576c23199d0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:17.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.562+0000 7f6ae0f76740 1 --2- 172.21.15.33:0/2690028987 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c228b370 0x5576c22b3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:17.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.562+0000 7f6ae0f76740 1 --2- 172.21.15.33:0/2690028987 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5576c2281b40 0x5576c22b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:17.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.562+0000 7f6ae0f76740 1 --2- 172.21.15.33:0/2690028987 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5576c22805d0 0x5576c22a4a20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:17.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.562+0000 7f6ae0f76740 1 -- 172.21.15.33:0/2690028987 >> 172.21.15.33:0/2690028987 conn(0x5576c2249310 msgr2=0x5576c2289ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:36:17.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.562+0000 7f6ab7fff640 0 client.25907 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:36:17.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.564+0000 7f6ae0f76740 1 -- 172.21.15.33:0/2690028987 shutdown_connections 2024-09-12T12:36:17.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.565+0000 7f6ae0f76740 1 -- 172.21.15.33:0/2690028987 wait complete. 2024-09-12T12:36:17.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.565+0000 7f6ae0f76740 20 client.25907 trim_cache size 0 max 16384 2024-09-12T12:36:17.567 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-09-12T12:36:17.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.571+0000 7f6adeb9d640 1 -- 172.21.15.33:0/2925604330 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f6ac00a2da0 msgr2=0x7f6ac00a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:17.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.571+0000 7f6adeb9d640 1 --2- 172.21.15.33:0/2925604330 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f6ac00a2da0 0x7f6ac00a5260 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0005fa0 tx=0x7f6ad0005ef0 comp rx=0 tx=0).stop 2024-09-12T12:36:17.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.571+0000 7f6adeb9d640 1 -- 172.21.15.33:0/2925604330 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ad8112bc0 msgr2=0x7f6ad810b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:17.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.571+0000 7f6adeb9d640 1 --2- 172.21.15.33:0/2925604330 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ad8112bc0 0x7f6ad810b310 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6ac800b3e0 tx=0x7f6ac800b8a0 comp rx=0 tx=0).stop 2024-09-12T12:36:17.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.571+0000 7f6adeb9d640 1 -- 172.21.15.33:0/2925604330 shutdown_connections 2024-09-12T12:36:17.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.571+0000 7f6adeb9d640 1 --2- 172.21.15.33:0/2925604330 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f6ac00a2da0 0x7f6ac00a5260 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:17.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.571+0000 7f6adeb9d640 1 --2- 172.21.15.33:0/2925604330 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ad8112bc0 0x7f6ad810b310 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:17.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.571+0000 7f6adeb9d640 1 --2- 172.21.15.33:0/2925604330 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ad8074eb0 0x7f6ad8112630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:17.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.571+0000 7f6adeb9d640 1 --2- 172.21.15.33:0/2925604330 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ad8074590 0x7f6ad81120f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:17.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.571+0000 7f6adeb9d640 1 -- 172.21.15.33:0/2925604330 >> 172.21.15.33:0/2925604330 conn(0x7f6ad80fd8d0 msgr2=0x7f6ad80fef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:36:17.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.573+0000 7f6adeb9d640 1 -- 172.21.15.33:0/2925604330 shutdown_connections 2024-09-12T12:36:17.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:17.573+0000 7f6adeb9d640 1 -- 172.21.15.33:0/2925604330 wait complete. 2024-09-12T12:36:18.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:17 smithi033 ceph-mon[31246]: pgmap v658: 129 pgs: 129 active+clean; 10 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 23 MiB/s wr, 465 op/s 2024-09-12T12:36:18.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:17 smithi043 ceph-mon[34144]: pgmap v658: 129 pgs: 129 active+clean; 10 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 23 MiB/s wr, 465 op/s 2024-09-12T12:36:18.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:17 smithi102 ceph-mon[34799]: pgmap v658: 129 pgs: 129 active+clean; 10 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 23 MiB/s wr, 465 op/s 2024-09-12T12:36:19.356 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T12:36:19.357 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T12:36:20.030 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:36:20.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:19 smithi043 ceph-mon[34144]: pgmap v659: 129 pgs: 129 active+clean; 10 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 MiB/s rd, 34 MiB/s wr, 678 op/s 2024-09-12T12:36:20.397 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:19 smithi102 ceph-mon[34799]: pgmap v659: 129 pgs: 129 active+clean; 10 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 MiB/s rd, 34 MiB/s wr, 678 op/s 2024-09-12T12:36:20.482 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:19 smithi033 ceph-mon[31246]: pgmap v659: 129 pgs: 129 active+clean; 10 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 MiB/s rd, 34 MiB/s wr, 678 op/s 2024-09-12T12:36:22.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:22 smithi102 ceph-mon[34799]: pgmap v660: 129 pgs: 129 active+clean; 10 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 25 MiB/s wr, 509 op/s 2024-09-12T12:36:22.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:22 smithi043 ceph-mon[34144]: pgmap v660: 129 pgs: 129 active+clean; 10 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 25 MiB/s wr, 509 op/s 2024-09-12T12:36:22.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:22 smithi033 ceph-mon[31246]: pgmap v660: 129 pgs: 129 active+clean; 10 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 25 MiB/s wr, 509 op/s 2024-09-12T12:36:24.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:24 smithi043 ceph-mon[34144]: pgmap v661: 129 pgs: 129 active+clean; 10 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 29 MiB/s wr, 579 op/s 2024-09-12T12:36:24.742 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:24 smithi102 ceph-mon[34799]: pgmap v661: 129 pgs: 129 active+clean; 10 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 29 MiB/s wr, 579 op/s 2024-09-12T12:36:24.743 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:24 smithi033 ceph-mon[31246]: pgmap v661: 129 pgs: 129 active+clean; 10 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 29 MiB/s wr, 579 op/s 2024-09-12T12:36:24.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.538+0000 7f1537f16640 1 -- 172.21.15.33:0/2011998340 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f153010ef30 msgr2=0x7f153010d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:24.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.538+0000 7f1537f16640 1 --2- 172.21.15.33:0/2011998340 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f153010ef30 0x7f153010d2a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f152c008440 tx=0x7f152c02e5a0 comp rx=0 tx=0).stop 2024-09-12T12:36:24.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.538+0000 7f1537f16640 1 -- 172.21.15.33:0/2011998340 shutdown_connections 2024-09-12T12:36:24.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.538+0000 7f1537f16640 1 --2- 172.21.15.33:0/2011998340 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f153010d9b0 0x7f1530115510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:24.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.538+0000 7f1537f16640 1 --2- 172.21.15.33:0/2011998340 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f153010ef30 0x7f153010d2a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:24.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.538+0000 7f1537f16640 1 --2- 172.21.15.33:0/2011998340 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f153010e580 0x7f153010e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:24.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.538+0000 7f1537f16640 1 -- 172.21.15.33:0/2011998340 >> 172.21.15.33:0/2011998340 conn(0x7f153006e140 msgr2=0x7f153006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:36:24.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.539+0000 7f1537f16640 1 -- 172.21.15.33:0/2011998340 shutdown_connections 2024-09-12T12:36:24.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.540+0000 7f1537f16640 1 -- 172.21.15.33:0/2011998340 wait complete. 2024-09-12T12:36:24.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.540+0000 7f1537f16640 1 Processor -- start 2024-09-12T12:36:24.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.541+0000 7f1537f16640 1 -- start start 2024-09-12T12:36:24.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.541+0000 7f1537f16640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f153010d9b0 0x7f15301a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:24.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.541+0000 7f1537f16640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f153010e580 0x7f15301a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:24.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.541+0000 7f1537f16640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f153010ef30 0x7f153019e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:24.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.541+0000 7f1537f16640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1530118460 con 0x7f153010e580 2024-09-12T12:36:24.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.541+0000 7f1537f16640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f15301182e0 con 0x7f153010d9b0 2024-09-12T12:36:24.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.541+0000 7f1537f16640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f15301185e0 con 0x7f153010ef30 2024-09-12T12:36:24.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.541+0000 7f15354b1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f153010e580 0x7f15301a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:24.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.541+0000 7f15354b1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f153010e580 0x7f15301a4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49672/0 (socket says 172.21.15.33:49672) 2024-09-12T12:36:24.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.541+0000 7f15354b1640 1 -- 172.21.15.33:0/3473538009 learned_addr learned my addr 172.21.15.33:0/3473538009 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:36:24.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.541+0000 7f15364b3640 1 --2- 172.21.15.33:0/3473538009 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f153010ef30 0x7f153019e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:24.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.542+0000 7f15354b1640 1 -- 172.21.15.33:0/3473538009 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f153010ef30 msgr2=0x7f153019e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:24.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.542+0000 7f15354b1640 1 --2- 172.21.15.33:0/3473538009 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f153010ef30 0x7f153019e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:24.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.542+0000 7f15354b1640 1 -- 172.21.15.33:0/3473538009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f153010d9b0 msgr2=0x7f15301a46d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T12:36:24.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.542+0000 7f15354b1640 1 --2- 172.21.15.33:0/3473538009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f153010d9b0 0x7f15301a46d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:24.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.542+0000 7f15354b1640 1 -- 172.21.15.33:0/3473538009 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f153019eff0 con 0x7f153010e580 2024-09-12T12:36:24.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.542+0000 7f15354b1640 1 --2- 172.21.15.33:0/3473538009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f153010e580 0x7f15301a4c10 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f152c00a3d0 tx=0x7f152c00a400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:36:24.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.543+0000 7f1526ffd640 1 -- 172.21.15.33:0/3473538009 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f152c03a050 con 0x7f153010e580 2024-09-12T12:36:24.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.543+0000 7f1526ffd640 1 -- 172.21.15.33:0/3473538009 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f152c03b040 con 0x7f153010e580 2024-09-12T12:36:24.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.543+0000 7f1526ffd640 1 -- 172.21.15.33:0/3473538009 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f152c003a20 con 0x7f153010e580 2024-09-12T12:36:24.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.543+0000 7f1537f16640 1 -- 172.21.15.33:0/3473538009 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f153019f280 con 0x7f153010e580 2024-09-12T12:36:24.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.543+0000 7f1537f16640 1 -- 172.21.15.33:0/3473538009 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15301ab530 con 0x7f153010e580 2024-09-12T12:36:24.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.547+0000 7f153a2ef740 1 Processor -- start 2024-09-12T12:36:24.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.548+0000 7f1526ffd640 1 -- 172.21.15.33:0/3473538009 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f152c046020 con 0x7f153010e580 2024-09-12T12:36:24.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.549+0000 7f1526ffd640 1 --2- 172.21.15.33:0/3473538009 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f151c0a2d50 0x7f151c0a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:24.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.549+0000 7f1526ffd640 1 -- 172.21.15.33:0/3473538009 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f152c0f3130 con 0x7f153010e580 2024-09-12T12:36:24.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.549+0000 7f153a2ef740 1 -- start start 2024-09-12T12:36:24.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.550+0000 7f153a2ef740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f6f0836370 0x55f6f0836750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:24.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.550+0000 7f153a2ef740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f6f0836c90 0x55f6f0841010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:24.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.550+0000 7f153a2ef740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f6f0841550 0x55f6f0843940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:24.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.550+0000 7f153a2ef740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55f6f0793280 con 0x55f6f0836370 2024-09-12T12:36:24.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.550+0000 7f153a2ef740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f6f073ab10 con 0x55f6f0836c90 2024-09-12T12:36:24.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.550+0000 7f153a2ef740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55f6f078f240 con 0x55f6f0841550 2024-09-12T12:36:24.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.550+0000 7f15354b1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f6f0836c90 0x55f6f0841010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:24.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.550+0000 7f15354b1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f6f0836c90 0x55f6f0841010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:37912/0 (socket says 172.21.15.33:37912) 2024-09-12T12:36:24.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.550+0000 7f15354b1640 1 -- 172.21.15.33:0/3544077462 learned_addr learned my addr 172.21.15.33:0/3544077462 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:36:24.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.550+0000 7f15364b3640 1 --2- 172.21.15.33:0/3544077462 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f6f0841550 0x55f6f0843940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:24.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.550+0000 7f1535cb2640 1 --2- 172.21.15.33:0/3544077462 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f6f0836370 0x55f6f0836750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:24.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.551+0000 7f15364b3640 1 --2- 172.21.15.33:0/3473538009 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f151c0a2d50 0x7f151c0a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:24.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.551+0000 7f15354b1640 1 -- 172.21.15.33:0/3544077462 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f6f0841550 msgr2=0x55f6f0843940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:36:24.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.551+0000 7f15354b1640 1 --2- 172.21.15.33:0/3544077462 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f6f0841550 0x55f6f0843940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:24.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.551+0000 7f15354b1640 1 -- 172.21.15.33:0/3544077462 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f6f0836370 msgr2=0x55f6f0836750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:36:24.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.551+0000 7f15354b1640 1 --2- 172.21.15.33:0/3544077462 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f6f0836370 0x55f6f0836750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:24.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.551+0000 7f15354b1640 1 -- 172.21.15.33:0/3544077462 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6f07471f0 con 0x55f6f0836c90 2024-09-12T12:36:24.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.552+0000 7f15354b1640 1 --2- 172.21.15.33:0/3544077462 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f6f0836c90 0x55f6f0841010 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f152c0bba00 tx=0x7f152c0bf430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ceace44c36d04674 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:36:24.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.552+0000 7f151bfff640 1 -- 172.21.15.33:0/3544077462 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f152c0bfca0 con 0x55f6f0836c90 2024-09-12T12:36:24.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.552+0000 7f151bfff640 1 -- 172.21.15.33:0/3544077462 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f152c0bf5a0 con 0x55f6f0836c90 2024-09-12T12:36:24.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.553+0000 7f153a2ef740 1 -- 172.21.15.33:0/3544077462 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f6f0836c90 msgr2=0x55f6f0841010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:24.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.553+0000 7f153a2ef740 1 --2- 172.21.15.33:0/3544077462 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f6f0836c90 0x55f6f0841010 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f152c0bba00 tx=0x7f152c0bf430 comp rx=0 tx=0).stop 2024-09-12T12:36:24.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.554+0000 7f153a2ef740 1 -- 172.21.15.33:0/3544077462 shutdown_connections 2024-09-12T12:36:24.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.554+0000 7f153a2ef740 1 --2- 172.21.15.33:0/3544077462 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f6f0841550 0x55f6f0843940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:24.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.554+0000 7f153a2ef740 1 --2- 172.21.15.33:0/3544077462 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f6f0836c90 0x55f6f0841010 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:24.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.554+0000 7f153a2ef740 1 --2- 172.21.15.33:0/3544077462 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f6f0836370 0x55f6f0836750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:24.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.554+0000 7f153a2ef740 1 -- 172.21.15.33:0/3544077462 >> 172.21.15.33:0/3544077462 conn(0x55f6f0832900 msgr2=0x55f6f0832ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:36:24.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.558+0000 7f153a2ef740 1 -- 172.21.15.33:0/3544077462 shutdown_connections 2024-09-12T12:36:24.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.558+0000 7f153a2ef740 1 -- 172.21.15.33:0/3544077462 wait complete. 2024-09-12T12:36:24.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.558+0000 7f15364b3640 1 --2- 172.21.15.33:0/3473538009 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f151c0a2d50 0x7f151c0a5210 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x55f6f0833c80 tx=0x7f15200090e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:36:24.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.559+0000 7f153a2ef740 1 -- start start 2024-09-12T12:36:24.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.559+0000 7f153a2ef740 1 Processor -- start 2024-09-12T12:36:24.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.561+0000 7f153a2ef740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f6f0836370 0x55f6f082f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:24.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.561+0000 7f153a2ef740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f6f0836c90 0x55f6f082fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:24.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.561+0000 7f153a2ef740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f6f0841550 0x55f6f082ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:24.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.561+0000 7f153a2ef740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55f6f0829b20 con 0x55f6f0836370 2024-09-12T12:36:24.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.561+0000 7f153a2ef740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f6f074df10 con 0x55f6f0841550 2024-09-12T12:36:24.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.561+0000 7f153a2ef740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55f6f0829ca0 con 0x55f6f0836c90 2024-09-12T12:36:24.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.561+0000 7f153a2ef740 10 client.0 _ll_register_callbacks cb 0x55f6f0716a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:36:24.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.562+0000 7f15364b3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f6f0841550 0x55f6f082ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:24.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.562+0000 7f15364b3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f6f0841550 0x55f6f082ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:37920/0 (socket says 172.21.15.33:37920) 2024-09-12T12:36:24.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.562+0000 7f15364b3640 1 -- 172.21.15.33:0/2774226034 learned_addr learned my addr 172.21.15.33:0/2774226034 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:36:24.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.562+0000 7f15364b3640 1 -- 172.21.15.33:0/2774226034 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f6f0836c90 msgr2=0x55f6f082fa90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T12:36:24.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.562+0000 7f15364b3640 1 --2- 172.21.15.33:0/2774226034 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f6f0836c90 0x55f6f082fa90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:24.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.562+0000 7f15364b3640 1 -- 172.21.15.33:0/2774226034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f6f0836370 msgr2=0x55f6f082f550 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T12:36:24.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.562+0000 7f15364b3640 1 --2- 172.21.15.33:0/2774226034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f6f0836370 0x55f6f082f550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:24.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.562+0000 7f15364b3640 1 -- 172.21.15.33:0/2774226034 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6f05046a0 con 0x55f6f0841550 2024-09-12T12:36:24.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.563+0000 7f15364b3640 1 --2- 172.21.15.33:0/2774226034 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f6f0841550 0x55f6f082ffd0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1520006b90 tx=0x7f15200046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e6633c9960bb73a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:36:24.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.563+0000 7f15197fa640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:36:24.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.563+0000 7f15197fa640 1 -- 172.21.15.33:0/2774226034 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1520015ad0 con 0x55f6f0841550 2024-09-12T12:36:24.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.563+0000 7f153a2ef740 1 -- 172.21.15.33:0/2774226034 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f6f07a07f0 con 0x55f6f0841550 2024-09-12T12:36:24.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.564+0000 7f15197fa640 1 -- 172.21.15.33:0/2774226034 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f1520015c70 con 0x55f6f0841550 2024-09-12T12:36:24.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.564+0000 7f15197fa640 1 -- 172.21.15.33:0/2774226034 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f15200059c0 con 0x55f6f0841550 2024-09-12T12:36:24.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.564+0000 7f153a2ef740 10 client.25916 fetch_fsmap learned FSMap version 27 2024-09-12T12:36:24.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.564+0000 7f153a2ef740 1 -- 172.21.15.33:0/2774226034 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f6f08584f0 con 0x55f6f0841550 2024-09-12T12:36:24.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.565+0000 7f15197fa640 1 -- 172.21.15.33:0/2774226034 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55f6f07a07f0 con 0x55f6f0841550 2024-09-12T12:36:24.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.566+0000 7f15197fa640 1 -- 172.21.15.33:0/2774226034 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f1520005bf0 con 0x55f6f0841550 2024-09-12T12:36:24.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.567+0000 7f153a2ef740 10 client.25916 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:36:24.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.567+0000 7f153a2ef740 10 client.25916 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:36:24.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.567+0000 7f153a2ef740 20 client.25916 populate_metadata read hostname 'smithi033' 2024-09-12T12:36:24.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.567+0000 7f153a2ef740 1 --2- 172.21.15.33:0/2774226034 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55f6f0859df0 0x55f6f085c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:24.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.567+0000 7f153a2ef740 4 client.25916 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:36:24.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.567+0000 7f153a2ef740 1 -- 172.21.15.33:0/2774226034 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f6f079ad00 con 0x55f6f0859df0 2024-09-12T12:36:24.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.576+0000 7f1535cb2640 1 --2- 172.21.15.33:0/2774226034 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55f6f0859df0 0x55f6f085c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:24.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.600+0000 7f1535cb2640 1 --2- 172.21.15.33:0/2774226034 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55f6f0859df0 0x55f6f085c290 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae0d8fbc407b8011 server_cookie=326615a54e96a956 in_seq=0 out_seq=0 2024-09-12T12:36:24.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.600+0000 7f15197fa640 10 client.25916 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:36:24.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.603+0000 7f15197fa640 1 -- 172.21.15.33:0/2774226034 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f6f079ad00 con 0x55f6f0859df0 2024-09-12T12:36:24.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.604+0000 7f15197fa640 10 client.25916 handle_command_reply: tid=0 2024-09-12T12:36:24.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.605+0000 7f153a2ef740 1 client.25916 shutdown 2024-09-12T12:36:24.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.609+0000 7f153a2ef740 1 -- 172.21.15.33:0/2774226034 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f6f0841550 msgr2=0x55f6f082ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:24.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.609+0000 7f153a2ef740 1 --2- 172.21.15.33:0/2774226034 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f6f0841550 0x55f6f082ffd0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1520006b90 tx=0x7f15200046c0 comp rx=0 tx=0).stop 2024-09-12T12:36:24.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.609+0000 7f153a2ef740 1 -- 172.21.15.33:0/2774226034 shutdown_connections 2024-09-12T12:36:24.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.609+0000 7f153a2ef740 1 --2- 172.21.15.33:0/2774226034 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55f6f0859df0 0x55f6f085c290 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:24.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.609+0000 7f153a2ef740 1 --2- 172.21.15.33:0/2774226034 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f6f0841550 0x55f6f082ffd0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:24.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.609+0000 7f153a2ef740 1 --2- 172.21.15.33:0/2774226034 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f6f0836c90 0x55f6f082fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:24.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.609+0000 7f153a2ef740 1 --2- 172.21.15.33:0/2774226034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f6f0836370 0x55f6f082f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:24.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.609+0000 7f153a2ef740 1 -- 172.21.15.33:0/2774226034 >> 172.21.15.33:0/2774226034 conn(0x55f6f0832900 msgr2=0x55f6f0838660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:36:24.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.609+0000 7f15197fa640 0 client.25916 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:36:24.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.611+0000 7f153a2ef740 1 -- 172.21.15.33:0/2774226034 shutdown_connections 2024-09-12T12:36:24.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.612+0000 7f153a2ef740 1 -- 172.21.15.33:0/2774226034 wait complete. 2024-09-12T12:36:24.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.612+0000 7f153a2ef740 20 client.25916 trim_cache size 0 max 16384 2024-09-12T12:36:24.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.651+0000 7f153a2ef740 1 Processor -- start 2024-09-12T12:36:24.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.652+0000 7f153a2ef740 1 -- start start 2024-09-12T12:36:24.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.652+0000 7f153a2ef740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f6f0836370 0x55f6f082fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:24.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.652+0000 7f153a2ef740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f6f0836c90 0x55f6f0861ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:24.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.652+0000 7f153a2ef740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f6f0841550 0x55f6f08620e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:24.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.653+0000 7f153a2ef740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1514012570 con 0x55f6f0836c90 2024-09-12T12:36:24.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.653+0000 7f153a2ef740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f151400fe40 con 0x55f6f0841550 2024-09-12T12:36:24.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.653+0000 7f153a2ef740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f151400dc90 con 0x55f6f0836370 2024-09-12T12:36:24.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.653+0000 7f15354b1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f6f0836c90 0x55f6f0861ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:24.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.653+0000 7f15354b1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f6f0836c90 0x55f6f0861ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49692/0 (socket says 172.21.15.33:49692) 2024-09-12T12:36:24.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.653+0000 7f15354b1640 1 -- 172.21.15.33:0/3417333204 learned_addr learned my addr 172.21.15.33:0/3417333204 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:36:24.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.654+0000 7f15354b1640 1 -- 172.21.15.33:0/3417333204 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f6f0836370 msgr2=0x55f6f082fdf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T12:36:24.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.654+0000 7f15354b1640 1 --2- 172.21.15.33:0/3417333204 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f6f0836370 0x55f6f082fdf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:24.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.654+0000 7f15354b1640 1 -- 172.21.15.33:0/3417333204 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f6f0841550 msgr2=0x55f6f08620e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:36:24.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.654+0000 7f15354b1640 1 --2- 172.21.15.33:0/3417333204 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f6f0841550 0x55f6f08620e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:24.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.654+0000 7f15354b1640 1 -- 172.21.15.33:0/3417333204 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6f0824680 con 0x55f6f0836c90 2024-09-12T12:36:24.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.654+0000 7f15354b1640 1 --2- 172.21.15.33:0/3417333204 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f6f0836c90 0x55f6f0861ba0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f152c00a470 tx=0x7f152c02ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4a63c8f890e5a98 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:36:24.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.661+0000 7f151b7fe640 1 -- 172.21.15.33:0/3417333204 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f152c0d7070 con 0x55f6f0836c90 2024-09-12T12:36:24.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.662+0000 7f151b7fe640 1 -- 172.21.15.33:0/3417333204 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f152c0bfca0 con 0x55f6f0836c90 2024-09-12T12:36:24.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.663+0000 7f153a2ef740 1 -- 172.21.15.33:0/3417333204 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f6f0836c90 msgr2=0x55f6f0861ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:24.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.663+0000 7f153a2ef740 1 --2- 172.21.15.33:0/3417333204 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f6f0836c90 0x55f6f0861ba0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f152c00a470 tx=0x7f152c02ebe0 comp rx=0 tx=0).stop 2024-09-12T12:36:24.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.664+0000 7f153a2ef740 1 -- 172.21.15.33:0/3417333204 shutdown_connections 2024-09-12T12:36:24.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.664+0000 7f153a2ef740 1 --2- 172.21.15.33:0/3417333204 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f6f0841550 0x55f6f08620e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:24.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.664+0000 7f153a2ef740 1 --2- 172.21.15.33:0/3417333204 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f6f0836c90 0x55f6f0861ba0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:24.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.664+0000 7f153a2ef740 1 --2- 172.21.15.33:0/3417333204 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f6f0836370 0x55f6f082fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:24.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.664+0000 7f153a2ef740 1 -- 172.21.15.33:0/3417333204 >> 172.21.15.33:0/3417333204 conn(0x55f6f0832900 msgr2=0x55f6f0829270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:36:24.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.665+0000 7f153a2ef740 1 -- 172.21.15.33:0/3417333204 shutdown_connections 2024-09-12T12:36:24.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.665+0000 7f153a2ef740 1 -- 172.21.15.33:0/3417333204 wait complete. 2024-09-12T12:36:24.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.665+0000 7f153a2ef740 1 -- start start 2024-09-12T12:36:24.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.665+0000 7f153a2ef740 1 Processor -- start 2024-09-12T12:36:24.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.666+0000 7f153a2ef740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f6f0836370 0x55f6f083f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:24.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.666+0000 7f153a2ef740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f6f0836c90 0x55f6f083ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:24.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.666+0000 7f153a2ef740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f6f0841550 0x55f6f083b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:24.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.666+0000 7f153a2ef740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f151400e300 con 0x55f6f0836c90 2024-09-12T12:36:24.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.666+0000 7f153a2ef740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f151400f770 con 0x55f6f0836370 2024-09-12T12:36:24.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.666+0000 7f153a2ef740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f151400e9d0 con 0x55f6f0841550 2024-09-12T12:36:24.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.666+0000 7f153a2ef740 10 client.0 _ll_register_callbacks cb 0x7f15200173e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:36:24.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.666+0000 7f15364b3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f6f0841550 0x55f6f083b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:24.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.666+0000 7f15364b3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f6f0841550 0x55f6f083b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:41716/0 (socket says 172.21.15.33:41716) 2024-09-12T12:36:24.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.666+0000 7f15364b3640 1 -- 172.21.15.33:0/2935541338 learned_addr learned my addr 172.21.15.33:0/2935541338 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:36:24.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.667+0000 7f15364b3640 1 -- 172.21.15.33:0/2935541338 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f6f0836370 msgr2=0x55f6f083f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:36:24.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.667+0000 7f15364b3640 1 --2- 172.21.15.33:0/2935541338 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f6f0836370 0x55f6f083f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:24.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.667+0000 7f15364b3640 1 -- 172.21.15.33:0/2935541338 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f6f0836c90 msgr2=0x55f6f083ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:36:24.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.667+0000 7f15364b3640 1 --2- 172.21.15.33:0/2935541338 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f6f0836c90 0x55f6f083ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:24.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.667+0000 7f15364b3640 1 -- 172.21.15.33:0/2935541338 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6f0829d50 con 0x55f6f0841550 2024-09-12T12:36:24.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.667+0000 7f15364b3640 1 --2- 172.21.15.33:0/2935541338 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f6f0841550 0x55f6f083b200 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f152000a010 tx=0x7f1520023690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b101116a363b0964 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:36:24.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.667+0000 7f15197fa640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:36:24.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.668+0000 7f15197fa640 1 -- 172.21.15.33:0/2935541338 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f152003a020 con 0x55f6f0841550 2024-09-12T12:36:24.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.668+0000 7f153a2ef740 1 -- 172.21.15.33:0/2935541338 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f6f0717110 con 0x55f6f0841550 2024-09-12T12:36:24.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.668+0000 7f15197fa640 1 -- 172.21.15.33:0/2935541338 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f1520023b10 con 0x55f6f0841550 2024-09-12T12:36:24.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.668+0000 7f15197fa640 1 -- 172.21.15.33:0/2935541338 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1520023d10 con 0x55f6f0841550 2024-09-12T12:36:24.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.676+0000 7f153a2ef740 10 client.26041 fetch_fsmap learned FSMap version 27 2024-09-12T12:36:24.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.676+0000 7f153a2ef740 1 -- 172.21.15.33:0/2935541338 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f6f08c4b10 con 0x55f6f0841550 2024-09-12T12:36:24.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.676+0000 7f15197fa640 1 -- 172.21.15.33:0/2935541338 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55f6f0717110 con 0x55f6f0841550 2024-09-12T12:36:24.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.676+0000 7f15197fa640 1 -- 172.21.15.33:0/2935541338 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f15200363f0 con 0x55f6f0841550 2024-09-12T12:36:24.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.677+0000 7f153a2ef740 10 client.26041 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:36:24.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.677+0000 7f153a2ef740 10 client.26041 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:36:24.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.677+0000 7f153a2ef740 20 client.26041 populate_metadata read hostname 'smithi033' 2024-09-12T12:36:24.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.677+0000 7f153a2ef740 1 --2- 172.21.15.33:0/2935541338 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55f6f08c5250 0x55f6f08c76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:24.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.677+0000 7f153a2ef740 4 client.26041 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T12:36:24.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.677+0000 7f153a2ef740 1 -- 172.21.15.33:0/2935541338 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f6f0764940 con 0x55f6f08c5250 2024-09-12T12:36:24.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.677+0000 7f1535cb2640 1 --2- 172.21.15.33:0/2935541338 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55f6f08c5250 0x55f6f08c76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:24.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.690+0000 7f1535cb2640 1 --2- 172.21.15.33:0/2935541338 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55f6f08c5250 0x55f6f08c76d0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebd7c7f697b6b4ce server_cookie=9f2e9a5c5c786310 in_seq=0 out_seq=0 2024-09-12T12:36:24.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.690+0000 7f15197fa640 10 client.26041 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:36:24.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.691+0000 7f15197fa640 1 -- 172.21.15.33:0/2935541338 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f6f0764940 con 0x55f6f08c5250 2024-09-12T12:36:24.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.691+0000 7f15197fa640 10 client.26041 handle_command_reply: tid=0 2024-09-12T12:36:24.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.691+0000 7f153a2ef740 1 client.26041 shutdown 2024-09-12T12:36:24.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.698+0000 7f153a2ef740 1 -- 172.21.15.33:0/2935541338 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f6f0841550 msgr2=0x55f6f083b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:24.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.698+0000 7f153a2ef740 1 --2- 172.21.15.33:0/2935541338 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f6f0841550 0x55f6f083b200 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f152000a010 tx=0x7f1520023690 comp rx=0 tx=0).stop 2024-09-12T12:36:24.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.698+0000 7f153a2ef740 1 -- 172.21.15.33:0/2935541338 shutdown_connections 2024-09-12T12:36:24.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.698+0000 7f153a2ef740 1 --2- 172.21.15.33:0/2935541338 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x55f6f08c5250 0x55f6f08c76d0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:24.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.698+0000 7f153a2ef740 1 --2- 172.21.15.33:0/2935541338 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f6f0841550 0x55f6f083b200 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:24.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.698+0000 7f153a2ef740 1 --2- 172.21.15.33:0/2935541338 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f6f0836c90 0x55f6f083ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:24.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.698+0000 7f153a2ef740 1 --2- 172.21.15.33:0/2935541338 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f6f0836370 0x55f6f083f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:24.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.698+0000 7f153a2ef740 1 -- 172.21.15.33:0/2935541338 >> 172.21.15.33:0/2935541338 conn(0x55f6f0832900 msgr2=0x55f6f0837e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:36:24.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.698+0000 7f15197fa640 0 client.26041 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:36:24.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.698+0000 7f153a2ef740 1 -- 172.21.15.33:0/2935541338 shutdown_connections 2024-09-12T12:36:24.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.698+0000 7f153a2ef740 1 -- 172.21.15.33:0/2935541338 wait complete. 2024-09-12T12:36:24.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.699+0000 7f153a2ef740 20 client.26041 trim_cache size 0 max 16384 2024-09-12T12:36:24.761 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:36:24.761 INFO:teuthology.orchestra.run.smithi033.stdout: "return_code": 0, 2024-09-12T12:36:24.761 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_tag": "6fbf8f7e-7aed-48f6-8ed7-0687e9b7bea3", 2024-09-12T12:36:24.761 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": "asynchronous" 2024-09-12T12:36:24.762 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:36:24.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.702+0000 7f1537f16640 1 -- 172.21.15.33:0/3473538009 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f151c0a2d50 msgr2=0x7f151c0a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:24.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.702+0000 7f1537f16640 1 --2- 172.21.15.33:0/3473538009 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f151c0a2d50 0x7f151c0a5210 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x55f6f0833c80 tx=0x7f15200090e0 comp rx=0 tx=0).stop 2024-09-12T12:36:24.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.702+0000 7f1537f16640 1 -- 172.21.15.33:0/3473538009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f153010e580 msgr2=0x7f15301a4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:24.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.702+0000 7f1537f16640 1 --2- 172.21.15.33:0/3473538009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f153010e580 0x7f15301a4c10 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f152c00a3d0 tx=0x7f152c00a400 comp rx=0 tx=0).stop 2024-09-12T12:36:24.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.702+0000 7f1537f16640 1 -- 172.21.15.33:0/3473538009 shutdown_connections 2024-09-12T12:36:24.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.702+0000 7f1537f16640 1 --2- 172.21.15.33:0/3473538009 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f151c0a2d50 0x7f151c0a5210 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:24.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.702+0000 7f1537f16640 1 --2- 172.21.15.33:0/3473538009 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f153010ef30 0x7f153019e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:24.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.702+0000 7f1537f16640 1 --2- 172.21.15.33:0/3473538009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f153010e580 0x7f15301a4c10 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:24.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.702+0000 7f1537f16640 1 --2- 172.21.15.33:0/3473538009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f153010d9b0 0x7f15301a46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:24.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.702+0000 7f1537f16640 1 -- 172.21.15.33:0/3473538009 >> 172.21.15.33:0/3473538009 conn(0x7f153006e140 msgr2=0x7f153010b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:36:24.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.703+0000 7f1537f16640 1 -- 172.21.15.33:0/3473538009 shutdown_connections 2024-09-12T12:36:24.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:24.703+0000 7f1537f16640 1 -- 172.21.15.33:0/3473538009 wait complete. 2024-09-12T12:36:25.517 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T12:36:26.258 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:36:26.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:26 smithi043 ceph-mon[34144]: pgmap v662: 129 pgs: 129 active+clean; 10 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 31 MiB/s wr, 623 op/s 2024-09-12T12:36:26.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:26 smithi043 ceph-mon[34144]: scrub queued for path: / 2024-09-12T12:36:26.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:26 smithi043 ceph-mon[34144]: scrub summary: idle+waiting paths [/] 2024-09-12T12:36:26.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:26 smithi043 ceph-mon[34144]: scrub summary: active paths [/] 2024-09-12T12:36:26.366 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:26 smithi043 ceph-mon[34144]: scrub summary: active paths [/] 2024-09-12T12:36:26.366 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:26 smithi043 ceph-mon[34144]: scrub summary: idle+waiting paths [/] 2024-09-12T12:36:26.366 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:26 smithi043 ceph-mon[34144]: scrub summary: idle+waiting paths [/] 2024-09-12T12:36:26.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:26 smithi102 ceph-mon[34799]: pgmap v662: 129 pgs: 129 active+clean; 10 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 31 MiB/s wr, 623 op/s 2024-09-12T12:36:26.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:26 smithi102 ceph-mon[34799]: scrub queued for path: / 2024-09-12T12:36:26.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:26 smithi102 ceph-mon[34799]: scrub summary: idle+waiting paths [/] 2024-09-12T12:36:26.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:26 smithi102 ceph-mon[34799]: scrub summary: active paths [/] 2024-09-12T12:36:26.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:26 smithi102 ceph-mon[34799]: scrub summary: active paths [/] 2024-09-12T12:36:26.397 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:26 smithi102 ceph-mon[34799]: scrub summary: idle+waiting paths [/] 2024-09-12T12:36:26.397 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:26 smithi102 ceph-mon[34799]: scrub summary: idle+waiting paths [/] 2024-09-12T12:36:26.476 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:26 smithi033 ceph-mon[31246]: pgmap v662: 129 pgs: 129 active+clean; 10 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 31 MiB/s wr, 623 op/s 2024-09-12T12:36:26.477 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:26 smithi033 ceph-mon[31246]: scrub queued for path: / 2024-09-12T12:36:26.477 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:26 smithi033 ceph-mon[31246]: scrub summary: idle+waiting paths [/] 2024-09-12T12:36:26.477 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:26 smithi033 ceph-mon[31246]: scrub summary: active paths [/] 2024-09-12T12:36:26.477 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:26 smithi033 ceph-mon[31246]: scrub summary: active paths [/] 2024-09-12T12:36:26.477 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:26 smithi033 ceph-mon[31246]: scrub summary: idle+waiting paths [/] 2024-09-12T12:36:26.477 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:26 smithi033 ceph-mon[31246]: scrub summary: idle+waiting paths [/] 2024-09-12T12:36:27.067 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:27 smithi033 ceph-mon[31246]: pgmap v663: 129 pgs: 129 active+clean; 10 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 24 MiB/s wr, 485 op/s 2024-09-12T12:36:27.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:27 smithi043 ceph-mon[34144]: pgmap v663: 129 pgs: 129 active+clean; 10 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 24 MiB/s wr, 485 op/s 2024-09-12T12:36:27.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:27 smithi102 ceph-mon[34799]: pgmap v663: 129 pgs: 129 active+clean; 10 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 24 MiB/s wr, 485 op/s 2024-09-12T12:36:27.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.411+0000 7f2a34fdb640 1 -- 172.21.15.33:0/1737697329 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a30109830 msgr2=0x7f2a30109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:27.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.411+0000 7f2a34fdb640 1 --2- 172.21.15.33:0/1737697329 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a30109830 0x7f2a30109c90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2a24009860 tx=0x7f2a2402a360 comp rx=0 tx=0).stop 2024-09-12T12:36:27.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.414+0000 7f2a34fdb640 1 -- 172.21.15.33:0/1737697329 shutdown_connections 2024-09-12T12:36:27.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.414+0000 7f2a34fdb640 1 --2- 172.21.15.33:0/1737697329 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a3011b140 0x7f2a3011d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:27.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.414+0000 7f2a34fdb640 1 --2- 172.21.15.33:0/1737697329 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a30109830 0x7f2a30109c90 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:27.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.414+0000 7f2a34fdb640 1 --2- 172.21.15.33:0/1737697329 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a30109450 0x7f2a30110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:27.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.414+0000 7f2a34fdb640 1 -- 172.21.15.33:0/1737697329 >> 172.21.15.33:0/1737697329 conn(0x7f2a3006e140 msgr2=0x7f2a3006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:36:27.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.417+0000 7f2a34fdb640 1 -- 172.21.15.33:0/1737697329 shutdown_connections 2024-09-12T12:36:27.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.418+0000 7f2a34fdb640 1 -- 172.21.15.33:0/1737697329 wait complete. 2024-09-12T12:36:27.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.419+0000 7f2a34fdb640 1 Processor -- start 2024-09-12T12:36:27.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.419+0000 7f2a34fdb640 1 -- start start 2024-09-12T12:36:27.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.419+0000 7f2a34fdb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a30109450 0x7f2a301a7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:27.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.419+0000 7f2a34fdb640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a30109830 0x7f2a301a77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:27.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.419+0000 7f2a34fdb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a3011b140 0x7f2a301abb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:27.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.419+0000 7f2a34fdb640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2a30120cc0 con 0x7f2a30109450 2024-09-12T12:36:27.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.419+0000 7f2a34fdb640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2a30120b40 con 0x7f2a30109830 2024-09-12T12:36:27.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.419+0000 7f2a34fdb640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2a30120e40 con 0x7f2a3011b140 2024-09-12T12:36:27.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.423+0000 7f2a2e59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a30109450 0x7f2a301a7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:27.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.423+0000 7f2a2e59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a30109450 0x7f2a301a7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49726/0 (socket says 172.21.15.33:49726) 2024-09-12T12:36:27.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.423+0000 7f2a2e59c640 1 -- 172.21.15.33:0/3388770324 learned_addr learned my addr 172.21.15.33:0/3388770324 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:36:27.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.424+0000 7f2a2dd9b640 1 --2- 172.21.15.33:0/3388770324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a30109830 0x7f2a301a77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:27.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.424+0000 7f2a2e59c640 1 -- 172.21.15.33:0/3388770324 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a3011b140 msgr2=0x7f2a301abb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:27.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.424+0000 7f2a2e59c640 1 --2- 172.21.15.33:0/3388770324 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a3011b140 0x7f2a301abb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:27.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.424+0000 7f2a2e59c640 1 -- 172.21.15.33:0/3388770324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a30109830 msgr2=0x7f2a301a77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:27.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.424+0000 7f2a2e59c640 1 --2- 172.21.15.33:0/3388770324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a30109830 0x7f2a301a77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:27.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.424+0000 7f2a2e59c640 1 -- 172.21.15.33:0/3388770324 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a301ac250 con 0x7f2a30109450 2024-09-12T12:36:27.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.426+0000 7f2a2e59c640 1 --2- 172.21.15.33:0/3388770324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a30109450 0x7f2a301a7280 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f2a2000e9c0 tx=0x7f2a2000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:36:27.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.428+0000 7f2a1f7fe640 1 -- 172.21.15.33:0/3388770324 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a2000ccc0 con 0x7f2a30109450 2024-09-12T12:36:27.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.428+0000 7f2a1f7fe640 1 -- 172.21.15.33:0/3388770324 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2a200054d0 con 0x7f2a30109450 2024-09-12T12:36:27.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.428+0000 7f2a1f7fe640 1 -- 172.21.15.33:0/3388770324 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a20010430 con 0x7f2a30109450 2024-09-12T12:36:27.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.430+0000 7f2a34fdb640 1 -- 172.21.15.33:0/3388770324 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a301ac540 con 0x7f2a30109450 2024-09-12T12:36:27.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.430+0000 7f2a34fdb640 1 -- 172.21.15.33:0/3388770324 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a30110920 con 0x7f2a30109450 2024-09-12T12:36:27.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.434+0000 7f2a373b4740 1 Processor -- start 2024-09-12T12:36:27.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.434+0000 7f2a373b4740 1 -- start start 2024-09-12T12:36:27.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.434+0000 7f2a373b4740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d4be95790 0x557d4be95b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:27.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.434+0000 7f2a373b4740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d4be960b0 0x557d4bea0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:27.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.434+0000 7f2a373b4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557d4bea0970 0x557d4bea2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:27.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.434+0000 7f2a373b4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x557d4bdfb2e0 con 0x557d4bea0970 2024-09-12T12:36:27.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.434+0000 7f2a373b4740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557d4bda2ce0 con 0x557d4be95790 2024-09-12T12:36:27.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.434+0000 7f2a373b4740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557d4bdf72a0 con 0x557d4be960b0 2024-09-12T12:36:27.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.437+0000 7f2a1f7fe640 1 -- 172.21.15.33:0/3388770324 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2a20004f50 con 0x7f2a30109450 2024-09-12T12:36:27.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.438+0000 7f2a1f7fe640 1 --2- 172.21.15.33:0/3388770324 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2a180a2d10 0x7f2a180a51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:27.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.439+0000 7f2a1f7fe640 1 -- 172.21.15.33:0/3388770324 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f2a200cf760 con 0x7f2a30109450 2024-09-12T12:36:27.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.439+0000 7f2a2ed9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d4be95790 0x557d4be95b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:27.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.439+0000 7f2a2ed9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d4be95790 0x557d4be95b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:37966/0 (socket says 172.21.15.33:37966) 2024-09-12T12:36:27.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.439+0000 7f2a2ed9d640 1 -- 172.21.15.33:0/2121022680 learned_addr learned my addr 172.21.15.33:0/2121022680 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:36:27.566 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:36:27.566 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T12:36:27.566 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": { 2024-09-12T12:36:27.566 INFO:teuthology.orchestra.run.smithi033.stdout: "6fbf8f7e-7aed-48f6-8ed7-0687e9b7bea3": { 2024-09-12T12:36:27.566 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-09-12T12:36:27.566 INFO:teuthology.orchestra.run.smithi033.stdout: "tag": "6fbf8f7e-7aed-48f6-8ed7-0687e9b7bea3", 2024-09-12T12:36:27.566 INFO:teuthology.orchestra.run.smithi033.stdout: "options": "recursive,force" 2024-09-12T12:36:27.566 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:36:27.566 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:36:27.566 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:36:27.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.440+0000 7f2a2ed9d640 1 -- 172.21.15.33:0/2121022680 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d4be960b0 msgr2=0x557d4bea0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:36:27.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.440+0000 7f2a2e59c640 1 --2- 172.21.15.33:0/2121022680 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d4be960b0 0x557d4bea0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:27.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.440+0000 7f2a2ed9d640 1 --2- 172.21.15.33:0/2121022680 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d4be960b0 0x557d4bea0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:27.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.440+0000 7f2a2ed9d640 1 -- 172.21.15.33:0/2121022680 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557d4bea0970 msgr2=0x557d4bea2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:36:27.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.440+0000 7f2a2ed9d640 1 --2- 172.21.15.33:0/2121022680 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557d4bea0970 0x557d4bea2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:27.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.440+0000 7f2a2ed9d640 1 -- 172.21.15.33:0/2121022680 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d4bd87440 con 0x557d4be95790 2024-09-12T12:36:27.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.440+0000 7f2a2e59c640 1 --2- 172.21.15.33:0/2121022680 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d4be960b0 0x557d4bea0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:36:27.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.441+0000 7f2a2ed9d640 1 --2- 172.21.15.33:0/2121022680 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d4be95790 0x557d4be95b70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2a28002180 tx=0x7f2a2800e590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fce92f67eeadc19f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:36:27.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.441+0000 7f2a17fff640 1 -- 172.21.15.33:0/2121022680 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a28010040 con 0x557d4be95790 2024-09-12T12:36:27.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.441+0000 7f2a17fff640 1 -- 172.21.15.33:0/2121022680 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2a28019070 con 0x557d4be95790 2024-09-12T12:36:27.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.442+0000 7f2a373b4740 1 -- 172.21.15.33:0/2121022680 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d4be95790 msgr2=0x557d4be95b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:27.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.442+0000 7f2a17fff640 1 -- 172.21.15.33:0/2121022680 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a28010040 con 0x557d4be95790 2024-09-12T12:36:27.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.442+0000 7f2a373b4740 1 --2- 172.21.15.33:0/2121022680 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d4be95790 0x557d4be95b70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2a28002180 tx=0x7f2a2800e590 comp rx=0 tx=0).stop 2024-09-12T12:36:27.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.442+0000 7f2a373b4740 1 -- 172.21.15.33:0/2121022680 shutdown_connections 2024-09-12T12:36:27.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.442+0000 7f2a373b4740 1 --2- 172.21.15.33:0/2121022680 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557d4bea0970 0x557d4bea2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:27.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.442+0000 7f2a373b4740 1 --2- 172.21.15.33:0/2121022680 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d4be960b0 0x557d4bea0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:27.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.443+0000 7f2a373b4740 1 --2- 172.21.15.33:0/2121022680 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d4be95790 0x557d4be95b70 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:27.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.443+0000 7f2a373b4740 1 -- 172.21.15.33:0/2121022680 >> 172.21.15.33:0/2121022680 conn(0x557d4be91d20 msgr2=0x557d4be92100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:36:27.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.444+0000 7f2a373b4740 1 -- 172.21.15.33:0/2121022680 shutdown_connections 2024-09-12T12:36:27.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.444+0000 7f2a373b4740 1 -- 172.21.15.33:0/2121022680 wait complete. 2024-09-12T12:36:27.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.445+0000 7f2a373b4740 1 -- start start 2024-09-12T12:36:27.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.445+0000 7f2a373b4740 1 Processor -- start 2024-09-12T12:36:27.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.445+0000 7f2a373b4740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d4be95790 0x557d4bea0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:27.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.445+0000 7f2a373b4740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d4be960b0 0x557d4be9d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:27.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.445+0000 7f2a373b4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557d4bea0970 0x557d4be9d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:27.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.445+0000 7f2a373b4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x557d4bea34b0 con 0x557d4bea0970 2024-09-12T12:36:27.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.445+0000 7f2a373b4740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557d4bdb6050 con 0x557d4be95790 2024-09-12T12:36:27.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.445+0000 7f2a373b4740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557d4bea3630 con 0x557d4be960b0 2024-09-12T12:36:27.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.445+0000 7f2a373b4740 10 client.0 _ll_register_callbacks cb 0x557d4bdf6160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:36:27.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.446+0000 7f2a2dd9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d4be960b0 0x557d4be9d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:27.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.446+0000 7f2a2e59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d4be95790 0x557d4bea0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:27.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.446+0000 7f2a2e59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d4be95790 0x557d4bea0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:37970/0 (socket says 172.21.15.33:37970) 2024-09-12T12:36:27.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.446+0000 7f2a2e59c640 1 -- 172.21.15.33:0/1988351562 learned_addr learned my addr 172.21.15.33:0/1988351562 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:36:27.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.447+0000 7f2a2dd9b640 1 -- 172.21.15.33:0/1988351562 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d4be95790 msgr2=0x557d4bea0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:36:27.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.447+0000 7f2a2dd9b640 1 --2- 172.21.15.33:0/1988351562 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d4be95790 0x557d4bea0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:27.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.447+0000 7f2a2dd9b640 1 -- 172.21.15.33:0/1988351562 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557d4bea0970 msgr2=0x557d4be9d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:36:27.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.447+0000 7f2a2dd9b640 1 --2- 172.21.15.33:0/1988351562 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557d4bea0970 0x557d4be9d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:27.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.447+0000 7f2a2dd9b640 1 -- 172.21.15.33:0/1988351562 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d4bb6c3c0 con 0x557d4be960b0 2024-09-12T12:36:27.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.449+0000 7f2a2dd9b640 1 --2- 172.21.15.33:0/1988351562 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d4be960b0 0x557d4be9d2f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2a24035040 tx=0x7f2a24004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2e4e6d7b84db512 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:36:27.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.449+0000 7f2a15ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:36:27.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.449+0000 7f2a15ffb640 1 -- 172.21.15.33:0/1988351562 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a24040020 con 0x557d4be960b0 2024-09-12T12:36:27.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.449+0000 7f2a373b4740 1 -- 172.21.15.33:0/1988351562 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a28019070 con 0x557d4be960b0 2024-09-12T12:36:27.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.450+0000 7f2a15ffb640 1 -- 172.21.15.33:0/1988351562 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f2a24030450 con 0x557d4be960b0 2024-09-12T12:36:27.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.450+0000 7f2a15ffb640 1 -- 172.21.15.33:0/1988351562 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2a2404b050 con 0x557d4be960b0 2024-09-12T12:36:27.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.450+0000 7f2a373b4740 10 client.26047 fetch_fsmap learned FSMap version 27 2024-09-12T12:36:27.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.450+0000 7f2a373b4740 1 -- 172.21.15.33:0/1988351562 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557d4beaec20 con 0x557d4be960b0 2024-09-12T12:36:27.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.450+0000 7f2a15ffb640 1 -- 172.21.15.33:0/1988351562 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2a28019070 con 0x557d4be960b0 2024-09-12T12:36:27.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.452+0000 7f2a15ffb640 1 -- 172.21.15.33:0/1988351562 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f2a240046c0 con 0x557d4be960b0 2024-09-12T12:36:27.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.453+0000 7f2a373b4740 10 client.26047 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:36:27.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.453+0000 7f2a373b4740 10 client.26047 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:36:27.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.453+0000 7f2a373b4740 20 client.26047 populate_metadata read hostname 'smithi033' 2024-09-12T12:36:27.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.453+0000 7f2a373b4740 1 --2- 172.21.15.33:0/1988351562 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x557d4beb0500 0x557d4beb2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:27.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.453+0000 7f2a373b4740 4 client.26047 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:36:27.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.453+0000 7f2a373b4740 1 -- 172.21.15.33:0/1988351562 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d4be08850 con 0x557d4beb0500 2024-09-12T12:36:27.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.453+0000 7f2a2e59c640 1 --2- 172.21.15.33:0/1988351562 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x557d4beb0500 0x557d4beb2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:27.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.454+0000 7f2a2e59c640 1 --2- 172.21.15.33:0/1988351562 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x557d4beb0500 0x557d4beb2960 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f3b1b45860c7efd server_cookie=1120babdb305467f in_seq=0 out_seq=0 2024-09-12T12:36:27.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.455+0000 7f2a15ffb640 10 client.26047 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:36:27.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.456+0000 7f2a15ffb640 1 -- 172.21.15.33:0/1988351562 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557d4be08850 con 0x557d4beb0500 2024-09-12T12:36:27.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.456+0000 7f2a15ffb640 10 client.26047 handle_command_reply: tid=0 2024-09-12T12:36:27.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.456+0000 7f2a373b4740 1 client.26047 shutdown 2024-09-12T12:36:27.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.458+0000 7f2a2ed9d640 1 --2- 172.21.15.33:0/3388770324 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2a180a2d10 0x7f2a180a51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:27.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.458+0000 7f2a373b4740 1 -- 172.21.15.33:0/1988351562 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d4be960b0 msgr2=0x557d4be9d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:27.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.458+0000 7f2a373b4740 1 --2- 172.21.15.33:0/1988351562 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d4be960b0 0x557d4be9d2f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2a24035040 tx=0x7f2a24004270 comp rx=0 tx=0).stop 2024-09-12T12:36:27.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.458+0000 7f2a373b4740 1 -- 172.21.15.33:0/1988351562 shutdown_connections 2024-09-12T12:36:27.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.458+0000 7f2a373b4740 1 --2- 172.21.15.33:0/1988351562 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x557d4beb0500 0x557d4beb2960 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:27.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.458+0000 7f2a373b4740 1 --2- 172.21.15.33:0/1988351562 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557d4bea0970 0x557d4be9d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:27.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.458+0000 7f2a373b4740 1 --2- 172.21.15.33:0/1988351562 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d4be960b0 0x557d4be9d2f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:27.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.458+0000 7f2a373b4740 1 --2- 172.21.15.33:0/1988351562 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d4be95790 0x557d4bea0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:27.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.458+0000 7f2a373b4740 1 -- 172.21.15.33:0/1988351562 >> 172.21.15.33:0/1988351562 conn(0x557d4be91d20 msgr2=0x557d4be90ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:36:27.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.458+0000 7f2a2ed9d640 1 --2- 172.21.15.33:0/3388770324 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2a180a2d10 0x7f2a180a51d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2a28001fc0 tx=0x7f2a280133a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:36:27.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.458+0000 7f2a15ffb640 0 client.26047 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:36:27.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.459+0000 7f2a373b4740 1 -- 172.21.15.33:0/1988351562 shutdown_connections 2024-09-12T12:36:27.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.459+0000 7f2a373b4740 1 -- 172.21.15.33:0/1988351562 wait complete. 2024-09-12T12:36:27.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.459+0000 7f2a373b4740 20 client.26047 trim_cache size 0 max 16384 2024-09-12T12:36:27.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.493+0000 7f2a373b4740 1 Processor -- start 2024-09-12T12:36:27.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.493+0000 7f2a373b4740 1 -- start start 2024-09-12T12:36:27.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.494+0000 7f2a373b4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557d4be95790 0x557d4be98a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:27.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.494+0000 7f2a373b4740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d4be960b0 0x557d4beb8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:27.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.494+0000 7f2a373b4740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d4bea0970 0x557d4beb87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:27.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.494+0000 7f2a373b4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2a301c8d20 con 0x557d4be95790 2024-09-12T12:36:27.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.495+0000 7f2a2e59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557d4be95790 0x557d4be98a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:27.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.495+0000 7f2a2e59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557d4be95790 0x557d4be98a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49750/0 (socket says 172.21.15.33:49750) 2024-09-12T12:36:27.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.495+0000 7f2a2e59c640 1 -- 172.21.15.33:0/1342986961 learned_addr learned my addr 172.21.15.33:0/1342986961 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:36:27.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.495+0000 7f2a2ed9d640 1 --2- 172.21.15.33:0/1342986961 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d4bea0970 0x557d4beb87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:27.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.495+0000 7f2a373b4740 1 -- 172.21.15.33:0/1342986961 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2a301c65f0 con 0x557d4be960b0 2024-09-12T12:36:27.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.495+0000 7f2a373b4740 1 -- 172.21.15.33:0/1342986961 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2a30118760 con 0x557d4bea0970 2024-09-12T12:36:27.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.496+0000 7f2a2e59c640 1 -- 172.21.15.33:0/1342986961 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d4bea0970 msgr2=0x557d4beb87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:36:27.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.496+0000 7f2a2e59c640 1 --2- 172.21.15.33:0/1342986961 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d4bea0970 0x557d4beb87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:27.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.496+0000 7f2a2e59c640 1 -- 172.21.15.33:0/1342986961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d4be960b0 msgr2=0x557d4beb8270 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:36:27.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.496+0000 7f2a2e59c640 1 --2- 172.21.15.33:0/1342986961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d4be960b0 0x557d4beb8270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:27.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.496+0000 7f2a2e59c640 1 -- 172.21.15.33:0/1342986961 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d4be63de0 con 0x557d4be95790 2024-09-12T12:36:27.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.496+0000 7f2a2e59c640 1 --2- 172.21.15.33:0/1342986961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557d4be95790 0x557d4be98a50 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f2a2009b930 tx=0x7f2a200094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8f7cbd3a4f0e025 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:36:27.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.498+0000 7f2a177fe640 1 -- 172.21.15.33:0/1342986961 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a200a8020 con 0x557d4be95790 2024-09-12T12:36:27.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.498+0000 7f2a177fe640 1 -- 172.21.15.33:0/1342986961 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2a2009bc30 con 0x557d4be95790 2024-09-12T12:36:27.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.499+0000 7f2a373b4740 1 -- 172.21.15.33:0/1342986961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557d4be95790 msgr2=0x557d4be98a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:27.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.499+0000 7f2a373b4740 1 --2- 172.21.15.33:0/1342986961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557d4be95790 0x557d4be98a50 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f2a2009b930 tx=0x7f2a200094c0 comp rx=0 tx=0).stop 2024-09-12T12:36:27.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.499+0000 7f2a373b4740 1 -- 172.21.15.33:0/1342986961 shutdown_connections 2024-09-12T12:36:27.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.499+0000 7f2a373b4740 1 --2- 172.21.15.33:0/1342986961 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d4bea0970 0x557d4beb87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:27.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.499+0000 7f2a373b4740 1 --2- 172.21.15.33:0/1342986961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d4be960b0 0x557d4beb8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:27.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.499+0000 7f2a373b4740 1 --2- 172.21.15.33:0/1342986961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557d4be95790 0x557d4be98a50 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:27.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.499+0000 7f2a373b4740 1 -- 172.21.15.33:0/1342986961 >> 172.21.15.33:0/1342986961 conn(0x557d4be91d20 msgr2=0x557d4be98340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:36:27.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.504+0000 7f2a373b4740 1 -- 172.21.15.33:0/1342986961 shutdown_connections 2024-09-12T12:36:27.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.504+0000 7f2a373b4740 1 -- 172.21.15.33:0/1342986961 wait complete. 2024-09-12T12:36:27.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.504+0000 7f2a373b4740 1 -- start start 2024-09-12T12:36:27.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.504+0000 7f2a373b4740 1 Processor -- start 2024-09-12T12:36:27.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.505+0000 7f2a373b4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557d4be95790 0x557d4bea4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:27.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.505+0000 7f2a373b4740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d4be960b0 0x557d4bea4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:27.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.505+0000 7f2a373b4740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d4bea0970 0x557d4bea51c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:27.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.505+0000 7f2a373b4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2a30118dd0 con 0x557d4be95790 2024-09-12T12:36:27.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.505+0000 7f2a373b4740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2a301c5f20 con 0x557d4be960b0 2024-09-12T12:36:27.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.505+0000 7f2a373b4740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2a301c5180 con 0x557d4bea0970 2024-09-12T12:36:27.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.505+0000 7f2a373b4740 10 client.0 _ll_register_callbacks cb 0x7f2a24035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:36:27.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.507+0000 7f2a2dd9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d4be960b0 0x557d4bea4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:27.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.507+0000 7f2a2ed9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d4bea0970 0x557d4bea51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:27.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.507+0000 7f2a2e59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557d4be95790 0x557d4bea4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:27.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.507+0000 7f2a2e59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557d4be95790 0x557d4bea4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49762/0 (socket says 172.21.15.33:49762) 2024-09-12T12:36:27.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.507+0000 7f2a2e59c640 1 -- 172.21.15.33:0/1748224143 learned_addr learned my addr 172.21.15.33:0/1748224143 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:36:27.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.510+0000 7f2a2e59c640 1 -- 172.21.15.33:0/1748224143 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d4bea0970 msgr2=0x557d4bea51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:36:27.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.510+0000 7f2a2e59c640 1 --2- 172.21.15.33:0/1748224143 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d4bea0970 0x557d4bea51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:27.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.510+0000 7f2a2e59c640 1 -- 172.21.15.33:0/1748224143 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d4be960b0 msgr2=0x557d4bea4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:36:27.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.510+0000 7f2a2e59c640 1 --2- 172.21.15.33:0/1748224143 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d4be960b0 0x557d4bea4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:27.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.510+0000 7f2a2e59c640 1 -- 172.21.15.33:0/1748224143 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d4bf1a3a0 con 0x557d4be95790 2024-09-12T12:36:27.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.510+0000 7f2a2ed9d640 1 --2- 172.21.15.33:0/1748224143 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d4bea0970 0x557d4bea51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:36:27.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.511+0000 7f2a2e59c640 1 --2- 172.21.15.33:0/1748224143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557d4be95790 0x557d4bea4740 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f2a2000c6a0 tx=0x7f2a200cfaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4339045c9bb7e3ca server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:36:27.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.514+0000 7f2a157fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:36:27.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.514+0000 7f2a157fa640 1 -- 172.21.15.33:0/1748224143 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a200a8070 con 0x557d4be95790 2024-09-12T12:36:27.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.514+0000 7f2a157fa640 1 -- 172.21.15.33:0/1748224143 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f2a2001fde0 con 0x557d4be95790 2024-09-12T12:36:27.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.514+0000 7f2a373b4740 1 -- 172.21.15.33:0/1748224143 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a2009bc30 con 0x557d4be95790 2024-09-12T12:36:27.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.515+0000 7f2a157fa640 1 -- 172.21.15.33:0/1748224143 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2a200046c0 con 0x557d4be95790 2024-09-12T12:36:27.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.518+0000 7f2a373b4740 10 client.16236 fetch_fsmap learned FSMap version 27 2024-09-12T12:36:27.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.518+0000 7f2a373b4740 1 -- 172.21.15.33:0/1748224143 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557d4bf1b630 con 0x557d4be95790 2024-09-12T12:36:27.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.519+0000 7f2a157fa640 1 -- 172.21.15.33:0/1748224143 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2a2009bc30 con 0x557d4be95790 2024-09-12T12:36:27.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.519+0000 7f2a157fa640 1 -- 172.21.15.33:0/1748224143 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f2a20097980 con 0x557d4be95790 2024-09-12T12:36:27.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.519+0000 7f2a373b4740 10 client.16236 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:36:27.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.519+0000 7f2a373b4740 10 client.16236 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:36:27.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.519+0000 7f2a373b4740 20 client.16236 populate_metadata read hostname 'smithi033' 2024-09-12T12:36:27.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.519+0000 7f2a373b4740 1 --2- 172.21.15.33:0/1748224143 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x557d4bf1ba70 0x557d4bf1de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:36:27.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.519+0000 7f2a373b4740 4 client.16236 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:36:27.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.519+0000 7f2a373b4740 1 -- 172.21.15.33:0/1748224143 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557d4be02d60 con 0x557d4bf1ba70 2024-09-12T12:36:27.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.520+0000 7f2a2dd9b640 1 --2- 172.21.15.33:0/1748224143 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x557d4bf1ba70 0x557d4bf1de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:36:27.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.524+0000 7f2a2dd9b640 1 --2- 172.21.15.33:0/1748224143 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x557d4bf1ba70 0x557d4bf1de60 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a3a92a38dfa779 server_cookie=cf9130834bce745 in_seq=0 out_seq=0 2024-09-12T12:36:27.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.524+0000 7f2a157fa640 10 client.16236 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:36:27.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.524+0000 7f2a157fa640 1 -- 172.21.15.33:0/1748224143 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x557d4be02d60 con 0x557d4bf1ba70 2024-09-12T12:36:27.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.524+0000 7f2a157fa640 10 client.16236 handle_command_reply: tid=0 2024-09-12T12:36:27.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.524+0000 7f2a373b4740 1 client.16236 shutdown 2024-09-12T12:36:27.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.528+0000 7f2a373b4740 1 -- 172.21.15.33:0/1748224143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557d4be95790 msgr2=0x557d4bea4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:27.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.528+0000 7f2a373b4740 1 --2- 172.21.15.33:0/1748224143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557d4be95790 0x557d4bea4740 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f2a2000c6a0 tx=0x7f2a200cfaf0 comp rx=0 tx=0).stop 2024-09-12T12:36:27.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.529+0000 7f2a373b4740 1 -- 172.21.15.33:0/1748224143 shutdown_connections 2024-09-12T12:36:27.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.529+0000 7f2a373b4740 1 --2- 172.21.15.33:0/1748224143 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x557d4bf1ba70 0x557d4bf1de60 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:27.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.529+0000 7f2a373b4740 1 --2- 172.21.15.33:0/1748224143 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d4bea0970 0x557d4bea51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:27.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.529+0000 7f2a373b4740 1 --2- 172.21.15.33:0/1748224143 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d4be960b0 0x557d4bea4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:27.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.529+0000 7f2a373b4740 1 --2- 172.21.15.33:0/1748224143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557d4be95790 0x557d4bea4740 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:27.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.529+0000 7f2a157fa640 0 client.16236 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:36:27.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.529+0000 7f2a373b4740 1 -- 172.21.15.33:0/1748224143 >> 172.21.15.33:0/1748224143 conn(0x557d4be91d20 msgr2=0x557d4be98b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:36:27.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.529+0000 7f2a373b4740 1 -- 172.21.15.33:0/1748224143 shutdown_connections 2024-09-12T12:36:27.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.529+0000 7f2a373b4740 1 -- 172.21.15.33:0/1748224143 wait complete. 2024-09-12T12:36:27.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.530+0000 7f2a373b4740 20 client.16236 trim_cache size 0 max 16384 2024-09-12T12:36:27.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.536+0000 7f2a1d7fa640 1 -- 172.21.15.33:0/3388770324 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2a180a2d10 msgr2=0x7f2a180a51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:27.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.536+0000 7f2a1d7fa640 1 --2- 172.21.15.33:0/3388770324 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2a180a2d10 0x7f2a180a51d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2a28001fc0 tx=0x7f2a280133a0 comp rx=0 tx=0).stop 2024-09-12T12:36:27.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.537+0000 7f2a1d7fa640 1 -- 172.21.15.33:0/3388770324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a30109450 msgr2=0x7f2a301a7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:27.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.537+0000 7f2a1d7fa640 1 --2- 172.21.15.33:0/3388770324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a30109450 0x7f2a301a7280 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f2a2000e9c0 tx=0x7f2a2000ee80 comp rx=0 tx=0).stop 2024-09-12T12:36:27.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.537+0000 7f2a1d7fa640 1 -- 172.21.15.33:0/3388770324 shutdown_connections 2024-09-12T12:36:27.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.537+0000 7f2a1d7fa640 1 --2- 172.21.15.33:0/3388770324 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2a180a2d10 0x7f2a180a51d0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:27.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.537+0000 7f2a1d7fa640 1 --2- 172.21.15.33:0/3388770324 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a3011b140 0x7f2a301abb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:27.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.537+0000 7f2a1d7fa640 1 --2- 172.21.15.33:0/3388770324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a30109830 0x7f2a301a77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:27.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.537+0000 7f2a1d7fa640 1 --2- 172.21.15.33:0/3388770324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a30109450 0x7f2a301a7280 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:36:27.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.537+0000 7f2a1d7fa640 1 -- 172.21.15.33:0/3388770324 >> 172.21.15.33:0/3388770324 conn(0x7f2a3006e140 msgr2=0x7f2a3011c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:36:27.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.540+0000 7f2a1d7fa640 1 -- 172.21.15.33:0/3388770324 shutdown_connections 2024-09-12T12:36:27.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:27.540+0000 7f2a1d7fa640 1 -- 172.21.15.33:0/3388770324 wait complete. 2024-09-12T12:36:28.415 INFO:tasks.cephfs.filesystem:scrub status for tag:6fbf8f7e-7aed-48f6-8ed7-0687e9b7bea3 - {'path': '/', 'tag': '6fbf8f7e-7aed-48f6-8ed7-0687e9b7bea3', 'options': 'recursive,force'} 2024-09-12T12:36:29.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:29 smithi033 ceph-mon[31246]: pgmap v664: 129 pgs: 129 active+clean; 10 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 36 MiB/s wr, 711 op/s 2024-09-12T12:36:29.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:29 smithi043 ceph-mon[34144]: pgmap v664: 129 pgs: 129 active+clean; 10 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 36 MiB/s wr, 711 op/s 2024-09-12T12:36:29.647 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:29 smithi102 ceph-mon[34799]: pgmap v664: 129 pgs: 129 active+clean; 10 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 36 MiB/s wr, 711 op/s 2024-09-12T12:36:31.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:31 smithi043 ceph-mon[34144]: pgmap v665: 129 pgs: 129 active+clean; 10 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 26 MiB/s wr, 523 op/s 2024-09-12T12:36:31.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:31 smithi102 ceph-mon[34799]: pgmap v665: 129 pgs: 129 active+clean; 10 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 26 MiB/s wr, 523 op/s 2024-09-12T12:36:31.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:31 smithi033 ceph-mon[31246]: pgmap v665: 129 pgs: 129 active+clean; 10 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 26 MiB/s wr, 523 op/s 2024-09-12T12:36:33.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:33 smithi043 ceph-mon[34144]: pgmap v666: 129 pgs: 129 active+clean; 10 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 30 MiB/s wr, 595 op/s 2024-09-12T12:36:33.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:33 smithi043 ceph-mon[34144]: scrub summary: idle 2024-09-12T12:36:33.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:33 smithi102 ceph-mon[34799]: pgmap v666: 129 pgs: 129 active+clean; 10 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 30 MiB/s wr, 595 op/s 2024-09-12T12:36:33.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:33 smithi102 ceph-mon[34799]: scrub summary: idle 2024-09-12T12:36:33.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:33 smithi033 ceph-mon[31246]: pgmap v666: 129 pgs: 129 active+clean; 10 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 30 MiB/s wr, 595 op/s 2024-09-12T12:36:33.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:33 smithi033 ceph-mon[31246]: scrub summary: idle 2024-09-12T12:36:34.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:34 smithi043 ceph-mon[34144]: scrub summary: idle 2024-09-12T12:36:34.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:34 smithi102 ceph-mon[34799]: scrub summary: idle 2024-09-12T12:36:34.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:34 smithi033 ceph-mon[31246]: scrub summary: idle 2024-09-12T12:36:35.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:35 smithi043 ceph-mon[34144]: pgmap v667: 129 pgs: 129 active+clean; 10 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 33 MiB/s wr, 657 op/s 2024-09-12T12:36:35.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:35 smithi102 ceph-mon[34799]: pgmap v667: 129 pgs: 129 active+clean; 10 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 33 MiB/s wr, 657 op/s 2024-09-12T12:36:35.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:35 smithi033 ceph-mon[31246]: pgmap v667: 129 pgs: 129 active+clean; 10 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 33 MiB/s wr, 657 op/s 2024-09-12T12:36:37.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:37 smithi043 ceph-mon[34144]: pgmap v668: 129 pgs: 129 active+clean; 10 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 26 MiB/s wr, 503 op/s 2024-09-12T12:36:37.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:37 smithi102 ceph-mon[34799]: pgmap v668: 129 pgs: 129 active+clean; 10 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 26 MiB/s wr, 503 op/s 2024-09-12T12:36:37.733 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:37 smithi033 ceph-mon[31246]: pgmap v668: 129 pgs: 129 active+clean; 10 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 26 MiB/s wr, 503 op/s 2024-09-12T12:36:39.562 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:39 smithi033 ceph-mon[31246]: pgmap v669: 129 pgs: 129 active+clean; 10 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 38 MiB/s wr, 746 op/s 2024-09-12T12:36:39.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:39 smithi043 ceph-mon[34144]: pgmap v669: 129 pgs: 129 active+clean; 10 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 38 MiB/s wr, 746 op/s 2024-09-12T12:36:39.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:39 smithi102 ceph-mon[34799]: pgmap v669: 129 pgs: 129 active+clean; 10 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 38 MiB/s wr, 746 op/s 2024-09-12T12:36:41.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:41 smithi033 ceph-mon[31246]: pgmap v670: 129 pgs: 129 active+clean; 10 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 28 MiB/s wr, 545 op/s 2024-09-12T12:36:41.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:41 smithi043 ceph-mon[34144]: pgmap v670: 129 pgs: 129 active+clean; 10 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 28 MiB/s wr, 545 op/s 2024-09-12T12:36:41.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:41 smithi102 ceph-mon[34799]: pgmap v670: 129 pgs: 129 active+clean; 10 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 28 MiB/s wr, 545 op/s 2024-09-12T12:36:43.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:43 smithi043 ceph-mon[34144]: pgmap v671: 129 pgs: 129 active+clean; 10 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 31 MiB/s wr, 611 op/s 2024-09-12T12:36:43.649 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:43 smithi102 ceph-mon[34799]: pgmap v671: 129 pgs: 129 active+clean; 10 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 31 MiB/s wr, 611 op/s 2024-09-12T12:36:43.730 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:43 smithi033 ceph-mon[31246]: pgmap v671: 129 pgs: 129 active+clean; 10 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 31 MiB/s wr, 611 op/s 2024-09-12T12:36:45.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:45 smithi043 ceph-mon[34144]: pgmap v672: 129 pgs: 129 active+clean; 10 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 34 MiB/s wr, 663 op/s 2024-09-12T12:36:45.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:45 smithi102 ceph-mon[34799]: pgmap v672: 129 pgs: 129 active+clean; 10 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 34 MiB/s wr, 663 op/s 2024-09-12T12:36:45.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:45 smithi033 ceph-mon[31246]: pgmap v672: 129 pgs: 129 active+clean; 10 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 34 MiB/s wr, 663 op/s 2024-09-12T12:36:47.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:47 smithi043 ceph-mon[34144]: pgmap v673: 129 pgs: 129 active+clean; 10 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 26 MiB/s wr, 506 op/s 2024-09-12T12:36:47.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:47 smithi102 ceph-mon[34799]: pgmap v673: 129 pgs: 129 active+clean; 10 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 26 MiB/s wr, 506 op/s 2024-09-12T12:36:47.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:47 smithi033 ceph-mon[31246]: pgmap v673: 129 pgs: 129 active+clean; 10 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 26 MiB/s wr, 506 op/s 2024-09-12T12:36:49.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:49 smithi043 ceph-mon[34144]: pgmap v674: 129 pgs: 129 active+clean; 10 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 38 MiB/s wr, 739 op/s 2024-09-12T12:36:49.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:49 smithi102 ceph-mon[34799]: pgmap v674: 129 pgs: 129 active+clean; 10 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 38 MiB/s wr, 739 op/s 2024-09-12T12:36:49.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:49 smithi033 ceph-mon[31246]: pgmap v674: 129 pgs: 129 active+clean; 10 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 38 MiB/s wr, 739 op/s 2024-09-12T12:36:51.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:51 smithi043 ceph-mon[34144]: pgmap v675: 129 pgs: 129 active+clean; 10 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 27 MiB/s wr, 522 op/s 2024-09-12T12:36:51.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:51 smithi102 ceph-mon[34799]: pgmap v675: 129 pgs: 129 active+clean; 10 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 27 MiB/s wr, 522 op/s 2024-09-12T12:36:51.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:51 smithi033 ceph-mon[31246]: pgmap v675: 129 pgs: 129 active+clean; 10 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 27 MiB/s wr, 522 op/s 2024-09-12T12:36:53.615 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:53 smithi043 ceph-mon[34144]: pgmap v676: 129 pgs: 129 active+clean; 10 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 30 MiB/s wr, 571 op/s 2024-09-12T12:36:53.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:53 smithi102 ceph-mon[34799]: pgmap v676: 129 pgs: 129 active+clean; 10 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 30 MiB/s wr, 571 op/s 2024-09-12T12:36:53.735 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:53 smithi033 ceph-mon[31246]: pgmap v676: 129 pgs: 129 active+clean; 10 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 30 MiB/s wr, 571 op/s 2024-09-12T12:36:55.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:55 smithi102 ceph-mon[34799]: pgmap v677: 129 pgs: 129 active+clean; 10 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 35 MiB/s wr, 670 op/s 2024-09-12T12:36:55.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:55 smithi033 ceph-mon[31246]: pgmap v677: 129 pgs: 129 active+clean; 10 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 35 MiB/s wr, 670 op/s 2024-09-12T12:36:55.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:55 smithi043 ceph-mon[34144]: pgmap v677: 129 pgs: 129 active+clean; 10 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 35 MiB/s wr, 670 op/s 2024-09-12T12:36:57.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:57 smithi102 ceph-mon[34799]: pgmap v678: 129 pgs: 129 active+clean; 10 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 27 MiB/s wr, 522 op/s 2024-09-12T12:36:57.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:57 smithi033 ceph-mon[31246]: pgmap v678: 129 pgs: 129 active+clean; 10 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 27 MiB/s wr, 522 op/s 2024-09-12T12:36:57.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:57 smithi043 ceph-mon[34144]: pgmap v678: 129 pgs: 129 active+clean; 10 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 27 MiB/s wr, 522 op/s 2024-09-12T12:36:58.416 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T12:36:59.251 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:36:59.637 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:36:59 smithi033 ceph-mon[31246]: pgmap v679: 129 pgs: 129 active+clean; 10 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 40 MiB/s wr, 754 op/s 2024-09-12T12:36:59.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:36:59 smithi102 ceph-mon[34799]: pgmap v679: 129 pgs: 129 active+clean; 10 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 40 MiB/s wr, 754 op/s 2024-09-12T12:36:59.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:36:59 smithi043 ceph-mon[34144]: pgmap v679: 129 pgs: 129 active+clean; 10 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 40 MiB/s wr, 754 op/s 2024-09-12T12:36:59.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:59.998+0000 7fb75dbb1640 1 -- 172.21.15.33:0/1385727279 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7500a5140 msgr2=0x7fb7500b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:36:59.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:36:59.998+0000 7fb75dbb1640 1 --2- 172.21.15.33:0/1385727279 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7500a5140 0x7fb7500b7000 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fb744009900 tx=0x7fb74402a4d0 comp rx=0 tx=0).stop 2024-09-12T12:37:00.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.010+0000 7fb75dbb1640 1 -- 172.21.15.33:0/1385727279 shutdown_connections 2024-09-12T12:37:00.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.010+0000 7fb75dbb1640 1 --2- 172.21.15.33:0/1385727279 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb7500b7540 0x7fb7500b9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:00.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.010+0000 7fb75dbb1640 1 --2- 172.21.15.33:0/1385727279 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7500a5140 0x7fb7500b7000 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:00.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.010+0000 7fb75dbb1640 1 --2- 172.21.15.33:0/1385727279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7500a4820 0x7fb7500a4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:00.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.010+0000 7fb75dbb1640 1 -- 172.21.15.33:0/1385727279 >> 172.21.15.33:0/1385727279 conn(0x7fb75001a0e0 msgr2=0x7fb75001a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:37:00.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.010+0000 7fb75dbb1640 1 -- 172.21.15.33:0/1385727279 shutdown_connections 2024-09-12T12:37:00.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.010+0000 7fb75dbb1640 1 -- 172.21.15.33:0/1385727279 wait complete. 2024-09-12T12:37:00.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.011+0000 7fb75dbb1640 1 Processor -- start 2024-09-12T12:37:00.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.011+0000 7fb75dbb1640 1 -- start start 2024-09-12T12:37:00.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.011+0000 7fb75dbb1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7500a4820 0x7fb7500b55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:00.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.011+0000 7fb75dbb1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7500a5140 0x7fb7500ae680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:00.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.011+0000 7fb75dbb1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb7500b7540 0x7fb7500aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:00.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.011+0000 7fb75dbb1640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb7500bcf20 con 0x7fb7500a4820 2024-09-12T12:37:00.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.011+0000 7fb75dbb1640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb7500bcda0 con 0x7fb7500a5140 2024-09-12T12:37:00.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.011+0000 7fb75dbb1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb7500bd0a0 con 0x7fb7500b7540 2024-09-12T12:37:00.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.012+0000 7fb75d3b0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb7500b7540 0x7fb7500aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:00.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.012+0000 7fb75d3b0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb7500b7540 0x7fb7500aebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:54088/0 (socket says 172.21.15.33:54088) 2024-09-12T12:37:00.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.012+0000 7fb75d3b0640 1 -- 172.21.15.33:0/3461810348 learned_addr learned my addr 172.21.15.33:0/3461810348 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:37:00.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.013+0000 7fb757fff640 1 --2- 172.21.15.33:0/3461810348 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7500a5140 0x7fb7500ae680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:00.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.013+0000 7fb75d3b0640 1 -- 172.21.15.33:0/3461810348 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7500a5140 msgr2=0x7fb7500ae680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:00.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.013+0000 7fb75d3b0640 1 --2- 172.21.15.33:0/3461810348 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7500a5140 0x7fb7500ae680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:00.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.013+0000 7fb75d3b0640 1 -- 172.21.15.33:0/3461810348 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7500a4820 msgr2=0x7fb7500b55f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T12:37:00.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.013+0000 7fb75d3b0640 1 --2- 172.21.15.33:0/3461810348 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7500a4820 0x7fb7500b55f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:00.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.013+0000 7fb75d3b0640 1 -- 172.21.15.33:0/3461810348 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7500af1b0 con 0x7fb7500b7540 2024-09-12T12:37:00.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.021+0000 7fb75d3b0640 1 --2- 172.21.15.33:0/3461810348 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb7500b7540 0x7fb7500aebc0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb758050280 tx=0x7fb758072b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:37:00.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.025+0000 7fb755ffb640 1 -- 172.21.15.33:0/3461810348 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb75806bbd0 con 0x7fb7500b7540 2024-09-12T12:37:00.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.026+0000 7fb75dbb1640 1 -- 172.21.15.33:0/3461810348 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7500af4a0 con 0x7fb7500b7540 2024-09-12T12:37:00.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.026+0000 7fb75dbb1640 1 -- 172.21.15.33:0/3461810348 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7500b3410 con 0x7fb7500b7540 2024-09-12T12:37:00.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.026+0000 7fb755ffb640 1 -- 172.21.15.33:0/3461810348 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb75806bd70 con 0x7fb7500b7540 2024-09-12T12:37:00.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.026+0000 7fb755ffb640 1 -- 172.21.15.33:0/3461810348 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb75807a680 con 0x7fb7500b7540 2024-09-12T12:37:00.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.033+0000 7fb7611ec740 1 Processor -- start 2024-09-12T12:37:00.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.033+0000 7fb7611ec740 1 -- start start 2024-09-12T12:37:00.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.033+0000 7fb7611ec740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558b1a773670 0x558b1a773a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:00.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.033+0000 7fb7611ec740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b1a773f90 0x558b1a77e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:00.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.033+0000 7fb7611ec740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b1a77e850 0x558b1a780c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:00.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.033+0000 7fb7611ec740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x558b1a6d92e0 con 0x558b1a773670 2024-09-12T12:37:00.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.033+0000 7fb7611ec740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558b1a680ce0 con 0x558b1a773f90 2024-09-12T12:37:00.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.033+0000 7fb7611ec740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558b1a6d52a0 con 0x558b1a77e850 2024-09-12T12:37:00.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.033+0000 7fb755ffb640 1 -- 172.21.15.33:0/3461810348 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fb75807a960 con 0x7fb7500b7540 2024-09-12T12:37:00.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.034+0000 7fb75cbaf640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b1a773f90 0x558b1a77e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:00.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.034+0000 7fb75cbaf640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b1a773f90 0x558b1a77e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:52648/0 (socket says 172.21.15.33:52648) 2024-09-12T12:37:00.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.034+0000 7fb75cbaf640 1 -- 172.21.15.33:0/3442258636 learned_addr learned my addr 172.21.15.33:0/3442258636 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:37:00.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.034+0000 7fb75cbaf640 1 -- 172.21.15.33:0/3442258636 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b1a77e850 msgr2=0x558b1a780c40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:37:00.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.034+0000 7fb75cbaf640 1 --2- 172.21.15.33:0/3442258636 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b1a77e850 0x558b1a780c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:00.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.034+0000 7fb75cbaf640 1 -- 172.21.15.33:0/3442258636 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558b1a773670 msgr2=0x558b1a773a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:37:00.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.034+0000 7fb75cbaf640 1 --2- 172.21.15.33:0/3442258636 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558b1a773670 0x558b1a773a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:00.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.034+0000 7fb75cbaf640 1 -- 172.21.15.33:0/3442258636 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b1a665440 con 0x558b1a773f90 2024-09-12T12:37:00.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.037+0000 7fb75cbaf640 1 --2- 172.21.15.33:0/3442258636 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b1a773f90 0x558b1a77e310 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb74c009770 tx=0x7fb74c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=789f2b2ad11b3f67 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:37:00.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.039+0000 7fb742ffd640 1 -- 172.21.15.33:0/3442258636 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb74c015020 con 0x558b1a773f90 2024-09-12T12:37:00.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.042+0000 7fb742ffd640 1 -- 172.21.15.33:0/3442258636 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb74c011420 con 0x558b1a773f90 2024-09-12T12:37:00.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.042+0000 7fb742ffd640 1 -- 172.21.15.33:0/3442258636 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb74c0105c0 con 0x558b1a773f90 2024-09-12T12:37:00.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.044+0000 7fb7611ec740 1 -- 172.21.15.33:0/3442258636 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b1a773f90 msgr2=0x558b1a77e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:00.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.044+0000 7fb7611ec740 1 --2- 172.21.15.33:0/3442258636 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b1a773f90 0x558b1a77e310 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb74c009770 tx=0x7fb74c009c30 comp rx=0 tx=0).stop 2024-09-12T12:37:00.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.044+0000 7fb7611ec740 1 -- 172.21.15.33:0/3442258636 shutdown_connections 2024-09-12T12:37:00.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.044+0000 7fb7611ec740 1 --2- 172.21.15.33:0/3442258636 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b1a77e850 0x558b1a780c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:00.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.044+0000 7fb7611ec740 1 --2- 172.21.15.33:0/3442258636 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b1a773f90 0x558b1a77e310 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:00.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.044+0000 7fb7611ec740 1 --2- 172.21.15.33:0/3442258636 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558b1a773670 0x558b1a773a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:00.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.044+0000 7fb7611ec740 1 -- 172.21.15.33:0/3442258636 >> 172.21.15.33:0/3442258636 conn(0x558b1a76fc00 msgr2=0x558b1a76ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:37:00.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.045+0000 7fb755ffb640 1 --2- 172.21.15.33:0/3461810348 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb7480a2d60 0x7fb7480a5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:00.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.046+0000 7fb755ffb640 1 -- 172.21.15.33:0/3461810348 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fb758133710 con 0x7fb7500b7540 2024-09-12T12:37:00.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.047+0000 7fb75cbaf640 1 --2- 172.21.15.33:0/3461810348 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb7480a2d60 0x7fb7480a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:00.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.049+0000 7fb75cbaf640 1 --2- 172.21.15.33:0/3461810348 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb7480a2d60 0x7fb7480a5220 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb74c011e20 tx=0x7fb74c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:37:00.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.049+0000 7fb7611ec740 1 -- 172.21.15.33:0/3442258636 shutdown_connections 2024-09-12T12:37:00.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.050+0000 7fb7611ec740 1 -- 172.21.15.33:0/3442258636 wait complete. 2024-09-12T12:37:00.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.050+0000 7fb7611ec740 1 -- start start 2024-09-12T12:37:00.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.051+0000 7fb7611ec740 1 Processor -- start 2024-09-12T12:37:00.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.052+0000 7fb7611ec740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b1a773670 0x558b1a77e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:00.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.052+0000 7fb7611ec740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558b1a773f90 0x558b1a77b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:00.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.052+0000 7fb7611ec740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b1a77e850 0x558b1a77ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:00.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.052+0000 7fb7611ec740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x558b1a781420 con 0x558b1a773f90 2024-09-12T12:37:00.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.052+0000 7fb7611ec740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558b1a694050 con 0x558b1a773670 2024-09-12T12:37:00.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.052+0000 7fb7611ec740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558b1a7815a0 con 0x558b1a77e850 2024-09-12T12:37:00.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.052+0000 7fb7611ec740 10 client.0 _ll_register_callbacks cb 0x558b1a6d4160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:37:00.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.052+0000 7fb757fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558b1a773f90 0x558b1a77b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:00.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.053+0000 7fb757fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558b1a773f90 0x558b1a77b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58520/0 (socket says 172.21.15.33:58520) 2024-09-12T12:37:00.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.053+0000 7fb757fff640 1 -- 172.21.15.33:0/2576515825 learned_addr learned my addr 172.21.15.33:0/2576515825 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:37:00.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.053+0000 7fb75d3b0640 1 --2- 172.21.15.33:0/2576515825 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b1a77e850 0x558b1a77ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:00.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.053+0000 7fb75cbaf640 1 --2- 172.21.15.33:0/2576515825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b1a773670 0x558b1a77e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:00.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.054+0000 7fb75d3b0640 1 -- 172.21.15.33:0/2576515825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b1a773670 msgr2=0x558b1a77e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:37:00.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.054+0000 7fb75d3b0640 1 --2- 172.21.15.33:0/2576515825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b1a773670 0x558b1a77e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:00.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.054+0000 7fb75d3b0640 1 -- 172.21.15.33:0/2576515825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558b1a773f90 msgr2=0x558b1a77b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:37:00.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.054+0000 7fb75d3b0640 1 --2- 172.21.15.33:0/2576515825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558b1a773f90 0x558b1a77b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:00.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.054+0000 7fb75d3b0640 1 -- 172.21.15.33:0/2576515825 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b1a44a3c0 con 0x558b1a77e850 2024-09-12T12:37:00.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.055+0000 7fb75d3b0640 1 --2- 172.21.15.33:0/2576515825 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b1a77e850 0x558b1a77ba50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb758051220 tx=0x7fb7580ff5a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6ad13221ed55a85 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:37:00.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.055+0000 7fb737fff640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:37:00.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.057+0000 7fb737fff640 1 -- 172.21.15.33:0/2576515825 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7581087f0 con 0x558b1a77e850 2024-09-12T12:37:00.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.057+0000 7fb7611ec740 1 -- 172.21.15.33:0/2576515825 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb74c011420 con 0x558b1a77e850 2024-09-12T12:37:00.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.057+0000 7fb737fff640 1 -- 172.21.15.33:0/2576515825 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fb7581333c0 con 0x558b1a77e850 2024-09-12T12:37:00.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.060+0000 7fb737fff640 1 -- 172.21.15.33:0/2576515825 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb7580fc1f0 con 0x558b1a77e850 2024-09-12T12:37:00.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.061+0000 7fb7611ec740 10 client.26059 fetch_fsmap learned FSMap version 27 2024-09-12T12:37:00.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.061+0000 7fb7611ec740 1 -- 172.21.15.33:0/2576515825 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558b1a78cef0 con 0x558b1a77e850 2024-09-12T12:37:00.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.065+0000 7fb737fff640 1 -- 172.21.15.33:0/2576515825 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb74c011420 con 0x558b1a77e850 2024-09-12T12:37:00.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.065+0000 7fb737fff640 1 -- 172.21.15.33:0/2576515825 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fb758079070 con 0x558b1a77e850 2024-09-12T12:37:00.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.065+0000 7fb7611ec740 10 client.26059 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:37:00.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.065+0000 7fb7611ec740 10 client.26059 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:37:00.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.065+0000 7fb7611ec740 20 client.26059 populate_metadata read hostname 'smithi033' 2024-09-12T12:37:00.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.065+0000 7fb7611ec740 1 --2- 172.21.15.33:0/2576515825 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x558b1a78e7a0 0x558b1a790c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:00.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.065+0000 7fb7611ec740 4 client.26059 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:37:00.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.065+0000 7fb7611ec740 1 -- 172.21.15.33:0/2576515825 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558b1a6e6850 con 0x558b1a78e7a0 2024-09-12T12:37:00.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.069+0000 7fb75cbaf640 1 --2- 172.21.15.33:0/2576515825 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x558b1a78e7a0 0x558b1a790c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:00.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.072+0000 7fb75cbaf640 1 --2- 172.21.15.33:0/2576515825 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x558b1a78e7a0 0x558b1a790c20 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e98c19b033cb607 server_cookie=6ccbc415b83f668e in_seq=0 out_seq=0 2024-09-12T12:37:00.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.072+0000 7fb737fff640 10 client.26059 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:37:00.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.077+0000 7fb737fff640 1 -- 172.21.15.33:0/2576515825 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558b1a6e6850 con 0x558b1a78e7a0 2024-09-12T12:37:00.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.077+0000 7fb737fff640 10 client.26059 handle_command_reply: tid=0 2024-09-12T12:37:00.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.077+0000 7fb7611ec740 1 client.26059 shutdown 2024-09-12T12:37:00.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.082+0000 7fb7611ec740 1 -- 172.21.15.33:0/2576515825 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b1a77e850 msgr2=0x558b1a77ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:00.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.082+0000 7fb7611ec740 1 --2- 172.21.15.33:0/2576515825 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b1a77e850 0x558b1a77ba50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb758051220 tx=0x7fb7580ff5a0 comp rx=0 tx=0).stop 2024-09-12T12:37:00.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.083+0000 7fb7611ec740 1 -- 172.21.15.33:0/2576515825 shutdown_connections 2024-09-12T12:37:00.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.083+0000 7fb7611ec740 1 --2- 172.21.15.33:0/2576515825 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x558b1a78e7a0 0x558b1a790c20 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:00.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.083+0000 7fb7611ec740 1 --2- 172.21.15.33:0/2576515825 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b1a77e850 0x558b1a77ba50 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:00.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.083+0000 7fb7611ec740 1 --2- 172.21.15.33:0/2576515825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558b1a773f90 0x558b1a77b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:00.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.083+0000 7fb7611ec740 1 --2- 172.21.15.33:0/2576515825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b1a773670 0x558b1a77e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:00.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.083+0000 7fb7611ec740 1 -- 172.21.15.33:0/2576515825 >> 172.21.15.33:0/2576515825 conn(0x558b1a76fc00 msgr2=0x558b1a775930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:37:00.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.083+0000 7fb737fff640 0 client.26059 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:37:00.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.088+0000 7fb7611ec740 1 -- 172.21.15.33:0/2576515825 shutdown_connections 2024-09-12T12:37:00.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.090+0000 7fb7611ec740 1 -- 172.21.15.33:0/2576515825 wait complete. 2024-09-12T12:37:00.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.090+0000 7fb7611ec740 20 client.26059 trim_cache size 0 max 16384 2024-09-12T12:37:00.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.132+0000 7fb7611ec740 1 Processor -- start 2024-09-12T12:37:00.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.132+0000 7fb7611ec740 1 -- start start 2024-09-12T12:37:00.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.133+0000 7fb7611ec740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b1a773670 0x558b1a76ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:00.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.133+0000 7fb7611ec740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558b1a773f90 0x558b1a76ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:00.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.133+0000 7fb75cbaf640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b1a773670 0x558b1a76ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:00.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.133+0000 7fb75cbaf640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b1a773670 0x558b1a76ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:52654/0 (socket says 172.21.15.33:52654) 2024-09-12T12:37:00.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.134+0000 7fb75cbaf640 1 -- 172.21.15.33:0/3770223258 learned_addr learned my addr 172.21.15.33:0/3770223258 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:37:00.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.134+0000 7fb7611ec740 1 --2- 172.21.15.33:0/3770223258 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b1a77e850 0x558b1a7964f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:00.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.134+0000 7fb7611ec740 1 -- 172.21.15.33:0/3770223258 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb73c012580 con 0x558b1a773f90 2024-09-12T12:37:00.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.134+0000 7fb7611ec740 1 -- 172.21.15.33:0/3770223258 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb73c00fe50 con 0x558b1a773670 2024-09-12T12:37:00.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.134+0000 7fb7611ec740 1 -- 172.21.15.33:0/3770223258 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb73c00dca0 con 0x558b1a77e850 2024-09-12T12:37:00.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.134+0000 7fb757fff640 1 --2- 172.21.15.33:0/3770223258 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558b1a773f90 0x558b1a76ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:00.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.134+0000 7fb75cbaf640 1 -- 172.21.15.33:0/3770223258 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b1a77e850 msgr2=0x558b1a7964f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:37:00.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.134+0000 7fb75cbaf640 1 --2- 172.21.15.33:0/3770223258 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b1a77e850 0x558b1a7964f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:00.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.135+0000 7fb75cbaf640 1 -- 172.21.15.33:0/3770223258 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558b1a773f90 msgr2=0x558b1a76ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:37:00.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.135+0000 7fb75cbaf640 1 --2- 172.21.15.33:0/3770223258 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558b1a773f90 0x558b1a76ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:00.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.135+0000 7fb75cbaf640 1 -- 172.21.15.33:0/3770223258 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b1a77a460 con 0x558b1a773670 2024-09-12T12:37:00.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.135+0000 7fb75cbaf640 1 --2- 172.21.15.33:0/3770223258 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b1a773670 0x558b1a76ab90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb74c011e70 tx=0x7fb74c01e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57d1998324260b31 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:37:00.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.136+0000 7fb7427fc640 1 -- 172.21.15.33:0/3770223258 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb74c015040 con 0x558b1a773670 2024-09-12T12:37:00.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.136+0000 7fb7427fc640 1 -- 172.21.15.33:0/3770223258 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb74c006e50 con 0x558b1a773670 2024-09-12T12:37:00.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.137+0000 7fb7611ec740 1 -- 172.21.15.33:0/3770223258 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b1a773670 msgr2=0x558b1a76ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:00.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.137+0000 7fb7611ec740 1 --2- 172.21.15.33:0/3770223258 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b1a773670 0x558b1a76ab90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb74c011e70 tx=0x7fb74c01e000 comp rx=0 tx=0).stop 2024-09-12T12:37:00.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.141+0000 7fb7611ec740 1 -- 172.21.15.33:0/3770223258 shutdown_connections 2024-09-12T12:37:00.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.141+0000 7fb7611ec740 1 --2- 172.21.15.33:0/3770223258 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b1a77e850 0x558b1a7964f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:00.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.141+0000 7fb7611ec740 1 --2- 172.21.15.33:0/3770223258 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558b1a773f90 0x558b1a76ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:00.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.141+0000 7fb7611ec740 1 --2- 172.21.15.33:0/3770223258 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b1a773670 0x558b1a76ab90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:00.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.141+0000 7fb7611ec740 1 -- 172.21.15.33:0/3770223258 >> 172.21.15.33:0/3770223258 conn(0x558b1a76fc00 msgr2=0x558b1a76e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:37:00.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.145+0000 7fb7611ec740 1 -- 172.21.15.33:0/3770223258 shutdown_connections 2024-09-12T12:37:00.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.145+0000 7fb7611ec740 1 -- 172.21.15.33:0/3770223258 wait complete. 2024-09-12T12:37:00.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.145+0000 7fb7611ec740 1 -- start start 2024-09-12T12:37:00.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.145+0000 7fb7611ec740 1 Processor -- start 2024-09-12T12:37:00.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.146+0000 7fb7611ec740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558b1a773670 0x558b1a787150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:00.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.146+0000 7fb7611ec740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b1a773f90 0x558b1a7844a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:00.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.146+0000 7fb7611ec740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b1a77e850 0x558b1a784c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:00.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.146+0000 7fb7611ec740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb73c00e310 con 0x558b1a773670 2024-09-12T12:37:00.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.146+0000 7fb7611ec740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb73c00f780 con 0x558b1a77e850 2024-09-12T12:37:00.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.146+0000 7fb7611ec740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb73c00e9e0 con 0x558b1a773f90 2024-09-12T12:37:00.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.146+0000 7fb7611ec740 10 client.0 _ll_register_callbacks cb 0x7fb75806bf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:37:00.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.146+0000 7fb757fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b1a773f90 0x558b1a7844a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:00.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.146+0000 7fb757fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b1a773f90 0x558b1a7844a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:54132/0 (socket says 172.21.15.33:54132) 2024-09-12T12:37:00.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.146+0000 7fb757fff640 1 -- 172.21.15.33:0/1851984458 learned_addr learned my addr 172.21.15.33:0/1851984458 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:37:00.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.147+0000 7fb75d3b0640 1 --2- 172.21.15.33:0/1851984458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b1a77e850 0x558b1a784c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:00.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.147+0000 7fb757fff640 1 -- 172.21.15.33:0/1851984458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b1a77e850 msgr2=0x558b1a784c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:37:00.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.147+0000 7fb757fff640 1 --2- 172.21.15.33:0/1851984458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b1a77e850 0x558b1a784c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:00.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.147+0000 7fb757fff640 1 -- 172.21.15.33:0/1851984458 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558b1a773670 msgr2=0x558b1a787150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:37:00.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.147+0000 7fb757fff640 1 --2- 172.21.15.33:0/1851984458 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558b1a773670 0x558b1a787150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:00.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.147+0000 7fb757fff640 1 -- 172.21.15.33:0/1851984458 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b1a7f84d0 con 0x558b1a773f90 2024-09-12T12:37:00.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.148+0000 7fb757fff640 1 --2- 172.21.15.33:0/1851984458 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b1a773f90 0x558b1a7844a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb744009900 tx=0x7fb744005450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d262a58f4b3fb246 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:37:00.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.149+0000 7fb737fff640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:37:00.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.149+0000 7fb737fff640 1 -- 172.21.15.33:0/1851984458 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb744035020 con 0x558b1a773f90 2024-09-12T12:37:00.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.149+0000 7fb737fff640 1 -- 172.21.15.33:0/1851984458 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fb744004040 con 0x558b1a773f90 2024-09-12T12:37:00.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.150+0000 7fb7611ec740 1 -- 172.21.15.33:0/1851984458 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb74c006e50 con 0x558b1a773f90 2024-09-12T12:37:00.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.150+0000 7fb737fff640 1 -- 172.21.15.33:0/1851984458 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb744004240 con 0x558b1a773f90 2024-09-12T12:37:00.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.155+0000 7fb7611ec740 10 client.26062 fetch_fsmap learned FSMap version 27 2024-09-12T12:37:00.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.155+0000 7fb7611ec740 1 -- 172.21.15.33:0/1851984458 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558b1a7f96d0 con 0x558b1a773f90 2024-09-12T12:37:00.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.156+0000 7fb737fff640 1 -- 172.21.15.33:0/1851984458 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb74c006e50 con 0x558b1a773f90 2024-09-12T12:37:00.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.156+0000 7fb737fff640 1 -- 172.21.15.33:0/1851984458 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fb744045020 con 0x558b1a773f90 2024-09-12T12:37:00.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.156+0000 7fb7611ec740 10 client.26062 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:37:00.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.156+0000 7fb7611ec740 10 client.26062 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:37:00.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.156+0000 7fb7611ec740 20 client.26062 populate_metadata read hostname 'smithi033' 2024-09-12T12:37:00.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.156+0000 7fb7611ec740 1 --2- 172.21.15.33:0/1851984458 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x558b1a7f9de0 0x558b1a7fc200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:00.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.156+0000 7fb7611ec740 4 client.26062 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:37:00.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.156+0000 7fb7611ec740 1 -- 172.21.15.33:0/1851984458 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558b1a6e0d60 con 0x558b1a7f9de0 2024-09-12T12:37:00.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.156+0000 7fb75cbaf640 1 --2- 172.21.15.33:0/1851984458 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x558b1a7f9de0 0x558b1a7fc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:00.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.164+0000 7fb75cbaf640 1 --2- 172.21.15.33:0/1851984458 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x558b1a7f9de0 0x558b1a7fc200 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=949a8b898a161638 server_cookie=5fd649a45ba1dff4 in_seq=0 out_seq=0 2024-09-12T12:37:00.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.164+0000 7fb737fff640 10 client.26062 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:37:00.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.166+0000 7fb737fff640 1 -- 172.21.15.33:0/1851984458 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x558b1a6e0d60 con 0x558b1a7f9de0 2024-09-12T12:37:00.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.167+0000 7fb737fff640 10 client.26062 handle_command_reply: tid=0 2024-09-12T12:37:00.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.169+0000 7fb7611ec740 1 client.26062 shutdown 2024-09-12T12:37:00.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.172+0000 7fb7611ec740 1 -- 172.21.15.33:0/1851984458 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b1a773f90 msgr2=0x558b1a7844a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:00.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.172+0000 7fb7611ec740 1 --2- 172.21.15.33:0/1851984458 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b1a773f90 0x558b1a7844a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb744009900 tx=0x7fb744005450 comp rx=0 tx=0).stop 2024-09-12T12:37:00.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.172+0000 7fb7611ec740 1 -- 172.21.15.33:0/1851984458 shutdown_connections 2024-09-12T12:37:00.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.172+0000 7fb7611ec740 1 --2- 172.21.15.33:0/1851984458 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x558b1a7f9de0 0x558b1a7fc200 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:00.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.172+0000 7fb7611ec740 1 --2- 172.21.15.33:0/1851984458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b1a77e850 0x558b1a784c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:00.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.172+0000 7fb7611ec740 1 --2- 172.21.15.33:0/1851984458 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b1a773f90 0x558b1a7844a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:00.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.172+0000 7fb7611ec740 1 --2- 172.21.15.33:0/1851984458 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558b1a773670 0x558b1a787150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:00.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.172+0000 7fb7611ec740 1 -- 172.21.15.33:0/1851984458 >> 172.21.15.33:0/1851984458 conn(0x558b1a76fc00 msgr2=0x558b1a76ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:37:00.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.172+0000 7fb737fff640 0 client.26062 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:37:00.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.172+0000 7fb7611ec740 1 -- 172.21.15.33:0/1851984458 shutdown_connections 2024-09-12T12:37:00.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.172+0000 7fb7611ec740 1 -- 172.21.15.33:0/1851984458 wait complete. 2024-09-12T12:37:00.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.173+0000 7fb7611ec740 20 client.26062 trim_cache size 0 max 16384 2024-09-12T12:37:00.177 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:37:00.178 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "no active scrubs running", 2024-09-12T12:37:00.178 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": {} 2024-09-12T12:37:00.178 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:37:00.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.179+0000 7fb75dbb1640 1 -- 172.21.15.33:0/3461810348 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb7480a2d60 msgr2=0x7fb7480a5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:00.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.179+0000 7fb75dbb1640 1 --2- 172.21.15.33:0/3461810348 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb7480a2d60 0x7fb7480a5220 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb74c011e20 tx=0x7fb74c008040 comp rx=0 tx=0).stop 2024-09-12T12:37:00.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.179+0000 7fb75dbb1640 1 -- 172.21.15.33:0/3461810348 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb7500b7540 msgr2=0x7fb7500aebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:00.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.179+0000 7fb75dbb1640 1 --2- 172.21.15.33:0/3461810348 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb7500b7540 0x7fb7500aebc0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb758050280 tx=0x7fb758072b80 comp rx=0 tx=0).stop 2024-09-12T12:37:00.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.180+0000 7fb75dbb1640 1 -- 172.21.15.33:0/3461810348 shutdown_connections 2024-09-12T12:37:00.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.180+0000 7fb75dbb1640 1 --2- 172.21.15.33:0/3461810348 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb7480a2d60 0x7fb7480a5220 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:00.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.180+0000 7fb75dbb1640 1 --2- 172.21.15.33:0/3461810348 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb7500b7540 0x7fb7500aebc0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:00.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.180+0000 7fb75dbb1640 1 --2- 172.21.15.33:0/3461810348 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7500a5140 0x7fb7500ae680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:00.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.180+0000 7fb75dbb1640 1 --2- 172.21.15.33:0/3461810348 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7500a4820 0x7fb7500b55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:00.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.180+0000 7fb75dbb1640 1 -- 172.21.15.33:0/3461810348 >> 172.21.15.33:0/3461810348 conn(0x7fb75001a0e0 msgr2=0x7fb7500a1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:37:00.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.181+0000 7fb75dbb1640 1 -- 172.21.15.33:0/3461810348 shutdown_connections 2024-09-12T12:37:00.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:00.181+0000 7fb75dbb1640 1 -- 172.21.15.33:0/3461810348 wait complete. 2024-09-12T12:37:01.149 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T12:37:01.150 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:37:01.389 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:01 smithi033 ceph-mon[31246]: pgmap v680: 129 pgs: 129 active+clean; 10 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 29 MiB/s wr, 545 op/s 2024-09-12T12:37:01.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:01 smithi102 ceph-mon[34799]: pgmap v680: 129 pgs: 129 active+clean; 10 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 29 MiB/s wr, 545 op/s 2024-09-12T12:37:01.827 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:37:01.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:01 smithi043 ceph-mon[34144]: pgmap v680: 129 pgs: 129 active+clean; 10 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 29 MiB/s wr, 545 op/s 2024-09-12T12:37:03.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:03 smithi102 ceph-mon[34799]: pgmap v681: 129 pgs: 129 active+clean; 10 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 31 MiB/s wr, 590 op/s 2024-09-12T12:37:03.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:03 smithi033 ceph-mon[31246]: pgmap v681: 129 pgs: 129 active+clean; 10 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 31 MiB/s wr, 590 op/s 2024-09-12T12:37:03.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:03 smithi043 ceph-mon[34144]: pgmap v681: 129 pgs: 129 active+clean; 10 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 31 MiB/s wr, 590 op/s 2024-09-12T12:37:05.646 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:05 smithi102 ceph-mon[34799]: pgmap v682: 129 pgs: 129 active+clean; 10 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 37 MiB/s wr, 694 op/s 2024-09-12T12:37:05.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:05 smithi033 ceph-mon[31246]: pgmap v682: 129 pgs: 129 active+clean; 10 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 37 MiB/s wr, 694 op/s 2024-09-12T12:37:05.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:05 smithi043 ceph-mon[34144]: pgmap v682: 129 pgs: 129 active+clean; 10 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 37 MiB/s wr, 694 op/s 2024-09-12T12:37:07.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:07 smithi033 ceph-mon[31246]: pgmap v683: 129 pgs: 129 active+clean; 10 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 27 MiB/s wr, 504 op/s 2024-09-12T12:37:07.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:07 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/2076645222' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:37:07.667 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:07 smithi043 ceph-mon[34144]: pgmap v683: 129 pgs: 129 active+clean; 10 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 27 MiB/s wr, 504 op/s 2024-09-12T12:37:07.667 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:07 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/2076645222' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:37:07.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:07 smithi102 ceph-mon[34799]: pgmap v683: 129 pgs: 129 active+clean; 10 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 27 MiB/s wr, 504 op/s 2024-09-12T12:37:07.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:07 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/2076645222' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:37:08.181 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:37:08.181 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":27,"btime":"2024-09-12T12:29:38:065241+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3327066342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3327066342},{"type":"v1","addr":"172.21.15.33:6835","nonce":3327066342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/19516401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":19516401},{"type":"v1","addr":"172.21.15.33:6837","nonce":19516401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1260196118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1260196118},{"type":"v1","addr":"172.21.15.33:6839","nonce":1260196118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/4288248356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4288248356},{"type":"v1","addr":"172.21.15.33:6841","nonce":4288248356}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/3051073141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3051073141},{"type":"v1","addr":"172.21.15.43:6833","nonce":3051073141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3282762800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3282762800},{"type":"v1","addr":"172.21.15.43:6835","nonce":3282762800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:23:46.400609+0000","modified":"2024-09-12T12:29:37.555614+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24490,"mds_2":24478},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3051713000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3051713000},{"type":"v1","addr":"172.21.15.102:6833","nonce":3051713000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6837/2472064883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2472064883},{"type":"v1","addr":"172.21.15.43:6837","nonce":2472064883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/1987408860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":1987408860},{"type":"v1","addr":"172.21.15.43:6839","nonce":1987408860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/4179527539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":4179527539},{"type":"v1","addr":"172.21.15.102:6835","nonce":4179527539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/2409953270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2409953270},{"type":"v1","addr":"172.21.15.102:6837","nonce":2409953270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.102:6839/1553271340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":1553271340},{"type":"v1","addr":"172.21.15.102:6839","nonce":1553271340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24499,"qdb_cluster":[24499,24490,24478]},"id":1}]} 2024-09-12T12:37:08.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:06.889+0000 7f1dfbcb4640 1 -- 172.21.15.33:0/955655591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1df4101440 msgr2=0x7f1df410df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:08.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:06.889+0000 7f1dfbcb4640 1 --2- 172.21.15.33:0/955655591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1df4101440 0x7f1df410df30 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f1de4009900 tx=0x7f1de402a410 comp rx=0 tx=0).stop 2024-09-12T12:37:08.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:06.889+0000 7f1dfbcb4640 1 -- 172.21.15.33:0/955655591 shutdown_connections 2024-09-12T12:37:08.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:06.889+0000 7f1dfbcb4640 1 --2- 172.21.15.33:0/955655591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1df410e500 0x7f1df4110910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:08.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:06.889+0000 7f1dfbcb4640 1 --2- 172.21.15.33:0/955655591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1df4101440 0x7f1df410df30 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:08.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:06.889+0000 7f1dfbcb4640 1 --2- 172.21.15.33:0/955655591 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1df4100b20 0x7f1df4100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:08.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:06.889+0000 7f1dfbcb4640 1 -- 172.21.15.33:0/955655591 >> 172.21.15.33:0/955655591 conn(0x7f1df40fc7d0 msgr2=0x7f1df40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:37:08.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:06.889+0000 7f1dfbcb4640 1 -- 172.21.15.33:0/955655591 shutdown_connections 2024-09-12T12:37:08.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:06.889+0000 7f1dfbcb4640 1 -- 172.21.15.33:0/955655591 wait complete. 2024-09-12T12:37:08.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:06.890+0000 7f1dfbcb4640 1 Processor -- start 2024-09-12T12:37:08.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:06.890+0000 7f1dfbcb4640 1 -- start start 2024-09-12T12:37:08.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:06.890+0000 7f1dfbcb4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1df4100b20 0x7f1df419a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:08.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:06.890+0000 7f1dfbcb4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1df4101440 0x7f1df419abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:08.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:06.890+0000 7f1dfbcb4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1df410e500 0x7f1df419ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:08.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:06.890+0000 7f1dfbcb4640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1df4114100 con 0x7f1df410e500 2024-09-12T12:37:08.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:06.890+0000 7f1dfbcb4640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1df4113f80 con 0x7f1df4100b20 2024-09-12T12:37:08.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:06.890+0000 7f1dfbcb4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1df4114280 con 0x7f1df4101440 2024-09-12T12:37:08.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:06.890+0000 7f1dfa251640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1df410e500 0x7f1df419ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:08.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:06.890+0000 7f1dfa251640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1df410e500 0x7f1df419ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35884/0 (socket says 172.21.15.33:35884) 2024-09-12T12:37:08.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:06.890+0000 7f1dfa251640 1 -- 172.21.15.33:0/2076645222 learned_addr learned my addr 172.21.15.33:0/2076645222 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:37:08.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:06.890+0000 7f1df9a50640 1 --2- 172.21.15.33:0/2076645222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1df4100b20 0x7f1df419a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:08.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:06.891+0000 7f1df924f640 1 --2- 172.21.15.33:0/2076645222 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1df4101440 0x7f1df419abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:08.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:06.891+0000 7f1dfa251640 1 -- 172.21.15.33:0/2076645222 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1df4101440 msgr2=0x7f1df419abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:08.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:06.891+0000 7f1dfa251640 1 --2- 172.21.15.33:0/2076645222 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1df4101440 0x7f1df419abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:08.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:06.891+0000 7f1dfa251640 1 -- 172.21.15.33:0/2076645222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1df4100b20 msgr2=0x7f1df419a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:08.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:06.891+0000 7f1dfa251640 1 --2- 172.21.15.33:0/2076645222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1df4100b20 0x7f1df419a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:08.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:06.891+0000 7f1dfa251640 1 -- 172.21.15.33:0/2076645222 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1df419f660 con 0x7f1df410e500 2024-09-12T12:37:08.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:06.891+0000 7f1dfa251640 1 --2- 172.21.15.33:0/2076645222 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1df410e500 0x7f1df419ef80 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f1dec00cab0 tx=0x7f1dec00cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:37:08.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:06.891+0000 7f1deaffd640 1 -- 172.21.15.33:0/2076645222 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dec00ae20 con 0x7f1df410e500 2024-09-12T12:37:08.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:06.891+0000 7f1deaffd640 1 -- 172.21.15.33:0/2076645222 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1dec00f900 con 0x7f1df410e500 2024-09-12T12:37:08.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:06.891+0000 7f1dfbcb4640 1 -- 172.21.15.33:0/2076645222 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1df419f950 con 0x7f1df410e500 2024-09-12T12:37:08.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:06.891+0000 7f1deaffd640 1 -- 172.21.15.33:0/2076645222 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dec0189f0 con 0x7f1df410e500 2024-09-12T12:37:08.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:06.891+0000 7f1dfbcb4640 1 -- 172.21.15.33:0/2076645222 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1df41a7230 con 0x7f1df410e500 2024-09-12T12:37:08.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:06.892+0000 7f1dfbcb4640 1 -- 172.21.15.33:0/2076645222 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1df4100f00 con 0x7f1df410e500 2024-09-12T12:37:08.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:06.893+0000 7f1deaffd640 1 -- 172.21.15.33:0/2076645222 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1dec00fab0 con 0x7f1df410e500 2024-09-12T12:37:08.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:06.894+0000 7f1deaffd640 1 --2- 172.21.15.33:0/2076645222 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f1de00a2c00 0x7f1de00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:08.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:06.894+0000 7f1df9a50640 1 --2- 172.21.15.33:0/2076645222 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f1de00a2c00 0x7f1de00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:08.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:06.894+0000 7f1deaffd640 1 -- 172.21.15.33:0/2076645222 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f1dec0cfcb0 con 0x7f1df410e500 2024-09-12T12:37:08.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:06.895+0000 7f1df9a50640 1 --2- 172.21.15.33:0/2076645222 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f1de00a2c00 0x7f1de00a50c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1df0005d00 tx=0x7f1df000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:37:08.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:06.897+0000 7f1deaffd640 1 -- 172.21.15.33:0/2076645222 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1dec014030 con 0x7f1df410e500 2024-09-12T12:37:08.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:07.219+0000 7f1dfbcb4640 1 -- 172.21.15.33:0/2076645222 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1df4109600 con 0x7f1df410e500 2024-09-12T12:37:08.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:07.220+0000 7f1deaffd640 1 -- 172.21.15.33:0/2076645222 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11912 (secure 0 0 0) 0x7f1dec09c930 con 0x7f1df410e500 2024-09-12T12:37:08.185 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 27 2024-09-12T12:37:08.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:07.222+0000 7f1dfbcb4640 1 -- 172.21.15.33:0/2076645222 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f1de00a2c00 msgr2=0x7f1de00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:08.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:07.222+0000 7f1dfbcb4640 1 --2- 172.21.15.33:0/2076645222 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f1de00a2c00 0x7f1de00a50c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1df0005d00 tx=0x7f1df000b410 comp rx=0 tx=0).stop 2024-09-12T12:37:08.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:07.222+0000 7f1dfbcb4640 1 -- 172.21.15.33:0/2076645222 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1df410e500 msgr2=0x7f1df419ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:08.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:07.222+0000 7f1dfbcb4640 1 --2- 172.21.15.33:0/2076645222 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1df410e500 0x7f1df419ef80 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f1dec00cab0 tx=0x7f1dec00cf70 comp rx=0 tx=0).stop 2024-09-12T12:37:08.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:07.222+0000 7f1dfbcb4640 1 -- 172.21.15.33:0/2076645222 shutdown_connections 2024-09-12T12:37:08.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:07.222+0000 7f1dfbcb4640 1 --2- 172.21.15.33:0/2076645222 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f1de00a2c00 0x7f1de00a50c0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:08.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:07.222+0000 7f1dfbcb4640 1 --2- 172.21.15.33:0/2076645222 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1df410e500 0x7f1df419ef80 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:08.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:07.222+0000 7f1dfbcb4640 1 --2- 172.21.15.33:0/2076645222 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1df4101440 0x7f1df419abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:08.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:07.222+0000 7f1dfbcb4640 1 --2- 172.21.15.33:0/2076645222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1df4100b20 0x7f1df419a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:08.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:07.222+0000 7f1dfbcb4640 1 -- 172.21.15.33:0/2076645222 >> 172.21.15.33:0/2076645222 conn(0x7f1df40fc7d0 msgr2=0x7f1df40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:37:08.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:07.223+0000 7f1dfbcb4640 1 -- 172.21.15.33:0/2076645222 shutdown_connections 2024-09-12T12:37:08.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:07.223+0000 7f1dfbcb4640 1 -- 172.21.15.33:0/2076645222 wait complete. 2024-09-12T12:37:09.698 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:09 smithi102 ceph-mon[34799]: pgmap v684: 129 pgs: 129 active+clean; 10 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 37 MiB/s wr, 697 op/s 2024-09-12T12:37:09.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:09 smithi033 ceph-mon[31246]: pgmap v684: 129 pgs: 129 active+clean; 10 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 37 MiB/s wr, 697 op/s 2024-09-12T12:37:09.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:09 smithi043 ceph-mon[34144]: pgmap v684: 129 pgs: 129 active+clean; 10 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 37 MiB/s wr, 697 op/s 2024-09-12T12:37:11.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:11 smithi033 ceph-mon[31246]: pgmap v685: 129 pgs: 129 active+clean; 10 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 26 MiB/s wr, 494 op/s 2024-09-12T12:37:11.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:11 smithi043 ceph-mon[34144]: pgmap v685: 129 pgs: 129 active+clean; 10 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 26 MiB/s wr, 494 op/s 2024-09-12T12:37:11.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:11 smithi102 ceph-mon[34799]: pgmap v685: 129 pgs: 129 active+clean; 10 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 26 MiB/s wr, 494 op/s 2024-09-12T12:37:12.628 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T12:37:13.236 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:37:13.659 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:13 smithi033 ceph-mon[31246]: pgmap v686: 129 pgs: 129 active+clean; 10 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 26 MiB/s wr, 500 op/s 2024-09-12T12:37:13.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:13 smithi043 ceph-mon[34144]: pgmap v686: 129 pgs: 129 active+clean; 10 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 26 MiB/s wr, 500 op/s 2024-09-12T12:37:13.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:13 smithi102 ceph-mon[34799]: pgmap v686: 129 pgs: 129 active+clean; 10 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 26 MiB/s wr, 500 op/s 2024-09-12T12:37:14.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.008+0000 7f9526b6f640 1 -- 172.21.15.33:0/2754598988 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9520109450 msgr2=0x7f9520110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:14.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.008+0000 7f9526b6f640 1 --2- 172.21.15.33:0/2754598988 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9520109450 0x7f9520110250 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f951c009900 tx=0x7f951c02a440 comp rx=0 tx=0).stop 2024-09-12T12:37:14.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.011+0000 7f9526b6f640 1 -- 172.21.15.33:0/2754598988 shutdown_connections 2024-09-12T12:37:14.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.011+0000 7f9526b6f640 1 --2- 172.21.15.33:0/2754598988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f952011b140 0x7f952011d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:14.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.012+0000 7f9526b6f640 1 --2- 172.21.15.33:0/2754598988 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9520109830 0x7f9520109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:14.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.012+0000 7f9526b6f640 1 --2- 172.21.15.33:0/2754598988 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9520109450 0x7f9520110250 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:14.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.012+0000 7f9526b6f640 1 -- 172.21.15.33:0/2754598988 >> 172.21.15.33:0/2754598988 conn(0x7f952006e140 msgr2=0x7f952006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:37:14.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.014+0000 7f9526b6f640 1 -- 172.21.15.33:0/2754598988 shutdown_connections 2024-09-12T12:37:14.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.015+0000 7f9526b6f640 1 -- 172.21.15.33:0/2754598988 wait complete. 2024-09-12T12:37:14.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.016+0000 7f9526b6f640 1 Processor -- start 2024-09-12T12:37:14.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.022+0000 7f9526b6f640 1 -- start start 2024-09-12T12:37:14.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.022+0000 7f9526b6f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9520109450 0x7f95201a7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:14.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.022+0000 7f9526b6f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9520109830 0x7f95201a7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:14.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.022+0000 7f9526b6f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f952011b140 0x7f95201abaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:14.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.022+0000 7f9526b6f640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9520120ce0 con 0x7f9520109830 2024-09-12T12:37:14.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.022+0000 7f9526b6f640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9520120b60 con 0x7f952011b140 2024-09-12T12:37:14.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.022+0000 7f9526b6f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9520120e60 con 0x7f9520109450 2024-09-12T12:37:14.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.023+0000 7f952490b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9520109450 0x7f95201a7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:14.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.023+0000 7f952490b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9520109450 0x7f95201a7220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:52156/0 (socket says 172.21.15.33:52156) 2024-09-12T12:37:14.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.023+0000 7f952490b640 1 -- 172.21.15.33:0/718637846 learned_addr learned my addr 172.21.15.33:0/718637846 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:37:14.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.023+0000 7f9517fff640 1 --2- 172.21.15.33:0/718637846 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9520109830 0x7f95201a7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:14.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.024+0000 7f952490b640 1 -- 172.21.15.33:0/718637846 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f952011b140 msgr2=0x7f95201abaf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T12:37:14.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.024+0000 7f952490b640 1 --2- 172.21.15.33:0/718637846 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f952011b140 0x7f95201abaf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:14.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.024+0000 7f952490b640 1 -- 172.21.15.33:0/718637846 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9520109830 msgr2=0x7f95201a7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:14.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.024+0000 7f952490b640 1 --2- 172.21.15.33:0/718637846 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9520109830 0x7f95201a7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:14.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.024+0000 7f952490b640 1 -- 172.21.15.33:0/718637846 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95201ac1f0 con 0x7f9520109450 2024-09-12T12:37:14.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.025+0000 7f952490b640 1 --2- 172.21.15.33:0/718637846 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9520109450 0x7f95201a7220 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f951c02a9b0 tx=0x7f951c003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:37:14.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.027+0000 7f9515ffb640 1 -- 172.21.15.33:0/718637846 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f951c03f070 con 0x7f9520109450 2024-09-12T12:37:14.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.027+0000 7f9515ffb640 1 -- 172.21.15.33:0/718637846 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f951c03bb10 con 0x7f9520109450 2024-09-12T12:37:14.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.027+0000 7f9515ffb640 1 -- 172.21.15.33:0/718637846 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f951c035030 con 0x7f9520109450 2024-09-12T12:37:14.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.031+0000 7f9526b6f640 1 -- 172.21.15.33:0/718637846 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95201ac480 con 0x7f9520109450 2024-09-12T12:37:14.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.031+0000 7f9526b6f640 1 -- 172.21.15.33:0/718637846 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95201ac8e0 con 0x7f9520109450 2024-09-12T12:37:14.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.037+0000 7f9528f48740 1 Processor -- start 2024-09-12T12:37:14.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.037+0000 7f9528f48740 1 -- start start 2024-09-12T12:37:14.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.037+0000 7f9528f48740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a2f692b40 0x557a2f691090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:14.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.037+0000 7f9528f48740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a2f6915d0 0x557a2f691a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:14.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.037+0000 7f9528f48740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557a2f69c370 0x557a2f69e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:14.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.038+0000 7f9528f48740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x557a2f5f72f0 con 0x557a2f69c370 2024-09-12T12:37:14.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.038+0000 7f9528f48740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557a2f59ecf0 con 0x557a2f692b40 2024-09-12T12:37:14.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.038+0000 7f9528f48740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557a2f5f32b0 con 0x557a2f6915d0 2024-09-12T12:37:14.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.038+0000 7f9517fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557a2f69c370 0x557a2f69e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:14.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.038+0000 7f9517fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557a2f69c370 0x557a2f69e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37034/0 (socket says 172.21.15.33:37034) 2024-09-12T12:37:14.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.038+0000 7f9517fff640 1 -- 172.21.15.33:0/4230025308 learned_addr learned my addr 172.21.15.33:0/4230025308 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:37:14.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.039+0000 7f952510c640 1 --2- 172.21.15.33:0/4230025308 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a2f692b40 0x557a2f691090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:14.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.040+0000 7f952510c640 1 -- 172.21.15.33:0/4230025308 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a2f6915d0 msgr2=0x557a2f691a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:37:14.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.040+0000 7f952510c640 1 --2- 172.21.15.33:0/4230025308 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a2f6915d0 0x557a2f691a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:14.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.040+0000 7f952510c640 1 -- 172.21.15.33:0/4230025308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557a2f69c370 msgr2=0x557a2f69e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:37:14.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.040+0000 7f952510c640 1 --2- 172.21.15.33:0/4230025308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557a2f69c370 0x557a2f69e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:14.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.040+0000 7f952510c640 1 -- 172.21.15.33:0/4230025308 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a2f5833a0 con 0x557a2f692b40 2024-09-12T12:37:14.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.040+0000 7f952510c640 1 --2- 172.21.15.33:0/4230025308 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a2f692b40 0x557a2f691090 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9518009c10 tx=0x7f951800b7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=120b81f59ad485a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:37:14.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.040+0000 7f9506ffd640 1 -- 172.21.15.33:0/4230025308 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9518018070 con 0x557a2f692b40 2024-09-12T12:37:14.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.043+0000 7f9515ffb640 1 -- 172.21.15.33:0/718637846 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f951c042070 con 0x7f9520109450 2024-09-12T12:37:14.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.047+0000 7f9506ffd640 1 -- 172.21.15.33:0/4230025308 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f95180138c0 con 0x557a2f692b40 2024-09-12T12:37:14.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.047+0000 7f9515ffb640 1 --2- 172.21.15.33:0/718637846 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f95080a2d90 0x7f95080a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:14.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.048+0000 7f9528f48740 1 -- 172.21.15.33:0/4230025308 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a2f692b40 msgr2=0x557a2f691090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:14.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.048+0000 7f9528f48740 1 --2- 172.21.15.33:0/4230025308 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a2f692b40 0x557a2f691090 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9518009c10 tx=0x7f951800b7c0 comp rx=0 tx=0).stop 2024-09-12T12:37:14.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.049+0000 7f9515ffb640 1 -- 172.21.15.33:0/718637846 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f951c0efb30 con 0x7f9520109450 2024-09-12T12:37:14.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.051+0000 7f9528f48740 1 -- 172.21.15.33:0/4230025308 shutdown_connections 2024-09-12T12:37:14.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.051+0000 7f9528f48740 1 --2- 172.21.15.33:0/4230025308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557a2f69c370 0x557a2f69e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:14.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.051+0000 7f9528f48740 1 --2- 172.21.15.33:0/4230025308 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a2f6915d0 0x557a2f691a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:14.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.051+0000 7f9528f48740 1 --2- 172.21.15.33:0/4230025308 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a2f692b40 0x557a2f691090 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:14.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.051+0000 7f9528f48740 1 -- 172.21.15.33:0/4230025308 >> 172.21.15.33:0/4230025308 conn(0x557a2f65a310 msgr2=0x557a2f68dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:37:14.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.052+0000 7f952490b640 1 --2- 172.21.15.33:0/718637846 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f95080a2d90 0x7f95080a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:14.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.057+0000 7f9528f48740 1 -- 172.21.15.33:0/4230025308 shutdown_connections 2024-09-12T12:37:14.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.058+0000 7f9528f48740 1 -- 172.21.15.33:0/4230025308 wait complete. 2024-09-12T12:37:14.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.058+0000 7f9528f48740 1 -- start start 2024-09-12T12:37:14.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.058+0000 7f9528f48740 1 Processor -- start 2024-09-12T12:37:14.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.059+0000 7f9528f48740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a2f6915d0 0x557a2f69bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:14.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.059+0000 7f9528f48740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557a2f692b40 0x557a2f699050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:14.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.059+0000 7f9528f48740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a2f69c370 0x557a2f6997e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:14.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.059+0000 7f9528f48740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x557a2f69f110 con 0x557a2f692b40 2024-09-12T12:37:14.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.059+0000 7f9528f48740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557a2f5b2060 con 0x557a2f6915d0 2024-09-12T12:37:14.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.059+0000 7f9528f48740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557a2f69f290 con 0x557a2f69c370 2024-09-12T12:37:14.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.059+0000 7f9528f48740 10 client.0 _ll_register_callbacks cb 0x557a2f3058c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:37:14.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.060+0000 7f952510c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a2f6915d0 0x557a2f69bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:14.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.060+0000 7f952510c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a2f69c370 0x557a2f6997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:14.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.060+0000 7f952510c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a2f6915d0 0x557a2f69bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:42360/0 (socket says 172.21.15.33:42360) 2024-09-12T12:37:14.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.060+0000 7f952510c640 1 -- 172.21.15.33:0/881337667 learned_addr learned my addr 172.21.15.33:0/881337667 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:37:14.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.060+0000 7f952510c640 1 -- 172.21.15.33:0/881337667 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a2f69c370 msgr2=0x557a2f6997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:37:14.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.060+0000 7f952510c640 1 --2- 172.21.15.33:0/881337667 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a2f69c370 0x557a2f6997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:14.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.060+0000 7f952510c640 1 -- 172.21.15.33:0/881337667 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557a2f692b40 msgr2=0x557a2f699050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:37:14.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.060+0000 7f952510c640 1 --2- 172.21.15.33:0/881337667 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557a2f692b40 0x557a2f699050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:14.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.060+0000 7f952510c640 1 -- 172.21.15.33:0/881337667 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a2f3683c0 con 0x557a2f6915d0 2024-09-12T12:37:14.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.061+0000 7f952510c640 1 --2- 172.21.15.33:0/881337667 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a2f6915d0 0x557a2f69bda0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9518009fd0 tx=0x7f9518000f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22a33134855abd81 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:37:14.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.062+0000 7f94fffff640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:37:14.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.062+0000 7f94fffff640 1 -- 172.21.15.33:0/881337667 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9518018040 con 0x557a2f6915d0 2024-09-12T12:37:14.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.062+0000 7f9528f48740 1 -- 172.21.15.33:0/881337667 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557a2f604860 con 0x557a2f6915d0 2024-09-12T12:37:14.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.066+0000 7f94fffff640 1 -- 172.21.15.33:0/881337667 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f9518010040 con 0x557a2f6915d0 2024-09-12T12:37:14.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.068+0000 7f952490b640 1 --2- 172.21.15.33:0/718637846 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f95080a2d90 0x7f95080a5250 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f951c005ab0 tx=0x7f951c003f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:37:14.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.068+0000 7f94fffff640 1 -- 172.21.15.33:0/881337667 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f951802f050 con 0x557a2f6915d0 2024-09-12T12:37:14.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.068+0000 7f9528f48740 10 client.25958 fetch_fsmap learned FSMap version 27 2024-09-12T12:37:14.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.068+0000 7f9528f48740 1 -- 172.21.15.33:0/881337667 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557a2f6aad00 con 0x557a2f6915d0 2024-09-12T12:37:14.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.069+0000 7f94fffff640 1 -- 172.21.15.33:0/881337667 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x557a2f604860 con 0x557a2f6915d0 2024-09-12T12:37:14.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.070+0000 7f94fffff640 1 -- 172.21.15.33:0/881337667 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f9518009020 con 0x557a2f6915d0 2024-09-12T12:37:14.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.071+0000 7f9528f48740 10 client.25958 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:37:14.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.071+0000 7f9528f48740 10 client.25958 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-12T12:37:14.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.071+0000 7f9528f48740 20 client.25958 populate_metadata read hostname 'smithi033' 2024-09-12T12:37:14.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.071+0000 7f9528f48740 1 --2- 172.21.15.33:0/881337667 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x557a2f6ac5c0 0x557a2f6aea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:14.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.071+0000 7f9528f48740 4 client.25958 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:37:14.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.071+0000 7f9528f48740 1 -- 172.21.15.33:0/881337667 --> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a2f5fed70 con 0x557a2f6ac5c0 2024-09-12T12:37:14.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.075+0000 7f9517fff640 1 --2- 172.21.15.33:0/881337667 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x557a2f6ac5c0 0x557a2f6aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:14.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.085+0000 7f9517fff640 1 --2- 172.21.15.33:0/881337667 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x557a2f6ac5c0 0x557a2f6aea40 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1b8433989a9e931b server_cookie=306cf338bff52e73 in_seq=0 out_seq=0 2024-09-12T12:37:14.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.085+0000 7f94fffff640 10 client.25958 ms_handle_connect on v2:172.21.15.102:6834/4179527539 2024-09-12T12:37:14.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.093+0000 7f94fffff640 1 -- 172.21.15.33:0/881337667 <== mds.2 v2:172.21.15.102:6834/4179527539 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557a2f5fed70 con 0x557a2f6ac5c0 2024-09-12T12:37:14.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.093+0000 7f94fffff640 10 client.25958 handle_command_reply: tid=0 2024-09-12T12:37:14.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.093+0000 7f9528f48740 1 client.25958 shutdown 2024-09-12T12:37:14.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.101+0000 7f9528f48740 1 -- 172.21.15.33:0/881337667 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a2f6915d0 msgr2=0x557a2f69bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:14.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.101+0000 7f9528f48740 1 --2- 172.21.15.33:0/881337667 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a2f6915d0 0x557a2f69bda0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9518009fd0 tx=0x7f9518000f40 comp rx=0 tx=0).stop 2024-09-12T12:37:14.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.101+0000 7f9528f48740 1 -- 172.21.15.33:0/881337667 shutdown_connections 2024-09-12T12:37:14.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.101+0000 7f9528f48740 1 --2- 172.21.15.33:0/881337667 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a2f69c370 0x557a2f6997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:14.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.101+0000 7f9528f48740 1 --2- 172.21.15.33:0/881337667 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557a2f692b40 0x557a2f699050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:14.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.101+0000 7f9528f48740 1 --2- 172.21.15.33:0/881337667 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x557a2f6ac5c0 0x557a2f6aea40 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:14.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.101+0000 7f9528f48740 1 --2- 172.21.15.33:0/881337667 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a2f6915d0 0x557a2f69bda0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:14.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.101+0000 7f9528f48740 1 -- 172.21.15.33:0/881337667 >> 172.21.15.33:0/881337667 conn(0x557a2f65a310 msgr2=0x557a2f693990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:37:14.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.101+0000 7f94fffff640 0 client.25958 ms_handle_reset on v2:172.21.15.102:6834/4179527539 2024-09-12T12:37:14.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.101+0000 7f9528f48740 1 -- 172.21.15.33:0/881337667 shutdown_connections 2024-09-12T12:37:14.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.101+0000 7f9528f48740 1 -- 172.21.15.33:0/881337667 wait complete. 2024-09-12T12:37:14.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.101+0000 7f9528f48740 20 client.25958 trim_cache size 0 max 16384 2024-09-12T12:37:14.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.135+0000 7f9528f48740 1 Processor -- start 2024-09-12T12:37:14.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.135+0000 7f9528f48740 1 -- start start 2024-09-12T12:37:14.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.136+0000 7f9528f48740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a2f6915d0 0x557a2f68cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:14.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.136+0000 7f9528f48740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a2f692b40 0x557a2f68d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:14.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.136+0000 7f952510c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a2f6915d0 0x557a2f68cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:14.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.136+0000 7f952510c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a2f6915d0 0x557a2f68cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:52198/0 (socket says 172.21.15.33:52198) 2024-09-12T12:37:14.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.136+0000 7f952510c640 1 -- 172.21.15.33:0/4033560375 learned_addr learned my addr 172.21.15.33:0/4033560375 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:37:14.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.136+0000 7f9528f48740 1 --2- 172.21.15.33:0/4033560375 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557a2f69c370 0x557a2f694120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:14.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.136+0000 7f9528f48740 1 -- 172.21.15.33:0/4033560375 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f95201c8920 con 0x557a2f69c370 2024-09-12T12:37:14.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.136+0000 7f9528f48740 1 -- 172.21.15.33:0/4033560375 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f95201c61f0 con 0x557a2f692b40 2024-09-12T12:37:14.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.136+0000 7f9528f48740 1 -- 172.21.15.33:0/4033560375 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9520118470 con 0x557a2f6915d0 2024-09-12T12:37:14.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.136+0000 7f9517fff640 1 --2- 172.21.15.33:0/4033560375 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a2f692b40 0x557a2f68d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:14.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.137+0000 7f9517fff640 1 -- 172.21.15.33:0/4033560375 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a2f6915d0 msgr2=0x557a2f68cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:37:14.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.137+0000 7f9517fff640 1 --2- 172.21.15.33:0/4033560375 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a2f6915d0 0x557a2f68cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:14.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.137+0000 7f9517fff640 1 -- 172.21.15.33:0/4033560375 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557a2f69c370 msgr2=0x557a2f694120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:37:14.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.137+0000 7f9517fff640 1 --2- 172.21.15.33:0/4033560375 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557a2f69c370 0x557a2f694120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:14.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.138+0000 7f9517fff640 1 -- 172.21.15.33:0/4033560375 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a2f691d80 con 0x557a2f692b40 2024-09-12T12:37:14.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.139+0000 7f9517fff640 1 --2- 172.21.15.33:0/4033560375 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a2f692b40 0x557a2f68d130 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x557a2f6af2c0 tx=0x7f951000b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8d86b696d8977ea server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:37:14.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.139+0000 7f95067fc640 1 -- 172.21.15.33:0/4033560375 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f951001e070 con 0x557a2f692b40 2024-09-12T12:37:14.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.139+0000 7f95067fc640 1 -- 172.21.15.33:0/4033560375 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9510004230 con 0x557a2f692b40 2024-09-12T12:37:14.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.139+0000 7f95067fc640 1 -- 172.21.15.33:0/4033560375 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f951001a520 con 0x557a2f692b40 2024-09-12T12:37:14.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.140+0000 7f9528f48740 1 -- 172.21.15.33:0/4033560375 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a2f692b40 msgr2=0x557a2f68d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:14.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.141+0000 7f9528f48740 1 --2- 172.21.15.33:0/4033560375 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a2f692b40 0x557a2f68d130 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x557a2f6af2c0 tx=0x7f951000b810 comp rx=0 tx=0).stop 2024-09-12T12:37:14.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.145+0000 7f9528f48740 1 -- 172.21.15.33:0/4033560375 shutdown_connections 2024-09-12T12:37:14.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.145+0000 7f9528f48740 1 --2- 172.21.15.33:0/4033560375 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557a2f69c370 0x557a2f694120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:14.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.145+0000 7f9528f48740 1 --2- 172.21.15.33:0/4033560375 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a2f692b40 0x557a2f68d130 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:14.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.145+0000 7f9528f48740 1 --2- 172.21.15.33:0/4033560375 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a2f6915d0 0x557a2f68cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:14.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.145+0000 7f9528f48740 1 -- 172.21.15.33:0/4033560375 >> 172.21.15.33:0/4033560375 conn(0x557a2f65a310 msgr2=0x557a2f68c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:37:14.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.148+0000 7f9528f48740 1 -- 172.21.15.33:0/4033560375 shutdown_connections 2024-09-12T12:37:14.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.148+0000 7f9528f48740 1 -- 172.21.15.33:0/4033560375 wait complete. 2024-09-12T12:37:14.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.149+0000 7f9528f48740 1 -- start start 2024-09-12T12:37:14.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.150+0000 7f9528f48740 1 Processor -- start 2024-09-12T12:37:14.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.150+0000 7f9528f48740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a2f6915d0 0x557a2f69fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:14.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.150+0000 7f9528f48740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a2f692b40 0x557a2f6a0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:14.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.151+0000 7f952510c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a2f6915d0 0x557a2f69fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:14.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.151+0000 7f952510c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a2f6915d0 0x557a2f69fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:52200/0 (socket says 172.21.15.33:52200) 2024-09-12T12:37:14.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.151+0000 7f952510c640 1 -- 172.21.15.33:0/1503563840 learned_addr learned my addr 172.21.15.33:0/1503563840 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:37:14.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.151+0000 7f9528f48740 1 --2- 172.21.15.33:0/1503563840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557a2f69c370 0x557a2f70f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:14.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.151+0000 7f9528f48740 1 -- 172.21.15.33:0/1503563840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9520118a30 con 0x557a2f69c370 2024-09-12T12:37:14.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.151+0000 7f9528f48740 1 -- 172.21.15.33:0/1503563840 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f95201c5b20 con 0x557a2f692b40 2024-09-12T12:37:14.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.151+0000 7f9528f48740 1 -- 172.21.15.33:0/1503563840 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f95201c4db0 con 0x557a2f6915d0 2024-09-12T12:37:14.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.151+0000 7f952510c640 1 --2- 172.21.15.33:0/1503563840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557a2f69c370 0x557a2f70f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:14.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.151+0000 7f952510c640 1 -- 172.21.15.33:0/1503563840 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a2f692b40 msgr2=0x557a2f6a0220 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:37:14.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.151+0000 7f952510c640 1 --2- 172.21.15.33:0/1503563840 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a2f692b40 0x557a2f6a0220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:14.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.151+0000 7f952510c640 1 -- 172.21.15.33:0/1503563840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557a2f69c370 msgr2=0x557a2f70f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:37:14.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.151+0000 7f952510c640 1 --2- 172.21.15.33:0/1503563840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557a2f69c370 0x557a2f70f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:14.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.151+0000 7f952510c640 1 -- 172.21.15.33:0/1503563840 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a2f70f990 con 0x557a2f6915d0 2024-09-12T12:37:14.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.152+0000 7f9528f48740 10 client.0 _ll_register_callbacks cb 0x7f9518016070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:37:14.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.152+0000 7f9528f48740 1 -- 172.21.15.33:0/1503563840 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9510004230 con 0x557a2f6915d0 2024-09-12T12:37:14.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.156+0000 7f952510c640 1 --2- 172.21.15.33:0/1503563840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a2f6915d0 0x557a2f69fce0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9518021480 tx=0x7f95180094e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd0ea723c5c6dd96 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:37:14.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.156+0000 7f94fffff640 10 client.26080 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-12T12:37:14.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.156+0000 7f94fffff640 1 -- 172.21.15.33:0/1503563840 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9518018070 con 0x557a2f6915d0 2024-09-12T12:37:14.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.161+0000 7f94fffff640 1 -- 172.21.15.33:0/1503563840 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f951800b0e0 con 0x557a2f6915d0 2024-09-12T12:37:14.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.161+0000 7f94fffff640 1 -- 172.21.15.33:0/1503563840 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9518013410 con 0x557a2f6915d0 2024-09-12T12:37:14.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.161+0000 7f9528f48740 10 client.26080 fetch_fsmap learned FSMap version 27 2024-09-12T12:37:14.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.161+0000 7f9528f48740 1 -- 172.21.15.33:0/1503563840 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({fsmap=27}) -- 0x557a2f716a20 con 0x557a2f6915d0 2024-09-12T12:37:14.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.162+0000 7f94fffff640 1 -- 172.21.15.33:0/1503563840 <== mon.1 v2:172.21.15.102:3300/0 4 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f9518009040 con 0x557a2f6915d0 2024-09-12T12:37:14.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.162+0000 7f9528f48740 10 client.26080 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:37:14.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.162+0000 7f9528f48740 10 client.26080 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-12T12:37:14.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.162+0000 7f9528f48740 20 client.26080 populate_metadata read hostname 'smithi033' 2024-09-12T12:37:14.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.162+0000 7f9528f48740 1 --2- 172.21.15.33:0/1503563840 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x557a2f717100 0x557a2f7195c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:14.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.162+0000 7f9528f48740 4 client.26080 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:37:14.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.162+0000 7f9528f48740 1 -- 172.21.15.33:0/1503563840 --> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557a2f57b170 con 0x557a2f717100 2024-09-12T12:37:14.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.167+0000 7f9517fff640 1 --2- 172.21.15.33:0/1503563840 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x557a2f717100 0x557a2f7195c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:14.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.175+0000 7f9517fff640 1 --2- 172.21.15.33:0/1503563840 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x557a2f717100 0x557a2f7195c0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b0603e663bc2fd97 server_cookie=e9409a9b7bce04d8 in_seq=0 out_seq=0 2024-09-12T12:37:14.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.175+0000 7f94fffff640 10 client.26080 ms_handle_connect on v2:172.21.15.102:6834/4179527539 2024-09-12T12:37:14.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.178+0000 7f94fffff640 1 -- 172.21.15.33:0/1503563840 <== mds.2 v2:172.21.15.102:6834/4179527539 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557a2f57b170 con 0x557a2f717100 2024-09-12T12:37:14.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.178+0000 7f94fffff640 10 client.26080 handle_command_reply: tid=0 2024-09-12T12:37:14.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.178+0000 7f9528f48740 1 client.26080 shutdown 2024-09-12T12:37:14.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.184+0000 7f9528f48740 1 -- 172.21.15.33:0/1503563840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a2f6915d0 msgr2=0x557a2f69fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:14.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.184+0000 7f9528f48740 1 --2- 172.21.15.33:0/1503563840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a2f6915d0 0x557a2f69fce0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9518021480 tx=0x7f95180094e0 comp rx=0 tx=0).stop 2024-09-12T12:37:14.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.185+0000 7f9528f48740 1 -- 172.21.15.33:0/1503563840 shutdown_connections 2024-09-12T12:37:14.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.185+0000 7f9528f48740 1 --2- 172.21.15.33:0/1503563840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557a2f69c370 0x557a2f70f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:14.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.185+0000 7f9528f48740 1 --2- 172.21.15.33:0/1503563840 >> [v2:172.21.15.102:6834/4179527539,v1:172.21.15.102:6835/4179527539] conn(0x557a2f717100 0x557a2f7195c0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:14.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.185+0000 7f9528f48740 1 --2- 172.21.15.33:0/1503563840 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a2f692b40 0x557a2f6a0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:14.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.185+0000 7f9528f48740 1 --2- 172.21.15.33:0/1503563840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a2f6915d0 0x557a2f69fce0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:14.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.185+0000 7f9528f48740 1 -- 172.21.15.33:0/1503563840 >> 172.21.15.33:0/1503563840 conn(0x557a2f65a310 msgr2=0x557a2f68cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:37:14.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.185+0000 7f94fffff640 0 client.26080 ms_handle_reset on v2:172.21.15.102:6834/4179527539 2024-09-12T12:37:14.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.185+0000 7f9528f48740 1 -- 172.21.15.33:0/1503563840 shutdown_connections 2024-09-12T12:37:14.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.186+0000 7f9528f48740 1 -- 172.21.15.33:0/1503563840 wait complete. 2024-09-12T12:37:14.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.186+0000 7f9528f48740 20 client.26080 trim_cache size 0 max 16384 2024-09-12T12:37:14.187 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-09-12T12:37:14.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.188+0000 7f9526b6f640 1 -- 172.21.15.33:0/718637846 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f95080a2d90 msgr2=0x7f95080a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:14.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.188+0000 7f9526b6f640 1 --2- 172.21.15.33:0/718637846 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f95080a2d90 0x7f95080a5250 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f951c005ab0 tx=0x7f951c003f90 comp rx=0 tx=0).stop 2024-09-12T12:37:14.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.188+0000 7f9526b6f640 1 -- 172.21.15.33:0/718637846 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9520109450 msgr2=0x7f95201a7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:14.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.188+0000 7f9526b6f640 1 --2- 172.21.15.33:0/718637846 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9520109450 0x7f95201a7220 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f951c02a9b0 tx=0x7f951c003b90 comp rx=0 tx=0).stop 2024-09-12T12:37:14.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.188+0000 7f9526b6f640 1 -- 172.21.15.33:0/718637846 shutdown_connections 2024-09-12T12:37:14.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.188+0000 7f9526b6f640 1 --2- 172.21.15.33:0/718637846 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f95080a2d90 0x7f95080a5250 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:14.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.188+0000 7f9526b6f640 1 --2- 172.21.15.33:0/718637846 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f952011b140 0x7f95201abaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:14.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.188+0000 7f9526b6f640 1 --2- 172.21.15.33:0/718637846 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9520109830 0x7f95201a7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:14.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.188+0000 7f9526b6f640 1 --2- 172.21.15.33:0/718637846 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9520109450 0x7f95201a7220 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:14.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.188+0000 7f9526b6f640 1 -- 172.21.15.33:0/718637846 >> 172.21.15.33:0/718637846 conn(0x7f952006e140 msgr2=0x7f952011bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:37:14.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.188+0000 7f9526b6f640 1 -- 172.21.15.33:0/718637846 shutdown_connections 2024-09-12T12:37:14.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:14.188+0000 7f9526b6f640 1 -- 172.21.15.33:0/718637846 wait complete. 2024-09-12T12:37:14.582 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:14 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:37:14.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:14 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:37:14.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:14 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:37:15.095 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T12:37:15.734 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:15 smithi033 ceph-mon[31246]: pgmap v687: 129 pgs: 129 active+clean; 10 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 33 MiB/s wr, 621 op/s 2024-09-12T12:37:15.734 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:15 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:37:15.734 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:15 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:37:15.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:15 smithi043 ceph-mon[34144]: pgmap v687: 129 pgs: 129 active+clean; 10 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 33 MiB/s wr, 621 op/s 2024-09-12T12:37:15.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:15 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:37:15.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:15 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:37:15.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:15 smithi102 ceph-mon[34799]: pgmap v687: 129 pgs: 129 active+clean; 10 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 33 MiB/s wr, 621 op/s 2024-09-12T12:37:15.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:15 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:37:15.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:15 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:37:15.961 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:37:16.152 INFO:tasks.workunit.client.0.smithi033.stdout:stopping iogen 2024-09-12T12:37:16.152 INFO:tasks.workunit.client.0.smithi033.stderr:+ echo 'stopping iogen' 2024-09-12T12:37:16.152 INFO:tasks.workunit.client.0.smithi033.stderr:+ ./iogen -k 2024-09-12T12:37:16.168 INFO:tasks.workunit.client.0.smithi033.stdout:OK 2024-09-12T12:37:16.168 INFO:tasks.workunit.client.0.smithi033.stderr:+ echo OK 2024-09-12T12:37:16.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.909+0000 7fc51aaeb640 1 -- 172.21.15.33:0/3657011356 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc514105f50 msgr2=0x7fc5141063e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:16.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.909+0000 7fc51aaeb640 1 --2- 172.21.15.33:0/3657011356 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc514105f50 0x7fc5141063e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc50c009ca0 tx=0x7fc50c02a980 comp rx=0 tx=0).stop 2024-09-12T12:37:16.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.910+0000 7fc51aaeb640 1 -- 172.21.15.33:0/3657011356 shutdown_connections 2024-09-12T12:37:16.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.910+0000 7fc51aaeb640 1 --2- 172.21.15.33:0/3657011356 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc514105f50 0x7fc5141063e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:16.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.910+0000 7fc51aaeb640 1 --2- 172.21.15.33:0/3657011356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc514101460 0x7fc514105930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:16.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.910+0000 7fc51aaeb640 1 --2- 172.21.15.33:0/3657011356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc514100b40 0x7fc514100f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:16.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.910+0000 7fc51aaeb640 1 -- 172.21.15.33:0/3657011356 >> 172.21.15.33:0/3657011356 conn(0x7fc5140fc7d0 msgr2=0x7fc5140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:37:16.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.915+0000 7fc51aaeb640 1 -- 172.21.15.33:0/3657011356 shutdown_connections 2024-09-12T12:37:16.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.922+0000 7fc51aaeb640 1 -- 172.21.15.33:0/3657011356 wait complete. 2024-09-12T12:37:16.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.922+0000 7fc51aaeb640 1 Processor -- start 2024-09-12T12:37:16.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.923+0000 7fc51aaeb640 1 -- start start 2024-09-12T12:37:16.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.923+0000 7fc51aaeb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc514100b40 0x7fc514073a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:16.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.923+0000 7fc51aaeb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc514101460 0x7fc51406dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:16.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.923+0000 7fc518887640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc514100b40 0x7fc514073a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:16.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.923+0000 7fc518887640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc514100b40 0x7fc514073a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37084/0 (socket says 172.21.15.33:37084) 2024-09-12T12:37:16.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.924+0000 7fc518887640 1 -- 172.21.15.33:0/3408476451 learned_addr learned my addr 172.21.15.33:0/3408476451 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:37:16.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.924+0000 7fc51aaeb640 1 --2- 172.21.15.33:0/3408476451 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc514105f50 0x7fc51406e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:16.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.924+0000 7fc51aaeb640 1 -- 172.21.15.33:0/3408476451 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc51406c510 con 0x7fc514100b40 2024-09-12T12:37:16.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.924+0000 7fc51aaeb640 1 -- 172.21.15.33:0/3408476451 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc51406c390 con 0x7fc514105f50 2024-09-12T12:37:16.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.924+0000 7fc51aaeb640 1 -- 172.21.15.33:0/3408476451 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc51406c690 con 0x7fc514101460 2024-09-12T12:37:16.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.929+0000 7fc518887640 1 -- 172.21.15.33:0/3408476451 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc514101460 msgr2=0x7fc51406dae0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T12:37:16.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.929+0000 7fc518887640 1 --2- 172.21.15.33:0/3408476451 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc514101460 0x7fc51406dae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:16.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.929+0000 7fc518887640 1 -- 172.21.15.33:0/3408476451 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc514105f50 msgr2=0x7fc51406e020 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T12:37:16.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.929+0000 7fc518887640 1 --2- 172.21.15.33:0/3408476451 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc514105f50 0x7fc51406e020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:16.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.929+0000 7fc518887640 1 -- 172.21.15.33:0/3408476451 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc51406e660 con 0x7fc514100b40 2024-09-12T12:37:16.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.929+0000 7fc518887640 1 --2- 172.21.15.33:0/3408476451 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc514100b40 0x7fc514073a60 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc50400d950 tx=0x7fc50400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:37:16.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.930+0000 7fc511ffb640 1 -- 172.21.15.33:0/3408476451 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc504017070 con 0x7fc514100b40 2024-09-12T12:37:16.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.930+0000 7fc511ffb640 1 -- 172.21.15.33:0/3408476451 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc504009c30 con 0x7fc514100b40 2024-09-12T12:37:16.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.930+0000 7fc511ffb640 1 -- 172.21.15.33:0/3408476451 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50400f620 con 0x7fc514100b40 2024-09-12T12:37:16.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.931+0000 7fc51aaeb640 1 -- 172.21.15.33:0/3408476451 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5141b38d0 con 0x7fc514100b40 2024-09-12T12:37:16.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.931+0000 7fc51aaeb640 1 -- 172.21.15.33:0/3408476451 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5141b3c70 con 0x7fc514100b40 2024-09-12T12:37:16.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.935+0000 7fc51cec4740 1 Processor -- start 2024-09-12T12:37:16.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.936+0000 7fc51cec4740 1 -- start start 2024-09-12T12:37:16.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.936+0000 7fc51cec4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562e149eeb40 0x562e149ed090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:16.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.936+0000 7fc51cec4740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e149ed5d0 0x562e149eda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:16.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.936+0000 7fc51cec4740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e14a09380 0x562e14a0b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:16.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.936+0000 7fc51cec4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x562e149532f0 con 0x562e149eeb40 2024-09-12T12:37:16.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.936+0000 7fc51cec4740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x562e148facf0 con 0x562e149ed5d0 2024-09-12T12:37:16.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.936+0000 7fc51cec4740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x562e1494f2b0 con 0x562e14a09380 2024-09-12T12:37:16.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.938+0000 7fc518887640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e149ed5d0 0x562e149eda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:16.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.938+0000 7fc518887640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e149ed5d0 0x562e149eda10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:42402/0 (socket says 172.21.15.33:42402) 2024-09-12T12:37:16.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.938+0000 7fc518887640 1 -- 172.21.15.33:0/917995139 learned_addr learned my addr 172.21.15.33:0/917995139 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:37:16.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.940+0000 7fc519088640 1 --2- 172.21.15.33:0/917995139 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562e149eeb40 0x562e149ed090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:16.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.941+0000 7fc518887640 1 -- 172.21.15.33:0/917995139 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e14a09380 msgr2=0x562e14a0b770 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:37:16.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.941+0000 7fc518887640 1 --2- 172.21.15.33:0/917995139 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e14a09380 0x562e14a0b770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:16.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.941+0000 7fc518887640 1 -- 172.21.15.33:0/917995139 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562e149eeb40 msgr2=0x562e149ed090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:37:16.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.941+0000 7fc518887640 1 --2- 172.21.15.33:0/917995139 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562e149eeb40 0x562e149ed090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:16.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.941+0000 7fc518887640 1 -- 172.21.15.33:0/917995139 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e148df3a0 con 0x562e149ed5d0 2024-09-12T12:37:16.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.941+0000 7fc511ffb640 1 -- 172.21.15.33:0/3408476451 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc5040109a0 con 0x7fc514100b40 2024-09-12T12:37:16.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.943+0000 7fc511ffb640 1 --2- 172.21.15.33:0/3408476451 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc4fc0a2d90 0x7fc4fc0a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:16.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.943+0000 7fc511ffb640 1 -- 172.21.15.33:0/3408476451 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fc5040d3c10 con 0x7fc514100b40 2024-09-12T12:37:16.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.945+0000 7fc518887640 1 --2- 172.21.15.33:0/917995139 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e149ed5d0 0x562e149eda10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc5040d1e60 tx=0x7fc5040d4f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c2869ff31ed756d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:37:16.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.949+0000 7fc4faffd640 1 -- 172.21.15.33:0/917995139 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc504020070 con 0x562e149ed5d0 2024-09-12T12:37:16.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.949+0000 7fc4faffd640 1 -- 172.21.15.33:0/917995139 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc5040a1320 con 0x562e149ed5d0 2024-09-12T12:37:16.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.949+0000 7fc4faffd640 1 -- 172.21.15.33:0/917995139 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5040a0580 con 0x562e149ed5d0 2024-09-12T12:37:16.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.950+0000 7fc51cec4740 1 -- 172.21.15.33:0/917995139 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e149ed5d0 msgr2=0x562e149eda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:16.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.951+0000 7fc51cec4740 1 --2- 172.21.15.33:0/917995139 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e149ed5d0 0x562e149eda10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc5040d1e60 tx=0x7fc5040d4f90 comp rx=0 tx=0).stop 2024-09-12T12:37:16.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.951+0000 7fc519088640 1 --2- 172.21.15.33:0/3408476451 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc4fc0a2d90 0x7fc4fc0a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:16.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.951+0000 7fc51cec4740 1 -- 172.21.15.33:0/917995139 shutdown_connections 2024-09-12T12:37:16.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.951+0000 7fc51cec4740 1 --2- 172.21.15.33:0/917995139 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e14a09380 0x562e14a0b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:16.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.951+0000 7fc51cec4740 1 --2- 172.21.15.33:0/917995139 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e149ed5d0 0x562e149eda10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:16.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.951+0000 7fc51cec4740 1 --2- 172.21.15.33:0/917995139 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562e149eeb40 0x562e149ed090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:16.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.951+0000 7fc51cec4740 1 -- 172.21.15.33:0/917995139 >> 172.21.15.33:0/917995139 conn(0x562e149b6310 msgr2=0x562e149e9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:37:16.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.952+0000 7fc519088640 1 --2- 172.21.15.33:0/3408476451 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc4fc0a2d90 0x7fc4fc0a5250 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc50c006010 tx=0x7fc50c005f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:37:16.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.955+0000 7fc51cec4740 1 -- 172.21.15.33:0/917995139 shutdown_connections 2024-09-12T12:37:16.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.958+0000 7fc51cec4740 1 -- 172.21.15.33:0/917995139 wait complete. 2024-09-12T12:37:16.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.959+0000 7fc51cec4740 1 -- start start 2024-09-12T12:37:16.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.959+0000 7fc51cec4740 1 Processor -- start 2024-09-12T12:37:16.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.960+0000 7fc51cec4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562e149ed5d0 0x562e14a08df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:16.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.960+0000 7fc51cec4740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e149eeb40 0x562e14a060a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:16.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.960+0000 7fc51cec4740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e14a09380 0x562e14a067e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:16.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.960+0000 7fc51cec4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x562e14a0c080 con 0x562e149ed5d0 2024-09-12T12:37:16.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.960+0000 7fc51cec4740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x562e1490e060 con 0x562e14a09380 2024-09-12T12:37:16.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.960+0000 7fc51cec4740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x562e14a0c200 con 0x562e149eeb40 2024-09-12T12:37:16.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.960+0000 7fc51cec4740 10 client.0 _ll_register_callbacks cb 0x562e146618c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:37:16.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.961+0000 7fc519088640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e14a09380 0x562e14a067e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:16.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.961+0000 7fc519088640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e14a09380 0x562e14a067e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:42406/0 (socket says 172.21.15.33:42406) 2024-09-12T12:37:16.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.961+0000 7fc519088640 1 -- 172.21.15.33:0/2098352266 learned_addr learned my addr 172.21.15.33:0/2098352266 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:37:16.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.963+0000 7fc518887640 1 --2- 172.21.15.33:0/2098352266 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562e149ed5d0 0x562e14a08df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:16.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.965+0000 7fc518887640 1 -- 172.21.15.33:0/2098352266 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e149eeb40 msgr2=0x562e14a060a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:37:16.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.965+0000 7fc518887640 1 --2- 172.21.15.33:0/2098352266 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e149eeb40 0x562e14a060a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:16.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.965+0000 7fc518887640 1 -- 172.21.15.33:0/2098352266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e14a09380 msgr2=0x562e14a067e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:37:16.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.965+0000 7fc518887640 1 --2- 172.21.15.33:0/2098352266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e14a09380 0x562e14a067e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:16.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.965+0000 7fc518887640 1 -- 172.21.15.33:0/2098352266 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e146c43c0 con 0x562e149ed5d0 2024-09-12T12:37:16.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.965+0000 7fc518887640 1 --2- 172.21.15.33:0/2098352266 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562e149ed5d0 0x562e14a08df0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc5040a14d0 tx=0x7fc504005bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=128a960846d60ca1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:37:16.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.965+0000 7fc4f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:37:16.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.966+0000 7fc4f3fff640 1 -- 172.21.15.33:0/2098352266 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc504020040 con 0x562e149ed5d0 2024-09-12T12:37:16.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.966+0000 7fc51cec4740 1 -- 172.21.15.33:0/2098352266 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5040a1320 con 0x562e149ed5d0 2024-09-12T12:37:16.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.966+0000 7fc4f3fff640 1 -- 172.21.15.33:0/2098352266 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fc5040a0e80 con 0x562e149ed5d0 2024-09-12T12:37:16.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.966+0000 7fc4f3fff640 1 -- 172.21.15.33:0/2098352266 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc50409ed60 con 0x562e149ed5d0 2024-09-12T12:37:16.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.966+0000 7fc51cec4740 10 client.16272 fetch_fsmap learned FSMap version 27 2024-09-12T12:37:16.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.966+0000 7fc51cec4740 1 -- 172.21.15.33:0/2098352266 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562e14a17bb0 con 0x562e149ed5d0 2024-09-12T12:37:16.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.967+0000 7fc4f3fff640 1 -- 172.21.15.33:0/2098352266 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc5040a1320 con 0x562e149ed5d0 2024-09-12T12:37:16.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.967+0000 7fc4f3fff640 1 -- 172.21.15.33:0/2098352266 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fc5040a9400 con 0x562e149ed5d0 2024-09-12T12:37:16.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.967+0000 7fc51cec4740 10 client.16272 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:37:16.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.967+0000 7fc51cec4740 10 client.16272 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-12T12:37:16.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.967+0000 7fc51cec4740 20 client.16272 populate_metadata read hostname 'smithi033' 2024-09-12T12:37:16.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.967+0000 7fc51cec4740 1 --2- 172.21.15.33:0/2098352266 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x562e14a190b0 0x562e14a1b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:16.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.967+0000 7fc51cec4740 4 client.16272 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:37:16.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.967+0000 7fc51cec4740 1 -- 172.21.15.33:0/2098352266 --> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e14960860 con 0x562e14a190b0 2024-09-12T12:37:16.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.969+0000 7fc513fff640 1 --2- 172.21.15.33:0/2098352266 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x562e14a190b0 0x562e14a1b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:16.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.976+0000 7fc513fff640 1 --2- 172.21.15.33:0/2098352266 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x562e14a190b0 0x562e14a1b540 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ae1ed4639b9b0f0e server_cookie=8d32a4e7bb087dcb in_seq=0 out_seq=0 2024-09-12T12:37:16.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.976+0000 7fc4f3fff640 10 client.16272 ms_handle_connect on v2:172.21.15.102:6836/2409953270 2024-09-12T12:37:16.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.978+0000 7fc4f3fff640 1 -- 172.21.15.33:0/2098352266 <== mds.1 v2:172.21.15.102:6836/2409953270 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fc508001570 con 0x562e14a190b0 2024-09-12T12:37:16.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.978+0000 7fc4f3fff640 10 client.16272 handle_command_reply: tid=0 2024-09-12T12:37:16.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.978+0000 7fc51cec4740 1 client.16272 shutdown 2024-09-12T12:37:16.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.979+0000 7fc51cec4740 1 -- 172.21.15.33:0/2098352266 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562e149ed5d0 msgr2=0x562e14a08df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:16.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.979+0000 7fc51cec4740 1 --2- 172.21.15.33:0/2098352266 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562e149ed5d0 0x562e14a08df0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc5040a14d0 tx=0x7fc504005bb0 comp rx=0 tx=0).stop 2024-09-12T12:37:16.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.982+0000 7fc51cec4740 1 -- 172.21.15.33:0/2098352266 shutdown_connections 2024-09-12T12:37:16.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.982+0000 7fc51cec4740 1 --2- 172.21.15.33:0/2098352266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e14a09380 0x562e14a067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:16.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.982+0000 7fc51cec4740 1 --2- 172.21.15.33:0/2098352266 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x562e14a190b0 0x562e14a1b540 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:16.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.982+0000 7fc51cec4740 1 --2- 172.21.15.33:0/2098352266 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e149eeb40 0x562e14a060a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:16.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.982+0000 7fc51cec4740 1 --2- 172.21.15.33:0/2098352266 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562e149ed5d0 0x562e14a08df0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:16.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.982+0000 7fc51cec4740 1 -- 172.21.15.33:0/2098352266 >> 172.21.15.33:0/2098352266 conn(0x562e149b6310 msgr2=0x562e149ef930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:37:16.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.982+0000 7fc4f3fff640 0 client.16272 ms_handle_reset on v2:172.21.15.102:6836/2409953270 2024-09-12T12:37:16.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.986+0000 7fc51cec4740 1 -- 172.21.15.33:0/2098352266 shutdown_connections 2024-09-12T12:37:16.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.987+0000 7fc51cec4740 1 -- 172.21.15.33:0/2098352266 wait complete. 2024-09-12T12:37:16.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:16.990+0000 7fc51cec4740 20 client.16272 trim_cache size 0 max 16384 2024-09-12T12:37:17.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.020+0000 7fc51cec4740 1 Processor -- start 2024-09-12T12:37:17.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.020+0000 7fc51cec4740 1 -- start start 2024-09-12T12:37:17.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.021+0000 7fc51cec4740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e149ed5d0 0x562e14a15320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:17.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.021+0000 7fc51cec4740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e149eeb40 0x562e14a05080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:17.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.021+0000 7fc51cec4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562e14a09380 0x562e14a20e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:17.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.021+0000 7fc518887640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e149ed5d0 0x562e14a15320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:17.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.022+0000 7fc518887640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e149ed5d0 0x562e14a15320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:52252/0 (socket says 172.21.15.33:52252) 2024-09-12T12:37:17.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.022+0000 7fc518887640 1 -- 172.21.15.33:0/29948057 learned_addr learned my addr 172.21.15.33:0/29948057 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:37:17.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.022+0000 7fc51cec4740 1 -- 172.21.15.33:0/29948057 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc5141b7b90 con 0x562e14a09380 2024-09-12T12:37:17.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.022+0000 7fc51cec4740 1 -- 172.21.15.33:0/29948057 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc5141b5460 con 0x562e149eeb40 2024-09-12T12:37:17.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.022+0000 7fc51cec4740 1 -- 172.21.15.33:0/29948057 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc514105930 con 0x562e149ed5d0 2024-09-12T12:37:17.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.022+0000 7fc513fff640 1 --2- 172.21.15.33:0/29948057 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e149eeb40 0x562e14a05080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:17.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.022+0000 7fc513fff640 1 -- 172.21.15.33:0/29948057 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e149ed5d0 msgr2=0x562e14a15320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:37:17.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.022+0000 7fc513fff640 1 --2- 172.21.15.33:0/29948057 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e149ed5d0 0x562e14a15320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:17.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.022+0000 7fc513fff640 1 -- 172.21.15.33:0/29948057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562e14a09380 msgr2=0x562e14a20e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:37:17.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.022+0000 7fc513fff640 1 --2- 172.21.15.33:0/29948057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562e14a09380 0x562e14a20e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:17.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.022+0000 7fc513fff640 1 -- 172.21.15.33:0/29948057 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e149ea960 con 0x562e149eeb40 2024-09-12T12:37:17.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.022+0000 7fc513fff640 1 --2- 172.21.15.33:0/29948057 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e149eeb40 0x562e14a05080 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x562e14a076e0 tx=0x7fc508001b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93d829a259cc93ab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:37:17.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.023+0000 7fc518887640 1 --2- 172.21.15.33:0/29948057 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e149ed5d0 0x562e14a15320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:37:17.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.025+0000 7fc4fa7fc640 1 -- 172.21.15.33:0/29948057 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc508021070 con 0x562e149eeb40 2024-09-12T12:37:17.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.026+0000 7fc4fa7fc640 1 -- 172.21.15.33:0/29948057 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x562e14960860 con 0x562e149eeb40 2024-09-12T12:37:17.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.026+0000 7fc4fa7fc640 1 -- 172.21.15.33:0/29948057 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50801ccb0 con 0x562e149eeb40 2024-09-12T12:37:17.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.029+0000 7fc51cec4740 1 -- 172.21.15.33:0/29948057 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e149eeb40 msgr2=0x562e14a05080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:17.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.029+0000 7fc51cec4740 1 --2- 172.21.15.33:0/29948057 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e149eeb40 0x562e14a05080 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x562e14a076e0 tx=0x7fc508001b00 comp rx=0 tx=0).stop 2024-09-12T12:37:17.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.034+0000 7fc51cec4740 1 -- 172.21.15.33:0/29948057 shutdown_connections 2024-09-12T12:37:17.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.034+0000 7fc51cec4740 1 --2- 172.21.15.33:0/29948057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562e14a09380 0x562e14a20e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:17.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.034+0000 7fc51cec4740 1 --2- 172.21.15.33:0/29948057 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e149eeb40 0x562e14a05080 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:17.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.034+0000 7fc51cec4740 1 --2- 172.21.15.33:0/29948057 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e149ed5d0 0x562e14a15320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:17.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.034+0000 7fc51cec4740 1 -- 172.21.15.33:0/29948057 >> 172.21.15.33:0/29948057 conn(0x562e149b6310 msgr2=0x562e14a04970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:37:17.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.034+0000 7fc51cec4740 1 -- 172.21.15.33:0/29948057 shutdown_connections 2024-09-12T12:37:17.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.038+0000 7fc51cec4740 1 -- 172.21.15.33:0/29948057 wait complete. 2024-09-12T12:37:17.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.038+0000 7fc51cec4740 1 -- start start 2024-09-12T12:37:17.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.038+0000 7fc51cec4740 1 Processor -- start 2024-09-12T12:37:17.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.039+0000 7fc51cec4740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e149ed5d0 0x562e14a11a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:17.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.039+0000 7fc51cec4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562e149eeb40 0x562e14a0ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:17.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.039+0000 7fc51cec4740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e14a09380 0x562e14a0d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:17.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.039+0000 7fc51cec4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc514110340 con 0x562e149eeb40 2024-09-12T12:37:17.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.039+0000 7fc51cec4740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc5141b4d90 con 0x562e14a09380 2024-09-12T12:37:17.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.039+0000 7fc51cec4740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc5141b4010 con 0x562e149ed5d0 2024-09-12T12:37:17.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.039+0000 7fc51cec4740 10 client.0 _ll_register_callbacks cb 0x7fc5040d4930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:37:17.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.041+0000 7fc519088640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e14a09380 0x562e14a0d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:17.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.041+0000 7fc518887640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e149ed5d0 0x562e14a11a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:17.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.041+0000 7fc519088640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e14a09380 0x562e14a0d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:42432/0 (socket says 172.21.15.33:42432) 2024-09-12T12:37:17.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.041+0000 7fc519088640 1 -- 172.21.15.33:0/3179507625 learned_addr learned my addr 172.21.15.33:0/3179507625 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:37:17.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.044+0000 7fc519088640 1 -- 172.21.15.33:0/3179507625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e149ed5d0 msgr2=0x562e14a11a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:37:17.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.044+0000 7fc519088640 1 --2- 172.21.15.33:0/3179507625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e149ed5d0 0x562e14a11a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:17.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.044+0000 7fc519088640 1 -- 172.21.15.33:0/3179507625 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562e149eeb40 msgr2=0x562e14a0ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:37:17.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.044+0000 7fc519088640 1 --2- 172.21.15.33:0/3179507625 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562e149eeb40 0x562e14a0ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:17.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.044+0000 7fc519088640 1 -- 172.21.15.33:0/3179507625 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e14a0da40 con 0x562e14a09380 2024-09-12T12:37:17.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.050+0000 7fc519088640 1 --2- 172.21.15.33:0/3179507625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e14a09380 0x562e14a0d350 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc50c02fc60 tx=0x7fc50c0095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=762b43a84c2289aa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:37:17.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.050+0000 7fc4f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:37:17.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.051+0000 7fc4f3fff640 1 -- 172.21.15.33:0/3179507625 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50c056060 con 0x562e14a09380 2024-09-12T12:37:17.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.052+0000 7fc4f3fff640 1 -- 172.21.15.33:0/3179507625 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fc50c047420 con 0x562e14a09380 2024-09-12T12:37:17.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.052+0000 7fc51cec4740 1 -- 172.21.15.33:0/3179507625 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562e14960860 con 0x562e14a09380 2024-09-12T12:37:17.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.052+0000 7fc4f3fff640 1 -- 172.21.15.33:0/3179507625 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc50c034040 con 0x562e14a09380 2024-09-12T12:37:17.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.052+0000 7fc51cec4740 10 client.25976 fetch_fsmap learned FSMap version 27 2024-09-12T12:37:17.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.052+0000 7fc51cec4740 1 -- 172.21.15.33:0/3179507625 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562e149f0500 con 0x562e14a09380 2024-09-12T12:37:17.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.053+0000 7fc4f3fff640 1 -- 172.21.15.33:0/3179507625 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc50c047ad0 con 0x562e14a09380 2024-09-12T12:37:17.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.053+0000 7fc4f3fff640 1 -- 172.21.15.33:0/3179507625 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fc50c039970 con 0x562e14a09380 2024-09-12T12:37:17.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.053+0000 7fc51cec4740 10 client.25976 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:37:17.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.053+0000 7fc51cec4740 10 client.25976 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-12T12:37:17.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.053+0000 7fc51cec4740 20 client.25976 populate_metadata read hostname 'smithi033' 2024-09-12T12:37:17.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.053+0000 7fc51cec4740 1 --2- 172.21.15.33:0/3179507625 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x562e149f0c90 0x562e149f30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:17.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.053+0000 7fc51cec4740 4 client.25976 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:37:17.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.053+0000 7fc51cec4740 1 -- 172.21.15.33:0/3179507625 --> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562e14960860 con 0x562e149f0c90 2024-09-12T12:37:17.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.054+0000 7fc518887640 1 --2- 172.21.15.33:0/3179507625 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x562e149f0c90 0x562e149f30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:17.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.055+0000 7fc518887640 1 --2- 172.21.15.33:0/3179507625 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x562e149f0c90 0x562e149f30b0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=844e3005c12f0558 server_cookie=256947f6304258c8 in_seq=0 out_seq=0 2024-09-12T12:37:17.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.056+0000 7fc4f3fff640 10 client.25976 ms_handle_connect on v2:172.21.15.102:6836/2409953270 2024-09-12T12:37:17.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.056+0000 7fc4f3fff640 1 -- 172.21.15.33:0/3179507625 <== mds.1 v2:172.21.15.102:6836/2409953270 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fc5040a1320 con 0x562e149f0c90 2024-09-12T12:37:17.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.056+0000 7fc4f3fff640 10 client.25976 handle_command_reply: tid=0 2024-09-12T12:37:17.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.056+0000 7fc51cec4740 1 client.25976 shutdown 2024-09-12T12:37:17.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.063+0000 7fc51cec4740 1 -- 172.21.15.33:0/3179507625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e14a09380 msgr2=0x562e14a0d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:17.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.063+0000 7fc51cec4740 1 --2- 172.21.15.33:0/3179507625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e14a09380 0x562e14a0d350 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc50c02fc60 tx=0x7fc50c0095c0 comp rx=0 tx=0).stop 2024-09-12T12:37:17.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.063+0000 7fc51cec4740 1 -- 172.21.15.33:0/3179507625 shutdown_connections 2024-09-12T12:37:17.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.063+0000 7fc51cec4740 1 --2- 172.21.15.33:0/3179507625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e14a09380 0x562e14a0d350 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:17.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.063+0000 7fc51cec4740 1 --2- 172.21.15.33:0/3179507625 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562e149eeb40 0x562e14a0ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:17.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.063+0000 7fc51cec4740 1 --2- 172.21.15.33:0/3179507625 >> [v2:172.21.15.102:6836/2409953270,v1:172.21.15.102:6837/2409953270] conn(0x562e149f0c90 0x562e149f30b0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:17.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.063+0000 7fc51cec4740 1 --2- 172.21.15.33:0/3179507625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e149ed5d0 0x562e14a11a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:17.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.063+0000 7fc51cec4740 1 -- 172.21.15.33:0/3179507625 >> 172.21.15.33:0/3179507625 conn(0x562e149b6310 msgr2=0x562e14a05190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:37:17.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.063+0000 7fc4f3fff640 0 client.25976 ms_handle_reset on v2:172.21.15.102:6836/2409953270 2024-09-12T12:37:17.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.064+0000 7fc51cec4740 1 -- 172.21.15.33:0/3179507625 shutdown_connections 2024-09-12T12:37:17.068 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-09-12T12:37:17.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.065+0000 7fc51cec4740 1 -- 172.21.15.33:0/3179507625 wait complete. 2024-09-12T12:37:17.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.066+0000 7fc51cec4740 20 client.25976 trim_cache size 0 max 16384 2024-09-12T12:37:17.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.071+0000 7fc51aaeb640 1 -- 172.21.15.33:0/3408476451 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc4fc0a2d90 msgr2=0x7fc4fc0a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:17.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.071+0000 7fc51aaeb640 1 --2- 172.21.15.33:0/3408476451 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc4fc0a2d90 0x7fc4fc0a5250 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc50c006010 tx=0x7fc50c005f40 comp rx=0 tx=0).stop 2024-09-12T12:37:17.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.071+0000 7fc51aaeb640 1 -- 172.21.15.33:0/3408476451 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc514100b40 msgr2=0x7fc514073a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:17.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.071+0000 7fc51aaeb640 1 --2- 172.21.15.33:0/3408476451 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc514100b40 0x7fc514073a60 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc50400d950 tx=0x7fc50400de10 comp rx=0 tx=0).stop 2024-09-12T12:37:17.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.071+0000 7fc51aaeb640 1 -- 172.21.15.33:0/3408476451 shutdown_connections 2024-09-12T12:37:17.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.071+0000 7fc51aaeb640 1 --2- 172.21.15.33:0/3408476451 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc4fc0a2d90 0x7fc4fc0a5250 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:17.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.071+0000 7fc51aaeb640 1 --2- 172.21.15.33:0/3408476451 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc514105f50 0x7fc51406e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:17.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.071+0000 7fc51aaeb640 1 --2- 172.21.15.33:0/3408476451 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc514101460 0x7fc51406dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:17.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.071+0000 7fc51aaeb640 1 --2- 172.21.15.33:0/3408476451 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc514100b40 0x7fc514073a60 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:17.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.071+0000 7fc51aaeb640 1 -- 172.21.15.33:0/3408476451 >> 172.21.15.33:0/3408476451 conn(0x7fc5140fc7d0 msgr2=0x7fc5141038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:37:17.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.073+0000 7fc51aaeb640 1 -- 172.21.15.33:0/3408476451 shutdown_connections 2024-09-12T12:37:17.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:17.073+0000 7fc51aaeb640 1 -- 172.21.15.33:0/3408476451 wait complete. 2024-09-12T12:37:17.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:17 smithi033 ceph-mon[31246]: pgmap v688: 129 pgs: 129 active+clean; 10 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 24 MiB/s wr, 443 op/s 2024-09-12T12:37:17.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:17 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:37:17.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:17 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:37:17.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:17 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:37:17.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:17 smithi043 ceph-mon[34144]: pgmap v688: 129 pgs: 129 active+clean; 10 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 24 MiB/s wr, 443 op/s 2024-09-12T12:37:17.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:17 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:37:17.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:17 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:37:17.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:17 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:37:17.882 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T12:37:17.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:17 smithi102 ceph-mon[34799]: pgmap v688: 129 pgs: 129 active+clean; 10 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 24 MiB/s wr, 443 op/s 2024-09-12T12:37:17.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:17 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:37:17.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:17 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:37:17.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:17 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' 2024-09-12T12:37:18.338 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T12:37:18.339 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T12:37:18.554 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:37:19.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.080+0000 7f844fb09640 1 -- 172.21.15.33:0/332318442 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8448101430 msgr2=0x7f844810d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:19.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.080+0000 7f844fb09640 1 --2- 172.21.15.33:0/332318442 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8448101430 0x7f844810d960 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f8440009cd0 tx=0x7f844002a8e0 comp rx=0 tx=0).stop 2024-09-12T12:37:19.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.080+0000 7f844fb09640 1 -- 172.21.15.33:0/332318442 shutdown_connections 2024-09-12T12:37:19.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.080+0000 7f844fb09640 1 --2- 172.21.15.33:0/332318442 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8448101430 0x7f844810d960 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:19.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.080+0000 7f844fb09640 1 --2- 172.21.15.33:0/332318442 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8448100a90 0x7f8448100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:19.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.080+0000 7f844fb09640 1 --2- 172.21.15.33:0/332318442 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8448106a90 0x7f8448106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:19.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.080+0000 7f844fb09640 1 -- 172.21.15.33:0/332318442 >> 172.21.15.33:0/332318442 conn(0x7f84480fc7d0 msgr2=0x7f84480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:37:19.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.080+0000 7f844fb09640 1 -- 172.21.15.33:0/332318442 shutdown_connections 2024-09-12T12:37:19.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.080+0000 7f844fb09640 1 -- 172.21.15.33:0/332318442 wait complete. 2024-09-12T12:37:19.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.081+0000 7f844fb09640 1 Processor -- start 2024-09-12T12:37:19.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.081+0000 7f844fb09640 1 -- start start 2024-09-12T12:37:19.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.081+0000 7f844fb09640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8448100a90 0x7f8448198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:19.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.081+0000 7f844fb09640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8448101430 0x7f8448198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:19.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.081+0000 7f844fb09640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8448106a90 0x7f844819cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:19.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.081+0000 7f844fb09640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8448110d40 con 0x7f8448106a90 2024-09-12T12:37:19.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.081+0000 7f844fb09640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8448110bc0 con 0x7f8448101430 2024-09-12T12:37:19.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.081+0000 7f844fb09640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8448110ec0 con 0x7f8448100a90 2024-09-12T12:37:19.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.081+0000 7f844e0a6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8448106a90 0x7f844819cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:19.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.081+0000 7f844d8a5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8448100a90 0x7f8448198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:19.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.081+0000 7f844d8a5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8448100a90 0x7f8448198350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:52284/0 (socket says 172.21.15.33:52284) 2024-09-12T12:37:19.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.081+0000 7f844e0a6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8448106a90 0x7f844819cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37130/0 (socket says 172.21.15.33:37130) 2024-09-12T12:37:19.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.081+0000 7f844d8a5640 1 -- 172.21.15.33:0/1895601514 learned_addr learned my addr 172.21.15.33:0/1895601514 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:37:19.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.082+0000 7f844d0a4640 1 --2- 172.21.15.33:0/1895601514 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8448101430 0x7f8448198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:19.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.082+0000 7f844d8a5640 1 -- 172.21.15.33:0/1895601514 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8448101430 msgr2=0x7f8448198890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:19.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.082+0000 7f844d8a5640 1 --2- 172.21.15.33:0/1895601514 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8448101430 0x7f8448198890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:19.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.082+0000 7f844d8a5640 1 -- 172.21.15.33:0/1895601514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8448106a90 msgr2=0x7f844819cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:19.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.082+0000 7f844d8a5640 1 --2- 172.21.15.33:0/1895601514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8448106a90 0x7f844819cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:19.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.082+0000 7f844d8a5640 1 -- 172.21.15.33:0/1895601514 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f844819d300 con 0x7f8448100a90 2024-09-12T12:37:19.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.082+0000 7f844d0a4640 1 --2- 172.21.15.33:0/1895601514 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8448101430 0x7f8448198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:37:19.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.082+0000 7f844d8a5640 1 --2- 172.21.15.33:0/1895601514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8448100a90 0x7f8448198350 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f844400c920 tx=0x7f844400cde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:37:19.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.082+0000 7f843effd640 1 -- 172.21.15.33:0/1895601514 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8444007c70 con 0x7f8448100a90 2024-09-12T12:37:19.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.082+0000 7f843effd640 1 -- 172.21.15.33:0/1895601514 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8444007e10 con 0x7f8448100a90 2024-09-12T12:37:19.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.082+0000 7f844fb09640 1 -- 172.21.15.33:0/1895601514 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f844819d5f0 con 0x7f8448100a90 2024-09-12T12:37:19.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.082+0000 7f843effd640 1 -- 172.21.15.33:0/1895601514 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8444018820 con 0x7f8448100a90 2024-09-12T12:37:19.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.082+0000 7f844fb09640 1 -- 172.21.15.33:0/1895601514 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84481a4ed0 con 0x7f8448100a90 2024-09-12T12:37:19.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.085+0000 7f8451ee2740 1 Processor -- start 2024-09-12T12:37:19.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.085+0000 7f8451ee2740 1 -- start start 2024-09-12T12:37:19.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.086+0000 7f8451ee2740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556d272e4b40 0x556d272e3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:19.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.086+0000 7f8451ee2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d272e35d0 0x556d272e3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:19.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.086+0000 7f8451ee2740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d272ee370 0x556d272f0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:19.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.086+0000 7f8451ee2740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x556d272492f0 con 0x556d272e4b40 2024-09-12T12:37:19.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.086+0000 7f8451ee2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556d271f0cf0 con 0x556d272e35d0 2024-09-12T12:37:19.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.086+0000 7f8451ee2740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556d272452b0 con 0x556d272ee370 2024-09-12T12:37:19.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.086+0000 7f843effd640 1 -- 172.21.15.33:0/1895601514 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f84440189c0 con 0x7f8448100a90 2024-09-12T12:37:19.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.086+0000 7f844e0a6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556d272e4b40 0x556d272e3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:19.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.086+0000 7f844e0a6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556d272e4b40 0x556d272e3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37138/0 (socket says 172.21.15.33:37138) 2024-09-12T12:37:19.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.086+0000 7f844e0a6640 1 -- 172.21.15.33:0/1175193983 learned_addr learned my addr 172.21.15.33:0/1175193983 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:37:19.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.086+0000 7f844d8a5640 1 --2- 172.21.15.33:0/1175193983 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d272e35d0 0x556d272e3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:19.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.086+0000 7f844d0a4640 1 --2- 172.21.15.33:0/1175193983 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d272ee370 0x556d272f0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:19.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.086+0000 7f844e0a6640 1 -- 172.21.15.33:0/1175193983 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d272ee370 msgr2=0x556d272f0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:37:19.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.086+0000 7f844e0a6640 1 --2- 172.21.15.33:0/1175193983 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d272ee370 0x556d272f0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:19.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.086+0000 7f844e0a6640 1 -- 172.21.15.33:0/1175193983 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d272e35d0 msgr2=0x556d272e3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:37:19.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.086+0000 7f844e0a6640 1 --2- 172.21.15.33:0/1175193983 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d272e35d0 0x556d272e3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:19.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.086+0000 7f844e0a6640 1 -- 172.21.15.33:0/1175193983 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d271d53a0 con 0x556d272e4b40 2024-09-12T12:37:19.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.086+0000 7f844d8a5640 1 --2- 172.21.15.33:0/1175193983 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d272e35d0 0x556d272e3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:37:19.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.087+0000 7f844e0a6640 1 --2- 172.21.15.33:0/1175193983 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556d272e4b40 0x556d272e3090 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f8440009cd0 tx=0x7f8440009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d27f87f89b74dfbd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:37:19.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.087+0000 7f8433fff640 1 -- 172.21.15.33:0/1175193983 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8440049070 con 0x556d272e4b40 2024-09-12T12:37:19.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.087+0000 7f8433fff640 1 -- 172.21.15.33:0/1175193983 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8440036040 con 0x556d272e4b40 2024-09-12T12:37:19.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.087+0000 7f8433fff640 1 -- 172.21.15.33:0/1175193983 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8440004260 con 0x556d272e4b40 2024-09-12T12:37:19.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.087+0000 7f843effd640 1 --2- 172.21.15.33:0/1895601514 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f84340a2b80 0x7f84340a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:19.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.087+0000 7f844d8a5640 1 --2- 172.21.15.33:0/1895601514 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f84340a2b80 0x7f84340a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:19.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.087+0000 7f843effd640 1 -- 172.21.15.33:0/1895601514 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f84440cf4e0 con 0x7f8448100a90 2024-09-12T12:37:19.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.088+0000 7f8451ee2740 1 -- 172.21.15.33:0/1175193983 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556d272e4b40 msgr2=0x556d272e3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:19.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.088+0000 7f8451ee2740 1 --2- 172.21.15.33:0/1175193983 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556d272e4b40 0x556d272e3090 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f8440009cd0 tx=0x7f8440009a20 comp rx=0 tx=0).stop 2024-09-12T12:37:19.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.088+0000 7f844d8a5640 1 --2- 172.21.15.33:0/1895601514 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f84340a2b80 0x7f84340a5040 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f84440ccfc0 tx=0x7f8444000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:37:19.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.088+0000 7f8451ee2740 1 -- 172.21.15.33:0/1175193983 shutdown_connections 2024-09-12T12:37:19.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.088+0000 7f8451ee2740 1 --2- 172.21.15.33:0/1175193983 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d272ee370 0x556d272f0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:19.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.088+0000 7f8451ee2740 1 --2- 172.21.15.33:0/1175193983 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d272e35d0 0x556d272e3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:19.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.088+0000 7f8451ee2740 1 --2- 172.21.15.33:0/1175193983 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556d272e4b40 0x556d272e3090 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:19.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.088+0000 7f8451ee2740 1 -- 172.21.15.33:0/1175193983 >> 172.21.15.33:0/1175193983 conn(0x556d272ac310 msgr2=0x556d272dfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:37:19.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.088+0000 7f8451ee2740 1 -- 172.21.15.33:0/1175193983 shutdown_connections 2024-09-12T12:37:19.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.088+0000 7f8451ee2740 1 -- 172.21.15.33:0/1175193983 wait complete. 2024-09-12T12:37:19.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.088+0000 7f8451ee2740 1 -- start start 2024-09-12T12:37:19.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.089+0000 7f8451ee2740 1 Processor -- start 2024-09-12T12:37:19.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.089+0000 7f8451ee2740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556d272e35d0 0x556d272edda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:19.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.089+0000 7f8451ee2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d272e4b40 0x556d272eb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:19.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.089+0000 7f8451ee2740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d272ee370 0x556d272eb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:19.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.089+0000 7f8451ee2740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x556d272f1010 con 0x556d272e35d0 2024-09-12T12:37:19.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.089+0000 7f8451ee2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556d27204060 con 0x556d272e4b40 2024-09-12T12:37:19.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.089+0000 7f8451ee2740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556d272f1190 con 0x556d272ee370 2024-09-12T12:37:19.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.089+0000 7f8451ee2740 10 client.0 _ll_register_callbacks cb 0x556d26f578c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:37:19.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.089+0000 7f844e0a6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556d272e35d0 0x556d272edda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:19.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.089+0000 7f844d0a4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d272e4b40 0x556d272eb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:19.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.089+0000 7f844d0a4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d272e4b40 0x556d272eb050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:42466/0 (socket says 172.21.15.33:42466) 2024-09-12T12:37:19.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.089+0000 7f844e0a6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556d272e35d0 0x556d272edda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37148/0 (socket says 172.21.15.33:37148) 2024-09-12T12:37:19.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.089+0000 7f844d0a4640 1 -- 172.21.15.33:0/1310665500 learned_addr learned my addr 172.21.15.33:0/1310665500 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:37:19.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.090+0000 7f844e0a6640 1 --2- 172.21.15.33:0/1310665500 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d272ee370 0x556d272eb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:19.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.090+0000 7f844d0a4640 1 -- 172.21.15.33:0/1310665500 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d272ee370 msgr2=0x556d272eb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:37:19.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.090+0000 7f844d0a4640 1 --2- 172.21.15.33:0/1310665500 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d272ee370 0x556d272eb7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:19.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.090+0000 7f844d0a4640 1 -- 172.21.15.33:0/1310665500 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556d272e35d0 msgr2=0x556d272edda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:37:19.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.090+0000 7f844d0a4640 1 --2- 172.21.15.33:0/1310665500 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556d272e35d0 0x556d272edda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:19.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.090+0000 7f844d0a4640 1 -- 172.21.15.33:0/1310665500 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d26fba3c0 con 0x556d272e4b40 2024-09-12T12:37:19.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.090+0000 7f844e0a6640 1 --2- 172.21.15.33:0/1310665500 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d272ee370 0x556d272eb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:37:19.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.090+0000 7f844d0a4640 1 --2- 172.21.15.33:0/1310665500 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d272e4b40 0x556d272eb050 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8438012570 tx=0x7f8438012a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e13fe31ccdc6724 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:37:19.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.090+0000 7f84317fa640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-12T12:37:19.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.090+0000 7f84317fa640 1 -- 172.21.15.33:0/1310665500 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f843801f060 con 0x556d272e4b40 2024-09-12T12:37:19.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.090+0000 7f84317fa640 1 -- 172.21.15.33:0/1310665500 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f8438010860 con 0x556d272e4b40 2024-09-12T12:37:19.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.090+0000 7f8451ee2740 1 -- 172.21.15.33:0/1310665500 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8440036040 con 0x556d272e4b40 2024-09-12T12:37:19.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.091+0000 7f84317fa640 1 -- 172.21.15.33:0/1310665500 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8438026050 con 0x556d272e4b40 2024-09-12T12:37:19.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.091+0000 7f8451ee2740 10 client.25985 fetch_fsmap learned FSMap version 27 2024-09-12T12:37:19.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.091+0000 7f8451ee2740 1 -- 172.21.15.33:0/1310665500 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556d272fcb80 con 0x556d272e4b40 2024-09-12T12:37:19.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.091+0000 7f84317fa640 1 -- 172.21.15.33:0/1310665500 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8440036040 con 0x556d272e4b40 2024-09-12T12:37:19.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.091+0000 7f84317fa640 1 -- 172.21.15.33:0/1310665500 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f8438019b80 con 0x556d272e4b40 2024-09-12T12:37:19.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.091+0000 7f8451ee2740 10 client.25985 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:37:19.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.091+0000 7f8451ee2740 10 client.25985 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:37:19.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.091+0000 7f8451ee2740 20 client.25985 populate_metadata read hostname 'smithi033' 2024-09-12T12:37:19.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.091+0000 7f8451ee2740 1 --2- 172.21.15.33:0/1310665500 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x556d272fe410 0x556d27300890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:19.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.091+0000 7f8451ee2740 4 client.25985 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:37:19.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.091+0000 7f8451ee2740 1 -- 172.21.15.33:0/1310665500 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556d27256860 con 0x556d272fe410 2024-09-12T12:37:19.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.091+0000 7f844e0a6640 1 --2- 172.21.15.33:0/1310665500 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x556d272fe410 0x556d27300890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:19.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.092+0000 7f84317fa640 10 client.25985 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:37:19.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.092+0000 7f844e0a6640 1 --2- 172.21.15.33:0/1310665500 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x556d272fe410 0x556d27300890 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a578488b61e6d019 server_cookie=149009272651f104 in_seq=0 out_seq=0 2024-09-12T12:37:19.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.093+0000 7f84317fa640 1 -- 172.21.15.33:0/1310665500 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556d27256860 con 0x556d272fe410 2024-09-12T12:37:19.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.093+0000 7f84317fa640 10 client.25985 handle_command_reply: tid=0 2024-09-12T12:37:19.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.094+0000 7f8451ee2740 1 client.25985 shutdown 2024-09-12T12:37:19.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.094+0000 7f8451ee2740 1 -- 172.21.15.33:0/1310665500 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d272e4b40 msgr2=0x556d272eb050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:19.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.094+0000 7f8451ee2740 1 --2- 172.21.15.33:0/1310665500 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d272e4b40 0x556d272eb050 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8438012570 tx=0x7f8438012a30 comp rx=0 tx=0).stop 2024-09-12T12:37:19.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.094+0000 7f8451ee2740 1 -- 172.21.15.33:0/1310665500 shutdown_connections 2024-09-12T12:37:19.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.094+0000 7f8451ee2740 1 --2- 172.21.15.33:0/1310665500 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x556d272fe410 0x556d27300890 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:19.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.094+0000 7f8451ee2740 1 --2- 172.21.15.33:0/1310665500 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d272ee370 0x556d272eb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:19.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.094+0000 7f8451ee2740 1 --2- 172.21.15.33:0/1310665500 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d272e4b40 0x556d272eb050 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:19.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.094+0000 7f8451ee2740 1 --2- 172.21.15.33:0/1310665500 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556d272e35d0 0x556d272edda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:19.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.094+0000 7f84317fa640 0 client.25985 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:37:19.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.094+0000 7f8451ee2740 1 -- 172.21.15.33:0/1310665500 >> 172.21.15.33:0/1310665500 conn(0x556d272ac310 msgr2=0x556d272e5930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:37:19.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.094+0000 7f8451ee2740 1 -- 172.21.15.33:0/1310665500 shutdown_connections 2024-09-12T12:37:19.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.094+0000 7f8451ee2740 1 -- 172.21.15.33:0/1310665500 wait complete. 2024-09-12T12:37:19.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.094+0000 7f8451ee2740 20 client.25985 trim_cache size 0 max 16384 2024-09-12T12:37:19.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.108+0000 7f8451ee2740 1 Processor -- start 2024-09-12T12:37:19.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.108+0000 7f8451ee2740 1 -- start start 2024-09-12T12:37:19.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.108+0000 7f8451ee2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d272e35d0 0x556d272df700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:19.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.108+0000 7f8451ee2740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d272e4b40 0x556d272dfc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:19.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.108+0000 7f8451ee2740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556d272ee370 0x556d273061a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:19.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.108+0000 7f8451ee2740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f84481b3650 con 0x556d272ee370 2024-09-12T12:37:19.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.108+0000 7f8451ee2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f84481b0f20 con 0x556d272e35d0 2024-09-12T12:37:19.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.108+0000 7f8451ee2740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f84481aed70 con 0x556d272e4b40 2024-09-12T12:37:19.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.109+0000 7f844d0a4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d272e4b40 0x556d272dfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:19.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.109+0000 7f844e0a6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556d272ee370 0x556d273061a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:19.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.109+0000 7f844d0a4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d272e4b40 0x556d272dfc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.33:52306/0 (socket says 172.21.15.33:52306) 2024-09-12T12:37:19.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.109+0000 7f844d0a4640 1 -- 172.21.15.33:0/227108810 learned_addr learned my addr 172.21.15.33:0/227108810 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:37:19.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.109+0000 7f844e0a6640 1 --2- 172.21.15.33:0/227108810 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d272e35d0 0x556d272df700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:19.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.109+0000 7f844d0a4640 1 -- 172.21.15.33:0/227108810 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d272e35d0 msgr2=0x556d272df700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:37:19.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.109+0000 7f844d0a4640 1 --2- 172.21.15.33:0/227108810 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d272e35d0 0x556d272df700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:19.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.109+0000 7f844d0a4640 1 -- 172.21.15.33:0/227108810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556d272ee370 msgr2=0x556d273061a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:37:19.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.109+0000 7f844d0a4640 1 --2- 172.21.15.33:0/227108810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556d272ee370 0x556d273061a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:19.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.109+0000 7f844d0a4640 1 -- 172.21.15.33:0/227108810 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d272de310 con 0x556d272e4b40 2024-09-12T12:37:19.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.109+0000 7f844d0a4640 1 --2- 172.21.15.33:0/227108810 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d272e4b40 0x556d272dfc40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8438000c00 tx=0x7f84380056f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c676e9be38194f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:37:19.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.109+0000 7f84337fe640 1 -- 172.21.15.33:0/227108810 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f843800e770 con 0x556d272e4b40 2024-09-12T12:37:19.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.109+0000 7f84337fe640 1 -- 172.21.15.33:0/227108810 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f843800edf0 con 0x556d272e4b40 2024-09-12T12:37:19.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.109+0000 7f84337fe640 1 -- 172.21.15.33:0/227108810 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8438010d60 con 0x556d272e4b40 2024-09-12T12:37:19.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.110+0000 7f8451ee2740 1 -- 172.21.15.33:0/227108810 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d272e4b40 msgr2=0x556d272dfc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:19.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.110+0000 7f8451ee2740 1 --2- 172.21.15.33:0/227108810 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d272e4b40 0x556d272dfc40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8438000c00 tx=0x7f84380056f0 comp rx=0 tx=0).stop 2024-09-12T12:37:19.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.110+0000 7f8451ee2740 1 -- 172.21.15.33:0/227108810 shutdown_connections 2024-09-12T12:37:19.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.110+0000 7f8451ee2740 1 --2- 172.21.15.33:0/227108810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556d272ee370 0x556d273061a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:19.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.110+0000 7f8451ee2740 1 --2- 172.21.15.33:0/227108810 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d272e4b40 0x556d272dfc40 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:19.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.110+0000 7f8451ee2740 1 --2- 172.21.15.33:0/227108810 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d272e35d0 0x556d272df700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:19.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.110+0000 7f8451ee2740 1 -- 172.21.15.33:0/227108810 >> 172.21.15.33:0/227108810 conn(0x556d272ac310 msgr2=0x556d272e6310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:37:19.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.110+0000 7f8451ee2740 1 -- 172.21.15.33:0/227108810 shutdown_connections 2024-09-12T12:37:19.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.110+0000 7f8451ee2740 1 -- 172.21.15.33:0/227108810 wait complete. 2024-09-12T12:37:19.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.111+0000 7f8451ee2740 1 -- start start 2024-09-12T12:37:19.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.111+0000 7f8451ee2740 1 Processor -- start 2024-09-12T12:37:19.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.112+0000 7f8451ee2740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556d272e35d0 0x556d272f6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:19.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.112+0000 7f8451ee2740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d272e4b40 0x556d272e7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:19.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.112+0000 7f8451ee2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d272ee370 0x556d272e8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:19.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.112+0000 7f8451ee2740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f84481af3e0 con 0x556d272e35d0 2024-09-12T12:37:19.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.112+0000 7f8451ee2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f84481b0850 con 0x556d272ee370 2024-09-12T12:37:19.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.112+0000 7f8451ee2740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f84481afab0 con 0x556d272e4b40 2024-09-12T12:37:19.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.112+0000 7f8451ee2740 10 client.0 _ll_register_callbacks cb 0x7f84380095b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:37:19.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.112+0000 7f844e0a6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556d272e35d0 0x556d272f6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:19.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.112+0000 7f844d0a4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d272e4b40 0x556d272e7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:19.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.112+0000 7f844e0a6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556d272e35d0 0x556d272f6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37168/0 (socket says 172.21.15.33:37168) 2024-09-12T12:37:19.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.112+0000 7f844e0a6640 1 -- 172.21.15.33:0/2189893555 learned_addr learned my addr 172.21.15.33:0/2189893555 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:37:19.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.112+0000 7f844e0a6640 1 --2- 172.21.15.33:0/2189893555 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d272ee370 0x556d272e8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:19.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.112+0000 7f844e0a6640 1 -- 172.21.15.33:0/2189893555 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d272e4b40 msgr2=0x556d272e7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:37:19.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.112+0000 7f844e0a6640 1 --2- 172.21.15.33:0/2189893555 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d272e4b40 0x556d272e7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:19.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.112+0000 7f844e0a6640 1 -- 172.21.15.33:0/2189893555 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d272ee370 msgr2=0x556d272e8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:37:19.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.112+0000 7f844e0a6640 1 --2- 172.21.15.33:0/2189893555 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d272ee370 0x556d272e8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:19.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.112+0000 7f844e0a6640 1 -- 172.21.15.33:0/2189893555 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d272e6120 con 0x556d272e35d0 2024-09-12T12:37:19.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.113+0000 7f844e0a6640 1 --2- 172.21.15.33:0/2189893555 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556d272e35d0 0x556d272f6b60 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f8440005fe0 tx=0x7f8440009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cc3d73b87c2160b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:37:19.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.113+0000 7f84317fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-12T12:37:19.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.113+0000 7f84317fa640 1 -- 172.21.15.33:0/2189893555 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8440049040 con 0x556d272e35d0 2024-09-12T12:37:19.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.113+0000 7f84317fa640 1 -- 172.21.15.33:0/2189893555 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f8440041040 con 0x556d272e35d0 2024-09-12T12:37:19.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.113+0000 7f8451ee2740 1 -- 172.21.15.33:0/2189893555 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f843800edf0 con 0x556d272e35d0 2024-09-12T12:37:19.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.113+0000 7f84317fa640 1 -- 172.21.15.33:0/2189893555 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8440069050 con 0x556d272e35d0 2024-09-12T12:37:19.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.113+0000 7f8451ee2740 10 client.16290 fetch_fsmap learned FSMap version 27 2024-09-12T12:37:19.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.113+0000 7f8451ee2740 1 -- 172.21.15.33:0/2189893555 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556d27368f50 con 0x556d272e35d0 2024-09-12T12:37:19.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.113+0000 7f84317fa640 1 -- 172.21.15.33:0/2189893555 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f843800edf0 con 0x556d272e35d0 2024-09-12T12:37:19.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.114+0000 7f84317fa640 1 -- 172.21.15.33:0/2189893555 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f8440030070 con 0x556d272e35d0 2024-09-12T12:37:19.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.114+0000 7f8451ee2740 10 client.16290 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:37:19.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.114+0000 7f8451ee2740 10 client.16290 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T12:37:19.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.114+0000 7f8451ee2740 20 client.16290 populate_metadata read hostname 'smithi033' 2024-09-12T12:37:19.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.114+0000 7f8451ee2740 1 --2- 172.21.15.33:0/2189893555 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x556d27369350 0x556d2736b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:19.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.114+0000 7f8451ee2740 4 client.16290 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:37:19.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.114+0000 7f8451ee2740 1 -- 172.21.15.33:0/2189893555 --> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556d27250d70 con 0x556d27369350 2024-09-12T12:37:19.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.114+0000 7f844d0a4640 1 --2- 172.21.15.33:0/2189893555 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x556d27369350 0x556d2736b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:19.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.114+0000 7f84317fa640 10 client.16290 ms_handle_connect on v2:172.21.15.102:6838/1553271340 2024-09-12T12:37:19.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.114+0000 7f844d0a4640 1 --2- 172.21.15.33:0/2189893555 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x556d27369350 0x556d2736b740 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88285133fd376c3d server_cookie=9f045505aec51464 in_seq=0 out_seq=0 2024-09-12T12:37:19.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.115+0000 7f84317fa640 1 -- 172.21.15.33:0/2189893555 <== mds.0 v2:172.21.15.102:6838/1553271340 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556d27250d70 con 0x556d27369350 2024-09-12T12:37:19.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.115+0000 7f84317fa640 10 client.16290 handle_command_reply: tid=0 2024-09-12T12:37:19.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.115+0000 7f8451ee2740 1 client.16290 shutdown 2024-09-12T12:37:19.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.115+0000 7f8451ee2740 1 -- 172.21.15.33:0/2189893555 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556d272e35d0 msgr2=0x556d272f6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:19.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.115+0000 7f8451ee2740 1 --2- 172.21.15.33:0/2189893555 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556d272e35d0 0x556d272f6b60 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f8440005fe0 tx=0x7f8440009a20 comp rx=0 tx=0).stop 2024-09-12T12:37:19.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.115+0000 7f8451ee2740 1 -- 172.21.15.33:0/2189893555 shutdown_connections 2024-09-12T12:37:19.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.115+0000 7f8451ee2740 1 --2- 172.21.15.33:0/2189893555 >> [v2:172.21.15.102:6838/1553271340,v1:172.21.15.102:6839/1553271340] conn(0x556d27369350 0x556d2736b740 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:19.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.115+0000 7f8451ee2740 1 --2- 172.21.15.33:0/2189893555 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d272ee370 0x556d272e8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:19.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.115+0000 7f8451ee2740 1 --2- 172.21.15.33:0/2189893555 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d272e4b40 0x556d272e7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:19.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.115+0000 7f8451ee2740 1 --2- 172.21.15.33:0/2189893555 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556d272e35d0 0x556d272f6b60 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:19.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.115+0000 7f8451ee2740 1 -- 172.21.15.33:0/2189893555 >> 172.21.15.33:0/2189893555 conn(0x556d272ac310 msgr2=0x556d272e94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:37:19.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.115+0000 7f84317fa640 0 client.16290 ms_handle_reset on v2:172.21.15.102:6838/1553271340 2024-09-12T12:37:19.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.115+0000 7f8451ee2740 1 -- 172.21.15.33:0/2189893555 shutdown_connections 2024-09-12T12:37:19.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.115+0000 7f8451ee2740 1 -- 172.21.15.33:0/2189893555 wait complete. 2024-09-12T12:37:19.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.115+0000 7f8451ee2740 20 client.16290 trim_cache size 0 max 16384 2024-09-12T12:37:19.119 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-09-12T12:37:19.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.116+0000 7f844fb09640 1 -- 172.21.15.33:0/1895601514 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f84340a2b80 msgr2=0x7f84340a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:19.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.116+0000 7f844fb09640 1 --2- 172.21.15.33:0/1895601514 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f84340a2b80 0x7f84340a5040 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f84440ccfc0 tx=0x7f8444000bc0 comp rx=0 tx=0).stop 2024-09-12T12:37:19.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.116+0000 7f844fb09640 1 -- 172.21.15.33:0/1895601514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8448100a90 msgr2=0x7f8448198350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:19.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.116+0000 7f844fb09640 1 --2- 172.21.15.33:0/1895601514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8448100a90 0x7f8448198350 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f844400c920 tx=0x7f844400cde0 comp rx=0 tx=0).stop 2024-09-12T12:37:19.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.116+0000 7f844fb09640 1 -- 172.21.15.33:0/1895601514 shutdown_connections 2024-09-12T12:37:19.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.116+0000 7f844fb09640 1 --2- 172.21.15.33:0/1895601514 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f84340a2b80 0x7f84340a5040 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:19.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.116+0000 7f844fb09640 1 --2- 172.21.15.33:0/1895601514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8448106a90 0x7f844819cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:19.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.116+0000 7f844fb09640 1 --2- 172.21.15.33:0/1895601514 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8448101430 0x7f8448198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:19.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.116+0000 7f844fb09640 1 --2- 172.21.15.33:0/1895601514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8448100a90 0x7f8448198350 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:19.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.116+0000 7f844fb09640 1 -- 172.21.15.33:0/1895601514 >> 172.21.15.33:0/1895601514 conn(0x7f84480fc7d0 msgr2=0x7f844806aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:37:19.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.116+0000 7f844fb09640 1 -- 172.21.15.33:0/1895601514 shutdown_connections 2024-09-12T12:37:19.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:19.116+0000 7f844fb09640 1 -- 172.21.15.33:0/1895601514 wait complete. 2024-09-12T12:37:19.260 INFO:tasks.workunit:Stopping ['suites/iogen.sh'] on client.0... 2024-09-12T12:37:19.260 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T12:37:19.717 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:19 smithi033 ceph-mon[31246]: pgmap v689: 129 pgs: 129 active+clean; 10 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 33 MiB/s wr, 628 op/s 2024-09-12T12:37:19.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:19 smithi043 ceph-mon[34144]: pgmap v689: 129 pgs: 129 active+clean; 10 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 33 MiB/s wr, 628 op/s 2024-09-12T12:37:19.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:19 smithi102 ceph-mon[34799]: pgmap v689: 129 pgs: 129 active+clean; 10 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 33 MiB/s wr, 628 op/s 2024-09-12T12:37:20.092 DEBUG:teuthology.parallel:result is None 2024-09-12T12:37:20.093 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T12:37:20.130 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T12:37:20.131 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-12T12:37:20.147 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-12T12:37:20.148 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/thrasher.py", line 47, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-12T12:37:20.149 INFO:tasks.fwd_scrub:done joining 2024-09-12T12:37:20.150 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-12T12:37:20.159 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:37:20.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.358+0000 7fc5ead86640 1 -- 172.21.15.33:0/3821208013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5e4104fa0 msgr2=0x7fc5e4107390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:20.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.358+0000 7fc5ead86640 1 --2- 172.21.15.33:0/3821208013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5e4104fa0 0x7fc5e4107390 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8009900 tx=0x7fc5d802a410 comp rx=0 tx=0).stop 2024-09-12T12:37:20.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.358+0000 7fc5ead86640 1 -- 172.21.15.33:0/3821208013 shutdown_connections 2024-09-12T12:37:20.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.358+0000 7fc5ead86640 1 --2- 172.21.15.33:0/3821208013 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5e41078d0 0x7fc5e4109cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:20.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.358+0000 7fc5ead86640 1 --2- 172.21.15.33:0/3821208013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5e4104fa0 0x7fc5e4107390 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:20.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.358+0000 7fc5ead86640 1 --2- 172.21.15.33:0/3821208013 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5e4102670 0x7fc5e4104a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:20.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.358+0000 7fc5ead86640 1 -- 172.21.15.33:0/3821208013 >> 172.21.15.33:0/3821208013 conn(0x7fc5e40fc1b0 msgr2=0x7fc5e40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:37:20.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.358+0000 7fc5ead86640 1 -- 172.21.15.33:0/3821208013 shutdown_connections 2024-09-12T12:37:20.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.358+0000 7fc5ead86640 1 -- 172.21.15.33:0/3821208013 wait complete. 2024-09-12T12:37:20.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.358+0000 7fc5ead86640 1 Processor -- start 2024-09-12T12:37:20.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.359+0000 7fc5ead86640 1 -- start start 2024-09-12T12:37:20.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.359+0000 7fc5ead86640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5e4102670 0x7fc5e4197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:20.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.359+0000 7fc5ead86640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5e4104fa0 0x7fc5e41983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:20.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.359+0000 7fc5ead86640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5e41078d0 0x7fc5e419f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:20.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.359+0000 7fc5ead86640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e410d6c0 con 0x7fc5e4104fa0 2024-09-12T12:37:20.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.359+0000 7fc5ead86640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e410d540 con 0x7fc5e4102670 2024-09-12T12:37:20.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.359+0000 7fc5ead86640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e410d840 con 0x7fc5e41078d0 2024-09-12T12:37:20.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.359+0000 7fc5e3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5e4104fa0 0x7fc5e41983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:20.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.359+0000 7fc5e3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5e4104fa0 0x7fc5e41983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37198/0 (socket says 172.21.15.33:37198) 2024-09-12T12:37:20.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.359+0000 7fc5e3fff640 1 -- 172.21.15.33:0/3324026506 learned_addr learned my addr 172.21.15.33:0/3324026506 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:37:20.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.359+0000 7fc5e8b22640 1 --2- 172.21.15.33:0/3324026506 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5e4102670 0x7fc5e4197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:20.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.359+0000 7fc5e9323640 1 --2- 172.21.15.33:0/3324026506 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5e41078d0 0x7fc5e419f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:20.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.359+0000 7fc5e3fff640 1 -- 172.21.15.33:0/3324026506 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5e41078d0 msgr2=0x7fc5e419f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:20.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.359+0000 7fc5e3fff640 1 --2- 172.21.15.33:0/3324026506 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5e41078d0 0x7fc5e419f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:20.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.359+0000 7fc5e3fff640 1 -- 172.21.15.33:0/3324026506 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5e4102670 msgr2=0x7fc5e4197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:20.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.359+0000 7fc5e3fff640 1 --2- 172.21.15.33:0/3324026506 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5e4102670 0x7fc5e4197e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:20.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.359+0000 7fc5e3fff640 1 -- 172.21.15.33:0/3324026506 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5e419faa0 con 0x7fc5e4104fa0 2024-09-12T12:37:20.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.359+0000 7fc5e3fff640 1 --2- 172.21.15.33:0/3324026506 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5e4104fa0 0x7fc5e41983c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fc5d80314e0 tx=0x7fc5d80042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:37:20.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.360+0000 7fc5e1ffb640 1 -- 172.21.15.33:0/3324026506 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d803f030 con 0x7fc5e4104fa0 2024-09-12T12:37:20.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.360+0000 7fc5e1ffb640 1 -- 172.21.15.33:0/3324026506 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc5d8003cb0 con 0x7fc5e4104fa0 2024-09-12T12:37:20.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.360+0000 7fc5ead86640 1 -- 172.21.15.33:0/3324026506 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5e419fd30 con 0x7fc5e4104fa0 2024-09-12T12:37:20.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.360+0000 7fc5e1ffb640 1 -- 172.21.15.33:0/3324026506 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d8035070 con 0x7fc5e4104fa0 2024-09-12T12:37:20.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.360+0000 7fc5ead86640 1 -- 172.21.15.33:0/3324026506 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5e41a0250 con 0x7fc5e4104fa0 2024-09-12T12:37:20.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.361+0000 7fc5ead86640 1 -- 172.21.15.33:0/3324026506 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5e40fdca0 con 0x7fc5e4104fa0 2024-09-12T12:37:20.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.362+0000 7fc5e1ffb640 1 -- 172.21.15.33:0/3324026506 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc5d8042030 con 0x7fc5e4104fa0 2024-09-12T12:37:20.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.363+0000 7fc5e1ffb640 1 --2- 172.21.15.33:0/3324026506 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc5cc0a2b90 0x7fc5cc0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:20.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.363+0000 7fc5e8b22640 1 --2- 172.21.15.33:0/3324026506 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc5cc0a2b90 0x7fc5cc0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:20.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.363+0000 7fc5e1ffb640 1 -- 172.21.15.33:0/3324026506 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fc5d80efd50 con 0x7fc5e4104fa0 2024-09-12T12:37:20.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.363+0000 7fc5e8b22640 1 --2- 172.21.15.33:0/3324026506 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc5cc0a2b90 0x7fc5cc0a5050 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc5d400bbe0 tx=0x7fc5d400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:37:20.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.366+0000 7fc5e1ffb640 1 -- 172.21.15.33:0/3324026506 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc5d80bc2d0 con 0x7fc5e4104fa0 2024-09-12T12:37:20.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.546+0000 7fc5ead86640 1 -- 172.21.15.33:0/3324026506 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc5e402d9c0 con 0x7fc5e4104fa0 2024-09-12T12:37:20.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.548+0000 7fc5e1ffb640 1 -- 172.21.15.33:0/3324026506 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24763 (secure 0 0 0) 0x7fc5d80c05d0 con 0x7fc5e4104fa0 2024-09-12T12:37:20.548 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:37:20.548 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":89,"fsid":"a66dfafc-7100-11ef-bcea-c7b262605968","created":"2024-09-12T12:16:11.904815+0000","modified":"2024-09-12T12:25:59.801807+0000","last_up_change":"2024-09-12T12:22:57.476185+0000","last_in_change":"2024-09-12T12:22:35.192556+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:19:12.296305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:23:42.509774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:23:44.842852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T12:23:51.308720+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"74b68729-c97c-4da6-a659-75d6c147ad05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6803","nonce":963294466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6805","nonce":963294466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6809","nonce":963294466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6807","nonce":963294466}]},"public_addr":"172.21.15.33:6803/963294466","cluster_addr":"172.21.15.33:6805/963294466","heartbeat_back_addr":"172.21.15.33:6809/963294466","heartbeat_front_addr":"172.21.15.33:6807/963294466","state":["exists","up"]},{"osd":1,"uuid":"2461a388-e110-420b-9404-eb54cd39119e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6801","nonce":2306025171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6803","nonce":2306025171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6807","nonce":2306025171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6805","nonce":2306025171}]},"public_addr":"172.21.15.43:6801/2306025171","cluster_addr":"172.21.15.43:6803/2306025171","heartbeat_back_addr":"172.21.15.43:6807/2306025171","heartbeat_front_addr":"172.21.15.43:6805/2306025171","state":["exists","up"]},{"osd":2,"uuid":"4ba9dd02-977d-45fb-b366-ade15b52232b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6801","nonce":4257223217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6803","nonce":4257223217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6807","nonce":4257223217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6805","nonce":4257223217}]},"public_addr":"172.21.15.102:6801/4257223217","cluster_addr":"172.21.15.102:6803/4257223217","heartbeat_back_addr":"172.21.15.102:6807/4257223217","heartbeat_front_addr":"172.21.15.102:6805/4257223217","state":["exists","up"]},{"osd":3,"uuid":"345aa854-9ea2-4103-a186-9794af34c237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6811","nonce":2483872739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6813","nonce":2483872739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6817","nonce":2483872739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6815","nonce":2483872739}]},"public_addr":"172.21.15.33:6811/2483872739","cluster_addr":"172.21.15.33:6813/2483872739","heartbeat_back_addr":"172.21.15.33:6817/2483872739","heartbeat_front_addr":"172.21.15.33:6815/2483872739","state":["exists","up"]},{"osd":4,"uuid":"32acd6da-01d6-4a8e-9d05-3d394363d6f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6809","nonce":136043101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6811","nonce":136043101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6815","nonce":136043101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6813","nonce":136043101}]},"public_addr":"172.21.15.43:6809/136043101","cluster_addr":"172.21.15.43:6811/136043101","heartbeat_back_addr":"172.21.15.43:6815/136043101","heartbeat_front_addr":"172.21.15.43:6813/136043101","state":["exists","up"]},{"osd":5,"uuid":"dced0037-2da2-48c2-a391-f871d6ceebb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6809","nonce":2605625792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6811","nonce":2605625792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6815","nonce":2605625792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6813","nonce":2605625792}]},"public_addr":"172.21.15.102:6809/2605625792","cluster_addr":"172.21.15.102:6811/2605625792","heartbeat_back_addr":"172.21.15.102:6815/2605625792","heartbeat_front_addr":"172.21.15.102:6813/2605625792","state":["exists","up"]},{"osd":6,"uuid":"46e5532e-026a-4bb2-8847-2a3216e5d7a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6819","nonce":805864618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6821","nonce":805864618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6825","nonce":805864618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6823","nonce":805864618}]},"public_addr":"172.21.15.33:6819/805864618","cluster_addr":"172.21.15.33:6821/805864618","heartbeat_back_addr":"172.21.15.33:6825/805864618","heartbeat_front_addr":"172.21.15.33:6823/805864618","state":["exists","up"]},{"osd":7,"uuid":"c8474ab4-68cd-4475-9429-b54981247ee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6817","nonce":392537201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6819","nonce":392537201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6823","nonce":392537201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6821","nonce":392537201}]},"public_addr":"172.21.15.43:6817/392537201","cluster_addr":"172.21.15.43:6819/392537201","heartbeat_back_addr":"172.21.15.43:6823/392537201","heartbeat_front_addr":"172.21.15.43:6821/392537201","state":["exists","up"]},{"osd":8,"uuid":"e7c2ef28-8c84-44d0-ba6d-7556ec1d02dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6817","nonce":1768219597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6819","nonce":1768219597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6823","nonce":1768219597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6821","nonce":1768219597}]},"public_addr":"172.21.15.102:6817/1768219597","cluster_addr":"172.21.15.102:6819/1768219597","heartbeat_back_addr":"172.21.15.102:6823/1768219597","heartbeat_front_addr":"172.21.15.102:6821/1768219597","state":["exists","up"]},{"osd":9,"uuid":"f2500273-8b21-4984-bc41-cec5cc0c883b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6827","nonce":973136168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6829","nonce":973136168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6833","nonce":973136168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6831","nonce":973136168}]},"public_addr":"172.21.15.33:6827/973136168","cluster_addr":"172.21.15.33:6829/973136168","heartbeat_back_addr":"172.21.15.33:6833/973136168","heartbeat_front_addr":"172.21.15.33:6831/973136168","state":["exists","up"]},{"osd":10,"uuid":"954343c5-5d5b-4c30-acde-82aa695f7b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6825","nonce":248515585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6827","nonce":248515585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6831","nonce":248515585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6829","nonce":248515585}]},"public_addr":"172.21.15.43:6825/248515585","cluster_addr":"172.21.15.43:6827/248515585","heartbeat_back_addr":"172.21.15.43:6831/248515585","heartbeat_front_addr":"172.21.15.43:6829/248515585","state":["exists","up"]},{"osd":11,"uuid":"22b4147b-02ad-4514-be17-5bb395099eef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6825","nonce":2463068013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6827","nonce":2463068013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6831","nonce":2463068013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6829","nonce":2463068013}]},"public_addr":"172.21.15.102:6825/2463068013","cluster_addr":"172.21.15.102:6827/2463068013","heartbeat_back_addr":"172.21.15.102:6831/2463068013","heartbeat_front_addr":"172.21.15.102:6829/2463068013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:19.274804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:44.900294+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:08.885404+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:34.382089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:59.978538+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:25.275179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:49.429847+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:14.974792+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:40.268629+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:22:06.458679+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:22:31.813019+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:22:56.264078+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/3187741548":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6800/1381479235":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6801/1156183797":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/2222991013":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6801/1381479235":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6800/1156183797":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/3450458842":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/202580320":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/2441151017":"2024-09-13T12:16:57.792813+0000","172.21.15.33:0/1001176884":"2024-09-13T12:16:33.559150+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:37:20.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.550+0000 7fc5ead86640 1 -- 172.21.15.33:0/3324026506 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc5cc0a2b90 msgr2=0x7fc5cc0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:20.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.550+0000 7fc5ead86640 1 --2- 172.21.15.33:0/3324026506 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc5cc0a2b90 0x7fc5cc0a5050 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc5d400bbe0 tx=0x7fc5d400b390 comp rx=0 tx=0).stop 2024-09-12T12:37:20.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.550+0000 7fc5ead86640 1 -- 172.21.15.33:0/3324026506 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5e4104fa0 msgr2=0x7fc5e41983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:20.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.550+0000 7fc5ead86640 1 --2- 172.21.15.33:0/3324026506 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5e4104fa0 0x7fc5e41983c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fc5d80314e0 tx=0x7fc5d80042e0 comp rx=0 tx=0).stop 2024-09-12T12:37:20.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.550+0000 7fc5ead86640 1 -- 172.21.15.33:0/3324026506 shutdown_connections 2024-09-12T12:37:20.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.550+0000 7fc5ead86640 1 --2- 172.21.15.33:0/3324026506 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fc5cc0a2b90 0x7fc5cc0a5050 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:20.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.550+0000 7fc5ead86640 1 --2- 172.21.15.33:0/3324026506 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5e41078d0 0x7fc5e419f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:20.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.550+0000 7fc5ead86640 1 --2- 172.21.15.33:0/3324026506 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5e4104fa0 0x7fc5e41983c0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:20.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.550+0000 7fc5ead86640 1 --2- 172.21.15.33:0/3324026506 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5e4102670 0x7fc5e4197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:20.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.550+0000 7fc5ead86640 1 -- 172.21.15.33:0/3324026506 >> 172.21.15.33:0/3324026506 conn(0x7fc5e40fc1b0 msgr2=0x7fc5e4103030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:37:20.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.550+0000 7fc5ead86640 1 -- 172.21.15.33:0/3324026506 shutdown_connections 2024-09-12T12:37:20.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.550+0000 7fc5ead86640 1 -- 172.21.15.33:0/3324026506 wait complete. 2024-09-12T12:37:20.562 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T12:19:12.296305+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T12:23:42.509774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T12:23:44.842852+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-12T12:23:51.308720+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-12T12:37:20.563 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T12:37:20.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.670+0000 7f0c3e99f640 1 -- 172.21.15.33:0/390201771 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c381025b0 msgr2=0x7f0c381049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:20.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.670+0000 7f0c3e99f640 1 --2- 172.21.15.33:0/390201771 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c381025b0 0x7f0c381049a0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f0c28009900 tx=0x7f0c2802a410 comp rx=0 tx=0).stop 2024-09-12T12:37:20.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.670+0000 7f0c3e99f640 1 -- 172.21.15.33:0/390201771 shutdown_connections 2024-09-12T12:37:20.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.670+0000 7f0c3e99f640 1 --2- 172.21.15.33:0/390201771 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c38107810 0x7f0c38109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:20.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.670+0000 7f0c3e99f640 1 --2- 172.21.15.33:0/390201771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c38104ee0 0x7f0c381072d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:20.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.670+0000 7f0c3e99f640 1 --2- 172.21.15.33:0/390201771 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c381025b0 0x7f0c381049a0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:20.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.670+0000 7f0c3e99f640 1 -- 172.21.15.33:0/390201771 >> 172.21.15.33:0/390201771 conn(0x7f0c380fc1b0 msgr2=0x7f0c380fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:37:20.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.670+0000 7f0c3e99f640 1 -- 172.21.15.33:0/390201771 shutdown_connections 2024-09-12T12:37:20.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.670+0000 7f0c3e99f640 1 -- 172.21.15.33:0/390201771 wait complete. 2024-09-12T12:37:20.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.671+0000 7f0c3e99f640 1 Processor -- start 2024-09-12T12:37:20.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.671+0000 7f0c3e99f640 1 -- start start 2024-09-12T12:37:20.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.671+0000 7f0c3e99f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c381025b0 0x7f0c38197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:20.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.671+0000 7f0c3e99f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c38104ee0 0x7f0c381983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:20.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.671+0000 7f0c3e99f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c38107810 0x7f0c3819f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:20.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.671+0000 7f0c3e99f640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0c3810d6a0 con 0x7f0c38107810 2024-09-12T12:37:20.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.671+0000 7f0c3e99f640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0c3810d520 con 0x7f0c38104ee0 2024-09-12T12:37:20.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.671+0000 7f0c3e99f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0c3810d820 con 0x7f0c381025b0 2024-09-12T12:37:20.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.671+0000 7f0c3cf3c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c38107810 0x7f0c3819f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:20.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.671+0000 7f0c3cf3c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c38107810 0x7f0c3819f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58124/0 (socket says 172.21.15.33:58124) 2024-09-12T12:37:20.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.671+0000 7f0c3cf3c640 1 -- 172.21.15.33:0/2452259361 learned_addr learned my addr 172.21.15.33:0/2452259361 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:37:20.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.671+0000 7f0c37fff640 1 --2- 172.21.15.33:0/2452259361 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c381025b0 0x7f0c38197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:20.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.671+0000 7f0c377fe640 1 --2- 172.21.15.33:0/2452259361 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c38104ee0 0x7f0c381983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:20.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.672+0000 7f0c3cf3c640 1 -- 172.21.15.33:0/2452259361 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c381025b0 msgr2=0x7f0c38197eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:20.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.672+0000 7f0c3cf3c640 1 --2- 172.21.15.33:0/2452259361 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c381025b0 0x7f0c38197eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:20.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.672+0000 7f0c3cf3c640 1 -- 172.21.15.33:0/2452259361 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c38104ee0 msgr2=0x7f0c381983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:20.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.672+0000 7f0c3cf3c640 1 --2- 172.21.15.33:0/2452259361 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c38104ee0 0x7f0c381983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:20.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.672+0000 7f0c3cf3c640 1 -- 172.21.15.33:0/2452259361 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c3819fad0 con 0x7f0c38107810 2024-09-12T12:37:20.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.672+0000 7f0c3cf3c640 1 --2- 172.21.15.33:0/2452259361 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c38107810 0x7f0c3819f460 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f0c3000cab0 tx=0x7f0c3000cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:37:20.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.672+0000 7f0c357fa640 1 -- 172.21.15.33:0/2452259361 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3000ae20 con 0x7f0c38107810 2024-09-12T12:37:20.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.672+0000 7f0c357fa640 1 -- 172.21.15.33:0/2452259361 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0c3000f900 con 0x7f0c38107810 2024-09-12T12:37:20.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.672+0000 7f0c357fa640 1 -- 172.21.15.33:0/2452259361 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c300189f0 con 0x7f0c38107810 2024-09-12T12:37:20.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.672+0000 7f0c3e99f640 1 -- 172.21.15.33:0/2452259361 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c3819fdc0 con 0x7f0c38107810 2024-09-12T12:37:20.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.672+0000 7f0c3e99f640 1 -- 172.21.15.33:0/2452259361 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c381a0280 con 0x7f0c38107810 2024-09-12T12:37:20.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.673+0000 7f0c3e99f640 1 -- 172.21.15.33:0/2452259361 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c380fdca0 con 0x7f0c38107810 2024-09-12T12:37:20.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.674+0000 7f0c357fa640 1 -- 172.21.15.33:0/2452259361 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0c3000fab0 con 0x7f0c38107810 2024-09-12T12:37:20.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.675+0000 7f0c357fa640 1 --2- 172.21.15.33:0/2452259361 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0c200a2c10 0x7f0c200a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:20.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.675+0000 7f0c37fff640 1 --2- 172.21.15.33:0/2452259361 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0c200a2c10 0x7f0c200a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:20.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.675+0000 7f0c357fa640 1 -- 172.21.15.33:0/2452259361 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f0c300cfd00 con 0x7f0c38107810 2024-09-12T12:37:20.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.675+0000 7f0c37fff640 1 --2- 172.21.15.33:0/2452259361 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0c200a2c10 0x7f0c200a50d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0c280314e0 tx=0x7f0c28005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:37:20.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.678+0000 7f0c357fa640 1 -- 172.21.15.33:0/2452259361 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0c30014030 con 0x7f0c38107810 2024-09-12T12:37:20.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.852+0000 7f0c3e99f640 1 -- 172.21.15.33:0/2452259361 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0c38062e90 con 0x7f0c38107810 2024-09-12T12:37:20.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.852+0000 7f0c357fa640 1 -- 172.21.15.33:0/2452259361 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) ==== 93+0+10 (secure 0 0 0) 0x7f0c3009c980 con 0x7f0c38107810 2024-09-12T12:37:20.853 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-12T12:37:20.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.854+0000 7f0c3e99f640 1 -- 172.21.15.33:0/2452259361 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0c200a2c10 msgr2=0x7f0c200a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:20.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.854+0000 7f0c3e99f640 1 --2- 172.21.15.33:0/2452259361 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0c200a2c10 0x7f0c200a50d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0c280314e0 tx=0x7f0c28005b50 comp rx=0 tx=0).stop 2024-09-12T12:37:20.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.854+0000 7f0c3e99f640 1 -- 172.21.15.33:0/2452259361 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c38107810 msgr2=0x7f0c3819f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:20.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.854+0000 7f0c3e99f640 1 --2- 172.21.15.33:0/2452259361 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c38107810 0x7f0c3819f460 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f0c3000cab0 tx=0x7f0c3000cf70 comp rx=0 tx=0).stop 2024-09-12T12:37:20.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.855+0000 7f0c3e99f640 1 -- 172.21.15.33:0/2452259361 shutdown_connections 2024-09-12T12:37:20.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.855+0000 7f0c3e99f640 1 --2- 172.21.15.33:0/2452259361 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f0c200a2c10 0x7f0c200a50d0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:20.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.855+0000 7f0c3e99f640 1 --2- 172.21.15.33:0/2452259361 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c38107810 0x7f0c3819f460 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:20.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.855+0000 7f0c3e99f640 1 --2- 172.21.15.33:0/2452259361 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c38104ee0 0x7f0c381983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:20.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.855+0000 7f0c3e99f640 1 --2- 172.21.15.33:0/2452259361 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c381025b0 0x7f0c38197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:20.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.855+0000 7f0c3e99f640 1 -- 172.21.15.33:0/2452259361 >> 172.21.15.33:0/2452259361 conn(0x7f0c380fc1b0 msgr2=0x7f0c38102e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:37:20.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.855+0000 7f0c3e99f640 1 -- 172.21.15.33:0/2452259361 shutdown_connections 2024-09-12T12:37:20.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.855+0000 7f0c3e99f640 1 -- 172.21.15.33:0/2452259361 wait complete. 2024-09-12T12:37:20.866 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-12T12:37:20.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.974+0000 7fd3055cd640 1 -- 172.21.15.33:0/1605608146 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3001025b0 msgr2=0x7fd300108e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:20.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.974+0000 7fd3055cd640 1 --2- 172.21.15.33:0/1605608146 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3001025b0 0x7fd300108e40 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fd2f8009900 tx=0x7fd2f802a410 comp rx=0 tx=0).stop 2024-09-12T12:37:20.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.974+0000 7fd3055cd640 1 -- 172.21.15.33:0/1605608146 shutdown_connections 2024-09-12T12:37:20.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.974+0000 7fd3055cd640 1 --2- 172.21.15.33:0/1605608146 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3001025b0 0x7fd300108e40 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:20.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.974+0000 7fd3055cd640 1 --2- 172.21.15.33:0/1605608146 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd300101bf0 0x7fd300102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:20.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.974+0000 7fd3055cd640 1 --2- 172.21.15.33:0/1605608146 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd300100a00 0x7fd300100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:20.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.974+0000 7fd3055cd640 1 -- 172.21.15.33:0/1605608146 >> 172.21.15.33:0/1605608146 conn(0x7fd3000fc140 msgr2=0x7fd3000fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:37:20.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.974+0000 7fd3055cd640 1 -- 172.21.15.33:0/1605608146 shutdown_connections 2024-09-12T12:37:20.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.974+0000 7fd3055cd640 1 -- 172.21.15.33:0/1605608146 wait complete. 2024-09-12T12:37:20.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.975+0000 7fd3055cd640 1 Processor -- start 2024-09-12T12:37:20.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.975+0000 7fd3055cd640 1 -- start start 2024-09-12T12:37:20.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.975+0000 7fd3055cd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd300100a00 0x7fd300197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:20.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.975+0000 7fd3055cd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd300101bf0 0x7fd300198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:20.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.975+0000 7fd3055cd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3001025b0 0x7fd30019f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:20.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.975+0000 7fd3055cd640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd30010c590 con 0x7fd300101bf0 2024-09-12T12:37:20.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.975+0000 7fd3055cd640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd30010c410 con 0x7fd3001025b0 2024-09-12T12:37:20.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.975+0000 7fd3055cd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd30010c710 con 0x7fd300100a00 2024-09-12T12:37:20.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.975+0000 7fd2fe7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd300101bf0 0x7fd300198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:20.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.975+0000 7fd2fe7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd300101bf0 0x7fd300198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58152/0 (socket says 172.21.15.33:58152) 2024-09-12T12:37:20.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.975+0000 7fd2fe7fc640 1 -- 172.21.15.33:0/2503195864 learned_addr learned my addr 172.21.15.33:0/2503195864 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:37:20.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.975+0000 7fd2feffd640 1 --2- 172.21.15.33:0/2503195864 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd300100a00 0x7fd300197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:20.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.975+0000 7fd2ff7fe640 1 --2- 172.21.15.33:0/2503195864 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3001025b0 0x7fd30019f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:20.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.976+0000 7fd2fe7fc640 1 -- 172.21.15.33:0/2503195864 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd300100a00 msgr2=0x7fd300197e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:20.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.976+0000 7fd2fe7fc640 1 --2- 172.21.15.33:0/2503195864 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd300100a00 0x7fd300197e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:20.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.976+0000 7fd2fe7fc640 1 -- 172.21.15.33:0/2503195864 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3001025b0 msgr2=0x7fd30019f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:20.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.976+0000 7fd2fe7fc640 1 --2- 172.21.15.33:0/2503195864 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3001025b0 0x7fd30019f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:20.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.976+0000 7fd2fe7fc640 1 -- 172.21.15.33:0/2503195864 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd30019fa20 con 0x7fd300101bf0 2024-09-12T12:37:20.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.976+0000 7fd2fe7fc640 1 --2- 172.21.15.33:0/2503195864 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd300101bf0 0x7fd300198340 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fd2e800b4a0 tx=0x7fd2e800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:37:20.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.976+0000 7fd2f7fff640 1 -- 172.21.15.33:0/2503195864 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8014070 con 0x7fd300101bf0 2024-09-12T12:37:20.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.976+0000 7fd3055cd640 1 -- 172.21.15.33:0/2503195864 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd30019fd10 con 0x7fd300101bf0 2024-09-12T12:37:20.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.976+0000 7fd2f7fff640 1 -- 172.21.15.33:0/2503195864 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd2e8010ac0 con 0x7fd300101bf0 2024-09-12T12:37:20.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.976+0000 7fd2f7fff640 1 -- 172.21.15.33:0/2503195864 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8017c30 con 0x7fd300101bf0 2024-09-12T12:37:20.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.976+0000 7fd3055cd640 1 -- 172.21.15.33:0/2503195864 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3001a0280 con 0x7fd300101bf0 2024-09-12T12:37:20.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.977+0000 7fd3055cd640 1 -- 172.21.15.33:0/2503195864 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3001a0510 con 0x7fd300101bf0 2024-09-12T12:37:20.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.978+0000 7fd2f7fff640 1 -- 172.21.15.33:0/2503195864 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd2e8017070 con 0x7fd300101bf0 2024-09-12T12:37:20.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.979+0000 7fd2f7fff640 1 --2- 172.21.15.33:0/2503195864 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd2ec0a2b90 0x7fd2ec0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:20.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.979+0000 7fd2f7fff640 1 -- 172.21.15.33:0/2503195864 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fd2e80ce9f0 con 0x7fd300101bf0 2024-09-12T12:37:20.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.979+0000 7fd2feffd640 1 --2- 172.21.15.33:0/2503195864 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd2ec0a2b90 0x7fd2ec0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:20.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.979+0000 7fd2feffd640 1 --2- 172.21.15.33:0/2503195864 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd2ec0a2b90 0x7fd2ec0a5050 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd300101a50 tx=0x7fd2f0009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:37:20.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:20.982+0000 7fd2f7fff640 1 -- 172.21.15.33:0/2503195864 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd2e809af70 con 0x7fd300101bf0 2024-09-12T12:37:21.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.163+0000 7fd3055cd640 1 -- 172.21.15.33:0/2503195864 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd3001a06e0 con 0x7fd300101bf0 2024-09-12T12:37:21.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.163+0000 7fd2f7fff640 1 -- 172.21.15.33:0/2503195864 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) ==== 104+0+11 (secure 0 0 0) 0x7fd2e809f270 con 0x7fd300101bf0 2024-09-12T12:37:21.163 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-09-12T12:37:21.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.165+0000 7fd3055cd640 1 -- 172.21.15.33:0/2503195864 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd2ec0a2b90 msgr2=0x7fd2ec0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:21.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.165+0000 7fd3055cd640 1 --2- 172.21.15.33:0/2503195864 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd2ec0a2b90 0x7fd2ec0a5050 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd300101a50 tx=0x7fd2f0009500 comp rx=0 tx=0).stop 2024-09-12T12:37:21.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.165+0000 7fd3055cd640 1 -- 172.21.15.33:0/2503195864 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd300101bf0 msgr2=0x7fd300198340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:21.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.165+0000 7fd3055cd640 1 --2- 172.21.15.33:0/2503195864 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd300101bf0 0x7fd300198340 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fd2e800b4a0 tx=0x7fd2e800b960 comp rx=0 tx=0).stop 2024-09-12T12:37:21.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.165+0000 7fd3055cd640 1 -- 172.21.15.33:0/2503195864 shutdown_connections 2024-09-12T12:37:21.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.165+0000 7fd3055cd640 1 --2- 172.21.15.33:0/2503195864 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fd2ec0a2b90 0x7fd2ec0a5050 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:21.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.165+0000 7fd3055cd640 1 --2- 172.21.15.33:0/2503195864 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3001025b0 0x7fd30019f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:21.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.165+0000 7fd3055cd640 1 --2- 172.21.15.33:0/2503195864 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd300101bf0 0x7fd300198340 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:21.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.165+0000 7fd3055cd640 1 --2- 172.21.15.33:0/2503195864 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd300100a00 0x7fd300197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:21.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.165+0000 7fd3055cd640 1 -- 172.21.15.33:0/2503195864 >> 172.21.15.33:0/2503195864 conn(0x7fd3000fc140 msgr2=0x7fd3000693d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:37:21.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.165+0000 7fd3055cd640 1 -- 172.21.15.33:0/2503195864 shutdown_connections 2024-09-12T12:37:21.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.165+0000 7fd3055cd640 1 -- 172.21.15.33:0/2503195864 wait complete. 2024-09-12T12:37:21.176 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-12T12:37:21.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.315+0000 7fdca9c2b640 1 -- 172.21.15.33:0/3278682817 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc9c0a6030 msgr2=0x7fdc9c0aa8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:21.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.315+0000 7fdca9c2b640 1 --2- 172.21.15.33:0/3278682817 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc9c0a6030 0x7fdc9c0aa8d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fdc90009900 tx=0x7fdc9002a4d0 comp rx=0 tx=0).stop 2024-09-12T12:37:21.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.320+0000 7fdca9c2b640 1 -- 172.21.15.33:0/3278682817 shutdown_connections 2024-09-12T12:37:21.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.320+0000 7fdca9c2b640 1 --2- 172.21.15.33:0/3278682817 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc9c0a6030 0x7fdc9c0aa8d0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:21.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.320+0000 7fdca9c2b640 1 --2- 172.21.15.33:0/3278682817 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdc9c0a5670 0x7fdc9c0a5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:21.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.320+0000 7fdca9c2b640 1 --2- 172.21.15.33:0/3278682817 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc9c0a4540 0x7fdc9c0a4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:21.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.320+0000 7fdca9c2b640 1 -- 172.21.15.33:0/3278682817 >> 172.21.15.33:0/3278682817 conn(0x7fdc9c09fba0 msgr2=0x7fdc9c0a2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:37:21.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.329+0000 7fdca9c2b640 1 -- 172.21.15.33:0/3278682817 shutdown_connections 2024-09-12T12:37:21.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.331+0000 7fdca9c2b640 1 -- 172.21.15.33:0/3278682817 wait complete. 2024-09-12T12:37:21.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.335+0000 7fdca9c2b640 1 Processor -- start 2024-09-12T12:37:21.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.336+0000 7fdca9c2b640 1 -- start start 2024-09-12T12:37:21.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.336+0000 7fdca9c2b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdc9c0a4540 0x7fdc9c142eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:21.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.336+0000 7fdca9c2b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc9c0a5670 0x7fdc9c1433f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:21.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.336+0000 7fdca9c2b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc9c0a6030 0x7fdc9c00b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:21.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.336+0000 7fdca9c2b640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fdc9c0b8840 con 0x7fdc9c0a6030 2024-09-12T12:37:21.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.336+0000 7fdca9c2b640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdc9c0b86c0 con 0x7fdc9c0a4540 2024-09-12T12:37:21.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.336+0000 7fdca9c2b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdc9c0b89c0 con 0x7fdc9c0a5670 2024-09-12T12:37:21.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.336+0000 7fdca8c29640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdc9c0a4540 0x7fdc9c142eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:21.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.336+0000 7fdca8c29640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdc9c0a4540 0x7fdc9c142eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:46546/0 (socket says 172.21.15.33:46546) 2024-09-12T12:37:21.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.336+0000 7fdca8c29640 1 -- 172.21.15.33:0/2630493556 learned_addr learned my addr 172.21.15.33:0/2630493556 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:37:21.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.336+0000 7fdca3fff640 1 --2- 172.21.15.33:0/2630493556 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc9c0a5670 0x7fdc9c1433f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:21.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.337+0000 7fdca8c29640 1 -- 172.21.15.33:0/2630493556 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc9c0a5670 msgr2=0x7fdc9c1433f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:21.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.337+0000 7fdca8c29640 1 --2- 172.21.15.33:0/2630493556 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc9c0a5670 0x7fdc9c1433f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:21.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.337+0000 7fdca8c29640 1 -- 172.21.15.33:0/2630493556 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc9c0a6030 msgr2=0x7fdc9c00b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:21.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.337+0000 7fdca8c29640 1 --2- 172.21.15.33:0/2630493556 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc9c0a6030 0x7fdc9c00b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:21.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.337+0000 7fdca8c29640 1 -- 172.21.15.33:0/2630493556 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc9c00be40 con 0x7fdc9c0a4540 2024-09-12T12:37:21.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.337+0000 7fdca8c29640 1 --2- 172.21.15.33:0/2630493556 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdc9c0a4540 0x7fdc9c142eb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdca4051070 tx=0x7fdca4070bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:37:21.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.338+0000 7fdca1ffb640 1 -- 172.21.15.33:0/2630493556 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca407a020 con 0x7fdc9c0a4540 2024-09-12T12:37:21.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.338+0000 7fdca1ffb640 1 -- 172.21.15.33:0/2630493556 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdca406ecc0 con 0x7fdc9c0a4540 2024-09-12T12:37:21.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.339+0000 7fdca1ffb640 1 -- 172.21.15.33:0/2630493556 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca4076cd0 con 0x7fdc9c0a4540 2024-09-12T12:37:21.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.340+0000 7fdca9c2b640 1 -- 172.21.15.33:0/2630493556 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc9c00c130 con 0x7fdc9c0a4540 2024-09-12T12:37:21.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.340+0000 7fdca9c2b640 1 -- 172.21.15.33:0/2630493556 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc9c00c6b0 con 0x7fdc9c0a4540 2024-09-12T12:37:21.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.344+0000 7fdca9c2b640 1 -- 172.21.15.33:0/2630493556 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc9c0a4940 con 0x7fdc9c0a4540 2024-09-12T12:37:21.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.347+0000 7fdca1ffb640 1 -- 172.21.15.33:0/2630493556 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fdca407d020 con 0x7fdc9c0a4540 2024-09-12T12:37:21.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.348+0000 7fdca1ffb640 1 --2- 172.21.15.33:0/2630493556 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fdc940a2c00 0x7fdc940a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:21.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.348+0000 7fdca1ffb640 1 -- 172.21.15.33:0/2630493556 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fdca4132590 con 0x7fdc9c0a4540 2024-09-12T12:37:21.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.352+0000 7fdca3fff640 1 --2- 172.21.15.33:0/2630493556 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fdc940a2c00 0x7fdc940a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:21.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.353+0000 7fdca3fff640 1 --2- 172.21.15.33:0/2630493556 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fdc940a2c00 0x7fdc940a50c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c143fd0 tx=0x7fdc98005c80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:37:21.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.355+0000 7fdca1ffb640 1 -- 172.21.15.33:0/2630493556 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdca4085250 con 0x7fdc9c0a4540 2024-09-12T12:37:21.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.712+0000 7fdca9c2b640 1 -- 172.21.15.33:0/2630493556 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fdc9c00d040 con 0x7fdc9c0a4540 2024-09-12T12:37:21.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.717+0000 7fdca1ffb640 1 -- 172.21.15.33:0/2630493556 <== mon.2 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) ==== 100+0+11 (secure 0 0 0) 0x7fdca40ff100 con 0x7fdc9c0a4540 2024-09-12T12:37:21.717 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-09-12T12:37:21.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.720+0000 7fdca9c2b640 1 -- 172.21.15.33:0/2630493556 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fdc940a2c00 msgr2=0x7fdc940a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:21.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.720+0000 7fdca9c2b640 1 --2- 172.21.15.33:0/2630493556 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fdc940a2c00 0x7fdc940a50c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c143fd0 tx=0x7fdc98005c80 comp rx=0 tx=0).stop 2024-09-12T12:37:21.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.720+0000 7fdca9c2b640 1 -- 172.21.15.33:0/2630493556 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdc9c0a4540 msgr2=0x7fdc9c142eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:21.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.720+0000 7fdca9c2b640 1 --2- 172.21.15.33:0/2630493556 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdc9c0a4540 0x7fdc9c142eb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdca4051070 tx=0x7fdca4070bb0 comp rx=0 tx=0).stop 2024-09-12T12:37:21.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.720+0000 7fdca9c2b640 1 -- 172.21.15.33:0/2630493556 shutdown_connections 2024-09-12T12:37:21.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.720+0000 7fdca9c2b640 1 --2- 172.21.15.33:0/2630493556 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fdc940a2c00 0x7fdc940a50c0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:21.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.720+0000 7fdca9c2b640 1 --2- 172.21.15.33:0/2630493556 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc9c0a6030 0x7fdc9c00b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:21.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.720+0000 7fdca9c2b640 1 --2- 172.21.15.33:0/2630493556 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc9c0a5670 0x7fdc9c1433f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:21.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.720+0000 7fdca9c2b640 1 --2- 172.21.15.33:0/2630493556 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdc9c0a4540 0x7fdc9c142eb0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:21.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.720+0000 7fdca9c2b640 1 -- 172.21.15.33:0/2630493556 >> 172.21.15.33:0/2630493556 conn(0x7fdc9c09fba0 msgr2=0x7fdc9c0a07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:37:21.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.722+0000 7fdca9c2b640 1 -- 172.21.15.33:0/2630493556 shutdown_connections 2024-09-12T12:37:21.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.722+0000 7fdca9c2b640 1 -- 172.21.15.33:0/2630493556 wait complete. 2024-09-12T12:37:21.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:21 smithi033 ceph-mon[31246]: pgmap v690: 129 pgs: 129 active+clean; 10 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 26 MiB/s wr, 484 op/s 2024-09-12T12:37:21.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:21 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/3324026506' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:37:21.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:21 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/2452259361' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T12:37:21.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:21 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/2503195864' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T12:37:21.740 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-12T12:37:21.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:21 smithi043 ceph-mon[34144]: pgmap v690: 129 pgs: 129 active+clean; 10 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 26 MiB/s wr, 484 op/s 2024-09-12T12:37:21.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:21 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/3324026506' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:37:21.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:21 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/2452259361' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T12:37:21.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:21 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/2503195864' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T12:37:21.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:21 smithi102 ceph-mon[34799]: pgmap v690: 129 pgs: 129 active+clean; 10 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 26 MiB/s wr, 484 op/s 2024-09-12T12:37:21.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:21 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/3324026506' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:37:21.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:21 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/2452259361' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T12:37:21.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:21 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/2503195864' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T12:37:21.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.929+0000 7f40909bc640 1 -- 172.21.15.33:0/327578483 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4084096120 msgr2=0x7f408409c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:21.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.929+0000 7f40909bc640 1 --2- 172.21.15.33:0/327578483 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4084096120 0x7f408409c9b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f407c01a910 tx=0x7f407c03d640 comp rx=0 tx=0).stop 2024-09-12T12:37:21.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.931+0000 7f40909bc640 1 -- 172.21.15.33:0/327578483 shutdown_connections 2024-09-12T12:37:21.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.931+0000 7f40909bc640 1 --2- 172.21.15.33:0/327578483 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4084096120 0x7f408409c9b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:21.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.931+0000 7f40909bc640 1 --2- 172.21.15.33:0/327578483 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4084095760 0x7f4084095be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:21.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.931+0000 7f40909bc640 1 --2- 172.21.15.33:0/327578483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4084094570 0x7f4084094970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:21.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.931+0000 7f40909bc640 1 -- 172.21.15.33:0/327578483 >> 172.21.15.33:0/327578483 conn(0x7f408408fcb0 msgr2=0x7f4084092110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:37:21.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.932+0000 7f40909bc640 1 -- 172.21.15.33:0/327578483 shutdown_connections 2024-09-12T12:37:21.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.932+0000 7f40909bc640 1 -- 172.21.15.33:0/327578483 wait complete. 2024-09-12T12:37:21.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.933+0000 7f40909bc640 1 Processor -- start 2024-09-12T12:37:21.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.934+0000 7f40909bc640 1 -- start start 2024-09-12T12:37:21.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.935+0000 7f40909bc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4084094570 0x7f40841297b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:21.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.935+0000 7f40909bc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4084095760 0x7f4084129cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:21.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.935+0000 7f40909bc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4084096120 0x7f4084141fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:21.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.935+0000 7f40909bc640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f408409f0c0 con 0x7f4084095760 2024-09-12T12:37:21.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.935+0000 7f40909bc640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f408409ef40 con 0x7f4084096120 2024-09-12T12:37:21.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.935+0000 7f40909bc640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f408409f240 con 0x7f4084094570 2024-09-12T12:37:21.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.935+0000 7f408b59e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4084096120 0x7f4084141fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:21.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.935+0000 7f408b59e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4084096120 0x7f4084141fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.33:46568/0 (socket says 172.21.15.33:46568) 2024-09-12T12:37:21.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.935+0000 7f408b59e640 1 -- 172.21.15.33:0/3608125951 learned_addr learned my addr 172.21.15.33:0/3608125951 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:37:21.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.935+0000 7f408ad9d640 1 --2- 172.21.15.33:0/3608125951 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4084094570 0x7f40841297b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:21.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.936+0000 7f408b59e640 1 -- 172.21.15.33:0/3608125951 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4084094570 msgr2=0x7f40841297b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:21.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.936+0000 7f408b59e640 1 --2- 172.21.15.33:0/3608125951 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4084094570 0x7f40841297b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:21.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.936+0000 7f408b59e640 1 -- 172.21.15.33:0/3608125951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4084095760 msgr2=0x7f4084129cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:21.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.936+0000 7f408b59e640 1 --2- 172.21.15.33:0/3608125951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4084095760 0x7f4084129cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:21.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.936+0000 7f408b59e640 1 -- 172.21.15.33:0/3608125951 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4084142520 con 0x7f4084096120 2024-09-12T12:37:21.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.936+0000 7f408b59e640 1 --2- 172.21.15.33:0/3608125951 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4084096120 0x7f4084141fe0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f407c0054a0 tx=0x7f407c0048f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:37:21.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.939+0000 7f4073fff640 1 -- 172.21.15.33:0/3608125951 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407c050020 con 0x7f4084096120 2024-09-12T12:37:21.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.939+0000 7f4073fff640 1 -- 172.21.15.33:0/3608125951 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f407c0429c0 con 0x7f4084096120 2024-09-12T12:37:21.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.939+0000 7f4073fff640 1 -- 172.21.15.33:0/3608125951 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407c048030 con 0x7f4084096120 2024-09-12T12:37:21.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.940+0000 7f40909bc640 1 -- 172.21.15.33:0/3608125951 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40841426f0 con 0x7f4084096120 2024-09-12T12:37:21.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.940+0000 7f40909bc640 1 -- 172.21.15.33:0/3608125951 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4084142b80 con 0x7f4084096120 2024-09-12T12:37:21.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.942+0000 7f40909bc640 1 -- 172.21.15.33:0/3608125951 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4084094950 con 0x7f4084096120 2024-09-12T12:37:21.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.955+0000 7f4073fff640 1 -- 172.21.15.33:0/3608125951 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f407c053020 con 0x7f4084096120 2024-09-12T12:37:21.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.956+0000 7f4073fff640 1 --2- 172.21.15.33:0/3608125951 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f40740a2d90 0x7f40740a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:21.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.956+0000 7f4073fff640 1 -- 172.21.15.33:0/3608125951 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f407c100d40 con 0x7f4084096120 2024-09-12T12:37:21.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.956+0000 7f4073fff640 1 -- 172.21.15.33:0/3608125951 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f407c05a070 con 0x7f4084096120 2024-09-12T12:37:21.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.957+0000 7f408ad9d640 1 --2- 172.21.15.33:0/3608125951 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f40740a2d90 0x7f40740a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:21.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:21.958+0000 7f408ad9d640 1 --2- 172.21.15.33:0/3608125951 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f40740a2d90 0x7f40740a5250 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4080006fd0 tx=0x7f4080008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:37:22.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.306+0000 7f40909bc640 1 -- 172.21.15.33:0/3608125951 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f4084002350 con 0x7f4084096120 2024-09-12T12:37:22.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.307+0000 7f4073fff640 1 -- 172.21.15.33:0/3608125951 <== mon.2 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v89) ==== 103+0+11 (secure 0 0 0) 0x7f407c0cd930 con 0x7f4084096120 2024-09-12T12:37:22.307 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-09-12T12:37:22.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.310+0000 7f40909bc640 1 -- 172.21.15.33:0/3608125951 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f40740a2d90 msgr2=0x7f40740a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:22.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.310+0000 7f40909bc640 1 --2- 172.21.15.33:0/3608125951 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f40740a2d90 0x7f40740a5250 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4080006fd0 tx=0x7f4080008040 comp rx=0 tx=0).stop 2024-09-12T12:37:22.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.310+0000 7f40909bc640 1 -- 172.21.15.33:0/3608125951 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4084096120 msgr2=0x7f4084141fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:22.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.310+0000 7f40909bc640 1 --2- 172.21.15.33:0/3608125951 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4084096120 0x7f4084141fe0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f407c0054a0 tx=0x7f407c0048f0 comp rx=0 tx=0).stop 2024-09-12T12:37:22.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.311+0000 7f40909bc640 1 -- 172.21.15.33:0/3608125951 shutdown_connections 2024-09-12T12:37:22.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.311+0000 7f40909bc640 1 --2- 172.21.15.33:0/3608125951 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f40740a2d90 0x7f40740a5250 secure :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4080006fd0 tx=0x7f4080008040 comp rx=0 tx=0).stop 2024-09-12T12:37:22.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.311+0000 7f40909bc640 1 --2- 172.21.15.33:0/3608125951 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4084096120 0x7f4084141fe0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:22.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.311+0000 7f40909bc640 1 --2- 172.21.15.33:0/3608125951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4084095760 0x7f4084129cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:22.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.311+0000 7f40909bc640 1 --2- 172.21.15.33:0/3608125951 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4084094570 0x7f40841297b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:22.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.311+0000 7f40909bc640 1 -- 172.21.15.33:0/3608125951 >> 172.21.15.33:0/3608125951 conn(0x7f408408fcb0 msgr2=0x7f4084098b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:37:22.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.311+0000 7f40909bc640 1 -- 172.21.15.33:0/3608125951 shutdown_connections 2024-09-12T12:37:22.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.311+0000 7f40909bc640 1 -- 172.21.15.33:0/3608125951 wait complete. 2024-09-12T12:37:22.329 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-12T12:37:22.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.522+0000 7f59b136d640 1 -- 172.21.15.33:0/2164892211 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59ac0734a0 msgr2=0x7f59ac0738a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:22.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.522+0000 7f59b136d640 1 --2- 172.21.15.33:0/2164892211 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59ac0734a0 0x7f59ac0738a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f59a401acb0 tx=0x7f59a403b900 comp rx=0 tx=0).stop 2024-09-12T12:37:22.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.522+0000 7f59b136d640 1 -- 172.21.15.33:0/2164892211 shutdown_connections 2024-09-12T12:37:22.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.522+0000 7f59b136d640 1 --2- 172.21.15.33:0/2164892211 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59ac109cb0 0x7f59ac119130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:22.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.522+0000 7f59b136d640 1 --2- 172.21.15.33:0/2164892211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59ac1092f0 0x7f59ac109770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:22.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.522+0000 7f59b136d640 1 --2- 172.21.15.33:0/2164892211 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59ac0734a0 0x7f59ac0738a0 secure :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f59a401acb0 tx=0x7f59a403b900 comp rx=0 tx=0).stop 2024-09-12T12:37:22.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.522+0000 7f59b136d640 1 -- 172.21.15.33:0/2164892211 >> 172.21.15.33:0/2164892211 conn(0x7f59ac06eb60 msgr2=0x7f59ac070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:37:22.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.523+0000 7f59b136d640 1 -- 172.21.15.33:0/2164892211 shutdown_connections 2024-09-12T12:37:22.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.525+0000 7f59b136d640 1 -- 172.21.15.33:0/2164892211 wait complete. 2024-09-12T12:37:22.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.525+0000 7f59b136d640 1 Processor -- start 2024-09-12T12:37:22.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.526+0000 7f59b136d640 1 -- start start 2024-09-12T12:37:22.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.526+0000 7f59b136d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59ac1092f0 0x7f59ac19e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:22.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.526+0000 7f59b136d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59ac109cb0 0x7f59ac19ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:22.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.526+0000 7f59b136d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59ac078440 0x7f59ac07a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:22.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.526+0000 7f59b136d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f59ac113490 con 0x7f59ac078440 2024-09-12T12:37:22.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.526+0000 7f59b136d640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f59ac113310 con 0x7f59ac109cb0 2024-09-12T12:37:22.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.526+0000 7f59b136d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f59ac113610 con 0x7f59ac1092f0 2024-09-12T12:37:22.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.526+0000 7f59ab7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59ac078440 0x7f59ac07a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:22.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.526+0000 7f59ab7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59ac078440 0x7f59ac07a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58214/0 (socket says 172.21.15.33:58214) 2024-09-12T12:37:22.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.526+0000 7f59ab7fe640 1 -- 172.21.15.33:0/2263704688 learned_addr learned my addr 172.21.15.33:0/2263704688 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:37:22.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.527+0000 7f59aaffd640 1 --2- 172.21.15.33:0/2263704688 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59ac1092f0 0x7f59ac19e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:22.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.527+0000 7f59aa7fc640 1 --2- 172.21.15.33:0/2263704688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59ac109cb0 0x7f59ac19ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:22.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.527+0000 7f59ab7fe640 1 -- 172.21.15.33:0/2263704688 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59ac1092f0 msgr2=0x7f59ac19e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:22.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.528+0000 7f59ab7fe640 1 --2- 172.21.15.33:0/2263704688 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59ac1092f0 0x7f59ac19e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:22.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.528+0000 7f59ab7fe640 1 -- 172.21.15.33:0/2263704688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59ac109cb0 msgr2=0x7f59ac19ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:22.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.528+0000 7f59ab7fe640 1 --2- 172.21.15.33:0/2263704688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59ac109cb0 0x7f59ac19ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:22.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.528+0000 7f59ab7fe640 1 -- 172.21.15.33:0/2263704688 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59ac07aec0 con 0x7f59ac078440 2024-09-12T12:37:22.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.528+0000 7f59aaffd640 1 --2- 172.21.15.33:0/2263704688 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59ac1092f0 0x7f59ac19e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:37:22.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.528+0000 7f59ab7fe640 1 --2- 172.21.15.33:0/2263704688 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59ac078440 0x7f59ac07a900 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f599c00c7d0 tx=0x7f599c00cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:37:22.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.529+0000 7f5993fff640 1 -- 172.21.15.33:0/2263704688 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f599c007bb0 con 0x7f59ac078440 2024-09-12T12:37:22.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.529+0000 7f59b136d640 1 -- 172.21.15.33:0/2263704688 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59ac07b150 con 0x7f59ac078440 2024-09-12T12:37:22.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.529+0000 7f59b136d640 1 -- 172.21.15.33:0/2263704688 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59ac07b6f0 con 0x7f59ac078440 2024-09-12T12:37:22.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.530+0000 7f5993fff640 1 -- 172.21.15.33:0/2263704688 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f599c00ce20 con 0x7f59ac078440 2024-09-12T12:37:22.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.530+0000 7f5993fff640 1 -- 172.21.15.33:0/2263704688 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f599c004d60 con 0x7f59ac078440 2024-09-12T12:37:22.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.535+0000 7f5993fff640 1 -- 172.21.15.33:0/2263704688 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f599c005020 con 0x7f59ac078440 2024-09-12T12:37:22.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.535+0000 7f59b136d640 1 -- 172.21.15.33:0/2263704688 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59980052c0 con 0x7f59ac078440 2024-09-12T12:37:22.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.536+0000 7f5993fff640 1 --2- 172.21.15.33:0/2263704688 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f59940a2d90 0x7f59940a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:22.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.537+0000 7f5993fff640 1 -- 172.21.15.33:0/2263704688 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f599c0ceda0 con 0x7f59ac078440 2024-09-12T12:37:22.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.538+0000 7f59aaffd640 1 --2- 172.21.15.33:0/2263704688 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f59940a2d90 0x7f59940a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:22.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.546+0000 7f5993fff640 1 -- 172.21.15.33:0/2263704688 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f599c014030 con 0x7f59ac078440 2024-09-12T12:37:22.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.548+0000 7f59aaffd640 1 --2- 172.21.15.33:0/2263704688 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f59940a2d90 0x7f59940a5250 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f59a401ac00 tx=0x7f59a4005f50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:37:22.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:22 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/2630493556' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T12:37:22.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:22 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/3608125951' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-12T12:37:22.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:22 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/2630493556' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T12:37:22.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:22 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/3608125951' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-12T12:37:22.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:22 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/2630493556' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T12:37:22.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:22 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/3608125951' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-12T12:37:22.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:22.987+0000 7f59b136d640 1 -- 172.21.15.33:0/2263704688 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f59980055b0 con 0x7f59ac078440 2024-09-12T12:37:23.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:23.003+0000 7f5993fff640 1 -- 172.21.15.33:0/2263704688 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+740367 (secure 0 0 0) 0x7f599c0046c0 con 0x7f59ac078440 2024-09-12T12:37:23.004 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:37:23.015 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:37:23.015 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 18, 2024-09-12T12:37:23.015 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.015 INFO:teuthology.orchestra.run.smithi033.stdout: "active_gid": 14150, 2024-09-12T12:37:23.015 INFO:teuthology.orchestra.run.smithi033.stdout: "active_name": "x", 2024-09-12T12:37:23.015 INFO:teuthology.orchestra.run.smithi033.stdout: "active_addrs": { 2024-09-12T12:37:23.015 INFO:teuthology.orchestra.run.smithi033.stdout: "addrvec": [ 2024-09-12T12:37:23.015 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.015 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v2", 2024-09-12T12:37:23.015 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "172.21.15.33:6800", 2024-09-12T12:37:23.016 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 176202431 2024-09-12T12:37:23.016 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.016 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.016 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v1", 2024-09-12T12:37:23.016 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "172.21.15.33:6801", 2024-09-12T12:37:23.016 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 176202431 2024-09-12T12:37:23.016 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.016 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-09-12T12:37:23.016 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.016 INFO:teuthology.orchestra.run.smithi033.stdout: "active_addr": "172.21.15.33:6801/176202431", 2024-09-12T12:37:23.017 INFO:teuthology.orchestra.run.smithi033.stdout: "active_change": "2024-09-12T12:16:57.792919+0000", 2024-09-12T12:37:23.017 INFO:teuthology.orchestra.run.smithi033.stdout: "active_mgr_features": 4540701547738038271, 2024-09-12T12:37:23.017 INFO:teuthology.orchestra.run.smithi033.stdout: "available": true, 2024-09-12T12:37:23.017 INFO:teuthology.orchestra.run.smithi033.stdout: "standbys": [ 2024-09-12T12:37:23.017 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.017 INFO:teuthology.orchestra.run.smithi033.stdout: "gid": 24112, 2024-09-12T12:37:23.017 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "z", 2024-09-12T12:37:23.017 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr_features": 4540701547738038271, 2024-09-12T12:37:23.017 INFO:teuthology.orchestra.run.smithi033.stdout: "available_modules": [ 2024-09-12T12:37:23.017 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.017 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "alerts", 2024-09-12T12:37:23.017 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.017 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.018 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.018 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-09-12T12:37:23.018 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-09-12T12:37:23.018 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:23.018 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.018 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.018 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-09-12T12:37:23.018 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.018 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.018 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.018 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T12:37:23.018 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.019 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.019 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.019 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.019 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.019 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.019 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.019 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.019 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.019 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.020 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.020 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.020 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.020 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.020 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.021 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.021 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.021 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.021 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.021 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.021 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.021 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.021 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.021 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.021 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.021 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.022 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.022 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.022 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.022 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.022 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.022 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.022 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.022 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.022 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.022 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.022 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.022 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.022 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.023 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.023 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.023 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.023 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.023 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.023 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.023 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.023 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.023 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.023 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.023 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.023 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.023 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.024 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.024 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.024 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.024 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.024 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.024 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.024 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.024 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.024 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.024 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.024 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.024 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.024 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.025 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.025 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.025 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.025 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.025 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.025 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.025 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.025 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.025 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.025 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_destination": { 2024-09-12T12:37:23.025 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_destination", 2024-09-12T12:37:23.025 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.025 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.025 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.026 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.026 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.026 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.026 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.026 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Email address to send alerts to", 2024-09-12T12:37:23.026 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.026 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.026 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.026 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.026 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_from_name": { 2024-09-12T12:37:23.026 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_from_name", 2024-09-12T12:37:23.026 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.026 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.026 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.027 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "Ceph", 2024-09-12T12:37:23.027 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.027 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.027 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.027 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Email From: name", 2024-09-12T12:37:23.027 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.027 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.027 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.027 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.028 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_host": { 2024-09-12T12:37:23.028 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_host", 2024-09-12T12:37:23.028 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.028 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.028 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.028 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.029 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.029 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.029 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.029 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SMTP server", 2024-09-12T12:37:23.029 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.029 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.030 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.030 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.030 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_password": { 2024-09-12T12:37:23.030 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_password", 2024-09-12T12:37:23.030 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.030 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.030 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.030 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.031 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.031 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.031 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.031 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Password to authenticate with", 2024-09-12T12:37:23.031 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.031 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.031 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.031 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.032 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_port": { 2024-09-12T12:37:23.032 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_port", 2024-09-12T12:37:23.032 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.032 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.032 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.032 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "465", 2024-09-12T12:37:23.032 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.033 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.033 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.033 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SMTP port", 2024-09-12T12:37:23.033 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.033 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.033 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.033 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.034 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_sender": { 2024-09-12T12:37:23.034 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_sender", 2024-09-12T12:37:23.034 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.034 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.034 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.034 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.035 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.035 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.035 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.035 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SMTP envelope sender", 2024-09-12T12:37:23.035 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.035 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.036 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.036 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.036 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_ssl": { 2024-09-12T12:37:23.036 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_ssl", 2024-09-12T12:37:23.036 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.036 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.036 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.036 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.036 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.036 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.037 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.037 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T12:37:23.037 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.037 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.037 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.037 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.037 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_user": { 2024-09-12T12:37:23.037 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_user", 2024-09-12T12:37:23.037 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.037 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.037 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.037 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.037 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.037 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.038 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.038 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "User to authenticate as", 2024-09-12T12:37:23.038 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.038 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.038 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.038 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.038 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.038 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.038 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.038 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "balancer", 2024-09-12T12:37:23.038 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.038 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.038 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.038 INFO:teuthology.orchestra.run.smithi033.stdout: "active": { 2024-09-12T12:37:23.039 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "active", 2024-09-12T12:37:23.039 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.039 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.039 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.039 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.039 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.039 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.039 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.039 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T12:37:23.039 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.039 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.039 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.039 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.039 INFO:teuthology.orchestra.run.smithi033.stdout: "begin_time": { 2024-09-12T12:37:23.040 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "begin_time", 2024-09-12T12:37:23.040 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.040 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.040 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.040 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0000", 2024-09-12T12:37:23.040 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.040 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.040 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.040 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T12:37:23.040 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T12:37:23.040 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.040 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.040 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.041 INFO:teuthology.orchestra.run.smithi033.stdout: "begin_weekday": { 2024-09-12T12:37:23.041 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "begin_weekday", 2024-09-12T12:37:23.041 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-09-12T12:37:23.041 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.041 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.041 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-12T12:37:23.041 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "0", 2024-09-12T12:37:23.041 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "6", 2024-09-12T12:37:23.041 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.041 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T12:37:23.041 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T12:37:23.041 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.041 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.042 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.042 INFO:teuthology.orchestra.run.smithi033.stdout: "crush_compat_max_iterations": { 2024-09-12T12:37:23.042 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crush_compat_max_iterations", 2024-09-12T12:37:23.042 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-09-12T12:37:23.042 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.042 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.042 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "25", 2024-09-12T12:37:23.042 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-09-12T12:37:23.042 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "250", 2024-09-12T12:37:23.042 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.042 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T12:37:23.042 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.042 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.042 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.043 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.043 INFO:teuthology.orchestra.run.smithi033.stdout: "crush_compat_metrics": { 2024-09-12T12:37:23.043 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crush_compat_metrics", 2024-09-12T12:37:23.043 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.043 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.043 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.044 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T12:37:23.044 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.044 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.044 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.044 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T12:37:23.044 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T12:37:23.044 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.044 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.044 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.044 INFO:teuthology.orchestra.run.smithi033.stdout: "crush_compat_step": { 2024-09-12T12:37:23.044 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crush_compat_step", 2024-09-12T12:37:23.044 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-09-12T12:37:23.045 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.045 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.045 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0.5", 2024-09-12T12:37:23.045 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "0.001", 2024-09-12T12:37:23.045 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "0.999", 2024-09-12T12:37:23.045 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.045 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "aggressiveness of optimization", 2024-09-12T12:37:23.046 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T12:37:23.046 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.046 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.046 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.046 INFO:teuthology.orchestra.run.smithi033.stdout: "end_time": { 2024-09-12T12:37:23.046 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "end_time", 2024-09-12T12:37:23.046 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.047 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.047 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.047 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "2359", 2024-09-12T12:37:23.047 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.047 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.047 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.047 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T12:37:23.047 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T12:37:23.047 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.047 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.047 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.047 INFO:teuthology.orchestra.run.smithi033.stdout: "end_weekday": { 2024-09-12T12:37:23.048 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "end_weekday", 2024-09-12T12:37:23.048 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-09-12T12:37:23.048 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.048 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.048 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-12T12:37:23.048 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "0", 2024-09-12T12:37:23.048 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "6", 2024-09-12T12:37:23.048 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.048 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T12:37:23.048 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T12:37:23.048 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.048 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.048 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.048 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.049 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.049 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.049 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.049 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.049 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.049 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.049 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.049 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.049 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.049 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.049 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.049 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.049 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.049 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.050 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.050 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.050 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.050 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.050 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.050 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.052 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.052 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.052 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.052 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.053 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.053 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.053 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.053 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.053 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.053 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.053 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.053 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.053 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.053 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.053 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.054 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.054 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.054 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.054 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.054 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.054 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.054 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.054 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.054 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.055 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.055 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.055 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.055 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.055 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.055 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.055 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.055 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.055 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.055 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.055 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.055 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.055 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.056 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.056 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.056 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.056 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.056 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.056 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.056 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.056 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.056 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.056 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.056 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.056 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.056 INFO:teuthology.orchestra.run.smithi033.stdout: "min_score": { 2024-09-12T12:37:23.057 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "min_score", 2024-09-12T12:37:23.057 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-09-12T12:37:23.057 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.057 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.057 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-12T12:37:23.057 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.057 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.057 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.057 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T12:37:23.057 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.057 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.057 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.057 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.058 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": { 2024-09-12T12:37:23.058 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mode", 2024-09-12T12:37:23.058 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.058 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.058 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.058 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "upmap", 2024-09-12T12:37:23.058 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.058 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.058 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.058 INFO:teuthology.orchestra.run.smithi033.stdout: "crush-compat", 2024-09-12T12:37:23.058 INFO:teuthology.orchestra.run.smithi033.stdout: "none", 2024-09-12T12:37:23.058 INFO:teuthology.orchestra.run.smithi033.stdout: "read", 2024-09-12T12:37:23.058 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap", 2024-09-12T12:37:23.058 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap-read" 2024-09-12T12:37:23.059 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.059 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Balancer mode", 2024-09-12T12:37:23.059 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.059 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.059 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.059 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.059 INFO:teuthology.orchestra.run.smithi033.stdout: "pool_ids": { 2024-09-12T12:37:23.059 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pool_ids", 2024-09-12T12:37:23.059 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.059 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.059 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.059 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.059 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.059 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.060 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.060 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T12:37:23.060 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.060 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.060 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.060 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.060 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-09-12T12:37:23.060 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-09-12T12:37:23.060 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:23.060 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.060 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.060 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-09-12T12:37:23.060 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.061 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.061 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.061 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T12:37:23.061 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.061 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.061 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.061 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.061 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap_max_deviation": { 2024-09-12T12:37:23.061 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "upmap_max_deviation", 2024-09-12T12:37:23.061 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.061 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.061 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.061 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-09-12T12:37:23.062 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-09-12T12:37:23.062 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.062 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.062 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T12:37:23.062 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T12:37:23.062 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.062 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.062 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.062 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap_max_optimizations": { 2024-09-12T12:37:23.062 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "upmap_max_optimizations", 2024-09-12T12:37:23.062 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-09-12T12:37:23.062 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.062 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.062 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-12T12:37:23.063 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.063 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.063 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.063 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T12:37:23.063 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.063 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.063 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.063 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.063 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.063 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.063 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.063 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephadm", 2024-09-12T12:37:23.063 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.063 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.064 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.064 INFO:teuthology.orchestra.run.smithi033.stdout: "agent_down_multiplier": { 2024-09-12T12:37:23.064 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "agent_down_multiplier", 2024-09-12T12:37:23.064 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-09-12T12:37:23.064 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.064 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.064 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "3.0", 2024-09-12T12:37:23.064 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.064 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.064 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.064 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T12:37:23.065 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.065 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.065 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.065 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.065 INFO:teuthology.orchestra.run.smithi033.stdout: "agent_refresh_rate": { 2024-09-12T12:37:23.065 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "agent_refresh_rate", 2024-09-12T12:37:23.065 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:23.065 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.065 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.065 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "20", 2024-09-12T12:37:23.066 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.066 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.066 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.066 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T12:37:23.066 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.066 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.066 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.066 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.066 INFO:teuthology.orchestra.run.smithi033.stdout: "agent_starting_port": { 2024-09-12T12:37:23.066 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "agent_starting_port", 2024-09-12T12:37:23.066 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.066 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.066 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.066 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "4721", 2024-09-12T12:37:23.067 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.067 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.067 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.067 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T12:37:23.067 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.067 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.067 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.067 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.067 INFO:teuthology.orchestra.run.smithi033.stdout: "allow_ptrace": { 2024-09-12T12:37:23.067 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "allow_ptrace", 2024-09-12T12:37:23.067 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.067 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.068 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.068 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.068 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.068 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.068 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.068 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T12:37:23.068 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T12:37:23.068 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.068 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.068 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.068 INFO:teuthology.orchestra.run.smithi033.stdout: "autotune_interval": { 2024-09-12T12:37:23.068 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "autotune_interval", 2024-09-12T12:37:23.068 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:23.069 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.069 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.069 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-09-12T12:37:23.069 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.069 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.069 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.069 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T12:37:23.069 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.069 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.069 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.069 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.069 INFO:teuthology.orchestra.run.smithi033.stdout: "autotune_memory_target_ratio": { 2024-09-12T12:37:23.069 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T12:37:23.069 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-09-12T12:37:23.070 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.070 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.070 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0.7", 2024-09-12T12:37:23.070 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.070 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.070 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.070 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T12:37:23.070 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.070 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.070 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.070 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.070 INFO:teuthology.orchestra.run.smithi033.stdout: "cephadm_log_destination": { 2024-09-12T12:37:23.070 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephadm_log_destination", 2024-09-12T12:37:23.071 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.071 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.071 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.071 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.071 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.071 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.071 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.071 INFO:teuthology.orchestra.run.smithi033.stdout: "file", 2024-09-12T12:37:23.071 INFO:teuthology.orchestra.run.smithi033.stdout: "file,syslog", 2024-09-12T12:37:23.071 INFO:teuthology.orchestra.run.smithi033.stdout: "syslog" 2024-09-12T12:37:23.071 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.072 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T12:37:23.072 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.072 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.072 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.072 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.072 INFO:teuthology.orchestra.run.smithi033.stdout: "cgroups_split": { 2024-09-12T12:37:23.072 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cgroups_split", 2024-09-12T12:37:23.072 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.072 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.072 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.072 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.072 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.073 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.073 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.073 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T12:37:23.073 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.073 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.073 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.073 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.073 INFO:teuthology.orchestra.run.smithi033.stdout: "config_checks_enabled": { 2024-09-12T12:37:23.074 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "config_checks_enabled", 2024-09-12T12:37:23.074 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.074 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.074 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.074 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.074 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.074 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.074 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.074 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T12:37:23.074 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.074 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.074 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.074 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.075 INFO:teuthology.orchestra.run.smithi033.stdout: "config_dashboard": { 2024-09-12T12:37:23.075 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "config_dashboard", 2024-09-12T12:37:23.075 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.075 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.075 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.075 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.075 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.075 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.076 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.076 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T12:37:23.076 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.076 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.076 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.076 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.076 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_alertmanager": { 2024-09-12T12:37:23.076 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_alertmanager", 2024-09-12T12:37:23.076 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.076 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.076 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.076 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T12:37:23.076 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.077 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.077 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.077 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-09-12T12:37:23.077 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.077 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.077 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.077 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.077 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_base": { 2024-09-12T12:37:23.077 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_base", 2024-09-12T12:37:23.077 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.077 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.077 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.077 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T12:37:23.078 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.078 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.078 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.078 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Container image name, without the tag", 2024-09-12T12:37:23.078 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.078 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.078 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.078 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.078 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_elasticsearch": { 2024-09-12T12:37:23.078 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_elasticsearch", 2024-09-12T12:37:23.078 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.078 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.078 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.079 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T12:37:23.079 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.079 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.079 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.079 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "elasticsearch container image", 2024-09-12T12:37:23.079 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.079 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.079 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.079 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.079 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_grafana": { 2024-09-12T12:37:23.079 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_grafana", 2024-09-12T12:37:23.079 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.079 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.079 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.080 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T12:37:23.080 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.080 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.080 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.080 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-09-12T12:37:23.080 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.080 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.080 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.080 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.080 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_haproxy": { 2024-09-12T12:37:23.080 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_haproxy", 2024-09-12T12:37:23.080 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.080 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.081 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.081 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T12:37:23.081 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.081 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.081 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.081 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "HAproxy container image", 2024-09-12T12:37:23.081 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.081 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.081 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.081 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.082 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_jaeger_agent": { 2024-09-12T12:37:23.082 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_jaeger_agent", 2024-09-12T12:37:23.082 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.082 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.082 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.082 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T12:37:23.082 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.082 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.082 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.082 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Jaeger agent container image", 2024-09-12T12:37:23.082 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.082 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.082 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.082 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.082 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_jaeger_collector": { 2024-09-12T12:37:23.083 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_jaeger_collector", 2024-09-12T12:37:23.083 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.083 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.083 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.083 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T12:37:23.083 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.083 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.083 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.083 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Jaeger collector container image", 2024-09-12T12:37:23.083 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.083 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.084 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.084 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.084 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_jaeger_query": { 2024-09-12T12:37:23.084 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_jaeger_query", 2024-09-12T12:37:23.084 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.084 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.084 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.084 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T12:37:23.084 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.084 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.085 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.085 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Jaeger query container image", 2024-09-12T12:37:23.085 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.085 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.085 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.085 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.085 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_keepalived": { 2024-09-12T12:37:23.085 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_keepalived", 2024-09-12T12:37:23.085 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.085 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.085 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.085 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T12:37:23.085 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.086 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.086 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.086 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Keepalived container image", 2024-09-12T12:37:23.086 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.086 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.086 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.086 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.086 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_loki": { 2024-09-12T12:37:23.086 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_loki", 2024-09-12T12:37:23.087 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.087 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.087 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.087 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T12:37:23.087 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.087 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.087 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.087 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Loki container image", 2024-09-12T12:37:23.087 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.087 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.087 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.088 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.088 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_node_exporter": { 2024-09-12T12:37:23.088 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_node_exporter", 2024-09-12T12:37:23.088 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.088 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.088 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.088 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T12:37:23.088 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.088 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.088 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.088 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-09-12T12:37:23.088 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.088 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.088 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.089 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.089 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_nvmeof": { 2024-09-12T12:37:23.089 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_nvmeof", 2024-09-12T12:37:23.089 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.089 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.089 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.089 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T12:37:23.089 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.089 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.089 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.089 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Nvme-of container image", 2024-09-12T12:37:23.089 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.089 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.090 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.090 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.090 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_prometheus": { 2024-09-12T12:37:23.090 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_prometheus", 2024-09-12T12:37:23.090 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.090 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.090 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.090 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T12:37:23.090 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.090 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.090 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.090 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-09-12T12:37:23.090 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.091 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.091 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.091 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.091 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_promtail": { 2024-09-12T12:37:23.091 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_promtail", 2024-09-12T12:37:23.091 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.091 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.091 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.091 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T12:37:23.091 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.091 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.091 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.091 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Promtail container image", 2024-09-12T12:37:23.091 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.091 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.092 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.092 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.092 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_samba": { 2024-09-12T12:37:23.092 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_samba", 2024-09-12T12:37:23.092 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.092 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.092 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.092 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T12:37:23.092 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.092 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.092 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.092 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Samba/SMB container image", 2024-09-12T12:37:23.092 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.093 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.093 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.093 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.093 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_snmp_gateway": { 2024-09-12T12:37:23.093 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_snmp_gateway", 2024-09-12T12:37:23.093 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.093 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.093 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.093 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T12:37:23.093 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.093 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.093 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.093 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SNMP Gateway container image", 2024-09-12T12:37:23.093 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.093 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.094 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.094 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.094 INFO:teuthology.orchestra.run.smithi033.stdout: "container_init": { 2024-09-12T12:37:23.094 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_init", 2024-09-12T12:37:23.094 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.094 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.094 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.094 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.094 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.095 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.095 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.095 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T12:37:23.095 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.095 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.095 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.095 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.095 INFO:teuthology.orchestra.run.smithi033.stdout: "daemon_cache_timeout": { 2024-09-12T12:37:23.095 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "daemon_cache_timeout", 2024-09-12T12:37:23.095 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:23.095 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.095 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.096 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-09-12T12:37:23.096 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.096 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.096 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.096 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T12:37:23.096 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.096 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.096 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.096 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.096 INFO:teuthology.orchestra.run.smithi033.stdout: "default_cephadm_command_timeout": { 2024-09-12T12:37:23.097 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T12:37:23.097 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.097 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.097 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.097 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "900", 2024-09-12T12:37:23.097 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.097 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.097 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.097 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T12:37:23.098 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.098 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.098 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.098 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.098 INFO:teuthology.orchestra.run.smithi033.stdout: "default_registry": { 2024-09-12T12:37:23.098 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "default_registry", 2024-09-12T12:37:23.098 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.098 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.098 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.098 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io", 2024-09-12T12:37:23.098 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.098 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.098 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.099 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T12:37:23.099 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.099 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.099 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.099 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.099 INFO:teuthology.orchestra.run.smithi033.stdout: "device_cache_timeout": { 2024-09-12T12:37:23.099 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "device_cache_timeout", 2024-09-12T12:37:23.099 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:23.099 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.099 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.099 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "1800", 2024-09-12T12:37:23.099 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.099 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.099 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.099 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "seconds to cache device inventory", 2024-09-12T12:37:23.100 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.100 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.100 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.100 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.100 INFO:teuthology.orchestra.run.smithi033.stdout: "device_enhanced_scan": { 2024-09-12T12:37:23.100 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "device_enhanced_scan", 2024-09-12T12:37:23.100 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.100 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.100 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.100 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.100 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.100 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.100 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.101 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T12:37:23.101 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.101 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.101 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.101 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.101 INFO:teuthology.orchestra.run.smithi033.stdout: "facts_cache_timeout": { 2024-09-12T12:37:23.101 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "facts_cache_timeout", 2024-09-12T12:37:23.101 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:23.101 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.101 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.101 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-09-12T12:37:23.101 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.101 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.102 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.102 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "seconds to cache host facts data", 2024-09-12T12:37:23.102 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.102 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.102 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.102 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.102 INFO:teuthology.orchestra.run.smithi033.stdout: "grafana_dashboards_path": { 2024-09-12T12:37:23.102 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "grafana_dashboards_path", 2024-09-12T12:37:23.102 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.102 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.102 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.102 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T12:37:23.102 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.103 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.103 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.103 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T12:37:23.103 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.103 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.103 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.103 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.103 INFO:teuthology.orchestra.run.smithi033.stdout: "host_check_interval": { 2024-09-12T12:37:23.103 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "host_check_interval", 2024-09-12T12:37:23.103 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:23.104 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.104 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.104 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-09-12T12:37:23.104 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.104 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.104 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.104 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to perform a host check", 2024-09-12T12:37:23.104 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.104 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.104 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.104 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.104 INFO:teuthology.orchestra.run.smithi033.stdout: "hw_monitoring": { 2024-09-12T12:37:23.104 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "hw_monitoring", 2024-09-12T12:37:23.104 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.105 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.105 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.105 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.105 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.105 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.105 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.105 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T12:37:23.105 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.105 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.106 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.106 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.106 INFO:teuthology.orchestra.run.smithi033.stdout: "inventory_list_all": { 2024-09-12T12:37:23.106 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "inventory_list_all", 2024-09-12T12:37:23.106 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.106 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.106 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.106 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.106 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.106 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.106 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.106 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T12:37:23.106 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.106 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.107 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.107 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.107 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.107 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.107 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.107 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.107 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.107 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.107 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.108 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.108 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.108 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.108 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.108 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.108 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.108 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.108 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.108 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.108 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.108 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.108 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.108 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.108 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.109 INFO:teuthology.orchestra.run.smithi033.stdout: "log_refresh_metadata": { 2024-09-12T12:37:23.109 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_refresh_metadata", 2024-09-12T12:37:23.109 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.109 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.109 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.109 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.109 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.109 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.109 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.109 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T12:37:23.109 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.109 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.110 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.110 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.110 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.110 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.110 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.110 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.110 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.111 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.111 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.111 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.111 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.111 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T12:37:23.111 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.111 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.111 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.111 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.111 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.111 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.111 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.111 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.111 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.112 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.112 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.112 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.112 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.112 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.112 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.112 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.112 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.112 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.112 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.112 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.112 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.112 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.113 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.113 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.113 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.113 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.113 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.113 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.113 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.113 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.113 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.113 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.113 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.113 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.113 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.113 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.114 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.114 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.114 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.114 INFO:teuthology.orchestra.run.smithi033.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T12:37:23.114 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T12:37:23.114 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.114 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.114 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.114 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.114 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.114 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.114 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.114 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T12:37:23.114 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.115 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.115 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.115 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.115 INFO:teuthology.orchestra.run.smithi033.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T12:37:23.115 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T12:37:23.115 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.115 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.115 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.115 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "*", 2024-09-12T12:37:23.115 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.115 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.116 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.116 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T12:37:23.116 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.116 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.116 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.116 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.116 INFO:teuthology.orchestra.run.smithi033.stdout: "max_count_per_host": { 2024-09-12T12:37:23.116 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_count_per_host", 2024-09-12T12:37:23.116 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.116 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.116 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.117 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-12T12:37:23.117 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.117 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.117 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.117 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "max number of daemons per service per host", 2024-09-12T12:37:23.117 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.117 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.117 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.117 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.117 INFO:teuthology.orchestra.run.smithi033.stdout: "max_osd_draining_count": { 2024-09-12T12:37:23.117 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_osd_draining_count", 2024-09-12T12:37:23.117 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.117 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.117 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.118 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-12T12:37:23.118 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.118 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.118 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.118 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T12:37:23.118 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.118 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.118 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.118 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.118 INFO:teuthology.orchestra.run.smithi033.stdout: "migration_current": { 2024-09-12T12:37:23.119 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "migration_current", 2024-09-12T12:37:23.119 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.119 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.119 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.119 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.119 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.119 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.119 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.119 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "internal - do not modify", 2024-09-12T12:37:23.119 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.119 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.119 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.119 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.119 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": { 2024-09-12T12:37:23.120 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mode", 2024-09-12T12:37:23.120 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.120 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.120 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.120 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "root", 2024-09-12T12:37:23.120 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.120 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.120 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.120 INFO:teuthology.orchestra.run.smithi033.stdout: "cephadm-package", 2024-09-12T12:37:23.120 INFO:teuthology.orchestra.run.smithi033.stdout: "root" 2024-09-12T12:37:23.120 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.120 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T12:37:23.120 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.120 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.121 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.121 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.121 INFO:teuthology.orchestra.run.smithi033.stdout: "oob_default_addr": { 2024-09-12T12:37:23.121 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "oob_default_addr", 2024-09-12T12:37:23.121 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.121 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.121 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.121 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "169.254.1.1", 2024-09-12T12:37:23.121 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.121 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.121 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.121 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T12:37:23.121 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.121 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.122 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.122 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.122 INFO:teuthology.orchestra.run.smithi033.stdout: "prometheus_alerts_path": { 2024-09-12T12:37:23.122 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "prometheus_alerts_path", 2024-09-12T12:37:23.122 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.122 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.122 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.122 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T12:37:23.122 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.122 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.122 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.122 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T12:37:23.122 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.122 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.122 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.123 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.123 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_insecure": { 2024-09-12T12:37:23.123 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_insecure", 2024-09-12T12:37:23.123 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.123 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.123 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.123 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.123 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.123 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.123 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.123 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T12:37:23.123 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.124 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.124 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.124 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.124 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_password": { 2024-09-12T12:37:23.124 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_password", 2024-09-12T12:37:23.124 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.124 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.124 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.124 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.124 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.124 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.124 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.124 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T12:37:23.125 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.125 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.125 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.125 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.125 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_url": { 2024-09-12T12:37:23.125 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_url", 2024-09-12T12:37:23.125 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.125 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.125 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.125 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.125 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.125 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.125 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.125 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T12:37:23.126 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.126 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.126 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.126 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.126 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_username": { 2024-09-12T12:37:23.126 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_username", 2024-09-12T12:37:23.126 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.126 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.126 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.127 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.127 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.127 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.127 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.127 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T12:37:23.127 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.127 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.127 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.127 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.127 INFO:teuthology.orchestra.run.smithi033.stdout: "secure_monitoring_stack": { 2024-09-12T12:37:23.127 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "secure_monitoring_stack", 2024-09-12T12:37:23.127 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.127 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.127 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.128 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.128 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.128 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.128 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.128 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T12:37:23.128 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.128 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.128 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.128 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.128 INFO:teuthology.orchestra.run.smithi033.stdout: "service_discovery_port": { 2024-09-12T12:37:23.129 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "service_discovery_port", 2024-09-12T12:37:23.129 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.129 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.129 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.129 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8765", 2024-09-12T12:37:23.129 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.129 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.129 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.129 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "cephadm service discovery port", 2024-09-12T12:37:23.129 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.129 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.129 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.130 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.130 INFO:teuthology.orchestra.run.smithi033.stdout: "ssh_config_file": { 2024-09-12T12:37:23.130 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssh_config_file", 2024-09-12T12:37:23.130 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.130 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.130 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.130 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.130 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.130 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.130 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.130 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T12:37:23.130 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.130 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.131 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.131 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.131 INFO:teuthology.orchestra.run.smithi033.stdout: "use_agent": { 2024-09-12T12:37:23.131 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "use_agent", 2024-09-12T12:37:23.131 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.131 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.131 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.131 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.131 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.131 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.131 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.131 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T12:37:23.131 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.131 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.132 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.132 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.132 INFO:teuthology.orchestra.run.smithi033.stdout: "use_repo_digest": { 2024-09-12T12:37:23.132 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "use_repo_digest", 2024-09-12T12:37:23.132 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.132 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.132 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.132 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.132 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.132 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.132 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.132 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T12:37:23.132 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.132 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.133 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.133 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.133 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_on_failed_host_check": { 2024-09-12T12:37:23.133 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_on_failed_host_check", 2024-09-12T12:37:23.133 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.133 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.133 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.133 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.133 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.133 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.133 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.133 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T12:37:23.133 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.133 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.134 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.134 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.134 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_on_stray_daemons": { 2024-09-12T12:37:23.134 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_on_stray_daemons", 2024-09-12T12:37:23.134 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.134 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.134 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.134 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.134 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.134 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.134 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.134 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T12:37:23.134 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.134 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.134 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.135 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.135 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_on_stray_hosts": { 2024-09-12T12:37:23.135 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_on_stray_hosts", 2024-09-12T12:37:23.135 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.135 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.135 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.135 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.135 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.135 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.135 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.135 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T12:37:23.135 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.135 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.135 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.136 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.136 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.136 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.136 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.136 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crash", 2024-09-12T12:37:23.136 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.136 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.136 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.136 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.136 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.136 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.137 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.137 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.137 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.137 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.137 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.137 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.137 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.137 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.137 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.137 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.137 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.138 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.138 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.138 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.138 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.138 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.138 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.138 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.138 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.138 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.138 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.138 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.138 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.138 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.138 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.139 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.139 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.139 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.139 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.139 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.139 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.139 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.139 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.139 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.140 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.140 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.140 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.140 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.140 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.140 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.140 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.140 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.140 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.140 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.140 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.140 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.140 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.141 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.141 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.141 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.141 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.141 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.141 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.141 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.141 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.141 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.141 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.141 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.141 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.141 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.141 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.141 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.142 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.142 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.142 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.142 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.142 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.142 INFO:teuthology.orchestra.run.smithi033.stdout: "retain_interval": { 2024-09-12T12:37:23.142 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "retain_interval", 2024-09-12T12:37:23.142 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:23.142 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.142 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.142 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "31536000", 2024-09-12T12:37:23.142 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.142 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.142 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.143 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T12:37:23.143 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.143 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.143 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.143 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.143 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_recent_interval": { 2024-09-12T12:37:23.143 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_recent_interval", 2024-09-12T12:37:23.143 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:23.143 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.143 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.144 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "1209600", 2024-09-12T12:37:23.144 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.144 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.144 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.144 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T12:37:23.144 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.144 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.144 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.144 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.144 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.144 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.144 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.145 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "dashboard", 2024-09-12T12:37:23.145 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.145 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.145 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.145 INFO:teuthology.orchestra.run.smithi033.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T12:37:23.145 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T12:37:23.145 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.145 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.145 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.145 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-12T12:37:23.145 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.145 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.145 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.145 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.146 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.146 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.146 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.146 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.146 INFO:teuthology.orchestra.run.smithi033.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T12:37:23.146 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T12:37:23.146 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.146 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.146 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.146 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.146 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.146 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.146 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.146 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.147 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.147 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.147 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.147 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.147 INFO:teuthology.orchestra.run.smithi033.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T12:37:23.147 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T12:37:23.147 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.147 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.147 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.147 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.148 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.148 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.148 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.148 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.148 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.148 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.148 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.148 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.148 INFO:teuthology.orchestra.run.smithi033.stdout: "AUDIT_API_ENABLED": { 2024-09-12T12:37:23.148 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T12:37:23.148 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.148 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.148 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.148 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.149 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.149 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.149 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.149 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.149 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.149 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.149 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.149 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.149 INFO:teuthology.orchestra.run.smithi033.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T12:37:23.149 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T12:37:23.149 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.149 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.150 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.150 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.150 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.150 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.150 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.150 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.150 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.150 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.150 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.150 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.150 INFO:teuthology.orchestra.run.smithi033.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T12:37:23.151 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T12:37:23.151 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.151 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.151 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.151 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.151 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.151 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.151 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.151 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.151 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.151 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.151 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.151 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.152 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T12:37:23.152 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T12:37:23.152 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.152 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.152 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.152 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.152 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.152 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.152 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.152 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.152 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.152 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.152 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.153 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.153 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T12:37:23.153 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T12:37:23.153 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.153 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.153 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.153 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.153 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.153 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.153 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.153 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.153 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.154 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.154 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.154 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.154 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T12:37:23.154 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T12:37:23.154 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.154 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.154 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.154 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.154 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.154 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.154 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.154 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.154 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.155 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.155 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.155 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.155 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T12:37:23.155 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T12:37:23.155 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.155 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.155 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.155 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.155 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.155 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.155 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.155 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.155 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.156 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.156 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.156 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.156 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T12:37:23.156 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T12:37:23.156 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.156 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.156 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.156 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.156 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.156 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.156 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.156 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.156 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.157 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.157 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.157 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.157 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T12:37:23.157 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T12:37:23.157 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.157 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.157 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.157 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.157 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.157 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.157 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.157 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.157 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.158 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.158 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.158 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.158 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T12:37:23.158 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T12:37:23.158 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.158 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.158 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.158 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.159 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.159 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.159 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.159 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.159 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.159 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.159 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.159 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.159 INFO:teuthology.orchestra.run.smithi033.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T12:37:23.159 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T12:37:23.159 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.159 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.159 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.159 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.160 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.160 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.160 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.160 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.160 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.160 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.160 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.160 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.160 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T12:37:23.161 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T12:37:23.161 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.161 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.161 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.161 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "admin", 2024-09-12T12:37:23.161 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.161 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.161 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.161 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.161 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.161 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.161 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.161 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.161 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T12:37:23.162 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T12:37:23.162 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.162 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.162 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.162 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.162 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.162 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.162 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.162 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.162 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.162 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.162 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.162 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.162 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_URL": { 2024-09-12T12:37:23.163 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_URL", 2024-09-12T12:37:23.163 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.163 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.163 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.163 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.163 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.163 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.163 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.163 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.163 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.163 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.163 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.163 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.163 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T12:37:23.163 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T12:37:23.164 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.164 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.164 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.164 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "admin", 2024-09-12T12:37:23.164 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.164 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.164 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.164 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.164 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.164 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.164 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.164 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.164 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T12:37:23.164 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T12:37:23.165 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.165 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.165 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.165 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.165 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.165 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.165 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.165 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.165 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.165 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.165 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.165 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.165 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T12:37:23.166 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T12:37:23.166 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.166 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.166 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.166 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.166 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.166 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.166 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.166 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.166 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.166 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.166 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.166 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.166 INFO:teuthology.orchestra.run.smithi033.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T12:37:23.167 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T12:37:23.167 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.167 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.167 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.167 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.167 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.167 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.167 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.167 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.167 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.167 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.167 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.167 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.167 INFO:teuthology.orchestra.run.smithi033.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T12:37:23.168 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T12:37:23.168 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.168 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.168 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.168 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.168 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.168 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.168 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.168 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.168 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.169 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.169 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.169 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.169 INFO:teuthology.orchestra.run.smithi033.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T12:37:23.169 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T12:37:23.169 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.169 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.169 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.169 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.169 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.169 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.169 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.169 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.170 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.170 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.170 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.170 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.170 INFO:teuthology.orchestra.run.smithi033.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T12:37:23.170 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T12:37:23.170 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.170 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.170 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.170 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.170 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.170 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.170 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.171 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.171 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.171 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.171 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.171 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.171 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T12:37:23.171 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T12:37:23.171 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.171 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.171 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.172 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.172 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.172 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.172 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.172 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.172 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.172 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.172 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.172 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.172 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T12:37:23.172 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T12:37:23.172 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.172 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.173 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.173 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.173 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.173 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.173 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.173 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.173 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.173 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.173 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.173 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.173 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T12:37:23.173 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T12:37:23.173 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.174 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.174 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.174 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.174 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.174 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.174 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.174 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.174 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.174 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.174 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.174 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.174 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T12:37:23.174 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T12:37:23.174 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.175 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.175 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.175 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.175 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.175 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.175 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.175 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.175 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.175 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.175 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.175 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.175 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T12:37:23.175 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T12:37:23.175 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.176 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.176 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.176 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.176 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.176 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.176 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.176 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.176 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.176 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.176 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.176 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.176 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T12:37:23.176 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T12:37:23.176 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.177 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.177 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.177 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.177 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.177 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.177 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.177 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.177 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.177 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.177 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.177 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.177 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T12:37:23.177 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T12:37:23.177 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.178 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.178 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.178 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.178 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.178 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.178 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.178 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.178 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.178 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.178 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.178 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.178 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T12:37:23.179 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T12:37:23.179 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.179 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.179 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.179 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.179 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.179 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.179 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.179 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.179 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.180 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.180 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.180 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.180 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T12:37:23.180 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T12:37:23.180 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.180 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.180 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.180 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T12:37:23.180 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.180 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.180 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.181 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.181 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.181 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.181 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.181 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.181 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T12:37:23.182 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T12:37:23.182 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.182 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.182 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.182 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-12T12:37:23.182 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.182 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.182 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.183 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.183 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.183 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.183 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.183 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.183 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T12:37:23.183 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T12:37:23.183 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.183 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.183 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.183 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8", 2024-09-12T12:37:23.183 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.183 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.183 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.183 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.184 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.184 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.184 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.184 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.184 INFO:teuthology.orchestra.run.smithi033.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T12:37:23.184 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T12:37:23.184 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.184 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.184 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.184 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "45", 2024-09-12T12:37:23.184 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.184 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.184 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.185 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.185 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.185 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.185 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.185 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.185 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T12:37:23.185 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T12:37:23.185 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.185 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.185 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.185 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.185 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.185 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.185 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.186 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.186 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.186 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.186 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.186 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.186 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T12:37:23.186 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T12:37:23.186 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.186 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.186 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.186 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "admin", 2024-09-12T12:37:23.186 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.186 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.186 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.187 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.187 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.187 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.187 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.187 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.187 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T12:37:23.187 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T12:37:23.187 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.187 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.187 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.187 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.187 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.187 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.187 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.188 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.188 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.188 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.188 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.188 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.188 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T12:37:23.188 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T12:37:23.188 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.188 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.188 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.188 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.188 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.188 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.188 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.189 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.189 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.189 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.189 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.189 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.189 INFO:teuthology.orchestra.run.smithi033.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T12:37:23.189 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T12:37:23.189 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.189 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.189 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.189 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-12T12:37:23.189 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.190 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.190 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.190 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.190 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.190 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.190 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.190 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.190 INFO:teuthology.orchestra.run.smithi033.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T12:37:23.190 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T12:37:23.190 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.190 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.191 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.191 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-12T12:37:23.191 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.191 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.191 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.191 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.191 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.191 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.191 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.191 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.191 INFO:teuthology.orchestra.run.smithi033.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T12:37:23.191 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T12:37:23.191 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.191 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.191 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.192 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-09-12T12:37:23.192 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.192 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.192 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.192 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.192 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.192 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.192 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.192 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.192 INFO:teuthology.orchestra.run.smithi033.stdout: "cross_origin_url": { 2024-09-12T12:37:23.192 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cross_origin_url", 2024-09-12T12:37:23.192 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.192 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.192 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.193 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.193 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.193 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.193 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.193 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.193 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.193 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.193 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.193 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.193 INFO:teuthology.orchestra.run.smithi033.stdout: "crt_file": { 2024-09-12T12:37:23.193 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crt_file", 2024-09-12T12:37:23.193 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.193 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.193 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.194 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.194 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.194 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.194 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.194 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.194 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.194 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.194 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.194 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.194 INFO:teuthology.orchestra.run.smithi033.stdout: "debug": { 2024-09-12T12:37:23.194 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "debug", 2024-09-12T12:37:23.194 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.195 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.195 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.195 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.195 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.195 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.195 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.195 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Enable/disable debug options", 2024-09-12T12:37:23.195 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.195 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.195 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.195 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.195 INFO:teuthology.orchestra.run.smithi033.stdout: "jwt_token_ttl": { 2024-09-12T12:37:23.195 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "jwt_token_ttl", 2024-09-12T12:37:23.195 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.196 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.196 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.196 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "28800", 2024-09-12T12:37:23.196 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.196 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.196 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.196 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.196 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.196 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.196 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.196 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.196 INFO:teuthology.orchestra.run.smithi033.stdout: "key_file": { 2024-09-12T12:37:23.197 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "key_file", 2024-09-12T12:37:23.197 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.197 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.197 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.197 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.197 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.197 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.197 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.197 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.197 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.197 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.197 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.197 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.198 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.198 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.198 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.198 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.198 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.198 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.198 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.198 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.198 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.198 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.198 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.198 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.198 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.198 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.199 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.199 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.199 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.199 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.199 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.199 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.199 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.199 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.199 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.199 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.199 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.199 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.199 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.199 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.200 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.200 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.200 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.200 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.200 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.200 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.200 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.200 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.200 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.201 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.201 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.201 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.201 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.201 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.201 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.201 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.201 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.201 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.201 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.201 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.201 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.201 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.202 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.202 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.202 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.202 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.202 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.202 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.202 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.202 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.202 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.202 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.202 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.202 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.202 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.202 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.203 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.203 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.203 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.203 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.203 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.203 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.203 INFO:teuthology.orchestra.run.smithi033.stdout: "motd": { 2024-09-12T12:37:23.203 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "motd", 2024-09-12T12:37:23.203 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.203 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.203 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.204 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.204 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.204 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.204 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.204 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "The message of the day", 2024-09-12T12:37:23.204 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.204 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.204 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.204 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.204 INFO:teuthology.orchestra.run.smithi033.stdout: "redirect_resolve_ip_addr": { 2024-09-12T12:37:23.204 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T12:37:23.204 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.205 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.205 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.205 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.205 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.205 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.205 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.205 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.205 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.205 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.205 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.205 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.206 INFO:teuthology.orchestra.run.smithi033.stdout: "server_addr": { 2024-09-12T12:37:23.206 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_addr", 2024-09-12T12:37:23.206 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.206 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.206 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.206 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "::", 2024-09-12T12:37:23.206 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.206 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.206 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.206 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.206 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.206 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.206 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.206 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.206 INFO:teuthology.orchestra.run.smithi033.stdout: "server_port": { 2024-09-12T12:37:23.207 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_port", 2024-09-12T12:37:23.207 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.207 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.207 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.207 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8080", 2024-09-12T12:37:23.207 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.207 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.207 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.207 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.207 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.207 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.207 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.207 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.207 INFO:teuthology.orchestra.run.smithi033.stdout: "ssl": { 2024-09-12T12:37:23.208 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssl", 2024-09-12T12:37:23.208 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.208 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.208 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.208 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.208 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.208 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.208 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.208 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.208 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.208 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.208 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.208 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.208 INFO:teuthology.orchestra.run.smithi033.stdout: "ssl_server_port": { 2024-09-12T12:37:23.209 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssl_server_port", 2024-09-12T12:37:23.209 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.209 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.209 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.209 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8443", 2024-09-12T12:37:23.209 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.209 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.209 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.209 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.209 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.209 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.209 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.210 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.210 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_behaviour": { 2024-09-12T12:37:23.210 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_behaviour", 2024-09-12T12:37:23.210 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.210 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.210 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.210 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "redirect", 2024-09-12T12:37:23.210 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.210 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.210 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.210 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.211 INFO:teuthology.orchestra.run.smithi033.stdout: "redirect" 2024-09-12T12:37:23.211 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.211 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.211 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.211 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.211 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.211 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.211 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_error_status_code": { 2024-09-12T12:37:23.211 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_error_status_code", 2024-09-12T12:37:23.211 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.211 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.212 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.212 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "500", 2024-09-12T12:37:23.212 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "400", 2024-09-12T12:37:23.212 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "599", 2024-09-12T12:37:23.212 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.212 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.212 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.212 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.212 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.212 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.212 INFO:teuthology.orchestra.run.smithi033.stdout: "url_prefix": { 2024-09-12T12:37:23.212 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "url_prefix", 2024-09-12T12:37:23.212 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.213 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.213 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.213 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.213 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.213 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.213 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.213 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.213 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.213 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.213 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.213 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.213 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.213 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.213 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.214 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "devicehealth", 2024-09-12T12:37:23.214 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.214 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.214 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.214 INFO:teuthology.orchestra.run.smithi033.stdout: "enable_monitoring": { 2024-09-12T12:37:23.214 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enable_monitoring", 2024-09-12T12:37:23.214 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.214 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.214 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.214 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.214 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.214 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.214 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.214 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "monitor device health metrics", 2024-09-12T12:37:23.215 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.215 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.215 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.215 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.215 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.215 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.215 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.215 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.215 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.215 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.215 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.215 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.215 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.215 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.216 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.216 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.216 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.216 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.216 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.216 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.216 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.216 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.216 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.216 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.216 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.216 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.216 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.216 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.217 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.217 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.217 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.217 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.217 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.217 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.217 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.217 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.217 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.217 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.217 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.217 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.217 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.217 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.218 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.218 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.218 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.218 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.218 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.218 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.218 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.218 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.218 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.218 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.218 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.218 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.219 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.219 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.219 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.219 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.219 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.219 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.219 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.219 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.219 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.219 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.219 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.219 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.219 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.219 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.220 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.220 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.220 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.220 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.220 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.220 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.220 INFO:teuthology.orchestra.run.smithi033.stdout: "mark_out_threshold": { 2024-09-12T12:37:23.220 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mark_out_threshold", 2024-09-12T12:37:23.220 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:23.220 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.220 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.220 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "2419200", 2024-09-12T12:37:23.220 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.220 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.221 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.221 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T12:37:23.221 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.221 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.221 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.221 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.221 INFO:teuthology.orchestra.run.smithi033.stdout: "pool_name": { 2024-09-12T12:37:23.221 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pool_name", 2024-09-12T12:37:23.221 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.221 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.221 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.221 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "device_health_metrics", 2024-09-12T12:37:23.221 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.221 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.221 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.222 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T12:37:23.222 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.222 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.222 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.222 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.222 INFO:teuthology.orchestra.run.smithi033.stdout: "retention_period": { 2024-09-12T12:37:23.222 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "retention_period", 2024-09-12T12:37:23.222 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:23.222 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.222 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.222 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "15552000", 2024-09-12T12:37:23.222 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.222 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.222 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.223 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how long to retain device health metrics", 2024-09-12T12:37:23.223 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.223 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.223 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.223 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.223 INFO:teuthology.orchestra.run.smithi033.stdout: "scrape_frequency": { 2024-09-12T12:37:23.223 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "scrape_frequency", 2024-09-12T12:37:23.223 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:23.223 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.223 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.223 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "86400", 2024-09-12T12:37:23.223 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.224 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.224 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.224 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T12:37:23.224 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.224 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.224 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.224 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.224 INFO:teuthology.orchestra.run.smithi033.stdout: "self_heal": { 2024-09-12T12:37:23.224 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "self_heal", 2024-09-12T12:37:23.224 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.224 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.224 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.224 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.224 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.225 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.225 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.225 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T12:37:23.225 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.225 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.225 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.225 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.225 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-09-12T12:37:23.225 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-09-12T12:37:23.225 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:23.225 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.225 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.225 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-09-12T12:37:23.225 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.226 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.226 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.226 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T12:37:23.226 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.226 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.226 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.226 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.226 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_threshold": { 2024-09-12T12:37:23.226 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_threshold", 2024-09-12T12:37:23.226 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:23.226 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.226 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.226 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "7257600", 2024-09-12T12:37:23.226 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.227 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.227 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.227 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T12:37:23.227 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.227 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.227 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.227 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.227 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.227 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.227 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.227 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "diskprediction_local", 2024-09-12T12:37:23.227 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.227 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.227 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.228 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.228 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.228 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.228 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.228 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.228 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.228 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.228 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.228 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.228 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.228 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.228 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.228 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.228 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.229 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.229 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.229 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.229 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.229 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.229 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.229 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.229 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.229 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.229 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.229 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.229 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.229 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.229 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.230 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.230 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.230 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.230 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.230 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.230 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.230 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.230 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.230 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.230 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.230 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.230 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.230 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.230 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.231 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.231 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.231 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.231 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.231 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.231 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.231 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.231 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.231 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.231 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.231 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.231 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.231 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.232 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.232 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.232 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.232 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.232 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.232 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.232 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.232 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.232 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.232 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.232 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.233 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.233 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.233 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.233 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.233 INFO:teuthology.orchestra.run.smithi033.stdout: "predict_interval": { 2024-09-12T12:37:23.233 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "predict_interval", 2024-09-12T12:37:23.233 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.233 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.233 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.233 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "86400", 2024-09-12T12:37:23.233 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.233 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.233 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.233 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.234 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.234 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.234 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.234 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.234 INFO:teuthology.orchestra.run.smithi033.stdout: "predictor_model": { 2024-09-12T12:37:23.234 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "predictor_model", 2024-09-12T12:37:23.234 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.234 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.234 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.234 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "prophetstor", 2024-09-12T12:37:23.234 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.234 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.234 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.235 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.235 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.235 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.235 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.235 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.235 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-09-12T12:37:23.235 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-09-12T12:37:23.235 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.235 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.235 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.235 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-09-12T12:37:23.235 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.235 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.235 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.236 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.236 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.236 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.236 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.236 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.236 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.236 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.236 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.236 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "influx", 2024-09-12T12:37:23.236 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": false, 2024-09-12T12:37:23.236 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "influxdb python module not found", 2024-09-12T12:37:23.236 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.236 INFO:teuthology.orchestra.run.smithi033.stdout: "batch_size": { 2024-09-12T12:37:23.237 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "batch_size", 2024-09-12T12:37:23.237 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.237 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.237 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.237 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5000", 2024-09-12T12:37:23.237 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.237 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.237 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.237 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T12:37:23.237 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.237 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.237 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.237 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.238 INFO:teuthology.orchestra.run.smithi033.stdout: "database": { 2024-09-12T12:37:23.238 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "database", 2024-09-12T12:37:23.238 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.238 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.238 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.238 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "ceph", 2024-09-12T12:37:23.238 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.238 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.238 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.238 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T12:37:23.238 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.238 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.238 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.238 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.239 INFO:teuthology.orchestra.run.smithi033.stdout: "hostname": { 2024-09-12T12:37:23.239 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "hostname", 2024-09-12T12:37:23.239 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.239 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.239 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.239 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.239 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.239 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.239 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.239 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "InfluxDB server hostname", 2024-09-12T12:37:23.239 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.239 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.239 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.239 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.240 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-09-12T12:37:23.240 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-09-12T12:37:23.240 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:23.240 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.240 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.240 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "30", 2024-09-12T12:37:23.240 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "5", 2024-09-12T12:37:23.240 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.240 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.240 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T12:37:23.241 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.241 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.241 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.241 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.241 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.241 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.241 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.241 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.241 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.241 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.241 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.241 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.241 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.241 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.242 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.242 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.242 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.242 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.242 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.242 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.242 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.242 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.242 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.242 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.242 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.242 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.242 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.242 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.243 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.243 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.243 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.243 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.243 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.243 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.243 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.243 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.243 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.243 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.243 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.243 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.243 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.243 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.244 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.244 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.244 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.244 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.244 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.244 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.244 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.244 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.244 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.244 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.245 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.245 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.245 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.245 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.245 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.245 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.245 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.245 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.245 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.245 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.245 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.245 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.245 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.246 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.246 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.246 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.246 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.246 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.246 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.246 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.246 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.246 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.246 INFO:teuthology.orchestra.run.smithi033.stdout: "password": { 2024-09-12T12:37:23.246 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "password", 2024-09-12T12:37:23.247 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.247 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.247 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.247 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.247 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.247 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.247 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.247 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "password of InfluxDB server user", 2024-09-12T12:37:23.247 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.247 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.247 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.247 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.248 INFO:teuthology.orchestra.run.smithi033.stdout: "port": { 2024-09-12T12:37:23.248 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "port", 2024-09-12T12:37:23.248 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.248 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.248 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.248 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8086", 2024-09-12T12:37:23.248 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.249 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.249 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.249 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "InfluxDB server port", 2024-09-12T12:37:23.249 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.249 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.249 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.250 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.250 INFO:teuthology.orchestra.run.smithi033.stdout: "ssl": { 2024-09-12T12:37:23.250 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssl", 2024-09-12T12:37:23.250 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.250 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.250 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.250 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "false", 2024-09-12T12:37:23.250 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.250 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.250 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.250 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T12:37:23.250 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.250 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.250 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.251 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.251 INFO:teuthology.orchestra.run.smithi033.stdout: "threads": { 2024-09-12T12:37:23.251 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "threads", 2024-09-12T12:37:23.251 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.251 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.251 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.251 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-09-12T12:37:23.251 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-09-12T12:37:23.251 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "32", 2024-09-12T12:37:23.251 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.251 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T12:37:23.251 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.251 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.251 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.252 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.252 INFO:teuthology.orchestra.run.smithi033.stdout: "username": { 2024-09-12T12:37:23.252 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "username", 2024-09-12T12:37:23.252 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.252 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.252 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.252 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.252 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.252 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.252 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.252 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "username of InfluxDB server user", 2024-09-12T12:37:23.252 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.252 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.252 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.253 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.253 INFO:teuthology.orchestra.run.smithi033.stdout: "verify_ssl": { 2024-09-12T12:37:23.257 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "verify_ssl", 2024-09-12T12:37:23.257 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.257 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.257 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.257 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "true", 2024-09-12T12:37:23.258 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.258 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.258 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.258 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T12:37:23.258 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.258 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.258 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.258 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.258 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.259 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.259 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.259 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "insights", 2024-09-12T12:37:23.259 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.259 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.259 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.259 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.259 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.259 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.260 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.260 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.260 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.260 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.260 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.260 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.260 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.260 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.261 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.261 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.261 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.261 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.261 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.261 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.261 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.261 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.261 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.262 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.262 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.262 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.262 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.262 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.262 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.262 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.262 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.263 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.263 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.263 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.263 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.263 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.263 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.263 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.263 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.264 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.264 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.264 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.264 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.264 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.264 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.264 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.264 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.264 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.265 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.265 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.265 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.265 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.265 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.265 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.265 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.265 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.266 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.266 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.266 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.266 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.266 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.266 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.266 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.266 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.267 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.267 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.267 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.267 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.267 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.267 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.267 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.267 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.268 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.268 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.268 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.268 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.268 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "iostat", 2024-09-12T12:37:23.268 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.268 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.268 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.269 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.269 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.269 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.269 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.269 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.269 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.269 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.269 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.269 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.270 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.270 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.270 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.270 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.270 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.270 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.270 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.270 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.271 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.271 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.271 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.271 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.271 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.271 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.271 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.271 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.271 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.272 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.272 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.272 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.272 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.272 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.272 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.272 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.273 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.273 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.273 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.273 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.273 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.273 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.273 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.273 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.273 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.273 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.273 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.274 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.274 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.274 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.274 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.274 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.274 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.274 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.274 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.274 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.274 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.275 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.275 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.275 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.275 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.275 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.275 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.275 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.275 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.275 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.275 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.275 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.275 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.275 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.276 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.276 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.276 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.276 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.276 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.276 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.276 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "k8sevents", 2024-09-12T12:37:23.276 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.277 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.277 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.277 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_event_retention_days": { 2024-09-12T12:37:23.277 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ceph_event_retention_days", 2024-09-12T12:37:23.277 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.277 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.277 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.277 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "7", 2024-09-12T12:37:23.277 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.277 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.277 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.278 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T12:37:23.278 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.278 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.278 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.278 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.278 INFO:teuthology.orchestra.run.smithi033.stdout: "config_check_secs": { 2024-09-12T12:37:23.278 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "config_check_secs", 2024-09-12T12:37:23.278 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.278 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.278 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.279 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-12T12:37:23.279 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "10", 2024-09-12T12:37:23.279 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.279 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.279 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T12:37:23.279 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.279 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.279 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.279 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.279 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.279 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.280 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.280 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.280 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.280 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.280 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.280 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.280 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.280 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.280 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.280 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.280 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.280 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.280 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.281 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.281 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.281 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.281 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.281 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.281 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.281 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.281 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.281 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.281 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.281 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.281 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.282 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.282 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.282 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.282 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.282 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.282 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.282 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.282 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.282 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.282 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.282 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.282 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.282 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.282 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.283 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.283 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.283 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.283 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.283 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.283 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.283 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.283 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.283 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.283 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.283 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.283 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.283 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.283 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.284 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.284 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.284 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.284 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.284 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.284 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.284 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.284 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.284 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.284 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.284 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.284 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.284 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.285 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.285 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.285 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.285 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.285 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.285 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "localpool", 2024-09-12T12:37:23.285 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.285 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.285 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.285 INFO:teuthology.orchestra.run.smithi033.stdout: "failure_domain": { 2024-09-12T12:37:23.285 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "failure_domain", 2024-09-12T12:37:23.285 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.285 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.286 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.286 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "host", 2024-09-12T12:37:23.286 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.286 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.286 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.286 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "failure domain for any created local pool", 2024-09-12T12:37:23.286 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T12:37:23.286 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.286 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.286 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.286 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.286 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.286 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.287 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.287 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.287 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.287 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.287 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.287 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.287 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.287 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.287 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.288 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.288 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.288 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.288 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.288 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.288 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.288 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.288 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.288 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.288 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.288 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.288 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.289 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.289 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.289 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.289 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.289 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.289 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.290 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.290 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.290 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.290 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.290 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.290 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.290 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.290 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.290 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.290 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.290 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.290 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.290 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.290 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.291 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.291 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.291 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.291 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.291 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.291 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.291 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.291 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.291 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.291 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.291 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.291 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.291 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.292 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.292 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.292 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.292 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.292 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.292 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.292 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.292 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.292 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.292 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.292 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.292 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.292 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.292 INFO:teuthology.orchestra.run.smithi033.stdout: "min_size": { 2024-09-12T12:37:23.293 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "min_size", 2024-09-12T12:37:23.293 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.293 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.293 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.293 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.293 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.293 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.293 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.293 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "default min_size for any created local pool", 2024-09-12T12:37:23.293 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T12:37:23.293 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.293 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.293 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.293 INFO:teuthology.orchestra.run.smithi033.stdout: "num_rep": { 2024-09-12T12:37:23.294 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "num_rep", 2024-09-12T12:37:23.294 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.294 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.294 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.294 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "3", 2024-09-12T12:37:23.294 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.294 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.294 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.294 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "default replica count for any created local pool", 2024-09-12T12:37:23.295 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.295 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.295 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.295 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.295 INFO:teuthology.orchestra.run.smithi033.stdout: "pg_num": { 2024-09-12T12:37:23.295 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pg_num", 2024-09-12T12:37:23.295 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.295 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.295 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.295 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "128", 2024-09-12T12:37:23.295 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.295 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.295 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.295 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T12:37:23.296 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.296 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.296 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.296 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.296 INFO:teuthology.orchestra.run.smithi033.stdout: "prefix": { 2024-09-12T12:37:23.296 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "prefix", 2024-09-12T12:37:23.296 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.296 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.296 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.296 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.297 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.297 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.297 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.297 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "name prefix for any created local pool", 2024-09-12T12:37:23.297 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.297 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.297 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.297 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.297 INFO:teuthology.orchestra.run.smithi033.stdout: "subtree": { 2024-09-12T12:37:23.297 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "subtree", 2024-09-12T12:37:23.297 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.297 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.297 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.298 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "rack", 2024-09-12T12:37:23.298 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.298 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.298 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.298 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T12:37:23.298 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T12:37:23.298 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.298 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.298 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.298 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.299 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.299 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.299 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mds_autoscaler", 2024-09-12T12:37:23.299 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.299 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.299 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.299 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.300 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.300 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.300 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.300 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.300 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.300 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.300 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.300 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.301 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.301 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.301 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.301 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.301 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.301 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.301 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.301 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.301 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.301 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.301 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.302 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.302 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.302 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.302 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.302 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.302 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.303 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.303 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.303 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.303 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.303 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.303 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.303 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.303 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.303 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.304 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.304 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.304 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.304 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.304 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.304 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.304 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.304 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.304 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.304 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.304 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.304 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.304 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.305 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.305 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.305 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.305 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.305 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.305 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.305 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.305 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.305 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.305 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.305 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.305 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.305 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.305 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.306 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.306 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.306 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.306 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.306 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.306 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.306 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.306 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.306 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.306 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.306 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.307 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mirroring", 2024-09-12T12:37:23.307 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.307 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.307 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.307 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.307 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.307 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.307 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.307 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.307 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.307 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.307 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.307 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.307 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.308 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.308 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.308 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.308 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.308 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.308 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.308 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.308 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.308 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.308 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.308 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.308 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.308 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.309 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.309 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.309 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.309 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.309 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.309 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.309 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.309 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.309 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.309 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.309 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.309 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.309 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.309 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.310 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.310 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.310 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.310 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.310 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.310 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.311 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.311 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.311 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.311 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.311 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.311 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.311 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.311 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.311 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.312 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.312 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.312 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.312 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.312 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.312 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.312 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.312 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.312 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.312 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.312 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.313 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.313 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.313 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.313 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.313 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.313 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.313 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.313 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.313 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.313 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.313 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "nfs", 2024-09-12T12:37:23.313 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.313 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.313 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.314 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.314 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.314 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.314 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.314 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.314 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.314 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.314 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.314 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.314 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.314 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.314 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.314 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.315 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.315 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.315 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.315 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.315 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.315 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.315 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.315 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.315 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.315 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.315 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.315 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.315 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.315 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.316 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.316 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.316 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.316 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.316 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.316 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.316 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.316 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.316 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.317 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.317 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.317 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.317 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.317 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.317 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.317 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.317 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.317 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.317 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.317 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.317 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.317 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.317 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.318 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.318 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.318 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.318 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.318 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.318 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.318 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.318 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.318 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.318 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.318 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.318 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.318 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.318 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.319 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.319 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.319 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.319 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.319 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.319 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.319 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.319 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.319 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.319 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "orchestrator", 2024-09-12T12:37:23.319 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.319 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.319 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.319 INFO:teuthology.orchestra.run.smithi033.stdout: "fail_fs": { 2024-09-12T12:37:23.320 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "fail_fs", 2024-09-12T12:37:23.320 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.320 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.320 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.320 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.320 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.320 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.320 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.320 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T12:37:23.320 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.320 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.321 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.321 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.321 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.321 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.321 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.321 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.321 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.322 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.322 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.322 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.322 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.322 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.322 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.322 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.322 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.322 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.322 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.322 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.323 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.323 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.323 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.323 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.323 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.323 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.323 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.324 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.324 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.324 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.324 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.324 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.324 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.324 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.324 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.324 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.325 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.325 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.325 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.325 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.325 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.325 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.325 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.325 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.325 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.325 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.325 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.325 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.325 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.325 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.326 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.326 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.326 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.326 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.326 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.326 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.326 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.326 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.326 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.326 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.326 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.326 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.326 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.326 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.327 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.327 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.327 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.327 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.327 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.327 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.327 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.327 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.327 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.327 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.327 INFO:teuthology.orchestra.run.smithi033.stdout: "orchestrator": { 2024-09-12T12:37:23.327 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "orchestrator", 2024-09-12T12:37:23.327 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.327 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.328 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.328 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.328 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.328 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.328 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.328 INFO:teuthology.orchestra.run.smithi033.stdout: "cephadm", 2024-09-12T12:37:23.328 INFO:teuthology.orchestra.run.smithi033.stdout: "rook", 2024-09-12T12:37:23.328 INFO:teuthology.orchestra.run.smithi033.stdout: "test_orchestrator" 2024-09-12T12:37:23.328 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.328 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Orchestrator backend", 2024-09-12T12:37:23.328 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.328 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.328 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.328 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.329 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.329 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.329 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.329 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "osd_perf_query", 2024-09-12T12:37:23.329 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.329 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.329 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.329 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.329 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.329 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.329 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.329 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.330 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.330 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.330 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.330 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.330 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.330 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.330 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.330 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.330 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.330 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.330 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.331 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.331 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.331 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.331 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.331 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.331 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.331 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.331 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.332 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.332 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.332 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.332 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.332 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.332 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.333 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.333 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.333 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.333 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.333 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.333 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.334 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.334 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.334 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.334 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.334 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.334 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.334 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.334 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.334 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.334 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.334 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.335 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.335 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.335 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.335 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.335 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.335 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.335 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.335 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.335 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.335 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.335 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.335 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.335 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.335 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.336 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.336 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.336 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.336 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.336 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.336 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.336 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.336 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.336 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.336 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.336 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.337 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.337 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "osd_support", 2024-09-12T12:37:23.337 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.337 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.337 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.337 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.337 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.337 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.338 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.338 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.338 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.338 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.338 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.338 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.338 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.338 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.338 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.338 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.338 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.338 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.338 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.339 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.339 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.339 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.339 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.339 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.339 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.339 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.339 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.339 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.339 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.339 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.339 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.339 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.340 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.340 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.340 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.340 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.340 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.340 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.340 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.340 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.340 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.340 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.340 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.340 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.341 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.341 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.341 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.341 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.341 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.341 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.341 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.341 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.341 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.341 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.341 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.342 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.342 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.342 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.342 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.342 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.342 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.342 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.342 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.342 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.343 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.343 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.343 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.343 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.343 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.343 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.343 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.343 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.343 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.343 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.343 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.343 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.343 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pg_autoscaler", 2024-09-12T12:37:23.344 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.344 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.344 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.344 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.344 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.344 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.344 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.344 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.344 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.344 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.344 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.344 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.345 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.345 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.345 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.345 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.345 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.345 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.345 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.345 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.345 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.345 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.345 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.345 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.345 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.345 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.346 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.346 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.346 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.346 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.346 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.346 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.346 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.346 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.346 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.346 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.347 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.347 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.347 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.347 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.347 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.347 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.347 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.347 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.347 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.347 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.347 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.347 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.348 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.348 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.348 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.348 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.348 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.348 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.348 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.348 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.348 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.348 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.349 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.349 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.349 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.349 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.349 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.349 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.349 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.349 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.349 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.349 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.349 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.349 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.349 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.350 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.350 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.350 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-09-12T12:37:23.350 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-09-12T12:37:23.350 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:23.350 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.350 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.350 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-09-12T12:37:23.350 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.350 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.350 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.350 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.350 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.350 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.351 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.351 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.351 INFO:teuthology.orchestra.run.smithi033.stdout: "threshold": { 2024-09-12T12:37:23.351 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "threshold", 2024-09-12T12:37:23.351 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-09-12T12:37:23.351 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.351 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.351 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "3.0", 2024-09-12T12:37:23.351 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1.0", 2024-09-12T12:37:23.351 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.351 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.351 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "scaling threshold", 2024-09-12T12:37:23.351 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T12:37:23.351 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.352 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.352 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.352 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.352 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.352 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.352 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "progress", 2024-09-12T12:37:23.352 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.352 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.352 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.352 INFO:teuthology.orchestra.run.smithi033.stdout: "allow_pg_recovery_event": { 2024-09-12T12:37:23.353 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "allow_pg_recovery_event", 2024-09-12T12:37:23.353 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.353 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.353 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.353 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.353 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.353 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.353 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.353 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T12:37:23.353 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.353 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.354 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.354 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.354 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": { 2024-09-12T12:37:23.354 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enabled", 2024-09-12T12:37:23.354 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.354 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.354 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.354 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.354 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.354 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.354 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.354 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.354 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.355 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.355 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.355 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.355 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.355 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.355 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.355 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.355 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.355 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.355 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.355 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.355 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.355 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.355 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.356 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.356 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.356 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.356 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.356 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.356 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.356 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.356 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.356 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.356 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.356 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.356 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.356 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.357 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.357 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.357 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.357 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.357 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.357 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.357 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.357 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.357 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.357 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.357 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.357 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.357 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.357 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.358 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.358 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.358 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.358 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.358 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.358 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.358 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.358 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.358 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.358 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.358 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.358 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.358 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.358 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.359 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.359 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.359 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.359 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.359 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.359 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.359 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.359 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.359 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.359 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.359 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.359 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.359 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.359 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.359 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.360 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.360 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.360 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.360 INFO:teuthology.orchestra.run.smithi033.stdout: "max_completed_events": { 2024-09-12T12:37:23.360 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_completed_events", 2024-09-12T12:37:23.360 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.360 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.360 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.360 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "50", 2024-09-12T12:37:23.360 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.360 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.360 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.360 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "number of past completed events to remember", 2024-09-12T12:37:23.361 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.361 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.361 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.361 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.361 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-09-12T12:37:23.361 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-09-12T12:37:23.361 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:23.361 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.361 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.361 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-09-12T12:37:23.361 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.361 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.361 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.361 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how long the module is going to sleep", 2024-09-12T12:37:23.362 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.362 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.362 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.362 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.362 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.362 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.362 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.362 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "prometheus", 2024-09-12T12:37:23.362 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.362 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.362 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.362 INFO:teuthology.orchestra.run.smithi033.stdout: "cache": { 2024-09-12T12:37:23.362 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cache", 2024-09-12T12:37:23.362 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.363 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.363 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.363 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.363 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.363 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.363 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.363 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.363 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.363 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.364 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.364 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.364 INFO:teuthology.orchestra.run.smithi033.stdout: "exclude_perf_counters": { 2024-09-12T12:37:23.364 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "exclude_perf_counters", 2024-09-12T12:37:23.364 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.364 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.364 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.364 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.364 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.364 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.364 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.364 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T12:37:23.364 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T12:37:23.364 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.365 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.365 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.365 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.365 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.365 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.365 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.365 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.365 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.365 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.365 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.365 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.365 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.365 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.366 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.366 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.366 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.366 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.366 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.366 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.366 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.366 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.366 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.366 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.366 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.366 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.366 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.366 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.367 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.367 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.367 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.367 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.367 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.367 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.367 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.367 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.367 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.367 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.367 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.367 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.367 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.367 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.368 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.368 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.368 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.368 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.368 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.368 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.368 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.368 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.368 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.368 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.368 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.368 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.368 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.368 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.369 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.369 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.369 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.369 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.369 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.369 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.369 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.369 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.369 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.369 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.369 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.369 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.369 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.369 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.370 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.370 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.370 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.370 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_stats_pools": { 2024-09-12T12:37:23.370 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_stats_pools", 2024-09-12T12:37:23.370 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.370 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.370 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.370 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.370 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.370 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.370 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.370 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.371 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.371 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.371 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.371 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.371 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T12:37:23.371 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T12:37:23.371 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.371 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.371 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.371 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "300", 2024-09-12T12:37:23.371 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.371 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.371 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.371 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.371 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.372 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.372 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.372 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.372 INFO:teuthology.orchestra.run.smithi033.stdout: "scrape_interval": { 2024-09-12T12:37:23.372 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "scrape_interval", 2024-09-12T12:37:23.372 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-09-12T12:37:23.372 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.372 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.372 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "15.0", 2024-09-12T12:37:23.372 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.372 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.372 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.372 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.372 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.373 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.373 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.373 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.373 INFO:teuthology.orchestra.run.smithi033.stdout: "server_addr": { 2024-09-12T12:37:23.373 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_addr", 2024-09-12T12:37:23.373 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.373 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.373 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.373 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "::", 2024-09-12T12:37:23.373 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.374 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.374 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.374 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T12:37:23.374 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.374 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.374 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.374 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.374 INFO:teuthology.orchestra.run.smithi033.stdout: "server_port": { 2024-09-12T12:37:23.374 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_port", 2024-09-12T12:37:23.374 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.374 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.375 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.375 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "9283", 2024-09-12T12:37:23.375 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.375 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.375 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.375 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T12:37:23.375 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.375 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.375 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.375 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.375 INFO:teuthology.orchestra.run.smithi033.stdout: "stale_cache_strategy": { 2024-09-12T12:37:23.375 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "stale_cache_strategy", 2024-09-12T12:37:23.376 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.376 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.376 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.376 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "log", 2024-09-12T12:37:23.376 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.376 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.376 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.376 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.376 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.376 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.376 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.376 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.377 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_behaviour": { 2024-09-12T12:37:23.377 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_behaviour", 2024-09-12T12:37:23.377 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.377 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.377 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.378 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "default", 2024-09-12T12:37:23.378 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.378 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.378 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.378 INFO:teuthology.orchestra.run.smithi033.stdout: "default", 2024-09-12T12:37:23.378 INFO:teuthology.orchestra.run.smithi033.stdout: "error" 2024-09-12T12:37:23.378 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.378 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.378 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.378 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.378 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.378 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.378 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_error_status_code": { 2024-09-12T12:37:23.378 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_error_status_code", 2024-09-12T12:37:23.379 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.379 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.379 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.379 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "500", 2024-09-12T12:37:23.379 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "400", 2024-09-12T12:37:23.379 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "599", 2024-09-12T12:37:23.379 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.379 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.379 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.379 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.379 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.379 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.379 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.379 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.380 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.380 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_support", 2024-09-12T12:37:23.380 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.380 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.380 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.380 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.380 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.380 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.380 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.380 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.380 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.380 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.380 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.381 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.381 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.381 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.381 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.381 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.381 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.381 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.381 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.381 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.381 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.381 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.381 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.381 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.382 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.382 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.382 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.382 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.382 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.382 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.382 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.382 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.382 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.382 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.382 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.382 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.382 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.383 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.383 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.383 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.383 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.383 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.383 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.383 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.383 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.383 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.383 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.383 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.383 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.383 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.383 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.384 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.384 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.384 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.384 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.384 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.384 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.384 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.384 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.384 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.384 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.384 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.384 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.385 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.385 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.385 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.385 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.385 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.385 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.385 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.385 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.385 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.385 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.385 INFO:teuthology.orchestra.run.smithi033.stdout: "max_concurrent_snap_create": { 2024-09-12T12:37:23.386 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_concurrent_snap_create", 2024-09-12T12:37:23.386 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.386 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.386 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.386 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-12T12:37:23.386 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.386 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.386 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.386 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.386 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.386 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.386 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.386 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.386 INFO:teuthology.orchestra.run.smithi033.stdout: "mirror_snapshot_schedule": { 2024-09-12T12:37:23.387 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T12:37:23.387 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.387 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.387 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.387 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.387 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.387 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.387 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.387 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.387 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.387 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.387 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.387 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.387 INFO:teuthology.orchestra.run.smithi033.stdout: "trash_purge_schedule": { 2024-09-12T12:37:23.388 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "trash_purge_schedule", 2024-09-12T12:37:23.388 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.388 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.388 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.388 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.388 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.388 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.388 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.388 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.388 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.388 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.388 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.388 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.389 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.389 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.389 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.389 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "restful", 2024-09-12T12:37:23.389 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.389 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.389 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.389 INFO:teuthology.orchestra.run.smithi033.stdout: "enable_auth": { 2024-09-12T12:37:23.389 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enable_auth", 2024-09-12T12:37:23.389 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.389 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.389 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.389 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.389 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.390 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.390 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.390 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.390 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.390 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.390 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.390 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.390 INFO:teuthology.orchestra.run.smithi033.stdout: "key_file": { 2024-09-12T12:37:23.390 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "key_file", 2024-09-12T12:37:23.390 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.390 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.390 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.390 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.390 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.390 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.391 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.391 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.391 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.391 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.391 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.391 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.391 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.391 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.391 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.392 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.392 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.392 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.392 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.392 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.392 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.392 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.392 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.392 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.392 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.392 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.392 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.392 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.392 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.393 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.393 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.393 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.393 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.393 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.393 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.393 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.393 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.393 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.393 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.393 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.393 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.393 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.394 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.394 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.394 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.394 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.394 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.394 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.394 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.394 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.394 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.394 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.394 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.395 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.395 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.395 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.395 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.395 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.395 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.395 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.395 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.396 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.396 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.396 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.396 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.396 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.396 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.396 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.396 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.396 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.396 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.396 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.397 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.397 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.397 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.397 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.397 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.397 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.397 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.397 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.397 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.397 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.397 INFO:teuthology.orchestra.run.smithi033.stdout: "server_addr": { 2024-09-12T12:37:23.397 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_addr", 2024-09-12T12:37:23.397 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.398 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.398 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.398 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.398 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.398 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.398 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.399 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.399 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.399 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.399 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.399 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.399 INFO:teuthology.orchestra.run.smithi033.stdout: "server_port": { 2024-09-12T12:37:23.400 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_port", 2024-09-12T12:37:23.400 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.400 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.400 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.400 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.400 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.401 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.401 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.401 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.401 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.401 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.402 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.402 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.402 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.402 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.402 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.402 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rgw", 2024-09-12T12:37:23.403 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.403 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.403 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.403 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.403 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.404 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.404 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.404 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.404 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.404 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.405 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.405 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.405 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.405 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.405 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.406 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.406 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.406 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.406 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.406 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.406 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.407 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.407 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.407 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.407 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.407 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.407 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.408 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.408 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.408 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.408 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.408 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.409 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.409 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.409 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.409 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.409 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.410 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.410 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.410 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.410 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.410 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.410 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.411 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.411 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.411 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.411 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.411 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.412 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.412 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.412 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.412 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.412 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.412 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.413 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.413 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.413 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.413 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.413 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.414 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.414 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.414 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.414 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.414 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.414 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.415 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.415 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.415 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.415 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.415 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.415 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.416 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.416 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.416 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.416 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.416 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.417 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rook", 2024-09-12T12:37:23.417 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.417 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.417 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.417 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.417 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.418 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.418 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.418 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.418 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.418 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.418 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.419 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.419 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.419 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.419 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.419 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.420 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.420 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.420 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.420 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.421 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.421 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.421 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.421 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.421 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.422 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.422 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.422 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.422 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.422 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.422 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.423 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.423 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.423 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.423 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.423 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.424 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.424 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.424 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.424 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.424 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.424 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.425 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.425 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.425 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.425 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.425 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.426 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.426 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.426 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.426 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.426 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.427 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.427 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.427 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.427 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.427 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.427 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.428 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.428 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.428 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.428 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.428 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.429 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.429 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.429 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.429 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.429 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.429 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.430 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.430 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.430 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.430 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.430 INFO:teuthology.orchestra.run.smithi033.stdout: "storage_class": { 2024-09-12T12:37:23.431 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "storage_class", 2024-09-12T12:37:23.431 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.431 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.431 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.431 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "local", 2024-09-12T12:37:23.432 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.432 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.432 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.432 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T12:37:23.432 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.432 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.433 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.433 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.433 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.433 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.433 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.433 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "selftest", 2024-09-12T12:37:23.434 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.434 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.434 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.434 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.434 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.435 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.435 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.435 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.435 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.435 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.435 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.436 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.436 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.436 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.436 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.436 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.437 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.437 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.437 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.437 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.437 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.437 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.438 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.438 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.438 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.438 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.438 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.439 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.439 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.439 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.439 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.439 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.439 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.440 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.440 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.440 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.440 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.440 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.441 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.441 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.441 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.441 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.441 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.441 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.442 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.442 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.442 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.442 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.442 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.442 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.443 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.443 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.443 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.443 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.443 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.443 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.443 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.443 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.443 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.443 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.443 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.443 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.443 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.443 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.444 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.444 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.444 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.444 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.444 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.444 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.444 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.444 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.444 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.444 INFO:teuthology.orchestra.run.smithi033.stdout: "roption1": { 2024-09-12T12:37:23.444 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "roption1", 2024-09-12T12:37:23.444 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.444 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.444 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.445 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.445 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.445 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.445 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.445 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.445 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.445 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.445 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.445 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.445 INFO:teuthology.orchestra.run.smithi033.stdout: "roption2": { 2024-09-12T12:37:23.445 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "roption2", 2024-09-12T12:37:23.445 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.445 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.445 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.446 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "xyz", 2024-09-12T12:37:23.446 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.446 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.446 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.446 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.446 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.446 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.446 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.446 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.446 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption1": { 2024-09-12T12:37:23.446 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption1", 2024-09-12T12:37:23.446 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.446 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.446 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.447 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.447 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.447 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.447 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.447 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.447 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.447 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.447 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.447 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.447 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption2": { 2024-09-12T12:37:23.447 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption2", 2024-09-12T12:37:23.447 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.447 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.447 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.448 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.448 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.448 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.448 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.448 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.448 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.448 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.448 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.448 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.448 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption3": { 2024-09-12T12:37:23.448 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption3", 2024-09-12T12:37:23.448 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-09-12T12:37:23.449 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.449 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.449 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.449 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.449 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.449 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.449 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.449 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.449 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.449 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.449 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.449 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption4": { 2024-09-12T12:37:23.449 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption4", 2024-09-12T12:37:23.449 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.450 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.450 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.450 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.450 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.450 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.450 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.450 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.450 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.450 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.450 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.450 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.450 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption5": { 2024-09-12T12:37:23.450 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption5", 2024-09-12T12:37:23.450 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.451 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.451 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.451 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.451 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.451 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.451 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.451 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.451 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.451 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.451 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.451 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.451 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption6": { 2024-09-12T12:37:23.451 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption6", 2024-09-12T12:37:23.451 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.452 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.452 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.452 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.452 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.452 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.452 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.452 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.452 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.452 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.452 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.452 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.452 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption7": { 2024-09-12T12:37:23.452 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption7", 2024-09-12T12:37:23.452 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.453 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.453 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.453 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.453 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-09-12T12:37:23.453 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "42", 2024-09-12T12:37:23.453 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.453 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.453 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.453 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.453 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.453 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.453 INFO:teuthology.orchestra.run.smithi033.stdout: "testkey": { 2024-09-12T12:37:23.453 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "testkey", 2024-09-12T12:37:23.454 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.454 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.454 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.454 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.454 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.454 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.454 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.454 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.454 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.454 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.454 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.454 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.454 INFO:teuthology.orchestra.run.smithi033.stdout: "testlkey": { 2024-09-12T12:37:23.454 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "testlkey", 2024-09-12T12:37:23.455 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.455 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.455 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.455 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.455 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.455 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.455 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.455 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.455 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.455 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.455 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.455 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.455 INFO:teuthology.orchestra.run.smithi033.stdout: "testnewline": { 2024-09-12T12:37:23.455 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "testnewline", 2024-09-12T12:37:23.456 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.456 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.456 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.456 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.456 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.456 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.456 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.456 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.456 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.456 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.456 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.456 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.456 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.456 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.457 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.457 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snap_schedule", 2024-09-12T12:37:23.457 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.457 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.457 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.457 INFO:teuthology.orchestra.run.smithi033.stdout: "allow_m_granularity": { 2024-09-12T12:37:23.457 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "allow_m_granularity", 2024-09-12T12:37:23.457 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.457 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.457 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.457 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.457 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.457 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.457 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.458 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T12:37:23.458 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.460 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.460 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.461 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.461 INFO:teuthology.orchestra.run.smithi033.stdout: "dump_on_update": { 2024-09-12T12:37:23.461 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "dump_on_update", 2024-09-12T12:37:23.461 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.461 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.461 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.461 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.461 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.461 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.461 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.461 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "dump database to debug log on update", 2024-09-12T12:37:23.461 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.461 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.461 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.462 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.462 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.462 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.462 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.462 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.462 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.462 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.462 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.462 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.462 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.462 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.462 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.462 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.462 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.462 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.463 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.463 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.463 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.463 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.463 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.463 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.463 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.463 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.463 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.463 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.463 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.463 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.463 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.463 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.464 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.464 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.464 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.464 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.464 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.464 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.464 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.464 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.464 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.464 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.464 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.464 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.465 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.465 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.465 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.465 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.465 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.465 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.465 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.465 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.465 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.465 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.465 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.465 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.465 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.465 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.466 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.466 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.466 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.466 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.466 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.466 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.466 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.466 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.466 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.466 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.466 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.466 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.466 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.466 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.467 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.467 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.467 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.467 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.467 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.467 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "stats", 2024-09-12T12:37:23.467 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.467 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.467 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.467 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.467 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.467 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.467 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.467 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.468 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.468 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.468 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.468 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.468 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.468 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.468 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.468 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.468 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.468 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.468 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.468 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.468 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.469 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.469 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.469 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.469 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.469 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.469 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.469 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.469 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.469 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.469 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.469 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.469 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.469 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.470 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.470 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.470 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.470 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.470 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.470 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.470 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.470 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.470 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.470 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.470 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.470 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.470 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.470 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.471 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.471 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.471 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.471 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.471 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.471 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.471 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.471 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.471 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.471 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.471 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.471 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.471 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.471 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.472 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.472 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.472 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.472 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.472 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.472 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.472 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.472 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.472 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.472 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.472 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.472 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.472 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.472 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.473 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "status", 2024-09-12T12:37:23.473 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.473 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.473 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.473 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.473 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.473 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.473 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.473 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.473 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.473 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.473 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.473 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.473 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.473 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.474 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.474 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.474 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.474 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.474 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.474 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.474 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.474 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.474 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.474 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.474 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.474 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.474 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.474 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.475 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.475 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.475 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.475 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.475 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.475 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.475 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.475 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.475 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.475 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.475 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.475 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.475 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.475 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.476 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.476 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.476 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.476 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.476 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.476 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.476 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.476 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.476 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.476 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.476 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.476 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.476 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.476 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.477 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.477 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.477 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.477 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.477 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.477 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.477 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.477 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.477 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.477 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.477 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.477 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.477 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.477 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.477 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.478 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.478 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.478 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.478 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.478 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.478 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "telegraf", 2024-09-12T12:37:23.478 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.478 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.478 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.478 INFO:teuthology.orchestra.run.smithi033.stdout: "address": { 2024-09-12T12:37:23.478 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "address", 2024-09-12T12:37:23.478 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.478 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.478 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.479 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T12:37:23.479 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.479 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.479 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.479 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.479 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.479 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.479 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.479 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.479 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-09-12T12:37:23.479 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-09-12T12:37:23.479 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:23.480 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.480 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.480 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "15", 2024-09-12T12:37:23.480 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.480 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.480 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.480 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.480 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.480 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.480 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.480 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.480 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.480 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.480 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.481 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.481 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.481 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.481 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.481 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.481 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.481 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.481 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.481 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.481 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.481 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.481 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.481 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.481 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.482 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.482 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.482 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.482 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.482 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.482 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.482 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.482 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.482 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.482 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.482 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.482 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.482 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.482 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.483 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.483 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.483 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.483 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.483 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.483 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.483 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.483 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.483 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.483 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.483 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.483 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.483 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.483 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.484 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.484 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.484 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.484 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.484 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.484 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.484 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.484 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.484 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.484 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.484 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.484 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.484 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.484 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.485 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.485 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.485 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.485 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.485 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.485 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.485 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.485 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.485 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.485 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.485 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.485 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.485 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.485 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.486 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "telemetry", 2024-09-12T12:37:23.486 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.486 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.486 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.486 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_basic": { 2024-09-12T12:37:23.486 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_basic", 2024-09-12T12:37:23.486 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.486 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.486 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.486 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.486 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.486 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.486 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.486 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T12:37:23.487 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.487 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.487 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.487 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.487 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_crash": { 2024-09-12T12:37:23.487 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_crash", 2024-09-12T12:37:23.487 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.487 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.487 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.487 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.487 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.487 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.487 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.487 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T12:37:23.488 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.488 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.488 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.488 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.488 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_device": { 2024-09-12T12:37:23.488 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_device", 2024-09-12T12:37:23.488 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.488 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.488 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.488 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.488 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.488 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.488 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.488 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T12:37:23.489 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.489 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.489 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.489 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.489 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_ident": { 2024-09-12T12:37:23.489 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_ident", 2024-09-12T12:37:23.489 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.489 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.489 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.489 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.489 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.489 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.489 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.489 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T12:37:23.490 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.490 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.490 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.490 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.490 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_perf": { 2024-09-12T12:37:23.490 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_perf", 2024-09-12T12:37:23.490 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.490 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.490 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.490 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.490 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.490 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.490 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.490 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T12:37:23.490 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.491 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.491 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.491 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.491 INFO:teuthology.orchestra.run.smithi033.stdout: "contact": { 2024-09-12T12:37:23.491 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "contact", 2024-09-12T12:37:23.491 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.491 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.491 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.491 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.491 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.491 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.491 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.491 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.491 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.492 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.492 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.492 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.492 INFO:teuthology.orchestra.run.smithi033.stdout: "description": { 2024-09-12T12:37:23.492 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "description", 2024-09-12T12:37:23.492 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.492 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.492 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.492 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.492 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.492 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.492 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.493 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.493 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.493 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.493 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.493 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.493 INFO:teuthology.orchestra.run.smithi033.stdout: "device_url": { 2024-09-12T12:37:23.493 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "device_url", 2024-09-12T12:37:23.493 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.493 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.493 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.493 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T12:37:23.493 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.493 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.493 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.493 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.494 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.494 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.494 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.494 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.494 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": { 2024-09-12T12:37:23.494 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enabled", 2024-09-12T12:37:23.494 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.494 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.494 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.494 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.494 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.494 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.494 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.494 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.495 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.495 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.495 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.495 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.495 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-09-12T12:37:23.495 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-09-12T12:37:23.495 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.495 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.495 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.495 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "24", 2024-09-12T12:37:23.495 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "8", 2024-09-12T12:37:23.495 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.495 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.496 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.496 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.496 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.496 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.496 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.496 INFO:teuthology.orchestra.run.smithi033.stdout: "last_opt_revision": { 2024-09-12T12:37:23.496 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "last_opt_revision", 2024-09-12T12:37:23.496 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.496 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.496 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.496 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "1", 2024-09-12T12:37:23.496 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.496 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.497 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.497 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.497 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.497 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.497 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.497 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.497 INFO:teuthology.orchestra.run.smithi033.stdout: "leaderboard": { 2024-09-12T12:37:23.497 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "leaderboard", 2024-09-12T12:37:23.497 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.497 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.497 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.497 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.497 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.497 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.498 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.498 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.498 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.498 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.498 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.498 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.498 INFO:teuthology.orchestra.run.smithi033.stdout: "leaderboard_description": { 2024-09-12T12:37:23.498 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "leaderboard_description", 2024-09-12T12:37:23.498 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.498 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.498 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.498 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.498 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.498 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.499 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.499 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.499 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.499 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.499 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.499 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.499 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.499 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.499 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.499 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.499 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.499 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.499 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.499 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.500 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.500 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.500 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.500 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.500 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.500 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.500 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.500 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.500 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.500 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.500 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.500 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.500 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.500 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.501 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.501 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.501 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.501 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.501 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.501 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.501 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.501 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.501 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.501 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.501 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.501 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.501 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.502 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.502 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.502 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.502 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.502 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.502 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.502 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.502 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.502 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.502 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.502 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.502 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.502 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.502 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.503 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.503 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.503 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.503 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.503 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.503 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.503 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.503 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.503 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.503 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.503 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.503 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.503 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.503 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.504 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.504 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.504 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.504 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.504 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.504 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.504 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.504 INFO:teuthology.orchestra.run.smithi033.stdout: "organization": { 2024-09-12T12:37:23.504 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "organization", 2024-09-12T12:37:23.504 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.504 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.504 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.504 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.504 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.505 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.505 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.505 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.505 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.505 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.505 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.505 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.505 INFO:teuthology.orchestra.run.smithi033.stdout: "proxy": { 2024-09-12T12:37:23.505 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "proxy", 2024-09-12T12:37:23.505 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.505 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.505 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.505 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.506 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.506 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.506 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.506 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.506 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.506 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.506 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.506 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.506 INFO:teuthology.orchestra.run.smithi033.stdout: "url": { 2024-09-12T12:37:23.506 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "url", 2024-09-12T12:37:23.506 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.506 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.507 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.507 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T12:37:23.507 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.507 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.507 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.507 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.507 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.507 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.507 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.507 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.507 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.507 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.507 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.508 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "test_orchestrator", 2024-09-12T12:37:23.508 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.508 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.508 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.508 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.508 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.508 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.508 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.508 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.508 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.508 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.508 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.508 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.508 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.509 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.509 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.509 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.509 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.509 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.509 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.509 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.509 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.509 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.509 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.509 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.509 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.510 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.510 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.510 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.510 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.510 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.510 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.510 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.510 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.510 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.510 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.510 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.510 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.510 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.510 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.511 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.511 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.511 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.511 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.511 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.511 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.511 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.511 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.511 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.511 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.511 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.511 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.511 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.511 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.512 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.512 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.512 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.512 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.512 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.512 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.512 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.512 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.512 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.512 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.512 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.512 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.512 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.513 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.513 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.513 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.513 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.513 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.513 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.513 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.513 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.513 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.513 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.513 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "volumes", 2024-09-12T12:37:23.513 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.513 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.513 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.514 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.514 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.514 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.514 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.514 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.514 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.514 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.514 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.514 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.514 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.514 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.514 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.514 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.514 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.515 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.515 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.515 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.515 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.515 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.515 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.515 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.515 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.515 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.515 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.515 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.515 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.515 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.515 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.515 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.516 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.516 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.516 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.516 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.516 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.516 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.516 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.516 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.516 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.516 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.516 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.516 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.516 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.516 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.517 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.517 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.517 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.517 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.517 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.517 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.517 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.517 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.517 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.517 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.517 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.517 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.517 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.517 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.518 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.518 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.518 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.518 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.518 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.518 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.518 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.518 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.518 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.518 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.518 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.518 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.518 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.518 INFO:teuthology.orchestra.run.smithi033.stdout: "max_concurrent_clones": { 2024-09-12T12:37:23.518 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_concurrent_clones", 2024-09-12T12:37:23.519 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.519 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.519 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.519 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "4", 2024-09-12T12:37:23.519 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.519 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.519 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.519 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T12:37:23.519 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.519 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.519 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.519 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.519 INFO:teuthology.orchestra.run.smithi033.stdout: "periodic_async_work": { 2024-09-12T12:37:23.520 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "periodic_async_work", 2024-09-12T12:37:23.520 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.520 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.520 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.520 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.520 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.520 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.520 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.520 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Periodically check for async work", 2024-09-12T12:37:23.520 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.520 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.520 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.520 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.521 INFO:teuthology.orchestra.run.smithi033.stdout: "snapshot_clone_delay": { 2024-09-12T12:37:23.521 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snapshot_clone_delay", 2024-09-12T12:37:23.521 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.521 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.521 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.521 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-12T12:37:23.521 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.521 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.521 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.521 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T12:37:23.521 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.521 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.521 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.521 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.522 INFO:teuthology.orchestra.run.smithi033.stdout: "snapshot_clone_no_wait": { 2024-09-12T12:37:23.522 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T12:37:23.522 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.522 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.522 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.522 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.522 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.522 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.522 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.522 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T12:37:23.522 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.522 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.522 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.522 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.523 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.523 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.523 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.523 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix", 2024-09-12T12:37:23.523 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.523 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.523 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.523 INFO:teuthology.orchestra.run.smithi033.stdout: "discovery_interval": { 2024-09-12T12:37:23.523 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "discovery_interval", 2024-09-12T12:37:23.523 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-09-12T12:37:23.523 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.523 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.523 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "100", 2024-09-12T12:37:23.523 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.524 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.524 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.524 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.524 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.524 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.524 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.524 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.524 INFO:teuthology.orchestra.run.smithi033.stdout: "identifier": { 2024-09-12T12:37:23.524 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "identifier", 2024-09-12T12:37:23.524 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.524 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.524 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.524 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.525 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.525 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.525 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.525 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.525 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.525 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.525 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.525 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.525 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-09-12T12:37:23.525 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-09-12T12:37:23.525 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:23.525 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.525 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.525 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-09-12T12:37:23.526 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.526 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.526 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.526 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.526 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.526 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.526 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.526 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.526 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.526 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.526 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.526 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.526 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.526 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.527 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.527 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.527 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.527 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.527 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.527 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.527 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.527 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.527 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.527 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.527 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.527 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.527 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.527 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.528 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.528 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.528 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.528 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.528 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.528 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.528 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.528 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.528 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.528 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.528 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.528 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.528 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.528 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.529 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.529 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.529 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.529 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.529 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.529 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.529 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.529 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.529 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.529 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.529 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.529 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.529 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.529 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.530 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.530 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.530 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.530 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.530 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.530 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.530 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.530 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.530 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.530 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.530 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.530 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.530 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.530 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.530 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.531 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.531 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.531 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.531 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.531 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.531 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.531 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.531 INFO:teuthology.orchestra.run.smithi033.stdout: "zabbix_host": { 2024-09-12T12:37:23.531 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix_host", 2024-09-12T12:37:23.531 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.531 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.531 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.531 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.531 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.532 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.532 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.532 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.532 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.532 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.532 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.532 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.532 INFO:teuthology.orchestra.run.smithi033.stdout: "zabbix_port": { 2024-09-12T12:37:23.532 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix_port", 2024-09-12T12:37:23.532 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.532 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.532 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.532 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10051", 2024-09-12T12:37:23.532 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.533 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.533 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.533 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.533 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.533 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.533 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.533 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.533 INFO:teuthology.orchestra.run.smithi033.stdout: "zabbix_sender": { 2024-09-12T12:37:23.533 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix_sender", 2024-09-12T12:37:23.533 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.533 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.533 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.533 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T12:37:23.533 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.534 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.534 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.534 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.534 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.534 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.534 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.534 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.534 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.534 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.534 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-09-12T12:37:23.534 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.534 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.534 INFO:teuthology.orchestra.run.smithi033.stdout: "gid": 24125, 2024-09-12T12:37:23.535 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "y", 2024-09-12T12:37:23.535 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr_features": 4540701547738038271, 2024-09-12T12:37:23.535 INFO:teuthology.orchestra.run.smithi033.stdout: "available_modules": [ 2024-09-12T12:37:23.535 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.535 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "alerts", 2024-09-12T12:37:23.535 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.535 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.535 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.535 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-09-12T12:37:23.535 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-09-12T12:37:23.535 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:23.535 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.535 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.535 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-09-12T12:37:23.536 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.536 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.536 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.536 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T12:37:23.536 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.536 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.536 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.536 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.536 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.536 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.536 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.536 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.536 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.537 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.537 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.537 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.537 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.537 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.537 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.537 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.537 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.537 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.537 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.537 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.537 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.537 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.537 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.538 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.538 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.538 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.538 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.538 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.538 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.538 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.538 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.538 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.538 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.538 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.538 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.538 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.538 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.539 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.539 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.539 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.539 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.539 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.539 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.539 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.539 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.539 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.539 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.539 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.539 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.539 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.540 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.540 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.540 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.540 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.540 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.540 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.540 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.540 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.540 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.540 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.540 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.540 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.540 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.541 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.541 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.541 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.541 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.541 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.541 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.541 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.541 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.541 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.541 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.541 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.541 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_destination": { 2024-09-12T12:37:23.541 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_destination", 2024-09-12T12:37:23.541 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.542 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.542 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.542 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.542 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.542 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.542 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.542 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Email address to send alerts to", 2024-09-12T12:37:23.542 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.542 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.542 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.542 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.542 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_from_name": { 2024-09-12T12:37:23.542 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_from_name", 2024-09-12T12:37:23.542 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.543 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.543 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.543 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "Ceph", 2024-09-12T12:37:23.543 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.543 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.543 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.543 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Email From: name", 2024-09-12T12:37:23.543 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.543 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.543 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.543 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.543 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_host": { 2024-09-12T12:37:23.543 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_host", 2024-09-12T12:37:23.544 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.544 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.544 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.544 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.544 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.544 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.544 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.544 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SMTP server", 2024-09-12T12:37:23.544 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.544 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.544 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.544 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.544 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_password": { 2024-09-12T12:37:23.545 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_password", 2024-09-12T12:37:23.545 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.545 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.545 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.545 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.545 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.545 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.545 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.545 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Password to authenticate with", 2024-09-12T12:37:23.545 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.545 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.545 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.545 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.545 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_port": { 2024-09-12T12:37:23.546 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_port", 2024-09-12T12:37:23.546 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.546 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.546 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.546 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "465", 2024-09-12T12:37:23.546 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.546 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.546 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.546 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SMTP port", 2024-09-12T12:37:23.546 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.546 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.546 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.546 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.546 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_sender": { 2024-09-12T12:37:23.547 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_sender", 2024-09-12T12:37:23.547 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.547 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.547 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.547 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.547 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.547 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.547 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.547 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SMTP envelope sender", 2024-09-12T12:37:23.547 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.547 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.547 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.547 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.547 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_ssl": { 2024-09-12T12:37:23.548 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_ssl", 2024-09-12T12:37:23.548 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.548 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.548 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.548 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.548 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.548 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.548 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.548 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T12:37:23.548 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.548 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.548 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.549 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.549 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_user": { 2024-09-12T12:37:23.549 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_user", 2024-09-12T12:37:23.549 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.549 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.549 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.549 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.549 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.549 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.549 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.549 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "User to authenticate as", 2024-09-12T12:37:23.549 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.549 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.550 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.550 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.550 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.550 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.550 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.550 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "balancer", 2024-09-12T12:37:23.550 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.550 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.550 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.550 INFO:teuthology.orchestra.run.smithi033.stdout: "active": { 2024-09-12T12:37:23.550 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "active", 2024-09-12T12:37:23.550 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.550 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.550 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.551 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.551 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.551 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.551 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.551 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T12:37:23.551 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.551 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.551 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.551 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.551 INFO:teuthology.orchestra.run.smithi033.stdout: "begin_time": { 2024-09-12T12:37:23.551 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "begin_time", 2024-09-12T12:37:23.551 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.551 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.552 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.552 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0000", 2024-09-12T12:37:23.552 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.552 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.552 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.552 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T12:37:23.552 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T12:37:23.552 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.552 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.552 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.552 INFO:teuthology.orchestra.run.smithi033.stdout: "begin_weekday": { 2024-09-12T12:37:23.553 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "begin_weekday", 2024-09-12T12:37:23.553 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-09-12T12:37:23.553 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.553 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.553 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-12T12:37:23.553 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "0", 2024-09-12T12:37:23.553 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "6", 2024-09-12T12:37:23.553 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.553 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T12:37:23.553 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T12:37:23.553 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.553 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.553 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.554 INFO:teuthology.orchestra.run.smithi033.stdout: "crush_compat_max_iterations": { 2024-09-12T12:37:23.554 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crush_compat_max_iterations", 2024-09-12T12:37:23.554 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-09-12T12:37:23.554 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.554 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.554 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "25", 2024-09-12T12:37:23.554 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-09-12T12:37:23.554 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "250", 2024-09-12T12:37:23.554 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.554 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T12:37:23.554 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.554 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.554 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.554 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.555 INFO:teuthology.orchestra.run.smithi033.stdout: "crush_compat_metrics": { 2024-09-12T12:37:23.555 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crush_compat_metrics", 2024-09-12T12:37:23.555 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.555 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.555 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.555 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T12:37:23.555 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.555 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.555 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.555 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T12:37:23.555 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T12:37:23.555 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.555 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.556 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.556 INFO:teuthology.orchestra.run.smithi033.stdout: "crush_compat_step": { 2024-09-12T12:37:23.556 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crush_compat_step", 2024-09-12T12:37:23.556 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-09-12T12:37:23.556 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.556 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.556 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0.5", 2024-09-12T12:37:23.556 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "0.001", 2024-09-12T12:37:23.556 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "0.999", 2024-09-12T12:37:23.556 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.556 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "aggressiveness of optimization", 2024-09-12T12:37:23.556 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T12:37:23.556 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.557 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.557 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.557 INFO:teuthology.orchestra.run.smithi033.stdout: "end_time": { 2024-09-12T12:37:23.557 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "end_time", 2024-09-12T12:37:23.557 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.557 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.557 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.557 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "2359", 2024-09-12T12:37:23.557 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.557 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.557 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.557 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T12:37:23.557 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T12:37:23.557 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.558 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.558 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.558 INFO:teuthology.orchestra.run.smithi033.stdout: "end_weekday": { 2024-09-12T12:37:23.558 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "end_weekday", 2024-09-12T12:37:23.558 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-09-12T12:37:23.558 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.558 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.558 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-12T12:37:23.558 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "0", 2024-09-12T12:37:23.558 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "6", 2024-09-12T12:37:23.558 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.558 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T12:37:23.558 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T12:37:23.558 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.558 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.559 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.559 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.559 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.559 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.559 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.559 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.559 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.559 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.559 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.559 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.559 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.559 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.559 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.559 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.560 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.560 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.560 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.560 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.560 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.560 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.560 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.560 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.560 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.560 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.560 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.560 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.560 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.560 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.561 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.561 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.561 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.561 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.561 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.561 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.561 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.561 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.561 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.561 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.561 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.561 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.561 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.562 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.562 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.562 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.562 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.562 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.562 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.562 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.562 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.562 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.562 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.562 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.562 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.562 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.562 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.563 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.563 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.563 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.563 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.563 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.563 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.563 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.563 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.563 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.563 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.563 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.563 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.563 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.563 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.563 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.564 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.564 INFO:teuthology.orchestra.run.smithi033.stdout: "min_score": { 2024-09-12T12:37:23.564 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "min_score", 2024-09-12T12:37:23.564 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-09-12T12:37:23.564 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.564 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.564 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-12T12:37:23.564 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.564 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.564 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.564 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T12:37:23.564 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.564 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.565 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.565 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.565 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": { 2024-09-12T12:37:23.565 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mode", 2024-09-12T12:37:23.565 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.565 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.565 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.565 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "upmap", 2024-09-12T12:37:23.565 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.565 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.565 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.565 INFO:teuthology.orchestra.run.smithi033.stdout: "crush-compat", 2024-09-12T12:37:23.565 INFO:teuthology.orchestra.run.smithi033.stdout: "none", 2024-09-12T12:37:23.565 INFO:teuthology.orchestra.run.smithi033.stdout: "read", 2024-09-12T12:37:23.566 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap", 2024-09-12T12:37:23.566 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap-read" 2024-09-12T12:37:23.566 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.566 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Balancer mode", 2024-09-12T12:37:23.566 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.566 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.566 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.566 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.566 INFO:teuthology.orchestra.run.smithi033.stdout: "pool_ids": { 2024-09-12T12:37:23.566 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pool_ids", 2024-09-12T12:37:23.566 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.566 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.566 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.566 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.566 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.567 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.567 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.567 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T12:37:23.567 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.567 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.567 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.567 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.567 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-09-12T12:37:23.567 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-09-12T12:37:23.567 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:23.567 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.567 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.567 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-09-12T12:37:23.568 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.568 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.568 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.568 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T12:37:23.568 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.568 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.568 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.568 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.568 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap_max_deviation": { 2024-09-12T12:37:23.568 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "upmap_max_deviation", 2024-09-12T12:37:23.568 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.568 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.568 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.569 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-09-12T12:37:23.569 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-09-12T12:37:23.569 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.569 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.569 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T12:37:23.569 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T12:37:23.569 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.569 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.569 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.569 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap_max_optimizations": { 2024-09-12T12:37:23.569 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "upmap_max_optimizations", 2024-09-12T12:37:23.569 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-09-12T12:37:23.569 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.569 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.569 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-12T12:37:23.570 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.570 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.570 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.570 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T12:37:23.570 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.570 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.570 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.570 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.570 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.570 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.570 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.570 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephadm", 2024-09-12T12:37:23.570 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.570 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.571 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.571 INFO:teuthology.orchestra.run.smithi033.stdout: "agent_down_multiplier": { 2024-09-12T12:37:23.571 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "agent_down_multiplier", 2024-09-12T12:37:23.571 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-09-12T12:37:23.571 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.571 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.571 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "3.0", 2024-09-12T12:37:23.571 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.571 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.571 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.571 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T12:37:23.571 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.571 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.571 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.571 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.572 INFO:teuthology.orchestra.run.smithi033.stdout: "agent_refresh_rate": { 2024-09-12T12:37:23.572 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "agent_refresh_rate", 2024-09-12T12:37:23.572 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:23.572 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.572 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.572 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "20", 2024-09-12T12:37:23.572 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.572 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.572 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.572 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T12:37:23.572 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.572 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.572 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.573 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.573 INFO:teuthology.orchestra.run.smithi033.stdout: "agent_starting_port": { 2024-09-12T12:37:23.573 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "agent_starting_port", 2024-09-12T12:37:23.573 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.573 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.573 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.573 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "4721", 2024-09-12T12:37:23.573 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.573 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.573 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.573 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T12:37:23.573 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.573 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.573 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.573 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.574 INFO:teuthology.orchestra.run.smithi033.stdout: "allow_ptrace": { 2024-09-12T12:37:23.574 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "allow_ptrace", 2024-09-12T12:37:23.574 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.574 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.574 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.574 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.574 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.574 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.574 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.574 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T12:37:23.574 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T12:37:23.574 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.574 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.575 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.575 INFO:teuthology.orchestra.run.smithi033.stdout: "autotune_interval": { 2024-09-12T12:37:23.575 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "autotune_interval", 2024-09-12T12:37:23.575 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:23.575 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.575 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.575 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-09-12T12:37:23.575 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.575 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.575 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.575 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T12:37:23.575 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.575 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.575 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.576 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.576 INFO:teuthology.orchestra.run.smithi033.stdout: "autotune_memory_target_ratio": { 2024-09-12T12:37:23.576 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T12:37:23.576 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-09-12T12:37:23.576 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.576 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.576 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0.7", 2024-09-12T12:37:23.576 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.576 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.576 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.576 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T12:37:23.576 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.576 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.576 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.577 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.577 INFO:teuthology.orchestra.run.smithi033.stdout: "cephadm_log_destination": { 2024-09-12T12:37:23.577 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephadm_log_destination", 2024-09-12T12:37:23.577 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.577 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.577 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.577 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.577 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.577 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.577 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.577 INFO:teuthology.orchestra.run.smithi033.stdout: "file", 2024-09-12T12:37:23.577 INFO:teuthology.orchestra.run.smithi033.stdout: "file,syslog", 2024-09-12T12:37:23.577 INFO:teuthology.orchestra.run.smithi033.stdout: "syslog" 2024-09-12T12:37:23.577 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.578 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T12:37:23.578 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.578 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.578 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.578 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.578 INFO:teuthology.orchestra.run.smithi033.stdout: "cgroups_split": { 2024-09-12T12:37:23.578 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cgroups_split", 2024-09-12T12:37:23.578 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.578 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.578 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.578 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.578 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.578 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.578 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.579 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T12:37:23.579 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.579 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.579 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.579 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.579 INFO:teuthology.orchestra.run.smithi033.stdout: "config_checks_enabled": { 2024-09-12T12:37:23.579 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "config_checks_enabled", 2024-09-12T12:37:23.579 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.579 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.579 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.579 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.579 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.579 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.579 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.580 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T12:37:23.580 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.580 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.580 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.580 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.580 INFO:teuthology.orchestra.run.smithi033.stdout: "config_dashboard": { 2024-09-12T12:37:23.580 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "config_dashboard", 2024-09-12T12:37:23.580 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.580 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.580 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.580 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.580 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.580 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.580 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.581 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T12:37:23.581 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.581 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.581 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.581 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.581 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_alertmanager": { 2024-09-12T12:37:23.581 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_alertmanager", 2024-09-12T12:37:23.581 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.581 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.581 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.581 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T12:37:23.581 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.581 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.582 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.582 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-09-12T12:37:23.582 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.582 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.582 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.582 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.582 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_base": { 2024-09-12T12:37:23.582 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_base", 2024-09-12T12:37:23.582 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.582 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.582 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.582 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T12:37:23.582 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.582 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.583 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.583 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Container image name, without the tag", 2024-09-12T12:37:23.583 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.583 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.583 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.583 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.583 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_elasticsearch": { 2024-09-12T12:37:23.583 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_elasticsearch", 2024-09-12T12:37:23.583 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.583 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.583 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.583 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T12:37:23.583 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.583 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.583 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.584 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "elasticsearch container image", 2024-09-12T12:37:23.584 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.584 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.584 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.584 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.584 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_grafana": { 2024-09-12T12:37:23.584 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_grafana", 2024-09-12T12:37:23.584 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.584 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.584 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.584 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T12:37:23.584 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.584 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.584 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.585 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-09-12T12:37:23.585 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.585 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.585 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.585 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.585 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_haproxy": { 2024-09-12T12:37:23.585 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_haproxy", 2024-09-12T12:37:23.585 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.585 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.585 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.585 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T12:37:23.585 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.585 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.585 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.586 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "HAproxy container image", 2024-09-12T12:37:23.586 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.586 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.586 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.586 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.586 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_jaeger_agent": { 2024-09-12T12:37:23.586 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_jaeger_agent", 2024-09-12T12:37:23.586 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.586 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.586 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.586 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T12:37:23.586 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.586 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.587 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.587 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Jaeger agent container image", 2024-09-12T12:37:23.587 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.587 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.587 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.587 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.587 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_jaeger_collector": { 2024-09-12T12:37:23.587 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_jaeger_collector", 2024-09-12T12:37:23.587 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.587 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.587 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.587 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T12:37:23.587 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.587 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.588 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.588 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Jaeger collector container image", 2024-09-12T12:37:23.588 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.588 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.588 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.588 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.588 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_jaeger_query": { 2024-09-12T12:37:23.588 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_jaeger_query", 2024-09-12T12:37:23.588 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.588 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.588 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.588 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T12:37:23.588 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.588 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.589 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.589 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Jaeger query container image", 2024-09-12T12:37:23.589 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.589 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.589 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.589 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.589 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_keepalived": { 2024-09-12T12:37:23.589 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_keepalived", 2024-09-12T12:37:23.589 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.589 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.589 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.589 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T12:37:23.589 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.589 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.590 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.590 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Keepalived container image", 2024-09-12T12:37:23.590 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.590 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.590 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.590 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.590 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_loki": { 2024-09-12T12:37:23.590 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_loki", 2024-09-12T12:37:23.590 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.590 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.590 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.590 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T12:37:23.590 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.590 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.591 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.591 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Loki container image", 2024-09-12T12:37:23.591 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.591 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.591 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.591 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.591 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_node_exporter": { 2024-09-12T12:37:23.591 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_node_exporter", 2024-09-12T12:37:23.591 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.591 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.591 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.591 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T12:37:23.591 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.591 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.592 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.592 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-09-12T12:37:23.592 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.592 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.592 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.592 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.592 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_nvmeof": { 2024-09-12T12:37:23.592 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_nvmeof", 2024-09-12T12:37:23.592 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.592 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.592 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.592 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T12:37:23.592 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.593 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.593 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.593 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Nvme-of container image", 2024-09-12T12:37:23.593 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.593 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.593 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.593 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.593 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_prometheus": { 2024-09-12T12:37:23.593 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_prometheus", 2024-09-12T12:37:23.593 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.593 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.593 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.593 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T12:37:23.593 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.593 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.594 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.594 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-09-12T12:37:23.594 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.594 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.594 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.594 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.594 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_promtail": { 2024-09-12T12:37:23.594 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_promtail", 2024-09-12T12:37:23.594 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.594 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.594 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.594 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T12:37:23.594 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.594 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.595 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.595 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Promtail container image", 2024-09-12T12:37:23.595 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.595 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.595 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.595 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.595 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_samba": { 2024-09-12T12:37:23.595 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_samba", 2024-09-12T12:37:23.595 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.595 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.595 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.595 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T12:37:23.595 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.595 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.596 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.596 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Samba/SMB container image", 2024-09-12T12:37:23.596 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.596 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.596 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.596 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.596 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_snmp_gateway": { 2024-09-12T12:37:23.596 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_snmp_gateway", 2024-09-12T12:37:23.596 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.596 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.596 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.596 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T12:37:23.596 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.596 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.597 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.597 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SNMP Gateway container image", 2024-09-12T12:37:23.597 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.597 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.597 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.597 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.597 INFO:teuthology.orchestra.run.smithi033.stdout: "container_init": { 2024-09-12T12:37:23.597 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_init", 2024-09-12T12:37:23.597 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.597 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.597 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.597 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.597 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.597 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.597 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.598 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T12:37:23.598 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.598 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.598 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.598 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.598 INFO:teuthology.orchestra.run.smithi033.stdout: "daemon_cache_timeout": { 2024-09-12T12:37:23.598 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "daemon_cache_timeout", 2024-09-12T12:37:23.598 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:23.598 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.598 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.598 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-09-12T12:37:23.598 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.598 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.599 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.599 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T12:37:23.599 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.599 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.599 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.599 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.599 INFO:teuthology.orchestra.run.smithi033.stdout: "default_cephadm_command_timeout": { 2024-09-12T12:37:23.599 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T12:37:23.599 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.599 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.599 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.599 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "900", 2024-09-12T12:37:23.599 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.599 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.600 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.600 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T12:37:23.600 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.600 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.600 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.600 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.600 INFO:teuthology.orchestra.run.smithi033.stdout: "default_registry": { 2024-09-12T12:37:23.600 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "default_registry", 2024-09-12T12:37:23.600 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.600 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.600 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.600 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io", 2024-09-12T12:37:23.600 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.601 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.601 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.601 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T12:37:23.601 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.601 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.601 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.601 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.601 INFO:teuthology.orchestra.run.smithi033.stdout: "device_cache_timeout": { 2024-09-12T12:37:23.601 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "device_cache_timeout", 2024-09-12T12:37:23.601 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:23.601 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.601 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.601 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "1800", 2024-09-12T12:37:23.602 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.602 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.602 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.602 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "seconds to cache device inventory", 2024-09-12T12:37:23.602 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.602 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.602 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.602 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.602 INFO:teuthology.orchestra.run.smithi033.stdout: "device_enhanced_scan": { 2024-09-12T12:37:23.602 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "device_enhanced_scan", 2024-09-12T12:37:23.602 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.602 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.602 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.602 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.603 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.603 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.603 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.603 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T12:37:23.603 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.603 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.603 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.603 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.603 INFO:teuthology.orchestra.run.smithi033.stdout: "facts_cache_timeout": { 2024-09-12T12:37:23.603 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "facts_cache_timeout", 2024-09-12T12:37:23.603 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:23.603 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.603 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.604 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-09-12T12:37:23.604 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.604 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.604 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.604 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "seconds to cache host facts data", 2024-09-12T12:37:23.604 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.604 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.604 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.604 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.604 INFO:teuthology.orchestra.run.smithi033.stdout: "grafana_dashboards_path": { 2024-09-12T12:37:23.604 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "grafana_dashboards_path", 2024-09-12T12:37:23.604 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.604 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.605 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.605 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T12:37:23.605 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.605 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.605 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.605 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T12:37:23.605 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.605 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.605 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.605 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.605 INFO:teuthology.orchestra.run.smithi033.stdout: "host_check_interval": { 2024-09-12T12:37:23.605 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "host_check_interval", 2024-09-12T12:37:23.605 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:23.606 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.606 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.606 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-09-12T12:37:23.606 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.606 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.606 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.606 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to perform a host check", 2024-09-12T12:37:23.606 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.606 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.606 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.606 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.606 INFO:teuthology.orchestra.run.smithi033.stdout: "hw_monitoring": { 2024-09-12T12:37:23.606 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "hw_monitoring", 2024-09-12T12:37:23.606 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.607 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.607 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.607 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.607 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.607 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.607 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.607 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T12:37:23.607 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.607 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.607 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.607 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.607 INFO:teuthology.orchestra.run.smithi033.stdout: "inventory_list_all": { 2024-09-12T12:37:23.607 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "inventory_list_all", 2024-09-12T12:37:23.608 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.608 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.608 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.608 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.608 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.608 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.608 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.608 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T12:37:23.608 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.608 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.608 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.608 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.608 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.609 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.609 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.609 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.609 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.609 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.609 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.609 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.609 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.609 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.609 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.609 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.609 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.609 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.609 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.609 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.610 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.610 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.610 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.610 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.610 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.610 INFO:teuthology.orchestra.run.smithi033.stdout: "log_refresh_metadata": { 2024-09-12T12:37:23.610 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_refresh_metadata", 2024-09-12T12:37:23.610 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.610 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.610 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.610 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.610 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.610 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.610 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.611 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T12:37:23.611 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.611 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.611 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.611 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.611 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.611 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.611 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.611 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.611 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.611 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.611 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.611 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.612 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.612 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T12:37:23.612 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.612 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.612 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.612 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.612 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.612 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.612 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.612 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.612 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.612 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.612 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.613 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.613 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.613 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.613 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.613 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.613 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.613 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.613 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.613 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.613 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.613 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.613 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.613 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.613 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.614 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.614 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.614 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.614 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.614 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.614 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.614 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.614 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.614 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.614 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.614 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.614 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.614 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.614 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.615 INFO:teuthology.orchestra.run.smithi033.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T12:37:23.615 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T12:37:23.615 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.615 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.615 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.615 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.615 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.615 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.615 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.615 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T12:37:23.615 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.615 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.615 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.616 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.616 INFO:teuthology.orchestra.run.smithi033.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T12:37:23.616 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T12:37:23.616 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.616 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.616 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.616 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "*", 2024-09-12T12:37:23.616 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.616 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.616 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.616 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T12:37:23.616 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.616 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.617 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.617 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.617 INFO:teuthology.orchestra.run.smithi033.stdout: "max_count_per_host": { 2024-09-12T12:37:23.617 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_count_per_host", 2024-09-12T12:37:23.617 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.617 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.617 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.617 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-12T12:37:23.617 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.617 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.617 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.617 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "max number of daemons per service per host", 2024-09-12T12:37:23.617 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.617 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.618 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.618 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.618 INFO:teuthology.orchestra.run.smithi033.stdout: "max_osd_draining_count": { 2024-09-12T12:37:23.618 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_osd_draining_count", 2024-09-12T12:37:23.618 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.618 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.618 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.618 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-12T12:37:23.618 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.618 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.618 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.618 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T12:37:23.618 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.619 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.619 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.619 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.619 INFO:teuthology.orchestra.run.smithi033.stdout: "migration_current": { 2024-09-12T12:37:23.619 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "migration_current", 2024-09-12T12:37:23.619 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.619 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.619 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.619 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.619 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.619 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.619 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.619 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "internal - do not modify", 2024-09-12T12:37:23.619 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.620 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.620 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.620 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.620 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": { 2024-09-12T12:37:23.620 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mode", 2024-09-12T12:37:23.620 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.620 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.620 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.620 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "root", 2024-09-12T12:37:23.620 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.620 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.620 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.620 INFO:teuthology.orchestra.run.smithi033.stdout: "cephadm-package", 2024-09-12T12:37:23.621 INFO:teuthology.orchestra.run.smithi033.stdout: "root" 2024-09-12T12:37:23.621 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.621 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T12:37:23.621 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.621 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.621 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.621 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.621 INFO:teuthology.orchestra.run.smithi033.stdout: "oob_default_addr": { 2024-09-12T12:37:23.621 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "oob_default_addr", 2024-09-12T12:37:23.621 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.621 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.621 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.621 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "169.254.1.1", 2024-09-12T12:37:23.621 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.622 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.622 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.622 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T12:37:23.622 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.622 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.622 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.622 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.622 INFO:teuthology.orchestra.run.smithi033.stdout: "prometheus_alerts_path": { 2024-09-12T12:37:23.622 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "prometheus_alerts_path", 2024-09-12T12:37:23.622 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.622 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.622 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.622 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T12:37:23.622 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.623 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.623 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.623 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T12:37:23.623 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.623 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.623 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.623 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.623 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_insecure": { 2024-09-12T12:37:23.623 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_insecure", 2024-09-12T12:37:23.623 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.623 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.623 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.623 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.623 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.624 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.624 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.624 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T12:37:23.624 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.624 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.624 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.624 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.624 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_password": { 2024-09-12T12:37:23.624 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_password", 2024-09-12T12:37:23.624 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.624 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.624 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.624 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.625 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.625 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.625 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.625 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T12:37:23.625 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.625 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.625 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.625 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.625 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_url": { 2024-09-12T12:37:23.625 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_url", 2024-09-12T12:37:23.625 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.625 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.625 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.625 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.626 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.626 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.626 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.626 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T12:37:23.626 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.626 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.626 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.626 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.626 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_username": { 2024-09-12T12:37:23.626 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_username", 2024-09-12T12:37:23.626 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.626 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.626 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.626 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.627 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.627 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.627 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.627 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T12:37:23.627 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.627 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.627 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.627 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.627 INFO:teuthology.orchestra.run.smithi033.stdout: "secure_monitoring_stack": { 2024-09-12T12:37:23.627 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "secure_monitoring_stack", 2024-09-12T12:37:23.627 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.627 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.627 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.627 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.628 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.628 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.628 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.628 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T12:37:23.628 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.628 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.628 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.628 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.628 INFO:teuthology.orchestra.run.smithi033.stdout: "service_discovery_port": { 2024-09-12T12:37:23.628 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "service_discovery_port", 2024-09-12T12:37:23.628 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.628 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.628 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.628 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8765", 2024-09-12T12:37:23.629 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.629 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.629 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.629 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "cephadm service discovery port", 2024-09-12T12:37:23.629 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.629 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.629 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.629 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.629 INFO:teuthology.orchestra.run.smithi033.stdout: "ssh_config_file": { 2024-09-12T12:37:23.629 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssh_config_file", 2024-09-12T12:37:23.629 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.629 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.629 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.630 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.630 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.630 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.630 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.630 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T12:37:23.630 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.630 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.630 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.630 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.630 INFO:teuthology.orchestra.run.smithi033.stdout: "use_agent": { 2024-09-12T12:37:23.630 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "use_agent", 2024-09-12T12:37:23.630 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.630 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.630 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.631 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.631 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.631 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.631 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.631 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T12:37:23.631 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.631 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.631 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.631 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.631 INFO:teuthology.orchestra.run.smithi033.stdout: "use_repo_digest": { 2024-09-12T12:37:23.631 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "use_repo_digest", 2024-09-12T12:37:23.631 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.631 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.631 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.631 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.632 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.632 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.632 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.632 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T12:37:23.632 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.632 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.632 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.632 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.632 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_on_failed_host_check": { 2024-09-12T12:37:23.632 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_on_failed_host_check", 2024-09-12T12:37:23.632 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.632 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.632 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.632 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.633 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.633 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.633 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.633 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T12:37:23.633 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.633 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.633 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.633 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.633 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_on_stray_daemons": { 2024-09-12T12:37:23.633 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_on_stray_daemons", 2024-09-12T12:37:23.633 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.633 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.633 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.633 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.633 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.634 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.634 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.634 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T12:37:23.634 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.634 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.634 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.634 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.634 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_on_stray_hosts": { 2024-09-12T12:37:23.634 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_on_stray_hosts", 2024-09-12T12:37:23.634 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.634 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.634 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.634 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.634 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.635 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.635 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.635 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T12:37:23.635 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.635 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.635 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.635 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.635 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.635 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.635 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.635 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crash", 2024-09-12T12:37:23.635 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.635 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.635 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.635 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.636 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.636 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.636 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.636 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.636 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.636 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.636 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.636 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.636 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.636 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.636 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.636 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.637 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.637 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.637 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.637 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.637 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.637 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.637 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.637 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.637 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.637 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.637 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.637 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.637 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.637 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.638 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.638 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.638 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.638 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.638 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.638 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.638 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.638 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.638 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.638 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.638 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.638 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.638 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.638 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.639 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.639 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.639 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.639 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.639 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.639 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.639 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.639 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.639 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.639 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.639 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.639 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.639 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.639 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.640 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.640 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.640 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.640 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.640 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.640 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.640 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.640 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.640 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.640 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.640 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.640 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.640 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.640 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.641 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.641 INFO:teuthology.orchestra.run.smithi033.stdout: "retain_interval": { 2024-09-12T12:37:23.641 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "retain_interval", 2024-09-12T12:37:23.641 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:23.641 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.641 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.641 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "31536000", 2024-09-12T12:37:23.641 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.641 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.641 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.641 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T12:37:23.641 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.641 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.641 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.642 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.642 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_recent_interval": { 2024-09-12T12:37:23.642 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_recent_interval", 2024-09-12T12:37:23.642 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:23.642 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.642 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.642 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "1209600", 2024-09-12T12:37:23.642 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.642 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.642 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.642 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T12:37:23.642 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.642 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.642 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.643 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.643 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.643 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.643 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.643 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "dashboard", 2024-09-12T12:37:23.643 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.643 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.643 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.643 INFO:teuthology.orchestra.run.smithi033.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T12:37:23.643 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T12:37:23.643 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.643 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.643 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.643 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-12T12:37:23.644 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.644 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.644 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.644 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.644 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.644 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.644 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.644 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.644 INFO:teuthology.orchestra.run.smithi033.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T12:37:23.644 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T12:37:23.644 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.644 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.644 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.644 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.645 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.645 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.645 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.645 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.645 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.645 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.645 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.645 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.645 INFO:teuthology.orchestra.run.smithi033.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T12:37:23.645 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T12:37:23.645 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.645 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.645 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.645 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.646 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.646 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.646 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.646 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.646 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.646 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.646 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.646 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.646 INFO:teuthology.orchestra.run.smithi033.stdout: "AUDIT_API_ENABLED": { 2024-09-12T12:37:23.646 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T12:37:23.646 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.646 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.646 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.646 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.647 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.647 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.647 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.647 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.647 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.647 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.647 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.647 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.647 INFO:teuthology.orchestra.run.smithi033.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T12:37:23.647 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T12:37:23.647 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.647 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.647 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.647 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.648 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.648 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.648 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.648 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.648 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.648 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.648 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.648 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.648 INFO:teuthology.orchestra.run.smithi033.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T12:37:23.648 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T12:37:23.648 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.648 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.648 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.648 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.649 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.649 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.649 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.649 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.649 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.649 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.649 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.649 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.649 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T12:37:23.649 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T12:37:23.649 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.649 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.649 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.649 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.649 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.650 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.650 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.650 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.650 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.650 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.650 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.650 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.650 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T12:37:23.650 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T12:37:23.650 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.650 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.651 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.651 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.651 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.651 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.651 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.651 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.651 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.651 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.651 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.651 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.651 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T12:37:23.651 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T12:37:23.651 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.651 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.652 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.652 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.652 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.652 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.652 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.652 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.652 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.652 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.652 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.652 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.652 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T12:37:23.652 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T12:37:23.652 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.652 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.653 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.653 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.653 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.653 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.653 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.653 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.653 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.653 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.653 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.653 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.653 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T12:37:23.653 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T12:37:23.653 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.653 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.654 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.654 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.654 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.654 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.654 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.654 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.654 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.654 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.654 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.654 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.654 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T12:37:23.654 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T12:37:23.654 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.654 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.655 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.655 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.655 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.655 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.655 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.655 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.655 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.655 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.655 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.655 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.655 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T12:37:23.655 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T12:37:23.655 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.656 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.656 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.656 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.656 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.656 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.656 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.656 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.656 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.656 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.656 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.656 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.656 INFO:teuthology.orchestra.run.smithi033.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T12:37:23.656 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T12:37:23.657 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.657 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.657 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.657 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.657 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.657 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.657 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.657 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.657 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.657 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.657 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.657 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.657 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T12:37:23.657 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T12:37:23.658 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.658 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.658 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.658 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "admin", 2024-09-12T12:37:23.658 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.658 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.658 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.658 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.658 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.658 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.658 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.658 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.658 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T12:37:23.659 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T12:37:23.659 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.659 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.659 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.659 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.659 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.659 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.659 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.659 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.659 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.659 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.659 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.659 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.659 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_URL": { 2024-09-12T12:37:23.659 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_URL", 2024-09-12T12:37:23.660 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.660 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.660 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.660 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.660 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.660 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.660 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.660 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.660 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.660 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.660 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.660 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.660 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T12:37:23.660 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T12:37:23.661 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.661 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.661 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.661 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "admin", 2024-09-12T12:37:23.661 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.661 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.661 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.661 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.661 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.661 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.661 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.661 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.661 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T12:37:23.661 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T12:37:23.662 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.662 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.662 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.662 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.662 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.662 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.662 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.662 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.662 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.662 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.662 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.662 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.662 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T12:37:23.662 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T12:37:23.663 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.663 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.663 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.663 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.663 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.663 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.663 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.663 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.663 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.663 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.665 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.665 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.665 INFO:teuthology.orchestra.run.smithi033.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T12:37:23.665 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T12:37:23.665 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.665 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.666 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.666 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.666 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.666 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.666 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.666 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.666 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.666 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.666 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.666 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.666 INFO:teuthology.orchestra.run.smithi033.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T12:37:23.666 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T12:37:23.666 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.666 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.667 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.667 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.667 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.667 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.667 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.667 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.667 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.667 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.667 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.667 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.667 INFO:teuthology.orchestra.run.smithi033.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T12:37:23.667 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T12:37:23.667 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.667 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.668 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.668 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.668 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.668 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.668 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.668 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.668 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.668 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.668 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.668 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.668 INFO:teuthology.orchestra.run.smithi033.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T12:37:23.668 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T12:37:23.668 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.669 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.669 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.669 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.669 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.669 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.669 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.669 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.669 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.669 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.669 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.669 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.669 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T12:37:23.669 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T12:37:23.669 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.670 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.670 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.670 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.670 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.670 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.670 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.670 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.670 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.670 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.670 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.670 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.670 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T12:37:23.670 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T12:37:23.670 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.671 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.671 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.671 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.671 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.671 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.671 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.671 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.671 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.671 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.671 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.671 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.671 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T12:37:23.671 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T12:37:23.672 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.672 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.672 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.672 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.672 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.672 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.672 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.672 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.672 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.672 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.672 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.672 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.672 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T12:37:23.672 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T12:37:23.673 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.673 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.673 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.673 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.673 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.673 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.673 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.673 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.673 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.673 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.673 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.673 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.673 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T12:37:23.673 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T12:37:23.674 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.674 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.674 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.674 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.674 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.674 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.674 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.674 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.674 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.674 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.674 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.674 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.674 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T12:37:23.674 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T12:37:23.675 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.675 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.675 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.675 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.675 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.675 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.675 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.675 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.675 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.675 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.675 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.675 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.675 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T12:37:23.675 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T12:37:23.676 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.676 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.676 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.676 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.676 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.676 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.676 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.676 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.676 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.676 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.676 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.676 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.676 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T12:37:23.676 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T12:37:23.677 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.677 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.677 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.677 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.677 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.677 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.677 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.677 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.677 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.677 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.677 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.677 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.677 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T12:37:23.677 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T12:37:23.678 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.678 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.678 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.678 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T12:37:23.678 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.678 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.678 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.678 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.678 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.678 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.678 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.678 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.679 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T12:37:23.679 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T12:37:23.679 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.679 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.679 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.679 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-12T12:37:23.679 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.679 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.679 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.679 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.679 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.679 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.679 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.680 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.680 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T12:37:23.680 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T12:37:23.680 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.680 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.680 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.680 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8", 2024-09-12T12:37:23.680 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.680 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.680 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.680 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.680 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.680 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.681 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.681 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.681 INFO:teuthology.orchestra.run.smithi033.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T12:37:23.681 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T12:37:23.681 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.681 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.681 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.681 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "45", 2024-09-12T12:37:23.681 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.681 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.681 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.681 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.681 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.681 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.682 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.682 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.682 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T12:37:23.682 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T12:37:23.682 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.682 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.682 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.682 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.682 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.682 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.682 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.682 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.682 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.682 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.683 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.683 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.683 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T12:37:23.683 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T12:37:23.683 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.683 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.683 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.683 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "admin", 2024-09-12T12:37:23.683 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.683 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.683 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.683 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.683 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.683 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.684 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.684 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.684 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T12:37:23.684 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T12:37:23.684 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.684 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.684 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.684 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.684 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.684 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.684 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.684 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.684 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.685 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.685 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.685 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.685 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T12:37:23.685 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T12:37:23.685 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.685 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.685 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.685 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.685 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.685 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.685 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.685 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.685 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.685 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.686 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.686 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.686 INFO:teuthology.orchestra.run.smithi033.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T12:37:23.686 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T12:37:23.686 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.686 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.686 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.686 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-12T12:37:23.686 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.686 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.686 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.686 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.686 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.686 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.687 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.687 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.687 INFO:teuthology.orchestra.run.smithi033.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T12:37:23.687 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T12:37:23.687 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.687 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.687 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.687 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-12T12:37:23.687 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.687 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.687 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.687 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.687 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.687 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.688 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.688 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.688 INFO:teuthology.orchestra.run.smithi033.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T12:37:23.688 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T12:37:23.688 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.688 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.688 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.688 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-09-12T12:37:23.688 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.688 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.688 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.688 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.688 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.688 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.689 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.689 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.689 INFO:teuthology.orchestra.run.smithi033.stdout: "cross_origin_url": { 2024-09-12T12:37:23.689 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cross_origin_url", 2024-09-12T12:37:23.689 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.689 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.689 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.689 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.689 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.689 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.689 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.689 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.689 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.689 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.690 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.690 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.690 INFO:teuthology.orchestra.run.smithi033.stdout: "crt_file": { 2024-09-12T12:37:23.690 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crt_file", 2024-09-12T12:37:23.690 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.690 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.690 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.690 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.690 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.690 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.690 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.690 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.690 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.690 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.690 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.691 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.691 INFO:teuthology.orchestra.run.smithi033.stdout: "debug": { 2024-09-12T12:37:23.691 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "debug", 2024-09-12T12:37:23.691 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.691 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.691 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.691 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.691 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.691 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.691 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.691 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Enable/disable debug options", 2024-09-12T12:37:23.691 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.691 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.691 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.692 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.692 INFO:teuthology.orchestra.run.smithi033.stdout: "jwt_token_ttl": { 2024-09-12T12:37:23.692 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "jwt_token_ttl", 2024-09-12T12:37:23.692 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.692 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.692 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.692 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "28800", 2024-09-12T12:37:23.692 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.692 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.692 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.692 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.692 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.692 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.693 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.693 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.693 INFO:teuthology.orchestra.run.smithi033.stdout: "key_file": { 2024-09-12T12:37:23.693 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "key_file", 2024-09-12T12:37:23.693 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.693 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.693 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.693 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.693 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.693 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.693 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.693 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.693 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.693 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.694 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.694 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.694 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.694 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.694 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.694 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.694 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.694 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.694 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.694 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.694 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.694 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.694 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.694 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.695 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.695 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.695 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.695 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.695 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.695 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.695 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.695 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.695 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.695 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.695 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.695 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.695 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.695 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.695 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.696 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.696 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.696 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.696 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.696 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.696 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.696 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.696 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.696 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.696 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.696 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.696 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.696 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.696 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.697 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.697 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.697 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.697 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.697 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.697 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.697 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.697 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.697 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.697 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.697 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.697 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.697 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.697 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.698 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.698 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.698 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.698 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.698 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.698 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.698 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.698 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.698 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.698 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.698 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.698 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.698 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.698 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.699 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.699 INFO:teuthology.orchestra.run.smithi033.stdout: "motd": { 2024-09-12T12:37:23.699 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "motd", 2024-09-12T12:37:23.699 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.699 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.699 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.699 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.699 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.699 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.699 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.699 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "The message of the day", 2024-09-12T12:37:23.699 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.699 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.699 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.700 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.700 INFO:teuthology.orchestra.run.smithi033.stdout: "redirect_resolve_ip_addr": { 2024-09-12T12:37:23.700 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T12:37:23.700 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.700 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.700 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.700 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.700 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.700 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.700 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.700 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.700 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.700 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.700 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.701 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.701 INFO:teuthology.orchestra.run.smithi033.stdout: "server_addr": { 2024-09-12T12:37:23.701 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_addr", 2024-09-12T12:37:23.701 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.701 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.701 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.701 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "::", 2024-09-12T12:37:23.701 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.701 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.701 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.701 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.701 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.701 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.701 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.702 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.702 INFO:teuthology.orchestra.run.smithi033.stdout: "server_port": { 2024-09-12T12:37:23.702 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_port", 2024-09-12T12:37:23.702 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.702 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.702 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.702 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8080", 2024-09-12T12:37:23.702 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.702 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.702 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.702 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.702 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.702 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.702 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.703 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.703 INFO:teuthology.orchestra.run.smithi033.stdout: "ssl": { 2024-09-12T12:37:23.703 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssl", 2024-09-12T12:37:23.703 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.703 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.703 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.703 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.703 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.703 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.703 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.703 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.703 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.703 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.703 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.703 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.704 INFO:teuthology.orchestra.run.smithi033.stdout: "ssl_server_port": { 2024-09-12T12:37:23.704 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssl_server_port", 2024-09-12T12:37:23.704 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.704 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.704 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.704 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8443", 2024-09-12T12:37:23.704 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.704 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.704 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.704 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.704 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.704 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.704 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.704 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.705 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_behaviour": { 2024-09-12T12:37:23.705 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_behaviour", 2024-09-12T12:37:23.705 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.705 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.705 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.705 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "redirect", 2024-09-12T12:37:23.705 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.705 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.705 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.705 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.705 INFO:teuthology.orchestra.run.smithi033.stdout: "redirect" 2024-09-12T12:37:23.705 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.705 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.706 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.706 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.706 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.706 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.706 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_error_status_code": { 2024-09-12T12:37:23.706 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_error_status_code", 2024-09-12T12:37:23.706 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.706 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.706 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.706 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "500", 2024-09-12T12:37:23.706 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "400", 2024-09-12T12:37:23.706 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "599", 2024-09-12T12:37:23.706 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.706 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.707 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.707 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.707 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.707 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.707 INFO:teuthology.orchestra.run.smithi033.stdout: "url_prefix": { 2024-09-12T12:37:23.707 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "url_prefix", 2024-09-12T12:37:23.707 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.707 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.707 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.707 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.707 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.707 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.707 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.707 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.708 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.708 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.708 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.708 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.708 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.708 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.708 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.708 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "devicehealth", 2024-09-12T12:37:23.708 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.708 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.708 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.708 INFO:teuthology.orchestra.run.smithi033.stdout: "enable_monitoring": { 2024-09-12T12:37:23.708 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enable_monitoring", 2024-09-12T12:37:23.708 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.709 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.709 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.709 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.709 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.709 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.709 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.709 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "monitor device health metrics", 2024-09-12T12:37:23.709 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.709 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.709 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.709 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.709 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.709 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.709 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.710 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.710 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.710 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.710 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.710 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.710 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.710 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.710 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.710 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.710 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.710 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.710 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.710 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.710 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.711 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.711 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.711 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.711 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.711 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.711 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.711 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.711 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.711 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.711 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.711 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.711 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.711 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.711 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.712 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.712 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.712 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.712 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.712 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.712 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.712 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.712 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.712 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.712 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.712 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.712 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.712 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.712 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.713 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.713 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.713 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.713 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.713 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.713 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.713 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.713 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.713 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.713 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.713 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.713 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.713 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.713 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.714 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.714 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.714 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.714 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.714 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.714 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.714 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.714 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.714 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.714 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.714 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.714 INFO:teuthology.orchestra.run.smithi033.stdout: "mark_out_threshold": { 2024-09-12T12:37:23.714 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mark_out_threshold", 2024-09-12T12:37:23.714 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:23.714 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.715 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.715 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "2419200", 2024-09-12T12:37:23.715 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.715 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.715 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.715 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T12:37:23.715 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.715 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.715 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.715 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.715 INFO:teuthology.orchestra.run.smithi033.stdout: "pool_name": { 2024-09-12T12:37:23.715 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pool_name", 2024-09-12T12:37:23.715 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.715 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.716 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.716 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "device_health_metrics", 2024-09-12T12:37:23.716 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.716 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.716 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.716 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T12:37:23.716 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.716 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.716 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.716 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.716 INFO:teuthology.orchestra.run.smithi033.stdout: "retention_period": { 2024-09-12T12:37:23.716 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "retention_period", 2024-09-12T12:37:23.716 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:23.716 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.717 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.717 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "15552000", 2024-09-12T12:37:23.717 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.717 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.717 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.717 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how long to retain device health metrics", 2024-09-12T12:37:23.717 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.717 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.717 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.717 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.717 INFO:teuthology.orchestra.run.smithi033.stdout: "scrape_frequency": { 2024-09-12T12:37:23.717 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "scrape_frequency", 2024-09-12T12:37:23.717 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:23.717 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.717 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.718 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "86400", 2024-09-12T12:37:23.718 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.718 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.718 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.718 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T12:37:23.718 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.718 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.718 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.718 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.718 INFO:teuthology.orchestra.run.smithi033.stdout: "self_heal": { 2024-09-12T12:37:23.718 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "self_heal", 2024-09-12T12:37:23.718 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.718 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.718 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.719 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.719 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.719 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.719 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.719 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T12:37:23.719 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.719 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.719 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.719 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.719 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-09-12T12:37:23.719 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-09-12T12:37:23.719 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:23.719 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.720 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.720 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-09-12T12:37:23.720 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.720 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.720 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.720 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T12:37:23.720 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.720 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.720 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.720 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.720 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_threshold": { 2024-09-12T12:37:23.720 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_threshold", 2024-09-12T12:37:23.720 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:23.720 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.721 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.721 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "7257600", 2024-09-12T12:37:23.721 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.721 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.721 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.721 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T12:37:23.721 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.721 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.721 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.721 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.721 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.721 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.721 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.721 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "diskprediction_local", 2024-09-12T12:37:23.722 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.722 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.722 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.722 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.722 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.722 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.722 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.722 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.722 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.722 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.722 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.722 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.722 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.722 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.723 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.723 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.723 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.723 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.723 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.723 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.723 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.723 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.723 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.723 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.723 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.723 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.723 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.723 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.724 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.724 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.724 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.724 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.724 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.724 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.724 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.724 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.724 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.724 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.724 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.724 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.724 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.724 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.725 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.725 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.725 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.725 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.725 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.725 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.725 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.725 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.725 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.725 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.725 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.725 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.725 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.725 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.726 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.726 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.726 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.726 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.726 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.726 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.726 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.726 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.726 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.726 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.726 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.726 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.727 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.727 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.727 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.727 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.727 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.727 INFO:teuthology.orchestra.run.smithi033.stdout: "predict_interval": { 2024-09-12T12:37:23.727 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "predict_interval", 2024-09-12T12:37:23.727 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.727 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.727 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.727 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "86400", 2024-09-12T12:37:23.727 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.727 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.727 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.728 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.728 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.728 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.728 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.728 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.728 INFO:teuthology.orchestra.run.smithi033.stdout: "predictor_model": { 2024-09-12T12:37:23.728 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "predictor_model", 2024-09-12T12:37:23.728 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.728 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.728 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.728 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "prophetstor", 2024-09-12T12:37:23.728 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.728 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.728 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.729 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.729 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.729 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.729 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.729 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.729 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-09-12T12:37:23.729 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-09-12T12:37:23.729 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.729 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.729 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.729 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-09-12T12:37:23.729 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.729 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.729 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.730 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.730 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.730 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.730 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.730 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.730 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.730 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.730 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.730 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "influx", 2024-09-12T12:37:23.730 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": false, 2024-09-12T12:37:23.730 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "influxdb python module not found", 2024-09-12T12:37:23.730 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.730 INFO:teuthology.orchestra.run.smithi033.stdout: "batch_size": { 2024-09-12T12:37:23.730 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "batch_size", 2024-09-12T12:37:23.730 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.731 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.731 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.731 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5000", 2024-09-12T12:37:23.731 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.731 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.731 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.731 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T12:37:23.731 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.731 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.731 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.731 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.731 INFO:teuthology.orchestra.run.smithi033.stdout: "database": { 2024-09-12T12:37:23.731 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "database", 2024-09-12T12:37:23.731 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.732 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.732 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.732 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "ceph", 2024-09-12T12:37:23.732 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.732 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.732 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.732 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T12:37:23.732 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.732 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.732 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.732 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.732 INFO:teuthology.orchestra.run.smithi033.stdout: "hostname": { 2024-09-12T12:37:23.732 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "hostname", 2024-09-12T12:37:23.733 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.733 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.733 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.733 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.733 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.733 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.733 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.733 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "InfluxDB server hostname", 2024-09-12T12:37:23.733 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.733 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.733 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.733 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.733 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-09-12T12:37:23.733 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-09-12T12:37:23.734 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:23.734 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.734 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.734 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "30", 2024-09-12T12:37:23.734 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "5", 2024-09-12T12:37:23.734 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.734 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.734 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T12:37:23.734 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.734 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.734 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.734 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.734 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.734 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.735 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.735 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.735 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.735 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.735 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.735 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.735 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.735 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.735 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.735 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.735 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.735 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.735 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.735 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.736 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.736 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.736 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.736 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.736 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.736 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.736 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.736 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.736 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.736 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.736 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.736 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.736 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.736 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.737 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.737 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.737 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.737 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.737 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.737 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.737 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.737 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.737 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.737 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.737 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.737 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.737 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.737 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.738 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.738 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.738 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.738 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.738 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.738 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.738 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.738 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.738 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.738 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.738 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.738 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.738 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.738 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.739 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.739 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.739 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.739 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.739 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.739 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.739 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.739 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.739 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.739 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.739 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.739 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.739 INFO:teuthology.orchestra.run.smithi033.stdout: "password": { 2024-09-12T12:37:23.739 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "password", 2024-09-12T12:37:23.740 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.740 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.740 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.740 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.740 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.740 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.740 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.740 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "password of InfluxDB server user", 2024-09-12T12:37:23.740 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.740 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.740 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.740 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.740 INFO:teuthology.orchestra.run.smithi033.stdout: "port": { 2024-09-12T12:37:23.740 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "port", 2024-09-12T12:37:23.741 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.741 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.741 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.741 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8086", 2024-09-12T12:37:23.741 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.741 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.741 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.741 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "InfluxDB server port", 2024-09-12T12:37:23.741 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.741 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.741 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.741 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.741 INFO:teuthology.orchestra.run.smithi033.stdout: "ssl": { 2024-09-12T12:37:23.741 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssl", 2024-09-12T12:37:23.742 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.742 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.742 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.742 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "false", 2024-09-12T12:37:23.742 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.742 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.742 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.742 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T12:37:23.742 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.742 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.742 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.742 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.742 INFO:teuthology.orchestra.run.smithi033.stdout: "threads": { 2024-09-12T12:37:23.742 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "threads", 2024-09-12T12:37:23.742 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.743 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.743 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.743 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-09-12T12:37:23.743 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-09-12T12:37:23.743 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "32", 2024-09-12T12:37:23.743 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.743 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T12:37:23.743 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.743 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.743 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.743 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.743 INFO:teuthology.orchestra.run.smithi033.stdout: "username": { 2024-09-12T12:37:23.743 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "username", 2024-09-12T12:37:23.743 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.744 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.744 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.744 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.744 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.744 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.744 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.744 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "username of InfluxDB server user", 2024-09-12T12:37:23.744 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.744 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.744 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.744 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.744 INFO:teuthology.orchestra.run.smithi033.stdout: "verify_ssl": { 2024-09-12T12:37:23.744 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "verify_ssl", 2024-09-12T12:37:23.745 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.745 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.745 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.745 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "true", 2024-09-12T12:37:23.745 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.745 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.745 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.745 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T12:37:23.745 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.745 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.745 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.745 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.745 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.746 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.746 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.746 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "insights", 2024-09-12T12:37:23.746 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.746 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.746 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.746 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.746 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.746 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.746 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.746 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.746 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.746 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.746 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.747 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.747 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.747 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.747 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.747 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.747 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.747 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.747 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.747 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.747 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.747 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.747 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.747 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.747 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.748 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.748 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.748 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.748 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.748 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.748 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.748 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.748 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.748 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.748 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.748 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.748 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.748 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.748 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.749 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.749 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.749 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.749 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.749 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.749 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.749 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.749 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.749 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.749 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.749 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.749 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.749 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.749 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.749 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.750 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.750 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.750 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.750 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.750 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.750 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.750 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.750 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.750 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.750 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.750 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.750 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.750 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.750 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.751 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.751 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.751 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.751 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.751 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.751 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.751 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.751 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.751 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "iostat", 2024-09-12T12:37:23.751 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.751 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.751 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.751 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.751 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.752 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.752 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.752 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.752 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.752 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.752 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.752 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.752 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.752 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.752 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.752 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.752 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.752 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.752 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.753 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.753 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.753 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.753 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.753 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.753 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.753 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.753 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.753 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.753 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.753 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.753 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.753 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.753 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.754 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.754 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.754 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.754 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.754 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.754 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.754 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.754 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.754 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.754 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.754 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.754 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.754 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.754 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.754 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.755 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.755 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.755 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.755 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.755 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.755 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.755 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.755 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.755 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.755 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.755 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.755 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.755 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.755 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.756 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.756 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.756 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.756 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.756 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.756 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.756 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.756 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.756 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.756 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.756 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.756 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.756 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.756 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.756 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "k8sevents", 2024-09-12T12:37:23.757 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.757 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.757 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.757 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_event_retention_days": { 2024-09-12T12:37:23.757 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ceph_event_retention_days", 2024-09-12T12:37:23.757 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.757 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.757 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.757 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "7", 2024-09-12T12:37:23.757 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.757 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.757 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.757 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T12:37:23.757 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.758 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.758 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.758 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.758 INFO:teuthology.orchestra.run.smithi033.stdout: "config_check_secs": { 2024-09-12T12:37:23.758 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "config_check_secs", 2024-09-12T12:37:23.758 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.758 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.758 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.758 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-12T12:37:23.758 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "10", 2024-09-12T12:37:23.758 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.758 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.758 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T12:37:23.758 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.758 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.759 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.759 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.759 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.759 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.759 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.759 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.759 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.759 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.759 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.759 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.759 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.759 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.759 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.760 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.760 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.760 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.760 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.760 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.760 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.760 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.760 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.760 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.760 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.760 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.760 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.760 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.760 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.761 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.761 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.761 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.761 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.761 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.761 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.761 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.761 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.761 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.761 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.761 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.761 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.761 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.761 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.762 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.762 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.762 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.762 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.762 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.762 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.762 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.762 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.762 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.762 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.762 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.762 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.762 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.762 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.763 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.763 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.763 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.763 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.763 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.763 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.763 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.763 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.763 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.763 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.763 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.763 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.763 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.763 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.764 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.764 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.764 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.764 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.764 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.764 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.764 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "localpool", 2024-09-12T12:37:23.764 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.764 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.764 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.764 INFO:teuthology.orchestra.run.smithi033.stdout: "failure_domain": { 2024-09-12T12:37:23.764 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "failure_domain", 2024-09-12T12:37:23.765 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.765 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.765 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.765 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "host", 2024-09-12T12:37:23.765 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.765 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.765 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.765 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "failure domain for any created local pool", 2024-09-12T12:37:23.765 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T12:37:23.765 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.765 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.765 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.766 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.766 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.766 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.766 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.766 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.766 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.766 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.766 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.766 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.766 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.766 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.766 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.766 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.766 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.766 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.767 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.767 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.767 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.767 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.767 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.767 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.767 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.767 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.767 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.767 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.767 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.767 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.767 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.767 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.768 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.768 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.768 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.768 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.768 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.768 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.768 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.768 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.768 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.768 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.768 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.768 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.768 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.769 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.769 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.769 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.769 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.769 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.769 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.769 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.769 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.769 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.769 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.769 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.769 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.769 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.769 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.769 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.770 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.770 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.770 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.770 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.770 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.770 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.770 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.770 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.770 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.770 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.770 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.770 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.770 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.770 INFO:teuthology.orchestra.run.smithi033.stdout: "min_size": { 2024-09-12T12:37:23.771 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "min_size", 2024-09-12T12:37:23.771 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.771 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.771 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.771 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.771 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.771 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.771 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.771 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "default min_size for any created local pool", 2024-09-12T12:37:23.771 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T12:37:23.771 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.771 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.771 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.771 INFO:teuthology.orchestra.run.smithi033.stdout: "num_rep": { 2024-09-12T12:37:23.771 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "num_rep", 2024-09-12T12:37:23.772 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.772 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.772 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.772 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "3", 2024-09-12T12:37:23.772 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.772 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.772 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.772 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "default replica count for any created local pool", 2024-09-12T12:37:23.772 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.772 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.772 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.772 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.772 INFO:teuthology.orchestra.run.smithi033.stdout: "pg_num": { 2024-09-12T12:37:23.772 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pg_num", 2024-09-12T12:37:23.773 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.773 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.773 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.773 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "128", 2024-09-12T12:37:23.773 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.773 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.773 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.773 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T12:37:23.773 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.774 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.774 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.774 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.774 INFO:teuthology.orchestra.run.smithi033.stdout: "prefix": { 2024-09-12T12:37:23.774 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "prefix", 2024-09-12T12:37:23.774 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.774 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.774 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.774 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.774 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.774 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.774 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.774 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "name prefix for any created local pool", 2024-09-12T12:37:23.774 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.775 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.775 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.775 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.775 INFO:teuthology.orchestra.run.smithi033.stdout: "subtree": { 2024-09-12T12:37:23.775 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "subtree", 2024-09-12T12:37:23.775 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.775 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.775 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.775 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "rack", 2024-09-12T12:37:23.775 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.775 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.775 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.775 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T12:37:23.776 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T12:37:23.776 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.776 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.776 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.776 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.776 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.776 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.776 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mds_autoscaler", 2024-09-12T12:37:23.776 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.776 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.776 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.776 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.777 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.777 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.777 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.777 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.777 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.777 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.777 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.777 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.777 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.777 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.777 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.777 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.777 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.777 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.777 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.778 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.778 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.778 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.778 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.778 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.778 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.778 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.778 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.778 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.778 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.778 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.778 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.778 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.779 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.779 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.779 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.779 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.779 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.779 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.779 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.779 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.779 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.779 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.779 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.779 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.779 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.779 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.780 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.780 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.780 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.780 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.780 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.780 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.780 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.780 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.780 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.780 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.780 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.780 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.780 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.780 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.781 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.781 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.781 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.781 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.781 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.781 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.781 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.781 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.781 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.781 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.781 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.781 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.781 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.781 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.781 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.782 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.782 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mirroring", 2024-09-12T12:37:23.782 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.782 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.782 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.782 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.782 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.782 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.782 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.782 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.782 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.782 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.782 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.782 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.783 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.783 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.783 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.783 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.783 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.783 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.783 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.783 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.783 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.783 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.783 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.783 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.783 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.783 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.783 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.784 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.784 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.784 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.784 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.784 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.784 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.784 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.784 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.784 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.784 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.784 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.784 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.784 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.784 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.785 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.785 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.785 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.785 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.785 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.785 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.785 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.785 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.785 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.785 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.785 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.785 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.785 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.785 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.786 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.786 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.786 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.786 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.786 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.786 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.786 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.786 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.786 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.786 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.786 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.786 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.786 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.786 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.787 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.787 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.787 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.787 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.787 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.787 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.787 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.787 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "nfs", 2024-09-12T12:37:23.787 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.787 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.787 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.787 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.787 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.788 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.788 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.788 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.788 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.788 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.788 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.788 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.788 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.788 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.788 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.788 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.788 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.788 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.788 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.789 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.789 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.789 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.789 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.789 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.789 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.789 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.789 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.789 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.789 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.789 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.789 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.790 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.790 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.790 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.790 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.790 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.790 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.790 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.790 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.790 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.790 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.790 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.790 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.790 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.790 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.790 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.791 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.791 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.791 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.791 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.791 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.791 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.791 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.791 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.791 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.791 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.791 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.791 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.791 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.791 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.792 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.792 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.792 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.792 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.792 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.792 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.792 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.792 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.792 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.792 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.792 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.792 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.792 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.792 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.793 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.793 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.793 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "orchestrator", 2024-09-12T12:37:23.793 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.793 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.793 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.793 INFO:teuthology.orchestra.run.smithi033.stdout: "fail_fs": { 2024-09-12T12:37:23.793 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "fail_fs", 2024-09-12T12:37:23.793 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.793 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.793 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.793 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.793 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.793 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.794 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.794 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T12:37:23.794 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.794 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.794 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.794 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.794 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.794 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.794 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.794 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.794 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.794 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.794 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.794 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.795 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.795 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.795 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.795 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.795 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.795 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.795 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.795 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.795 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.795 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.795 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.795 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.795 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.795 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.795 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.796 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.796 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.796 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.796 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.796 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.796 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.796 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.796 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.796 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.796 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.796 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.796 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.796 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.796 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.797 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.797 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.797 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.797 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.797 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.797 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.797 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.797 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.797 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.797 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.797 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.797 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.797 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.797 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.798 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.798 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.798 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.798 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.798 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.798 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.798 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.798 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.798 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.798 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.798 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.798 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.798 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.798 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.799 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.799 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.799 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.799 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.799 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.799 INFO:teuthology.orchestra.run.smithi033.stdout: "orchestrator": { 2024-09-12T12:37:23.799 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "orchestrator", 2024-09-12T12:37:23.799 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.799 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.799 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.799 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.799 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.799 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.799 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.799 INFO:teuthology.orchestra.run.smithi033.stdout: "cephadm", 2024-09-12T12:37:23.800 INFO:teuthology.orchestra.run.smithi033.stdout: "rook", 2024-09-12T12:37:23.800 INFO:teuthology.orchestra.run.smithi033.stdout: "test_orchestrator" 2024-09-12T12:37:23.800 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.800 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Orchestrator backend", 2024-09-12T12:37:23.800 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.800 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.800 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.800 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.800 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.800 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.800 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.800 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "osd_perf_query", 2024-09-12T12:37:23.800 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.800 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.801 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.801 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.801 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.801 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.801 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.801 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.801 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.801 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.801 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.801 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.801 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.801 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.801 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.802 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.802 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.802 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.802 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.802 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.802 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.802 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.802 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.802 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.802 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.802 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.803 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.803 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.803 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.803 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.803 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.803 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.803 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.803 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.803 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.803 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.803 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.803 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.803 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.803 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.804 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.804 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.804 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.804 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.804 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.804 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.804 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.804 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.804 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.804 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.804 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.804 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.804 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.805 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.805 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.805 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.805 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.805 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.805 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.805 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.805 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.805 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.805 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.805 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.805 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.806 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.806 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.806 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.806 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.806 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.806 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.806 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.806 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.806 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.806 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.806 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.806 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "osd_support", 2024-09-12T12:37:23.806 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.806 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.807 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.807 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.807 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.807 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.807 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.807 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.807 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.807 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.807 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.807 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.807 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.807 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.807 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.808 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.808 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.808 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.808 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.808 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.808 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.808 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.808 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.808 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.808 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.808 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.808 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.809 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.809 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.809 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.809 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.809 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.809 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.809 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.809 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.809 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.809 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.810 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.810 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.810 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.810 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.810 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.810 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.810 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.810 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.810 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.810 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.810 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.810 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.811 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.811 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.811 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.811 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.811 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.811 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.811 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.811 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.811 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.811 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.811 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.812 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.812 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.812 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.812 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.812 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.812 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.812 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.812 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.812 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.812 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.812 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.813 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.813 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.813 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.813 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.813 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.813 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pg_autoscaler", 2024-09-12T12:37:23.813 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.813 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.813 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.813 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.813 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.814 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.814 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.814 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.814 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.814 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.814 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.814 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.814 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.814 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.814 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.814 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.814 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.815 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.815 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.815 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.815 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.815 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.815 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.815 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.815 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.815 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.815 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.815 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.816 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.816 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.816 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.816 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.816 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.816 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.816 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.816 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.816 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.816 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.816 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.817 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.817 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.817 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.817 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.817 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.817 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.817 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.817 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.817 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.817 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.817 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.817 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.818 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.818 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.818 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.818 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.818 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.818 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.818 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.818 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.818 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.818 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.818 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.819 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.819 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.819 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.819 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.819 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.819 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.819 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.819 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.819 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.819 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.819 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.820 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-09-12T12:37:23.820 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-09-12T12:37:23.820 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:23.820 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.820 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.820 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-09-12T12:37:23.820 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.820 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.820 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.820 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.820 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.821 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.821 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.821 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.821 INFO:teuthology.orchestra.run.smithi033.stdout: "threshold": { 2024-09-12T12:37:23.821 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "threshold", 2024-09-12T12:37:23.821 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-09-12T12:37:23.821 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.821 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.821 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "3.0", 2024-09-12T12:37:23.821 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1.0", 2024-09-12T12:37:23.821 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.822 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.822 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "scaling threshold", 2024-09-12T12:37:23.822 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T12:37:23.822 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.822 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.822 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.822 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.822 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.822 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.822 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "progress", 2024-09-12T12:37:23.822 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.823 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.823 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.823 INFO:teuthology.orchestra.run.smithi033.stdout: "allow_pg_recovery_event": { 2024-09-12T12:37:23.823 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "allow_pg_recovery_event", 2024-09-12T12:37:23.823 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.823 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.823 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.823 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.823 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.824 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.824 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.824 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T12:37:23.824 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.824 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.824 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.824 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.824 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": { 2024-09-12T12:37:23.824 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enabled", 2024-09-12T12:37:23.824 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.824 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.825 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.825 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.825 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.825 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.825 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.825 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.825 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.825 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.825 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.826 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.826 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.826 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.826 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.826 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.826 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.826 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.826 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.826 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.826 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.826 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.827 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.827 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.827 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.827 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.827 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.827 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.827 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.827 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.827 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.827 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.828 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.828 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.828 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.828 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.828 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.828 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.828 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.828 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.828 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.828 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.829 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.829 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.829 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.829 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.829 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.829 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.829 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.829 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.829 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.829 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.829 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.829 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.830 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.830 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.830 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.830 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.830 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.830 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.830 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.830 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.830 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.830 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.830 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.831 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.831 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.831 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.831 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.831 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.831 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.831 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.831 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.831 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.831 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.831 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.832 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.832 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.832 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.832 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.832 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.832 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.832 INFO:teuthology.orchestra.run.smithi033.stdout: "max_completed_events": { 2024-09-12T12:37:23.832 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_completed_events", 2024-09-12T12:37:23.832 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.832 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.832 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.833 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "50", 2024-09-12T12:37:23.833 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.833 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.833 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.833 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "number of past completed events to remember", 2024-09-12T12:37:23.833 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.833 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.833 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.833 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.833 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-09-12T12:37:23.833 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-09-12T12:37:23.833 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:23.834 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.834 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.834 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-09-12T12:37:23.834 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.834 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.834 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.834 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how long the module is going to sleep", 2024-09-12T12:37:23.834 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.834 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.834 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.834 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.834 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.835 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.835 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.835 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "prometheus", 2024-09-12T12:37:23.835 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.835 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.835 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.835 INFO:teuthology.orchestra.run.smithi033.stdout: "cache": { 2024-09-12T12:37:23.835 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cache", 2024-09-12T12:37:23.835 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.835 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.835 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.836 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.836 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.836 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.836 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.836 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.836 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.836 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.836 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.836 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.836 INFO:teuthology.orchestra.run.smithi033.stdout: "exclude_perf_counters": { 2024-09-12T12:37:23.836 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "exclude_perf_counters", 2024-09-12T12:37:23.837 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.837 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.837 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.837 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.837 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.837 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.837 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.837 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T12:37:23.837 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T12:37:23.837 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.837 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.838 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.838 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.838 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.838 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.838 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.838 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.838 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.838 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.838 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.838 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.838 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.839 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.839 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.839 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.839 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.839 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.839 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.839 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.839 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.839 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.839 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.839 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.839 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.840 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.840 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.840 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.840 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.840 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.840 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.840 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.840 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.840 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.840 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.840 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.841 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.841 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.841 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.841 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.841 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.841 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.841 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.841 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.841 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.841 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.841 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.841 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.842 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.842 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.842 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.842 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.842 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.842 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.842 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.842 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.842 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.842 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.842 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.843 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.843 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.843 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.843 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.843 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.843 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.843 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.843 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.843 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.843 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.844 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.844 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.844 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.844 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.844 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_stats_pools": { 2024-09-12T12:37:23.844 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_stats_pools", 2024-09-12T12:37:23.844 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.844 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.844 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.844 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.844 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.844 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.845 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.845 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.845 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.845 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.845 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.845 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.845 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T12:37:23.845 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T12:37:23.845 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.845 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.845 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.845 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "300", 2024-09-12T12:37:23.846 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.846 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.846 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.846 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.846 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.846 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.846 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.846 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.846 INFO:teuthology.orchestra.run.smithi033.stdout: "scrape_interval": { 2024-09-12T12:37:23.846 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "scrape_interval", 2024-09-12T12:37:23.846 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-09-12T12:37:23.846 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.847 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.847 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "15.0", 2024-09-12T12:37:23.847 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.847 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.847 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.847 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.847 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.847 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.847 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.847 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.847 INFO:teuthology.orchestra.run.smithi033.stdout: "server_addr": { 2024-09-12T12:37:23.847 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_addr", 2024-09-12T12:37:23.848 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.848 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.848 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.848 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "::", 2024-09-12T12:37:23.848 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.848 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.848 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.848 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T12:37:23.848 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.848 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.848 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.848 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.849 INFO:teuthology.orchestra.run.smithi033.stdout: "server_port": { 2024-09-12T12:37:23.849 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_port", 2024-09-12T12:37:23.849 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.849 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.849 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.849 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "9283", 2024-09-12T12:37:23.849 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.849 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.849 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.849 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T12:37:23.849 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.849 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.850 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.850 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.850 INFO:teuthology.orchestra.run.smithi033.stdout: "stale_cache_strategy": { 2024-09-12T12:37:23.850 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "stale_cache_strategy", 2024-09-12T12:37:23.850 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.850 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.850 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.850 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "log", 2024-09-12T12:37:23.850 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.850 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.850 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.851 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.851 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.851 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.851 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.851 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.851 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_behaviour": { 2024-09-12T12:37:23.851 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_behaviour", 2024-09-12T12:37:23.851 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.851 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.851 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.851 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "default", 2024-09-12T12:37:23.851 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.851 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.852 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.852 INFO:teuthology.orchestra.run.smithi033.stdout: "default", 2024-09-12T12:37:23.852 INFO:teuthology.orchestra.run.smithi033.stdout: "error" 2024-09-12T12:37:23.852 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.852 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.852 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.852 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.852 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.852 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.852 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_error_status_code": { 2024-09-12T12:37:23.852 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_error_status_code", 2024-09-12T12:37:23.852 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.853 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.853 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.853 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "500", 2024-09-12T12:37:23.853 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "400", 2024-09-12T12:37:23.853 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "599", 2024-09-12T12:37:23.853 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.853 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.853 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.853 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.853 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.853 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.853 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.854 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.854 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.854 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_support", 2024-09-12T12:37:23.854 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.854 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.854 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.854 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.854 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.854 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.854 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.854 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.854 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.855 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.855 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.855 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.855 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.855 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.855 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.855 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.855 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.855 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.855 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.855 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.855 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.856 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.856 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.856 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.856 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.856 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.856 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.856 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.856 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.856 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.856 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.856 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.857 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.857 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.857 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.857 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.857 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.857 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.857 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.857 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.857 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.857 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.857 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.857 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.858 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.858 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.858 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.858 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.858 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.858 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.858 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.858 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.858 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.858 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.858 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.858 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.859 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.859 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.859 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.859 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.859 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.859 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.859 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.859 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.859 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.859 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.859 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.859 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.860 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.860 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.860 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.860 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.860 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.860 INFO:teuthology.orchestra.run.smithi033.stdout: "max_concurrent_snap_create": { 2024-09-12T12:37:23.860 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_concurrent_snap_create", 2024-09-12T12:37:23.860 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.860 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.860 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.860 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-12T12:37:23.860 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.861 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.861 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.861 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.861 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.861 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.861 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.861 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.861 INFO:teuthology.orchestra.run.smithi033.stdout: "mirror_snapshot_schedule": { 2024-09-12T12:37:23.861 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T12:37:23.861 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.861 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.861 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.862 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.862 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.862 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.862 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.862 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.862 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.862 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.862 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.862 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.862 INFO:teuthology.orchestra.run.smithi033.stdout: "trash_purge_schedule": { 2024-09-12T12:37:23.862 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "trash_purge_schedule", 2024-09-12T12:37:23.863 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.863 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.863 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.863 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.863 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.863 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.863 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.863 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.863 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.863 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.863 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.863 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.863 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.864 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.864 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.864 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "restful", 2024-09-12T12:37:23.864 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.864 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.864 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.864 INFO:teuthology.orchestra.run.smithi033.stdout: "enable_auth": { 2024-09-12T12:37:23.864 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enable_auth", 2024-09-12T12:37:23.864 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.864 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.864 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.864 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.864 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.865 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.865 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.865 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.865 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.865 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.865 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.865 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.865 INFO:teuthology.orchestra.run.smithi033.stdout: "key_file": { 2024-09-12T12:37:23.865 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "key_file", 2024-09-12T12:37:23.865 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.865 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.866 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.866 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.866 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.866 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.866 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.866 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.866 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.866 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.866 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.866 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.866 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.866 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.866 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.867 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.867 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.867 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.867 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.867 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.867 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.867 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.868 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.868 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.868 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.868 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.868 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.868 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.868 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.868 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.868 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.868 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.868 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.869 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.869 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.869 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.869 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.869 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.869 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.869 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.869 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.869 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.869 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.870 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.870 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.870 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.870 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.870 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.870 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.870 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.870 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.870 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.870 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.870 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.871 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.871 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.871 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.871 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.871 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.871 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.871 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.871 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.871 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.871 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.871 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.872 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.872 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.872 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.872 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.872 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.872 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.872 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.872 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.872 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.872 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.872 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.873 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.873 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.873 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.873 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.873 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.873 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.873 INFO:teuthology.orchestra.run.smithi033.stdout: "server_addr": { 2024-09-12T12:37:23.873 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_addr", 2024-09-12T12:37:23.873 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.873 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.873 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.873 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.874 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.874 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.874 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.874 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.874 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.874 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.874 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.874 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.874 INFO:teuthology.orchestra.run.smithi033.stdout: "server_port": { 2024-09-12T12:37:23.874 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_port", 2024-09-12T12:37:23.874 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.875 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.875 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.875 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.875 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.875 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.875 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.875 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.875 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.875 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.875 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.875 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.876 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.876 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.876 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.876 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rgw", 2024-09-12T12:37:23.876 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.876 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.876 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.876 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.876 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.876 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.877 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.877 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.877 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.877 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.877 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.877 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.877 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.877 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.877 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.877 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.877 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.878 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.878 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.878 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.878 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.878 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.878 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.878 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.878 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.878 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.878 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.878 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.878 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.879 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.879 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.879 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.879 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.879 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.879 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.879 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.879 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.879 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.879 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.879 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.879 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.880 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.880 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.880 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.880 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.880 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.880 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.880 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.880 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.880 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.880 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.880 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.881 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.881 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.881 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.881 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.881 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.881 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.881 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.881 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.881 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.881 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.881 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.882 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.882 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.882 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.882 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.882 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.882 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.882 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.882 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.882 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.882 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.882 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.882 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.883 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.883 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rook", 2024-09-12T12:37:23.883 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.883 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.883 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.883 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.883 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.883 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.883 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.883 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.883 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.883 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.884 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.884 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.884 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.884 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.884 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.884 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.884 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.884 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.884 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.885 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.885 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.885 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.885 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.885 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.885 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.885 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.885 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.885 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.885 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.885 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.886 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.886 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.886 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.886 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.886 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.886 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.886 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.886 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.886 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.886 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.886 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.886 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.887 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.887 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.887 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.887 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.887 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.887 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.887 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.887 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.887 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.887 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.888 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.888 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.888 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.888 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.888 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.888 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.888 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.888 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.888 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.888 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.888 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.889 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.889 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.889 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.889 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.889 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.889 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.889 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.889 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.889 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.889 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.890 INFO:teuthology.orchestra.run.smithi033.stdout: "storage_class": { 2024-09-12T12:37:23.890 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "storage_class", 2024-09-12T12:37:23.890 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.890 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.890 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.890 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "local", 2024-09-12T12:37:23.890 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.890 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.890 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.890 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T12:37:23.890 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.890 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.891 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.891 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.891 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.891 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.891 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.891 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "selftest", 2024-09-12T12:37:23.891 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.891 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.891 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.891 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.891 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.892 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.892 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.892 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.892 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.892 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.892 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.892 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.892 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.892 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.892 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.892 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.893 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.893 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.893 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.893 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.893 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.893 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.893 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.893 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.893 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.893 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.893 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.894 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.894 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.894 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.894 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.894 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.894 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.894 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.894 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.894 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.894 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.894 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.895 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.895 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.895 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.895 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.895 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.895 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.895 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.895 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.895 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.895 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.895 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.896 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.896 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.896 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.896 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.896 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.896 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.896 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.896 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.896 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.896 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.897 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.897 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.897 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.897 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.897 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.897 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.897 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.897 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.897 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.897 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.897 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.897 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.898 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.898 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.898 INFO:teuthology.orchestra.run.smithi033.stdout: "roption1": { 2024-09-12T12:37:23.898 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "roption1", 2024-09-12T12:37:23.898 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.898 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.898 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.898 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.898 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.898 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.898 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.899 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.899 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.899 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.899 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.899 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.899 INFO:teuthology.orchestra.run.smithi033.stdout: "roption2": { 2024-09-12T12:37:23.899 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "roption2", 2024-09-12T12:37:23.899 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.899 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.899 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.899 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "xyz", 2024-09-12T12:37:23.900 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.900 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.900 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.900 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.900 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.900 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.900 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.900 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.900 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption1": { 2024-09-12T12:37:23.900 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption1", 2024-09-12T12:37:23.900 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.900 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.901 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.901 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.901 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.901 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.901 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.901 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.901 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.901 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.901 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.901 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.901 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption2": { 2024-09-12T12:37:23.901 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption2", 2024-09-12T12:37:23.902 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.902 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.902 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.902 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.902 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.902 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.902 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.902 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.902 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.902 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.902 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.902 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.903 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption3": { 2024-09-12T12:37:23.903 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption3", 2024-09-12T12:37:23.903 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-09-12T12:37:23.903 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.903 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.903 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.903 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.903 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.903 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.903 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.903 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.903 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.904 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.904 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.904 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption4": { 2024-09-12T12:37:23.904 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption4", 2024-09-12T12:37:23.904 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.904 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.904 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.904 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.904 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.904 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.904 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.904 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.905 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.905 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.905 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.905 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.905 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption5": { 2024-09-12T12:37:23.905 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption5", 2024-09-12T12:37:23.905 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.905 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.905 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.905 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.905 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.905 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.906 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.906 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.906 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.906 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.906 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.906 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.906 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption6": { 2024-09-12T12:37:23.906 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption6", 2024-09-12T12:37:23.906 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.906 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.906 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.906 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.907 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.907 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.907 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.907 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.907 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.907 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.907 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.907 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.907 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption7": { 2024-09-12T12:37:23.907 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption7", 2024-09-12T12:37:23.907 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.907 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.908 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.908 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.908 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-09-12T12:37:23.908 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "42", 2024-09-12T12:37:23.908 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.908 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.908 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.908 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.908 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.908 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.908 INFO:teuthology.orchestra.run.smithi033.stdout: "testkey": { 2024-09-12T12:37:23.909 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "testkey", 2024-09-12T12:37:23.909 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.909 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.909 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.909 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.909 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.909 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.909 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.909 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.909 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.909 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.909 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.910 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.910 INFO:teuthology.orchestra.run.smithi033.stdout: "testlkey": { 2024-09-12T12:37:23.910 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "testlkey", 2024-09-12T12:37:23.910 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.910 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.910 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.910 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.910 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.910 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.910 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.910 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.910 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.911 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.911 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.911 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.911 INFO:teuthology.orchestra.run.smithi033.stdout: "testnewline": { 2024-09-12T12:37:23.911 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "testnewline", 2024-09-12T12:37:23.911 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.911 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.911 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.911 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.911 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.911 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.911 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.912 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.912 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.912 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.912 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.912 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.912 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.912 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.912 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.912 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snap_schedule", 2024-09-12T12:37:23.912 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.912 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.912 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.912 INFO:teuthology.orchestra.run.smithi033.stdout: "allow_m_granularity": { 2024-09-12T12:37:23.913 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "allow_m_granularity", 2024-09-12T12:37:23.913 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.913 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.913 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.913 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.913 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.913 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.913 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.913 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T12:37:23.913 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.913 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.913 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.914 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.914 INFO:teuthology.orchestra.run.smithi033.stdout: "dump_on_update": { 2024-09-12T12:37:23.914 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "dump_on_update", 2024-09-12T12:37:23.914 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.914 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.914 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.914 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.914 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.914 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.914 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.914 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "dump database to debug log on update", 2024-09-12T12:37:23.914 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.915 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.915 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.915 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.915 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.915 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.915 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.915 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.915 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.915 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.915 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.915 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.915 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.916 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.916 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.916 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.916 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.916 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.916 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.916 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.916 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.916 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.916 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.916 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.916 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.917 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.917 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.917 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.917 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.917 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.917 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.917 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.917 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.917 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.917 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.917 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.917 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.918 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.918 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.918 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.918 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.918 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.918 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.918 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.918 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.918 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.918 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.918 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.918 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.919 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.919 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.919 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.919 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.919 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.919 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.919 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.919 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.919 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.919 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.919 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.919 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.920 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.920 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.920 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.920 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.920 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.920 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.920 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.920 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.920 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.920 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.920 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.921 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.921 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.921 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.921 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.921 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.921 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "stats", 2024-09-12T12:37:23.921 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.921 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.921 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.921 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.921 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.921 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.922 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.922 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.922 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.922 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.922 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.922 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.922 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.922 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.922 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.922 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.922 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.922 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.922 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.923 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.923 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.923 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.923 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.923 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.923 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.923 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.923 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.923 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.923 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.923 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.923 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.924 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.924 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.924 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.924 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.924 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.924 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.924 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.924 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.924 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.924 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.924 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.924 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.924 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.925 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.925 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.925 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.925 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.925 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.925 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.925 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.925 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.925 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.925 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.925 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.925 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.926 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.926 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.926 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.926 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.926 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.926 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.926 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.926 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.926 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.926 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.926 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.926 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.927 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.927 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.927 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.927 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.927 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.927 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.927 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.927 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.927 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "status", 2024-09-12T12:37:23.927 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.927 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.928 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.928 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.928 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.928 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.928 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.928 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.928 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.928 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.928 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.928 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.928 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.928 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.929 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.929 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.929 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.929 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.929 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.929 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.929 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.929 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.929 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.929 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.929 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.929 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.930 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.930 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.930 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.930 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.930 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.930 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.930 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.930 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.930 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.930 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.930 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.931 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.931 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.931 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.931 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.931 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.931 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.931 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.931 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.931 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.931 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.931 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.931 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.932 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.932 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.932 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.932 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.932 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.932 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.932 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.932 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.932 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.932 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.932 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.933 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.933 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.933 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.933 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.933 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.933 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.933 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.933 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.933 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.933 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.933 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.933 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.934 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.934 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.934 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.934 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.934 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "telegraf", 2024-09-12T12:37:23.934 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.934 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.934 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.934 INFO:teuthology.orchestra.run.smithi033.stdout: "address": { 2024-09-12T12:37:23.934 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "address", 2024-09-12T12:37:23.934 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.934 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.935 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.935 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T12:37:23.935 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.935 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.935 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.935 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.935 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.935 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.935 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.935 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.936 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-09-12T12:37:23.936 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-09-12T12:37:23.936 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:23.936 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.936 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.936 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "15", 2024-09-12T12:37:23.936 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.936 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.936 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.936 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.936 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.937 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.937 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.937 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.937 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.937 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.937 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.937 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.937 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.937 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.937 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.937 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.937 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.938 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.938 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.938 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.938 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.938 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.938 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.938 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.938 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.938 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.938 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.938 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.938 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.939 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.939 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.939 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.939 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.939 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.939 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.939 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.939 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.939 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.939 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.939 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.940 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.940 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.940 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.940 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.940 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.940 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.940 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.940 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.940 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.940 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.941 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.941 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.941 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.941 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.941 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.941 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.941 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.941 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.941 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.941 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.941 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.942 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.942 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.942 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.942 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.942 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.942 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.942 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.942 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.942 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.942 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.942 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.942 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.943 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.943 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.943 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.943 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.943 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.943 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.943 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.943 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.943 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "telemetry", 2024-09-12T12:37:23.943 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.943 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.944 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.944 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_basic": { 2024-09-12T12:37:23.944 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_basic", 2024-09-12T12:37:23.944 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.944 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.944 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.944 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.944 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.944 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.944 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.944 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T12:37:23.944 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.945 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.945 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.945 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.945 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_crash": { 2024-09-12T12:37:23.945 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_crash", 2024-09-12T12:37:23.945 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.945 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.945 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.945 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.945 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.946 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.946 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.946 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T12:37:23.946 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.946 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.946 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.946 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.946 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_device": { 2024-09-12T12:37:23.946 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_device", 2024-09-12T12:37:23.946 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.947 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.947 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.947 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.947 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.947 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.947 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.947 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T12:37:23.947 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.947 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.947 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.947 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.947 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_ident": { 2024-09-12T12:37:23.948 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_ident", 2024-09-12T12:37:23.948 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.948 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.948 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.948 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.948 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.948 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.948 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.948 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T12:37:23.948 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.948 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.948 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.949 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.949 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_perf": { 2024-09-12T12:37:23.949 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_perf", 2024-09-12T12:37:23.949 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.949 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.949 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.949 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.949 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.949 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.949 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.950 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T12:37:23.950 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.950 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.950 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.950 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.950 INFO:teuthology.orchestra.run.smithi033.stdout: "contact": { 2024-09-12T12:37:23.950 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "contact", 2024-09-12T12:37:23.950 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.950 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.950 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.950 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.951 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.951 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.951 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.951 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.951 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.951 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.951 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.951 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.951 INFO:teuthology.orchestra.run.smithi033.stdout: "description": { 2024-09-12T12:37:23.951 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "description", 2024-09-12T12:37:23.951 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.951 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.952 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.952 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.952 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.952 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.952 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.952 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.952 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.952 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.952 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.952 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.952 INFO:teuthology.orchestra.run.smithi033.stdout: "device_url": { 2024-09-12T12:37:23.953 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "device_url", 2024-09-12T12:37:23.953 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.953 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.953 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.953 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T12:37:23.953 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.953 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.953 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.953 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.953 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.953 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.954 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.954 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.954 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": { 2024-09-12T12:37:23.954 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enabled", 2024-09-12T12:37:23.954 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.954 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.954 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.954 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.954 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.954 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.954 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.954 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.955 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.955 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.955 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.955 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.955 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-09-12T12:37:23.955 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-09-12T12:37:23.955 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.955 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.955 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.955 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "24", 2024-09-12T12:37:23.955 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "8", 2024-09-12T12:37:23.956 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.956 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.956 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.956 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.956 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.956 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.956 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.956 INFO:teuthology.orchestra.run.smithi033.stdout: "last_opt_revision": { 2024-09-12T12:37:23.956 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "last_opt_revision", 2024-09-12T12:37:23.956 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.956 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.957 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.957 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "1", 2024-09-12T12:37:23.957 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.957 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.957 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.957 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.957 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.957 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.957 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.957 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.957 INFO:teuthology.orchestra.run.smithi033.stdout: "leaderboard": { 2024-09-12T12:37:23.958 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "leaderboard", 2024-09-12T12:37:23.958 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.958 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.958 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.958 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.958 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.958 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.958 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.958 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.958 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.958 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.959 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.959 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.959 INFO:teuthology.orchestra.run.smithi033.stdout: "leaderboard_description": { 2024-09-12T12:37:23.959 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "leaderboard_description", 2024-09-12T12:37:23.959 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.959 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.959 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.959 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.959 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.959 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.959 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.959 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.960 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.960 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.960 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.960 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.960 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.960 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.960 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.960 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.960 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.960 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.960 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.961 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.961 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.961 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.961 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.961 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.961 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.961 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.961 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.961 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.961 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.961 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.961 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.961 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.962 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.962 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.962 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.962 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.962 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.962 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.962 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.962 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.962 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.962 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.962 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.962 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.962 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.963 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.963 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.963 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.963 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.963 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.963 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.963 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.963 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.963 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.963 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.963 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.964 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.964 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.964 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.964 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.964 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.964 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.964 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.964 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.964 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.964 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.964 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.964 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.965 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.965 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.965 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.965 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.965 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.965 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.965 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.965 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.965 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.965 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.965 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.965 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.965 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.966 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.966 INFO:teuthology.orchestra.run.smithi033.stdout: "organization": { 2024-09-12T12:37:23.966 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "organization", 2024-09-12T12:37:23.966 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.966 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.966 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.969 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.969 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.969 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.969 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.969 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.969 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.969 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.970 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.970 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.970 INFO:teuthology.orchestra.run.smithi033.stdout: "proxy": { 2024-09-12T12:37:23.970 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "proxy", 2024-09-12T12:37:23.970 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.970 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.970 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.970 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.970 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.970 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.970 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.971 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.971 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.971 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.971 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.971 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.971 INFO:teuthology.orchestra.run.smithi033.stdout: "url": { 2024-09-12T12:37:23.971 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "url", 2024-09-12T12:37:23.971 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.971 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.971 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.971 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T12:37:23.971 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.971 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.972 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.972 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.972 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.972 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.972 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.972 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.972 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.972 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.972 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.972 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "test_orchestrator", 2024-09-12T12:37:23.973 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.973 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.973 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.973 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.973 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.973 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.973 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.973 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.973 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.973 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.974 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.974 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.974 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.974 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.974 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.974 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.974 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.974 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.974 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.974 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.974 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.974 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.975 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.975 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.975 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.975 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.975 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.975 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.975 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.975 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.975 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.975 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.975 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.976 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.976 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.976 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.976 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.976 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.976 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.976 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.976 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.976 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.976 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.976 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.977 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.977 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.977 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.977 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.977 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.977 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.977 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.977 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.977 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.977 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.977 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.978 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.978 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.978 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.978 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.978 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.978 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.978 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.978 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.978 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.978 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.978 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.978 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.979 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.979 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.979 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.979 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.979 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.979 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.979 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.979 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.979 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.979 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "volumes", 2024-09-12T12:37:23.979 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.980 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.980 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.980 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.980 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.980 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.980 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.980 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.980 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.980 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.981 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.981 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.981 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.981 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.981 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.981 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.981 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.981 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.981 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.981 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.981 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.982 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.982 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.982 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.982 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.982 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.982 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.982 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.982 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.982 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.982 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.982 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.982 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.983 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.983 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.983 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.983 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.983 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.983 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.983 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.983 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.983 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.983 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.983 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:23.984 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.984 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.984 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.984 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.984 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.984 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.984 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.984 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.984 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.984 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.984 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.985 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.985 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.985 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.985 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.985 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:23.985 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:23.985 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.985 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.985 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.985 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.985 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.986 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.986 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.986 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.986 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.986 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.986 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.986 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.986 INFO:teuthology.orchestra.run.smithi033.stdout: "max_concurrent_clones": { 2024-09-12T12:37:23.986 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_concurrent_clones", 2024-09-12T12:37:23.986 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.986 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.987 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.987 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "4", 2024-09-12T12:37:23.987 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.987 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.987 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.987 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T12:37:23.987 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.987 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.987 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.987 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.987 INFO:teuthology.orchestra.run.smithi033.stdout: "periodic_async_work": { 2024-09-12T12:37:23.988 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "periodic_async_work", 2024-09-12T12:37:23.988 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.988 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.988 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.988 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.988 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.988 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.988 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.988 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Periodically check for async work", 2024-09-12T12:37:23.988 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.988 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.989 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.989 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.989 INFO:teuthology.orchestra.run.smithi033.stdout: "snapshot_clone_delay": { 2024-09-12T12:37:23.989 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snapshot_clone_delay", 2024-09-12T12:37:23.989 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:23.989 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.989 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.989 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-12T12:37:23.989 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.989 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.990 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.990 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T12:37:23.990 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.990 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.990 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.990 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.990 INFO:teuthology.orchestra.run.smithi033.stdout: "snapshot_clone_no_wait": { 2024-09-12T12:37:23.990 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T12:37:23.990 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.990 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.991 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.991 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:23.991 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.991 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.991 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.991 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T12:37:23.991 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.991 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.991 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.991 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.991 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:23.991 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.992 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:23.992 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix", 2024-09-12T12:37:23.992 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:23.992 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:23.992 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:23.992 INFO:teuthology.orchestra.run.smithi033.stdout: "discovery_interval": { 2024-09-12T12:37:23.992 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "discovery_interval", 2024-09-12T12:37:23.992 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-09-12T12:37:23.992 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.992 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.993 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "100", 2024-09-12T12:37:23.993 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.993 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.993 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.993 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.993 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.993 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.993 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.993 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.993 INFO:teuthology.orchestra.run.smithi033.stdout: "identifier": { 2024-09-12T12:37:23.993 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "identifier", 2024-09-12T12:37:23.993 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.994 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.994 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.994 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.994 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.994 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.994 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.994 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.994 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.994 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.994 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.994 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.995 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-09-12T12:37:23.995 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-09-12T12:37:23.995 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:23.995 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.995 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:23.995 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-09-12T12:37:23.995 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.995 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.995 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.995 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.995 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.996 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.996 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.996 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.996 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:23.996 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:23.996 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.996 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.996 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.996 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:23.996 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.996 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.997 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:23.997 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:23.997 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:23.997 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:23.997 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:23.997 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:23.997 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:23.997 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:23.997 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.997 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.997 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.998 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.998 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.998 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:23.998 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:23.998 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:23.998 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.998 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:23.998 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:23.998 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:23.998 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:23.999 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:23.999 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:23.999 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:23.999 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:23.999 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:23.999 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:23.999 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:23.999 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:23.999 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:23.999 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:23.999 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.000 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:24.000 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.000 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.000 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.000 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.000 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.000 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.000 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.000 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.000 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.000 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.001 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.001 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.001 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.001 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.001 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.001 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:24.001 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:24.001 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.001 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.001 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.001 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.002 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.002 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.002 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.002 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.002 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.002 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.002 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.002 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.002 INFO:teuthology.orchestra.run.smithi033.stdout: "zabbix_host": { 2024-09-12T12:37:24.002 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix_host", 2024-09-12T12:37:24.002 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.003 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.003 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.003 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.003 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.003 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.003 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.003 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.003 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.003 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.003 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.003 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.004 INFO:teuthology.orchestra.run.smithi033.stdout: "zabbix_port": { 2024-09-12T12:37:24.004 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix_port", 2024-09-12T12:37:24.004 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:24.004 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.004 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.004 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10051", 2024-09-12T12:37:24.004 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.004 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.004 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.004 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.004 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.005 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.005 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.005 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.005 INFO:teuthology.orchestra.run.smithi033.stdout: "zabbix_sender": { 2024-09-12T12:37:24.005 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix_sender", 2024-09-12T12:37:24.005 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.005 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.005 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.005 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T12:37:24.005 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.005 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.005 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.006 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.006 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.006 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.006 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.006 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.006 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.006 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.006 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-09-12T12:37:24.006 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.006 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.006 INFO:teuthology.orchestra.run.smithi033.stdout: "modules": [ 2024-09-12T12:37:24.007 INFO:teuthology.orchestra.run.smithi033.stdout: "cephadm", 2024-09-12T12:37:24.007 INFO:teuthology.orchestra.run.smithi033.stdout: "dashboard", 2024-09-12T12:37:24.007 INFO:teuthology.orchestra.run.smithi033.stdout: "iostat", 2024-09-12T12:37:24.007 INFO:teuthology.orchestra.run.smithi033.stdout: "nfs", 2024-09-12T12:37:24.007 INFO:teuthology.orchestra.run.smithi033.stdout: "restful" 2024-09-12T12:37:24.007 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.007 INFO:teuthology.orchestra.run.smithi033.stdout: "available_modules": [ 2024-09-12T12:37:24.007 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:24.007 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "alerts", 2024-09-12T12:37:24.007 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:24.007 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:24.007 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:24.008 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-09-12T12:37:24.008 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-09-12T12:37:24.008 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:24.008 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.008 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.008 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-09-12T12:37:24.008 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.008 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.009 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.009 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T12:37:24.009 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.009 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.009 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.009 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.009 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:24.009 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:24.009 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.009 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.009 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.010 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.010 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.010 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.010 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.010 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.010 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.010 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.010 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.010 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.010 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.011 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.011 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.011 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.011 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.011 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.011 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.011 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:24.011 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:24.011 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.011 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.011 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.011 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.012 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.012 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.012 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.012 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.012 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.012 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.012 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.012 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.012 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:24.012 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:24.013 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.013 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.013 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.013 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:24.013 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.013 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.013 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.013 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.013 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.013 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.013 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.014 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.014 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.014 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.014 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.014 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.014 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.014 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.014 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.014 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:24.014 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:24.014 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.015 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.015 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.015 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.015 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.015 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.015 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.015 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.015 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.015 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.015 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.015 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.016 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_destination": { 2024-09-12T12:37:24.016 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_destination", 2024-09-12T12:37:24.016 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.016 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.016 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.016 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.016 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.016 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.016 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.016 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Email address to send alerts to", 2024-09-12T12:37:24.016 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.017 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.017 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.017 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.017 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_from_name": { 2024-09-12T12:37:24.017 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_from_name", 2024-09-12T12:37:24.017 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.017 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.017 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.017 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "Ceph", 2024-09-12T12:37:24.017 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.017 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.017 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.018 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Email From: name", 2024-09-12T12:37:24.018 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.018 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.018 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.018 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.018 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_host": { 2024-09-12T12:37:24.018 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_host", 2024-09-12T12:37:24.018 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.018 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.018 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.019 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.019 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.019 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.019 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.019 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SMTP server", 2024-09-12T12:37:24.019 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.019 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.019 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.019 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.019 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_password": { 2024-09-12T12:37:24.019 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_password", 2024-09-12T12:37:24.020 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.020 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.020 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.020 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.020 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.020 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.020 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.020 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Password to authenticate with", 2024-09-12T12:37:24.020 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.020 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.020 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.020 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.021 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_port": { 2024-09-12T12:37:24.021 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_port", 2024-09-12T12:37:24.021 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:24.021 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.021 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.021 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "465", 2024-09-12T12:37:24.021 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.021 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.021 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.021 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SMTP port", 2024-09-12T12:37:24.021 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.022 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.022 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.022 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.022 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_sender": { 2024-09-12T12:37:24.022 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_sender", 2024-09-12T12:37:24.022 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.022 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.022 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.022 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.022 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.022 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.023 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.023 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SMTP envelope sender", 2024-09-12T12:37:24.023 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.023 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.023 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.023 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.023 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_ssl": { 2024-09-12T12:37:24.023 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_ssl", 2024-09-12T12:37:24.023 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.023 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.023 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.023 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:24.024 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.024 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.024 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.024 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T12:37:24.024 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.024 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.024 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.024 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.024 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_user": { 2024-09-12T12:37:24.024 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_user", 2024-09-12T12:37:24.024 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.024 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.025 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.025 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.025 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.025 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.025 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.025 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "User to authenticate as", 2024-09-12T12:37:24.025 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.025 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.025 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.025 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.026 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.026 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.026 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:24.026 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "balancer", 2024-09-12T12:37:24.026 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:24.026 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:24.026 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:24.026 INFO:teuthology.orchestra.run.smithi033.stdout: "active": { 2024-09-12T12:37:24.026 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "active", 2024-09-12T12:37:24.026 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.026 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.026 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.027 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:24.027 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.027 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.027 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.027 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T12:37:24.027 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.027 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.027 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.027 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.027 INFO:teuthology.orchestra.run.smithi033.stdout: "begin_time": { 2024-09-12T12:37:24.027 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "begin_time", 2024-09-12T12:37:24.027 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.028 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.028 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.028 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0000", 2024-09-12T12:37:24.028 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.028 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.028 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.028 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T12:37:24.028 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T12:37:24.028 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.028 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.028 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.029 INFO:teuthology.orchestra.run.smithi033.stdout: "begin_weekday": { 2024-09-12T12:37:24.029 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "begin_weekday", 2024-09-12T12:37:24.029 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-09-12T12:37:24.029 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.029 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.029 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-12T12:37:24.029 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "0", 2024-09-12T12:37:24.029 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "6", 2024-09-12T12:37:24.029 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.029 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T12:37:24.029 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T12:37:24.030 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.030 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.030 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.030 INFO:teuthology.orchestra.run.smithi033.stdout: "crush_compat_max_iterations": { 2024-09-12T12:37:24.030 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crush_compat_max_iterations", 2024-09-12T12:37:24.030 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-09-12T12:37:24.030 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.030 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.030 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "25", 2024-09-12T12:37:24.030 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-09-12T12:37:24.030 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "250", 2024-09-12T12:37:24.031 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.031 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T12:37:24.031 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.031 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.031 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.031 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.031 INFO:teuthology.orchestra.run.smithi033.stdout: "crush_compat_metrics": { 2024-09-12T12:37:24.031 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crush_compat_metrics", 2024-09-12T12:37:24.031 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.031 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.031 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.031 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T12:37:24.032 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.032 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.032 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.032 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T12:37:24.032 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T12:37:24.032 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.032 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.032 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.032 INFO:teuthology.orchestra.run.smithi033.stdout: "crush_compat_step": { 2024-09-12T12:37:24.032 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crush_compat_step", 2024-09-12T12:37:24.033 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-09-12T12:37:24.033 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.033 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.033 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0.5", 2024-09-12T12:37:24.033 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "0.001", 2024-09-12T12:37:24.033 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "0.999", 2024-09-12T12:37:24.033 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.033 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "aggressiveness of optimization", 2024-09-12T12:37:24.033 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T12:37:24.033 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.033 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.034 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.034 INFO:teuthology.orchestra.run.smithi033.stdout: "end_time": { 2024-09-12T12:37:24.034 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "end_time", 2024-09-12T12:37:24.034 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.034 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.034 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.034 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "2359", 2024-09-12T12:37:24.034 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.034 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.034 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.034 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T12:37:24.034 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T12:37:24.035 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.035 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.035 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.035 INFO:teuthology.orchestra.run.smithi033.stdout: "end_weekday": { 2024-09-12T12:37:24.035 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "end_weekday", 2024-09-12T12:37:24.035 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-09-12T12:37:24.035 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.035 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.035 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-12T12:37:24.035 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "0", 2024-09-12T12:37:24.035 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "6", 2024-09-12T12:37:24.036 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.036 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T12:37:24.036 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T12:37:24.036 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.036 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.036 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.036 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:24.036 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:24.036 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.036 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.036 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.037 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.037 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.037 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.037 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.037 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.037 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.037 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.037 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.037 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.037 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.037 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.037 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.038 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.038 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.038 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.038 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.038 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:24.038 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:24.038 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.038 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.038 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.038 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.038 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.038 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.039 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.039 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.039 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.039 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.039 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.039 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.039 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:24.039 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:24.039 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.039 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.039 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.039 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:24.040 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.040 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.040 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.040 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.040 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.040 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.040 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.040 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.040 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.040 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.040 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.041 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.041 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.041 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.041 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.041 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:24.041 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:24.041 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.041 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.041 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.041 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.041 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.041 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.042 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.042 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.042 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.042 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.042 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.042 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.042 INFO:teuthology.orchestra.run.smithi033.stdout: "min_score": { 2024-09-12T12:37:24.042 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "min_score", 2024-09-12T12:37:24.042 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-09-12T12:37:24.042 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.042 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.043 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-12T12:37:24.043 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.043 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.043 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.043 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T12:37:24.043 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.043 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.043 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.043 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.043 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": { 2024-09-12T12:37:24.043 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mode", 2024-09-12T12:37:24.043 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.044 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.044 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.044 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "upmap", 2024-09-12T12:37:24.044 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.044 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.044 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.044 INFO:teuthology.orchestra.run.smithi033.stdout: "crush-compat", 2024-09-12T12:37:24.044 INFO:teuthology.orchestra.run.smithi033.stdout: "none", 2024-09-12T12:37:24.044 INFO:teuthology.orchestra.run.smithi033.stdout: "read", 2024-09-12T12:37:24.044 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap", 2024-09-12T12:37:24.045 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap-read" 2024-09-12T12:37:24.045 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.045 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Balancer mode", 2024-09-12T12:37:24.045 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.045 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.045 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.045 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.045 INFO:teuthology.orchestra.run.smithi033.stdout: "pool_ids": { 2024-09-12T12:37:24.045 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pool_ids", 2024-09-12T12:37:24.045 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.045 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.045 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.046 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.046 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.046 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.046 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.046 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T12:37:24.046 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.046 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.046 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.046 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.046 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-09-12T12:37:24.046 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-09-12T12:37:24.046 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:24.047 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.047 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.047 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-09-12T12:37:24.047 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.047 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.047 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.047 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T12:37:24.047 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.047 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.047 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.047 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.047 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap_max_deviation": { 2024-09-12T12:37:24.048 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "upmap_max_deviation", 2024-09-12T12:37:24.048 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:24.048 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.048 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.048 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-09-12T12:37:24.048 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-09-12T12:37:24.048 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.048 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.048 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T12:37:24.048 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T12:37:24.048 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.048 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.049 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.049 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap_max_optimizations": { 2024-09-12T12:37:24.049 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "upmap_max_optimizations", 2024-09-12T12:37:24.049 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-09-12T12:37:24.049 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.049 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.049 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-12T12:37:24.049 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.049 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.049 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.049 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T12:37:24.049 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.050 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.050 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.050 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.050 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.050 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.050 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:24.050 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephadm", 2024-09-12T12:37:24.050 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:24.050 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:24.050 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:24.050 INFO:teuthology.orchestra.run.smithi033.stdout: "agent_down_multiplier": { 2024-09-12T12:37:24.051 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "agent_down_multiplier", 2024-09-12T12:37:24.051 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-09-12T12:37:24.051 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.051 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.051 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "3.0", 2024-09-12T12:37:24.051 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.051 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.051 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.051 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T12:37:24.051 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.051 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.051 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.051 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.052 INFO:teuthology.orchestra.run.smithi033.stdout: "agent_refresh_rate": { 2024-09-12T12:37:24.052 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "agent_refresh_rate", 2024-09-12T12:37:24.052 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:24.052 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.052 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.052 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "20", 2024-09-12T12:37:24.052 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.052 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.052 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.052 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T12:37:24.052 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.052 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.053 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.053 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.053 INFO:teuthology.orchestra.run.smithi033.stdout: "agent_starting_port": { 2024-09-12T12:37:24.053 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "agent_starting_port", 2024-09-12T12:37:24.053 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:24.053 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.053 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.053 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "4721", 2024-09-12T12:37:24.053 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.053 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.053 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.053 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T12:37:24.054 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.054 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.054 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.054 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.054 INFO:teuthology.orchestra.run.smithi033.stdout: "allow_ptrace": { 2024-09-12T12:37:24.054 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "allow_ptrace", 2024-09-12T12:37:24.054 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.054 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.054 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.054 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.054 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.055 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.055 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.055 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T12:37:24.055 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T12:37:24.055 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.055 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.055 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.055 INFO:teuthology.orchestra.run.smithi033.stdout: "autotune_interval": { 2024-09-12T12:37:24.055 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "autotune_interval", 2024-09-12T12:37:24.055 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:24.055 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.055 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.056 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-09-12T12:37:24.056 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.056 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.056 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.056 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T12:37:24.056 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.056 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.056 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.056 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.056 INFO:teuthology.orchestra.run.smithi033.stdout: "autotune_memory_target_ratio": { 2024-09-12T12:37:24.056 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T12:37:24.057 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-09-12T12:37:24.057 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.057 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.057 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0.7", 2024-09-12T12:37:24.057 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.057 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.057 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.057 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T12:37:24.057 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.057 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.057 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.057 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.058 INFO:teuthology.orchestra.run.smithi033.stdout: "cephadm_log_destination": { 2024-09-12T12:37:24.058 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephadm_log_destination", 2024-09-12T12:37:24.058 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.058 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.058 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.058 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.058 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.058 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.058 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.058 INFO:teuthology.orchestra.run.smithi033.stdout: "file", 2024-09-12T12:37:24.058 INFO:teuthology.orchestra.run.smithi033.stdout: "file,syslog", 2024-09-12T12:37:24.058 INFO:teuthology.orchestra.run.smithi033.stdout: "syslog" 2024-09-12T12:37:24.059 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.059 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T12:37:24.059 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.059 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.059 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.059 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.059 INFO:teuthology.orchestra.run.smithi033.stdout: "cgroups_split": { 2024-09-12T12:37:24.059 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cgroups_split", 2024-09-12T12:37:24.059 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.059 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.059 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.060 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:24.060 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.060 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.060 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.060 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T12:37:24.060 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.060 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.060 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.060 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.060 INFO:teuthology.orchestra.run.smithi033.stdout: "config_checks_enabled": { 2024-09-12T12:37:24.060 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "config_checks_enabled", 2024-09-12T12:37:24.060 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.061 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.061 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.061 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.061 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.061 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.061 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.061 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T12:37:24.061 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.061 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.061 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.061 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.062 INFO:teuthology.orchestra.run.smithi033.stdout: "config_dashboard": { 2024-09-12T12:37:24.062 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "config_dashboard", 2024-09-12T12:37:24.062 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.062 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.062 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.062 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:24.062 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.062 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.062 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.062 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T12:37:24.062 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.062 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.062 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.063 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.063 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_alertmanager": { 2024-09-12T12:37:24.063 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_alertmanager", 2024-09-12T12:37:24.063 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.063 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.063 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.063 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T12:37:24.063 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.063 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.063 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.063 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-09-12T12:37:24.063 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.064 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.064 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.064 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.064 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_base": { 2024-09-12T12:37:24.064 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_base", 2024-09-12T12:37:24.064 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.064 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.064 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.064 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T12:37:24.064 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.064 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.065 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.065 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Container image name, without the tag", 2024-09-12T12:37:24.065 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.065 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.065 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.065 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.065 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_elasticsearch": { 2024-09-12T12:37:24.065 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_elasticsearch", 2024-09-12T12:37:24.065 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.065 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.065 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.066 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T12:37:24.066 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.066 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.066 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.066 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "elasticsearch container image", 2024-09-12T12:37:24.066 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.066 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.066 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.066 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.066 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_grafana": { 2024-09-12T12:37:24.066 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_grafana", 2024-09-12T12:37:24.067 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.067 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.067 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.067 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T12:37:24.067 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.067 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.067 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.067 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-09-12T12:37:24.067 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.067 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.068 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.068 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.068 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_haproxy": { 2024-09-12T12:37:24.068 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_haproxy", 2024-09-12T12:37:24.068 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.068 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.068 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.068 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T12:37:24.068 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.068 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.068 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.069 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "HAproxy container image", 2024-09-12T12:37:24.069 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.069 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.069 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.069 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.069 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_jaeger_agent": { 2024-09-12T12:37:24.069 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_jaeger_agent", 2024-09-12T12:37:24.069 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.069 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.069 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.069 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T12:37:24.069 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.070 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.070 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.070 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Jaeger agent container image", 2024-09-12T12:37:24.070 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.070 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.070 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.070 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.070 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_jaeger_collector": { 2024-09-12T12:37:24.070 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_jaeger_collector", 2024-09-12T12:37:24.070 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.070 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.071 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.071 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T12:37:24.071 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.071 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.071 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.073 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Jaeger collector container image", 2024-09-12T12:37:24.073 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.073 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.073 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.073 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.073 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_jaeger_query": { 2024-09-12T12:37:24.073 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_jaeger_query", 2024-09-12T12:37:24.073 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.074 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.074 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.074 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T12:37:24.074 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.074 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.074 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.074 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Jaeger query container image", 2024-09-12T12:37:24.074 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.074 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.074 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.074 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.075 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_keepalived": { 2024-09-12T12:37:24.075 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_keepalived", 2024-09-12T12:37:24.075 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.075 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.075 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.075 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T12:37:24.075 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.075 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.075 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.075 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Keepalived container image", 2024-09-12T12:37:24.075 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.076 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.076 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.076 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.076 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_loki": { 2024-09-12T12:37:24.076 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_loki", 2024-09-12T12:37:24.076 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.076 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.076 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.076 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T12:37:24.076 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.076 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.077 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.077 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Loki container image", 2024-09-12T12:37:24.077 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.077 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.077 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.077 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.077 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_node_exporter": { 2024-09-12T12:37:24.077 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_node_exporter", 2024-09-12T12:37:24.077 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.077 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.077 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.077 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T12:37:24.078 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.078 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.078 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.078 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-09-12T12:37:24.078 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.078 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.078 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.078 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.078 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_nvmeof": { 2024-09-12T12:37:24.078 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_nvmeof", 2024-09-12T12:37:24.078 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.079 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.079 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.079 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T12:37:24.079 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.079 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.079 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.079 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Nvme-of container image", 2024-09-12T12:37:24.079 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.079 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.079 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.079 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.079 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_prometheus": { 2024-09-12T12:37:24.080 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_prometheus", 2024-09-12T12:37:24.080 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.080 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.080 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.080 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T12:37:24.080 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.080 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.080 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.080 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-09-12T12:37:24.080 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.080 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.081 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.081 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.081 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_promtail": { 2024-09-12T12:37:24.081 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_promtail", 2024-09-12T12:37:24.081 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.081 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.081 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.081 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T12:37:24.081 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.081 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.081 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.082 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Promtail container image", 2024-09-12T12:37:24.082 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.082 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.082 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.082 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.082 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_samba": { 2024-09-12T12:37:24.082 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_samba", 2024-09-12T12:37:24.082 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.082 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.082 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.083 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T12:37:24.083 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.083 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.083 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.083 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Samba/SMB container image", 2024-09-12T12:37:24.083 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.083 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.083 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.083 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.083 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_snmp_gateway": { 2024-09-12T12:37:24.083 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_snmp_gateway", 2024-09-12T12:37:24.084 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.084 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.084 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.084 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T12:37:24.084 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.084 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.084 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.084 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SNMP Gateway container image", 2024-09-12T12:37:24.084 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.084 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.084 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.084 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.085 INFO:teuthology.orchestra.run.smithi033.stdout: "container_init": { 2024-09-12T12:37:24.085 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_init", 2024-09-12T12:37:24.085 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.085 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.085 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.085 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:24.085 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.085 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.085 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.085 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T12:37:24.085 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.086 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.086 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.086 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.086 INFO:teuthology.orchestra.run.smithi033.stdout: "daemon_cache_timeout": { 2024-09-12T12:37:24.086 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "daemon_cache_timeout", 2024-09-12T12:37:24.086 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:24.086 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.086 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.086 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-09-12T12:37:24.086 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.086 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.087 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.087 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T12:37:24.087 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.087 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.087 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.087 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.087 INFO:teuthology.orchestra.run.smithi033.stdout: "default_cephadm_command_timeout": { 2024-09-12T12:37:24.087 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T12:37:24.087 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:24.087 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.087 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.087 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "900", 2024-09-12T12:37:24.088 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.088 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.088 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.088 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T12:37:24.088 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.088 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.088 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.088 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.088 INFO:teuthology.orchestra.run.smithi033.stdout: "default_registry": { 2024-09-12T12:37:24.088 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "default_registry", 2024-09-12T12:37:24.088 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.088 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.089 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.089 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io", 2024-09-12T12:37:24.089 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.089 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.089 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.089 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T12:37:24.089 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.089 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.089 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.089 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.089 INFO:teuthology.orchestra.run.smithi033.stdout: "device_cache_timeout": { 2024-09-12T12:37:24.090 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "device_cache_timeout", 2024-09-12T12:37:24.090 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:24.090 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.090 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.090 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "1800", 2024-09-12T12:37:24.090 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.090 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.090 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.090 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "seconds to cache device inventory", 2024-09-12T12:37:24.090 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.090 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.090 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.091 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.091 INFO:teuthology.orchestra.run.smithi033.stdout: "device_enhanced_scan": { 2024-09-12T12:37:24.091 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "device_enhanced_scan", 2024-09-12T12:37:24.091 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.091 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.091 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.091 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.091 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.091 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.091 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.092 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T12:37:24.092 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.092 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.092 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.092 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.092 INFO:teuthology.orchestra.run.smithi033.stdout: "facts_cache_timeout": { 2024-09-12T12:37:24.092 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "facts_cache_timeout", 2024-09-12T12:37:24.092 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:24.092 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.092 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.092 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-09-12T12:37:24.093 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.093 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.093 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.093 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "seconds to cache host facts data", 2024-09-12T12:37:24.093 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.093 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.093 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.093 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.093 INFO:teuthology.orchestra.run.smithi033.stdout: "grafana_dashboards_path": { 2024-09-12T12:37:24.093 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "grafana_dashboards_path", 2024-09-12T12:37:24.093 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.094 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.094 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.094 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T12:37:24.094 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.094 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.094 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.094 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T12:37:24.094 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.094 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.094 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.094 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.095 INFO:teuthology.orchestra.run.smithi033.stdout: "host_check_interval": { 2024-09-12T12:37:24.095 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "host_check_interval", 2024-09-12T12:37:24.095 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:24.095 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.095 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.095 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-09-12T12:37:24.095 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.095 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.095 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.095 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to perform a host check", 2024-09-12T12:37:24.095 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.096 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.096 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.096 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.096 INFO:teuthology.orchestra.run.smithi033.stdout: "hw_monitoring": { 2024-09-12T12:37:24.096 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "hw_monitoring", 2024-09-12T12:37:24.096 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.096 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.096 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.096 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.096 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.096 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.096 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.097 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T12:37:24.097 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.097 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.097 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.097 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.097 INFO:teuthology.orchestra.run.smithi033.stdout: "inventory_list_all": { 2024-09-12T12:37:24.097 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "inventory_list_all", 2024-09-12T12:37:24.097 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.097 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.097 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.097 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.098 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.098 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.098 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.098 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T12:37:24.098 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.098 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.098 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.098 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.099 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:24.099 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:24.099 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.099 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.099 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.099 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.099 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.099 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.099 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.099 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.099 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.099 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.100 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.100 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.100 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.100 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.100 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.100 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.100 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.100 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.100 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.100 INFO:teuthology.orchestra.run.smithi033.stdout: "log_refresh_metadata": { 2024-09-12T12:37:24.101 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_refresh_metadata", 2024-09-12T12:37:24.101 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.101 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.101 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.101 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.101 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.101 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.101 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.101 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T12:37:24.101 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.102 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.102 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.102 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.102 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:24.102 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:24.102 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.102 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.102 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.102 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:24.102 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.102 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.103 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.103 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T12:37:24.103 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.103 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.103 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.103 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.103 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:24.103 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:24.103 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.103 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.103 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.104 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:24.104 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.104 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.104 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.104 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.104 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.104 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.104 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.104 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.104 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.104 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.105 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.105 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.105 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.105 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.105 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.105 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:24.105 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:24.105 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.105 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.105 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.105 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.105 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.106 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.106 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.106 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.106 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.106 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.106 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.106 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.106 INFO:teuthology.orchestra.run.smithi033.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T12:37:24.106 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T12:37:24.106 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.106 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.107 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.107 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.107 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.107 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.107 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.107 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T12:37:24.107 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.107 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.107 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.107 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.107 INFO:teuthology.orchestra.run.smithi033.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T12:37:24.108 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T12:37:24.108 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.108 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.108 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.108 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "*", 2024-09-12T12:37:24.108 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.108 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.108 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.108 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T12:37:24.108 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.108 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.108 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.109 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.109 INFO:teuthology.orchestra.run.smithi033.stdout: "max_count_per_host": { 2024-09-12T12:37:24.109 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_count_per_host", 2024-09-12T12:37:24.109 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:24.109 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.109 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.109 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-12T12:37:24.109 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.109 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.109 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.109 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "max number of daemons per service per host", 2024-09-12T12:37:24.110 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.110 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.110 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.110 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.110 INFO:teuthology.orchestra.run.smithi033.stdout: "max_osd_draining_count": { 2024-09-12T12:37:24.110 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_osd_draining_count", 2024-09-12T12:37:24.110 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:24.110 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.110 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.110 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-12T12:37:24.110 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.110 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.111 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.111 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T12:37:24.111 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.111 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.111 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.111 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.111 INFO:teuthology.orchestra.run.smithi033.stdout: "migration_current": { 2024-09-12T12:37:24.111 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "migration_current", 2024-09-12T12:37:24.111 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:24.111 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.111 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.111 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.112 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.112 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.112 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.112 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "internal - do not modify", 2024-09-12T12:37:24.112 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.112 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.112 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.112 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.112 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": { 2024-09-12T12:37:24.113 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mode", 2024-09-12T12:37:24.113 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.113 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.113 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.113 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "root", 2024-09-12T12:37:24.113 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.113 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.113 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.113 INFO:teuthology.orchestra.run.smithi033.stdout: "cephadm-package", 2024-09-12T12:37:24.113 INFO:teuthology.orchestra.run.smithi033.stdout: "root" 2024-09-12T12:37:24.113 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.113 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T12:37:24.114 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.114 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.114 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.114 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.114 INFO:teuthology.orchestra.run.smithi033.stdout: "oob_default_addr": { 2024-09-12T12:37:24.114 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "oob_default_addr", 2024-09-12T12:37:24.114 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.114 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.114 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.114 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "169.254.1.1", 2024-09-12T12:37:24.114 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.115 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.115 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.115 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T12:37:24.115 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.115 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.115 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.115 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.115 INFO:teuthology.orchestra.run.smithi033.stdout: "prometheus_alerts_path": { 2024-09-12T12:37:24.115 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "prometheus_alerts_path", 2024-09-12T12:37:24.115 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.115 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.115 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.116 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T12:37:24.116 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.116 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.116 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.116 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T12:37:24.116 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.116 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.116 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.116 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.116 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_insecure": { 2024-09-12T12:37:24.116 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_insecure", 2024-09-12T12:37:24.117 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.117 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.117 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.117 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.117 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.117 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.117 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.117 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T12:37:24.117 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.117 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.117 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.117 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.118 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_password": { 2024-09-12T12:37:24.118 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_password", 2024-09-12T12:37:24.118 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.118 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.118 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.118 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.118 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.118 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.118 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.118 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T12:37:24.118 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.119 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.119 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.119 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.119 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_url": { 2024-09-12T12:37:24.119 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_url", 2024-09-12T12:37:24.119 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.119 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.119 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.119 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.119 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.119 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.119 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.119 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T12:37:24.120 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.120 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.120 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.120 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.120 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_username": { 2024-09-12T12:37:24.120 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_username", 2024-09-12T12:37:24.120 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.120 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.120 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.120 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.120 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.120 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.121 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.121 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T12:37:24.121 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.121 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.121 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.121 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.121 INFO:teuthology.orchestra.run.smithi033.stdout: "secure_monitoring_stack": { 2024-09-12T12:37:24.121 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "secure_monitoring_stack", 2024-09-12T12:37:24.121 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.121 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.122 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.122 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.122 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.122 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.122 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.122 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T12:37:24.122 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.122 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.122 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.122 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.122 INFO:teuthology.orchestra.run.smithi033.stdout: "service_discovery_port": { 2024-09-12T12:37:24.123 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "service_discovery_port", 2024-09-12T12:37:24.123 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:24.123 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.123 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.123 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8765", 2024-09-12T12:37:24.123 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.123 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.123 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.123 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "cephadm service discovery port", 2024-09-12T12:37:24.123 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.124 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.124 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.124 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.124 INFO:teuthology.orchestra.run.smithi033.stdout: "ssh_config_file": { 2024-09-12T12:37:24.124 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssh_config_file", 2024-09-12T12:37:24.124 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.124 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.124 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.124 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.124 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.125 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.125 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.125 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T12:37:24.125 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.125 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.125 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.125 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.125 INFO:teuthology.orchestra.run.smithi033.stdout: "use_agent": { 2024-09-12T12:37:24.125 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "use_agent", 2024-09-12T12:37:24.125 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.126 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.126 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.126 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.126 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.126 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.126 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.126 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T12:37:24.126 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.126 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.126 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.127 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.127 INFO:teuthology.orchestra.run.smithi033.stdout: "use_repo_digest": { 2024-09-12T12:37:24.127 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "use_repo_digest", 2024-09-12T12:37:24.127 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.127 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.127 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.127 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:24.127 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.127 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.127 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.128 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T12:37:24.128 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.128 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.128 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.128 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.128 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_on_failed_host_check": { 2024-09-12T12:37:24.128 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_on_failed_host_check", 2024-09-12T12:37:24.128 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.128 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.128 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.128 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:24.129 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.129 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.129 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.129 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T12:37:24.129 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.129 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.129 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.129 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.129 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_on_stray_daemons": { 2024-09-12T12:37:24.129 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_on_stray_daemons", 2024-09-12T12:37:24.129 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.129 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.130 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.130 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:24.130 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.130 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.130 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.130 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T12:37:24.130 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.130 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.130 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.130 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.130 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_on_stray_hosts": { 2024-09-12T12:37:24.131 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_on_stray_hosts", 2024-09-12T12:37:24.131 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.131 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.131 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.131 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:24.131 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.131 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.131 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.131 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T12:37:24.131 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.131 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.131 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.132 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.132 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.132 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.132 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:24.132 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crash", 2024-09-12T12:37:24.132 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:24.132 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:24.132 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:24.132 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:24.132 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:24.132 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.133 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.133 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.133 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.133 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.133 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.133 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.133 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.133 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.133 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.133 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.133 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.133 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.134 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.134 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.134 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.134 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.134 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.134 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.134 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:24.134 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:24.134 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.134 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.134 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.134 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.135 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.135 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.135 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.135 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.135 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.135 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.135 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.135 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.135 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:24.135 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:24.135 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.136 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.136 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.136 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:24.136 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.136 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.136 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.136 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.136 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.136 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.136 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.136 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.137 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.137 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.137 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.137 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.137 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.137 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.137 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.137 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:24.137 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:24.137 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.137 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.137 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.138 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.138 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.138 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.138 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.138 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.138 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.138 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.138 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.138 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.138 INFO:teuthology.orchestra.run.smithi033.stdout: "retain_interval": { 2024-09-12T12:37:24.138 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "retain_interval", 2024-09-12T12:37:24.138 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:24.139 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.139 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.139 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "31536000", 2024-09-12T12:37:24.139 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.139 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.139 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.139 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T12:37:24.139 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.139 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.139 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.139 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.139 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_recent_interval": { 2024-09-12T12:37:24.140 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_recent_interval", 2024-09-12T12:37:24.140 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:24.140 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.140 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.140 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "1209600", 2024-09-12T12:37:24.140 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.140 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.140 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.140 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T12:37:24.140 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.141 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.141 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.141 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.141 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.141 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.141 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:24.141 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "dashboard", 2024-09-12T12:37:24.141 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:24.141 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:24.141 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:24.141 INFO:teuthology.orchestra.run.smithi033.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T12:37:24.141 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T12:37:24.142 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:24.142 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.142 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.142 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-12T12:37:24.142 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.142 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.142 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.142 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.142 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.142 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.142 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.143 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.143 INFO:teuthology.orchestra.run.smithi033.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T12:37:24.143 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T12:37:24.143 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.143 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.143 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.143 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.143 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.143 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.143 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.143 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.143 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.144 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.144 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.144 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.144 INFO:teuthology.orchestra.run.smithi033.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T12:37:24.144 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T12:37:24.144 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.144 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.144 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.144 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:24.144 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.144 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.145 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.145 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.145 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.145 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.145 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.145 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.145 INFO:teuthology.orchestra.run.smithi033.stdout: "AUDIT_API_ENABLED": { 2024-09-12T12:37:24.145 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T12:37:24.145 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.145 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.145 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.146 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.146 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.146 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.146 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.146 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.146 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.146 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.146 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.146 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.146 INFO:teuthology.orchestra.run.smithi033.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T12:37:24.146 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T12:37:24.146 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.147 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.147 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.147 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:24.147 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.147 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.147 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.147 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.147 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.147 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.147 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.147 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.148 INFO:teuthology.orchestra.run.smithi033.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T12:37:24.148 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T12:37:24.148 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.148 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.148 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.148 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:24.148 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.148 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.148 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.148 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.148 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.149 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.149 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.149 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.149 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T12:37:24.149 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T12:37:24.149 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.149 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.149 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.149 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:24.149 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.149 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.149 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.150 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.150 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.150 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.150 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.150 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.150 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T12:37:24.150 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T12:37:24.150 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.150 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.150 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.150 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:24.151 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.151 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.151 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.151 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.151 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.151 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.151 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.151 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.151 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T12:37:24.151 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T12:37:24.151 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.151 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.152 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.152 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:24.152 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.152 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.152 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.152 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.152 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.152 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.152 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.152 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.153 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T12:37:24.153 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T12:37:24.153 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.153 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.153 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.153 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:24.153 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.153 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.153 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.153 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.153 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.154 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.154 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.154 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.154 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T12:37:24.154 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T12:37:24.154 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.154 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.154 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.154 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:24.154 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.154 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.154 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.155 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.155 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.155 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.155 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.155 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.155 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T12:37:24.155 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T12:37:24.155 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.155 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.155 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.155 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:24.156 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.156 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.156 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.156 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.156 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.156 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.156 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.156 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.156 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T12:37:24.156 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T12:37:24.156 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.157 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.157 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.157 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:24.157 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.157 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.157 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.157 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.158 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.158 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.158 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.158 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.158 INFO:teuthology.orchestra.run.smithi033.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T12:37:24.158 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T12:37:24.158 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.158 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.158 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.158 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.159 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.159 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.159 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.159 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.159 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.159 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.159 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.159 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.159 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T12:37:24.159 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T12:37:24.159 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.160 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.160 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.160 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "admin", 2024-09-12T12:37:24.160 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.160 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.160 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.160 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.160 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.160 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.160 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.161 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.161 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T12:37:24.161 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T12:37:24.161 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.161 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.161 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.161 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:24.161 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.161 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.161 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.161 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.162 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.162 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.162 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.162 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.162 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_URL": { 2024-09-12T12:37:24.162 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_URL", 2024-09-12T12:37:24.162 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.162 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.162 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.162 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.162 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.163 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.163 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.163 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.163 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.163 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.163 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.163 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.163 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T12:37:24.163 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T12:37:24.163 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.163 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.163 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.164 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "admin", 2024-09-12T12:37:24.164 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.164 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.164 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.164 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.164 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.164 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.164 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.164 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.164 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T12:37:24.165 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T12:37:24.165 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.165 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.165 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.165 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.165 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.165 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.165 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.165 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.165 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.165 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.166 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.166 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.166 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T12:37:24.166 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T12:37:24.166 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.166 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.166 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.166 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.166 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.166 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.166 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.166 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.167 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.167 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.167 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.167 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.167 INFO:teuthology.orchestra.run.smithi033.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T12:37:24.167 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T12:37:24.167 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.167 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.167 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.167 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:24.167 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.167 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.168 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.168 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.168 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.168 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.168 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.168 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.168 INFO:teuthology.orchestra.run.smithi033.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T12:37:24.168 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T12:37:24.168 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.168 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.169 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.169 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.169 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.169 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.169 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.169 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.169 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.169 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.169 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.169 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.169 INFO:teuthology.orchestra.run.smithi033.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T12:37:24.169 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T12:37:24.170 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.170 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.170 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.170 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.170 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.170 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.170 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.170 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.170 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.170 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.171 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.171 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.171 INFO:teuthology.orchestra.run.smithi033.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T12:37:24.171 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T12:37:24.171 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.171 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.171 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.171 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:24.171 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.171 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.171 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.172 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.172 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.172 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.172 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.172 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.172 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T12:37:24.172 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T12:37:24.172 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.172 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.172 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.172 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.173 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.173 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.173 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.173 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.173 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.173 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.173 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.173 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.173 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T12:37:24.173 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T12:37:24.173 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.173 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.174 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.174 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.174 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.174 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.174 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.174 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.174 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.174 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.174 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.174 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.174 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T12:37:24.174 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T12:37:24.175 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.175 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.175 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.175 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:24.175 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.175 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.175 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.175 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.175 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.175 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.175 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.175 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.176 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T12:37:24.176 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T12:37:24.176 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.176 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.176 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.176 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:24.176 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.176 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.176 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.176 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.176 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.176 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.177 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.177 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.177 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T12:37:24.177 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T12:37:24.177 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.177 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.177 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.177 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.177 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.177 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.177 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.178 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.178 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.178 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.178 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.178 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.178 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T12:37:24.178 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T12:37:24.178 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.178 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.178 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.178 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.178 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.179 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.179 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.179 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.179 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.179 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.179 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.179 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.179 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T12:37:24.179 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T12:37:24.179 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.179 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.179 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.180 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.180 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.180 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.180 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.180 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.180 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.180 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.180 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.180 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.180 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T12:37:24.180 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T12:37:24.181 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.181 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.181 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.181 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:24.181 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.181 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.181 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.181 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.181 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.181 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.181 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.182 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.182 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T12:37:24.182 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T12:37:24.182 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.182 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.182 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.182 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T12:37:24.182 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.182 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.182 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.182 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.182 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.183 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.183 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.183 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.183 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T12:37:24.183 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T12:37:24.183 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:24.183 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.183 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.183 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-12T12:37:24.183 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.183 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.183 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.184 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.184 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.184 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.184 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.184 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.184 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T12:37:24.184 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T12:37:24.184 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:24.184 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.184 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.184 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8", 2024-09-12T12:37:24.184 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.185 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.185 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.185 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.185 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.185 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.185 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.185 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.185 INFO:teuthology.orchestra.run.smithi033.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T12:37:24.185 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T12:37:24.185 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:24.185 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.185 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.185 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "45", 2024-09-12T12:37:24.186 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.186 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.186 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.186 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.186 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.186 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.186 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.186 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.186 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T12:37:24.186 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T12:37:24.186 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.186 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.187 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.187 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.187 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.187 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.187 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.187 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.187 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.187 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.187 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.187 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.187 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T12:37:24.187 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T12:37:24.187 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.188 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.188 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.188 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "admin", 2024-09-12T12:37:24.188 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.188 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.188 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.188 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.188 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.188 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.188 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.188 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.189 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T12:37:24.189 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T12:37:24.189 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.189 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.189 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.189 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.189 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.189 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.189 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.189 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.189 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.189 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.190 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.190 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.190 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T12:37:24.190 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T12:37:24.190 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.190 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.190 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.190 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:24.190 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.190 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.191 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.191 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.191 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.191 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.191 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.191 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.191 INFO:teuthology.orchestra.run.smithi033.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T12:37:24.191 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T12:37:24.191 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:24.191 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.191 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.191 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-12T12:37:24.191 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.192 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.192 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.192 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.192 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.192 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.192 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.192 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.192 INFO:teuthology.orchestra.run.smithi033.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T12:37:24.192 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T12:37:24.192 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:24.192 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.193 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.193 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-12T12:37:24.193 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.193 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.193 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.193 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.193 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.193 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.193 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.193 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.193 INFO:teuthology.orchestra.run.smithi033.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T12:37:24.193 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T12:37:24.194 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:24.194 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.194 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.194 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-09-12T12:37:24.194 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.194 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.194 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.194 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.194 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.194 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.194 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.194 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.195 INFO:teuthology.orchestra.run.smithi033.stdout: "cross_origin_url": { 2024-09-12T12:37:24.195 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cross_origin_url", 2024-09-12T12:37:24.195 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.195 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.195 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.195 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.195 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.195 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.195 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.195 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.195 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.195 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.196 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.196 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.196 INFO:teuthology.orchestra.run.smithi033.stdout: "crt_file": { 2024-09-12T12:37:24.196 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crt_file", 2024-09-12T12:37:24.196 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.196 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.196 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.196 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.196 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.196 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.196 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.196 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.197 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.197 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.197 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.197 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.197 INFO:teuthology.orchestra.run.smithi033.stdout: "debug": { 2024-09-12T12:37:24.197 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "debug", 2024-09-12T12:37:24.197 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.197 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.197 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.197 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.197 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.198 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.198 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.198 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Enable/disable debug options", 2024-09-12T12:37:24.198 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.198 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.198 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.198 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.198 INFO:teuthology.orchestra.run.smithi033.stdout: "jwt_token_ttl": { 2024-09-12T12:37:24.198 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "jwt_token_ttl", 2024-09-12T12:37:24.198 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:24.198 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.199 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.199 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "28800", 2024-09-12T12:37:24.199 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.199 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.199 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.199 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.199 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.199 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.199 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.199 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.199 INFO:teuthology.orchestra.run.smithi033.stdout: "key_file": { 2024-09-12T12:37:24.200 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "key_file", 2024-09-12T12:37:24.200 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.200 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.200 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.200 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.200 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.200 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.200 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.200 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.200 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.201 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.201 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.201 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.201 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:24.201 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:24.201 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.201 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.201 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.201 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.201 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.201 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.201 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.202 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.202 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.202 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.202 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.202 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.202 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.202 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.202 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.202 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.202 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.202 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.202 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.202 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:24.203 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:24.203 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.203 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.203 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.203 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.203 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.203 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.203 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.203 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.203 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.203 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.203 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.204 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.204 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:24.204 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:24.204 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.204 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.204 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.204 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:24.204 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.204 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.204 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.204 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.204 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.205 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.205 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.205 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.205 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.205 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.205 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.205 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.205 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.205 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.205 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.205 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:24.205 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:24.206 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.206 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.206 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.206 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.206 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.206 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.206 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.206 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.206 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.206 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.206 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.206 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.207 INFO:teuthology.orchestra.run.smithi033.stdout: "motd": { 2024-09-12T12:37:24.207 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "motd", 2024-09-12T12:37:24.207 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.207 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.207 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.207 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.207 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.207 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.207 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.207 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "The message of the day", 2024-09-12T12:37:24.207 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.207 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.207 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.208 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.208 INFO:teuthology.orchestra.run.smithi033.stdout: "redirect_resolve_ip_addr": { 2024-09-12T12:37:24.208 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T12:37:24.208 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.208 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.208 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.208 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.208 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.208 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.208 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.208 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.209 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.209 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.209 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.209 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.209 INFO:teuthology.orchestra.run.smithi033.stdout: "server_addr": { 2024-09-12T12:37:24.209 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_addr", 2024-09-12T12:37:24.209 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.209 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.209 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.209 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "::", 2024-09-12T12:37:24.209 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.209 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.210 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.210 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.210 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.210 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.210 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.210 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.210 INFO:teuthology.orchestra.run.smithi033.stdout: "server_port": { 2024-09-12T12:37:24.210 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_port", 2024-09-12T12:37:24.210 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:24.210 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.210 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.211 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8080", 2024-09-12T12:37:24.211 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.211 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.211 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.211 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.211 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.211 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.211 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.211 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.211 INFO:teuthology.orchestra.run.smithi033.stdout: "ssl": { 2024-09-12T12:37:24.211 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssl", 2024-09-12T12:37:24.211 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.212 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.212 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.212 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:24.212 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.212 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.212 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.212 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.212 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.212 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.212 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.212 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.212 INFO:teuthology.orchestra.run.smithi033.stdout: "ssl_server_port": { 2024-09-12T12:37:24.213 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssl_server_port", 2024-09-12T12:37:24.213 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:24.213 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.213 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.213 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8443", 2024-09-12T12:37:24.213 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.213 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.213 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.213 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.213 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.213 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.213 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.214 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.214 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_behaviour": { 2024-09-12T12:37:24.214 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_behaviour", 2024-09-12T12:37:24.214 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.214 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.214 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.214 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "redirect", 2024-09-12T12:37:24.214 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.214 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.214 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.214 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.214 INFO:teuthology.orchestra.run.smithi033.stdout: "redirect" 2024-09-12T12:37:24.215 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.215 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.215 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.215 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.215 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.215 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.215 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_error_status_code": { 2024-09-12T12:37:24.215 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_error_status_code", 2024-09-12T12:37:24.215 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:24.215 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.215 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.215 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "500", 2024-09-12T12:37:24.216 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "400", 2024-09-12T12:37:24.216 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "599", 2024-09-12T12:37:24.216 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.216 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.216 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.216 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.216 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.216 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.216 INFO:teuthology.orchestra.run.smithi033.stdout: "url_prefix": { 2024-09-12T12:37:24.216 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "url_prefix", 2024-09-12T12:37:24.217 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.217 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.217 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.217 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.217 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.217 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.217 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.217 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.217 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.217 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.217 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.217 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.218 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.218 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.218 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:24.218 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "devicehealth", 2024-09-12T12:37:24.218 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:24.218 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:24.218 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:24.218 INFO:teuthology.orchestra.run.smithi033.stdout: "enable_monitoring": { 2024-09-12T12:37:24.218 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enable_monitoring", 2024-09-12T12:37:24.218 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.218 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.219 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.219 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:24.219 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.219 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.219 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.219 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "monitor device health metrics", 2024-09-12T12:37:24.219 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.219 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.219 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.219 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.219 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:24.219 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:24.220 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.220 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.220 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.220 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.220 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.220 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.220 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.220 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.220 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.220 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.221 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.221 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.221 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.221 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.221 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.221 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.221 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.221 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.221 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.221 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:24.221 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:24.222 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.222 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.222 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.222 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.222 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.222 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.222 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.222 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.222 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.222 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.222 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.223 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.223 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:24.223 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:24.223 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.223 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.223 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.223 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:24.223 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.223 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.223 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.223 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.223 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.224 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.224 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.224 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.224 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.224 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.224 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.224 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.224 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.224 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.224 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.224 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:24.225 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:24.225 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.225 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.225 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.225 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.225 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.225 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.225 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.225 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.225 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.225 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.226 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.226 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.226 INFO:teuthology.orchestra.run.smithi033.stdout: "mark_out_threshold": { 2024-09-12T12:37:24.226 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mark_out_threshold", 2024-09-12T12:37:24.226 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:24.226 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.226 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.226 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "2419200", 2024-09-12T12:37:24.226 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.226 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.226 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.227 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T12:37:24.227 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.227 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.227 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.227 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.227 INFO:teuthology.orchestra.run.smithi033.stdout: "pool_name": { 2024-09-12T12:37:24.227 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pool_name", 2024-09-12T12:37:24.227 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.227 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.227 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.227 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "device_health_metrics", 2024-09-12T12:37:24.227 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.228 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.228 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.228 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T12:37:24.228 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.228 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.228 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.228 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.228 INFO:teuthology.orchestra.run.smithi033.stdout: "retention_period": { 2024-09-12T12:37:24.228 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "retention_period", 2024-09-12T12:37:24.228 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:24.228 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.229 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.229 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "15552000", 2024-09-12T12:37:24.229 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.229 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.229 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.229 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how long to retain device health metrics", 2024-09-12T12:37:24.229 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.229 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.229 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.229 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.229 INFO:teuthology.orchestra.run.smithi033.stdout: "scrape_frequency": { 2024-09-12T12:37:24.230 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "scrape_frequency", 2024-09-12T12:37:24.230 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:24.230 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.230 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.230 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "86400", 2024-09-12T12:37:24.230 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.230 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.230 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.230 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T12:37:24.230 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.230 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.230 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.231 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.231 INFO:teuthology.orchestra.run.smithi033.stdout: "self_heal": { 2024-09-12T12:37:24.231 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "self_heal", 2024-09-12T12:37:24.231 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.231 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.231 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.231 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:24.231 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.231 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.231 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.231 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T12:37:24.232 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.232 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.232 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.232 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.232 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-09-12T12:37:24.232 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-09-12T12:37:24.232 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:24.232 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.232 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.232 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-09-12T12:37:24.232 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.232 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.233 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.233 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T12:37:24.233 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.233 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.233 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.233 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.233 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_threshold": { 2024-09-12T12:37:24.233 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_threshold", 2024-09-12T12:37:24.233 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:24.233 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.233 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.233 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "7257600", 2024-09-12T12:37:24.234 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.234 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.234 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.234 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T12:37:24.234 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.234 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.234 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.234 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.234 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.234 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.234 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:24.234 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "diskprediction_local", 2024-09-12T12:37:24.235 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:24.235 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:24.235 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:24.235 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:24.235 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:24.235 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.235 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.235 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.235 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.235 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.235 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.235 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.236 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.236 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.236 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.236 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.236 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.236 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.236 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.236 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.236 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.236 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.236 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.236 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.237 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:24.237 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:24.237 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.237 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.237 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.237 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.237 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.237 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.237 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.237 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.237 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.238 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.238 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.238 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.238 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:24.238 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:24.238 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.238 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.238 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.238 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:24.238 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.238 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.239 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.239 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.239 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.239 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.239 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.239 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.239 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.239 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.239 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.239 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.239 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.240 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.240 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.240 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:24.240 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:24.240 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.240 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.240 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.240 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.240 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.240 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.240 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.241 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.241 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.241 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.241 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.241 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.241 INFO:teuthology.orchestra.run.smithi033.stdout: "predict_interval": { 2024-09-12T12:37:24.241 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "predict_interval", 2024-09-12T12:37:24.241 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.241 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.241 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.242 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "86400", 2024-09-12T12:37:24.242 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.242 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.242 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.242 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.242 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.242 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.242 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.242 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.242 INFO:teuthology.orchestra.run.smithi033.stdout: "predictor_model": { 2024-09-12T12:37:24.242 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "predictor_model", 2024-09-12T12:37:24.243 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.243 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.243 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.243 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "prophetstor", 2024-09-12T12:37:24.243 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.243 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.243 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.243 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.243 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.243 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.243 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.243 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.244 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-09-12T12:37:24.244 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-09-12T12:37:24.244 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.244 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.244 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.244 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-09-12T12:37:24.244 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.244 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.244 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.244 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.244 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.244 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.245 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.245 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.245 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.245 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.245 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:24.245 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "influx", 2024-09-12T12:37:24.245 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": false, 2024-09-12T12:37:24.245 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "influxdb python module not found", 2024-09-12T12:37:24.245 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:24.245 INFO:teuthology.orchestra.run.smithi033.stdout: "batch_size": { 2024-09-12T12:37:24.245 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "batch_size", 2024-09-12T12:37:24.245 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:24.245 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.246 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.246 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5000", 2024-09-12T12:37:24.246 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.246 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.246 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.246 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T12:37:24.246 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.246 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.246 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.246 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.246 INFO:teuthology.orchestra.run.smithi033.stdout: "database": { 2024-09-12T12:37:24.247 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "database", 2024-09-12T12:37:24.247 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.247 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.247 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.247 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "ceph", 2024-09-12T12:37:24.247 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.247 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.247 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.247 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T12:37:24.247 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.247 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.248 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.248 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.248 INFO:teuthology.orchestra.run.smithi033.stdout: "hostname": { 2024-09-12T12:37:24.248 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "hostname", 2024-09-12T12:37:24.248 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.248 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.248 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.248 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.248 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.248 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.248 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.248 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "InfluxDB server hostname", 2024-09-12T12:37:24.248 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.249 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.249 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.249 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.249 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-09-12T12:37:24.249 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-09-12T12:37:24.249 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:24.249 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.249 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.249 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "30", 2024-09-12T12:37:24.249 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "5", 2024-09-12T12:37:24.249 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.250 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.250 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T12:37:24.250 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.250 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.250 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.250 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.250 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:24.250 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:24.250 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.250 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.250 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.251 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.251 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.251 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.251 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.251 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.251 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.251 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.251 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.251 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.251 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.251 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.251 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.252 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.252 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.252 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.252 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.252 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:24.252 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:24.252 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.252 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.252 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.252 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.252 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.253 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.253 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.253 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.253 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.253 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.253 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.253 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.253 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:24.253 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:24.253 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.253 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.253 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.254 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:24.254 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.254 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.254 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.254 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.254 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.254 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.254 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.254 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.254 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.254 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.254 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.255 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.255 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.255 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.255 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.255 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:24.255 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:24.255 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.255 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.255 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.255 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.255 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.255 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.255 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.256 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.256 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.256 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.256 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.256 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.256 INFO:teuthology.orchestra.run.smithi033.stdout: "password": { 2024-09-12T12:37:24.256 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "password", 2024-09-12T12:37:24.256 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.256 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.256 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.256 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.256 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.257 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.257 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.257 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "password of InfluxDB server user", 2024-09-12T12:37:24.257 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.257 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.257 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.257 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.257 INFO:teuthology.orchestra.run.smithi033.stdout: "port": { 2024-09-12T12:37:24.257 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "port", 2024-09-12T12:37:24.257 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:24.257 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.258 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.258 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8086", 2024-09-12T12:37:24.258 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.258 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.258 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.258 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "InfluxDB server port", 2024-09-12T12:37:24.258 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.258 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.258 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.258 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.258 INFO:teuthology.orchestra.run.smithi033.stdout: "ssl": { 2024-09-12T12:37:24.258 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssl", 2024-09-12T12:37:24.258 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.259 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.259 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.259 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "false", 2024-09-12T12:37:24.259 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.259 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.259 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.259 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T12:37:24.259 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.259 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.259 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.259 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.259 INFO:teuthology.orchestra.run.smithi033.stdout: "threads": { 2024-09-12T12:37:24.260 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "threads", 2024-09-12T12:37:24.260 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:24.260 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.260 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.260 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-09-12T12:37:24.260 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-09-12T12:37:24.260 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "32", 2024-09-12T12:37:24.260 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.260 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T12:37:24.260 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.260 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.260 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.261 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.261 INFO:teuthology.orchestra.run.smithi033.stdout: "username": { 2024-09-12T12:37:24.261 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "username", 2024-09-12T12:37:24.261 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.261 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.261 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.261 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.261 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.261 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.261 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.261 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "username of InfluxDB server user", 2024-09-12T12:37:24.261 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.262 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.262 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.262 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.262 INFO:teuthology.orchestra.run.smithi033.stdout: "verify_ssl": { 2024-09-12T12:37:24.262 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "verify_ssl", 2024-09-12T12:37:24.262 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.262 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.262 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.262 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "true", 2024-09-12T12:37:24.262 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.262 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.262 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.262 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T12:37:24.263 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.263 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.263 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.263 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.263 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.263 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.263 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:24.263 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "insights", 2024-09-12T12:37:24.263 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:24.263 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:24.263 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:24.263 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:24.263 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:24.264 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.264 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.264 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.264 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.264 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.264 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.264 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.264 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.264 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.264 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.264 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.264 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.265 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.265 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.265 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.265 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.265 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.265 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.265 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.265 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:24.265 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:24.265 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.265 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.265 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.266 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.266 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.266 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.266 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.266 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.266 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.266 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.266 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.266 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.266 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:24.266 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:24.266 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.267 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.267 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.267 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:24.267 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.267 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.267 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.267 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.267 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.267 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.267 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.268 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.268 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.268 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.268 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.268 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.268 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.268 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.268 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.268 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:24.268 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:24.268 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.269 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.269 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.269 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.269 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.269 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.269 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.269 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.269 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.269 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.269 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.269 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.270 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.270 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.270 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:24.270 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "iostat", 2024-09-12T12:37:24.270 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:24.270 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:24.270 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:24.270 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:24.270 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:24.270 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.271 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.271 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.271 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.271 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.271 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.271 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.271 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.271 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.271 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.271 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.271 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.271 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.272 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.272 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.272 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.272 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.272 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.272 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.272 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:24.272 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:24.272 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.272 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.272 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.273 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.273 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.273 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.273 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.277 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.277 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.277 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.277 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.277 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.277 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:24.278 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:24.278 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.278 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.278 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.278 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:24.278 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.278 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.278 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.278 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.278 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.278 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.279 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.279 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.279 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.279 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.279 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.279 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.279 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.279 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.279 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.279 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:24.280 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:24.280 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.280 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.280 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.280 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.280 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.280 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.280 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.280 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.281 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.281 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.281 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.281 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.281 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.281 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.281 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:24.281 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "k8sevents", 2024-09-12T12:37:24.281 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:24.281 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:24.282 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:24.282 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_event_retention_days": { 2024-09-12T12:37:24.282 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ceph_event_retention_days", 2024-09-12T12:37:24.282 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:24.282 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.282 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.282 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "7", 2024-09-12T12:37:24.282 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.282 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.282 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.282 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T12:37:24.283 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.283 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.283 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.283 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.283 INFO:teuthology.orchestra.run.smithi033.stdout: "config_check_secs": { 2024-09-12T12:37:24.283 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "config_check_secs", 2024-09-12T12:37:24.283 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:24.283 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.283 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.283 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-12T12:37:24.283 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "10", 2024-09-12T12:37:24.284 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.284 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.284 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T12:37:24.284 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.284 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.284 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.284 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.284 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:24.284 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:24.284 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.284 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.285 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.285 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.285 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.285 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.285 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.285 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.285 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.285 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.285 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.285 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.285 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.285 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.286 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.286 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.286 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.286 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.286 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.286 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:24.286 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:24.286 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.286 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.286 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.286 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.287 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.287 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.287 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.287 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.287 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.287 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.287 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.287 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.287 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:24.287 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:24.287 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.287 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.288 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.288 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:24.288 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.288 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.288 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.288 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.288 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.288 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.288 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.288 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.288 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.289 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.289 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.289 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.289 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.289 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.289 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.289 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:24.289 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:24.289 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.289 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.289 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.289 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.290 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.290 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.290 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.290 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.290 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.290 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.290 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.290 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.290 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.290 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.290 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:24.290 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "localpool", 2024-09-12T12:37:24.291 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:24.291 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:24.291 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:24.291 INFO:teuthology.orchestra.run.smithi033.stdout: "failure_domain": { 2024-09-12T12:37:24.291 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "failure_domain", 2024-09-12T12:37:24.291 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.291 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.291 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.291 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "host", 2024-09-12T12:37:24.291 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.291 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.292 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.292 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "failure domain for any created local pool", 2024-09-12T12:37:24.292 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T12:37:24.292 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.292 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.292 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.292 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:24.292 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:24.292 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.292 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.292 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.292 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.293 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.293 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.293 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.293 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.293 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.293 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.293 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.293 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.293 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.293 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.293 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.293 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.294 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.294 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.294 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.294 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:24.294 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:24.294 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.294 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.294 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.294 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.294 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.294 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.295 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.295 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.295 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.295 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.295 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.295 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.295 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:24.295 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:24.295 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.295 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.295 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.295 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:24.296 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.296 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.296 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.296 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.296 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.296 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.296 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.296 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.296 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.296 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.296 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.297 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.297 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.297 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.297 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.297 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:24.297 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:24.297 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.297 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.297 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.297 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.297 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.297 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.298 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.298 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.298 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.298 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.298 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.298 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.298 INFO:teuthology.orchestra.run.smithi033.stdout: "min_size": { 2024-09-12T12:37:24.298 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "min_size", 2024-09-12T12:37:24.298 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:24.298 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.298 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.298 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.299 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.299 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.299 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.299 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "default min_size for any created local pool", 2024-09-12T12:37:24.299 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T12:37:24.299 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.299 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.299 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.299 INFO:teuthology.orchestra.run.smithi033.stdout: "num_rep": { 2024-09-12T12:37:24.299 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "num_rep", 2024-09-12T12:37:24.299 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:24.299 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.300 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.300 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "3", 2024-09-12T12:37:24.300 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.300 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.300 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.300 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "default replica count for any created local pool", 2024-09-12T12:37:24.300 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.300 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.300 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.300 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.300 INFO:teuthology.orchestra.run.smithi033.stdout: "pg_num": { 2024-09-12T12:37:24.300 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pg_num", 2024-09-12T12:37:24.301 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:24.301 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.301 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.301 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "128", 2024-09-12T12:37:24.301 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.301 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.301 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.301 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T12:37:24.301 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.301 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.301 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.302 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.302 INFO:teuthology.orchestra.run.smithi033.stdout: "prefix": { 2024-09-12T12:37:24.302 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "prefix", 2024-09-12T12:37:24.302 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.302 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.302 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.302 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.302 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.302 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.302 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.302 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "name prefix for any created local pool", 2024-09-12T12:37:24.302 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.303 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.303 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.303 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.303 INFO:teuthology.orchestra.run.smithi033.stdout: "subtree": { 2024-09-12T12:37:24.303 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "subtree", 2024-09-12T12:37:24.303 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.303 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.303 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.303 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "rack", 2024-09-12T12:37:24.303 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.303 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.303 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.304 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T12:37:24.304 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T12:37:24.304 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.304 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.304 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.304 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.304 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.304 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:24.304 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mds_autoscaler", 2024-09-12T12:37:24.304 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:24.304 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:24.304 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:24.305 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:24.305 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:24.305 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.305 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.305 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.305 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.305 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.305 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.305 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.305 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.305 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.306 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.306 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.306 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.306 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.306 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.306 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.306 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.306 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.306 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.306 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.306 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:24.306 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:24.307 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.307 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.307 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.307 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.307 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.307 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.307 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.307 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.307 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.307 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.307 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.308 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.308 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:24.308 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:24.308 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.308 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.308 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.308 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:24.308 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.308 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.308 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.308 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.309 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.309 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.309 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.309 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.309 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.309 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.309 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.309 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.309 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.309 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.309 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.309 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:24.310 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:24.310 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.310 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.310 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.310 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.310 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.310 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.310 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.310 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.310 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.310 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.310 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.311 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.311 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.311 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.311 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:24.311 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mirroring", 2024-09-12T12:37:24.311 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:24.311 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:24.311 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:24.311 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:24.311 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:24.311 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.312 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.312 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.312 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.312 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.312 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.312 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.312 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.312 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.312 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.312 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.312 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.313 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.313 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.313 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.313 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.313 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.313 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.313 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.313 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:24.313 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:24.313 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.314 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.314 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.314 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.314 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.314 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.314 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.314 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.314 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.314 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.314 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.314 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.315 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:24.315 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:24.315 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.315 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.315 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.315 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:24.315 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.315 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.315 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.315 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.315 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.315 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.316 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.316 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.316 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.316 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.316 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.316 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.316 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.316 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.316 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.316 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:24.316 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:24.317 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.317 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.317 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.317 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.317 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.317 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.317 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.317 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.317 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.317 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.317 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.317 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.318 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.318 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.318 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:24.318 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "nfs", 2024-09-12T12:37:24.318 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:24.318 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:24.318 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:24.318 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:24.318 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:24.318 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.318 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.318 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.319 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.319 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.319 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.319 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.319 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.319 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.319 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.319 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.319 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.319 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.319 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.319 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.319 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.320 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.320 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.320 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.320 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:24.320 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:24.320 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.320 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.320 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.320 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.320 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.320 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.320 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.321 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.321 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.321 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.321 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.321 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.321 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:24.321 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:24.321 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.321 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.321 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.321 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:24.321 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.321 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.322 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.322 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.322 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.322 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.322 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.322 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.322 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.322 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.322 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.322 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.322 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.322 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.322 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.323 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:24.323 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:24.323 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.323 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.323 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.323 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.323 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.323 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.323 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.323 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.323 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.323 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.323 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.324 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.324 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.324 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.324 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:24.324 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "orchestrator", 2024-09-12T12:37:24.324 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:24.324 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:24.324 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:24.324 INFO:teuthology.orchestra.run.smithi033.stdout: "fail_fs": { 2024-09-12T12:37:24.324 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "fail_fs", 2024-09-12T12:37:24.324 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.325 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.325 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.325 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.325 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.325 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.325 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.325 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T12:37:24.325 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.325 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.325 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.325 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.325 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:24.325 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:24.326 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.326 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.326 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.326 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.326 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.326 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.326 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.326 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.326 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.326 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.326 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.326 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.327 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.327 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.327 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.327 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.327 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.327 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.327 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.327 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:24.327 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:24.327 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.327 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.328 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.328 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.328 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.328 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.328 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.328 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.328 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.328 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.328 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.328 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.328 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:24.328 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:24.329 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.329 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.329 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.329 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:24.329 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.329 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.329 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.329 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.329 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.329 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.329 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.330 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.330 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.330 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.330 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.330 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.330 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.330 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.330 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.330 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:24.330 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:24.331 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.331 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.331 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.331 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.331 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.331 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.331 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.331 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.331 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.331 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.331 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.331 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.332 INFO:teuthology.orchestra.run.smithi033.stdout: "orchestrator": { 2024-09-12T12:37:24.332 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "orchestrator", 2024-09-12T12:37:24.332 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.332 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.332 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.332 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.332 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.332 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.332 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.332 INFO:teuthology.orchestra.run.smithi033.stdout: "cephadm", 2024-09-12T12:37:24.332 INFO:teuthology.orchestra.run.smithi033.stdout: "rook", 2024-09-12T12:37:24.333 INFO:teuthology.orchestra.run.smithi033.stdout: "test_orchestrator" 2024-09-12T12:37:24.333 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.333 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Orchestrator backend", 2024-09-12T12:37:24.333 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.333 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.333 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.333 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.333 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.333 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.333 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:24.333 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "osd_perf_query", 2024-09-12T12:37:24.333 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:24.334 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:24.334 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:24.334 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:24.334 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:24.334 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.334 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.334 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.334 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.334 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.334 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.334 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.334 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.334 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.335 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.335 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.335 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.335 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.335 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.335 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.335 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.335 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.335 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.335 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.335 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:24.335 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:24.336 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.336 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.336 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.336 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.336 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.336 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.336 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.336 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.336 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.336 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.336 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.336 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.337 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:24.337 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:24.337 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.337 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.337 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.337 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:24.337 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.337 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.337 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.337 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.337 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.338 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.338 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.338 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.338 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.338 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.338 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.338 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.338 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.338 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.338 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.338 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:24.338 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:24.339 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.339 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.339 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.339 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.339 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.339 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.339 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.339 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.339 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.339 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.339 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.340 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.340 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.340 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.340 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:24.340 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "osd_support", 2024-09-12T12:37:24.340 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:24.340 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:24.340 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:24.340 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:24.340 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:24.340 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.340 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.341 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.341 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.341 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.341 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.341 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.341 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.341 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.341 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.341 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.341 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.341 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.341 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.342 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.342 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.342 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.342 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.342 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.342 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:24.342 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:24.342 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.342 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.342 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.342 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.343 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.343 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.343 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.343 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.343 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.343 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.343 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.343 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.343 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:24.343 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:24.343 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.343 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.343 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.344 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:24.344 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.344 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.344 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.344 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.344 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.344 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.344 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.344 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.344 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.344 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.344 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.345 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.345 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.345 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.345 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.345 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:24.345 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:24.345 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.345 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.345 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.345 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.346 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.346 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.346 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.346 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.346 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.346 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.346 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.346 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.346 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.346 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.346 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:24.347 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pg_autoscaler", 2024-09-12T12:37:24.347 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:24.347 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:24.347 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:24.347 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:24.347 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:24.347 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.347 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.347 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.347 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.347 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.347 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.348 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.348 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.348 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.348 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.348 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.348 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.348 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.348 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.349 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.349 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.349 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.349 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.349 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.349 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:24.349 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:24.349 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.349 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.349 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.349 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.349 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.350 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.350 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.350 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.350 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.350 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.350 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.350 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.350 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:24.350 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:24.350 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.351 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.351 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.351 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:24.351 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.351 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.351 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.351 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.351 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.351 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.351 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.351 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.352 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.352 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.352 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.352 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.352 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.352 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.352 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.352 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:24.352 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:24.352 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.352 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.352 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.353 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.353 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.353 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.353 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.353 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.353 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.353 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.353 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.353 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.353 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-09-12T12:37:24.353 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-09-12T12:37:24.353 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:24.354 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.354 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.354 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-09-12T12:37:24.354 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.354 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.354 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.354 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.354 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.354 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.354 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.354 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.355 INFO:teuthology.orchestra.run.smithi033.stdout: "threshold": { 2024-09-12T12:37:24.355 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "threshold", 2024-09-12T12:37:24.355 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-09-12T12:37:24.355 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.355 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.355 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "3.0", 2024-09-12T12:37:24.355 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1.0", 2024-09-12T12:37:24.355 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.355 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.355 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "scaling threshold", 2024-09-12T12:37:24.355 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T12:37:24.355 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.356 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.356 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.356 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.356 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.356 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:24.356 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "progress", 2024-09-12T12:37:24.356 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:24.356 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:24.356 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:24.356 INFO:teuthology.orchestra.run.smithi033.stdout: "allow_pg_recovery_event": { 2024-09-12T12:37:24.356 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "allow_pg_recovery_event", 2024-09-12T12:37:24.357 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.357 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.357 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.357 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.357 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.357 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.357 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.357 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T12:37:24.357 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.357 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.357 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.358 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.358 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": { 2024-09-12T12:37:24.358 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enabled", 2024-09-12T12:37:24.358 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.358 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.358 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.358 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:24.358 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.358 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.358 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.359 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.359 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.359 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.359 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.359 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.359 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:24.359 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:24.359 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.359 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.359 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.359 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.359 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.360 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.360 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.360 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.360 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.360 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.360 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.360 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.360 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.360 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.360 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.361 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.361 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.361 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.361 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.361 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:24.361 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:24.361 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.361 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.361 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.361 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.361 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.362 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.362 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.362 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.362 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.362 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.362 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.362 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.362 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:24.362 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:24.362 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.362 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.363 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.363 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:24.363 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.363 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.363 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.363 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.363 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.363 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.363 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.363 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.363 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.364 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.364 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.364 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.364 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.364 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.364 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.364 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:24.364 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:24.364 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.365 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.365 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.365 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.365 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.365 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.365 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.365 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.365 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.365 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.365 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.365 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.366 INFO:teuthology.orchestra.run.smithi033.stdout: "max_completed_events": { 2024-09-12T12:37:24.366 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_completed_events", 2024-09-12T12:37:24.366 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:24.366 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.366 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.366 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "50", 2024-09-12T12:37:24.366 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.366 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.366 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.366 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "number of past completed events to remember", 2024-09-12T12:37:24.366 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.367 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.367 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.367 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.367 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-09-12T12:37:24.367 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-09-12T12:37:24.367 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:24.367 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.367 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.367 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-09-12T12:37:24.367 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.367 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.368 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.368 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how long the module is going to sleep", 2024-09-12T12:37:24.368 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.368 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.368 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.368 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.368 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.368 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.368 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:24.369 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "prometheus", 2024-09-12T12:37:24.369 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:24.369 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:24.369 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:24.369 INFO:teuthology.orchestra.run.smithi033.stdout: "cache": { 2024-09-12T12:37:24.369 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cache", 2024-09-12T12:37:24.369 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.369 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.369 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.369 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:24.369 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.370 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.370 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.370 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.370 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.370 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.370 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.370 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.370 INFO:teuthology.orchestra.run.smithi033.stdout: "exclude_perf_counters": { 2024-09-12T12:37:24.370 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "exclude_perf_counters", 2024-09-12T12:37:24.370 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.370 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.370 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.371 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:24.371 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.371 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.371 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.371 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T12:37:24.371 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T12:37:24.371 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.371 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.371 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.371 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:24.371 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:24.372 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.372 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.372 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.372 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.372 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.372 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.372 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.372 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.372 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.372 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.373 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.373 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.373 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.373 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.373 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.373 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.373 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.373 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.373 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.373 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:24.373 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:24.374 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.374 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.374 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.374 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.374 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.374 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.374 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.374 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.374 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.374 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.374 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.375 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.375 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:24.375 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:24.375 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.375 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.375 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.375 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:24.375 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.375 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.375 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.375 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.375 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.376 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.376 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.376 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.376 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.376 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.376 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.376 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.376 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.376 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.376 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.376 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:24.377 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:24.377 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.377 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.377 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.377 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.377 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.377 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.377 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.377 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.377 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.377 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.377 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.378 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.378 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_stats_pools": { 2024-09-12T12:37:24.378 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_stats_pools", 2024-09-12T12:37:24.378 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.378 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.378 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.378 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.378 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.378 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.378 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.378 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.378 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.379 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.379 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.379 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.379 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T12:37:24.379 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T12:37:24.379 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:24.379 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.379 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.379 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "300", 2024-09-12T12:37:24.379 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.379 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.380 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.380 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.380 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.380 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.380 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.380 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.380 INFO:teuthology.orchestra.run.smithi033.stdout: "scrape_interval": { 2024-09-12T12:37:24.380 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "scrape_interval", 2024-09-12T12:37:24.380 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-09-12T12:37:24.380 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.380 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.380 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "15.0", 2024-09-12T12:37:24.381 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.381 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.381 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.381 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.381 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.381 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.381 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.381 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.381 INFO:teuthology.orchestra.run.smithi033.stdout: "server_addr": { 2024-09-12T12:37:24.381 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_addr", 2024-09-12T12:37:24.381 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.381 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.382 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.382 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "::", 2024-09-12T12:37:24.382 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.382 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.382 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.382 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T12:37:24.382 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.382 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.382 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.382 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.382 INFO:teuthology.orchestra.run.smithi033.stdout: "server_port": { 2024-09-12T12:37:24.382 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_port", 2024-09-12T12:37:24.383 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:24.383 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.383 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.383 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "9283", 2024-09-12T12:37:24.383 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.383 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.383 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.383 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T12:37:24.383 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.383 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.383 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.383 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.384 INFO:teuthology.orchestra.run.smithi033.stdout: "stale_cache_strategy": { 2024-09-12T12:37:24.384 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "stale_cache_strategy", 2024-09-12T12:37:24.384 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.384 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.384 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.384 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "log", 2024-09-12T12:37:24.384 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.384 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.385 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.385 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.385 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.385 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.385 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.385 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.385 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_behaviour": { 2024-09-12T12:37:24.385 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_behaviour", 2024-09-12T12:37:24.385 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.385 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.385 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.385 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "default", 2024-09-12T12:37:24.386 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.386 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.386 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.386 INFO:teuthology.orchestra.run.smithi033.stdout: "default", 2024-09-12T12:37:24.386 INFO:teuthology.orchestra.run.smithi033.stdout: "error" 2024-09-12T12:37:24.386 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.386 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.386 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.386 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.386 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.386 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.386 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_error_status_code": { 2024-09-12T12:37:24.387 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_error_status_code", 2024-09-12T12:37:24.387 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:24.387 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.387 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.387 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "500", 2024-09-12T12:37:24.387 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "400", 2024-09-12T12:37:24.387 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "599", 2024-09-12T12:37:24.387 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.387 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.388 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.388 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.388 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.388 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.388 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.388 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.388 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:24.388 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_support", 2024-09-12T12:37:24.388 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:24.388 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:24.388 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:24.388 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:24.389 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:24.389 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.389 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.389 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.389 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.389 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.389 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.389 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.389 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.389 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.389 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.390 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.390 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.390 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.390 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.390 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.390 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.390 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.390 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.390 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.390 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:24.390 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:24.390 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.391 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.391 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.391 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.391 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.391 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.391 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.391 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.391 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.391 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.391 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.391 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.391 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:24.392 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:24.392 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.392 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.392 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.392 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:24.392 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.392 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.392 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.392 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.392 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.392 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.392 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.393 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.393 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.393 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.393 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.393 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.393 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.393 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.393 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.393 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:24.393 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:24.393 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.393 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.394 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.394 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.394 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.394 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.394 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.394 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.394 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.394 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.394 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.394 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.394 INFO:teuthology.orchestra.run.smithi033.stdout: "max_concurrent_snap_create": { 2024-09-12T12:37:24.395 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_concurrent_snap_create", 2024-09-12T12:37:24.395 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:24.395 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.395 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.395 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-12T12:37:24.395 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.395 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.395 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.395 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.395 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.395 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.395 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.396 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.396 INFO:teuthology.orchestra.run.smithi033.stdout: "mirror_snapshot_schedule": { 2024-09-12T12:37:24.396 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T12:37:24.396 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.396 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.396 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.396 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.396 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.396 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.396 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.396 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.396 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.397 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.397 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.397 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.397 INFO:teuthology.orchestra.run.smithi033.stdout: "trash_purge_schedule": { 2024-09-12T12:37:24.397 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "trash_purge_schedule", 2024-09-12T12:37:24.397 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.397 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.397 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.397 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.397 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.397 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.397 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.398 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.398 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.398 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.398 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.398 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.398 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.398 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.398 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:24.398 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "restful", 2024-09-12T12:37:24.398 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:24.398 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:24.398 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:24.399 INFO:teuthology.orchestra.run.smithi033.stdout: "enable_auth": { 2024-09-12T12:37:24.399 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enable_auth", 2024-09-12T12:37:24.399 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.399 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.399 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.399 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:24.399 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.399 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.399 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.399 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.399 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.399 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.400 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.400 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.400 INFO:teuthology.orchestra.run.smithi033.stdout: "key_file": { 2024-09-12T12:37:24.400 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "key_file", 2024-09-12T12:37:24.400 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.400 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.400 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.400 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.400 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.400 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.400 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.401 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.401 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.401 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.401 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.401 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.401 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:24.401 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:24.401 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.401 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.401 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.401 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.401 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.401 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.402 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.402 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.402 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.402 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.402 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.402 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.402 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.402 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.402 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.402 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.402 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.402 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.403 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.403 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:24.403 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:24.403 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.403 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.403 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.403 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.403 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.403 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.403 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.403 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.403 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.404 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.404 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.404 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.404 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:24.404 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:24.404 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.404 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.404 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.404 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:24.405 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.405 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.405 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.405 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.405 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.405 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.405 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.405 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.405 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.405 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.405 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.405 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.406 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.406 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.406 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.406 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:24.406 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:24.406 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.406 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.406 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.406 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.406 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.407 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.407 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.407 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.407 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.407 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.407 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.407 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.407 INFO:teuthology.orchestra.run.smithi033.stdout: "server_addr": { 2024-09-12T12:37:24.407 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_addr", 2024-09-12T12:37:24.407 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.407 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.407 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.408 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.408 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.408 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.408 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.408 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.408 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.408 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.408 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.408 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.408 INFO:teuthology.orchestra.run.smithi033.stdout: "server_port": { 2024-09-12T12:37:24.408 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_port", 2024-09-12T12:37:24.408 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.409 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.409 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.409 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.409 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.409 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.409 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.409 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.409 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.409 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.409 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.409 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.409 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.410 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.410 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:24.410 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rgw", 2024-09-12T12:37:24.410 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:24.410 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:24.410 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:24.410 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:24.410 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:24.410 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.410 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.410 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.411 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.411 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.411 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.411 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.411 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.411 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.411 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.411 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.411 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.411 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.411 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.411 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.412 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.412 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.412 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.412 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.412 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:24.412 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:24.412 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.412 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.412 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.412 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.412 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.412 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.413 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.413 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.413 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.413 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.413 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.413 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.413 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:24.413 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:24.413 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.413 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.413 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.414 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:24.414 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.414 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.414 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.414 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.414 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.414 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.414 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.414 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.414 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.414 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.414 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.415 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.415 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.415 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.415 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.415 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:24.415 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:24.415 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.415 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.415 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.415 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.415 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.415 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.416 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.416 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.416 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.416 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.416 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.416 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.416 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.416 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.416 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:24.416 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rook", 2024-09-12T12:37:24.416 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:24.416 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:24.417 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:24.417 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:24.417 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:24.417 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.417 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.417 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.417 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.417 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.417 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.417 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.418 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.418 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.418 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.418 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.418 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.418 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.418 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.418 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.418 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.418 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.418 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.419 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.419 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:24.419 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:24.419 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.419 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.419 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.419 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.419 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.419 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.419 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.419 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.419 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.420 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.420 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.420 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.420 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:24.420 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:24.420 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.420 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.420 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.420 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:24.421 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.421 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.421 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.421 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.421 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.421 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.421 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.421 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.421 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.421 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.421 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.421 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.422 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.422 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.422 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.422 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:24.422 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:24.422 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.422 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.422 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.422 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.422 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.423 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.423 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.423 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.423 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.423 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.423 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.423 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.423 INFO:teuthology.orchestra.run.smithi033.stdout: "storage_class": { 2024-09-12T12:37:24.423 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "storage_class", 2024-09-12T12:37:24.423 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.423 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.424 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.424 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "local", 2024-09-12T12:37:24.424 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.424 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.424 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.424 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T12:37:24.424 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.424 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.424 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.424 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.424 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.425 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.425 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:24.425 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "selftest", 2024-09-12T12:37:24.425 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:24.425 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:24.425 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:24.425 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:24.425 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:24.425 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.425 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.425 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.425 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.426 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.426 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.426 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.426 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.426 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.426 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.426 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.426 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.426 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.426 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.426 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.426 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.427 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.427 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.427 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.427 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:24.427 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:24.427 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.427 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.427 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.427 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.427 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.427 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.427 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.428 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.428 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.428 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.428 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.428 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.428 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:24.428 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:24.428 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.428 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.428 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.428 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:24.428 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.429 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.429 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.429 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.429 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.429 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.429 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.429 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.429 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.429 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.429 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.429 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.429 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.430 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.430 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.430 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:24.430 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:24.430 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.430 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.430 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.430 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.430 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.430 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.430 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.430 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.431 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.431 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.431 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.431 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.431 INFO:teuthology.orchestra.run.smithi033.stdout: "roption1": { 2024-09-12T12:37:24.431 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "roption1", 2024-09-12T12:37:24.431 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.431 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.431 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.431 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.431 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.432 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.432 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.432 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.432 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.432 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.432 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.432 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.432 INFO:teuthology.orchestra.run.smithi033.stdout: "roption2": { 2024-09-12T12:37:24.432 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "roption2", 2024-09-12T12:37:24.432 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.432 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.432 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.433 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "xyz", 2024-09-12T12:37:24.433 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.433 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.433 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.433 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.433 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.433 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.433 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.433 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.433 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption1": { 2024-09-12T12:37:24.433 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption1", 2024-09-12T12:37:24.433 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.434 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.434 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.434 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.434 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.434 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.434 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.434 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.434 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.434 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.434 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.434 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.434 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption2": { 2024-09-12T12:37:24.435 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption2", 2024-09-12T12:37:24.435 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:24.435 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.435 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.435 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.435 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.435 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.435 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.435 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.435 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.435 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.436 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.436 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.436 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption3": { 2024-09-12T12:37:24.436 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption3", 2024-09-12T12:37:24.436 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-09-12T12:37:24.436 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.436 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.436 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.436 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.436 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.436 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.437 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.437 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.437 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.437 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.437 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.437 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption4": { 2024-09-12T12:37:24.437 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption4", 2024-09-12T12:37:24.437 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.437 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.437 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.437 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.438 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.438 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.438 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.438 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.438 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.438 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.438 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.438 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.438 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption5": { 2024-09-12T12:37:24.438 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption5", 2024-09-12T12:37:24.438 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.439 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.439 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.439 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.439 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.439 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.439 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.439 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.439 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.439 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.439 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.439 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.440 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption6": { 2024-09-12T12:37:24.440 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption6", 2024-09-12T12:37:24.440 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.440 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.440 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.440 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:24.440 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.440 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.440 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.440 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.440 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.441 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.441 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.441 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.441 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption7": { 2024-09-12T12:37:24.441 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption7", 2024-09-12T12:37:24.441 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:24.441 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.441 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.441 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.441 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-09-12T12:37:24.442 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "42", 2024-09-12T12:37:24.442 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.442 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.442 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.442 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.442 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.442 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.442 INFO:teuthology.orchestra.run.smithi033.stdout: "testkey": { 2024-09-12T12:37:24.442 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "testkey", 2024-09-12T12:37:24.442 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.442 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.443 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.443 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.443 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.443 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.443 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.443 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.443 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.443 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.443 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.443 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.444 INFO:teuthology.orchestra.run.smithi033.stdout: "testlkey": { 2024-09-12T12:37:24.444 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "testlkey", 2024-09-12T12:37:24.444 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.444 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.444 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.444 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.444 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.444 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.444 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.444 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.445 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.445 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.445 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.445 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.445 INFO:teuthology.orchestra.run.smithi033.stdout: "testnewline": { 2024-09-12T12:37:24.445 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "testnewline", 2024-09-12T12:37:24.445 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.445 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.445 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.445 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.446 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.446 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.446 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.446 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.446 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.446 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.446 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.446 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.446 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.446 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.446 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:24.447 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snap_schedule", 2024-09-12T12:37:24.447 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:24.447 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:24.447 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:24.447 INFO:teuthology.orchestra.run.smithi033.stdout: "allow_m_granularity": { 2024-09-12T12:37:24.447 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "allow_m_granularity", 2024-09-12T12:37:24.447 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.447 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.447 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.447 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.447 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.448 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.448 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.448 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T12:37:24.448 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.448 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.448 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.448 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.448 INFO:teuthology.orchestra.run.smithi033.stdout: "dump_on_update": { 2024-09-12T12:37:24.448 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "dump_on_update", 2024-09-12T12:37:24.448 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.448 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.448 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.449 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.449 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.449 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.449 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.449 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "dump database to debug log on update", 2024-09-12T12:37:24.449 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.449 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.449 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.449 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.449 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:24.449 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:24.449 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.450 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.450 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.450 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.450 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.450 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.450 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.450 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.450 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.450 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.450 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.450 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.450 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.451 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.451 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.451 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.451 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.451 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.451 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.451 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:24.451 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:24.451 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.451 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.451 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.452 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.452 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.452 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.452 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.452 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.452 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.452 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.452 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.452 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.452 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:24.452 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:24.453 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.453 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.453 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.453 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:24.453 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.453 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.453 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.453 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.453 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.453 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.453 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.453 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.454 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.454 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.454 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.454 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.454 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.454 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.454 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.454 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:24.454 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:24.454 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.454 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.455 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.455 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.455 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.455 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.455 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.455 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.455 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.455 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.455 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.455 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.455 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.456 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.456 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:24.456 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "stats", 2024-09-12T12:37:24.456 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:24.456 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:24.456 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:24.456 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:24.456 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:24.456 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.456 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.456 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.457 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.457 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.457 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.457 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.457 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.457 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.457 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.457 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.457 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.457 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.457 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.458 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.458 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.458 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.458 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.458 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.458 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:24.458 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:24.458 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.458 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.458 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.458 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.459 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.459 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.459 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.459 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.459 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.459 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.459 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.459 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.459 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:24.459 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:24.460 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.460 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.460 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.460 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:24.460 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.460 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.460 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.460 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.460 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.460 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.460 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.461 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.461 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.461 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.461 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.461 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.461 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.461 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.461 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.461 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:24.461 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:24.461 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.461 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.462 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.462 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.462 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.462 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.462 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.462 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.462 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.462 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.462 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.462 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.462 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.463 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.463 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:24.463 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "status", 2024-09-12T12:37:24.463 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:24.463 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:24.463 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:24.463 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:24.463 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:24.463 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.463 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.464 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.464 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.464 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.464 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.464 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.464 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.464 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.464 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.464 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.464 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.464 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.465 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.465 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.465 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.465 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.465 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.465 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.465 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:24.465 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:24.465 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.465 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.465 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.466 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.466 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.466 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.466 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.466 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.466 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.466 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.466 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.466 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.466 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:24.466 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:24.467 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.467 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.467 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.467 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:24.467 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.467 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.467 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.467 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.467 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.467 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.467 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.468 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.468 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.468 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.468 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.468 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.468 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.468 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.468 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.468 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:24.468 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:24.468 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.469 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.469 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.469 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.469 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.469 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.469 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.469 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.469 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.469 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.469 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.469 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.470 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.470 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.470 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:24.470 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "telegraf", 2024-09-12T12:37:24.470 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:24.470 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:24.470 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:24.470 INFO:teuthology.orchestra.run.smithi033.stdout: "address": { 2024-09-12T12:37:24.470 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "address", 2024-09-12T12:37:24.470 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.470 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.470 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.471 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T12:37:24.471 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.471 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.471 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.471 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.471 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.471 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.471 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.471 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.471 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-09-12T12:37:24.471 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-09-12T12:37:24.471 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:24.472 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.472 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.472 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "15", 2024-09-12T12:37:24.472 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.472 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.472 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.472 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.472 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.472 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.472 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.472 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.472 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:24.472 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:24.473 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.473 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.473 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.473 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.473 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.473 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.473 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.473 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.473 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.473 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.473 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.473 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.474 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.474 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.474 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.474 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.474 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.474 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.474 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.474 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:24.474 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:24.474 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.474 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.474 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.474 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.475 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.475 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.475 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.475 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.475 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.475 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.475 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.475 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.475 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:24.475 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:24.475 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.475 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.475 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.476 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:24.476 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.476 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.476 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.476 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.476 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.476 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.476 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.476 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.476 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.476 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.477 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.477 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.477 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.477 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.477 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.477 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:24.477 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:24.477 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.477 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.477 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.477 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.477 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.477 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.478 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.478 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.478 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.478 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.481 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.481 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.481 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.481 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.481 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:24.482 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "telemetry", 2024-09-12T12:37:24.482 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:24.482 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:24.482 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:24.482 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_basic": { 2024-09-12T12:37:24.482 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_basic", 2024-09-12T12:37:24.482 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.482 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.482 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.483 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:24.483 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.483 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.483 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.483 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T12:37:24.483 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.483 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.483 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.483 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.483 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_crash": { 2024-09-12T12:37:24.483 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_crash", 2024-09-12T12:37:24.484 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.484 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.484 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.484 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:24.484 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.484 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.484 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.484 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T12:37:24.484 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.484 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.484 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.485 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.485 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_device": { 2024-09-12T12:37:24.485 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_device", 2024-09-12T12:37:24.485 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.485 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.485 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.485 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:24.485 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.485 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.486 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.486 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T12:37:24.486 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.486 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.486 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.486 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.486 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_ident": { 2024-09-12T12:37:24.486 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_ident", 2024-09-12T12:37:24.486 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.486 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.487 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.487 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.487 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.487 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.487 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.487 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T12:37:24.487 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.487 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.487 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.487 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.487 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_perf": { 2024-09-12T12:37:24.487 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_perf", 2024-09-12T12:37:24.488 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.488 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.488 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.488 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.488 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.488 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.488 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.488 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T12:37:24.488 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.488 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.488 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.489 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.489 INFO:teuthology.orchestra.run.smithi033.stdout: "contact": { 2024-09-12T12:37:24.489 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "contact", 2024-09-12T12:37:24.489 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.489 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.489 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.489 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.489 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.489 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.489 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.489 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.490 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.490 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.490 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.490 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.490 INFO:teuthology.orchestra.run.smithi033.stdout: "description": { 2024-09-12T12:37:24.490 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "description", 2024-09-12T12:37:24.490 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.490 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.490 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.490 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.490 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.491 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.491 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.491 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.491 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.491 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.491 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.491 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.491 INFO:teuthology.orchestra.run.smithi033.stdout: "device_url": { 2024-09-12T12:37:24.491 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "device_url", 2024-09-12T12:37:24.491 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.491 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.492 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.492 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T12:37:24.492 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.492 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.492 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.492 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.492 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.492 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.492 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.492 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.492 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": { 2024-09-12T12:37:24.493 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enabled", 2024-09-12T12:37:24.493 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.493 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.493 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.493 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.493 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.493 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.493 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.493 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.493 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.493 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.493 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.494 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.494 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-09-12T12:37:24.494 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-09-12T12:37:24.494 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:24.494 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.494 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.494 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "24", 2024-09-12T12:37:24.494 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "8", 2024-09-12T12:37:24.494 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.494 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.494 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.495 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.495 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.495 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.495 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.495 INFO:teuthology.orchestra.run.smithi033.stdout: "last_opt_revision": { 2024-09-12T12:37:24.495 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "last_opt_revision", 2024-09-12T12:37:24.495 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:24.495 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.495 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.495 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "1", 2024-09-12T12:37:24.495 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.496 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.496 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.496 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.496 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.496 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.496 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.496 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.496 INFO:teuthology.orchestra.run.smithi033.stdout: "leaderboard": { 2024-09-12T12:37:24.496 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "leaderboard", 2024-09-12T12:37:24.496 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.496 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.497 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.497 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.497 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.497 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.497 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.497 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.497 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.497 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.497 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.497 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.497 INFO:teuthology.orchestra.run.smithi033.stdout: "leaderboard_description": { 2024-09-12T12:37:24.498 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "leaderboard_description", 2024-09-12T12:37:24.498 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.498 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.498 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.498 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.498 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.498 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.498 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.498 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.498 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.498 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.499 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.499 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.499 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:24.499 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:24.499 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.499 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.499 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.499 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.499 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.499 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.499 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.499 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.500 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.500 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.500 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.500 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.500 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.500 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.500 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.500 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.500 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.500 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.500 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.501 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:24.501 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:24.501 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.501 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.501 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.501 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.501 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.501 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.501 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.501 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.501 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.501 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.502 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.502 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.502 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:24.502 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:24.502 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.502 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.502 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.502 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:24.502 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.502 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.502 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.502 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.503 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.503 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.503 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.503 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.503 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.503 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.503 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.503 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.503 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.503 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.504 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.504 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:24.504 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:24.504 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.504 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.504 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.504 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.504 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.504 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.504 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.504 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.505 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.505 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.505 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.505 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.505 INFO:teuthology.orchestra.run.smithi033.stdout: "organization": { 2024-09-12T12:37:24.505 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "organization", 2024-09-12T12:37:24.505 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.505 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.505 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.506 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.506 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.506 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.506 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.506 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.506 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.506 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.506 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.506 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.506 INFO:teuthology.orchestra.run.smithi033.stdout: "proxy": { 2024-09-12T12:37:24.506 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "proxy", 2024-09-12T12:37:24.506 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.507 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.507 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.507 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.507 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.507 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.507 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.507 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.507 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.507 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.507 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.507 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.508 INFO:teuthology.orchestra.run.smithi033.stdout: "url": { 2024-09-12T12:37:24.508 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "url", 2024-09-12T12:37:24.508 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.508 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.508 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.508 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T12:37:24.508 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.508 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.508 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.508 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.508 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.509 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.509 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.509 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.509 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.509 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.509 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:24.509 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "test_orchestrator", 2024-09-12T12:37:24.509 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:24.509 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:24.509 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:24.509 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:24.510 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:24.510 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.510 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.510 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.510 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.510 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.510 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.510 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.510 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.510 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.510 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.511 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.511 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.511 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.511 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.511 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.511 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.511 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.511 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.511 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.511 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:24.511 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:24.512 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.512 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.512 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.512 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.512 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.512 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.512 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.512 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.512 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.512 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.512 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.512 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.513 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:24.513 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:24.513 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.513 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.513 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.513 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:24.513 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.513 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.513 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.513 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.513 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.513 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.514 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.514 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.514 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.514 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.514 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.514 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.514 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.514 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.514 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.514 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:24.514 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:24.514 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.515 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.515 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.515 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.515 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.515 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.515 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.515 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.515 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.515 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.515 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.515 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.515 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.516 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.516 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:24.516 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "volumes", 2024-09-12T12:37:24.516 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:24.516 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:24.516 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:24.516 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:24.516 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:24.516 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.516 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.516 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.516 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.517 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.517 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.517 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.517 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.517 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.517 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.517 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.517 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.517 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.517 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.517 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.517 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.517 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.518 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.518 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.518 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:24.518 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:24.518 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.518 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.518 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.518 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.518 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.518 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.518 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.518 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.519 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.519 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.519 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.519 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.519 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:24.519 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:24.519 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.519 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.519 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.519 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:24.519 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.520 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.520 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.520 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.520 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.520 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.520 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.520 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.520 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.520 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.520 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.520 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.520 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.521 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.521 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.521 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:24.521 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:24.521 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.521 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.521 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.521 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.521 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.521 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.521 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.521 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.522 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.522 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.522 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.522 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.522 INFO:teuthology.orchestra.run.smithi033.stdout: "max_concurrent_clones": { 2024-09-12T12:37:24.522 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_concurrent_clones", 2024-09-12T12:37:24.522 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:24.522 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.522 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.522 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "4", 2024-09-12T12:37:24.522 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.523 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.523 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.523 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T12:37:24.523 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.523 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.523 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.523 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.523 INFO:teuthology.orchestra.run.smithi033.stdout: "periodic_async_work": { 2024-09-12T12:37:24.523 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "periodic_async_work", 2024-09-12T12:37:24.523 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.523 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.523 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.524 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.524 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.524 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.524 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.524 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Periodically check for async work", 2024-09-12T12:37:24.524 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.524 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.524 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.524 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.524 INFO:teuthology.orchestra.run.smithi033.stdout: "snapshot_clone_delay": { 2024-09-12T12:37:24.524 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snapshot_clone_delay", 2024-09-12T12:37:24.525 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:24.525 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.525 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.525 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-12T12:37:24.525 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.525 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.525 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.525 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T12:37:24.525 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.526 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.526 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.526 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.526 INFO:teuthology.orchestra.run.smithi033.stdout: "snapshot_clone_no_wait": { 2024-09-12T12:37:24.526 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T12:37:24.526 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.526 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.526 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.526 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-12T12:37:24.526 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.526 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.526 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.527 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T12:37:24.527 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.527 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.527 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.527 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.527 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.527 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.527 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:24.527 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix", 2024-09-12T12:37:24.527 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-12T12:37:24.527 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-12T12:37:24.528 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-12T12:37:24.528 INFO:teuthology.orchestra.run.smithi033.stdout: "discovery_interval": { 2024-09-12T12:37:24.528 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "discovery_interval", 2024-09-12T12:37:24.528 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-09-12T12:37:24.528 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.528 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.528 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "100", 2024-09-12T12:37:24.528 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.528 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.528 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.528 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.529 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.529 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.529 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.529 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.529 INFO:teuthology.orchestra.run.smithi033.stdout: "identifier": { 2024-09-12T12:37:24.529 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "identifier", 2024-09-12T12:37:24.529 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.529 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.529 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.529 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.529 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.529 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.530 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.530 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.530 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.530 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.530 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.530 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.530 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-09-12T12:37:24.530 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-09-12T12:37:24.530 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-12T12:37:24.530 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.531 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.531 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-09-12T12:37:24.531 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.531 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.531 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.531 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.531 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.531 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.531 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.531 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.531 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-12T12:37:24.531 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-12T12:37:24.532 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.532 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.532 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.532 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.532 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.532 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.532 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.532 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.532 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.532 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.532 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.533 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.533 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.533 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.533 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.533 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.533 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.533 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.533 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.533 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-12T12:37:24.533 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-12T12:37:24.533 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.534 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.534 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.534 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.534 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.534 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.534 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.534 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.534 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.534 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.534 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.534 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.534 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-12T12:37:24.535 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-12T12:37:24.535 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.535 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.535 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.535 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-12T12:37:24.535 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.535 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.535 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-12T12:37:24.535 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-12T12:37:24.535 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-12T12:37:24.535 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-12T12:37:24.535 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-12T12:37:24.535 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-12T12:37:24.536 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-12T12:37:24.536 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.536 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.536 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.536 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.536 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.536 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.536 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-12T12:37:24.536 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-12T12:37:24.536 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-12T12:37:24.536 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.536 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-12T12:37:24.536 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-12T12:37:24.537 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.537 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.537 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.537 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.537 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.537 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.537 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.537 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.537 INFO:teuthology.orchestra.run.smithi033.stdout: "zabbix_host": { 2024-09-12T12:37:24.537 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix_host", 2024-09-12T12:37:24.537 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.537 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.538 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.538 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-12T12:37:24.538 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.538 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.538 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.538 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.538 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.538 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.538 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.538 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.538 INFO:teuthology.orchestra.run.smithi033.stdout: "zabbix_port": { 2024-09-12T12:37:24.538 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix_port", 2024-09-12T12:37:24.538 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-12T12:37:24.538 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.539 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.539 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10051", 2024-09-12T12:37:24.539 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.539 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.539 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.539 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.539 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.539 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.539 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.539 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.539 INFO:teuthology.orchestra.run.smithi033.stdout: "zabbix_sender": { 2024-09-12T12:37:24.539 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix_sender", 2024-09-12T12:37:24.540 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-12T12:37:24.540 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-12T12:37:24.540 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-12T12:37:24.540 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T12:37:24.540 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-12T12:37:24.540 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-12T12:37:24.540 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-12T12:37:24.540 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-12T12:37:24.540 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-12T12:37:24.540 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T12:37:24.540 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-12T12:37:24.540 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.541 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.541 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.541 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.541 INFO:teuthology.orchestra.run.smithi033.stdout: "services": { 2024-09-12T12:37:24.541 INFO:teuthology.orchestra.run.smithi033.stdout: "dashboard": "https://172.21.15.33:8443/" 2024-09-12T12:37:24.541 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.541 INFO:teuthology.orchestra.run.smithi033.stdout: "always_on_modules": { 2024-09-12T12:37:24.541 INFO:teuthology.orchestra.run.smithi033.stdout: "octopus": [ 2024-09-12T12:37:24.541 INFO:teuthology.orchestra.run.smithi033.stdout: "balancer", 2024-09-12T12:37:24.541 INFO:teuthology.orchestra.run.smithi033.stdout: "crash", 2024-09-12T12:37:24.541 INFO:teuthology.orchestra.run.smithi033.stdout: "devicehealth", 2024-09-12T12:37:24.541 INFO:teuthology.orchestra.run.smithi033.stdout: "orchestrator", 2024-09-12T12:37:24.542 INFO:teuthology.orchestra.run.smithi033.stdout: "pg_autoscaler", 2024-09-12T12:37:24.542 INFO:teuthology.orchestra.run.smithi033.stdout: "progress", 2024-09-12T12:37:24.542 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_support", 2024-09-12T12:37:24.542 INFO:teuthology.orchestra.run.smithi033.stdout: "status", 2024-09-12T12:37:24.542 INFO:teuthology.orchestra.run.smithi033.stdout: "telemetry", 2024-09-12T12:37:24.542 INFO:teuthology.orchestra.run.smithi033.stdout: "volumes" 2024-09-12T12:37:24.542 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.542 INFO:teuthology.orchestra.run.smithi033.stdout: "pacific": [ 2024-09-12T12:37:24.542 INFO:teuthology.orchestra.run.smithi033.stdout: "balancer", 2024-09-12T12:37:24.542 INFO:teuthology.orchestra.run.smithi033.stdout: "crash", 2024-09-12T12:37:24.542 INFO:teuthology.orchestra.run.smithi033.stdout: "devicehealth", 2024-09-12T12:37:24.543 INFO:teuthology.orchestra.run.smithi033.stdout: "orchestrator", 2024-09-12T12:37:24.543 INFO:teuthology.orchestra.run.smithi033.stdout: "pg_autoscaler", 2024-09-12T12:37:24.543 INFO:teuthology.orchestra.run.smithi033.stdout: "progress", 2024-09-12T12:37:24.543 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_support", 2024-09-12T12:37:24.543 INFO:teuthology.orchestra.run.smithi033.stdout: "status", 2024-09-12T12:37:24.543 INFO:teuthology.orchestra.run.smithi033.stdout: "telemetry", 2024-09-12T12:37:24.543 INFO:teuthology.orchestra.run.smithi033.stdout: "volumes" 2024-09-12T12:37:24.543 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.543 INFO:teuthology.orchestra.run.smithi033.stdout: "quincy": [ 2024-09-12T12:37:24.543 INFO:teuthology.orchestra.run.smithi033.stdout: "balancer", 2024-09-12T12:37:24.543 INFO:teuthology.orchestra.run.smithi033.stdout: "crash", 2024-09-12T12:37:24.544 INFO:teuthology.orchestra.run.smithi033.stdout: "devicehealth", 2024-09-12T12:37:24.544 INFO:teuthology.orchestra.run.smithi033.stdout: "orchestrator", 2024-09-12T12:37:24.544 INFO:teuthology.orchestra.run.smithi033.stdout: "pg_autoscaler", 2024-09-12T12:37:24.544 INFO:teuthology.orchestra.run.smithi033.stdout: "progress", 2024-09-12T12:37:24.544 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_support", 2024-09-12T12:37:24.544 INFO:teuthology.orchestra.run.smithi033.stdout: "status", 2024-09-12T12:37:24.544 INFO:teuthology.orchestra.run.smithi033.stdout: "telemetry", 2024-09-12T12:37:24.544 INFO:teuthology.orchestra.run.smithi033.stdout: "volumes" 2024-09-12T12:37:24.544 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.544 INFO:teuthology.orchestra.run.smithi033.stdout: "reef": [ 2024-09-12T12:37:24.544 INFO:teuthology.orchestra.run.smithi033.stdout: "balancer", 2024-09-12T12:37:24.544 INFO:teuthology.orchestra.run.smithi033.stdout: "crash", 2024-09-12T12:37:24.545 INFO:teuthology.orchestra.run.smithi033.stdout: "devicehealth", 2024-09-12T12:37:24.545 INFO:teuthology.orchestra.run.smithi033.stdout: "orchestrator", 2024-09-12T12:37:24.545 INFO:teuthology.orchestra.run.smithi033.stdout: "pg_autoscaler", 2024-09-12T12:37:24.545 INFO:teuthology.orchestra.run.smithi033.stdout: "progress", 2024-09-12T12:37:24.545 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_support", 2024-09-12T12:37:24.545 INFO:teuthology.orchestra.run.smithi033.stdout: "status", 2024-09-12T12:37:24.545 INFO:teuthology.orchestra.run.smithi033.stdout: "telemetry", 2024-09-12T12:37:24.545 INFO:teuthology.orchestra.run.smithi033.stdout: "volumes" 2024-09-12T12:37:24.545 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T12:37:24.545 INFO:teuthology.orchestra.run.smithi033.stdout: "squid": [ 2024-09-12T12:37:24.545 INFO:teuthology.orchestra.run.smithi033.stdout: "balancer", 2024-09-12T12:37:24.546 INFO:teuthology.orchestra.run.smithi033.stdout: "crash", 2024-09-12T12:37:24.546 INFO:teuthology.orchestra.run.smithi033.stdout: "devicehealth", 2024-09-12T12:37:24.546 INFO:teuthology.orchestra.run.smithi033.stdout: "orchestrator", 2024-09-12T12:37:24.546 INFO:teuthology.orchestra.run.smithi033.stdout: "pg_autoscaler", 2024-09-12T12:37:24.546 INFO:teuthology.orchestra.run.smithi033.stdout: "progress", 2024-09-12T12:37:24.546 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_support", 2024-09-12T12:37:24.546 INFO:teuthology.orchestra.run.smithi033.stdout: "status", 2024-09-12T12:37:24.546 INFO:teuthology.orchestra.run.smithi033.stdout: "telemetry", 2024-09-12T12:37:24.546 INFO:teuthology.orchestra.run.smithi033.stdout: "volumes" 2024-09-12T12:37:24.546 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-09-12T12:37:24.546 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.546 INFO:teuthology.orchestra.run.smithi033.stdout: "last_failure_osd_epoch": 3, 2024-09-12T12:37:24.547 INFO:teuthology.orchestra.run.smithi033.stdout: "active_clients": [ 2024-09-12T12:37:24.547 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:24.547 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "devicehealth", 2024-09-12T12:37:24.547 INFO:teuthology.orchestra.run.smithi033.stdout: "addrvec": [ 2024-09-12T12:37:24.547 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:24.547 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v2", 2024-09-12T12:37:24.547 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "172.21.15.33:0", 2024-09-12T12:37:24.547 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 1815738657 2024-09-12T12:37:24.547 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.547 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-09-12T12:37:24.547 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.547 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:24.548 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "libcephsqlite", 2024-09-12T12:37:24.548 INFO:teuthology.orchestra.run.smithi033.stdout: "addrvec": [ 2024-09-12T12:37:24.548 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:24.548 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v2", 2024-09-12T12:37:24.548 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "172.21.15.33:0", 2024-09-12T12:37:24.548 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 4187934157 2024-09-12T12:37:24.548 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.548 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-09-12T12:37:24.548 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.548 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:24.548 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_support", 2024-09-12T12:37:24.549 INFO:teuthology.orchestra.run.smithi033.stdout: "addrvec": [ 2024-09-12T12:37:24.549 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:24.549 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v2", 2024-09-12T12:37:24.549 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "172.21.15.33:0", 2024-09-12T12:37:24.549 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 1685402607 2024-09-12T12:37:24.549 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.549 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-09-12T12:37:24.549 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:24.549 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:24.549 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "volumes", 2024-09-12T12:37:24.549 INFO:teuthology.orchestra.run.smithi033.stdout: "addrvec": [ 2024-09-12T12:37:24.549 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T12:37:24.549 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v2", 2024-09-12T12:37:24.550 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "172.21.15.33:0", 2024-09-12T12:37:24.550 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 118994610 2024-09-12T12:37:24.550 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.550 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-09-12T12:37:24.550 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:24.550 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-09-12T12:37:24.550 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:37:24.551 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:23 smithi102 ceph-mon[34799]: pgmap v691: 129 pgs: 129 active+clean; 9.9 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 25 MiB/s wr, 472 op/s 2024-09-12T12:37:24.552 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:23 smithi102 ceph-mon[34799]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T12:37:24.552 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:23 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/2263704688' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T12:37:24.552 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:23 smithi043 ceph-mon[34144]: pgmap v691: 129 pgs: 129 active+clean; 9.9 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 25 MiB/s wr, 472 op/s 2024-09-12T12:37:24.552 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:23 smithi043 ceph-mon[34144]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T12:37:24.552 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:23 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/2263704688' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T12:37:24.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:23.012+0000 7f59b136d640 1 -- 172.21.15.33:0/2263704688 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f59940a2d90 msgr2=0x7f59940a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:24.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:23.012+0000 7f59b136d640 1 --2- 172.21.15.33:0/2263704688 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f59940a2d90 0x7f59940a5250 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f59a401ac00 tx=0x7f59a4005f50 comp rx=0 tx=0).stop 2024-09-12T12:37:24.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:23.012+0000 7f59b136d640 1 -- 172.21.15.33:0/2263704688 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59ac078440 msgr2=0x7f59ac07a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:24.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:23.012+0000 7f59b136d640 1 --2- 172.21.15.33:0/2263704688 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59ac078440 0x7f59ac07a900 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f599c00c7d0 tx=0x7f599c00cbd0 comp rx=0 tx=0).stop 2024-09-12T12:37:24.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:23.012+0000 7f59b136d640 1 -- 172.21.15.33:0/2263704688 shutdown_connections 2024-09-12T12:37:24.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:23.012+0000 7f59b136d640 1 --2- 172.21.15.33:0/2263704688 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f59940a2d90 0x7f59940a5250 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:24.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:23.012+0000 7f59b136d640 1 --2- 172.21.15.33:0/2263704688 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59ac078440 0x7f59ac07a900 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:24.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:23.012+0000 7f59b136d640 1 --2- 172.21.15.33:0/2263704688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59ac109cb0 0x7f59ac19ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:24.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:23.012+0000 7f59b136d640 1 --2- 172.21.15.33:0/2263704688 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59ac1092f0 0x7f59ac19e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:24.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:23.012+0000 7f59b136d640 1 -- 172.21.15.33:0/2263704688 >> 172.21.15.33:0/2263704688 conn(0x7f59ac06eb60 msgr2=0x7f59ac1161a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:37:24.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:23.012+0000 7f59b136d640 1 -- 172.21.15.33:0/2263704688 shutdown_connections 2024-09-12T12:37:24.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:23.012+0000 7f59b136d640 1 -- 172.21.15.33:0/2263704688 wait complete. 2024-09-12T12:37:24.560 DEBUG:tasks.check_counter:Getting stats from a 2024-09-12T12:37:24.560 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-12T12:37:24.561 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:23 smithi033 ceph-mon[31246]: pgmap v691: 129 pgs: 129 active+clean; 9.9 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 25 MiB/s wr, 472 op/s 2024-09-12T12:37:24.561 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:23 smithi033 ceph-mon[31246]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T12:37:24.561 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:23 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/2263704688' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T12:37:25.068 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:37:25.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:25 smithi043 ceph-mon[34144]: pgmap v692: 129 pgs: 129 active+clean; 7.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 25 MiB/s wr, 524 op/s 2024-09-12T12:37:25.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:25 smithi102 ceph-mon[34799]: pgmap v692: 129 pgs: 129 active+clean; 7.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 25 MiB/s wr, 524 op/s 2024-09-12T12:37:25.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:25 smithi033 ceph-mon[31246]: pgmap v692: 129 pgs: 129 active+clean; 7.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 25 MiB/s wr, 524 op/s 2024-09-12T12:37:27.239 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:37:27.239 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T12:37:27.239 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 0, 2024-09-12T12:37:27.240 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 2, 2024-09-12T12:37:27.240 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 0, 2024-09-12T12:37:27.240 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 0, 2024-09-12T12:37:27.240 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 4, 2024-09-12T12:37:27.240 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 0, 2024-09-12T12:37:27.240 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.001506250, 2024-09-12T12:37:27.240 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.000000000, 2024-09-12T12:37:27.240 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.000354966, 2024-09-12T12:37:27.240 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T12:37:27.240 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:37:27.240 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-09-12T12:37:27.240 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-09-12T12:37:27.240 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-09-12T12:37:27.241 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:27.241 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:37:27.241 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-09-12T12:37:27.241 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-09-12T12:37:27.241 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-09-12T12:37:27.241 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:27.241 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T12:37:27.241 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T12:37:27.241 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:27.241 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T12:37:27.241 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 1, 2024-09-12T12:37:27.241 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 170, 2024-09-12T12:37:27.242 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 160, 2024-09-12T12:37:27.242 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 108352, 2024-09-12T12:37:27.242 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 3, 2024-09-12T12:37:27.242 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 2, 2024-09-12T12:37:27.242 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.013309118, 2024-09-12T12:37:27.242 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.009668183, 2024-09-12T12:37:27.242 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.001212853, 2024-09-12T12:37:27.242 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T12:37:27.242 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:37:27.242 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 168, 2024-09-12T12:37:27.242 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.009079078, 2024-09-12T12:37:27.242 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000054042 2024-09-12T12:37:27.242 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:27.243 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:37:27.243 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-09-12T12:37:27.243 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-09-12T12:37:27.243 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-09-12T12:37:27.243 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:27.243 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T12:37:27.243 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 108352 2024-09-12T12:37:27.243 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:27.243 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T12:37:27.243 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 231, 2024-09-12T12:37:27.243 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 226, 2024-09-12T12:37:27.243 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 483312, 2024-09-12T12:37:27.243 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 138112, 2024-09-12T12:37:27.243 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 2, 2024-09-12T12:37:27.244 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 1, 2024-09-12T12:37:27.244 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.041429818, 2024-09-12T12:37:27.244 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.016894728, 2024-09-12T12:37:27.244 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.027357579, 2024-09-12T12:37:27.244 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T12:37:27.244 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:37:27.244 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 226, 2024-09-12T12:37:27.244 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.028895936, 2024-09-12T12:37:27.244 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000127858 2024-09-12T12:37:27.244 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:27.244 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:37:27.244 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-09-12T12:37:27.244 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-09-12T12:37:27.245 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-09-12T12:37:27.245 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:27.245 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 483312, 2024-09-12T12:37:27.245 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 138112 2024-09-12T12:37:27.245 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:27.245 INFO:teuthology.orchestra.run.smithi033.stdout: "cct": { 2024-09-12T12:37:27.245 INFO:teuthology.orchestra.run.smithi033.stdout: "total_workers": 0, 2024-09-12T12:37:27.245 INFO:teuthology.orchestra.run.smithi033.stdout: "unhealthy_workers": 0 2024-09-12T12:37:27.246 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:27.246 INFO:teuthology.orchestra.run.smithi033.stdout: "mempool": { 2024-09-12T12:37:27.246 INFO:teuthology.orchestra.run.smithi033.stdout: "bloom_filter_bytes": 0, 2024-09-12T12:37:27.246 INFO:teuthology.orchestra.run.smithi033.stdout: "bloom_filter_items": 0, 2024-09-12T12:37:27.246 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T12:37:27.247 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_alloc_items": 0, 2024-09-12T12:37:27.247 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T12:37:27.247 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_data_items": 0, 2024-09-12T12:37:27.247 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T12:37:27.247 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T12:37:27.247 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T12:37:27.247 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T12:37:27.247 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T12:37:27.247 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_other_items": 0, 2024-09-12T12:37:27.247 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T12:37:27.247 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T12:37:27.247 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_extent_bytes": 0, 2024-09-12T12:37:27.247 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_extent_items": 0, 2024-09-12T12:37:27.248 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_blob_bytes": 0, 2024-09-12T12:37:27.248 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_blob_items": 0, 2024-09-12T12:37:27.248 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T12:37:27.248 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T12:37:27.248 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T12:37:27.248 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T12:37:27.248 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T12:37:27.248 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_fsck_items": 0, 2024-09-12T12:37:27.248 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_txc_bytes": 0, 2024-09-12T12:37:27.248 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_txc_items": 0, 2024-09-12T12:37:27.248 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T12:37:27.248 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T12:37:27.249 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_bytes": 0, 2024-09-12T12:37:27.249 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_items": 0, 2024-09-12T12:37:27.249 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_bytes": 0, 2024-09-12T12:37:27.249 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_items": 0, 2024-09-12T12:37:27.249 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T12:37:27.249 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_reader_items": 0, 2024-09-12T12:37:27.249 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T12:37:27.249 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_writer_items": 0, 2024-09-12T12:37:27.249 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_anon_bytes": 148984, 2024-09-12T12:37:27.249 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_anon_items": 30, 2024-09-12T12:37:27.249 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_meta_bytes": 0, 2024-09-12T12:37:27.249 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_meta_items": 0, 2024-09-12T12:37:27.249 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_bytes": 0, 2024-09-12T12:37:27.249 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_items": 0, 2024-09-12T12:37:27.250 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_mapbl_bytes": 0, 2024-09-12T12:37:27.250 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_mapbl_items": 0, 2024-09-12T12:37:27.250 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_pglog_bytes": 0, 2024-09-12T12:37:27.250 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_pglog_items": 0, 2024-09-12T12:37:27.250 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_bytes": 0, 2024-09-12T12:37:27.250 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_items": 0, 2024-09-12T12:37:27.250 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T12:37:27.250 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_mapping_items": 0, 2024-09-12T12:37:27.250 INFO:teuthology.orchestra.run.smithi033.stdout: "pgmap_bytes": 0, 2024-09-12T12:37:27.250 INFO:teuthology.orchestra.run.smithi033.stdout: "pgmap_items": 0, 2024-09-12T12:37:27.250 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_co_bytes": 928, 2024-09-12T12:37:27.250 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_co_items": 2, 2024-09-12T12:37:27.250 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_1_bytes": 0, 2024-09-12T12:37:27.250 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_1_items": 0, 2024-09-12T12:37:27.250 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_2_bytes": 0, 2024-09-12T12:37:27.251 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_2_items": 0 2024-09-12T12:37:27.251 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:27.251 INFO:teuthology.orchestra.run.smithi033.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T12:37:27.251 INFO:teuthology.orchestra.run.smithi033.stdout: "val": 0, 2024-09-12T12:37:27.251 INFO:teuthology.orchestra.run.smithi033.stdout: "max": 104857600, 2024-09-12T12:37:27.251 INFO:teuthology.orchestra.run.smithi033.stdout: "get_started": 0, 2024-09-12T12:37:27.251 INFO:teuthology.orchestra.run.smithi033.stdout: "get": 228, 2024-09-12T12:37:27.251 INFO:teuthology.orchestra.run.smithi033.stdout: "get_sum": 448290, 2024-09-12T12:37:27.251 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_fail": 0, 2024-09-12T12:37:27.251 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_success": 228, 2024-09-12T12:37:27.251 INFO:teuthology.orchestra.run.smithi033.stdout: "take": 0, 2024-09-12T12:37:27.251 INFO:teuthology.orchestra.run.smithi033.stdout: "take_sum": 0, 2024-09-12T12:37:27.251 INFO:teuthology.orchestra.run.smithi033.stdout: "put": 228, 2024-09-12T12:37:27.252 INFO:teuthology.orchestra.run.smithi033.stdout: "put_sum": 448290, 2024-09-12T12:37:27.252 INFO:teuthology.orchestra.run.smithi033.stdout: "wait": { 2024-09-12T12:37:27.252 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-09-12T12:37:27.252 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-09-12T12:37:27.252 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-09-12T12:37:27.252 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:27.252 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:27.252 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:37:27.673 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:27 smithi033 ceph-mon[31246]: pgmap v693: 129 pgs: 129 active+clean; 7.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 14 MiB/s wr, 332 op/s 2024-09-12T12:37:27.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:27 smithi043 ceph-mon[34144]: pgmap v693: 129 pgs: 129 active+clean; 7.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 14 MiB/s wr, 332 op/s 2024-09-12T12:37:27.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:27 smithi102 ceph-mon[34799]: pgmap v693: 129 pgs: 129 active+clean; 7.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 14 MiB/s wr, 332 op/s 2024-09-12T12:37:28.208 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-12T12:37:28.208 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-12T12:37:28.209 DEBUG:tasks.check_counter:Getting stats from d 2024-09-12T12:37:28.209 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-12T12:37:28.472 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:37:28.996 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:37:28.996 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T12:37:28.996 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 232, 2024-09-12T12:37:28.996 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 229, 2024-09-12T12:37:28.997 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 481728, 2024-09-12T12:37:28.997 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 140848, 2024-09-12T12:37:28.997 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 4, 2024-09-12T12:37:28.997 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 0, 2024-09-12T12:37:28.997 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.044808633, 2024-09-12T12:37:28.997 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.016135724, 2024-09-12T12:37:28.997 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.031127998, 2024-09-12T12:37:28.997 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T12:37:28.997 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:37:28.997 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 228, 2024-09-12T12:37:28.997 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.018612040, 2024-09-12T12:37:28.997 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000081631 2024-09-12T12:37:28.997 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:28.998 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:37:28.998 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-09-12T12:37:28.998 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-09-12T12:37:28.998 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-09-12T12:37:28.998 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:28.998 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 481728, 2024-09-12T12:37:28.998 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 140848 2024-09-12T12:37:28.998 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:28.998 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T12:37:28.998 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 1, 2024-09-12T12:37:28.998 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 174, 2024-09-12T12:37:28.998 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 160, 2024-09-12T12:37:28.999 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 109056, 2024-09-12T12:37:28.999 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 3, 2024-09-12T12:37:28.999 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 2, 2024-09-12T12:37:28.999 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.015063377, 2024-09-12T12:37:28.999 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.011391747, 2024-09-12T12:37:28.999 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.001235156, 2024-09-12T12:37:28.999 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T12:37:28.999 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:37:28.999 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 172, 2024-09-12T12:37:28.999 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.015937028, 2024-09-12T12:37:28.999 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000092657 2024-09-12T12:37:28.999 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:28.999 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:37:29.000 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-09-12T12:37:29.000 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-09-12T12:37:29.000 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-09-12T12:37:29.000 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:29.000 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T12:37:29.000 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 109056 2024-09-12T12:37:29.000 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:29.000 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T12:37:29.000 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 4, 2024-09-12T12:37:29.000 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 4, 2024-09-12T12:37:29.000 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 2944, 2024-09-12T12:37:29.000 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 448, 2024-09-12T12:37:29.000 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 2, 2024-09-12T12:37:29.001 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 1, 2024-09-12T12:37:29.001 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.002399057, 2024-09-12T12:37:29.001 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.000037232, 2024-09-12T12:37:29.001 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.002340864, 2024-09-12T12:37:29.001 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T12:37:29.001 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:37:29.001 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 3, 2024-09-12T12:37:29.001 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.004192306, 2024-09-12T12:37:29.001 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.001397435 2024-09-12T12:37:29.001 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:29.001 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:37:29.001 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-09-12T12:37:29.001 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-09-12T12:37:29.002 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-09-12T12:37:29.002 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:29.002 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-12T12:37:29.002 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T12:37:29.002 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:29.002 INFO:teuthology.orchestra.run.smithi033.stdout: "cct": { 2024-09-12T12:37:29.002 INFO:teuthology.orchestra.run.smithi033.stdout: "total_workers": 0, 2024-09-12T12:37:29.002 INFO:teuthology.orchestra.run.smithi033.stdout: "unhealthy_workers": 0 2024-09-12T12:37:29.002 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:29.002 INFO:teuthology.orchestra.run.smithi033.stdout: "mempool": { 2024-09-12T12:37:29.002 INFO:teuthology.orchestra.run.smithi033.stdout: "bloom_filter_bytes": 0, 2024-09-12T12:37:29.002 INFO:teuthology.orchestra.run.smithi033.stdout: "bloom_filter_items": 0, 2024-09-12T12:37:29.002 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T12:37:29.002 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_alloc_items": 0, 2024-09-12T12:37:29.003 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T12:37:29.003 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_data_items": 0, 2024-09-12T12:37:29.003 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T12:37:29.003 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T12:37:29.003 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T12:37:29.003 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T12:37:29.003 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T12:37:29.003 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_other_items": 0, 2024-09-12T12:37:29.003 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T12:37:29.003 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T12:37:29.003 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_extent_bytes": 0, 2024-09-12T12:37:29.003 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_extent_items": 0, 2024-09-12T12:37:29.003 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_blob_bytes": 0, 2024-09-12T12:37:29.003 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_blob_items": 0, 2024-09-12T12:37:29.004 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T12:37:29.004 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T12:37:29.004 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T12:37:29.004 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T12:37:29.004 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T12:37:29.004 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_fsck_items": 0, 2024-09-12T12:37:29.004 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_txc_bytes": 0, 2024-09-12T12:37:29.004 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_txc_items": 0, 2024-09-12T12:37:29.004 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T12:37:29.004 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T12:37:29.004 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_bytes": 0, 2024-09-12T12:37:29.004 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_items": 0, 2024-09-12T12:37:29.005 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_bytes": 0, 2024-09-12T12:37:29.005 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_items": 0, 2024-09-12T12:37:29.005 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T12:37:29.005 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_reader_items": 0, 2024-09-12T12:37:29.005 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T12:37:29.005 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_writer_items": 0, 2024-09-12T12:37:29.005 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_anon_bytes": 148967, 2024-09-12T12:37:29.005 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_anon_items": 29, 2024-09-12T12:37:29.005 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_meta_bytes": 0, 2024-09-12T12:37:29.005 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_meta_items": 0, 2024-09-12T12:37:29.005 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_bytes": 0, 2024-09-12T12:37:29.005 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_items": 0, 2024-09-12T12:37:29.005 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_mapbl_bytes": 0, 2024-09-12T12:37:29.005 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_mapbl_items": 0, 2024-09-12T12:37:29.005 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_pglog_bytes": 0, 2024-09-12T12:37:29.006 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_pglog_items": 0, 2024-09-12T12:37:29.006 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_bytes": 0, 2024-09-12T12:37:29.006 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_items": 0, 2024-09-12T12:37:29.006 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T12:37:29.006 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_mapping_items": 0, 2024-09-12T12:37:29.006 INFO:teuthology.orchestra.run.smithi033.stdout: "pgmap_bytes": 0, 2024-09-12T12:37:29.006 INFO:teuthology.orchestra.run.smithi033.stdout: "pgmap_items": 0, 2024-09-12T12:37:29.006 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_co_bytes": 928, 2024-09-12T12:37:29.006 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_co_items": 2, 2024-09-12T12:37:29.006 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_1_bytes": 0, 2024-09-12T12:37:29.006 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_1_items": 0, 2024-09-12T12:37:29.006 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_2_bytes": 0, 2024-09-12T12:37:29.006 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_2_items": 0 2024-09-12T12:37:29.006 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:29.007 INFO:teuthology.orchestra.run.smithi033.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T12:37:29.007 INFO:teuthology.orchestra.run.smithi033.stdout: "val": 0, 2024-09-12T12:37:29.007 INFO:teuthology.orchestra.run.smithi033.stdout: "max": 104857600, 2024-09-12T12:37:29.007 INFO:teuthology.orchestra.run.smithi033.stdout: "get_started": 0, 2024-09-12T12:37:29.007 INFO:teuthology.orchestra.run.smithi033.stdout: "get": 233, 2024-09-12T12:37:29.007 INFO:teuthology.orchestra.run.smithi033.stdout: "get_sum": 448940, 2024-09-12T12:37:29.007 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_fail": 0, 2024-09-12T12:37:29.007 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_success": 233, 2024-09-12T12:37:29.007 INFO:teuthology.orchestra.run.smithi033.stdout: "take": 0, 2024-09-12T12:37:29.007 INFO:teuthology.orchestra.run.smithi033.stdout: "take_sum": 0, 2024-09-12T12:37:29.008 INFO:teuthology.orchestra.run.smithi033.stdout: "put": 233, 2024-09-12T12:37:29.008 INFO:teuthology.orchestra.run.smithi033.stdout: "put_sum": 448940, 2024-09-12T12:37:29.008 INFO:teuthology.orchestra.run.smithi033.stdout: "wait": { 2024-09-12T12:37:29.008 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-09-12T12:37:29.008 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-09-12T12:37:29.008 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-09-12T12:37:29.008 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:29.008 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:29.008 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:37:29.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:29 smithi033 ceph-mon[31246]: pgmap v694: 129 pgs: 129 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 14 MiB/s wr, 458 op/s 2024-09-12T12:37:29.743 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-12T12:37:29.743 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-12T12:37:29.743 DEBUG:tasks.check_counter:Getting stats from g 2024-09-12T12:37:29.743 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-12T12:37:29.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:29 smithi043 ceph-mon[34144]: pgmap v694: 129 pgs: 129 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 14 MiB/s wr, 458 op/s 2024-09-12T12:37:29.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:29 smithi102 ceph-mon[34799]: pgmap v694: 129 pgs: 129 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 14 MiB/s wr, 458 op/s 2024-09-12T12:37:30.018 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:37:31.821 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:37:31.822 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T12:37:31.822 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 4, 2024-09-12T12:37:31.822 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 4, 2024-09-12T12:37:31.822 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 2944, 2024-09-12T12:37:31.822 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 448, 2024-09-12T12:37:31.822 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 4, 2024-09-12T12:37:31.822 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 0, 2024-09-12T12:37:31.823 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.003345600, 2024-09-12T12:37:31.824 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.000041031, 2024-09-12T12:37:31.824 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.002280347, 2024-09-12T12:37:31.824 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T12:37:31.824 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:37:31.824 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 3, 2024-09-12T12:37:31.824 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.004183168, 2024-09-12T12:37:31.824 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.001394389 2024-09-12T12:37:31.824 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:31.824 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:37:31.824 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-09-12T12:37:31.825 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-09-12T12:37:31.825 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-09-12T12:37:31.825 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:31.825 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-12T12:37:31.825 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T12:37:31.825 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:31.825 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T12:37:31.825 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 1, 2024-09-12T12:37:31.825 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 172, 2024-09-12T12:37:31.825 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 160, 2024-09-12T12:37:31.826 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 108704, 2024-09-12T12:37:31.826 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 3, 2024-09-12T12:37:31.826 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 2, 2024-09-12T12:37:31.826 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.014491410, 2024-09-12T12:37:31.826 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.010967389, 2024-09-12T12:37:31.826 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.001079960, 2024-09-12T12:37:31.826 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T12:37:31.826 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:37:31.826 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 170, 2024-09-12T12:37:31.826 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.007230043, 2024-09-12T12:37:31.827 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000042529 2024-09-12T12:37:31.827 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:31.827 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:37:31.827 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-09-12T12:37:31.827 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-09-12T12:37:31.827 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-09-12T12:37:31.827 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:31.827 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T12:37:31.827 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 108704 2024-09-12T12:37:31.827 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:31.827 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T12:37:31.827 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 229, 2024-09-12T12:37:31.828 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 226, 2024-09-12T12:37:31.828 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 480912, 2024-09-12T12:37:31.828 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 138944, 2024-09-12T12:37:31.828 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 2, 2024-09-12T12:37:31.828 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 1, 2024-09-12T12:37:31.829 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.040739765, 2024-09-12T12:37:31.829 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.015727090, 2024-09-12T12:37:31.829 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.028970603, 2024-09-12T12:37:31.829 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T12:37:31.829 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:37:31.830 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 225, 2024-09-12T12:37:31.830 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.012500526, 2024-09-12T12:37:31.830 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000055557 2024-09-12T12:37:31.830 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:31.830 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:37:31.830 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-09-12T12:37:31.830 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-09-12T12:37:31.830 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-09-12T12:37:31.830 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:31.831 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 480912, 2024-09-12T12:37:31.831 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 138944 2024-09-12T12:37:31.831 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:31.831 INFO:teuthology.orchestra.run.smithi033.stdout: "cct": { 2024-09-12T12:37:31.831 INFO:teuthology.orchestra.run.smithi033.stdout: "total_workers": 0, 2024-09-12T12:37:31.831 INFO:teuthology.orchestra.run.smithi033.stdout: "unhealthy_workers": 0 2024-09-12T12:37:31.831 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:31.831 INFO:teuthology.orchestra.run.smithi033.stdout: "mempool": { 2024-09-12T12:37:31.831 INFO:teuthology.orchestra.run.smithi033.stdout: "bloom_filter_bytes": 0, 2024-09-12T12:37:31.831 INFO:teuthology.orchestra.run.smithi033.stdout: "bloom_filter_items": 0, 2024-09-12T12:37:31.831 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T12:37:31.832 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_alloc_items": 0, 2024-09-12T12:37:31.832 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T12:37:31.832 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_data_items": 0, 2024-09-12T12:37:31.832 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T12:37:31.832 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T12:37:31.832 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T12:37:31.833 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T12:37:31.833 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T12:37:31.833 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_other_items": 0, 2024-09-12T12:37:31.833 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T12:37:31.833 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T12:37:31.833 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_extent_bytes": 0, 2024-09-12T12:37:31.833 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_extent_items": 0, 2024-09-12T12:37:31.833 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_blob_bytes": 0, 2024-09-12T12:37:31.833 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_blob_items": 0, 2024-09-12T12:37:31.833 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T12:37:31.833 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T12:37:31.834 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T12:37:31.834 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T12:37:31.834 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T12:37:31.834 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_fsck_items": 0, 2024-09-12T12:37:31.834 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_txc_bytes": 0, 2024-09-12T12:37:31.834 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_txc_items": 0, 2024-09-12T12:37:31.834 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T12:37:31.834 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T12:37:31.834 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_bytes": 0, 2024-09-12T12:37:31.834 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_items": 0, 2024-09-12T12:37:31.834 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_bytes": 0, 2024-09-12T12:37:31.835 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_items": 0, 2024-09-12T12:37:31.835 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T12:37:31.835 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_reader_items": 0, 2024-09-12T12:37:31.835 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T12:37:31.835 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_writer_items": 0, 2024-09-12T12:37:31.835 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_anon_bytes": 149007, 2024-09-12T12:37:31.835 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_anon_items": 30, 2024-09-12T12:37:31.835 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_meta_bytes": 0, 2024-09-12T12:37:31.835 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_meta_items": 0, 2024-09-12T12:37:31.835 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_bytes": 0, 2024-09-12T12:37:31.835 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_items": 0, 2024-09-12T12:37:31.835 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_mapbl_bytes": 0, 2024-09-12T12:37:31.836 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_mapbl_items": 0, 2024-09-12T12:37:31.836 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_pglog_bytes": 0, 2024-09-12T12:37:31.836 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_pglog_items": 0, 2024-09-12T12:37:31.836 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_bytes": 0, 2024-09-12T12:37:31.836 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_items": 0, 2024-09-12T12:37:31.836 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T12:37:31.836 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_mapping_items": 0, 2024-09-12T12:37:31.836 INFO:teuthology.orchestra.run.smithi033.stdout: "pgmap_bytes": 0, 2024-09-12T12:37:31.836 INFO:teuthology.orchestra.run.smithi033.stdout: "pgmap_items": 0, 2024-09-12T12:37:31.836 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_co_bytes": 928, 2024-09-12T12:37:31.836 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_co_items": 2, 2024-09-12T12:37:31.837 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_1_bytes": 0, 2024-09-12T12:37:31.837 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_1_items": 0, 2024-09-12T12:37:31.837 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_2_bytes": 0, 2024-09-12T12:37:31.837 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_2_items": 0 2024-09-12T12:37:31.837 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:31.837 INFO:teuthology.orchestra.run.smithi033.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T12:37:31.837 INFO:teuthology.orchestra.run.smithi033.stdout: "val": 0, 2024-09-12T12:37:31.837 INFO:teuthology.orchestra.run.smithi033.stdout: "max": 104857600, 2024-09-12T12:37:31.837 INFO:teuthology.orchestra.run.smithi033.stdout: "get_started": 0, 2024-09-12T12:37:31.837 INFO:teuthology.orchestra.run.smithi033.stdout: "get": 230, 2024-09-12T12:37:31.837 INFO:teuthology.orchestra.run.smithi033.stdout: "get_sum": 448550, 2024-09-12T12:37:31.838 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_fail": 0, 2024-09-12T12:37:31.838 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_success": 230, 2024-09-12T12:37:31.838 INFO:teuthology.orchestra.run.smithi033.stdout: "take": 0, 2024-09-12T12:37:31.838 INFO:teuthology.orchestra.run.smithi033.stdout: "take_sum": 0, 2024-09-12T12:37:31.838 INFO:teuthology.orchestra.run.smithi033.stdout: "put": 230, 2024-09-12T12:37:31.838 INFO:teuthology.orchestra.run.smithi033.stdout: "put_sum": 448550, 2024-09-12T12:37:31.838 INFO:teuthology.orchestra.run.smithi033.stdout: "wait": { 2024-09-12T12:37:31.838 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-09-12T12:37:31.838 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-09-12T12:37:31.838 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-09-12T12:37:31.838 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:31.838 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:31.839 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:37:31.839 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:31 smithi033 ceph-mon[31246]: pgmap v695: 129 pgs: 129 active+clean; 249 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 666 KiB/s rd, 4.6 MiB/s wr, 303 op/s 2024-09-12T12:37:31.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:31 smithi043 ceph-mon[34144]: pgmap v695: 129 pgs: 129 active+clean; 249 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 666 KiB/s rd, 4.6 MiB/s wr, 303 op/s 2024-09-12T12:37:31.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:31 smithi102 ceph-mon[34799]: pgmap v695: 129 pgs: 129 active+clean; 249 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 666 KiB/s rd, 4.6 MiB/s wr, 303 op/s 2024-09-12T12:37:33.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:33 smithi043 ceph-mon[34144]: pgmap v696: 129 pgs: 129 active+clean; 1.3 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 2.1 MiB/s wr, 260 op/s 2024-09-12T12:37:33.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:33 smithi102 ceph-mon[34799]: pgmap v696: 129 pgs: 129 active+clean; 1.3 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 2.1 MiB/s wr, 260 op/s 2024-09-12T12:37:33.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:33 smithi033 ceph-mon[31246]: pgmap v696: 129 pgs: 129 active+clean; 1.3 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 2.1 MiB/s wr, 260 op/s 2024-09-12T12:37:34.628 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-12T12:37:34.629 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-12T12:37:34.629 DEBUG:tasks.check_counter:Getting stats from j 2024-09-12T12:37:34.629 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-12T12:37:34.892 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:37:35.417 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T12:37:35.417 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T12:37:35.417 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 0, 2024-09-12T12:37:35.417 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 2, 2024-09-12T12:37:35.418 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 0, 2024-09-12T12:37:35.418 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 0, 2024-09-12T12:37:35.418 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 4, 2024-09-12T12:37:35.418 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 0, 2024-09-12T12:37:35.418 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.001685074, 2024-09-12T12:37:35.418 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.000000000, 2024-09-12T12:37:35.418 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.000314786, 2024-09-12T12:37:35.418 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T12:37:35.418 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:37:35.418 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-09-12T12:37:35.418 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-09-12T12:37:35.418 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-09-12T12:37:35.419 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:35.419 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:37:35.419 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-09-12T12:37:35.419 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-09-12T12:37:35.419 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-09-12T12:37:35.419 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:35.419 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T12:37:35.419 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T12:37:35.419 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:35.419 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T12:37:35.419 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 239, 2024-09-12T12:37:35.420 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 234, 2024-09-12T12:37:35.420 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 485488, 2024-09-12T12:37:35.420 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 143232, 2024-09-12T12:37:35.420 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 2, 2024-09-12T12:37:35.420 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 1, 2024-09-12T12:37:35.420 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.039463171, 2024-09-12T12:37:35.420 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.016999721, 2024-09-12T12:37:35.420 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.026165503, 2024-09-12T12:37:35.420 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T12:37:35.420 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:37:35.420 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 234, 2024-09-12T12:37:35.420 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.022740409, 2024-09-12T12:37:35.421 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000097181 2024-09-12T12:37:35.421 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:35.421 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:37:35.421 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-09-12T12:37:35.421 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-09-12T12:37:35.421 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-09-12T12:37:35.421 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:35.421 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 485488, 2024-09-12T12:37:35.421 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 143232 2024-09-12T12:37:35.421 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:35.421 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T12:37:35.422 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 1, 2024-09-12T12:37:35.422 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 176, 2024-09-12T12:37:35.422 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 160, 2024-09-12T12:37:35.422 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 109408, 2024-09-12T12:37:35.422 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 3, 2024-09-12T12:37:35.422 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 2, 2024-09-12T12:37:35.422 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.015843900, 2024-09-12T12:37:35.422 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.011591257, 2024-09-12T12:37:35.422 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.001572812, 2024-09-12T12:37:35.422 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T12:37:35.422 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:37:35.423 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 174, 2024-09-12T12:37:35.423 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.008369532, 2024-09-12T12:37:35.423 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000048100 2024-09-12T12:37:35.423 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:35.423 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:37:35.423 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-09-12T12:37:35.423 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-09-12T12:37:35.423 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-09-12T12:37:35.423 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:35.423 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T12:37:35.423 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 109408 2024-09-12T12:37:35.424 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:35.424 INFO:teuthology.orchestra.run.smithi033.stdout: "cct": { 2024-09-12T12:37:35.424 INFO:teuthology.orchestra.run.smithi033.stdout: "total_workers": 0, 2024-09-12T12:37:35.424 INFO:teuthology.orchestra.run.smithi033.stdout: "unhealthy_workers": 0 2024-09-12T12:37:35.424 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:35.424 INFO:teuthology.orchestra.run.smithi033.stdout: "mempool": { 2024-09-12T12:37:35.424 INFO:teuthology.orchestra.run.smithi033.stdout: "bloom_filter_bytes": 0, 2024-09-12T12:37:35.424 INFO:teuthology.orchestra.run.smithi033.stdout: "bloom_filter_items": 0, 2024-09-12T12:37:35.424 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T12:37:35.424 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_alloc_items": 0, 2024-09-12T12:37:35.424 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T12:37:35.425 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_data_items": 0, 2024-09-12T12:37:35.425 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T12:37:35.425 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T12:37:35.425 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T12:37:35.425 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T12:37:35.425 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T12:37:35.425 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_other_items": 0, 2024-09-12T12:37:35.425 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T12:37:35.425 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T12:37:35.425 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_extent_bytes": 0, 2024-09-12T12:37:35.425 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_extent_items": 0, 2024-09-12T12:37:35.425 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_blob_bytes": 0, 2024-09-12T12:37:35.426 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_blob_items": 0, 2024-09-12T12:37:35.426 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T12:37:35.426 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T12:37:35.426 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T12:37:35.426 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T12:37:35.426 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T12:37:35.426 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_fsck_items": 0, 2024-09-12T12:37:35.426 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_txc_bytes": 0, 2024-09-12T12:37:35.426 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_txc_items": 0, 2024-09-12T12:37:35.426 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T12:37:35.426 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T12:37:35.426 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_bytes": 0, 2024-09-12T12:37:35.427 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_items": 0, 2024-09-12T12:37:35.427 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_bytes": 0, 2024-09-12T12:37:35.427 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_items": 0, 2024-09-12T12:37:35.427 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T12:37:35.427 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_reader_items": 0, 2024-09-12T12:37:35.427 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T12:37:35.427 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_writer_items": 0, 2024-09-12T12:37:35.427 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_anon_bytes": 148967, 2024-09-12T12:37:35.427 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_anon_items": 29, 2024-09-12T12:37:35.427 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_meta_bytes": 0, 2024-09-12T12:37:35.427 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_meta_items": 0, 2024-09-12T12:37:35.427 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_bytes": 0, 2024-09-12T12:37:35.428 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_items": 0, 2024-09-12T12:37:35.428 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_mapbl_bytes": 0, 2024-09-12T12:37:35.428 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_mapbl_items": 0, 2024-09-12T12:37:35.428 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_pglog_bytes": 0, 2024-09-12T12:37:35.428 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_pglog_items": 0, 2024-09-12T12:37:35.428 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_bytes": 0, 2024-09-12T12:37:35.428 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_items": 0, 2024-09-12T12:37:35.428 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T12:37:35.428 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_mapping_items": 0, 2024-09-12T12:37:35.428 INFO:teuthology.orchestra.run.smithi033.stdout: "pgmap_bytes": 0, 2024-09-12T12:37:35.428 INFO:teuthology.orchestra.run.smithi033.stdout: "pgmap_items": 0, 2024-09-12T12:37:35.428 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_co_bytes": 928, 2024-09-12T12:37:35.429 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_co_items": 2, 2024-09-12T12:37:35.429 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_1_bytes": 0, 2024-09-12T12:37:35.429 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_1_items": 0, 2024-09-12T12:37:35.429 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_2_bytes": 0, 2024-09-12T12:37:35.429 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_2_items": 0 2024-09-12T12:37:35.429 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T12:37:35.429 INFO:teuthology.orchestra.run.smithi033.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T12:37:35.429 INFO:teuthology.orchestra.run.smithi033.stdout: "val": 0, 2024-09-12T12:37:35.429 INFO:teuthology.orchestra.run.smithi033.stdout: "max": 104857600, 2024-09-12T12:37:35.429 INFO:teuthology.orchestra.run.smithi033.stdout: "get_started": 0, 2024-09-12T12:37:35.429 INFO:teuthology.orchestra.run.smithi033.stdout: "get": 236, 2024-09-12T12:37:35.430 INFO:teuthology.orchestra.run.smithi033.stdout: "get_sum": 449330, 2024-09-12T12:37:35.430 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_fail": 0, 2024-09-12T12:37:35.430 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_success": 236, 2024-09-12T12:37:35.430 INFO:teuthology.orchestra.run.smithi033.stdout: "take": 0, 2024-09-12T12:37:35.430 INFO:teuthology.orchestra.run.smithi033.stdout: "take_sum": 0, 2024-09-12T12:37:35.430 INFO:teuthology.orchestra.run.smithi033.stdout: "put": 236, 2024-09-12T12:37:35.430 INFO:teuthology.orchestra.run.smithi033.stdout: "put_sum": 449330, 2024-09-12T12:37:35.430 INFO:teuthology.orchestra.run.smithi033.stdout: "wait": { 2024-09-12T12:37:35.430 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-09-12T12:37:35.430 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-09-12T12:37:35.430 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-09-12T12:37:35.431 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:35.431 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T12:37:35.431 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T12:37:35.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:35 smithi033 ceph-mon[31246]: pgmap v697: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 1.3 MiB/s wr, 246 op/s 2024-09-12T12:37:35.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:35 smithi043 ceph-mon[34144]: pgmap v697: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 1.3 MiB/s wr, 246 op/s 2024-09-12T12:37:35.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:35 smithi102 ceph-mon[34799]: pgmap v697: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 1.3 MiB/s wr, 246 op/s 2024-09-12T12:37:36.130 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-12T12:37:36.130 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-12T12:37:36.130 DEBUG:tasks.check_counter:Getting stats from b 2024-09-12T12:37:36.130 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-12T12:37:36.428 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T12:37:36.921 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-12T12:37:36.921 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T12:37:36.921 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 1630, 2024-09-12T12:37:36.921 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 1632, 2024-09-12T12:37:36.921 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 1207919, 2024-09-12T12:37:36.921 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 518350, 2024-09-12T12:37:36.921 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 6, 2024-09-12T12:37:36.921 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 2, 2024-09-12T12:37:36.921 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 0.137927644, 2024-09-12T12:37:36.921 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.047924132, 2024-09-12T12:37:36.921 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.033924584, 2024-09-12T12:37:36.922 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.044334445, 2024-09-12T12:37:36.922 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:37:36.922 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 1630, 2024-09-12T12:37:36.922 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.070131683, 2024-09-12T12:37:36.922 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000043025 2024-09-12T12:37:36.922 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.922 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:37:36.922 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:36.922 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:36.922 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:36.922 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.922 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T12:37:36.922 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T12:37:36.923 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.923 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T12:37:36.923 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 252, 2024-09-12T12:37:36.923 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 242, 2024-09-12T12:37:36.923 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 523320, 2024-09-12T12:37:36.923 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 142426, 2024-09-12T12:37:36.923 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 4, 2024-09-12T12:37:36.923 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 3, 2024-09-12T12:37:36.923 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 0.034176398, 2024-09-12T12:37:36.923 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.014247371, 2024-09-12T12:37:36.923 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.026408827, 2024-09-12T12:37:36.923 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.000114202, 2024-09-12T12:37:36.923 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:37:36.924 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 242, 2024-09-12T12:37:36.924 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.024398742, 2024-09-12T12:37:36.924 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000100821 2024-09-12T12:37:36.924 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.924 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:37:36.924 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:36.924 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:36.924 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:36.924 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.924 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 521664, 2024-09-12T12:37:36.924 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 141088 2024-09-12T12:37:36.924 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.924 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T12:37:36.925 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 790, 2024-09-12T12:37:36.925 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 960, 2024-09-12T12:37:36.925 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 194521, 2024-09-12T12:37:36.925 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 623897, 2024-09-12T12:37:36.925 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 4, 2024-09-12T12:37:36.925 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 3, 2024-09-12T12:37:36.925 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 0.072751307, 2024-09-12T12:37:36.925 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.023094009, 2024-09-12T12:37:36.925 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.015163755, 2024-09-12T12:37:36.925 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.024819076, 2024-09-12T12:37:36.925 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:37:36.925 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 958, 2024-09-12T12:37:36.925 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.033990477, 2024-09-12T12:37:36.926 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000035480 2024-09-12T12:37:36.926 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.926 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:37:36.926 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:36.926 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:36.926 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:36.926 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.926 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T12:37:36.926 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 373312 2024-09-12T12:37:36.926 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.926 INFO:teuthology.orchestra.run.smithi043.stdout: "cct": { 2024-09-12T12:37:36.926 INFO:teuthology.orchestra.run.smithi043.stdout: "total_workers": 1, 2024-09-12T12:37:36.926 INFO:teuthology.orchestra.run.smithi043.stdout: "unhealthy_workers": 0 2024-09-12T12:37:36.927 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.927 INFO:teuthology.orchestra.run.smithi043.stdout: "finisher-MDSRank": { 2024-09-12T12:37:36.927 INFO:teuthology.orchestra.run.smithi043.stdout: "queue_len": 0, 2024-09-12T12:37:36.927 INFO:teuthology.orchestra.run.smithi043.stdout: "complete_latency": { 2024-09-12T12:37:36.927 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 3972, 2024-09-12T12:37:36.927 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.106053791, 2024-09-12T12:37:36.927 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000026700 2024-09-12T12:37:36.927 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T12:37:36.927 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.927 INFO:teuthology.orchestra.run.smithi043.stdout: "finisher-PurgeQueue": { 2024-09-12T12:37:36.927 INFO:teuthology.orchestra.run.smithi043.stdout: "queue_len": 0, 2024-09-12T12:37:36.927 INFO:teuthology.orchestra.run.smithi043.stdout: "complete_latency": { 2024-09-12T12:37:36.927 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:36.927 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:36.928 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:36.928 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T12:37:36.928 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.928 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": { 2024-09-12T12:37:36.928 INFO:teuthology.orchestra.run.smithi043.stdout: "request": 0, 2024-09-12T12:37:36.928 INFO:teuthology.orchestra.run.smithi043.stdout: "reply": 0, 2024-09-12T12:37:36.928 INFO:teuthology.orchestra.run.smithi043.stdout: "reply_latency": { 2024-09-12T12:37:36.928 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:36.928 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:36.928 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:36.928 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.928 INFO:teuthology.orchestra.run.smithi043.stdout: "slow_reply": 0, 2024-09-12T12:37:36.928 INFO:teuthology.orchestra.run.smithi043.stdout: "forward": 0, 2024-09-12T12:37:36.928 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_fetch_complete": 0, 2024-09-12T12:37:36.929 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_fetch_keys": 0, 2024-09-12T12:37:36.929 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_commit": 0, 2024-09-12T12:37:36.929 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_split": 0, 2024-09-12T12:37:36.929 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_merge": 0, 2024-09-12T12:37:36.929 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes": 34, 2024-09-12T12:37:36.929 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_top": 0, 2024-09-12T12:37:36.929 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_bottom": 34, 2024-09-12T12:37:36.929 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_pin_tail": 0, 2024-09-12T12:37:36.929 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_pinned": 34, 2024-09-12T12:37:36.929 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_expired": 0, 2024-09-12T12:37:36.929 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_with_caps": 0, 2024-09-12T12:37:36.929 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": 0, 2024-09-12T12:37:36.929 INFO:teuthology.orchestra.run.smithi043.stdout: "subtrees": 2, 2024-09-12T12:37:36.930 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse": 0, 2024-09-12T12:37:36.930 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_hit": 0, 2024-09-12T12:37:36.930 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_forward": 0, 2024-09-12T12:37:36.930 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_discover": 0, 2024-09-12T12:37:36.930 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_dir_fetch": 0, 2024-09-12T12:37:36.930 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_remote_ino": 0, 2024-09-12T12:37:36.930 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_lock": 0, 2024-09-12T12:37:36.930 INFO:teuthology.orchestra.run.smithi043.stdout: "load_cent": 0, 2024-09-12T12:37:36.930 INFO:teuthology.orchestra.run.smithi043.stdout: "q": 0, 2024-09-12T12:37:36.930 INFO:teuthology.orchestra.run.smithi043.stdout: "exported": 0, 2024-09-12T12:37:36.930 INFO:teuthology.orchestra.run.smithi043.stdout: "exported_inodes": 0, 2024-09-12T12:37:36.930 INFO:teuthology.orchestra.run.smithi043.stdout: "imported": 0, 2024-09-12T12:37:36.930 INFO:teuthology.orchestra.run.smithi043.stdout: "imported_inodes": 0, 2024-09-12T12:37:36.931 INFO:teuthology.orchestra.run.smithi043.stdout: "openino_dir_fetch": 0, 2024-09-12T12:37:36.931 INFO:teuthology.orchestra.run.smithi043.stdout: "openino_backtrace_fetch": 0, 2024-09-12T12:37:36.931 INFO:teuthology.orchestra.run.smithi043.stdout: "openino_peer_discover": 0, 2024-09-12T12:37:36.931 INFO:teuthology.orchestra.run.smithi043.stdout: "root_rfiles": 4, 2024-09-12T12:37:36.931 INFO:teuthology.orchestra.run.smithi043.stdout: "root_rbytes": 234, 2024-09-12T12:37:36.931 INFO:teuthology.orchestra.run.smithi043.stdout: "root_rsnaps": 0, 2024-09-12T12:37:36.931 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T12:37:36.931 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_set_tag": 0, 2024-09-12T12:37:36.931 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T12:37:36.931 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_inotable_repaired": 0, 2024-09-12T12:37:36.931 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_dir_inodes": 0, 2024-09-12T12:37:36.931 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T12:37:36.931 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T12:37:36.931 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_file_inodes": 0, 2024-09-12T12:37:36.932 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_inode_file_caps": 0, 2024-09-12T12:37:36.932 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T12:37:36.932 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_cap_op_grant": 0, 2024-09-12T12:37:36.932 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T12:37:36.932 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T12:37:36.932 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T12:37:36.932 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_client_caps": 0, 2024-09-12T12:37:36.932 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_client_caps_dirty": 0, 2024-09-12T12:37:36.932 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_client_cap_release": 0, 2024-09-12T12:37:36.932 INFO:teuthology.orchestra.run.smithi043.stdout: "process_request_cap_release": 0 2024-09-12T12:37:36.932 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.932 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cache": { 2024-09-12T12:37:36.933 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_update": 0, 2024-09-12T12:37:36.933 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_update_receipt": 0, 2024-09-12T12:37:36.933 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_try_discover": 0, 2024-09-12T12:37:36.933 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_send_discover": 0, 2024-09-12T12:37:36.933 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_handle_discover": 0, 2024-09-12T12:37:36.933 INFO:teuthology.orchestra.run.smithi043.stdout: "num_strays": 0, 2024-09-12T12:37:36.933 INFO:teuthology.orchestra.run.smithi043.stdout: "num_strays_delayed": 0, 2024-09-12T12:37:36.933 INFO:teuthology.orchestra.run.smithi043.stdout: "num_strays_enqueuing": 0, 2024-09-12T12:37:36.933 INFO:teuthology.orchestra.run.smithi043.stdout: "strays_created": 0, 2024-09-12T12:37:36.933 INFO:teuthology.orchestra.run.smithi043.stdout: "strays_enqueued": 0, 2024-09-12T12:37:36.933 INFO:teuthology.orchestra.run.smithi043.stdout: "strays_reintegrated": 0, 2024-09-12T12:37:36.934 INFO:teuthology.orchestra.run.smithi043.stdout: "strays_migrated": 0, 2024-09-12T12:37:36.934 INFO:teuthology.orchestra.run.smithi043.stdout: "num_recovering_processing": 0, 2024-09-12T12:37:36.934 INFO:teuthology.orchestra.run.smithi043.stdout: "num_recovering_enqueued": 0, 2024-09-12T12:37:36.934 INFO:teuthology.orchestra.run.smithi043.stdout: "num_recovering_prioritized": 0, 2024-09-12T12:37:36.934 INFO:teuthology.orchestra.run.smithi043.stdout: "recovery_started": 0, 2024-09-12T12:37:36.934 INFO:teuthology.orchestra.run.smithi043.stdout: "recovery_completed": 0, 2024-09-12T12:37:36.934 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_quiesce_path": 0, 2024-09-12T12:37:36.934 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_quiesce_inode": 0, 2024-09-12T12:37:36.934 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T12:37:36.934 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_exportdir": 0, 2024-09-12T12:37:36.934 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_flush": 0, 2024-09-12T12:37:36.934 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_fragmentdir": 0, 2024-09-12T12:37:36.934 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_fragstats": 0, 2024-09-12T12:37:36.934 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_inodestats": 0 2024-09-12T12:37:36.935 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.935 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_log": { 2024-09-12T12:37:36.935 INFO:teuthology.orchestra.run.smithi043.stdout: "evlrg": 0, 2024-09-12T12:37:36.935 INFO:teuthology.orchestra.run.smithi043.stdout: "evadd": 0, 2024-09-12T12:37:36.935 INFO:teuthology.orchestra.run.smithi043.stdout: "evex": 0, 2024-09-12T12:37:36.935 INFO:teuthology.orchestra.run.smithi043.stdout: "evtrm": 0, 2024-09-12T12:37:36.935 INFO:teuthology.orchestra.run.smithi043.stdout: "ev": 276, 2024-09-12T12:37:36.935 INFO:teuthology.orchestra.run.smithi043.stdout: "evexg": 0, 2024-09-12T12:37:36.935 INFO:teuthology.orchestra.run.smithi043.stdout: "evexd": 0, 2024-09-12T12:37:36.935 INFO:teuthology.orchestra.run.smithi043.stdout: "segadd": 0, 2024-09-12T12:37:36.935 INFO:teuthology.orchestra.run.smithi043.stdout: "segex": 0, 2024-09-12T12:37:36.935 INFO:teuthology.orchestra.run.smithi043.stdout: "segtrm": 0, 2024-09-12T12:37:36.935 INFO:teuthology.orchestra.run.smithi043.stdout: "seg": 2, 2024-09-12T12:37:36.935 INFO:teuthology.orchestra.run.smithi043.stdout: "segmjr": 2, 2024-09-12T12:37:36.936 INFO:teuthology.orchestra.run.smithi043.stdout: "segexg": 0, 2024-09-12T12:37:36.936 INFO:teuthology.orchestra.run.smithi043.stdout: "segexd": 0, 2024-09-12T12:37:36.936 INFO:teuthology.orchestra.run.smithi043.stdout: "expos": 4194304, 2024-09-12T12:37:36.936 INFO:teuthology.orchestra.run.smithi043.stdout: "wrpos": 4917200, 2024-09-12T12:37:36.936 INFO:teuthology.orchestra.run.smithi043.stdout: "rdpos": 4912563, 2024-09-12T12:37:36.936 INFO:teuthology.orchestra.run.smithi043.stdout: "jlat": { 2024-09-12T12:37:36.936 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:36.936 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:36.937 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:36.937 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.937 INFO:teuthology.orchestra.run.smithi043.stdout: "replayed": 276 2024-09-12T12:37:36.937 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.937 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_mem": { 2024-09-12T12:37:36.937 INFO:teuthology.orchestra.run.smithi043.stdout: "ino": 14, 2024-09-12T12:37:36.937 INFO:teuthology.orchestra.run.smithi043.stdout: "ino+": 36, 2024-09-12T12:37:36.937 INFO:teuthology.orchestra.run.smithi043.stdout: "ino-": 22, 2024-09-12T12:37:36.937 INFO:teuthology.orchestra.run.smithi043.stdout: "dir": 9, 2024-09-12T12:37:36.937 INFO:teuthology.orchestra.run.smithi043.stdout: "dir+": 13, 2024-09-12T12:37:36.937 INFO:teuthology.orchestra.run.smithi043.stdout: "dir-": 4, 2024-09-12T12:37:36.938 INFO:teuthology.orchestra.run.smithi043.stdout: "dn": 34, 2024-09-12T12:37:36.938 INFO:teuthology.orchestra.run.smithi043.stdout: "dn+": 55, 2024-09-12T12:37:36.938 INFO:teuthology.orchestra.run.smithi043.stdout: "dn-": 21, 2024-09-12T12:37:36.938 INFO:teuthology.orchestra.run.smithi043.stdout: "cap": 0, 2024-09-12T12:37:36.938 INFO:teuthology.orchestra.run.smithi043.stdout: "cap+": 0, 2024-09-12T12:37:36.938 INFO:teuthology.orchestra.run.smithi043.stdout: "cap-": 0, 2024-09-12T12:37:36.938 INFO:teuthology.orchestra.run.smithi043.stdout: "rss": 49532, 2024-09-12T12:37:36.938 INFO:teuthology.orchestra.run.smithi043.stdout: "heap": 215328 2024-09-12T12:37:36.938 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.938 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_server": { 2024-09-12T12:37:36.939 INFO:teuthology.orchestra.run.smithi043.stdout: "dispatch_client_request": 0, 2024-09-12T12:37:36.939 INFO:teuthology.orchestra.run.smithi043.stdout: "dispatch_server_request": 0, 2024-09-12T12:37:36.939 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_client_request": 0, 2024-09-12T12:37:36.939 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_client_session": 0, 2024-09-12T12:37:36.939 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_peer_request": 0, 2024-09-12T12:37:36.939 INFO:teuthology.orchestra.run.smithi043.stdout: "req_create_latency": { 2024-09-12T12:37:36.939 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:36.939 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:36.939 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:36.939 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.940 INFO:teuthology.orchestra.run.smithi043.stdout: "req_getattr_latency": { 2024-09-12T12:37:36.940 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:36.940 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:36.940 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:36.940 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.940 INFO:teuthology.orchestra.run.smithi043.stdout: "req_getfilelock_latency": { 2024-09-12T12:37:36.940 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:36.940 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:36.940 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:36.940 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.940 INFO:teuthology.orchestra.run.smithi043.stdout: "req_link_latency": { 2024-09-12T12:37:36.940 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:36.940 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:36.941 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:36.941 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.941 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookup_latency": { 2024-09-12T12:37:36.941 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:36.941 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:36.941 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:36.941 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.941 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookuphash_latency": { 2024-09-12T12:37:36.941 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:36.941 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:36.941 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:36.942 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.942 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookupino_latency": { 2024-09-12T12:37:36.942 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:36.942 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:36.942 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:36.942 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.942 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookupname_latency": { 2024-09-12T12:37:36.942 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:36.942 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:36.942 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:36.942 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.942 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookupparent_latency": { 2024-09-12T12:37:36.942 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:36.942 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:36.943 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:36.943 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.943 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookupsnap_latency": { 2024-09-12T12:37:36.943 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:36.943 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:36.943 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:36.943 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.943 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lssnap_latency": { 2024-09-12T12:37:36.943 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:36.943 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:36.943 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:36.943 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.943 INFO:teuthology.orchestra.run.smithi043.stdout: "req_mkdir_latency": { 2024-09-12T12:37:36.943 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:36.944 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:36.944 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:36.944 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.944 INFO:teuthology.orchestra.run.smithi043.stdout: "req_mknod_latency": { 2024-09-12T12:37:36.945 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:36.945 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:36.945 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:36.945 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.945 INFO:teuthology.orchestra.run.smithi043.stdout: "req_mksnap_latency": { 2024-09-12T12:37:36.945 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:36.945 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:36.945 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:36.945 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.945 INFO:teuthology.orchestra.run.smithi043.stdout: "req_open_latency": { 2024-09-12T12:37:36.945 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:36.946 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:36.946 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:36.946 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.946 INFO:teuthology.orchestra.run.smithi043.stdout: "req_readdir_latency": { 2024-09-12T12:37:36.946 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:36.946 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:36.947 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:36.947 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.947 INFO:teuthology.orchestra.run.smithi043.stdout: "req_rename_latency": { 2024-09-12T12:37:36.947 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:36.947 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:36.947 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:36.947 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.947 INFO:teuthology.orchestra.run.smithi043.stdout: "req_renamesnap_latency": { 2024-09-12T12:37:36.947 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:36.947 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:36.947 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:36.947 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.947 INFO:teuthology.orchestra.run.smithi043.stdout: "req_snapdiff_latency": { 2024-09-12T12:37:36.947 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:36.948 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:36.948 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:36.948 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.948 INFO:teuthology.orchestra.run.smithi043.stdout: "req_rmdir_latency": { 2024-09-12T12:37:36.948 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:36.948 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:36.948 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:36.948 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.948 INFO:teuthology.orchestra.run.smithi043.stdout: "req_rmsnap_latency": { 2024-09-12T12:37:36.948 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:36.948 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:36.948 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:36.949 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.949 INFO:teuthology.orchestra.run.smithi043.stdout: "req_rmxattr_latency": { 2024-09-12T12:37:36.949 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:36.949 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:36.949 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:36.949 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.949 INFO:teuthology.orchestra.run.smithi043.stdout: "req_setattr_latency": { 2024-09-12T12:37:36.949 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:36.949 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:36.949 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:36.950 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.950 INFO:teuthology.orchestra.run.smithi043.stdout: "req_setdirlayout_latency": { 2024-09-12T12:37:36.950 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:36.950 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:36.950 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:36.950 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.950 INFO:teuthology.orchestra.run.smithi043.stdout: "req_setfilelock_latency": { 2024-09-12T12:37:36.950 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:36.950 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:36.950 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:36.950 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.950 INFO:teuthology.orchestra.run.smithi043.stdout: "req_setlayout_latency": { 2024-09-12T12:37:36.950 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:36.951 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:36.951 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:36.951 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.951 INFO:teuthology.orchestra.run.smithi043.stdout: "req_setxattr_latency": { 2024-09-12T12:37:36.951 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:36.951 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:36.951 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:36.951 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.951 INFO:teuthology.orchestra.run.smithi043.stdout: "req_symlink_latency": { 2024-09-12T12:37:36.951 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:36.951 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:36.951 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:36.951 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.951 INFO:teuthology.orchestra.run.smithi043.stdout: "req_unlink_latency": { 2024-09-12T12:37:36.952 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:36.952 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:36.952 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:36.952 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.952 INFO:teuthology.orchestra.run.smithi043.stdout: "cap_revoke_eviction": 0, 2024-09-12T12:37:36.952 INFO:teuthology.orchestra.run.smithi043.stdout: "cap_acquisition_throttle": 0, 2024-09-12T12:37:36.952 INFO:teuthology.orchestra.run.smithi043.stdout: "req_getvxattr_latency": { 2024-09-12T12:37:36.952 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:36.952 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:36.952 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:36.952 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T12:37:36.952 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.952 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_sessions": { 2024-09-12T12:37:36.953 INFO:teuthology.orchestra.run.smithi043.stdout: "session_count": 1, 2024-09-12T12:37:36.953 INFO:teuthology.orchestra.run.smithi043.stdout: "session_add": 3, 2024-09-12T12:37:36.953 INFO:teuthology.orchestra.run.smithi043.stdout: "session_remove": 2, 2024-09-12T12:37:36.953 INFO:teuthology.orchestra.run.smithi043.stdout: "sessions_open": 1, 2024-09-12T12:37:36.953 INFO:teuthology.orchestra.run.smithi043.stdout: "sessions_stale": 0, 2024-09-12T12:37:36.953 INFO:teuthology.orchestra.run.smithi043.stdout: "total_load": 0, 2024-09-12T12:37:36.953 INFO:teuthology.orchestra.run.smithi043.stdout: "average_load": 0, 2024-09-12T12:37:36.953 INFO:teuthology.orchestra.run.smithi043.stdout: "avg_session_uptime": 1763, 2024-09-12T12:37:36.953 INFO:teuthology.orchestra.run.smithi043.stdout: "mdthresh_evicted": 0 2024-09-12T12:37:36.953 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.953 INFO:teuthology.orchestra.run.smithi043.stdout: "mempool": { 2024-09-12T12:37:36.953 INFO:teuthology.orchestra.run.smithi043.stdout: "bloom_filter_bytes": 0, 2024-09-12T12:37:36.953 INFO:teuthology.orchestra.run.smithi043.stdout: "bloom_filter_items": 0, 2024-09-12T12:37:36.954 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T12:37:36.954 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_alloc_items": 0, 2024-09-12T12:37:36.954 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T12:37:36.954 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_data_items": 0, 2024-09-12T12:37:36.954 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T12:37:36.954 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T12:37:36.954 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T12:37:36.954 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T12:37:36.954 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T12:37:36.954 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_other_items": 0, 2024-09-12T12:37:36.954 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T12:37:36.954 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T12:37:36.955 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_bytes": 0, 2024-09-12T12:37:36.955 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_items": 0, 2024-09-12T12:37:36.955 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_blob_bytes": 0, 2024-09-12T12:37:36.955 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_blob_items": 0, 2024-09-12T12:37:36.955 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T12:37:36.955 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T12:37:36.955 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T12:37:36.955 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T12:37:36.955 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T12:37:36.955 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_items": 0, 2024-09-12T12:37:36.955 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_txc_bytes": 0, 2024-09-12T12:37:36.955 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_txc_items": 0, 2024-09-12T12:37:36.955 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T12:37:36.955 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T12:37:36.956 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_bytes": 0, 2024-09-12T12:37:36.956 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_items": 0, 2024-09-12T12:37:36.956 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_bytes": 0, 2024-09-12T12:37:36.956 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_items": 0, 2024-09-12T12:37:36.956 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T12:37:36.956 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_reader_items": 0, 2024-09-12T12:37:36.956 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T12:37:36.956 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_writer_items": 0, 2024-09-12T12:37:36.956 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_anon_bytes": 189423, 2024-09-12T12:37:36.956 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_anon_items": 51, 2024-09-12T12:37:36.957 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_meta_bytes": 0, 2024-09-12T12:37:36.957 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_meta_items": 0, 2024-09-12T12:37:36.957 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_bytes": 0, 2024-09-12T12:37:36.957 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_items": 0, 2024-09-12T12:37:36.957 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mapbl_bytes": 0, 2024-09-12T12:37:36.957 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mapbl_items": 0, 2024-09-12T12:37:36.957 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pglog_bytes": 0, 2024-09-12T12:37:36.957 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pglog_items": 0, 2024-09-12T12:37:36.957 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_bytes": 8856, 2024-09-12T12:37:36.957 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_items": 166, 2024-09-12T12:37:36.957 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T12:37:36.957 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_mapping_items": 0, 2024-09-12T12:37:36.957 INFO:teuthology.orchestra.run.smithi043.stdout: "pgmap_bytes": 0, 2024-09-12T12:37:36.957 INFO:teuthology.orchestra.run.smithi043.stdout: "pgmap_items": 0, 2024-09-12T12:37:36.958 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_co_bytes": 66946, 2024-09-12T12:37:36.958 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_co_items": 329, 2024-09-12T12:37:36.958 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_1_bytes": 0, 2024-09-12T12:37:36.958 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_1_items": 0, 2024-09-12T12:37:36.958 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_2_bytes": 0, 2024-09-12T12:37:36.958 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_2_items": 0 2024-09-12T12:37:36.958 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.958 INFO:teuthology.orchestra.run.smithi043.stdout: "objecter": { 2024-09-12T12:37:36.958 INFO:teuthology.orchestra.run.smithi043.stdout: "op_active": 0, 2024-09-12T12:37:36.958 INFO:teuthology.orchestra.run.smithi043.stdout: "op_laggy": 0, 2024-09-12T12:37:36.958 INFO:teuthology.orchestra.run.smithi043.stdout: "op_send": 2422, 2024-09-12T12:37:36.958 INFO:teuthology.orchestra.run.smithi043.stdout: "op_send_bytes": 26, 2024-09-12T12:37:36.958 INFO:teuthology.orchestra.run.smithi043.stdout: "op_resend": 4, 2024-09-12T12:37:36.959 INFO:teuthology.orchestra.run.smithi043.stdout: "op_reply": 2422, 2024-09-12T12:37:36.959 INFO:teuthology.orchestra.run.smithi043.stdout: "op_latency": { 2024-09-12T12:37:36.959 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 2422, 2024-09-12T12:37:36.959 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 1.588980763, 2024-09-12T12:37:36.959 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000656061 2024-09-12T12:37:36.959 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.959 INFO:teuthology.orchestra.run.smithi043.stdout: "op_inflight": 0, 2024-09-12T12:37:36.959 INFO:teuthology.orchestra.run.smithi043.stdout: "oplen_avg": { 2024-09-12T12:37:36.959 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 2422, 2024-09-12T12:37:36.959 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 2423 2024-09-12T12:37:36.959 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.959 INFO:teuthology.orchestra.run.smithi043.stdout: "op": 2422, 2024-09-12T12:37:36.959 INFO:teuthology.orchestra.run.smithi043.stdout: "op_r": 2422, 2024-09-12T12:37:36.959 INFO:teuthology.orchestra.run.smithi043.stdout: "op_w": 0, 2024-09-12T12:37:36.960 INFO:teuthology.orchestra.run.smithi043.stdout: "op_rmw": 0, 2024-09-12T12:37:36.960 INFO:teuthology.orchestra.run.smithi043.stdout: "op_pg": 0, 2024-09-12T12:37:36.960 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_stat": 1574, 2024-09-12T12:37:36.960 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_create": 0, 2024-09-12T12:37:36.960 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_read": 845, 2024-09-12T12:37:36.960 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_write": 0, 2024-09-12T12:37:36.960 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_writefull": 0, 2024-09-12T12:37:36.960 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_writesame": 0, 2024-09-12T12:37:36.960 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_append": 0, 2024-09-12T12:37:36.960 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_zero": 0, 2024-09-12T12:37:36.960 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_truncate": 0, 2024-09-12T12:37:36.960 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_delete": 0, 2024-09-12T12:37:36.960 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_mapext": 0, 2024-09-12T12:37:36.961 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_sparse_read": 0, 2024-09-12T12:37:36.961 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_clonerange": 0, 2024-09-12T12:37:36.961 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_getxattr": 2, 2024-09-12T12:37:36.961 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_setxattr": 0, 2024-09-12T12:37:36.961 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_cmpxattr": 0, 2024-09-12T12:37:36.961 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_rmxattr": 0, 2024-09-12T12:37:36.961 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_resetxattrs": 0, 2024-09-12T12:37:36.961 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_call": 0, 2024-09-12T12:37:36.961 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_watch": 0, 2024-09-12T12:37:36.961 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_notify": 0, 2024-09-12T12:37:36.961 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T12:37:36.961 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_pgls": 0, 2024-09-12T12:37:36.961 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_pgls_filter": 0, 2024-09-12T12:37:36.961 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_other": 0, 2024-09-12T12:37:36.962 INFO:teuthology.orchestra.run.smithi043.stdout: "linger_active": 0, 2024-09-12T12:37:36.962 INFO:teuthology.orchestra.run.smithi043.stdout: "linger_send": 0, 2024-09-12T12:37:36.962 INFO:teuthology.orchestra.run.smithi043.stdout: "linger_resend": 0, 2024-09-12T12:37:36.962 INFO:teuthology.orchestra.run.smithi043.stdout: "linger_ping": 0, 2024-09-12T12:37:36.962 INFO:teuthology.orchestra.run.smithi043.stdout: "poolop_active": 0, 2024-09-12T12:37:36.962 INFO:teuthology.orchestra.run.smithi043.stdout: "poolop_send": 0, 2024-09-12T12:37:36.962 INFO:teuthology.orchestra.run.smithi043.stdout: "poolop_resend": 0, 2024-09-12T12:37:36.962 INFO:teuthology.orchestra.run.smithi043.stdout: "poolstat_active": 0, 2024-09-12T12:37:36.962 INFO:teuthology.orchestra.run.smithi043.stdout: "poolstat_send": 0, 2024-09-12T12:37:36.962 INFO:teuthology.orchestra.run.smithi043.stdout: "poolstat_resend": 0, 2024-09-12T12:37:36.962 INFO:teuthology.orchestra.run.smithi043.stdout: "statfs_active": 0, 2024-09-12T12:37:36.962 INFO:teuthology.orchestra.run.smithi043.stdout: "statfs_send": 0, 2024-09-12T12:37:36.962 INFO:teuthology.orchestra.run.smithi043.stdout: "statfs_resend": 0, 2024-09-12T12:37:36.963 INFO:teuthology.orchestra.run.smithi043.stdout: "command_active": 0, 2024-09-12T12:37:36.963 INFO:teuthology.orchestra.run.smithi043.stdout: "command_send": 0, 2024-09-12T12:37:36.963 INFO:teuthology.orchestra.run.smithi043.stdout: "command_resend": 0, 2024-09-12T12:37:36.963 INFO:teuthology.orchestra.run.smithi043.stdout: "map_epoch": 89, 2024-09-12T12:37:36.963 INFO:teuthology.orchestra.run.smithi043.stdout: "map_full": 0, 2024-09-12T12:37:36.963 INFO:teuthology.orchestra.run.smithi043.stdout: "map_inc": 4, 2024-09-12T12:37:36.963 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_sessions": 5, 2024-09-12T12:37:36.963 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_session_open": 5, 2024-09-12T12:37:36.963 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_session_close": 0, 2024-09-12T12:37:36.963 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_laggy": 0, 2024-09-12T12:37:36.963 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_wr": 0, 2024-09-12T12:37:36.963 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_rd": 2, 2024-09-12T12:37:36.963 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_del": 0 2024-09-12T12:37:36.963 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.964 INFO:teuthology.orchestra.run.smithi043.stdout: "oft": { 2024-09-12T12:37:36.964 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_total_objs": 0, 2024-09-12T12:37:36.964 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_total_kv_pairs": 0, 2024-09-12T12:37:36.964 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_total_updates": 0, 2024-09-12T12:37:36.964 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_total_removes": 0 2024-09-12T12:37:36.964 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.964 INFO:teuthology.orchestra.run.smithi043.stdout: "osd-slow-ops": { 2024-09-12T12:37:36.964 INFO:teuthology.orchestra.run.smithi043.stdout: "slow_ops_count": 0 2024-09-12T12:37:36.964 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.964 INFO:teuthology.orchestra.run.smithi043.stdout: "purge_queue": { 2024-09-12T12:37:36.964 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executing_ops": 0, 2024-09-12T12:37:36.964 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T12:37:36.964 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executing": 0, 2024-09-12T12:37:36.964 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executing_high_water": 0, 2024-09-12T12:37:36.965 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executed_ops": 0, 2024-09-12T12:37:36.965 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executed": 0, 2024-09-12T12:37:36.965 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_item_in_journal": 0 2024-09-12T12:37:36.965 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.965 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T12:37:36.965 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-09-12T12:37:36.965 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 104857600, 2024-09-12T12:37:36.965 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-09-12T12:37:36.965 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 2668, 2024-09-12T12:37:36.965 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 1670204, 2024-09-12T12:37:36.965 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-09-12T12:37:36.965 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 2668, 2024-09-12T12:37:36.965 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 0, 2024-09-12T12:37:36.965 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 0, 2024-09-12T12:37:36.966 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 2668, 2024-09-12T12:37:36.966 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 1670204, 2024-09-12T12:37:36.966 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-09-12T12:37:36.966 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:36.966 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:36.966 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:36.966 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T12:37:36.966 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.966 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-objecter_bytes": { 2024-09-12T12:37:36.966 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-09-12T12:37:36.966 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 104857600, 2024-09-12T12:37:36.966 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-09-12T12:37:36.966 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 0, 2024-09-12T12:37:36.966 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 0, 2024-09-12T12:37:36.967 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-09-12T12:37:36.967 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 0, 2024-09-12T12:37:36.967 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 2422, 2024-09-12T12:37:36.967 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 722906, 2024-09-12T12:37:36.967 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 2422, 2024-09-12T12:37:36.967 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 722906, 2024-09-12T12:37:36.967 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-09-12T12:37:36.967 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:36.967 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:36.967 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:36.967 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T12:37:36.967 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.967 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-objecter_ops": { 2024-09-12T12:37:36.967 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-09-12T12:37:36.968 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 1024, 2024-09-12T12:37:36.968 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-09-12T12:37:36.968 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 0, 2024-09-12T12:37:36.968 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 0, 2024-09-12T12:37:36.968 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-09-12T12:37:36.968 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 0, 2024-09-12T12:37:36.968 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 2422, 2024-09-12T12:37:36.968 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 2422, 2024-09-12T12:37:36.968 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 2422, 2024-09-12T12:37:36.968 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 2422, 2024-09-12T12:37:36.968 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-09-12T12:37:36.968 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:36.968 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:36.968 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:36.969 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T12:37:36.969 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.969 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-write_buf_throttle": { 2024-09-12T12:37:36.969 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-09-12T12:37:36.969 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 3758096384, 2024-09-12T12:37:36.969 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-09-12T12:37:36.969 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 0, 2024-09-12T12:37:36.969 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 0, 2024-09-12T12:37:36.969 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-09-12T12:37:36.969 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 0, 2024-09-12T12:37:36.969 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 0, 2024-09-12T12:37:36.969 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 0, 2024-09-12T12:37:36.969 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 0, 2024-09-12T12:37:36.969 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 0, 2024-09-12T12:37:36.970 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-09-12T12:37:36.970 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:36.970 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:36.970 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:36.970 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T12:37:36.970 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:36.970 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-write_buf_throttle-0x55b1e7aa6b40": { 2024-09-12T12:37:36.970 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-09-12T12:37:36.970 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 3758096384, 2024-09-12T12:37:36.970 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-09-12T12:37:36.970 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 0, 2024-09-12T12:37:36.970 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 0, 2024-09-12T12:37:36.970 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-09-12T12:37:36.970 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 0, 2024-09-12T12:37:36.970 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 0, 2024-09-12T12:37:36.971 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 0, 2024-09-12T12:37:36.971 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 0, 2024-09-12T12:37:36.971 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 0, 2024-09-12T12:37:36.971 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-09-12T12:37:36.971 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:36.971 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:36.971 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:36.971 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T12:37:36.971 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T12:37:36.971 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-12T12:37:37.709 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:37 smithi043 ceph-mon[34144]: pgmap v698: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 163 op/s 2024-09-12T12:37:37.738 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-09-12T12:37:37.738 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-09-12T12:37:37.738 DEBUG:tasks.check_counter:Getting stats from e 2024-09-12T12:37:37.738 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-12T12:37:37.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:37 smithi102 ceph-mon[34799]: pgmap v698: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 163 op/s 2024-09-12T12:37:37.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:37 smithi033 ceph-mon[31246]: pgmap v698: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 163 op/s 2024-09-12T12:37:38.000 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T12:37:38.528 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-12T12:37:38.528 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T12:37:38.528 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 4, 2024-09-12T12:37:38.528 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 4, 2024-09-12T12:37:38.528 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 2944, 2024-09-12T12:37:38.528 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 448, 2024-09-12T12:37:38.528 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 4, 2024-09-12T12:37:38.529 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 0, 2024-09-12T12:37:38.529 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 0.003254414, 2024-09-12T12:37:38.529 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.000039796, 2024-09-12T12:37:38.529 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.002291539, 2024-09-12T12:37:38.529 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T12:37:38.529 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:37:38.529 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 3, 2024-09-12T12:37:38.529 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.004155807, 2024-09-12T12:37:38.529 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.001385269 2024-09-12T12:37:38.529 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:38.529 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:37:38.529 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:38.529 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:38.530 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:38.530 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:38.530 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-12T12:37:38.530 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T12:37:38.530 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:38.530 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T12:37:38.530 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 1, 2024-09-12T12:37:38.530 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 176, 2024-09-12T12:37:38.530 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 160, 2024-09-12T12:37:38.530 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 109408, 2024-09-12T12:37:38.530 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 3, 2024-09-12T12:37:38.530 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 2, 2024-09-12T12:37:38.531 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 0.009736214, 2024-09-12T12:37:38.531 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.007020779, 2024-09-12T12:37:38.531 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.000893594, 2024-09-12T12:37:38.531 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T12:37:38.531 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:37:38.531 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 174, 2024-09-12T12:37:38.531 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.009819314, 2024-09-12T12:37:38.531 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000056432 2024-09-12T12:37:38.531 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:38.531 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:37:38.531 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:38.531 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:38.531 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:38.532 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:38.532 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T12:37:38.532 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 109408 2024-09-12T12:37:38.532 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:38.532 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T12:37:38.532 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 234, 2024-09-12T12:37:38.532 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 231, 2024-09-12T12:37:38.532 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 482272, 2024-09-12T12:37:38.532 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 142144, 2024-09-12T12:37:38.532 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 2, 2024-09-12T12:37:38.532 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 1, 2024-09-12T12:37:38.532 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 0.032119548, 2024-09-12T12:37:38.532 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.013955951, 2024-09-12T12:37:38.533 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.023049632, 2024-09-12T12:37:38.533 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T12:37:38.533 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:37:38.533 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 230, 2024-09-12T12:37:38.533 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.013353331, 2024-09-12T12:37:38.533 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000058057 2024-09-12T12:37:38.533 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:38.533 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:37:38.533 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:38.533 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:38.533 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:38.533 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:38.533 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 482272, 2024-09-12T12:37:38.533 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 142144 2024-09-12T12:37:38.534 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:38.534 INFO:teuthology.orchestra.run.smithi043.stdout: "cct": { 2024-09-12T12:37:38.534 INFO:teuthology.orchestra.run.smithi043.stdout: "total_workers": 0, 2024-09-12T12:37:38.534 INFO:teuthology.orchestra.run.smithi043.stdout: "unhealthy_workers": 0 2024-09-12T12:37:38.534 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:38.534 INFO:teuthology.orchestra.run.smithi043.stdout: "mempool": { 2024-09-12T12:37:38.534 INFO:teuthology.orchestra.run.smithi043.stdout: "bloom_filter_bytes": 0, 2024-09-12T12:37:38.534 INFO:teuthology.orchestra.run.smithi043.stdout: "bloom_filter_items": 0, 2024-09-12T12:37:38.534 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T12:37:38.534 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_alloc_items": 0, 2024-09-12T12:37:38.534 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T12:37:38.535 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_data_items": 0, 2024-09-12T12:37:38.535 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T12:37:38.535 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T12:37:38.535 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T12:37:38.535 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T12:37:38.535 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T12:37:38.535 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_other_items": 0, 2024-09-12T12:37:38.535 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T12:37:38.535 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T12:37:38.535 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_bytes": 0, 2024-09-12T12:37:38.535 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_items": 0, 2024-09-12T12:37:38.535 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_blob_bytes": 0, 2024-09-12T12:37:38.535 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_blob_items": 0, 2024-09-12T12:37:38.536 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T12:37:38.536 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T12:37:38.536 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T12:37:38.536 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T12:37:38.536 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T12:37:38.536 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_items": 0, 2024-09-12T12:37:38.536 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_txc_bytes": 0, 2024-09-12T12:37:38.536 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_txc_items": 0, 2024-09-12T12:37:38.536 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T12:37:38.536 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T12:37:38.536 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_bytes": 0, 2024-09-12T12:37:38.536 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_items": 0, 2024-09-12T12:37:38.537 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_bytes": 0, 2024-09-12T12:37:38.537 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_items": 0, 2024-09-12T12:37:38.537 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T12:37:38.537 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_reader_items": 0, 2024-09-12T12:37:38.537 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T12:37:38.537 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_writer_items": 0, 2024-09-12T12:37:38.537 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_anon_bytes": 148967, 2024-09-12T12:37:38.537 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_anon_items": 29, 2024-09-12T12:37:38.537 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_meta_bytes": 0, 2024-09-12T12:37:38.537 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_meta_items": 0, 2024-09-12T12:37:38.537 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_bytes": 0, 2024-09-12T12:37:38.537 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_items": 0, 2024-09-12T12:37:38.537 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mapbl_bytes": 0, 2024-09-12T12:37:38.538 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mapbl_items": 0, 2024-09-12T12:37:38.538 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pglog_bytes": 0, 2024-09-12T12:37:38.538 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pglog_items": 0, 2024-09-12T12:37:38.538 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_bytes": 0, 2024-09-12T12:37:38.538 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_items": 0, 2024-09-12T12:37:38.538 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T12:37:38.538 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_mapping_items": 0, 2024-09-12T12:37:38.538 INFO:teuthology.orchestra.run.smithi043.stdout: "pgmap_bytes": 0, 2024-09-12T12:37:38.538 INFO:teuthology.orchestra.run.smithi043.stdout: "pgmap_items": 0, 2024-09-12T12:37:38.538 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_co_bytes": 928, 2024-09-12T12:37:38.538 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_co_items": 2, 2024-09-12T12:37:38.538 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_1_bytes": 0, 2024-09-12T12:37:38.538 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_1_items": 0, 2024-09-12T12:37:38.539 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_2_bytes": 0, 2024-09-12T12:37:38.539 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_2_items": 0 2024-09-12T12:37:38.539 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:38.539 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T12:37:38.539 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-09-12T12:37:38.539 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 104857600, 2024-09-12T12:37:38.539 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-09-12T12:37:38.539 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 235, 2024-09-12T12:37:38.539 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 449200, 2024-09-12T12:37:38.539 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-09-12T12:37:38.539 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 235, 2024-09-12T12:37:38.539 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 0, 2024-09-12T12:37:38.539 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 0, 2024-09-12T12:37:38.539 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 235, 2024-09-12T12:37:38.540 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 449200, 2024-09-12T12:37:38.540 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-09-12T12:37:38.540 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:38.540 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:38.540 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:38.540 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T12:37:38.540 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T12:37:38.540 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-12T12:37:39.281 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.e 2024-09-12T12:37:39.281 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.e 2024-09-12T12:37:39.281 DEBUG:tasks.check_counter:Getting stats from h 2024-09-12T12:37:39.281 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-12T12:37:39.540 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T12:37:39.782 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:39 smithi033 ceph-mon[31246]: pgmap v699: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 164 op/s 2024-09-12T12:37:39.787 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:39 smithi043 ceph-mon[34144]: pgmap v699: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 164 op/s 2024-09-12T12:37:39.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:39 smithi102 ceph-mon[34799]: pgmap v699: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 164 op/s 2024-09-12T12:37:40.035 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-12T12:37:40.035 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T12:37:40.035 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 2294, 2024-09-12T12:37:40.035 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 2295, 2024-09-12T12:37:40.036 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 672130, 2024-09-12T12:37:40.036 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 729181, 2024-09-12T12:37:40.036 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 6, 2024-09-12T12:37:40.036 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 2, 2024-09-12T12:37:40.036 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 0.161266106, 2024-09-12T12:37:40.036 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.047629417, 2024-09-12T12:37:40.036 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.042306529, 2024-09-12T12:37:40.036 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.059391552, 2024-09-12T12:37:40.036 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:37:40.036 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 2293, 2024-09-12T12:37:40.036 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.081354312, 2024-09-12T12:37:40.037 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000035479 2024-09-12T12:37:40.037 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.037 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:37:40.037 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:40.037 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:40.037 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:40.037 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.037 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T12:37:40.037 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T12:37:40.037 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.037 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T12:37:40.037 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 252, 2024-09-12T12:37:40.038 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 242, 2024-09-12T12:37:40.038 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 522876, 2024-09-12T12:37:40.038 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 143546, 2024-09-12T12:37:40.038 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 3, 2024-09-12T12:37:40.038 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 2, 2024-09-12T12:37:40.038 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 0.033838995, 2024-09-12T12:37:40.038 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.014102650, 2024-09-12T12:37:40.038 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.024327819, 2024-09-12T12:37:40.038 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.000064131, 2024-09-12T12:37:40.038 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:37:40.039 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 242, 2024-09-12T12:37:40.039 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.017983068, 2024-09-12T12:37:40.039 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000074310 2024-09-12T12:37:40.039 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.039 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:37:40.039 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:40.039 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:40.039 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:40.039 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.039 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 522320, 2024-09-12T12:37:40.039 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 142848 2024-09-12T12:37:40.039 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.040 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T12:37:40.040 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 2, 2024-09-12T12:37:40.040 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 175, 2024-09-12T12:37:40.040 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 428, 2024-09-12T12:37:40.040 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 373982, 2024-09-12T12:37:40.040 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 4, 2024-09-12T12:37:40.040 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 3, 2024-09-12T12:37:40.040 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 0.010259902, 2024-09-12T12:37:40.040 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.007275781, 2024-09-12T12:37:40.041 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.001398854, 2024-09-12T12:37:40.041 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.000027747, 2024-09-12T12:37:40.041 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:37:40.041 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 173, 2024-09-12T12:37:40.041 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.010331595, 2024-09-12T12:37:40.041 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000059720 2024-09-12T12:37:40.041 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.041 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:37:40.042 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:40.042 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:40.042 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:40.042 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.042 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T12:37:40.042 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 373664 2024-09-12T12:37:40.042 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.042 INFO:teuthology.orchestra.run.smithi043.stdout: "cct": { 2024-09-12T12:37:40.043 INFO:teuthology.orchestra.run.smithi043.stdout: "total_workers": 1, 2024-09-12T12:37:40.044 INFO:teuthology.orchestra.run.smithi043.stdout: "unhealthy_workers": 0 2024-09-12T12:37:40.044 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.044 INFO:teuthology.orchestra.run.smithi043.stdout: "finisher-MDSRank": { 2024-09-12T12:37:40.044 INFO:teuthology.orchestra.run.smithi043.stdout: "queue_len": 0, 2024-09-12T12:37:40.044 INFO:teuthology.orchestra.run.smithi043.stdout: "complete_latency": { 2024-09-12T12:37:40.044 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 3849, 2024-09-12T12:37:40.044 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.087160896, 2024-09-12T12:37:40.044 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000022645 2024-09-12T12:37:40.045 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T12:37:40.045 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.045 INFO:teuthology.orchestra.run.smithi043.stdout: "finisher-PurgeQueue": { 2024-09-12T12:37:40.045 INFO:teuthology.orchestra.run.smithi043.stdout: "queue_len": 0, 2024-09-12T12:37:40.045 INFO:teuthology.orchestra.run.smithi043.stdout: "complete_latency": { 2024-09-12T12:37:40.045 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:40.045 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:40.045 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:40.045 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T12:37:40.045 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.045 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": { 2024-09-12T12:37:40.045 INFO:teuthology.orchestra.run.smithi043.stdout: "request": 0, 2024-09-12T12:37:40.046 INFO:teuthology.orchestra.run.smithi043.stdout: "reply": 0, 2024-09-12T12:37:40.046 INFO:teuthology.orchestra.run.smithi043.stdout: "reply_latency": { 2024-09-12T12:37:40.046 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:40.046 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:40.046 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:40.046 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.046 INFO:teuthology.orchestra.run.smithi043.stdout: "slow_reply": 0, 2024-09-12T12:37:40.046 INFO:teuthology.orchestra.run.smithi043.stdout: "forward": 0, 2024-09-12T12:37:40.046 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_fetch_complete": 0, 2024-09-12T12:37:40.047 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_fetch_keys": 0, 2024-09-12T12:37:40.047 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_commit": 0, 2024-09-12T12:37:40.047 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_split": 0, 2024-09-12T12:37:40.047 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_merge": 0, 2024-09-12T12:37:40.047 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes": 3, 2024-09-12T12:37:40.047 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_top": 0, 2024-09-12T12:37:40.047 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_bottom": 3, 2024-09-12T12:37:40.047 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_pin_tail": 0, 2024-09-12T12:37:40.047 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_pinned": 3, 2024-09-12T12:37:40.047 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_expired": 0, 2024-09-12T12:37:40.047 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_with_caps": 0, 2024-09-12T12:37:40.047 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": 0, 2024-09-12T12:37:40.048 INFO:teuthology.orchestra.run.smithi043.stdout: "subtrees": 1, 2024-09-12T12:37:40.048 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse": 0, 2024-09-12T12:37:40.048 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_hit": 0, 2024-09-12T12:37:40.048 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_forward": 0, 2024-09-12T12:37:40.048 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_discover": 0, 2024-09-12T12:37:40.048 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_dir_fetch": 0, 2024-09-12T12:37:40.048 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_remote_ino": 0, 2024-09-12T12:37:40.048 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_lock": 0, 2024-09-12T12:37:40.048 INFO:teuthology.orchestra.run.smithi043.stdout: "load_cent": 0, 2024-09-12T12:37:40.048 INFO:teuthology.orchestra.run.smithi043.stdout: "q": 0, 2024-09-12T12:37:40.048 INFO:teuthology.orchestra.run.smithi043.stdout: "exported": 0, 2024-09-12T12:37:40.048 INFO:teuthology.orchestra.run.smithi043.stdout: "exported_inodes": 0, 2024-09-12T12:37:40.048 INFO:teuthology.orchestra.run.smithi043.stdout: "imported": 0, 2024-09-12T12:37:40.049 INFO:teuthology.orchestra.run.smithi043.stdout: "imported_inodes": 0, 2024-09-12T12:37:40.049 INFO:teuthology.orchestra.run.smithi043.stdout: "openino_dir_fetch": 0, 2024-09-12T12:37:40.049 INFO:teuthology.orchestra.run.smithi043.stdout: "openino_backtrace_fetch": 0, 2024-09-12T12:37:40.049 INFO:teuthology.orchestra.run.smithi043.stdout: "openino_peer_discover": 0, 2024-09-12T12:37:40.049 INFO:teuthology.orchestra.run.smithi043.stdout: "root_rfiles": 0, 2024-09-12T12:37:40.049 INFO:teuthology.orchestra.run.smithi043.stdout: "root_rbytes": 0, 2024-09-12T12:37:40.049 INFO:teuthology.orchestra.run.smithi043.stdout: "root_rsnaps": 0, 2024-09-12T12:37:40.049 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T12:37:40.049 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_set_tag": 0, 2024-09-12T12:37:40.049 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T12:37:40.049 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_inotable_repaired": 0, 2024-09-12T12:37:40.049 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_dir_inodes": 0, 2024-09-12T12:37:40.049 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T12:37:40.050 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T12:37:40.050 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_file_inodes": 0, 2024-09-12T12:37:40.050 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_inode_file_caps": 0, 2024-09-12T12:37:40.050 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T12:37:40.050 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_cap_op_grant": 0, 2024-09-12T12:37:40.050 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T12:37:40.050 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T12:37:40.050 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T12:37:40.050 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_client_caps": 0, 2024-09-12T12:37:40.050 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_client_caps_dirty": 0, 2024-09-12T12:37:40.050 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_client_cap_release": 0, 2024-09-12T12:37:40.050 INFO:teuthology.orchestra.run.smithi043.stdout: "process_request_cap_release": 0 2024-09-12T12:37:40.050 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.050 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cache": { 2024-09-12T12:37:40.051 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_update": 0, 2024-09-12T12:37:40.051 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_update_receipt": 0, 2024-09-12T12:37:40.051 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_try_discover": 0, 2024-09-12T12:37:40.051 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_send_discover": 0, 2024-09-12T12:37:40.051 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_handle_discover": 0, 2024-09-12T12:37:40.051 INFO:teuthology.orchestra.run.smithi043.stdout: "num_strays": 0, 2024-09-12T12:37:40.051 INFO:teuthology.orchestra.run.smithi043.stdout: "num_strays_delayed": 0, 2024-09-12T12:37:40.051 INFO:teuthology.orchestra.run.smithi043.stdout: "num_strays_enqueuing": 0, 2024-09-12T12:37:40.051 INFO:teuthology.orchestra.run.smithi043.stdout: "strays_created": 0, 2024-09-12T12:37:40.051 INFO:teuthology.orchestra.run.smithi043.stdout: "strays_enqueued": 0, 2024-09-12T12:37:40.051 INFO:teuthology.orchestra.run.smithi043.stdout: "strays_reintegrated": 0, 2024-09-12T12:37:40.051 INFO:teuthology.orchestra.run.smithi043.stdout: "strays_migrated": 0, 2024-09-12T12:37:40.051 INFO:teuthology.orchestra.run.smithi043.stdout: "num_recovering_processing": 0, 2024-09-12T12:37:40.052 INFO:teuthology.orchestra.run.smithi043.stdout: "num_recovering_enqueued": 0, 2024-09-12T12:37:40.052 INFO:teuthology.orchestra.run.smithi043.stdout: "num_recovering_prioritized": 0, 2024-09-12T12:37:40.052 INFO:teuthology.orchestra.run.smithi043.stdout: "recovery_started": 0, 2024-09-12T12:37:40.052 INFO:teuthology.orchestra.run.smithi043.stdout: "recovery_completed": 0, 2024-09-12T12:37:40.052 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_quiesce_path": 0, 2024-09-12T12:37:40.052 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_quiesce_inode": 0, 2024-09-12T12:37:40.052 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T12:37:40.052 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_exportdir": 0, 2024-09-12T12:37:40.052 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_flush": 0, 2024-09-12T12:37:40.052 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_fragmentdir": 0, 2024-09-12T12:37:40.052 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_fragstats": 0, 2024-09-12T12:37:40.052 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_inodestats": 0 2024-09-12T12:37:40.053 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.053 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_log": { 2024-09-12T12:37:40.053 INFO:teuthology.orchestra.run.smithi043.stdout: "evlrg": 0, 2024-09-12T12:37:40.053 INFO:teuthology.orchestra.run.smithi043.stdout: "evadd": 0, 2024-09-12T12:37:40.053 INFO:teuthology.orchestra.run.smithi043.stdout: "evex": 0, 2024-09-12T12:37:40.053 INFO:teuthology.orchestra.run.smithi043.stdout: "evtrm": 0, 2024-09-12T12:37:40.053 INFO:teuthology.orchestra.run.smithi043.stdout: "ev": 16, 2024-09-12T12:37:40.053 INFO:teuthology.orchestra.run.smithi043.stdout: "evexg": 0, 2024-09-12T12:37:40.053 INFO:teuthology.orchestra.run.smithi043.stdout: "evexd": 0, 2024-09-12T12:37:40.053 INFO:teuthology.orchestra.run.smithi043.stdout: "segadd": 0, 2024-09-12T12:37:40.053 INFO:teuthology.orchestra.run.smithi043.stdout: "segex": 0, 2024-09-12T12:37:40.053 INFO:teuthology.orchestra.run.smithi043.stdout: "segtrm": 0, 2024-09-12T12:37:40.053 INFO:teuthology.orchestra.run.smithi043.stdout: "seg": 2, 2024-09-12T12:37:40.054 INFO:teuthology.orchestra.run.smithi043.stdout: "segmjr": 2, 2024-09-12T12:37:40.054 INFO:teuthology.orchestra.run.smithi043.stdout: "segexg": 0, 2024-09-12T12:37:40.054 INFO:teuthology.orchestra.run.smithi043.stdout: "segexd": 0, 2024-09-12T12:37:40.054 INFO:teuthology.orchestra.run.smithi043.stdout: "expos": 4194304, 2024-09-12T12:37:40.054 INFO:teuthology.orchestra.run.smithi043.stdout: "wrpos": 4217551, 2024-09-12T12:37:40.054 INFO:teuthology.orchestra.run.smithi043.stdout: "rdpos": 4215900, 2024-09-12T12:37:40.054 INFO:teuthology.orchestra.run.smithi043.stdout: "jlat": { 2024-09-12T12:37:40.054 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:40.054 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:40.054 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:40.054 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.054 INFO:teuthology.orchestra.run.smithi043.stdout: "replayed": 16 2024-09-12T12:37:40.054 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.054 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_mem": { 2024-09-12T12:37:40.055 INFO:teuthology.orchestra.run.smithi043.stdout: "ino": 4, 2024-09-12T12:37:40.055 INFO:teuthology.orchestra.run.smithi043.stdout: "ino+": 16, 2024-09-12T12:37:40.055 INFO:teuthology.orchestra.run.smithi043.stdout: "ino-": 12, 2024-09-12T12:37:40.055 INFO:teuthology.orchestra.run.smithi043.stdout: "dir": 2, 2024-09-12T12:37:40.055 INFO:teuthology.orchestra.run.smithi043.stdout: "dir+": 13, 2024-09-12T12:37:40.055 INFO:teuthology.orchestra.run.smithi043.stdout: "dir-": 11, 2024-09-12T12:37:40.055 INFO:teuthology.orchestra.run.smithi043.stdout: "dn": 3, 2024-09-12T12:37:40.055 INFO:teuthology.orchestra.run.smithi043.stdout: "dn+": 15, 2024-09-12T12:37:40.055 INFO:teuthology.orchestra.run.smithi043.stdout: "dn-": 12, 2024-09-12T12:37:40.055 INFO:teuthology.orchestra.run.smithi043.stdout: "cap": 0, 2024-09-12T12:37:40.056 INFO:teuthology.orchestra.run.smithi043.stdout: "cap+": 0, 2024-09-12T12:37:40.056 INFO:teuthology.orchestra.run.smithi043.stdout: "cap-": 0, 2024-09-12T12:37:40.056 INFO:teuthology.orchestra.run.smithi043.stdout: "rss": 48332, 2024-09-12T12:37:40.056 INFO:teuthology.orchestra.run.smithi043.stdout: "heap": 215328 2024-09-12T12:37:40.056 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.056 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_server": { 2024-09-12T12:37:40.056 INFO:teuthology.orchestra.run.smithi043.stdout: "dispatch_client_request": 0, 2024-09-12T12:37:40.056 INFO:teuthology.orchestra.run.smithi043.stdout: "dispatch_server_request": 0, 2024-09-12T12:37:40.056 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_client_request": 0, 2024-09-12T12:37:40.056 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_client_session": 0, 2024-09-12T12:37:40.056 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_peer_request": 0, 2024-09-12T12:37:40.056 INFO:teuthology.orchestra.run.smithi043.stdout: "req_create_latency": { 2024-09-12T12:37:40.056 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:40.057 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:40.057 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:40.057 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.057 INFO:teuthology.orchestra.run.smithi043.stdout: "req_getattr_latency": { 2024-09-12T12:37:40.057 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:40.057 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:40.057 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:40.057 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.057 INFO:teuthology.orchestra.run.smithi043.stdout: "req_getfilelock_latency": { 2024-09-12T12:37:40.057 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:40.057 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:40.057 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:40.057 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.057 INFO:teuthology.orchestra.run.smithi043.stdout: "req_link_latency": { 2024-09-12T12:37:40.057 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:40.058 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:40.058 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:40.058 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.058 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookup_latency": { 2024-09-12T12:37:40.058 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:40.058 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:40.058 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:40.058 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.058 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookuphash_latency": { 2024-09-12T12:37:40.058 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:40.058 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:40.058 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:40.058 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.059 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookupino_latency": { 2024-09-12T12:37:40.059 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:40.059 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:40.059 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:40.059 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.059 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookupname_latency": { 2024-09-12T12:37:40.059 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:40.059 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:40.059 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:40.059 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.060 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookupparent_latency": { 2024-09-12T12:37:40.060 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:40.060 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:40.060 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:40.060 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.060 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookupsnap_latency": { 2024-09-12T12:37:40.060 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:40.060 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:40.060 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:40.060 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.060 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lssnap_latency": { 2024-09-12T12:37:40.060 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:40.060 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:40.061 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:40.061 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.061 INFO:teuthology.orchestra.run.smithi043.stdout: "req_mkdir_latency": { 2024-09-12T12:37:40.061 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:40.061 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:40.061 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:40.062 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.062 INFO:teuthology.orchestra.run.smithi043.stdout: "req_mknod_latency": { 2024-09-12T12:37:40.062 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:40.062 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:40.062 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:40.062 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.062 INFO:teuthology.orchestra.run.smithi043.stdout: "req_mksnap_latency": { 2024-09-12T12:37:40.062 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:40.062 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:40.062 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:40.062 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.062 INFO:teuthology.orchestra.run.smithi043.stdout: "req_open_latency": { 2024-09-12T12:37:40.062 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:40.062 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:40.063 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:40.063 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.063 INFO:teuthology.orchestra.run.smithi043.stdout: "req_readdir_latency": { 2024-09-12T12:37:40.063 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:40.063 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:40.063 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:40.063 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.063 INFO:teuthology.orchestra.run.smithi043.stdout: "req_rename_latency": { 2024-09-12T12:37:40.063 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:40.063 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:40.063 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:40.063 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.064 INFO:teuthology.orchestra.run.smithi043.stdout: "req_renamesnap_latency": { 2024-09-12T12:37:40.064 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:40.064 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:40.064 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:40.064 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.064 INFO:teuthology.orchestra.run.smithi043.stdout: "req_snapdiff_latency": { 2024-09-12T12:37:40.064 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:40.064 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:40.064 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:40.064 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.065 INFO:teuthology.orchestra.run.smithi043.stdout: "req_rmdir_latency": { 2024-09-12T12:37:40.065 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:40.065 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:40.065 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:40.065 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.065 INFO:teuthology.orchestra.run.smithi043.stdout: "req_rmsnap_latency": { 2024-09-12T12:37:40.065 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:40.065 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:40.065 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:40.065 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.065 INFO:teuthology.orchestra.run.smithi043.stdout: "req_rmxattr_latency": { 2024-09-12T12:37:40.065 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:40.066 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:40.066 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:40.066 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.066 INFO:teuthology.orchestra.run.smithi043.stdout: "req_setattr_latency": { 2024-09-12T12:37:40.066 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:40.066 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:40.066 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:40.066 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.066 INFO:teuthology.orchestra.run.smithi043.stdout: "req_setdirlayout_latency": { 2024-09-12T12:37:40.066 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:40.066 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:40.067 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:40.067 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.067 INFO:teuthology.orchestra.run.smithi043.stdout: "req_setfilelock_latency": { 2024-09-12T12:37:40.067 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:40.067 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:40.067 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:40.067 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.067 INFO:teuthology.orchestra.run.smithi043.stdout: "req_setlayout_latency": { 2024-09-12T12:37:40.067 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:40.067 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:40.067 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:40.067 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.067 INFO:teuthology.orchestra.run.smithi043.stdout: "req_setxattr_latency": { 2024-09-12T12:37:40.067 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:40.068 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:40.068 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:40.068 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.068 INFO:teuthology.orchestra.run.smithi043.stdout: "req_symlink_latency": { 2024-09-12T12:37:40.068 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:40.068 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:40.068 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:40.068 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.068 INFO:teuthology.orchestra.run.smithi043.stdout: "req_unlink_latency": { 2024-09-12T12:37:40.068 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:40.068 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:40.068 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:40.068 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.068 INFO:teuthology.orchestra.run.smithi043.stdout: "cap_revoke_eviction": 0, 2024-09-12T12:37:40.069 INFO:teuthology.orchestra.run.smithi043.stdout: "cap_acquisition_throttle": 0, 2024-09-12T12:37:40.069 INFO:teuthology.orchestra.run.smithi043.stdout: "req_getvxattr_latency": { 2024-09-12T12:37:40.069 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:40.069 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:40.069 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:40.069 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T12:37:40.069 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.069 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_sessions": { 2024-09-12T12:37:40.069 INFO:teuthology.orchestra.run.smithi043.stdout: "session_count": 1, 2024-09-12T12:37:40.069 INFO:teuthology.orchestra.run.smithi043.stdout: "session_add": 2, 2024-09-12T12:37:40.069 INFO:teuthology.orchestra.run.smithi043.stdout: "session_remove": 1, 2024-09-12T12:37:40.069 INFO:teuthology.orchestra.run.smithi043.stdout: "sessions_open": 1, 2024-09-12T12:37:40.070 INFO:teuthology.orchestra.run.smithi043.stdout: "sessions_stale": 0, 2024-09-12T12:37:40.070 INFO:teuthology.orchestra.run.smithi043.stdout: "total_load": 0, 2024-09-12T12:37:40.070 INFO:teuthology.orchestra.run.smithi043.stdout: "average_load": 0, 2024-09-12T12:37:40.071 INFO:teuthology.orchestra.run.smithi043.stdout: "avg_session_uptime": 1767, 2024-09-12T12:37:40.071 INFO:teuthology.orchestra.run.smithi043.stdout: "mdthresh_evicted": 0 2024-09-12T12:37:40.071 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.071 INFO:teuthology.orchestra.run.smithi043.stdout: "mempool": { 2024-09-12T12:37:40.071 INFO:teuthology.orchestra.run.smithi043.stdout: "bloom_filter_bytes": 0, 2024-09-12T12:37:40.071 INFO:teuthology.orchestra.run.smithi043.stdout: "bloom_filter_items": 0, 2024-09-12T12:37:40.071 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T12:37:40.071 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_alloc_items": 0, 2024-09-12T12:37:40.072 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T12:37:40.072 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_data_items": 0, 2024-09-12T12:37:40.072 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T12:37:40.072 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T12:37:40.072 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T12:37:40.072 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T12:37:40.072 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T12:37:40.072 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_other_items": 0, 2024-09-12T12:37:40.072 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T12:37:40.072 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T12:37:40.073 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_bytes": 0, 2024-09-12T12:37:40.073 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_items": 0, 2024-09-12T12:37:40.073 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_blob_bytes": 0, 2024-09-12T12:37:40.073 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_blob_items": 0, 2024-09-12T12:37:40.073 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T12:37:40.073 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T12:37:40.073 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T12:37:40.073 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T12:37:40.073 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T12:37:40.073 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_items": 0, 2024-09-12T12:37:40.073 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_txc_bytes": 0, 2024-09-12T12:37:40.073 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_txc_items": 0, 2024-09-12T12:37:40.073 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T12:37:40.074 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T12:37:40.074 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_bytes": 0, 2024-09-12T12:37:40.074 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_items": 0, 2024-09-12T12:37:40.074 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_bytes": 0, 2024-09-12T12:37:40.074 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_items": 0, 2024-09-12T12:37:40.074 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T12:37:40.074 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_reader_items": 0, 2024-09-12T12:37:40.074 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T12:37:40.074 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_writer_items": 0, 2024-09-12T12:37:40.074 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_anon_bytes": 181383, 2024-09-12T12:37:40.074 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_anon_items": 48, 2024-09-12T12:37:40.074 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_meta_bytes": 0, 2024-09-12T12:37:40.074 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_meta_items": 0, 2024-09-12T12:37:40.074 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_bytes": 0, 2024-09-12T12:37:40.075 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_items": 0, 2024-09-12T12:37:40.075 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mapbl_bytes": 0, 2024-09-12T12:37:40.075 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mapbl_items": 0, 2024-09-12T12:37:40.075 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pglog_bytes": 0, 2024-09-12T12:37:40.075 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pglog_items": 0, 2024-09-12T12:37:40.075 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_bytes": 8856, 2024-09-12T12:37:40.075 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_items": 166, 2024-09-12T12:37:40.075 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T12:37:40.075 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_mapping_items": 0, 2024-09-12T12:37:40.075 INFO:teuthology.orchestra.run.smithi043.stdout: "pgmap_bytes": 0, 2024-09-12T12:37:40.075 INFO:teuthology.orchestra.run.smithi043.stdout: "pgmap_items": 0, 2024-09-12T12:37:40.075 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_co_bytes": 14160, 2024-09-12T12:37:40.075 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_co_items": 40, 2024-09-12T12:37:40.076 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_1_bytes": 0, 2024-09-12T12:37:40.076 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_1_items": 0, 2024-09-12T12:37:40.076 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_2_bytes": 0, 2024-09-12T12:37:40.076 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_2_items": 0 2024-09-12T12:37:40.076 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.076 INFO:teuthology.orchestra.run.smithi043.stdout: "objecter": { 2024-09-12T12:37:40.076 INFO:teuthology.orchestra.run.smithi043.stdout: "op_active": 0, 2024-09-12T12:37:40.076 INFO:teuthology.orchestra.run.smithi043.stdout: "op_laggy": 0, 2024-09-12T12:37:40.076 INFO:teuthology.orchestra.run.smithi043.stdout: "op_send": 2296, 2024-09-12T12:37:40.076 INFO:teuthology.orchestra.run.smithi043.stdout: "op_send_bytes": 21, 2024-09-12T12:37:40.076 INFO:teuthology.orchestra.run.smithi043.stdout: "op_resend": 3, 2024-09-12T12:37:40.076 INFO:teuthology.orchestra.run.smithi043.stdout: "op_reply": 2296, 2024-09-12T12:37:40.077 INFO:teuthology.orchestra.run.smithi043.stdout: "op_latency": { 2024-09-12T12:37:40.077 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 2296, 2024-09-12T12:37:40.077 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 1.825977931, 2024-09-12T12:37:40.077 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000795286 2024-09-12T12:37:40.077 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.077 INFO:teuthology.orchestra.run.smithi043.stdout: "op_inflight": 0, 2024-09-12T12:37:40.077 INFO:teuthology.orchestra.run.smithi043.stdout: "oplen_avg": { 2024-09-12T12:37:40.077 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 2296, 2024-09-12T12:37:40.077 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 2297 2024-09-12T12:37:40.077 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.077 INFO:teuthology.orchestra.run.smithi043.stdout: "op": 2296, 2024-09-12T12:37:40.077 INFO:teuthology.orchestra.run.smithi043.stdout: "op_r": 2296, 2024-09-12T12:37:40.077 INFO:teuthology.orchestra.run.smithi043.stdout: "op_w": 0, 2024-09-12T12:37:40.077 INFO:teuthology.orchestra.run.smithi043.stdout: "op_rmw": 0, 2024-09-12T12:37:40.078 INFO:teuthology.orchestra.run.smithi043.stdout: "op_pg": 0, 2024-09-12T12:37:40.078 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_stat": 1491, 2024-09-12T12:37:40.078 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_create": 0, 2024-09-12T12:37:40.078 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_read": 803, 2024-09-12T12:37:40.078 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_write": 0, 2024-09-12T12:37:40.078 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_writefull": 0, 2024-09-12T12:37:40.078 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_writesame": 0, 2024-09-12T12:37:40.078 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_append": 0, 2024-09-12T12:37:40.078 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_zero": 0, 2024-09-12T12:37:40.078 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_truncate": 0, 2024-09-12T12:37:40.078 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_delete": 0, 2024-09-12T12:37:40.078 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_mapext": 0, 2024-09-12T12:37:40.079 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_sparse_read": 0, 2024-09-12T12:37:40.079 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_clonerange": 0, 2024-09-12T12:37:40.079 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_getxattr": 1, 2024-09-12T12:37:40.079 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_setxattr": 0, 2024-09-12T12:37:40.079 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_cmpxattr": 0, 2024-09-12T12:37:40.079 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_rmxattr": 0, 2024-09-12T12:37:40.079 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_resetxattrs": 0, 2024-09-12T12:37:40.079 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_call": 0, 2024-09-12T12:37:40.079 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_watch": 0, 2024-09-12T12:37:40.080 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_notify": 0, 2024-09-12T12:37:40.080 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T12:37:40.080 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_pgls": 0, 2024-09-12T12:37:40.080 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_pgls_filter": 0, 2024-09-12T12:37:40.080 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_other": 0, 2024-09-12T12:37:40.080 INFO:teuthology.orchestra.run.smithi043.stdout: "linger_active": 0, 2024-09-12T12:37:40.080 INFO:teuthology.orchestra.run.smithi043.stdout: "linger_send": 0, 2024-09-12T12:37:40.080 INFO:teuthology.orchestra.run.smithi043.stdout: "linger_resend": 0, 2024-09-12T12:37:40.080 INFO:teuthology.orchestra.run.smithi043.stdout: "linger_ping": 0, 2024-09-12T12:37:40.081 INFO:teuthology.orchestra.run.smithi043.stdout: "poolop_active": 0, 2024-09-12T12:37:40.081 INFO:teuthology.orchestra.run.smithi043.stdout: "poolop_send": 0, 2024-09-12T12:37:40.081 INFO:teuthology.orchestra.run.smithi043.stdout: "poolop_resend": 0, 2024-09-12T12:37:40.081 INFO:teuthology.orchestra.run.smithi043.stdout: "poolstat_active": 0, 2024-09-12T12:37:40.081 INFO:teuthology.orchestra.run.smithi043.stdout: "poolstat_send": 0, 2024-09-12T12:37:40.081 INFO:teuthology.orchestra.run.smithi043.stdout: "poolstat_resend": 0, 2024-09-12T12:37:40.081 INFO:teuthology.orchestra.run.smithi043.stdout: "statfs_active": 0, 2024-09-12T12:37:40.081 INFO:teuthology.orchestra.run.smithi043.stdout: "statfs_send": 0, 2024-09-12T12:37:40.082 INFO:teuthology.orchestra.run.smithi043.stdout: "statfs_resend": 0, 2024-09-12T12:37:40.082 INFO:teuthology.orchestra.run.smithi043.stdout: "command_active": 0, 2024-09-12T12:37:40.082 INFO:teuthology.orchestra.run.smithi043.stdout: "command_send": 0, 2024-09-12T12:37:40.082 INFO:teuthology.orchestra.run.smithi043.stdout: "command_resend": 0, 2024-09-12T12:37:40.082 INFO:teuthology.orchestra.run.smithi043.stdout: "map_epoch": 89, 2024-09-12T12:37:40.082 INFO:teuthology.orchestra.run.smithi043.stdout: "map_full": 0, 2024-09-12T12:37:40.082 INFO:teuthology.orchestra.run.smithi043.stdout: "map_inc": 4, 2024-09-12T12:37:40.082 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_sessions": 4, 2024-09-12T12:37:40.082 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_session_open": 4, 2024-09-12T12:37:40.082 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_session_close": 0, 2024-09-12T12:37:40.082 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_laggy": 0, 2024-09-12T12:37:40.082 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_wr": 0, 2024-09-12T12:37:40.082 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_rd": 2, 2024-09-12T12:37:40.083 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_del": 0 2024-09-12T12:37:40.083 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.083 INFO:teuthology.orchestra.run.smithi043.stdout: "oft": { 2024-09-12T12:37:40.083 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_total_objs": 0, 2024-09-12T12:37:40.083 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_total_kv_pairs": 0, 2024-09-12T12:37:40.083 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_total_updates": 0, 2024-09-12T12:37:40.083 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_total_removes": 0 2024-09-12T12:37:40.083 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.083 INFO:teuthology.orchestra.run.smithi043.stdout: "osd-slow-ops": { 2024-09-12T12:37:40.083 INFO:teuthology.orchestra.run.smithi043.stdout: "slow_ops_count": 0 2024-09-12T12:37:40.083 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.083 INFO:teuthology.orchestra.run.smithi043.stdout: "purge_queue": { 2024-09-12T12:37:40.083 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executing_ops": 0, 2024-09-12T12:37:40.084 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T12:37:40.084 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executing": 0, 2024-09-12T12:37:40.084 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executing_high_water": 0, 2024-09-12T12:37:40.084 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executed_ops": 0, 2024-09-12T12:37:40.084 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executed": 0, 2024-09-12T12:37:40.084 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_item_in_journal": 0 2024-09-12T12:37:40.084 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.084 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T12:37:40.084 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-09-12T12:37:40.084 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 104857600, 2024-09-12T12:37:40.084 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-09-12T12:37:40.084 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 2544, 2024-09-12T12:37:40.084 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 950928, 2024-09-12T12:37:40.085 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-09-12T12:37:40.085 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 2544, 2024-09-12T12:37:40.085 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 0, 2024-09-12T12:37:40.085 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 0, 2024-09-12T12:37:40.085 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 2544, 2024-09-12T12:37:40.085 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 950928, 2024-09-12T12:37:40.085 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-09-12T12:37:40.085 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:40.085 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:40.085 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:40.085 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T12:37:40.085 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.085 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-objecter_bytes": { 2024-09-12T12:37:40.086 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-09-12T12:37:40.086 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 104857600, 2024-09-12T12:37:40.086 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-09-12T12:37:40.086 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 0, 2024-09-12T12:37:40.086 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 0, 2024-09-12T12:37:40.086 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-09-12T12:37:40.086 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 0, 2024-09-12T12:37:40.086 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 2296, 2024-09-12T12:37:40.086 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 23252, 2024-09-12T12:37:40.086 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 2296, 2024-09-12T12:37:40.086 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 23252, 2024-09-12T12:37:40.086 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-09-12T12:37:40.086 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:40.086 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:40.087 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:40.087 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T12:37:40.087 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.087 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-objecter_ops": { 2024-09-12T12:37:40.087 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-09-12T12:37:40.087 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 1024, 2024-09-12T12:37:40.087 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-09-12T12:37:40.087 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 0, 2024-09-12T12:37:40.087 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 0, 2024-09-12T12:37:40.087 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-09-12T12:37:40.087 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 0, 2024-09-12T12:37:40.087 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 2296, 2024-09-12T12:37:40.087 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 2296, 2024-09-12T12:37:40.088 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 2296, 2024-09-12T12:37:40.088 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 2296, 2024-09-12T12:37:40.088 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-09-12T12:37:40.088 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:40.088 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:40.088 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:40.088 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T12:37:40.088 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.088 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-write_buf_throttle": { 2024-09-12T12:37:40.088 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-09-12T12:37:40.088 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 3758096384, 2024-09-12T12:37:40.088 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-09-12T12:37:40.089 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 0, 2024-09-12T12:37:40.089 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 0, 2024-09-12T12:37:40.089 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-09-12T12:37:40.089 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 0, 2024-09-12T12:37:40.089 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 0, 2024-09-12T12:37:40.089 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 0, 2024-09-12T12:37:40.089 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 0, 2024-09-12T12:37:40.089 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 0, 2024-09-12T12:37:40.089 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-09-12T12:37:40.089 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:40.089 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:40.089 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:40.089 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T12:37:40.089 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:40.090 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-write_buf_throttle-0x562c2f4c2b40": { 2024-09-12T12:37:40.090 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-09-12T12:37:40.090 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 3758096384, 2024-09-12T12:37:40.090 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-09-12T12:37:40.090 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 0, 2024-09-12T12:37:40.090 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 0, 2024-09-12T12:37:40.090 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-09-12T12:37:40.090 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 0, 2024-09-12T12:37:40.090 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 0, 2024-09-12T12:37:40.090 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 0, 2024-09-12T12:37:40.090 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 0, 2024-09-12T12:37:40.090 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 0, 2024-09-12T12:37:40.090 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-09-12T12:37:40.091 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:40.091 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:40.091 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:40.091 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T12:37:40.091 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T12:37:40.091 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-12T12:37:40.808 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-12T12:37:40.808 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-12T12:37:40.808 DEBUG:tasks.check_counter:Getting stats from k 2024-09-12T12:37:40.808 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-12T12:37:41.064 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T12:37:41.554 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-12T12:37:41.554 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T12:37:41.554 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 237, 2024-09-12T12:37:41.554 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 234, 2024-09-12T12:37:41.555 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 483088, 2024-09-12T12:37:41.555 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 144064, 2024-09-12T12:37:41.555 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 4, 2024-09-12T12:37:41.555 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 0, 2024-09-12T12:37:41.555 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 0.033853959, 2024-09-12T12:37:41.555 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.014452745, 2024-09-12T12:37:41.555 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.023698813, 2024-09-12T12:37:41.555 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T12:37:41.555 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:37:41.555 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 233, 2024-09-12T12:37:41.555 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.012718966, 2024-09-12T12:37:41.555 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000054587 2024-09-12T12:37:41.555 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:41.556 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:37:41.556 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:41.556 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:41.556 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:41.556 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:41.556 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 483088, 2024-09-12T12:37:41.556 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 144064 2024-09-12T12:37:41.556 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:41.556 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T12:37:41.556 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 5, 2024-09-12T12:37:41.556 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 180, 2024-09-12T12:37:41.556 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 3104, 2024-09-12T12:37:41.556 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 110208, 2024-09-12T12:37:41.557 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 3, 2024-09-12T12:37:41.557 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 2, 2024-09-12T12:37:41.557 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 0.011852469, 2024-09-12T12:37:41.557 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.007074857, 2024-09-12T12:37:41.557 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.002994945, 2024-09-12T12:37:41.557 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T12:37:41.557 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:37:41.557 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 179, 2024-09-12T12:37:41.557 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.011506336, 2024-09-12T12:37:41.557 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000064281 2024-09-12T12:37:41.557 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:41.557 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:37:41.557 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:41.558 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:41.558 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:41.558 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:41.558 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-12T12:37:41.558 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 110208 2024-09-12T12:37:41.558 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:41.558 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T12:37:41.558 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 0, 2024-09-12T12:37:41.558 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 2, 2024-09-12T12:37:41.558 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 0, 2024-09-12T12:37:41.558 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 0, 2024-09-12T12:37:41.558 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 2, 2024-09-12T12:37:41.558 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 1, 2024-09-12T12:37:41.558 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 0.000363326, 2024-09-12T12:37:41.559 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.000000000, 2024-09-12T12:37:41.559 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.000286256, 2024-09-12T12:37:41.559 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T12:37:41.559 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:37:41.559 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:41.559 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:41.559 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:41.559 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:41.559 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:37:41.559 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:41.559 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:41.559 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:41.559 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:41.560 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T12:37:41.560 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T12:37:41.560 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:41.560 INFO:teuthology.orchestra.run.smithi043.stdout: "cct": { 2024-09-12T12:37:41.560 INFO:teuthology.orchestra.run.smithi043.stdout: "total_workers": 0, 2024-09-12T12:37:41.560 INFO:teuthology.orchestra.run.smithi043.stdout: "unhealthy_workers": 0 2024-09-12T12:37:41.560 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:41.560 INFO:teuthology.orchestra.run.smithi043.stdout: "mempool": { 2024-09-12T12:37:41.560 INFO:teuthology.orchestra.run.smithi043.stdout: "bloom_filter_bytes": 0, 2024-09-12T12:37:41.560 INFO:teuthology.orchestra.run.smithi043.stdout: "bloom_filter_items": 0, 2024-09-12T12:37:41.560 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T12:37:41.560 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_alloc_items": 0, 2024-09-12T12:37:41.560 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T12:37:41.560 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_data_items": 0, 2024-09-12T12:37:41.561 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T12:37:41.561 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T12:37:41.561 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T12:37:41.561 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T12:37:41.561 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T12:37:41.561 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_other_items": 0, 2024-09-12T12:37:41.561 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T12:37:41.561 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T12:37:41.561 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_bytes": 0, 2024-09-12T12:37:41.561 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_items": 0, 2024-09-12T12:37:41.561 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_blob_bytes": 0, 2024-09-12T12:37:41.561 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_blob_items": 0, 2024-09-12T12:37:41.561 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T12:37:41.561 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T12:37:41.562 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T12:37:41.562 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T12:37:41.562 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T12:37:41.562 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_items": 0, 2024-09-12T12:37:41.562 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_txc_bytes": 0, 2024-09-12T12:37:41.562 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_txc_items": 0, 2024-09-12T12:37:41.562 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T12:37:41.562 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T12:37:41.562 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_bytes": 0, 2024-09-12T12:37:41.563 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_items": 0, 2024-09-12T12:37:41.563 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_bytes": 0, 2024-09-12T12:37:41.563 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_items": 0, 2024-09-12T12:37:41.563 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T12:37:41.563 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_reader_items": 0, 2024-09-12T12:37:41.564 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T12:37:41.565 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_writer_items": 0, 2024-09-12T12:37:41.565 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_anon_bytes": 148984, 2024-09-12T12:37:41.565 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_anon_items": 30, 2024-09-12T12:37:41.565 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_meta_bytes": 0, 2024-09-12T12:37:41.566 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_meta_items": 0, 2024-09-12T12:37:41.566 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_bytes": 0, 2024-09-12T12:37:41.566 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_items": 0, 2024-09-12T12:37:41.566 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mapbl_bytes": 0, 2024-09-12T12:37:41.566 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mapbl_items": 0, 2024-09-12T12:37:41.566 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pglog_bytes": 0, 2024-09-12T12:37:41.566 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pglog_items": 0, 2024-09-12T12:37:41.566 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_bytes": 0, 2024-09-12T12:37:41.567 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_items": 0, 2024-09-12T12:37:41.567 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T12:37:41.567 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_mapping_items": 0, 2024-09-12T12:37:41.567 INFO:teuthology.orchestra.run.smithi043.stdout: "pgmap_bytes": 0, 2024-09-12T12:37:41.567 INFO:teuthology.orchestra.run.smithi043.stdout: "pgmap_items": 0, 2024-09-12T12:37:41.567 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_co_bytes": 928, 2024-09-12T12:37:41.567 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_co_items": 2, 2024-09-12T12:37:41.567 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_1_bytes": 0, 2024-09-12T12:37:41.567 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_1_items": 0, 2024-09-12T12:37:41.567 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_2_bytes": 0, 2024-09-12T12:37:41.567 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_2_items": 0 2024-09-12T12:37:41.568 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T12:37:41.568 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T12:37:41.568 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-09-12T12:37:41.568 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 104857600, 2024-09-12T12:37:41.568 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-09-12T12:37:41.568 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 238, 2024-09-12T12:37:41.568 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 449590, 2024-09-12T12:37:41.568 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-09-12T12:37:41.568 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 238, 2024-09-12T12:37:41.568 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 0, 2024-09-12T12:37:41.568 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 0, 2024-09-12T12:37:41.568 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 238, 2024-09-12T12:37:41.568 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 449590, 2024-09-12T12:37:41.569 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-09-12T12:37:41.569 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-09-12T12:37:41.569 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-09-12T12:37:41.569 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-09-12T12:37:41.569 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T12:37:41.569 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T12:37:41.569 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-12T12:37:41.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:41 smithi043 ceph-mon[34144]: pgmap v700: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 767 B/s wr, 40 op/s 2024-09-12T12:37:41.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:41 smithi102 ceph-mon[34799]: pgmap v700: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 767 B/s wr, 40 op/s 2024-09-12T12:37:41.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:41 smithi033 ceph-mon[31246]: pgmap v700: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 767 B/s wr, 40 op/s 2024-09-12T12:37:42.346 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-09-12T12:37:42.346 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-09-12T12:37:42.346 DEBUG:tasks.check_counter:Getting stats from c 2024-09-12T12:37:42.346 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-12T12:37:42.712 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:37:43.230 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-12T12:37:43.231 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T12:37:43.231 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 416, 2024-09-12T12:37:43.231 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 410, 2024-09-12T12:37:43.231 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 583635, 2024-09-12T12:37:43.231 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 259959, 2024-09-12T12:37:43.231 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 12, 2024-09-12T12:37:43.231 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 4, 2024-09-12T12:37:43.231 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.047873375, 2024-09-12T12:37:43.231 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.018759185, 2024-09-12T12:37:43.231 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.033773531, 2024-09-12T12:37:43.231 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.000682288, 2024-09-12T12:37:43.232 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:37:43.232 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 409, 2024-09-12T12:37:43.232 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.047690242, 2024-09-12T12:37:43.232 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000116602 2024-09-12T12:37:43.232 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.232 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:37:43.232 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 159, 2024-09-12T12:37:43.232 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000026297, 2024-09-12T12:37:43.232 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000165 2024-09-12T12:37:43.232 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.232 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 538976, 2024-09-12T12:37:43.232 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 159056 2024-09-12T12:37:43.233 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.233 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T12:37:43.233 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 595, 2024-09-12T12:37:43.233 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 864, 2024-09-12T12:37:43.233 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 161210, 2024-09-12T12:37:43.233 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 881159, 2024-09-12T12:37:43.233 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 28, 2024-09-12T12:37:43.233 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 8, 2024-09-12T12:37:43.233 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.081990338, 2024-09-12T12:37:43.233 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.034721274, 2024-09-12T12:37:43.233 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.041974873, 2024-09-12T12:37:43.233 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.004278299, 2024-09-12T12:37:43.233 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:37:43.233 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 864, 2024-09-12T12:37:43.234 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.044764179, 2024-09-12T12:37:43.234 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000051810 2024-09-12T12:37:43.234 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.234 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:37:43.234 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 1200, 2024-09-12T12:37:43.234 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000242035, 2024-09-12T12:37:43.234 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000201 2024-09-12T12:37:43.234 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.234 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T12:37:43.234 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 377792 2024-09-12T12:37:43.234 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.234 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T12:37:43.234 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 48, 2024-09-12T12:37:43.235 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 50, 2024-09-12T12:37:43.235 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 14131, 2024-09-12T12:37:43.235 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 95407, 2024-09-12T12:37:43.235 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 14, 2024-09-12T12:37:43.235 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 6, 2024-09-12T12:37:43.235 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.008925486, 2024-09-12T12:37:43.235 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.000863580, 2024-09-12T12:37:43.235 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.006503237, 2024-09-12T12:37:43.235 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.001073773, 2024-09-12T12:37:43.236 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:37:43.236 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 47, 2024-09-12T12:37:43.236 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.020470748, 2024-09-12T12:37:43.236 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000435547 2024-09-12T12:37:43.236 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.236 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:37:43.236 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 6, 2024-09-12T12:37:43.236 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000448, 2024-09-12T12:37:43.236 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000074 2024-09-12T12:37:43.236 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.236 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-12T12:37:43.236 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T12:37:43.236 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.237 INFO:teuthology.orchestra.run.smithi102.stdout: "cct": { 2024-09-12T12:37:43.237 INFO:teuthology.orchestra.run.smithi102.stdout: "total_workers": 1, 2024-09-12T12:37:43.237 INFO:teuthology.orchestra.run.smithi102.stdout: "unhealthy_workers": 0 2024-09-12T12:37:43.237 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.237 INFO:teuthology.orchestra.run.smithi102.stdout: "finisher-MDSRank": { 2024-09-12T12:37:43.237 INFO:teuthology.orchestra.run.smithi102.stdout: "queue_len": 0, 2024-09-12T12:37:43.237 INFO:teuthology.orchestra.run.smithi102.stdout: "complete_latency": { 2024-09-12T12:37:43.237 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 94, 2024-09-12T12:37:43.237 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.005690215, 2024-09-12T12:37:43.237 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000060534 2024-09-12T12:37:43.237 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T12:37:43.237 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.237 INFO:teuthology.orchestra.run.smithi102.stdout: "finisher-PurgeQueue": { 2024-09-12T12:37:43.237 INFO:teuthology.orchestra.run.smithi102.stdout: "queue_len": 0, 2024-09-12T12:37:43.238 INFO:teuthology.orchestra.run.smithi102.stdout: "complete_latency": { 2024-09-12T12:37:43.238 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 15, 2024-09-12T12:37:43.238 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000371963, 2024-09-12T12:37:43.238 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000024797 2024-09-12T12:37:43.238 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T12:37:43.238 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.238 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": { 2024-09-12T12:37:43.238 INFO:teuthology.orchestra.run.smithi102.stdout: "request": 11, 2024-09-12T12:37:43.238 INFO:teuthology.orchestra.run.smithi102.stdout: "reply": 9, 2024-09-12T12:37:43.238 INFO:teuthology.orchestra.run.smithi102.stdout: "reply_latency": { 2024-09-12T12:37:43.238 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 9, 2024-09-12T12:37:43.238 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.004959980, 2024-09-12T12:37:43.238 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000551108 2024-09-12T12:37:43.238 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.239 INFO:teuthology.orchestra.run.smithi102.stdout: "slow_reply": 0, 2024-09-12T12:37:43.239 INFO:teuthology.orchestra.run.smithi102.stdout: "forward": 2, 2024-09-12T12:37:43.239 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_fetch_complete": 0, 2024-09-12T12:37:43.239 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_fetch_keys": 0, 2024-09-12T12:37:43.239 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_commit": 11, 2024-09-12T12:37:43.239 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_split": 0, 2024-09-12T12:37:43.239 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_merge": 0, 2024-09-12T12:37:43.239 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes": 15, 2024-09-12T12:37:43.239 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_top": 0, 2024-09-12T12:37:43.239 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_bottom": 15, 2024-09-12T12:37:43.239 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_pin_tail": 0, 2024-09-12T12:37:43.239 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_pinned": 14, 2024-09-12T12:37:43.239 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_expired": 8, 2024-09-12T12:37:43.239 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_with_caps": 4, 2024-09-12T12:37:43.240 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": 4, 2024-09-12T12:37:43.240 INFO:teuthology.orchestra.run.smithi102.stdout: "subtrees": 3, 2024-09-12T12:37:43.240 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse": 21, 2024-09-12T12:37:43.240 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_hit": 12, 2024-09-12T12:37:43.240 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_forward": 0, 2024-09-12T12:37:43.240 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_discover": 3, 2024-09-12T12:37:43.240 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_dir_fetch": 0, 2024-09-12T12:37:43.240 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_remote_ino": 0, 2024-09-12T12:37:43.240 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_lock": 0, 2024-09-12T12:37:43.240 INFO:teuthology.orchestra.run.smithi102.stdout: "load_cent": 0, 2024-09-12T12:37:43.240 INFO:teuthology.orchestra.run.smithi102.stdout: "q": 0, 2024-09-12T12:37:43.240 INFO:teuthology.orchestra.run.smithi102.stdout: "exported": 1, 2024-09-12T12:37:43.241 INFO:teuthology.orchestra.run.smithi102.stdout: "exported_inodes": 0, 2024-09-12T12:37:43.241 INFO:teuthology.orchestra.run.smithi102.stdout: "imported": 1, 2024-09-12T12:37:43.241 INFO:teuthology.orchestra.run.smithi102.stdout: "imported_inodes": 2, 2024-09-12T12:37:43.241 INFO:teuthology.orchestra.run.smithi102.stdout: "openino_dir_fetch": 0, 2024-09-12T12:37:43.241 INFO:teuthology.orchestra.run.smithi102.stdout: "openino_backtrace_fetch": 20, 2024-09-12T12:37:43.241 INFO:teuthology.orchestra.run.smithi102.stdout: "openino_peer_discover": 0, 2024-09-12T12:37:43.241 INFO:teuthology.orchestra.run.smithi102.stdout: "root_rfiles": 22, 2024-09-12T12:37:43.241 INFO:teuthology.orchestra.run.smithi102.stdout: "root_rbytes": 7436767523, 2024-09-12T12:37:43.241 INFO:teuthology.orchestra.run.smithi102.stdout: "root_rsnaps": 0, 2024-09-12T12:37:43.241 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_backtrace_fetch": 20, 2024-09-12T12:37:43.241 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_set_tag": 0, 2024-09-12T12:37:43.242 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T12:37:43.242 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_inotable_repaired": 0, 2024-09-12T12:37:43.242 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_dir_inodes": 0, 2024-09-12T12:37:43.242 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T12:37:43.242 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T12:37:43.242 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_file_inodes": 20, 2024-09-12T12:37:43.242 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_inode_file_caps": 0, 2024-09-12T12:37:43.242 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_revoke": 2, 2024-09-12T12:37:43.242 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_grant": 2, 2024-09-12T12:37:43.242 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T12:37:43.242 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T12:37:43.242 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T12:37:43.242 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_caps": 2, 2024-09-12T12:37:43.243 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_caps_dirty": 0, 2024-09-12T12:37:43.243 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_cap_release": 1, 2024-09-12T12:37:43.243 INFO:teuthology.orchestra.run.smithi102.stdout: "process_request_cap_release": 6 2024-09-12T12:37:43.243 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.243 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_cache": { 2024-09-12T12:37:43.243 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_update": 0, 2024-09-12T12:37:43.243 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_update_receipt": 0, 2024-09-12T12:37:43.243 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_try_discover": 0, 2024-09-12T12:37:43.243 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_send_discover": 4, 2024-09-12T12:37:43.243 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_handle_discover": 0, 2024-09-12T12:37:43.244 INFO:teuthology.orchestra.run.smithi102.stdout: "num_strays": 0, 2024-09-12T12:37:43.244 INFO:teuthology.orchestra.run.smithi102.stdout: "num_strays_delayed": 0, 2024-09-12T12:37:43.244 INFO:teuthology.orchestra.run.smithi102.stdout: "num_strays_enqueuing": 0, 2024-09-12T12:37:43.244 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_created": 2, 2024-09-12T12:37:43.244 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_enqueued": 2, 2024-09-12T12:37:43.244 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_reintegrated": 0, 2024-09-12T12:37:43.245 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_migrated": 0, 2024-09-12T12:37:43.245 INFO:teuthology.orchestra.run.smithi102.stdout: "num_recovering_processing": 0, 2024-09-12T12:37:43.245 INFO:teuthology.orchestra.run.smithi102.stdout: "num_recovering_enqueued": 0, 2024-09-12T12:37:43.245 INFO:teuthology.orchestra.run.smithi102.stdout: "num_recovering_prioritized": 0, 2024-09-12T12:37:43.245 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_started": 0, 2024-09-12T12:37:43.245 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_completed": 0, 2024-09-12T12:37:43.246 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_quiesce_path": 0, 2024-09-12T12:37:43.246 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_quiesce_inode": 0, 2024-09-12T12:37:43.246 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T12:37:43.246 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_exportdir": 1, 2024-09-12T12:37:43.246 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_flush": 0, 2024-09-12T12:37:43.246 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_fragmentdir": 0, 2024-09-12T12:37:43.247 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_fragstats": 0, 2024-09-12T12:37:43.247 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_inodestats": 0 2024-09-12T12:37:43.247 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.247 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_log": { 2024-09-12T12:37:43.247 INFO:teuthology.orchestra.run.smithi102.stdout: "evlrg": 0, 2024-09-12T12:37:43.247 INFO:teuthology.orchestra.run.smithi102.stdout: "evadd": 16, 2024-09-12T12:37:43.248 INFO:teuthology.orchestra.run.smithi102.stdout: "evex": 0, 2024-09-12T12:37:43.248 INFO:teuthology.orchestra.run.smithi102.stdout: "evtrm": 0, 2024-09-12T12:37:43.248 INFO:teuthology.orchestra.run.smithi102.stdout: "ev": 16, 2024-09-12T12:37:43.248 INFO:teuthology.orchestra.run.smithi102.stdout: "evexg": 0, 2024-09-12T12:37:43.248 INFO:teuthology.orchestra.run.smithi102.stdout: "evexd": 0, 2024-09-12T12:37:43.248 INFO:teuthology.orchestra.run.smithi102.stdout: "segadd": 2, 2024-09-12T12:37:43.249 INFO:teuthology.orchestra.run.smithi102.stdout: "segex": 0, 2024-09-12T12:37:43.249 INFO:teuthology.orchestra.run.smithi102.stdout: "segtrm": 0, 2024-09-12T12:37:43.249 INFO:teuthology.orchestra.run.smithi102.stdout: "seg": 2, 2024-09-12T12:37:43.249 INFO:teuthology.orchestra.run.smithi102.stdout: "segmjr": 2, 2024-09-12T12:37:43.249 INFO:teuthology.orchestra.run.smithi102.stdout: "segexg": 0, 2024-09-12T12:37:43.249 INFO:teuthology.orchestra.run.smithi102.stdout: "segexd": 0, 2024-09-12T12:37:43.250 INFO:teuthology.orchestra.run.smithi102.stdout: "expos": 4194304, 2024-09-12T12:37:43.250 INFO:teuthology.orchestra.run.smithi102.stdout: "wrpos": 4217551, 2024-09-12T12:37:43.250 INFO:teuthology.orchestra.run.smithi102.stdout: "rdpos": 0, 2024-09-12T12:37:43.250 INFO:teuthology.orchestra.run.smithi102.stdout: "jlat": { 2024-09-12T12:37:43.250 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 12, 2024-09-12T12:37:43.250 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.042922181, 2024-09-12T12:37:43.251 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.003576848 2024-09-12T12:37:43.251 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.251 INFO:teuthology.orchestra.run.smithi102.stdout: "replayed": 0 2024-09-12T12:37:43.251 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.251 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_mem": { 2024-09-12T12:37:43.251 INFO:teuthology.orchestra.run.smithi102.stdout: "ino": 19, 2024-09-12T12:37:43.252 INFO:teuthology.orchestra.run.smithi102.stdout: "ino+": 25, 2024-09-12T12:37:43.252 INFO:teuthology.orchestra.run.smithi102.stdout: "ino-": 6, 2024-09-12T12:37:43.252 INFO:teuthology.orchestra.run.smithi102.stdout: "dir": 18, 2024-09-12T12:37:43.252 INFO:teuthology.orchestra.run.smithi102.stdout: "dir+": 23, 2024-09-12T12:37:43.252 INFO:teuthology.orchestra.run.smithi102.stdout: "dir-": 5, 2024-09-12T12:37:43.253 INFO:teuthology.orchestra.run.smithi102.stdout: "dn": 15, 2024-09-12T12:37:43.253 INFO:teuthology.orchestra.run.smithi102.stdout: "dn+": 27, 2024-09-12T12:37:43.253 INFO:teuthology.orchestra.run.smithi102.stdout: "dn-": 12, 2024-09-12T12:37:43.253 INFO:teuthology.orchestra.run.smithi102.stdout: "cap": 4, 2024-09-12T12:37:43.253 INFO:teuthology.orchestra.run.smithi102.stdout: "cap+": 8, 2024-09-12T12:37:43.253 INFO:teuthology.orchestra.run.smithi102.stdout: "cap-": 4, 2024-09-12T12:37:43.254 INFO:teuthology.orchestra.run.smithi102.stdout: "rss": 51820, 2024-09-12T12:37:43.254 INFO:teuthology.orchestra.run.smithi102.stdout: "heap": 223520 2024-09-12T12:37:43.254 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.254 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_server": { 2024-09-12T12:37:43.254 INFO:teuthology.orchestra.run.smithi102.stdout: "dispatch_client_request": 17, 2024-09-12T12:37:43.254 INFO:teuthology.orchestra.run.smithi102.stdout: "dispatch_server_request": 1, 2024-09-12T12:37:43.255 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_request": 11, 2024-09-12T12:37:43.255 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_session": 13, 2024-09-12T12:37:43.255 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_peer_request": 5, 2024-09-12T12:37:43.255 INFO:teuthology.orchestra.run.smithi102.stdout: "req_create_latency": { 2024-09-12T12:37:43.255 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:43.255 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:43.256 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:43.256 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.256 INFO:teuthology.orchestra.run.smithi102.stdout: "req_getattr_latency": { 2024-09-12T12:37:43.256 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 5, 2024-09-12T12:37:43.256 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.001895775, 2024-09-12T12:37:43.256 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000379155 2024-09-12T12:37:43.257 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.257 INFO:teuthology.orchestra.run.smithi102.stdout: "req_getfilelock_latency": { 2024-09-12T12:37:43.257 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:43.257 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:43.257 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:43.257 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.258 INFO:teuthology.orchestra.run.smithi102.stdout: "req_link_latency": { 2024-09-12T12:37:43.258 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:43.258 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:43.258 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:43.258 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.258 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookup_latency": { 2024-09-12T12:37:43.259 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 1, 2024-09-12T12:37:43.259 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000281475, 2024-09-12T12:37:43.259 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000281475 2024-09-12T12:37:43.259 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.259 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookuphash_latency": { 2024-09-12T12:37:43.259 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:43.260 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:43.260 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:43.260 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.260 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupino_latency": { 2024-09-12T12:37:43.260 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:43.261 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:43.261 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:43.261 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.261 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupname_latency": { 2024-09-12T12:37:43.261 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:43.261 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:43.262 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:43.262 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.262 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupparent_latency": { 2024-09-12T12:37:43.262 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:43.262 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:43.262 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:43.263 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.263 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupsnap_latency": { 2024-09-12T12:37:43.263 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:43.263 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:43.263 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:43.263 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.264 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lssnap_latency": { 2024-09-12T12:37:43.264 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:43.264 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:43.264 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:43.264 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.264 INFO:teuthology.orchestra.run.smithi102.stdout: "req_mkdir_latency": { 2024-09-12T12:37:43.266 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:43.266 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:43.266 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:43.266 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.266 INFO:teuthology.orchestra.run.smithi102.stdout: "req_mknod_latency": { 2024-09-12T12:37:43.266 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:43.267 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:43.267 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:43.267 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.267 INFO:teuthology.orchestra.run.smithi102.stdout: "req_mksnap_latency": { 2024-09-12T12:37:43.267 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:43.267 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:43.268 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:43.268 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.268 INFO:teuthology.orchestra.run.smithi102.stdout: "req_open_latency": { 2024-09-12T12:37:43.268 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:43.268 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:43.268 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:43.269 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.269 INFO:teuthology.orchestra.run.smithi102.stdout: "req_readdir_latency": { 2024-09-12T12:37:43.269 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 1, 2024-09-12T12:37:43.269 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000238527, 2024-09-12T12:37:43.269 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000238527 2024-09-12T12:37:43.269 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.270 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rename_latency": { 2024-09-12T12:37:43.270 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:43.270 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:43.270 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:43.270 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.271 INFO:teuthology.orchestra.run.smithi102.stdout: "req_renamesnap_latency": { 2024-09-12T12:37:43.271 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:43.271 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:43.271 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:43.271 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.271 INFO:teuthology.orchestra.run.smithi102.stdout: "req_snapdiff_latency": { 2024-09-12T12:37:43.272 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:43.272 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:43.272 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:43.272 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.272 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rmdir_latency": { 2024-09-12T12:37:43.272 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:43.273 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:43.273 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:43.273 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.273 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rmsnap_latency": { 2024-09-12T12:37:43.273 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:43.273 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:43.274 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:43.274 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.274 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rmxattr_latency": { 2024-09-12T12:37:43.274 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:43.274 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:43.274 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:43.275 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.275 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setattr_latency": { 2024-09-12T12:37:43.275 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:43.275 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:43.275 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:43.275 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.276 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setdirlayout_latency": { 2024-09-12T12:37:43.276 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:43.276 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:43.276 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:43.276 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.276 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setfilelock_latency": { 2024-09-12T12:37:43.277 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:43.277 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:43.277 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:43.277 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.278 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setlayout_latency": { 2024-09-12T12:37:43.278 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:43.278 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:43.278 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:43.278 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.278 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setxattr_latency": { 2024-09-12T12:37:43.279 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:43.279 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:43.279 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:43.279 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.279 INFO:teuthology.orchestra.run.smithi102.stdout: "req_symlink_latency": { 2024-09-12T12:37:43.280 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:43.280 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:43.280 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:43.280 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.280 INFO:teuthology.orchestra.run.smithi102.stdout: "req_unlink_latency": { 2024-09-12T12:37:43.280 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 2, 2024-09-12T12:37:43.281 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.002544203, 2024-09-12T12:37:43.281 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.001272101 2024-09-12T12:37:43.281 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.281 INFO:teuthology.orchestra.run.smithi102.stdout: "cap_revoke_eviction": 0, 2024-09-12T12:37:43.281 INFO:teuthology.orchestra.run.smithi102.stdout: "cap_acquisition_throttle": 0, 2024-09-12T12:37:43.281 INFO:teuthology.orchestra.run.smithi102.stdout: "req_getvxattr_latency": { 2024-09-12T12:37:43.282 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:43.282 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:43.282 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:43.283 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T12:37:43.283 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.283 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_sessions": { 2024-09-12T12:37:43.283 INFO:teuthology.orchestra.run.smithi102.stdout: "session_count": 1, 2024-09-12T12:37:43.283 INFO:teuthology.orchestra.run.smithi102.stdout: "session_add": 2, 2024-09-12T12:37:43.283 INFO:teuthology.orchestra.run.smithi102.stdout: "session_remove": 1, 2024-09-12T12:37:43.284 INFO:teuthology.orchestra.run.smithi102.stdout: "sessions_open": 1, 2024-09-12T12:37:43.284 INFO:teuthology.orchestra.run.smithi102.stdout: "sessions_stale": 0, 2024-09-12T12:37:43.284 INFO:teuthology.orchestra.run.smithi102.stdout: "total_load": 4, 2024-09-12T12:37:43.284 INFO:teuthology.orchestra.run.smithi102.stdout: "average_load": 4, 2024-09-12T12:37:43.284 INFO:teuthology.orchestra.run.smithi102.stdout: "avg_session_uptime": 696, 2024-09-12T12:37:43.285 INFO:teuthology.orchestra.run.smithi102.stdout: "mdthresh_evicted": 0 2024-09-12T12:37:43.285 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.285 INFO:teuthology.orchestra.run.smithi102.stdout: "mempool": { 2024-09-12T12:37:43.285 INFO:teuthology.orchestra.run.smithi102.stdout: "bloom_filter_bytes": 0, 2024-09-12T12:37:43.285 INFO:teuthology.orchestra.run.smithi102.stdout: "bloom_filter_items": 0, 2024-09-12T12:37:43.285 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T12:37:43.286 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_alloc_items": 0, 2024-09-12T12:37:43.286 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T12:37:43.286 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_data_items": 0, 2024-09-12T12:37:43.286 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T12:37:43.286 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T12:37:43.286 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T12:37:43.287 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T12:37:43.287 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T12:37:43.287 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_other_items": 0, 2024-09-12T12:37:43.287 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T12:37:43.287 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T12:37:43.287 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_bytes": 0, 2024-09-12T12:37:43.288 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_items": 0, 2024-09-12T12:37:43.288 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_blob_bytes": 0, 2024-09-12T12:37:43.288 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_blob_items": 0, 2024-09-12T12:37:43.288 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T12:37:43.288 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T12:37:43.288 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T12:37:43.289 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T12:37:43.289 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T12:37:43.289 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_items": 0, 2024-09-12T12:37:43.289 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_txc_bytes": 0, 2024-09-12T12:37:43.289 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_txc_items": 0, 2024-09-12T12:37:43.289 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T12:37:43.290 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T12:37:43.290 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_bytes": 0, 2024-09-12T12:37:43.290 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_items": 0, 2024-09-12T12:37:43.290 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_bytes": 0, 2024-09-12T12:37:43.290 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_items": 0, 2024-09-12T12:37:43.290 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T12:37:43.290 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_reader_items": 0, 2024-09-12T12:37:43.291 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T12:37:43.291 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_writer_items": 0, 2024-09-12T12:37:43.291 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_anon_bytes": 276219, 2024-09-12T12:37:43.291 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_anon_items": 98, 2024-09-12T12:37:43.291 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_meta_bytes": 0, 2024-09-12T12:37:43.292 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_meta_items": 0, 2024-09-12T12:37:43.292 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_bytes": 0, 2024-09-12T12:37:43.292 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_items": 0, 2024-09-12T12:37:43.292 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mapbl_bytes": 0, 2024-09-12T12:37:43.292 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mapbl_items": 0, 2024-09-12T12:37:43.292 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pglog_bytes": 0, 2024-09-12T12:37:43.293 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pglog_items": 0, 2024-09-12T12:37:43.293 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_bytes": 8856, 2024-09-12T12:37:43.293 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_items": 166, 2024-09-12T12:37:43.293 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T12:37:43.293 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_mapping_items": 0, 2024-09-12T12:37:43.293 INFO:teuthology.orchestra.run.smithi102.stdout: "pgmap_bytes": 0, 2024-09-12T12:37:43.293 INFO:teuthology.orchestra.run.smithi102.stdout: "pgmap_items": 0, 2024-09-12T12:37:43.293 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_co_bytes": 78365, 2024-09-12T12:37:43.293 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_co_items": 337, 2024-09-12T12:37:43.293 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_1_bytes": 0, 2024-09-12T12:37:43.293 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_1_items": 0, 2024-09-12T12:37:43.293 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_2_bytes": 0, 2024-09-12T12:37:43.293 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_2_items": 0 2024-09-12T12:37:43.293 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.294 INFO:teuthology.orchestra.run.smithi102.stdout: "objecter": { 2024-09-12T12:37:43.294 INFO:teuthology.orchestra.run.smithi102.stdout: "op_active": 0, 2024-09-12T12:37:43.294 INFO:teuthology.orchestra.run.smithi102.stdout: "op_laggy": 0, 2024-09-12T12:37:43.294 INFO:teuthology.orchestra.run.smithi102.stdout: "op_send": 87, 2024-09-12T12:37:43.294 INFO:teuthology.orchestra.run.smithi102.stdout: "op_send_bytes": 35222, 2024-09-12T12:37:43.294 INFO:teuthology.orchestra.run.smithi102.stdout: "op_resend": 33, 2024-09-12T12:37:43.294 INFO:teuthology.orchestra.run.smithi102.stdout: "op_reply": 87, 2024-09-12T12:37:43.294 INFO:teuthology.orchestra.run.smithi102.stdout: "op_latency": { 2024-09-12T12:37:43.294 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 87, 2024-09-12T12:37:43.294 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.386992107, 2024-09-12T12:37:43.294 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.004448185 2024-09-12T12:37:43.294 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.294 INFO:teuthology.orchestra.run.smithi102.stdout: "op_inflight": 0, 2024-09-12T12:37:43.294 INFO:teuthology.orchestra.run.smithi102.stdout: "oplen_avg": { 2024-09-12T12:37:43.295 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 87, 2024-09-12T12:37:43.295 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 114 2024-09-12T12:37:43.295 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.295 INFO:teuthology.orchestra.run.smithi102.stdout: "op": 87, 2024-09-12T12:37:43.295 INFO:teuthology.orchestra.run.smithi102.stdout: "op_r": 21, 2024-09-12T12:37:43.295 INFO:teuthology.orchestra.run.smithi102.stdout: "op_w": 66, 2024-09-12T12:37:43.295 INFO:teuthology.orchestra.run.smithi102.stdout: "op_rmw": 0, 2024-09-12T12:37:43.295 INFO:teuthology.orchestra.run.smithi102.stdout: "op_pg": 0, 2024-09-12T12:37:43.295 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_stat": 0, 2024-09-12T12:37:43.295 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_create": 10, 2024-09-12T12:37:43.295 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_read": 1, 2024-09-12T12:37:43.295 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_write": 13, 2024-09-12T12:37:43.295 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_writefull": 10, 2024-09-12T12:37:43.296 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_writesame": 0, 2024-09-12T12:37:43.296 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_append": 0, 2024-09-12T12:37:43.296 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_zero": 0, 2024-09-12T12:37:43.296 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_truncate": 0, 2024-09-12T12:37:43.296 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_delete": 16, 2024-09-12T12:37:43.296 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_mapext": 0, 2024-09-12T12:37:43.296 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_sparse_read": 0, 2024-09-12T12:37:43.296 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_clonerange": 0, 2024-09-12T12:37:43.296 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_getxattr": 20, 2024-09-12T12:37:43.296 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_setxattr": 20, 2024-09-12T12:37:43.296 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_cmpxattr": 0, 2024-09-12T12:37:43.296 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_rmxattr": 0, 2024-09-12T12:37:43.296 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_resetxattrs": 0, 2024-09-12T12:37:43.296 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_call": 0, 2024-09-12T12:37:43.297 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_watch": 0, 2024-09-12T12:37:43.297 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_notify": 0, 2024-09-12T12:37:43.297 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T12:37:43.297 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_pgls": 0, 2024-09-12T12:37:43.297 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_pgls_filter": 0, 2024-09-12T12:37:43.297 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_other": 0, 2024-09-12T12:37:43.297 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_active": 0, 2024-09-12T12:37:43.297 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_send": 0, 2024-09-12T12:37:43.297 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_resend": 0, 2024-09-12T12:37:43.297 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_ping": 0, 2024-09-12T12:37:43.297 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_active": 0, 2024-09-12T12:37:43.297 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_send": 0, 2024-09-12T12:37:43.298 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_resend": 0, 2024-09-12T12:37:43.298 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_active": 0, 2024-09-12T12:37:43.298 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_send": 0, 2024-09-12T12:37:43.298 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_resend": 0, 2024-09-12T12:37:43.298 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_active": 0, 2024-09-12T12:37:43.298 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_send": 0, 2024-09-12T12:37:43.298 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_resend": 0, 2024-09-12T12:37:43.298 INFO:teuthology.orchestra.run.smithi102.stdout: "command_active": 0, 2024-09-12T12:37:43.298 INFO:teuthology.orchestra.run.smithi102.stdout: "command_send": 0, 2024-09-12T12:37:43.299 INFO:teuthology.orchestra.run.smithi102.stdout: "command_resend": 0, 2024-09-12T12:37:43.299 INFO:teuthology.orchestra.run.smithi102.stdout: "map_epoch": 89, 2024-09-12T12:37:43.299 INFO:teuthology.orchestra.run.smithi102.stdout: "map_full": 0, 2024-09-12T12:37:43.299 INFO:teuthology.orchestra.run.smithi102.stdout: "map_inc": 4, 2024-09-12T12:37:43.299 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_sessions": 11, 2024-09-12T12:37:43.299 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_session_open": 11, 2024-09-12T12:37:43.299 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_session_close": 0, 2024-09-12T12:37:43.299 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_laggy": 0, 2024-09-12T12:37:43.299 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_wr": 21, 2024-09-12T12:37:43.299 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_rd": 0, 2024-09-12T12:37:43.299 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_del": 3 2024-09-12T12:37:43.299 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.300 INFO:teuthology.orchestra.run.smithi102.stdout: "oft": { 2024-09-12T12:37:43.300 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_objs": 1, 2024-09-12T12:37:43.300 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_kv_pairs": 0, 2024-09-12T12:37:43.300 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_updates": 0, 2024-09-12T12:37:43.300 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_removes": 0 2024-09-12T12:37:43.300 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.301 INFO:teuthology.orchestra.run.smithi102.stdout: "osd-slow-ops": { 2024-09-12T12:37:43.301 INFO:teuthology.orchestra.run.smithi102.stdout: "slow_ops_count": 0 2024-09-12T12:37:43.301 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.301 INFO:teuthology.orchestra.run.smithi102.stdout: "purge_queue": { 2024-09-12T12:37:43.301 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing_ops": 0, 2024-09-12T12:37:43.301 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing_ops_high_water": 4, 2024-09-12T12:37:43.301 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing": 0, 2024-09-12T12:37:43.301 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing_high_water": 2, 2024-09-12T12:37:43.301 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executed_ops": 4, 2024-09-12T12:37:43.301 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executed": 2, 2024-09-12T12:37:43.301 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_item_in_journal": 0 2024-09-12T12:37:43.301 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.302 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T12:37:43.302 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-12T12:37:43.302 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 104857600, 2024-09-12T12:37:43.302 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-12T12:37:43.302 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 1055, 2024-09-12T12:37:43.302 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 645659, 2024-09-12T12:37:43.302 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-12T12:37:43.302 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 1055, 2024-09-12T12:37:43.303 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-09-12T12:37:43.303 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-09-12T12:37:43.303 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 1055, 2024-09-12T12:37:43.303 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 645659, 2024-09-12T12:37:43.303 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-12T12:37:43.303 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:43.303 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:43.304 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:43.304 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T12:37:43.304 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.304 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-objecter_bytes": { 2024-09-12T12:37:43.304 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-12T12:37:43.304 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 104857600, 2024-09-12T12:37:43.304 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-12T12:37:43.304 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 0, 2024-09-12T12:37:43.304 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2024-09-12T12:37:43.304 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-12T12:37:43.304 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 0, 2024-09-12T12:37:43.304 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 87, 2024-09-12T12:37:43.304 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 35440, 2024-09-12T12:37:43.305 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 87, 2024-09-12T12:37:43.305 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 35440, 2024-09-12T12:37:43.305 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-12T12:37:43.305 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:43.305 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:43.305 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:43.305 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T12:37:43.305 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.305 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-objecter_ops": { 2024-09-12T12:37:43.305 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-12T12:37:43.305 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 1024, 2024-09-12T12:37:43.305 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-12T12:37:43.305 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 0, 2024-09-12T12:37:43.306 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2024-09-12T12:37:43.306 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-12T12:37:43.306 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 0, 2024-09-12T12:37:43.306 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 87, 2024-09-12T12:37:43.306 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 87, 2024-09-12T12:37:43.306 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 87, 2024-09-12T12:37:43.306 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 87, 2024-09-12T12:37:43.306 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-12T12:37:43.306 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:43.306 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:43.306 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:43.306 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T12:37:43.306 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.307 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-write_buf_throttle": { 2024-09-12T12:37:43.307 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-12T12:37:43.307 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 3758096384, 2024-09-12T12:37:43.307 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-12T12:37:43.307 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 2, 2024-09-12T12:37:43.307 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 218, 2024-09-12T12:37:43.307 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-12T12:37:43.307 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 2, 2024-09-12T12:37:43.307 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-09-12T12:37:43.307 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-09-12T12:37:43.307 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 1, 2024-09-12T12:37:43.307 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 218, 2024-09-12T12:37:43.307 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-12T12:37:43.308 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:43.308 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:43.308 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:43.308 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T12:37:43.308 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:43.308 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-write_buf_throttle-0x563e9f90c960": { 2024-09-12T12:37:43.308 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-12T12:37:43.308 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 3758096384, 2024-09-12T12:37:43.308 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-12T12:37:43.308 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 16, 2024-09-12T12:37:43.308 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 23247, 2024-09-12T12:37:43.308 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-12T12:37:43.308 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 16, 2024-09-12T12:37:43.309 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-09-12T12:37:43.309 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-09-12T12:37:43.309 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 12, 2024-09-12T12:37:43.309 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 23247, 2024-09-12T12:37:43.309 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-12T12:37:43.309 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:43.309 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:43.309 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:43.309 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T12:37:43.309 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T12:37:43.309 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-12T12:37:43.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:43 smithi043 ceph-mon[34144]: pgmap v701: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-12T12:37:43.876 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:43 smithi102 ceph-mon[34799]: pgmap v701: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-12T12:37:43.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:43 smithi033 ceph-mon[31246]: pgmap v701: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-12T12:37:44.112 INFO:tasks.check_counter:Daemon mds.c mds.exported=1 2024-09-12T12:37:44.113 INFO:tasks.check_counter:Daemon mds.c mds.imported=1 2024-09-12T12:37:44.113 DEBUG:tasks.check_counter:Getting stats from f 2024-09-12T12:37:44.113 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-12T12:37:44.372 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:37:44.889 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-12T12:37:44.889 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T12:37:44.889 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 619, 2024-09-12T12:37:44.889 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 812, 2024-09-12T12:37:44.889 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 614378, 2024-09-12T12:37:44.890 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 367244, 2024-09-12T12:37:44.890 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 7, 2024-09-12T12:37:44.890 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 2, 2024-09-12T12:37:44.890 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.086920858, 2024-09-12T12:37:44.890 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.035888315, 2024-09-12T12:37:44.890 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.051638923, 2024-09-12T12:37:44.890 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.003608581, 2024-09-12T12:37:44.890 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:37:44.890 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 814, 2024-09-12T12:37:44.890 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.050892256, 2024-09-12T12:37:44.890 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000062521 2024-09-12T12:37:44.890 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.890 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:37:44.891 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 837, 2024-09-12T12:37:44.891 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000198623, 2024-09-12T12:37:44.891 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000237 2024-09-12T12:37:44.891 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.891 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 533424, 2024-09-12T12:37:44.891 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 150208 2024-09-12T12:37:44.891 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.891 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T12:37:44.891 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 73, 2024-09-12T12:37:44.891 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 248, 2024-09-12T12:37:44.891 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 37098, 2024-09-12T12:37:44.891 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 420524, 2024-09-12T12:37:44.891 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 7, 2024-09-12T12:37:44.892 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 5, 2024-09-12T12:37:44.892 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.015541382, 2024-09-12T12:37:44.892 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.009210930, 2024-09-12T12:37:44.892 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.005246337, 2024-09-12T12:37:44.892 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.000346429, 2024-09-12T12:37:44.892 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:37:44.892 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 246, 2024-09-12T12:37:44.892 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.023395834, 2024-09-12T12:37:44.892 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000095105 2024-09-12T12:37:44.892 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.892 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:37:44.892 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 100, 2024-09-12T12:37:44.892 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000017376, 2024-09-12T12:37:44.893 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000173 2024-09-12T12:37:44.893 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.893 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T12:37:44.893 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 375632 2024-09-12T12:37:44.893 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.893 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T12:37:44.893 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 48, 2024-09-12T12:37:44.893 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 52, 2024-09-12T12:37:44.893 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 8532, 2024-09-12T12:37:44.893 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 348479, 2024-09-12T12:37:44.893 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 36, 2024-09-12T12:37:44.893 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 6, 2024-09-12T12:37:44.893 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.015430840, 2024-09-12T12:37:44.894 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.001171376, 2024-09-12T12:37:44.894 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.012992672, 2024-09-12T12:37:44.894 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.000304609, 2024-09-12T12:37:44.894 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:37:44.894 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 48, 2024-09-12T12:37:44.894 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.009921937, 2024-09-12T12:37:44.894 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000206707 2024-09-12T12:37:44.894 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.894 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:37:44.894 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 46, 2024-09-12T12:37:44.894 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000007746, 2024-09-12T12:37:44.894 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000168 2024-09-12T12:37:44.894 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.894 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T12:37:44.895 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T12:37:44.895 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.895 INFO:teuthology.orchestra.run.smithi102.stdout: "cct": { 2024-09-12T12:37:44.895 INFO:teuthology.orchestra.run.smithi102.stdout: "total_workers": 1, 2024-09-12T12:37:44.895 INFO:teuthology.orchestra.run.smithi102.stdout: "unhealthy_workers": 0 2024-09-12T12:37:44.895 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.895 INFO:teuthology.orchestra.run.smithi102.stdout: "finisher-MDSRank": { 2024-09-12T12:37:44.895 INFO:teuthology.orchestra.run.smithi102.stdout: "queue_len": 0, 2024-09-12T12:37:44.895 INFO:teuthology.orchestra.run.smithi102.stdout: "complete_latency": { 2024-09-12T12:37:44.895 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 46, 2024-09-12T12:37:44.895 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.001347830, 2024-09-12T12:37:44.895 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000029300 2024-09-12T12:37:44.895 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T12:37:44.895 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.896 INFO:teuthology.orchestra.run.smithi102.stdout: "finisher-PurgeQueue": { 2024-09-12T12:37:44.896 INFO:teuthology.orchestra.run.smithi102.stdout: "queue_len": 0, 2024-09-12T12:37:44.896 INFO:teuthology.orchestra.run.smithi102.stdout: "complete_latency": { 2024-09-12T12:37:44.896 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 2, 2024-09-12T12:37:44.896 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000012689, 2024-09-12T12:37:44.896 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000006344 2024-09-12T12:37:44.896 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T12:37:44.896 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.896 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": { 2024-09-12T12:37:44.896 INFO:teuthology.orchestra.run.smithi102.stdout: "request": 0, 2024-09-12T12:37:44.896 INFO:teuthology.orchestra.run.smithi102.stdout: "reply": 0, 2024-09-12T12:37:44.896 INFO:teuthology.orchestra.run.smithi102.stdout: "reply_latency": { 2024-09-12T12:37:44.896 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:44.897 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:44.897 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:44.897 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.897 INFO:teuthology.orchestra.run.smithi102.stdout: "slow_reply": 0, 2024-09-12T12:37:44.897 INFO:teuthology.orchestra.run.smithi102.stdout: "forward": 0, 2024-09-12T12:37:44.897 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_fetch_complete": 0, 2024-09-12T12:37:44.897 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_fetch_keys": 0, 2024-09-12T12:37:44.897 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_commit": 11, 2024-09-12T12:37:44.897 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_split": 0, 2024-09-12T12:37:44.897 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_merge": 0, 2024-09-12T12:37:44.897 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes": 10, 2024-09-12T12:37:44.897 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_top": 0, 2024-09-12T12:37:44.897 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_bottom": 10, 2024-09-12T12:37:44.898 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_pin_tail": 0, 2024-09-12T12:37:44.898 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_pinned": 10, 2024-09-12T12:37:44.898 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_expired": 0, 2024-09-12T12:37:44.898 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_with_caps": 0, 2024-09-12T12:37:44.898 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": 0, 2024-09-12T12:37:44.898 INFO:teuthology.orchestra.run.smithi102.stdout: "subtrees": 1, 2024-09-12T12:37:44.898 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse": 0, 2024-09-12T12:37:44.898 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_hit": 0, 2024-09-12T12:37:44.898 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_forward": 0, 2024-09-12T12:37:44.898 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_discover": 0, 2024-09-12T12:37:44.898 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_dir_fetch": 0, 2024-09-12T12:37:44.898 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_remote_ino": 0, 2024-09-12T12:37:44.898 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_lock": 0, 2024-09-12T12:37:44.898 INFO:teuthology.orchestra.run.smithi102.stdout: "load_cent": 0, 2024-09-12T12:37:44.899 INFO:teuthology.orchestra.run.smithi102.stdout: "q": 0, 2024-09-12T12:37:44.899 INFO:teuthology.orchestra.run.smithi102.stdout: "exported": 0, 2024-09-12T12:37:44.899 INFO:teuthology.orchestra.run.smithi102.stdout: "exported_inodes": 0, 2024-09-12T12:37:44.899 INFO:teuthology.orchestra.run.smithi102.stdout: "imported": 0, 2024-09-12T12:37:44.899 INFO:teuthology.orchestra.run.smithi102.stdout: "imported_inodes": 0, 2024-09-12T12:37:44.899 INFO:teuthology.orchestra.run.smithi102.stdout: "openino_dir_fetch": 0, 2024-09-12T12:37:44.899 INFO:teuthology.orchestra.run.smithi102.stdout: "openino_backtrace_fetch": 0, 2024-09-12T12:37:44.899 INFO:teuthology.orchestra.run.smithi102.stdout: "openino_peer_discover": 0, 2024-09-12T12:37:44.899 INFO:teuthology.orchestra.run.smithi102.stdout: "root_rfiles": 22, 2024-09-12T12:37:44.899 INFO:teuthology.orchestra.run.smithi102.stdout: "root_rbytes": 7436767523, 2024-09-12T12:37:44.899 INFO:teuthology.orchestra.run.smithi102.stdout: "root_rsnaps": 0, 2024-09-12T12:37:44.899 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T12:37:44.899 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_set_tag": 0, 2024-09-12T12:37:44.899 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T12:37:44.900 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_inotable_repaired": 0, 2024-09-12T12:37:44.900 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_dir_inodes": 0, 2024-09-12T12:37:44.900 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T12:37:44.900 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T12:37:44.900 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_file_inodes": 0, 2024-09-12T12:37:44.900 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_inode_file_caps": 0, 2024-09-12T12:37:44.900 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T12:37:44.900 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_grant": 0, 2024-09-12T12:37:44.900 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T12:37:44.900 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T12:37:44.900 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T12:37:44.900 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_caps": 0, 2024-09-12T12:37:44.901 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_caps_dirty": 0, 2024-09-12T12:37:44.901 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_cap_release": 0, 2024-09-12T12:37:44.901 INFO:teuthology.orchestra.run.smithi102.stdout: "process_request_cap_release": 0 2024-09-12T12:37:44.901 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.901 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_cache": { 2024-09-12T12:37:44.901 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_update": 0, 2024-09-12T12:37:44.901 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_update_receipt": 0, 2024-09-12T12:37:44.901 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_try_discover": 0, 2024-09-12T12:37:44.901 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_send_discover": 1, 2024-09-12T12:37:44.901 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_handle_discover": 0, 2024-09-12T12:37:44.901 INFO:teuthology.orchestra.run.smithi102.stdout: "num_strays": 0, 2024-09-12T12:37:44.901 INFO:teuthology.orchestra.run.smithi102.stdout: "num_strays_delayed": 0, 2024-09-12T12:37:44.902 INFO:teuthology.orchestra.run.smithi102.stdout: "num_strays_enqueuing": 0, 2024-09-12T12:37:44.902 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_created": 0, 2024-09-12T12:37:44.902 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_enqueued": 0, 2024-09-12T12:37:44.902 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_reintegrated": 0, 2024-09-12T12:37:44.902 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_migrated": 0, 2024-09-12T12:37:44.902 INFO:teuthology.orchestra.run.smithi102.stdout: "num_recovering_processing": 0, 2024-09-12T12:37:44.902 INFO:teuthology.orchestra.run.smithi102.stdout: "num_recovering_enqueued": 0, 2024-09-12T12:37:44.902 INFO:teuthology.orchestra.run.smithi102.stdout: "num_recovering_prioritized": 0, 2024-09-12T12:37:44.902 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_started": 0, 2024-09-12T12:37:44.902 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_completed": 0, 2024-09-12T12:37:44.902 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_quiesce_path": 0, 2024-09-12T12:37:44.902 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_quiesce_inode": 0, 2024-09-12T12:37:44.902 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T12:37:44.902 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_exportdir": 0, 2024-09-12T12:37:44.903 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_flush": 0, 2024-09-12T12:37:44.903 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_fragmentdir": 0, 2024-09-12T12:37:44.903 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_fragstats": 0, 2024-09-12T12:37:44.903 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_inodestats": 0 2024-09-12T12:37:44.903 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.903 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_log": { 2024-09-12T12:37:44.903 INFO:teuthology.orchestra.run.smithi102.stdout: "evlrg": 0, 2024-09-12T12:37:44.903 INFO:teuthology.orchestra.run.smithi102.stdout: "evadd": 3, 2024-09-12T12:37:44.903 INFO:teuthology.orchestra.run.smithi102.stdout: "evex": 0, 2024-09-12T12:37:44.903 INFO:teuthology.orchestra.run.smithi102.stdout: "evtrm": 0, 2024-09-12T12:37:44.903 INFO:teuthology.orchestra.run.smithi102.stdout: "ev": 3, 2024-09-12T12:37:44.903 INFO:teuthology.orchestra.run.smithi102.stdout: "evexg": 0, 2024-09-12T12:37:44.903 INFO:teuthology.orchestra.run.smithi102.stdout: "evexd": 0, 2024-09-12T12:37:44.904 INFO:teuthology.orchestra.run.smithi102.stdout: "segadd": 2, 2024-09-12T12:37:44.904 INFO:teuthology.orchestra.run.smithi102.stdout: "segex": 0, 2024-09-12T12:37:44.904 INFO:teuthology.orchestra.run.smithi102.stdout: "segtrm": 0, 2024-09-12T12:37:44.904 INFO:teuthology.orchestra.run.smithi102.stdout: "seg": 2, 2024-09-12T12:37:44.904 INFO:teuthology.orchestra.run.smithi102.stdout: "segmjr": 2, 2024-09-12T12:37:44.904 INFO:teuthology.orchestra.run.smithi102.stdout: "segexg": 0, 2024-09-12T12:37:44.904 INFO:teuthology.orchestra.run.smithi102.stdout: "segexd": 0, 2024-09-12T12:37:44.904 INFO:teuthology.orchestra.run.smithi102.stdout: "expos": 4194304, 2024-09-12T12:37:44.904 INFO:teuthology.orchestra.run.smithi102.stdout: "wrpos": 4195387, 2024-09-12T12:37:44.904 INFO:teuthology.orchestra.run.smithi102.stdout: "rdpos": 0, 2024-09-12T12:37:44.904 INFO:teuthology.orchestra.run.smithi102.stdout: "jlat": { 2024-09-12T12:37:44.904 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 2, 2024-09-12T12:37:44.904 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.003167091, 2024-09-12T12:37:44.904 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.001583545 2024-09-12T12:37:44.905 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.905 INFO:teuthology.orchestra.run.smithi102.stdout: "replayed": 0 2024-09-12T12:37:44.905 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.905 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_mem": { 2024-09-12T12:37:44.905 INFO:teuthology.orchestra.run.smithi102.stdout: "ino": 13, 2024-09-12T12:37:44.905 INFO:teuthology.orchestra.run.smithi102.stdout: "ino+": 13, 2024-09-12T12:37:44.905 INFO:teuthology.orchestra.run.smithi102.stdout: "ino-": 0, 2024-09-12T12:37:44.905 INFO:teuthology.orchestra.run.smithi102.stdout: "dir": 11, 2024-09-12T12:37:44.905 INFO:teuthology.orchestra.run.smithi102.stdout: "dir+": 12, 2024-09-12T12:37:44.905 INFO:teuthology.orchestra.run.smithi102.stdout: "dir-": 1, 2024-09-12T12:37:44.905 INFO:teuthology.orchestra.run.smithi102.stdout: "dn": 10, 2024-09-12T12:37:44.905 INFO:teuthology.orchestra.run.smithi102.stdout: "dn+": 10, 2024-09-12T12:37:44.905 INFO:teuthology.orchestra.run.smithi102.stdout: "dn-": 0, 2024-09-12T12:37:44.906 INFO:teuthology.orchestra.run.smithi102.stdout: "cap": 0, 2024-09-12T12:37:44.906 INFO:teuthology.orchestra.run.smithi102.stdout: "cap+": 0, 2024-09-12T12:37:44.906 INFO:teuthology.orchestra.run.smithi102.stdout: "cap-": 0, 2024-09-12T12:37:44.906 INFO:teuthology.orchestra.run.smithi102.stdout: "rss": 49688, 2024-09-12T12:37:44.906 INFO:teuthology.orchestra.run.smithi102.stdout: "heap": 223520 2024-09-12T12:37:44.906 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.906 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_server": { 2024-09-12T12:37:44.906 INFO:teuthology.orchestra.run.smithi102.stdout: "dispatch_client_request": 0, 2024-09-12T12:37:44.906 INFO:teuthology.orchestra.run.smithi102.stdout: "dispatch_server_request": 0, 2024-09-12T12:37:44.906 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_request": 0, 2024-09-12T12:37:44.906 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_session": 9, 2024-09-12T12:37:44.906 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_peer_request": 0, 2024-09-12T12:37:44.906 INFO:teuthology.orchestra.run.smithi102.stdout: "req_create_latency": { 2024-09-12T12:37:44.907 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:44.907 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:44.907 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:44.907 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.907 INFO:teuthology.orchestra.run.smithi102.stdout: "req_getattr_latency": { 2024-09-12T12:37:44.907 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:44.907 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:44.907 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:44.907 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.907 INFO:teuthology.orchestra.run.smithi102.stdout: "req_getfilelock_latency": { 2024-09-12T12:37:44.907 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:44.907 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:44.908 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:44.908 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.908 INFO:teuthology.orchestra.run.smithi102.stdout: "req_link_latency": { 2024-09-12T12:37:44.908 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:44.908 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:44.908 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:44.908 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.908 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookup_latency": { 2024-09-12T12:37:44.908 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:44.908 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:44.908 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:44.908 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.908 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookuphash_latency": { 2024-09-12T12:37:44.909 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:44.909 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:44.909 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:44.909 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.909 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupino_latency": { 2024-09-12T12:37:44.909 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:44.909 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:44.909 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:44.909 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.909 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupname_latency": { 2024-09-12T12:37:44.909 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:44.909 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:44.909 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:44.910 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.910 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupparent_latency": { 2024-09-12T12:37:44.910 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:44.910 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:44.910 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:44.910 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.910 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupsnap_latency": { 2024-09-12T12:37:44.910 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:44.910 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:44.910 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:44.910 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.910 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lssnap_latency": { 2024-09-12T12:37:44.910 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:44.910 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:44.911 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:44.911 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.911 INFO:teuthology.orchestra.run.smithi102.stdout: "req_mkdir_latency": { 2024-09-12T12:37:44.911 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:44.912 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:44.912 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:44.912 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.912 INFO:teuthology.orchestra.run.smithi102.stdout: "req_mknod_latency": { 2024-09-12T12:37:44.912 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:44.912 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:44.912 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:44.912 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.912 INFO:teuthology.orchestra.run.smithi102.stdout: "req_mksnap_latency": { 2024-09-12T12:37:44.912 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:44.912 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:44.912 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:44.913 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.913 INFO:teuthology.orchestra.run.smithi102.stdout: "req_open_latency": { 2024-09-12T12:37:44.913 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:44.913 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:44.913 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:44.913 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.913 INFO:teuthology.orchestra.run.smithi102.stdout: "req_readdir_latency": { 2024-09-12T12:37:44.913 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:44.913 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:44.913 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:44.913 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.913 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rename_latency": { 2024-09-12T12:37:44.913 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:44.914 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:44.914 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:44.914 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.914 INFO:teuthology.orchestra.run.smithi102.stdout: "req_renamesnap_latency": { 2024-09-12T12:37:44.914 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:44.914 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:44.914 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:44.914 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.914 INFO:teuthology.orchestra.run.smithi102.stdout: "req_snapdiff_latency": { 2024-09-12T12:37:44.914 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:44.914 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:44.914 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:44.914 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.915 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rmdir_latency": { 2024-09-12T12:37:44.915 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:44.915 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:44.915 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:44.915 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.915 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rmsnap_latency": { 2024-09-12T12:37:44.915 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:44.915 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:44.915 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:44.915 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.915 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rmxattr_latency": { 2024-09-12T12:37:44.915 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:44.915 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:44.916 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:44.916 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.916 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setattr_latency": { 2024-09-12T12:37:44.916 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:44.916 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:44.916 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:44.916 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.916 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setdirlayout_latency": { 2024-09-12T12:37:44.916 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:44.916 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:44.916 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:44.916 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.916 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setfilelock_latency": { 2024-09-12T12:37:44.917 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:44.917 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:44.917 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:44.917 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.917 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setlayout_latency": { 2024-09-12T12:37:44.917 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:44.917 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:44.917 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:44.917 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.917 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setxattr_latency": { 2024-09-12T12:37:44.917 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:44.917 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:44.917 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:44.918 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.918 INFO:teuthology.orchestra.run.smithi102.stdout: "req_symlink_latency": { 2024-09-12T12:37:44.918 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:44.918 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:44.918 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:44.918 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.918 INFO:teuthology.orchestra.run.smithi102.stdout: "req_unlink_latency": { 2024-09-12T12:37:44.918 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:44.918 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:44.918 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:44.918 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.918 INFO:teuthology.orchestra.run.smithi102.stdout: "cap_revoke_eviction": 0, 2024-09-12T12:37:44.918 INFO:teuthology.orchestra.run.smithi102.stdout: "cap_acquisition_throttle": 0, 2024-09-12T12:37:44.918 INFO:teuthology.orchestra.run.smithi102.stdout: "req_getvxattr_latency": { 2024-09-12T12:37:44.919 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:44.919 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:44.919 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:44.919 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T12:37:44.919 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.919 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_sessions": { 2024-09-12T12:37:44.919 INFO:teuthology.orchestra.run.smithi102.stdout: "session_count": 1, 2024-09-12T12:37:44.919 INFO:teuthology.orchestra.run.smithi102.stdout: "session_add": 1, 2024-09-12T12:37:44.919 INFO:teuthology.orchestra.run.smithi102.stdout: "session_remove": 0, 2024-09-12T12:37:44.919 INFO:teuthology.orchestra.run.smithi102.stdout: "sessions_open": 1, 2024-09-12T12:37:44.919 INFO:teuthology.orchestra.run.smithi102.stdout: "sessions_stale": 0, 2024-09-12T12:37:44.919 INFO:teuthology.orchestra.run.smithi102.stdout: "total_load": 0, 2024-09-12T12:37:44.920 INFO:teuthology.orchestra.run.smithi102.stdout: "average_load": 0, 2024-09-12T12:37:44.920 INFO:teuthology.orchestra.run.smithi102.stdout: "avg_session_uptime": 699, 2024-09-12T12:37:44.920 INFO:teuthology.orchestra.run.smithi102.stdout: "mdthresh_evicted": 0 2024-09-12T12:37:44.920 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.920 INFO:teuthology.orchestra.run.smithi102.stdout: "mempool": { 2024-09-12T12:37:44.920 INFO:teuthology.orchestra.run.smithi102.stdout: "bloom_filter_bytes": 0, 2024-09-12T12:37:44.920 INFO:teuthology.orchestra.run.smithi102.stdout: "bloom_filter_items": 0, 2024-09-12T12:37:44.920 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T12:37:44.920 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_alloc_items": 0, 2024-09-12T12:37:44.920 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T12:37:44.920 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_data_items": 0, 2024-09-12T12:37:44.920 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T12:37:44.920 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T12:37:44.921 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T12:37:44.921 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T12:37:44.921 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T12:37:44.921 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_other_items": 0, 2024-09-12T12:37:44.921 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T12:37:44.921 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T12:37:44.921 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_bytes": 0, 2024-09-12T12:37:44.921 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_items": 0, 2024-09-12T12:37:44.921 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_blob_bytes": 0, 2024-09-12T12:37:44.921 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_blob_items": 0, 2024-09-12T12:37:44.921 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T12:37:44.921 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T12:37:44.922 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T12:37:44.922 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T12:37:44.922 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T12:37:44.922 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_items": 0, 2024-09-12T12:37:44.922 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_txc_bytes": 0, 2024-09-12T12:37:44.922 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_txc_items": 0, 2024-09-12T12:37:44.922 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T12:37:44.922 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T12:37:44.922 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_bytes": 0, 2024-09-12T12:37:44.922 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_items": 0, 2024-09-12T12:37:44.922 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_bytes": 0, 2024-09-12T12:37:44.922 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_items": 0, 2024-09-12T12:37:44.922 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T12:37:44.922 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_reader_items": 0, 2024-09-12T12:37:44.923 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T12:37:44.923 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_writer_items": 0, 2024-09-12T12:37:44.923 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_anon_bytes": 230151, 2024-09-12T12:37:44.923 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_anon_items": 75, 2024-09-12T12:37:44.923 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_meta_bytes": 0, 2024-09-12T12:37:44.923 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_meta_items": 0, 2024-09-12T12:37:44.923 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_bytes": 0, 2024-09-12T12:37:44.923 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_items": 0, 2024-09-12T12:37:44.923 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mapbl_bytes": 0, 2024-09-12T12:37:44.923 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mapbl_items": 0, 2024-09-12T12:37:44.923 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pglog_bytes": 0, 2024-09-12T12:37:44.923 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pglog_items": 0, 2024-09-12T12:37:44.923 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_bytes": 8856, 2024-09-12T12:37:44.924 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_items": 166, 2024-09-12T12:37:44.924 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T12:37:44.924 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_mapping_items": 0, 2024-09-12T12:37:44.924 INFO:teuthology.orchestra.run.smithi102.stdout: "pgmap_bytes": 0, 2024-09-12T12:37:44.924 INFO:teuthology.orchestra.run.smithi102.stdout: "pgmap_items": 0, 2024-09-12T12:37:44.924 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_co_bytes": 50872, 2024-09-12T12:37:44.924 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_co_items": 198, 2024-09-12T12:37:44.924 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_1_bytes": 0, 2024-09-12T12:37:44.924 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_1_items": 0, 2024-09-12T12:37:44.924 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_2_bytes": 0, 2024-09-12T12:37:44.924 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_2_items": 0 2024-09-12T12:37:44.924 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.924 INFO:teuthology.orchestra.run.smithi102.stdout: "objecter": { 2024-09-12T12:37:44.925 INFO:teuthology.orchestra.run.smithi102.stdout: "op_active": 0, 2024-09-12T12:37:44.925 INFO:teuthology.orchestra.run.smithi102.stdout: "op_laggy": 0, 2024-09-12T12:37:44.925 INFO:teuthology.orchestra.run.smithi102.stdout: "op_send": 37, 2024-09-12T12:37:44.925 INFO:teuthology.orchestra.run.smithi102.stdout: "op_send_bytes": 11295, 2024-09-12T12:37:44.925 INFO:teuthology.orchestra.run.smithi102.stdout: "op_resend": 33, 2024-09-12T12:37:44.925 INFO:teuthology.orchestra.run.smithi102.stdout: "op_reply": 37, 2024-09-12T12:37:44.925 INFO:teuthology.orchestra.run.smithi102.stdout: "op_latency": { 2024-09-12T12:37:44.925 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 37, 2024-09-12T12:37:44.925 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.214995533, 2024-09-12T12:37:44.925 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.005810690 2024-09-12T12:37:44.925 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.925 INFO:teuthology.orchestra.run.smithi102.stdout: "op_inflight": 0, 2024-09-12T12:37:44.926 INFO:teuthology.orchestra.run.smithi102.stdout: "oplen_avg": { 2024-09-12T12:37:44.926 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 37, 2024-09-12T12:37:44.926 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 59 2024-09-12T12:37:44.926 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.926 INFO:teuthology.orchestra.run.smithi102.stdout: "op": 37, 2024-09-12T12:37:44.926 INFO:teuthology.orchestra.run.smithi102.stdout: "op_r": 0, 2024-09-12T12:37:44.926 INFO:teuthology.orchestra.run.smithi102.stdout: "op_w": 37, 2024-09-12T12:37:44.926 INFO:teuthology.orchestra.run.smithi102.stdout: "op_rmw": 0, 2024-09-12T12:37:44.926 INFO:teuthology.orchestra.run.smithi102.stdout: "op_pg": 0, 2024-09-12T12:37:44.926 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_stat": 0, 2024-09-12T12:37:44.926 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_create": 10, 2024-09-12T12:37:44.926 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_read": 0, 2024-09-12T12:37:44.926 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_write": 2, 2024-09-12T12:37:44.926 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_writefull": 6, 2024-09-12T12:37:44.927 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_writesame": 0, 2024-09-12T12:37:44.927 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_append": 0, 2024-09-12T12:37:44.927 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_zero": 0, 2024-09-12T12:37:44.927 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_truncate": 0, 2024-09-12T12:37:44.927 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_delete": 6, 2024-09-12T12:37:44.927 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_mapext": 0, 2024-09-12T12:37:44.927 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_sparse_read": 0, 2024-09-12T12:37:44.927 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_clonerange": 0, 2024-09-12T12:37:44.927 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_getxattr": 0, 2024-09-12T12:37:44.927 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_setxattr": 20, 2024-09-12T12:37:44.927 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_cmpxattr": 0, 2024-09-12T12:37:44.927 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_rmxattr": 0, 2024-09-12T12:37:44.927 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_resetxattrs": 0, 2024-09-12T12:37:44.928 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_call": 0, 2024-09-12T12:37:44.928 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_watch": 0, 2024-09-12T12:37:44.928 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_notify": 0, 2024-09-12T12:37:44.928 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T12:37:44.928 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_pgls": 0, 2024-09-12T12:37:44.928 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_pgls_filter": 0, 2024-09-12T12:37:44.928 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_other": 0, 2024-09-12T12:37:44.928 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_active": 0, 2024-09-12T12:37:44.928 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_send": 0, 2024-09-12T12:37:44.928 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_resend": 0, 2024-09-12T12:37:44.928 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_ping": 0, 2024-09-12T12:37:44.928 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_active": 0, 2024-09-12T12:37:44.928 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_send": 0, 2024-09-12T12:37:44.929 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_resend": 0, 2024-09-12T12:37:44.929 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_active": 0, 2024-09-12T12:37:44.929 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_send": 0, 2024-09-12T12:37:44.929 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_resend": 0, 2024-09-12T12:37:44.929 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_active": 0, 2024-09-12T12:37:44.929 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_send": 0, 2024-09-12T12:37:44.929 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_resend": 0, 2024-09-12T12:37:44.929 INFO:teuthology.orchestra.run.smithi102.stdout: "command_active": 0, 2024-09-12T12:37:44.929 INFO:teuthology.orchestra.run.smithi102.stdout: "command_send": 0, 2024-09-12T12:37:44.929 INFO:teuthology.orchestra.run.smithi102.stdout: "command_resend": 0, 2024-09-12T12:37:44.929 INFO:teuthology.orchestra.run.smithi102.stdout: "map_epoch": 89, 2024-09-12T12:37:44.929 INFO:teuthology.orchestra.run.smithi102.stdout: "map_full": 0, 2024-09-12T12:37:44.929 INFO:teuthology.orchestra.run.smithi102.stdout: "map_inc": 4, 2024-09-12T12:37:44.930 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_sessions": 8, 2024-09-12T12:37:44.930 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_session_open": 8, 2024-09-12T12:37:44.930 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_session_close": 0, 2024-09-12T12:37:44.930 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_laggy": 0, 2024-09-12T12:37:44.930 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_wr": 14, 2024-09-12T12:37:44.930 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_rd": 0, 2024-09-12T12:37:44.930 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_del": 1 2024-09-12T12:37:44.930 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.930 INFO:teuthology.orchestra.run.smithi102.stdout: "oft": { 2024-09-12T12:37:44.930 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_objs": 1, 2024-09-12T12:37:44.930 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_kv_pairs": 0, 2024-09-12T12:37:44.930 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_updates": 0, 2024-09-12T12:37:44.930 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_removes": 0 2024-09-12T12:37:44.931 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.931 INFO:teuthology.orchestra.run.smithi102.stdout: "osd-slow-ops": { 2024-09-12T12:37:44.931 INFO:teuthology.orchestra.run.smithi102.stdout: "slow_ops_count": 0 2024-09-12T12:37:44.931 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.931 INFO:teuthology.orchestra.run.smithi102.stdout: "purge_queue": { 2024-09-12T12:37:44.931 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing_ops": 0, 2024-09-12T12:37:44.931 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T12:37:44.931 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing": 0, 2024-09-12T12:37:44.931 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing_high_water": 0, 2024-09-12T12:37:44.932 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executed_ops": 0, 2024-09-12T12:37:44.932 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executed": 0, 2024-09-12T12:37:44.932 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_item_in_journal": 0 2024-09-12T12:37:44.932 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.932 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T12:37:44.932 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-12T12:37:44.932 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 104857600, 2024-09-12T12:37:44.932 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-12T12:37:44.932 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 736, 2024-09-12T12:37:44.932 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 576538, 2024-09-12T12:37:44.932 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-12T12:37:44.932 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 736, 2024-09-12T12:37:44.933 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-09-12T12:37:44.933 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-09-12T12:37:44.933 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 736, 2024-09-12T12:37:44.933 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 576538, 2024-09-12T12:37:44.933 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-12T12:37:44.933 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:44.933 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:44.933 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:44.933 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T12:37:44.933 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.933 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-objecter_bytes": { 2024-09-12T12:37:44.933 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-12T12:37:44.933 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 104857600, 2024-09-12T12:37:44.933 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-12T12:37:44.934 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 0, 2024-09-12T12:37:44.934 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2024-09-12T12:37:44.934 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-12T12:37:44.934 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 0, 2024-09-12T12:37:44.934 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 37, 2024-09-12T12:37:44.934 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 11295, 2024-09-12T12:37:44.934 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 37, 2024-09-12T12:37:44.934 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 11295, 2024-09-12T12:37:44.934 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-12T12:37:44.934 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:44.934 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:44.934 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:44.934 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T12:37:44.934 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.935 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-objecter_ops": { 2024-09-12T12:37:44.935 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-12T12:37:44.935 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 1024, 2024-09-12T12:37:44.935 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-12T12:37:44.935 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 0, 2024-09-12T12:37:44.935 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2024-09-12T12:37:44.935 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-12T12:37:44.935 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 0, 2024-09-12T12:37:44.935 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 37, 2024-09-12T12:37:44.935 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 37, 2024-09-12T12:37:44.935 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 37, 2024-09-12T12:37:44.935 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 37, 2024-09-12T12:37:44.936 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-12T12:37:44.936 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:44.936 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:44.936 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:44.936 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T12:37:44.936 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.936 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-write_buf_throttle": { 2024-09-12T12:37:44.936 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-12T12:37:44.936 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 3758096384, 2024-09-12T12:37:44.936 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-12T12:37:44.936 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 0, 2024-09-12T12:37:44.936 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2024-09-12T12:37:44.937 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-12T12:37:44.937 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 0, 2024-09-12T12:37:44.937 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-09-12T12:37:44.937 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-09-12T12:37:44.937 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 0, 2024-09-12T12:37:44.937 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 0, 2024-09-12T12:37:44.937 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-12T12:37:44.937 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:44.937 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:44.937 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:44.937 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T12:37:44.937 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:44.937 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-write_buf_throttle-0x55b216052960": { 2024-09-12T12:37:44.938 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-12T12:37:44.938 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 3758096384, 2024-09-12T12:37:44.938 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-12T12:37:44.938 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 3, 2024-09-12T12:37:44.938 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 1083, 2024-09-12T12:37:44.938 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-12T12:37:44.938 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 3, 2024-09-12T12:37:44.938 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-09-12T12:37:44.938 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-09-12T12:37:44.938 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 2, 2024-09-12T12:37:44.938 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 1083, 2024-09-12T12:37:44.938 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-12T12:37:44.938 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:44.939 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:44.939 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:44.939 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T12:37:44.939 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T12:37:44.939 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-12T12:37:45.705 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-12T12:37:45.705 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-12T12:37:45.705 DEBUG:tasks.check_counter:Getting stats from i 2024-09-12T12:37:45.705 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-12T12:37:45.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:45 smithi043 ceph-mon[34144]: pgmap v702: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T12:37:45.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:45 smithi102 ceph-mon[34799]: pgmap v702: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T12:37:45.951 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:37:45.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:45 smithi033 ceph-mon[31246]: pgmap v702: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T12:37:46.482 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-12T12:37:46.483 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T12:37:46.483 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 1772, 2024-09-12T12:37:46.483 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 1565, 2024-09-12T12:37:46.483 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 524663, 2024-09-12T12:37:46.483 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 2332988, 2024-09-12T12:37:46.483 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 104, 2024-09-12T12:37:46.483 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 4, 2024-09-12T12:37:46.483 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.178377071, 2024-09-12T12:37:46.483 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.047506191, 2024-09-12T12:37:46.483 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.089816996, 2024-09-12T12:37:46.483 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.035606269, 2024-09-12T12:37:46.483 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:37:46.483 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 1564, 2024-09-12T12:37:46.483 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.234694909, 2024-09-12T12:37:46.484 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000150060 2024-09-12T12:37:46.484 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.484 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:37:46.484 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 909, 2024-09-12T12:37:46.484 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000170579, 2024-09-12T12:37:46.484 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000187 2024-09-12T12:37:46.484 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.484 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-12T12:37:46.484 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T12:37:46.484 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.484 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T12:37:46.484 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 2066, 2024-09-12T12:37:46.484 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 1646, 2024-09-12T12:37:46.485 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 683025, 2024-09-12T12:37:46.485 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 945910, 2024-09-12T12:37:46.485 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 12, 2024-09-12T12:37:46.485 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 5, 2024-09-12T12:37:46.485 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.184071406, 2024-09-12T12:37:46.485 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.046023353, 2024-09-12T12:37:46.485 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.064601019, 2024-09-12T12:37:46.485 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.067426777, 2024-09-12T12:37:46.485 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:37:46.485 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 1644, 2024-09-12T12:37:46.485 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.268241577, 2024-09-12T12:37:46.485 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000163163 2024-09-12T12:37:46.485 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.486 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:37:46.486 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 1498, 2024-09-12T12:37:46.486 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000243565, 2024-09-12T12:37:46.486 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000162 2024-09-12T12:37:46.486 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.486 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 56000, 2024-09-12T12:37:46.486 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 423472 2024-09-12T12:37:46.486 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.486 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T12:37:46.486 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 2559, 2024-09-12T12:37:46.486 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 2444, 2024-09-12T12:37:46.486 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 1206051, 2024-09-12T12:37:46.486 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 892308, 2024-09-12T12:37:46.487 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 12, 2024-09-12T12:37:46.487 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 6, 2024-09-12T12:37:46.487 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.207608740, 2024-09-12T12:37:46.487 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.077559493, 2024-09-12T12:37:46.487 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.099069400, 2024-09-12T12:37:46.487 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.040200143, 2024-09-12T12:37:46.487 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:37:46.487 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 2443, 2024-09-12T12:37:46.487 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.319997609, 2024-09-12T12:37:46.487 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000130985 2024-09-12T12:37:46.487 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.487 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:37:46.487 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 1193, 2024-09-12T12:37:46.488 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000252068, 2024-09-12T12:37:46.488 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000211 2024-09-12T12:37:46.488 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.488 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 547232, 2024-09-12T12:37:46.488 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 162736 2024-09-12T12:37:46.488 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.488 INFO:teuthology.orchestra.run.smithi102.stdout: "cct": { 2024-09-12T12:37:46.488 INFO:teuthology.orchestra.run.smithi102.stdout: "total_workers": 1, 2024-09-12T12:37:46.488 INFO:teuthology.orchestra.run.smithi102.stdout: "unhealthy_workers": 0 2024-09-12T12:37:46.488 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.488 INFO:teuthology.orchestra.run.smithi102.stdout: "finisher-MDSRank": { 2024-09-12T12:37:46.489 INFO:teuthology.orchestra.run.smithi102.stdout: "queue_len": 0, 2024-09-12T12:37:46.489 INFO:teuthology.orchestra.run.smithi102.stdout: "complete_latency": { 2024-09-12T12:37:46.489 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 681, 2024-09-12T12:37:46.489 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.168653838, 2024-09-12T12:37:46.489 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000247656 2024-09-12T12:37:46.489 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T12:37:46.489 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.489 INFO:teuthology.orchestra.run.smithi102.stdout: "finisher-PurgeQueue": { 2024-09-12T12:37:46.489 INFO:teuthology.orchestra.run.smithi102.stdout: "queue_len": 0, 2024-09-12T12:37:46.489 INFO:teuthology.orchestra.run.smithi102.stdout: "complete_latency": { 2024-09-12T12:37:46.489 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 2487, 2024-09-12T12:37:46.489 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.084409854, 2024-09-12T12:37:46.490 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000033940 2024-09-12T12:37:46.490 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T12:37:46.490 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.490 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": { 2024-09-12T12:37:46.490 INFO:teuthology.orchestra.run.smithi102.stdout: "request": 112, 2024-09-12T12:37:46.490 INFO:teuthology.orchestra.run.smithi102.stdout: "reply": 110, 2024-09-12T12:37:46.490 INFO:teuthology.orchestra.run.smithi102.stdout: "reply_latency": { 2024-09-12T12:37:46.490 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 110, 2024-09-12T12:37:46.490 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.146422333, 2024-09-12T12:37:46.490 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.001331112 2024-09-12T12:37:46.490 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.490 INFO:teuthology.orchestra.run.smithi102.stdout: "slow_reply": 0, 2024-09-12T12:37:46.490 INFO:teuthology.orchestra.run.smithi102.stdout: "forward": 2, 2024-09-12T12:37:46.490 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_fetch_complete": 0, 2024-09-12T12:37:46.491 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_fetch_keys": 0, 2024-09-12T12:37:46.491 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_commit": 12, 2024-09-12T12:37:46.491 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_split": 0, 2024-09-12T12:37:46.491 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_merge": 0, 2024-09-12T12:37:46.491 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes": 23, 2024-09-12T12:37:46.491 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_top": 0, 2024-09-12T12:37:46.491 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_bottom": 23, 2024-09-12T12:37:46.491 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_pin_tail": 0, 2024-09-12T12:37:46.491 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_pinned": 23, 2024-09-12T12:37:46.491 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_expired": 2, 2024-09-12T12:37:46.491 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_with_caps": 2, 2024-09-12T12:37:46.491 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": 2, 2024-09-12T12:37:46.491 INFO:teuthology.orchestra.run.smithi102.stdout: "subtrees": 2, 2024-09-12T12:37:46.492 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse": 174, 2024-09-12T12:37:46.492 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_hit": 158, 2024-09-12T12:37:46.492 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_forward": 0, 2024-09-12T12:37:46.492 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_discover": 0, 2024-09-12T12:37:46.492 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_dir_fetch": 0, 2024-09-12T12:37:46.492 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_remote_ino": 0, 2024-09-12T12:37:46.492 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_lock": 0, 2024-09-12T12:37:46.492 INFO:teuthology.orchestra.run.smithi102.stdout: "load_cent": 28, 2024-09-12T12:37:46.492 INFO:teuthology.orchestra.run.smithi102.stdout: "q": 0, 2024-09-12T12:37:46.492 INFO:teuthology.orchestra.run.smithi102.stdout: "exported": 1, 2024-09-12T12:37:46.492 INFO:teuthology.orchestra.run.smithi102.stdout: "exported_inodes": 2, 2024-09-12T12:37:46.492 INFO:teuthology.orchestra.run.smithi102.stdout: "imported": 1, 2024-09-12T12:37:46.492 INFO:teuthology.orchestra.run.smithi102.stdout: "imported_inodes": 0, 2024-09-12T12:37:46.493 INFO:teuthology.orchestra.run.smithi102.stdout: "openino_dir_fetch": 0, 2024-09-12T12:37:46.493 INFO:teuthology.orchestra.run.smithi102.stdout: "openino_backtrace_fetch": 334, 2024-09-12T12:37:46.493 INFO:teuthology.orchestra.run.smithi102.stdout: "openino_peer_discover": 0, 2024-09-12T12:37:46.493 INFO:teuthology.orchestra.run.smithi102.stdout: "root_rfiles": 4, 2024-09-12T12:37:46.493 INFO:teuthology.orchestra.run.smithi102.stdout: "root_rbytes": 234, 2024-09-12T12:37:46.493 INFO:teuthology.orchestra.run.smithi102.stdout: "root_rsnaps": 0, 2024-09-12T12:37:46.493 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_backtrace_fetch": 334, 2024-09-12T12:37:46.493 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_set_tag": 0, 2024-09-12T12:37:46.493 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T12:37:46.493 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_inotable_repaired": 0, 2024-09-12T12:37:46.493 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_dir_inodes": 126, 2024-09-12T12:37:46.493 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_dir_base_inodes": 12, 2024-09-12T12:37:46.493 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_dirfrag_rstats": 114, 2024-09-12T12:37:46.494 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_file_inodes": 208, 2024-09-12T12:37:46.494 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_inode_file_caps": 0, 2024-09-12T12:37:46.494 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_revoke": 40, 2024-09-12T12:37:46.494 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_grant": 133, 2024-09-12T12:37:46.494 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T12:37:46.494 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T12:37:46.494 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T12:37:46.494 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_caps": 177, 2024-09-12T12:37:46.494 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_caps_dirty": 143, 2024-09-12T12:37:46.494 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_cap_release": 3, 2024-09-12T12:37:46.495 INFO:teuthology.orchestra.run.smithi102.stdout: "process_request_cap_release": 79 2024-09-12T12:37:46.495 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.495 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_cache": { 2024-09-12T12:37:46.495 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_update": 0, 2024-09-12T12:37:46.495 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_update_receipt": 0, 2024-09-12T12:37:46.495 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_try_discover": 0, 2024-09-12T12:37:46.495 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_send_discover": 0, 2024-09-12T12:37:46.495 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_handle_discover": 5, 2024-09-12T12:37:46.495 INFO:teuthology.orchestra.run.smithi102.stdout: "num_strays": 0, 2024-09-12T12:37:46.495 INFO:teuthology.orchestra.run.smithi102.stdout: "num_strays_delayed": 0, 2024-09-12T12:37:46.495 INFO:teuthology.orchestra.run.smithi102.stdout: "num_strays_enqueuing": 0, 2024-09-12T12:37:46.495 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_created": 20, 2024-09-12T12:37:46.495 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_enqueued": 20, 2024-09-12T12:37:46.496 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_reintegrated": 0, 2024-09-12T12:37:46.496 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_migrated": 0, 2024-09-12T12:37:46.496 INFO:teuthology.orchestra.run.smithi102.stdout: "num_recovering_processing": 0, 2024-09-12T12:37:46.496 INFO:teuthology.orchestra.run.smithi102.stdout: "num_recovering_enqueued": 0, 2024-09-12T12:37:46.496 INFO:teuthology.orchestra.run.smithi102.stdout: "num_recovering_prioritized": 0, 2024-09-12T12:37:46.496 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_started": 0, 2024-09-12T12:37:46.496 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_completed": 0, 2024-09-12T12:37:46.496 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_quiesce_path": 0, 2024-09-12T12:37:46.496 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_quiesce_inode": 0, 2024-09-12T12:37:46.496 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_enqueue_scrub": 12, 2024-09-12T12:37:46.496 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_exportdir": 1, 2024-09-12T12:37:46.496 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_flush": 0, 2024-09-12T12:37:46.497 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_fragmentdir": 0, 2024-09-12T12:37:46.497 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_fragstats": 0, 2024-09-12T12:37:46.497 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_inodestats": 0 2024-09-12T12:37:46.497 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.497 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_log": { 2024-09-12T12:37:46.497 INFO:teuthology.orchestra.run.smithi102.stdout: "evlrg": 0, 2024-09-12T12:37:46.497 INFO:teuthology.orchestra.run.smithi102.stdout: "evadd": 276, 2024-09-12T12:37:46.497 INFO:teuthology.orchestra.run.smithi102.stdout: "evex": 0, 2024-09-12T12:37:46.497 INFO:teuthology.orchestra.run.smithi102.stdout: "evtrm": 0, 2024-09-12T12:37:46.497 INFO:teuthology.orchestra.run.smithi102.stdout: "ev": 276, 2024-09-12T12:37:46.497 INFO:teuthology.orchestra.run.smithi102.stdout: "evexg": 0, 2024-09-12T12:37:46.497 INFO:teuthology.orchestra.run.smithi102.stdout: "evexd": 0, 2024-09-12T12:37:46.497 INFO:teuthology.orchestra.run.smithi102.stdout: "segadd": 2, 2024-09-12T12:37:46.497 INFO:teuthology.orchestra.run.smithi102.stdout: "segex": 0, 2024-09-12T12:37:46.498 INFO:teuthology.orchestra.run.smithi102.stdout: "segtrm": 0, 2024-09-12T12:37:46.498 INFO:teuthology.orchestra.run.smithi102.stdout: "seg": 2, 2024-09-12T12:37:46.498 INFO:teuthology.orchestra.run.smithi102.stdout: "segmjr": 2, 2024-09-12T12:37:46.498 INFO:teuthology.orchestra.run.smithi102.stdout: "segexg": 0, 2024-09-12T12:37:46.498 INFO:teuthology.orchestra.run.smithi102.stdout: "segexd": 0, 2024-09-12T12:37:46.498 INFO:teuthology.orchestra.run.smithi102.stdout: "expos": 4194304, 2024-09-12T12:37:46.498 INFO:teuthology.orchestra.run.smithi102.stdout: "wrpos": 4917200, 2024-09-12T12:37:46.498 INFO:teuthology.orchestra.run.smithi102.stdout: "rdpos": 0, 2024-09-12T12:37:46.498 INFO:teuthology.orchestra.run.smithi102.stdout: "jlat": { 2024-09-12T12:37:46.498 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 152, 2024-09-12T12:37:46.498 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.384596440, 2024-09-12T12:37:46.498 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.002530239 2024-09-12T12:37:46.498 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.498 INFO:teuthology.orchestra.run.smithi102.stdout: "replayed": 0 2024-09-12T12:37:46.499 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.499 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_mem": { 2024-09-12T12:37:46.499 INFO:teuthology.orchestra.run.smithi102.stdout: "ino": 23, 2024-09-12T12:37:46.499 INFO:teuthology.orchestra.run.smithi102.stdout: "ino+": 57, 2024-09-12T12:37:46.499 INFO:teuthology.orchestra.run.smithi102.stdout: "ino-": 34, 2024-09-12T12:37:46.499 INFO:teuthology.orchestra.run.smithi102.stdout: "dir": 18, 2024-09-12T12:37:46.499 INFO:teuthology.orchestra.run.smithi102.stdout: "dir+": 22, 2024-09-12T12:37:46.499 INFO:teuthology.orchestra.run.smithi102.stdout: "dir-": 4, 2024-09-12T12:37:46.499 INFO:teuthology.orchestra.run.smithi102.stdout: "dn": 23, 2024-09-12T12:37:46.499 INFO:teuthology.orchestra.run.smithi102.stdout: "dn+": 64, 2024-09-12T12:37:46.499 INFO:teuthology.orchestra.run.smithi102.stdout: "dn-": 41, 2024-09-12T12:37:46.499 INFO:teuthology.orchestra.run.smithi102.stdout: "cap": 2, 2024-09-12T12:37:46.499 INFO:teuthology.orchestra.run.smithi102.stdout: "cap+": 36, 2024-09-12T12:37:46.499 INFO:teuthology.orchestra.run.smithi102.stdout: "cap-": 34, 2024-09-12T12:37:46.499 INFO:teuthology.orchestra.run.smithi102.stdout: "rss": 55232, 2024-09-12T12:37:46.500 INFO:teuthology.orchestra.run.smithi102.stdout: "heap": 231712 2024-09-12T12:37:46.500 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.500 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_server": { 2024-09-12T12:37:46.500 INFO:teuthology.orchestra.run.smithi102.stdout: "dispatch_client_request": 162, 2024-09-12T12:37:46.500 INFO:teuthology.orchestra.run.smithi102.stdout: "dispatch_server_request": 3, 2024-09-12T12:37:46.500 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_request": 112, 2024-09-12T12:37:46.500 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_session": 20, 2024-09-12T12:37:46.500 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_peer_request": 8, 2024-09-12T12:37:46.500 INFO:teuthology.orchestra.run.smithi102.stdout: "req_create_latency": { 2024-09-12T12:37:46.500 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 22, 2024-09-12T12:37:46.500 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.019424695, 2024-09-12T12:37:46.500 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000882940 2024-09-12T12:37:46.500 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.500 INFO:teuthology.orchestra.run.smithi102.stdout: "req_getattr_latency": { 2024-09-12T12:37:46.501 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 40, 2024-09-12T12:37:46.501 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.009806638, 2024-09-12T12:37:46.501 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000245165 2024-09-12T12:37:46.501 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.501 INFO:teuthology.orchestra.run.smithi102.stdout: "req_getfilelock_latency": { 2024-09-12T12:37:46.501 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:46.501 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:46.501 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:46.501 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.501 INFO:teuthology.orchestra.run.smithi102.stdout: "req_link_latency": { 2024-09-12T12:37:46.501 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:46.501 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:46.501 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:46.502 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.502 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookup_latency": { 2024-09-12T12:37:46.502 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 1, 2024-09-12T12:37:46.502 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.005579530, 2024-09-12T12:37:46.502 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.005579530 2024-09-12T12:37:46.502 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.502 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookuphash_latency": { 2024-09-12T12:37:46.502 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:46.502 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:46.502 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:46.502 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.502 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupino_latency": { 2024-09-12T12:37:46.502 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:46.502 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:46.503 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:46.503 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.503 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupname_latency": { 2024-09-12T12:37:46.503 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:46.503 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:46.503 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:46.503 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.503 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupparent_latency": { 2024-09-12T12:37:46.503 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:46.503 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:46.503 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:46.503 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.503 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupsnap_latency": { 2024-09-12T12:37:46.503 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:46.504 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:46.504 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:46.504 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.504 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lssnap_latency": { 2024-09-12T12:37:46.504 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:46.504 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:46.504 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:46.505 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.505 INFO:teuthology.orchestra.run.smithi102.stdout: "req_mkdir_latency": { 2024-09-12T12:37:46.505 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 10, 2024-09-12T12:37:46.505 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.015794833, 2024-09-12T12:37:46.505 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.001579483 2024-09-12T12:37:46.505 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.505 INFO:teuthology.orchestra.run.smithi102.stdout: "req_mknod_latency": { 2024-09-12T12:37:46.505 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:46.505 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:46.505 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:46.506 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.506 INFO:teuthology.orchestra.run.smithi102.stdout: "req_mksnap_latency": { 2024-09-12T12:37:46.506 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:46.506 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:46.506 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:46.506 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.506 INFO:teuthology.orchestra.run.smithi102.stdout: "req_open_latency": { 2024-09-12T12:37:46.506 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 1, 2024-09-12T12:37:46.506 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000435070, 2024-09-12T12:37:46.506 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000435070 2024-09-12T12:37:46.506 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.506 INFO:teuthology.orchestra.run.smithi102.stdout: "req_readdir_latency": { 2024-09-12T12:37:46.507 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 4, 2024-09-12T12:37:46.507 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.020124112, 2024-09-12T12:37:46.507 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.005031028 2024-09-12T12:37:46.507 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.507 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rename_latency": { 2024-09-12T12:37:46.507 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 2, 2024-09-12T12:37:46.507 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.003353053, 2024-09-12T12:37:46.507 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.001676526 2024-09-12T12:37:46.507 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.507 INFO:teuthology.orchestra.run.smithi102.stdout: "req_renamesnap_latency": { 2024-09-12T12:37:46.507 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:46.507 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:46.507 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:46.507 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.508 INFO:teuthology.orchestra.run.smithi102.stdout: "req_snapdiff_latency": { 2024-09-12T12:37:46.508 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:46.508 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:46.508 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:46.508 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.508 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rmdir_latency": { 2024-09-12T12:37:46.508 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 4, 2024-09-12T12:37:46.508 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.029923708, 2024-09-12T12:37:46.508 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.007480927 2024-09-12T12:37:46.508 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.508 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rmsnap_latency": { 2024-09-12T12:37:46.508 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:46.508 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:46.509 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:46.509 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.509 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rmxattr_latency": { 2024-09-12T12:37:46.509 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:46.509 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:46.509 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:46.509 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.509 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setattr_latency": { 2024-09-12T12:37:46.509 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 2, 2024-09-12T12:37:46.509 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.001247423, 2024-09-12T12:37:46.509 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000623711 2024-09-12T12:37:46.509 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.509 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setdirlayout_latency": { 2024-09-12T12:37:46.509 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:46.510 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:46.510 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:46.510 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.510 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setfilelock_latency": { 2024-09-12T12:37:46.510 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:46.510 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:46.510 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:46.510 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.510 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setlayout_latency": { 2024-09-12T12:37:46.510 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:46.510 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:46.510 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:46.510 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.510 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setxattr_latency": { 2024-09-12T12:37:46.511 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 8, 2024-09-12T12:37:46.511 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.021767819, 2024-09-12T12:37:46.511 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.002720977 2024-09-12T12:37:46.511 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.511 INFO:teuthology.orchestra.run.smithi102.stdout: "req_symlink_latency": { 2024-09-12T12:37:46.511 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:46.511 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:46.511 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:46.511 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.511 INFO:teuthology.orchestra.run.smithi102.stdout: "req_unlink_latency": { 2024-09-12T12:37:46.511 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 16, 2024-09-12T12:37:46.511 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.018965452, 2024-09-12T12:37:46.511 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.001185340 2024-09-12T12:37:46.511 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.512 INFO:teuthology.orchestra.run.smithi102.stdout: "cap_revoke_eviction": 0, 2024-09-12T12:37:46.512 INFO:teuthology.orchestra.run.smithi102.stdout: "cap_acquisition_throttle": 0, 2024-09-12T12:37:46.512 INFO:teuthology.orchestra.run.smithi102.stdout: "req_getvxattr_latency": { 2024-09-12T12:37:46.512 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:46.512 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:46.512 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:46.512 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T12:37:46.512 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.512 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_sessions": { 2024-09-12T12:37:46.512 INFO:teuthology.orchestra.run.smithi102.stdout: "session_count": 1, 2024-09-12T12:37:46.512 INFO:teuthology.orchestra.run.smithi102.stdout: "session_add": 3, 2024-09-12T12:37:46.512 INFO:teuthology.orchestra.run.smithi102.stdout: "session_remove": 2, 2024-09-12T12:37:46.512 INFO:teuthology.orchestra.run.smithi102.stdout: "sessions_open": 1, 2024-09-12T12:37:46.513 INFO:teuthology.orchestra.run.smithi102.stdout: "sessions_stale": 0, 2024-09-12T12:37:46.513 INFO:teuthology.orchestra.run.smithi102.stdout: "total_load": 39, 2024-09-12T12:37:46.513 INFO:teuthology.orchestra.run.smithi102.stdout: "average_load": 39, 2024-09-12T12:37:46.513 INFO:teuthology.orchestra.run.smithi102.stdout: "avg_session_uptime": 697, 2024-09-12T12:37:46.513 INFO:teuthology.orchestra.run.smithi102.stdout: "mdthresh_evicted": 0 2024-09-12T12:37:46.513 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.513 INFO:teuthology.orchestra.run.smithi102.stdout: "mempool": { 2024-09-12T12:37:46.513 INFO:teuthology.orchestra.run.smithi102.stdout: "bloom_filter_bytes": 0, 2024-09-12T12:37:46.513 INFO:teuthology.orchestra.run.smithi102.stdout: "bloom_filter_items": 0, 2024-09-12T12:37:46.513 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T12:37:46.513 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_alloc_items": 0, 2024-09-12T12:37:46.513 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T12:37:46.514 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_data_items": 0, 2024-09-12T12:37:46.514 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T12:37:46.514 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T12:37:46.514 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T12:37:46.514 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T12:37:46.514 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T12:37:46.514 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_other_items": 0, 2024-09-12T12:37:46.514 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T12:37:46.514 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T12:37:46.514 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_bytes": 0, 2024-09-12T12:37:46.514 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_items": 0, 2024-09-12T12:37:46.514 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_blob_bytes": 0, 2024-09-12T12:37:46.514 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_blob_items": 0, 2024-09-12T12:37:46.514 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T12:37:46.514 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T12:37:46.515 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T12:37:46.515 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T12:37:46.515 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T12:37:46.515 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_items": 0, 2024-09-12T12:37:46.515 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_txc_bytes": 0, 2024-09-12T12:37:46.515 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_txc_items": 0, 2024-09-12T12:37:46.515 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T12:37:46.515 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T12:37:46.515 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_bytes": 0, 2024-09-12T12:37:46.515 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_items": 0, 2024-09-12T12:37:46.515 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_bytes": 0, 2024-09-12T12:37:46.515 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_items": 0, 2024-09-12T12:37:46.515 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T12:37:46.516 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_reader_items": 0, 2024-09-12T12:37:46.516 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T12:37:46.516 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_writer_items": 0, 2024-09-12T12:37:46.516 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_anon_bytes": 307678, 2024-09-12T12:37:46.516 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_anon_items": 119, 2024-09-12T12:37:46.516 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_meta_bytes": 0, 2024-09-12T12:37:46.516 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_meta_items": 0, 2024-09-12T12:37:46.516 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_bytes": 0, 2024-09-12T12:37:46.516 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_items": 0, 2024-09-12T12:37:46.516 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mapbl_bytes": 0, 2024-09-12T12:37:46.516 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mapbl_items": 0, 2024-09-12T12:37:46.516 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pglog_bytes": 0, 2024-09-12T12:37:46.516 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pglog_items": 0, 2024-09-12T12:37:46.517 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_bytes": 8856, 2024-09-12T12:37:46.517 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_items": 166, 2024-09-12T12:37:46.517 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T12:37:46.517 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_mapping_items": 0, 2024-09-12T12:37:46.517 INFO:teuthology.orchestra.run.smithi102.stdout: "pgmap_bytes": 0, 2024-09-12T12:37:46.517 INFO:teuthology.orchestra.run.smithi102.stdout: "pgmap_items": 0, 2024-09-12T12:37:46.517 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_co_bytes": 94114, 2024-09-12T12:37:46.517 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_co_items": 626, 2024-09-12T12:37:46.517 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_1_bytes": 0, 2024-09-12T12:37:46.517 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_1_items": 0, 2024-09-12T12:37:46.517 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_2_bytes": 0, 2024-09-12T12:37:46.517 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_2_items": 0 2024-09-12T12:37:46.517 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.517 INFO:teuthology.orchestra.run.smithi102.stdout: "objecter": { 2024-09-12T12:37:46.518 INFO:teuthology.orchestra.run.smithi102.stdout: "op_active": 0, 2024-09-12T12:37:46.518 INFO:teuthology.orchestra.run.smithi102.stdout: "op_laggy": 0, 2024-09-12T12:37:46.518 INFO:teuthology.orchestra.run.smithi102.stdout: "op_send": 3702, 2024-09-12T12:37:46.518 INFO:teuthology.orchestra.run.smithi102.stdout: "op_send_bytes": 744984, 2024-09-12T12:37:46.518 INFO:teuthology.orchestra.run.smithi102.stdout: "op_resend": 31, 2024-09-12T12:37:46.518 INFO:teuthology.orchestra.run.smithi102.stdout: "op_reply": 3702, 2024-09-12T12:37:46.518 INFO:teuthology.orchestra.run.smithi102.stdout: "op_latency": { 2024-09-12T12:37:46.518 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 3702, 2024-09-12T12:37:46.518 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 82.872335583, 2024-09-12T12:37:46.518 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.022385828 2024-09-12T12:37:46.518 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.518 INFO:teuthology.orchestra.run.smithi102.stdout: "op_inflight": 0, 2024-09-12T12:37:46.518 INFO:teuthology.orchestra.run.smithi102.stdout: "oplen_avg": { 2024-09-12T12:37:46.519 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 3702, 2024-09-12T12:37:46.519 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 3755 2024-09-12T12:37:46.519 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.519 INFO:teuthology.orchestra.run.smithi102.stdout: "op": 3702, 2024-09-12T12:37:46.519 INFO:teuthology.orchestra.run.smithi102.stdout: "op_r": 362, 2024-09-12T12:37:46.519 INFO:teuthology.orchestra.run.smithi102.stdout: "op_w": 3340, 2024-09-12T12:37:46.519 INFO:teuthology.orchestra.run.smithi102.stdout: "op_rmw": 0, 2024-09-12T12:37:46.519 INFO:teuthology.orchestra.run.smithi102.stdout: "op_pg": 0, 2024-09-12T12:37:46.519 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_stat": 0, 2024-09-12T12:37:46.519 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_create": 11, 2024-09-12T12:37:46.519 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_read": 16, 2024-09-12T12:37:46.519 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_write": 156, 2024-09-12T12:37:46.519 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_writefull": 28, 2024-09-12T12:37:46.519 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_writesame": 0, 2024-09-12T12:37:46.520 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_append": 0, 2024-09-12T12:37:46.520 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_zero": 0, 2024-09-12T12:37:46.520 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_truncate": 0, 2024-09-12T12:37:46.520 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_delete": 3108, 2024-09-12T12:37:46.520 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_mapext": 0, 2024-09-12T12:37:46.520 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_sparse_read": 0, 2024-09-12T12:37:46.520 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_clonerange": 0, 2024-09-12T12:37:46.520 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_getxattr": 346, 2024-09-12T12:37:46.520 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_setxattr": 22, 2024-09-12T12:37:46.520 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_cmpxattr": 0, 2024-09-12T12:37:46.520 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_rmxattr": 0, 2024-09-12T12:37:46.520 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_resetxattrs": 0, 2024-09-12T12:37:46.520 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_call": 0, 2024-09-12T12:37:46.520 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_watch": 0, 2024-09-12T12:37:46.521 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_notify": 0, 2024-09-12T12:37:46.521 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T12:37:46.521 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_pgls": 0, 2024-09-12T12:37:46.521 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_pgls_filter": 0, 2024-09-12T12:37:46.521 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_other": 0, 2024-09-12T12:37:46.521 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_active": 0, 2024-09-12T12:37:46.521 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_send": 0, 2024-09-12T12:37:46.521 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_resend": 0, 2024-09-12T12:37:46.521 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_ping": 0, 2024-09-12T12:37:46.521 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_active": 0, 2024-09-12T12:37:46.521 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_send": 0, 2024-09-12T12:37:46.521 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_resend": 0, 2024-09-12T12:37:46.521 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_active": 0, 2024-09-12T12:37:46.521 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_send": 0, 2024-09-12T12:37:46.522 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_resend": 0, 2024-09-12T12:37:46.522 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_active": 0, 2024-09-12T12:37:46.522 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_send": 0, 2024-09-12T12:37:46.522 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_resend": 0, 2024-09-12T12:37:46.522 INFO:teuthology.orchestra.run.smithi102.stdout: "command_active": 0, 2024-09-12T12:37:46.522 INFO:teuthology.orchestra.run.smithi102.stdout: "command_send": 0, 2024-09-12T12:37:46.522 INFO:teuthology.orchestra.run.smithi102.stdout: "command_resend": 0, 2024-09-12T12:37:46.522 INFO:teuthology.orchestra.run.smithi102.stdout: "map_epoch": 89, 2024-09-12T12:37:46.522 INFO:teuthology.orchestra.run.smithi102.stdout: "map_full": 0, 2024-09-12T12:37:46.522 INFO:teuthology.orchestra.run.smithi102.stdout: "map_inc": 10, 2024-09-12T12:37:46.522 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_sessions": 12, 2024-09-12T12:37:46.522 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_session_open": 12, 2024-09-12T12:37:46.522 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_session_close": 0, 2024-09-12T12:37:46.522 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_laggy": 0, 2024-09-12T12:37:46.523 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_wr": 53, 2024-09-12T12:37:46.523 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_rd": 0, 2024-09-12T12:37:46.523 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_del": 15 2024-09-12T12:37:46.523 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.523 INFO:teuthology.orchestra.run.smithi102.stdout: "oft": { 2024-09-12T12:37:46.523 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_objs": 1, 2024-09-12T12:37:46.523 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_kv_pairs": 0, 2024-09-12T12:37:46.523 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_updates": 0, 2024-09-12T12:37:46.523 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_removes": 0 2024-09-12T12:37:46.523 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.523 INFO:teuthology.orchestra.run.smithi102.stdout: "osd-slow-ops": { 2024-09-12T12:37:46.523 INFO:teuthology.orchestra.run.smithi102.stdout: "slow_ops_count": 0 2024-09-12T12:37:46.523 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.524 INFO:teuthology.orchestra.run.smithi102.stdout: "purge_queue": { 2024-09-12T12:37:46.524 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing_ops": 0, 2024-09-12T12:37:46.524 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing_ops_high_water": 527, 2024-09-12T12:37:46.524 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing": 0, 2024-09-12T12:37:46.524 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing_high_water": 8, 2024-09-12T12:37:46.524 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executed_ops": 2596, 2024-09-12T12:37:46.524 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executed": 20, 2024-09-12T12:37:46.524 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_item_in_journal": 0 2024-09-12T12:37:46.524 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.524 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T12:37:46.524 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-12T12:37:46.524 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 104857600, 2024-09-12T12:37:46.524 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-12T12:37:46.525 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 6393, 2024-09-12T12:37:46.525 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 1813668, 2024-09-12T12:37:46.525 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-12T12:37:46.525 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 6393, 2024-09-12T12:37:46.525 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-09-12T12:37:46.525 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-09-12T12:37:46.525 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 6393, 2024-09-12T12:37:46.525 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 1813668, 2024-09-12T12:37:46.525 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-12T12:37:46.525 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:46.525 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:46.525 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:46.525 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T12:37:46.525 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.526 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-objecter_bytes": { 2024-09-12T12:37:46.526 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-12T12:37:46.526 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 104857600, 2024-09-12T12:37:46.526 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-12T12:37:46.526 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 0, 2024-09-12T12:37:46.526 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2024-09-12T12:37:46.526 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-12T12:37:46.526 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 0, 2024-09-12T12:37:46.526 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 3702, 2024-09-12T12:37:46.526 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 747132, 2024-09-12T12:37:46.526 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 3702, 2024-09-12T12:37:46.526 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 747132, 2024-09-12T12:37:46.526 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-12T12:37:46.527 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:46.527 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:46.527 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:46.527 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T12:37:46.527 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.527 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-objecter_ops": { 2024-09-12T12:37:46.527 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-12T12:37:46.527 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 1024, 2024-09-12T12:37:46.527 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-12T12:37:46.527 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 0, 2024-09-12T12:37:46.527 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2024-09-12T12:37:46.527 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-12T12:37:46.527 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 0, 2024-09-12T12:37:46.527 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 3702, 2024-09-12T12:37:46.527 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 3702, 2024-09-12T12:37:46.528 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 3702, 2024-09-12T12:37:46.528 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 3702, 2024-09-12T12:37:46.528 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-12T12:37:46.528 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:46.528 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:46.528 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:46.528 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T12:37:46.528 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.528 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-write_buf_throttle": { 2024-09-12T12:37:46.528 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-12T12:37:46.528 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 3758096384, 2024-09-12T12:37:46.528 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-12T12:37:46.528 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 20, 2024-09-12T12:37:46.529 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 2148, 2024-09-12T12:37:46.529 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-12T12:37:46.529 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 20, 2024-09-12T12:37:46.529 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-09-12T12:37:46.529 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-09-12T12:37:46.529 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 4, 2024-09-12T12:37:46.529 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 2148, 2024-09-12T12:37:46.529 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-12T12:37:46.529 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:46.529 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:46.529 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:46.529 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T12:37:46.529 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:46.529 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-write_buf_throttle-0x55b11983e960": { 2024-09-12T12:37:46.530 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-12T12:37:46.530 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 3758096384, 2024-09-12T12:37:46.530 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-12T12:37:46.530 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 276, 2024-09-12T12:37:46.530 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 722896, 2024-09-12T12:37:46.530 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-12T12:37:46.530 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 276, 2024-09-12T12:37:46.530 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-09-12T12:37:46.530 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-09-12T12:37:46.530 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 152, 2024-09-12T12:37:46.530 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 722896, 2024-09-12T12:37:46.530 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-12T12:37:46.530 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:46.530 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:46.530 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:46.531 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T12:37:46.531 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T12:37:46.531 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-12T12:37:47.298 INFO:tasks.check_counter:Daemon mds.i mds.exported=1 2024-09-12T12:37:47.298 INFO:tasks.check_counter:Daemon mds.i mds.imported=1 2024-09-12T12:37:47.298 DEBUG:tasks.check_counter:Getting stats from l 2024-09-12T12:37:47.299 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-12T12:37:47.542 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:37:47.811 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:47 smithi102 ceph-mon[34799]: pgmap v703: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T12:37:47.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:47 smithi043 ceph-mon[34144]: pgmap v703: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T12:37:47.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:47 smithi033 ceph-mon[31246]: pgmap v703: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T12:37:48.078 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-12T12:37:48.078 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T12:37:48.078 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 799, 2024-09-12T12:37:48.078 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 801, 2024-09-12T12:37:48.078 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 211028, 2024-09-12T12:37:48.079 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 254146, 2024-09-12T12:37:48.079 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 6, 2024-09-12T12:37:48.079 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 2, 2024-09-12T12:37:48.079 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.061155054, 2024-09-12T12:37:48.079 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.017859597, 2024-09-12T12:37:48.079 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.016860766, 2024-09-12T12:37:48.079 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.019346223, 2024-09-12T12:37:48.079 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:37:48.079 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 799, 2024-09-12T12:37:48.079 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.033510579, 2024-09-12T12:37:48.079 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000041940 2024-09-12T12:37:48.079 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.080 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:37:48.080 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:48.080 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:48.080 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:48.080 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.080 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T12:37:48.080 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T12:37:48.080 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.080 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T12:37:48.080 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 704, 2024-09-12T12:37:48.080 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 881, 2024-09-12T12:37:48.080 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 175080, 2024-09-12T12:37:48.080 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 600687, 2024-09-12T12:37:48.081 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 5, 2024-09-12T12:37:48.081 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 4, 2024-09-12T12:37:48.081 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.068768135, 2024-09-12T12:37:48.081 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.020371142, 2024-09-12T12:37:48.081 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.017357611, 2024-09-12T12:37:48.081 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.024802311, 2024-09-12T12:37:48.081 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:37:48.081 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 880, 2024-09-12T12:37:48.081 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.047364166, 2024-09-12T12:37:48.081 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000053822 2024-09-12T12:37:48.081 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.081 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:37:48.081 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:48.082 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:48.082 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:48.082 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.082 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-12T12:37:48.082 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 378400 2024-09-12T12:37:48.082 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.082 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T12:37:48.082 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 1047, 2024-09-12T12:37:48.082 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 1039, 2024-09-12T12:37:48.082 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 788064, 2024-09-12T12:37:48.082 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 399372, 2024-09-12T12:37:48.082 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 3, 2024-09-12T12:37:48.082 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 2, 2024-09-12T12:37:48.082 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.112458591, 2024-09-12T12:37:48.083 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.037751540, 2024-09-12T12:37:48.083 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.045588737, 2024-09-12T12:37:48.083 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.027995258, 2024-09-12T12:37:48.083 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:37:48.083 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 1038, 2024-09-12T12:37:48.083 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.065949255, 2024-09-12T12:37:48.083 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000063534 2024-09-12T12:37:48.083 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.083 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:37:48.083 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:48.083 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:48.083 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:48.084 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.084 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 521280, 2024-09-12T12:37:48.084 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 146880 2024-09-12T12:37:48.084 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.084 INFO:teuthology.orchestra.run.smithi102.stdout: "cct": { 2024-09-12T12:37:48.084 INFO:teuthology.orchestra.run.smithi102.stdout: "total_workers": 1, 2024-09-12T12:37:48.084 INFO:teuthology.orchestra.run.smithi102.stdout: "unhealthy_workers": 0 2024-09-12T12:37:48.084 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.084 INFO:teuthology.orchestra.run.smithi102.stdout: "finisher-MDSRank": { 2024-09-12T12:37:48.084 INFO:teuthology.orchestra.run.smithi102.stdout: "queue_len": 0, 2024-09-12T12:37:48.084 INFO:teuthology.orchestra.run.smithi102.stdout: "complete_latency": { 2024-09-12T12:37:48.084 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 3853, 2024-09-12T12:37:48.084 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.105413770, 2024-09-12T12:37:48.084 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000027358 2024-09-12T12:37:48.085 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T12:37:48.085 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.085 INFO:teuthology.orchestra.run.smithi102.stdout: "finisher-PurgeQueue": { 2024-09-12T12:37:48.085 INFO:teuthology.orchestra.run.smithi102.stdout: "queue_len": 0, 2024-09-12T12:37:48.085 INFO:teuthology.orchestra.run.smithi102.stdout: "complete_latency": { 2024-09-12T12:37:48.085 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:48.085 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:48.085 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:48.085 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T12:37:48.085 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.085 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": { 2024-09-12T12:37:48.085 INFO:teuthology.orchestra.run.smithi102.stdout: "request": 0, 2024-09-12T12:37:48.085 INFO:teuthology.orchestra.run.smithi102.stdout: "reply": 0, 2024-09-12T12:37:48.086 INFO:teuthology.orchestra.run.smithi102.stdout: "reply_latency": { 2024-09-12T12:37:48.086 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:48.086 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:48.086 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:48.086 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.086 INFO:teuthology.orchestra.run.smithi102.stdout: "slow_reply": 0, 2024-09-12T12:37:48.086 INFO:teuthology.orchestra.run.smithi102.stdout: "forward": 0, 2024-09-12T12:37:48.086 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_fetch_complete": 0, 2024-09-12T12:37:48.086 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_fetch_keys": 0, 2024-09-12T12:37:48.086 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_commit": 0, 2024-09-12T12:37:48.086 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_split": 0, 2024-09-12T12:37:48.086 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_merge": 0, 2024-09-12T12:37:48.086 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes": 0, 2024-09-12T12:37:48.086 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_top": 0, 2024-09-12T12:37:48.087 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_bottom": 0, 2024-09-12T12:37:48.087 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_pin_tail": 0, 2024-09-12T12:37:48.087 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_pinned": 0, 2024-09-12T12:37:48.087 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_expired": 0, 2024-09-12T12:37:48.087 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_with_caps": 0, 2024-09-12T12:37:48.087 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": 0, 2024-09-12T12:37:48.087 INFO:teuthology.orchestra.run.smithi102.stdout: "subtrees": 1, 2024-09-12T12:37:48.087 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse": 0, 2024-09-12T12:37:48.087 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_hit": 0, 2024-09-12T12:37:48.087 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_forward": 0, 2024-09-12T12:37:48.087 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_discover": 0, 2024-09-12T12:37:48.087 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_dir_fetch": 0, 2024-09-12T12:37:48.087 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_remote_ino": 0, 2024-09-12T12:37:48.088 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_lock": 0, 2024-09-12T12:37:48.088 INFO:teuthology.orchestra.run.smithi102.stdout: "load_cent": 0, 2024-09-12T12:37:48.088 INFO:teuthology.orchestra.run.smithi102.stdout: "q": 0, 2024-09-12T12:37:48.088 INFO:teuthology.orchestra.run.smithi102.stdout: "exported": 0, 2024-09-12T12:37:48.088 INFO:teuthology.orchestra.run.smithi102.stdout: "exported_inodes": 0, 2024-09-12T12:37:48.088 INFO:teuthology.orchestra.run.smithi102.stdout: "imported": 0, 2024-09-12T12:37:48.088 INFO:teuthology.orchestra.run.smithi102.stdout: "imported_inodes": 0, 2024-09-12T12:37:48.088 INFO:teuthology.orchestra.run.smithi102.stdout: "openino_dir_fetch": 0, 2024-09-12T12:37:48.088 INFO:teuthology.orchestra.run.smithi102.stdout: "openino_backtrace_fetch": 0, 2024-09-12T12:37:48.088 INFO:teuthology.orchestra.run.smithi102.stdout: "openino_peer_discover": 0, 2024-09-12T12:37:48.088 INFO:teuthology.orchestra.run.smithi102.stdout: "root_rfiles": 0, 2024-09-12T12:37:48.088 INFO:teuthology.orchestra.run.smithi102.stdout: "root_rbytes": 0, 2024-09-12T12:37:48.088 INFO:teuthology.orchestra.run.smithi102.stdout: "root_rsnaps": 0, 2024-09-12T12:37:48.089 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T12:37:48.089 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_set_tag": 0, 2024-09-12T12:37:48.089 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T12:37:48.089 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_inotable_repaired": 0, 2024-09-12T12:37:48.089 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_dir_inodes": 0, 2024-09-12T12:37:48.089 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T12:37:48.089 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T12:37:48.089 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_file_inodes": 0, 2024-09-12T12:37:48.089 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_inode_file_caps": 0, 2024-09-12T12:37:48.089 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T12:37:48.089 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_grant": 0, 2024-09-12T12:37:48.089 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T12:37:48.089 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T12:37:48.089 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T12:37:48.090 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_caps": 0, 2024-09-12T12:37:48.090 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_caps_dirty": 0, 2024-09-12T12:37:48.090 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_cap_release": 0, 2024-09-12T12:37:48.090 INFO:teuthology.orchestra.run.smithi102.stdout: "process_request_cap_release": 0 2024-09-12T12:37:48.090 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.090 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_cache": { 2024-09-12T12:37:48.090 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_update": 0, 2024-09-12T12:37:48.090 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_update_receipt": 0, 2024-09-12T12:37:48.090 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_try_discover": 0, 2024-09-12T12:37:48.090 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_send_discover": 0, 2024-09-12T12:37:48.090 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_handle_discover": 0, 2024-09-12T12:37:48.090 INFO:teuthology.orchestra.run.smithi102.stdout: "num_strays": 0, 2024-09-12T12:37:48.090 INFO:teuthology.orchestra.run.smithi102.stdout: "num_strays_delayed": 0, 2024-09-12T12:37:48.090 INFO:teuthology.orchestra.run.smithi102.stdout: "num_strays_enqueuing": 0, 2024-09-12T12:37:48.091 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_created": 0, 2024-09-12T12:37:48.091 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_enqueued": 0, 2024-09-12T12:37:48.091 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_reintegrated": 0, 2024-09-12T12:37:48.091 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_migrated": 0, 2024-09-12T12:37:48.091 INFO:teuthology.orchestra.run.smithi102.stdout: "num_recovering_processing": 0, 2024-09-12T12:37:48.091 INFO:teuthology.orchestra.run.smithi102.stdout: "num_recovering_enqueued": 0, 2024-09-12T12:37:48.091 INFO:teuthology.orchestra.run.smithi102.stdout: "num_recovering_prioritized": 0, 2024-09-12T12:37:48.091 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_started": 0, 2024-09-12T12:37:48.091 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_completed": 0, 2024-09-12T12:37:48.091 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_quiesce_path": 0, 2024-09-12T12:37:48.091 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_quiesce_inode": 0, 2024-09-12T12:37:48.091 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T12:37:48.092 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_exportdir": 0, 2024-09-12T12:37:48.092 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_flush": 0, 2024-09-12T12:37:48.092 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_fragmentdir": 0, 2024-09-12T12:37:48.092 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_fragstats": 0, 2024-09-12T12:37:48.092 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_inodestats": 0 2024-09-12T12:37:48.092 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.092 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_log": { 2024-09-12T12:37:48.092 INFO:teuthology.orchestra.run.smithi102.stdout: "evlrg": 0, 2024-09-12T12:37:48.092 INFO:teuthology.orchestra.run.smithi102.stdout: "evadd": 0, 2024-09-12T12:37:48.092 INFO:teuthology.orchestra.run.smithi102.stdout: "evex": 0, 2024-09-12T12:37:48.092 INFO:teuthology.orchestra.run.smithi102.stdout: "evtrm": 0, 2024-09-12T12:37:48.092 INFO:teuthology.orchestra.run.smithi102.stdout: "ev": 3, 2024-09-12T12:37:48.092 INFO:teuthology.orchestra.run.smithi102.stdout: "evexg": 0, 2024-09-12T12:37:48.093 INFO:teuthology.orchestra.run.smithi102.stdout: "evexd": 0, 2024-09-12T12:37:48.093 INFO:teuthology.orchestra.run.smithi102.stdout: "segadd": 0, 2024-09-12T12:37:48.093 INFO:teuthology.orchestra.run.smithi102.stdout: "segex": 0, 2024-09-12T12:37:48.093 INFO:teuthology.orchestra.run.smithi102.stdout: "segtrm": 0, 2024-09-12T12:37:48.093 INFO:teuthology.orchestra.run.smithi102.stdout: "seg": 2, 2024-09-12T12:37:48.093 INFO:teuthology.orchestra.run.smithi102.stdout: "segmjr": 2, 2024-09-12T12:37:48.093 INFO:teuthology.orchestra.run.smithi102.stdout: "segexg": 0, 2024-09-12T12:37:48.093 INFO:teuthology.orchestra.run.smithi102.stdout: "segexd": 0, 2024-09-12T12:37:48.093 INFO:teuthology.orchestra.run.smithi102.stdout: "expos": 4194304, 2024-09-12T12:37:48.093 INFO:teuthology.orchestra.run.smithi102.stdout: "wrpos": 4195387, 2024-09-12T12:37:48.093 INFO:teuthology.orchestra.run.smithi102.stdout: "rdpos": 4194892, 2024-09-12T12:37:48.093 INFO:teuthology.orchestra.run.smithi102.stdout: "jlat": { 2024-09-12T12:37:48.093 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:48.094 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:48.094 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:48.094 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.094 INFO:teuthology.orchestra.run.smithi102.stdout: "replayed": 3 2024-09-12T12:37:48.094 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.094 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_mem": { 2024-09-12T12:37:48.094 INFO:teuthology.orchestra.run.smithi102.stdout: "ino": 3, 2024-09-12T12:37:48.094 INFO:teuthology.orchestra.run.smithi102.stdout: "ino+": 3, 2024-09-12T12:37:48.094 INFO:teuthology.orchestra.run.smithi102.stdout: "ino-": 0, 2024-09-12T12:37:48.094 INFO:teuthology.orchestra.run.smithi102.stdout: "dir": 1, 2024-09-12T12:37:48.094 INFO:teuthology.orchestra.run.smithi102.stdout: "dir+": 1, 2024-09-12T12:37:48.094 INFO:teuthology.orchestra.run.smithi102.stdout: "dir-": 0, 2024-09-12T12:37:48.094 INFO:teuthology.orchestra.run.smithi102.stdout: "dn": 0, 2024-09-12T12:37:48.094 INFO:teuthology.orchestra.run.smithi102.stdout: "dn+": 0, 2024-09-12T12:37:48.095 INFO:teuthology.orchestra.run.smithi102.stdout: "dn-": 0, 2024-09-12T12:37:48.095 INFO:teuthology.orchestra.run.smithi102.stdout: "cap": 0, 2024-09-12T12:37:48.095 INFO:teuthology.orchestra.run.smithi102.stdout: "cap+": 0, 2024-09-12T12:37:48.095 INFO:teuthology.orchestra.run.smithi102.stdout: "cap-": 0, 2024-09-12T12:37:48.095 INFO:teuthology.orchestra.run.smithi102.stdout: "rss": 52552, 2024-09-12T12:37:48.095 INFO:teuthology.orchestra.run.smithi102.stdout: "heap": 215328 2024-09-12T12:37:48.095 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.095 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_server": { 2024-09-12T12:37:48.095 INFO:teuthology.orchestra.run.smithi102.stdout: "dispatch_client_request": 0, 2024-09-12T12:37:48.095 INFO:teuthology.orchestra.run.smithi102.stdout: "dispatch_server_request": 0, 2024-09-12T12:37:48.095 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_request": 0, 2024-09-12T12:37:48.095 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_session": 0, 2024-09-12T12:37:48.096 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_peer_request": 0, 2024-09-12T12:37:48.096 INFO:teuthology.orchestra.run.smithi102.stdout: "req_create_latency": { 2024-09-12T12:37:48.096 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:48.096 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:48.096 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:48.096 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.096 INFO:teuthology.orchestra.run.smithi102.stdout: "req_getattr_latency": { 2024-09-12T12:37:48.096 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:48.097 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:48.097 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:48.097 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.097 INFO:teuthology.orchestra.run.smithi102.stdout: "req_getfilelock_latency": { 2024-09-12T12:37:48.097 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:48.097 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:48.097 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:48.097 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.097 INFO:teuthology.orchestra.run.smithi102.stdout: "req_link_latency": { 2024-09-12T12:37:48.097 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:48.097 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:48.097 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:48.097 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.097 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookup_latency": { 2024-09-12T12:37:48.098 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:48.098 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:48.098 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:48.098 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.098 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookuphash_latency": { 2024-09-12T12:37:48.098 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:48.098 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:48.098 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:48.098 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.098 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupino_latency": { 2024-09-12T12:37:48.098 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:48.098 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:48.098 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:48.099 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.099 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupname_latency": { 2024-09-12T12:37:48.099 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:48.099 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:48.099 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:48.099 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.099 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupparent_latency": { 2024-09-12T12:37:48.099 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:48.099 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:48.099 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:48.099 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.099 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupsnap_latency": { 2024-09-12T12:37:48.099 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:48.099 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:48.100 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:48.100 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.100 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lssnap_latency": { 2024-09-12T12:37:48.100 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:48.100 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:48.100 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:48.100 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.100 INFO:teuthology.orchestra.run.smithi102.stdout: "req_mkdir_latency": { 2024-09-12T12:37:48.100 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:48.101 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:48.101 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:48.102 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.102 INFO:teuthology.orchestra.run.smithi102.stdout: "req_mknod_latency": { 2024-09-12T12:37:48.102 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:48.102 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:48.102 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:48.102 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.102 INFO:teuthology.orchestra.run.smithi102.stdout: "req_mksnap_latency": { 2024-09-12T12:37:48.102 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:48.102 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:48.102 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:48.102 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.102 INFO:teuthology.orchestra.run.smithi102.stdout: "req_open_latency": { 2024-09-12T12:37:48.102 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:48.102 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:48.103 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:48.103 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.103 INFO:teuthology.orchestra.run.smithi102.stdout: "req_readdir_latency": { 2024-09-12T12:37:48.103 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:48.103 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:48.103 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:48.103 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.103 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rename_latency": { 2024-09-12T12:37:48.103 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:48.103 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:48.103 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:48.103 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.103 INFO:teuthology.orchestra.run.smithi102.stdout: "req_renamesnap_latency": { 2024-09-12T12:37:48.103 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:48.104 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:48.104 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:48.104 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.104 INFO:teuthology.orchestra.run.smithi102.stdout: "req_snapdiff_latency": { 2024-09-12T12:37:48.104 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:48.104 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:48.104 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:48.104 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.104 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rmdir_latency": { 2024-09-12T12:37:48.104 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:48.104 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:48.104 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:48.104 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.105 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rmsnap_latency": { 2024-09-12T12:37:48.105 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:48.105 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:48.105 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:48.105 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.105 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rmxattr_latency": { 2024-09-12T12:37:48.105 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:48.105 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:48.105 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:48.105 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.105 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setattr_latency": { 2024-09-12T12:37:48.105 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:48.105 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:48.105 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:48.106 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.106 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setdirlayout_latency": { 2024-09-12T12:37:48.106 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:48.106 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:48.106 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:48.106 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.106 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setfilelock_latency": { 2024-09-12T12:37:48.106 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:48.106 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:48.106 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:48.106 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.106 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setlayout_latency": { 2024-09-12T12:37:48.106 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:48.106 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:48.107 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:48.107 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.107 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setxattr_latency": { 2024-09-12T12:37:48.107 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:48.107 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:48.107 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:48.107 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.107 INFO:teuthology.orchestra.run.smithi102.stdout: "req_symlink_latency": { 2024-09-12T12:37:48.107 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:48.107 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:48.107 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:48.107 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.107 INFO:teuthology.orchestra.run.smithi102.stdout: "req_unlink_latency": { 2024-09-12T12:37:48.108 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:48.108 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:48.108 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:48.108 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.108 INFO:teuthology.orchestra.run.smithi102.stdout: "cap_revoke_eviction": 0, 2024-09-12T12:37:48.108 INFO:teuthology.orchestra.run.smithi102.stdout: "cap_acquisition_throttle": 0, 2024-09-12T12:37:48.108 INFO:teuthology.orchestra.run.smithi102.stdout: "req_getvxattr_latency": { 2024-09-12T12:37:48.108 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:48.108 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:48.108 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:48.108 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T12:37:48.108 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.108 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_sessions": { 2024-09-12T12:37:48.109 INFO:teuthology.orchestra.run.smithi102.stdout: "session_count": 1, 2024-09-12T12:37:48.109 INFO:teuthology.orchestra.run.smithi102.stdout: "session_add": 1, 2024-09-12T12:37:48.109 INFO:teuthology.orchestra.run.smithi102.stdout: "session_remove": 0, 2024-09-12T12:37:48.109 INFO:teuthology.orchestra.run.smithi102.stdout: "sessions_open": 1, 2024-09-12T12:37:48.109 INFO:teuthology.orchestra.run.smithi102.stdout: "sessions_stale": 0, 2024-09-12T12:37:48.109 INFO:teuthology.orchestra.run.smithi102.stdout: "total_load": 0, 2024-09-12T12:37:48.109 INFO:teuthology.orchestra.run.smithi102.stdout: "average_load": 0, 2024-09-12T12:37:48.109 INFO:teuthology.orchestra.run.smithi102.stdout: "avg_session_uptime": 1782, 2024-09-12T12:37:48.109 INFO:teuthology.orchestra.run.smithi102.stdout: "mdthresh_evicted": 0 2024-09-12T12:37:48.109 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.109 INFO:teuthology.orchestra.run.smithi102.stdout: "mempool": { 2024-09-12T12:37:48.109 INFO:teuthology.orchestra.run.smithi102.stdout: "bloom_filter_bytes": 0, 2024-09-12T12:37:48.109 INFO:teuthology.orchestra.run.smithi102.stdout: "bloom_filter_items": 0, 2024-09-12T12:37:48.109 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T12:37:48.110 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_alloc_items": 0, 2024-09-12T12:37:48.110 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T12:37:48.110 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_data_items": 0, 2024-09-12T12:37:48.110 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T12:37:48.110 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T12:37:48.110 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T12:37:48.110 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T12:37:48.110 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T12:37:48.110 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_other_items": 0, 2024-09-12T12:37:48.110 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T12:37:48.110 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T12:37:48.110 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_bytes": 0, 2024-09-12T12:37:48.110 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_items": 0, 2024-09-12T12:37:48.111 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_blob_bytes": 0, 2024-09-12T12:37:48.111 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_blob_items": 0, 2024-09-12T12:37:48.111 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T12:37:48.111 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T12:37:48.111 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T12:37:48.111 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T12:37:48.111 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T12:37:48.111 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_items": 0, 2024-09-12T12:37:48.111 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_txc_bytes": 0, 2024-09-12T12:37:48.111 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_txc_items": 0, 2024-09-12T12:37:48.111 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T12:37:48.111 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T12:37:48.111 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_bytes": 0, 2024-09-12T12:37:48.111 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_items": 0, 2024-09-12T12:37:48.112 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_bytes": 0, 2024-09-12T12:37:48.112 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_items": 0, 2024-09-12T12:37:48.112 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T12:37:48.112 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_reader_items": 0, 2024-09-12T12:37:48.112 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T12:37:48.112 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_writer_items": 0, 2024-09-12T12:37:48.112 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_anon_bytes": 190224, 2024-09-12T12:37:48.112 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_anon_items": 54, 2024-09-12T12:37:48.112 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_meta_bytes": 0, 2024-09-12T12:37:48.112 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_meta_items": 0, 2024-09-12T12:37:48.112 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_bytes": 0, 2024-09-12T12:37:48.112 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_items": 0, 2024-09-12T12:37:48.112 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mapbl_bytes": 0, 2024-09-12T12:37:48.113 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mapbl_items": 0, 2024-09-12T12:37:48.113 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pglog_bytes": 0, 2024-09-12T12:37:48.113 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pglog_items": 0, 2024-09-12T12:37:48.113 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_bytes": 8856, 2024-09-12T12:37:48.113 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_items": 166, 2024-09-12T12:37:48.113 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T12:37:48.113 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_mapping_items": 0, 2024-09-12T12:37:48.113 INFO:teuthology.orchestra.run.smithi102.stdout: "pgmap_bytes": 0, 2024-09-12T12:37:48.113 INFO:teuthology.orchestra.run.smithi102.stdout: "pgmap_items": 0, 2024-09-12T12:37:48.113 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_co_bytes": 8512, 2024-09-12T12:37:48.113 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_co_items": 13, 2024-09-12T12:37:48.113 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_1_bytes": 0, 2024-09-12T12:37:48.113 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_1_items": 0, 2024-09-12T12:37:48.113 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_2_bytes": 0, 2024-09-12T12:37:48.114 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_2_items": 0 2024-09-12T12:37:48.114 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.114 INFO:teuthology.orchestra.run.smithi102.stdout: "objecter": { 2024-09-12T12:37:48.114 INFO:teuthology.orchestra.run.smithi102.stdout: "op_active": 0, 2024-09-12T12:37:48.114 INFO:teuthology.orchestra.run.smithi102.stdout: "op_laggy": 0, 2024-09-12T12:37:48.114 INFO:teuthology.orchestra.run.smithi102.stdout: "op_send": 2292, 2024-09-12T12:37:48.114 INFO:teuthology.orchestra.run.smithi102.stdout: "op_send_bytes": 21, 2024-09-12T12:37:48.114 INFO:teuthology.orchestra.run.smithi102.stdout: "op_resend": 3, 2024-09-12T12:37:48.114 INFO:teuthology.orchestra.run.smithi102.stdout: "op_reply": 2292, 2024-09-12T12:37:48.114 INFO:teuthology.orchestra.run.smithi102.stdout: "op_latency": { 2024-09-12T12:37:48.114 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 2292, 2024-09-12T12:37:48.114 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 6.109875967, 2024-09-12T12:37:48.114 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.002665739 2024-09-12T12:37:48.115 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.115 INFO:teuthology.orchestra.run.smithi102.stdout: "op_inflight": 0, 2024-09-12T12:37:48.115 INFO:teuthology.orchestra.run.smithi102.stdout: "oplen_avg": { 2024-09-12T12:37:48.115 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 2292, 2024-09-12T12:37:48.115 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 2293 2024-09-12T12:37:48.115 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.115 INFO:teuthology.orchestra.run.smithi102.stdout: "op": 2292, 2024-09-12T12:37:48.115 INFO:teuthology.orchestra.run.smithi102.stdout: "op_r": 2292, 2024-09-12T12:37:48.115 INFO:teuthology.orchestra.run.smithi102.stdout: "op_w": 0, 2024-09-12T12:37:48.115 INFO:teuthology.orchestra.run.smithi102.stdout: "op_rmw": 0, 2024-09-12T12:37:48.115 INFO:teuthology.orchestra.run.smithi102.stdout: "op_pg": 0, 2024-09-12T12:37:48.115 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_stat": 1491, 2024-09-12T12:37:48.115 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_create": 0, 2024-09-12T12:37:48.115 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_read": 799, 2024-09-12T12:37:48.115 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_write": 0, 2024-09-12T12:37:48.116 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_writefull": 0, 2024-09-12T12:37:48.116 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_writesame": 0, 2024-09-12T12:37:48.116 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_append": 0, 2024-09-12T12:37:48.116 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_zero": 0, 2024-09-12T12:37:48.116 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_truncate": 0, 2024-09-12T12:37:48.116 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_delete": 0, 2024-09-12T12:37:48.116 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_mapext": 0, 2024-09-12T12:37:48.116 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_sparse_read": 0, 2024-09-12T12:37:48.116 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_clonerange": 0, 2024-09-12T12:37:48.116 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_getxattr": 1, 2024-09-12T12:37:48.116 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_setxattr": 0, 2024-09-12T12:37:48.116 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_cmpxattr": 0, 2024-09-12T12:37:48.116 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_rmxattr": 0, 2024-09-12T12:37:48.117 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_resetxattrs": 0, 2024-09-12T12:37:48.117 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_call": 0, 2024-09-12T12:37:48.117 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_watch": 0, 2024-09-12T12:37:48.117 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_notify": 0, 2024-09-12T12:37:48.117 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T12:37:48.117 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_pgls": 0, 2024-09-12T12:37:48.117 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_pgls_filter": 0, 2024-09-12T12:37:48.117 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_other": 0, 2024-09-12T12:37:48.117 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_active": 0, 2024-09-12T12:37:48.117 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_send": 0, 2024-09-12T12:37:48.117 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_resend": 0, 2024-09-12T12:37:48.117 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_ping": 0, 2024-09-12T12:37:48.117 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_active": 0, 2024-09-12T12:37:48.118 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_send": 0, 2024-09-12T12:37:48.118 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_resend": 0, 2024-09-12T12:37:48.118 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_active": 0, 2024-09-12T12:37:48.118 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_send": 0, 2024-09-12T12:37:48.118 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_resend": 0, 2024-09-12T12:37:48.118 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_active": 0, 2024-09-12T12:37:48.118 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_send": 0, 2024-09-12T12:37:48.118 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_resend": 0, 2024-09-12T12:37:48.118 INFO:teuthology.orchestra.run.smithi102.stdout: "command_active": 0, 2024-09-12T12:37:48.118 INFO:teuthology.orchestra.run.smithi102.stdout: "command_send": 0, 2024-09-12T12:37:48.118 INFO:teuthology.orchestra.run.smithi102.stdout: "command_resend": 0, 2024-09-12T12:37:48.118 INFO:teuthology.orchestra.run.smithi102.stdout: "map_epoch": 89, 2024-09-12T12:37:48.118 INFO:teuthology.orchestra.run.smithi102.stdout: "map_full": 0, 2024-09-12T12:37:48.119 INFO:teuthology.orchestra.run.smithi102.stdout: "map_inc": 4, 2024-09-12T12:37:48.119 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_sessions": 5, 2024-09-12T12:37:48.119 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_session_open": 5, 2024-09-12T12:37:48.119 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_session_close": 0, 2024-09-12T12:37:48.119 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_laggy": 0, 2024-09-12T12:37:48.119 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_wr": 0, 2024-09-12T12:37:48.119 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_rd": 2, 2024-09-12T12:37:48.119 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_del": 0 2024-09-12T12:37:48.119 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.119 INFO:teuthology.orchestra.run.smithi102.stdout: "oft": { 2024-09-12T12:37:48.119 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_objs": 0, 2024-09-12T12:37:48.119 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_kv_pairs": 0, 2024-09-12T12:37:48.119 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_updates": 0, 2024-09-12T12:37:48.119 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_removes": 0 2024-09-12T12:37:48.120 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.120 INFO:teuthology.orchestra.run.smithi102.stdout: "osd-slow-ops": { 2024-09-12T12:37:48.120 INFO:teuthology.orchestra.run.smithi102.stdout: "slow_ops_count": 0 2024-09-12T12:37:48.120 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.120 INFO:teuthology.orchestra.run.smithi102.stdout: "purge_queue": { 2024-09-12T12:37:48.120 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing_ops": 0, 2024-09-12T12:37:48.120 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T12:37:48.120 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing": 0, 2024-09-12T12:37:48.120 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing_high_water": 0, 2024-09-12T12:37:48.120 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executed_ops": 0, 2024-09-12T12:37:48.120 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executed": 0, 2024-09-12T12:37:48.120 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_item_in_journal": 0 2024-09-12T12:37:48.120 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.121 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T12:37:48.121 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-12T12:37:48.121 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 104857600, 2024-09-12T12:37:48.121 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-12T12:37:48.121 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 2546, 2024-09-12T12:37:48.121 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 929122, 2024-09-12T12:37:48.121 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-12T12:37:48.121 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 2546, 2024-09-12T12:37:48.121 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-09-12T12:37:48.121 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-09-12T12:37:48.121 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 2546, 2024-09-12T12:37:48.121 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 929122, 2024-09-12T12:37:48.121 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-12T12:37:48.122 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:48.122 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:48.122 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:48.122 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T12:37:48.122 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.122 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-objecter_bytes": { 2024-09-12T12:37:48.122 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-12T12:37:48.122 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 104857600, 2024-09-12T12:37:48.122 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-12T12:37:48.122 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 0, 2024-09-12T12:37:48.122 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2024-09-12T12:37:48.122 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-12T12:37:48.122 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 0, 2024-09-12T12:37:48.122 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 2292, 2024-09-12T12:37:48.123 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 1088, 2024-09-12T12:37:48.123 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 2292, 2024-09-12T12:37:48.123 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 1088, 2024-09-12T12:37:48.123 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-12T12:37:48.123 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:48.123 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:48.123 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:48.123 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T12:37:48.123 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.123 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-objecter_ops": { 2024-09-12T12:37:48.123 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-12T12:37:48.123 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 1024, 2024-09-12T12:37:48.123 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-12T12:37:48.123 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 0, 2024-09-12T12:37:48.124 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2024-09-12T12:37:48.124 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-12T12:37:48.124 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 0, 2024-09-12T12:37:48.124 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 2292, 2024-09-12T12:37:48.124 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 2292, 2024-09-12T12:37:48.124 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 2292, 2024-09-12T12:37:48.124 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 2292, 2024-09-12T12:37:48.124 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-12T12:37:48.124 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:48.124 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:48.124 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:48.124 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T12:37:48.124 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.125 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-write_buf_throttle": { 2024-09-12T12:37:48.125 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-12T12:37:48.125 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 3758096384, 2024-09-12T12:37:48.125 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-12T12:37:48.125 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 0, 2024-09-12T12:37:48.125 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2024-09-12T12:37:48.125 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-12T12:37:48.125 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 0, 2024-09-12T12:37:48.125 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-09-12T12:37:48.125 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-09-12T12:37:48.125 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 0, 2024-09-12T12:37:48.125 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 0, 2024-09-12T12:37:48.125 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-12T12:37:48.125 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:48.125 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:48.126 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:48.126 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T12:37:48.126 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T12:37:48.126 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-write_buf_throttle-0x5613001b8b40": { 2024-09-12T12:37:48.126 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-12T12:37:48.126 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 3758096384, 2024-09-12T12:37:48.126 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-12T12:37:48.126 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 0, 2024-09-12T12:37:48.126 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2024-09-12T12:37:48.126 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-12T12:37:48.126 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 0, 2024-09-12T12:37:48.126 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-09-12T12:37:48.126 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-09-12T12:37:48.126 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 0, 2024-09-12T12:37:48.126 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 0, 2024-09-12T12:37:48.126 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-12T12:37:48.127 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-12T12:37:48.127 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-12T12:37:48.127 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-12T12:37:48.127 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T12:37:48.127 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T12:37:48.127 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-12T12:37:48.976 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-09-12T12:37:48.976 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-09-12T12:37:48.976 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-12T12:37:48.990 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-12T12:37:48.990 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T12:37:48.991 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:37:49.027 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T12:37:49.027 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:37:49.088 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-12T12:37:49.400 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:37:49.803 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:49 smithi033 ceph-mon[31246]: pgmap v704: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-12T12:37:49.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:49 smithi043 ceph-mon[34144]: pgmap v704: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-12T12:37:49.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:49 smithi102 ceph-mon[34799]: pgmap v704: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-12T12:37:49.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:49.885+0000 7f066cfca640 1 -- 172.21.15.33:0/3743561818 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0668102790 msgr2=0x7f06681067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:49.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:49.885+0000 7f066cfca640 1 --2- 172.21.15.33:0/3743561818 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0668102790 0x7f06681067e0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f065c009900 tx=0x7f065c02a3f0 comp rx=0 tx=0).stop 2024-09-12T12:37:49.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:49.885+0000 7f066cfca640 1 -- 172.21.15.33:0/3743561818 shutdown_connections 2024-09-12T12:37:49.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:49.885+0000 7f066cfca640 1 --2- 172.21.15.33:0/3743561818 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0668106f10 0x7f066810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:49.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:49.885+0000 7f066cfca640 1 --2- 172.21.15.33:0/3743561818 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0668102790 0x7f06681067e0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:49.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:49.885+0000 7f066cfca640 1 --2- 172.21.15.33:0/3743561818 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0668101de0 0x7f06681021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:49.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:49.885+0000 7f066cfca640 1 -- 172.21.15.33:0/3743561818 >> 172.21.15.33:0/3743561818 conn(0x7f06680fd8c0 msgr2=0x7f06680ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:37:49.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:49.885+0000 7f066cfca640 1 -- 172.21.15.33:0/3743561818 shutdown_connections 2024-09-12T12:37:49.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:49.885+0000 7f066cfca640 1 -- 172.21.15.33:0/3743561818 wait complete. 2024-09-12T12:37:49.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:49.886+0000 7f066cfca640 1 Processor -- start 2024-09-12T12:37:49.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:49.886+0000 7f066cfca640 1 -- start start 2024-09-12T12:37:49.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:49.886+0000 7f066cfca640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0668101de0 0x7f0668198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:49.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:49.886+0000 7f066cfca640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0668102790 0x7f0668198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:49.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:49.886+0000 7f066cfca640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0668106f10 0x7f066819cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:49.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:49.886+0000 7f066cfca640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0668111de0 con 0x7f0668101de0 2024-09-12T12:37:49.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:49.886+0000 7f066cfca640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0668111c60 con 0x7f0668102790 2024-09-12T12:37:49.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:49.886+0000 7f066cfca640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0668111f60 con 0x7f0668106f10 2024-09-12T12:37:49.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:49.886+0000 7f066659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0668101de0 0x7f0668198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:49.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:49.887+0000 7f066659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0668101de0 0x7f0668198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50806/0 (socket says 172.21.15.33:50806) 2024-09-12T12:37:49.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:49.887+0000 7f066659c640 1 -- 172.21.15.33:0/2915589337 learned_addr learned my addr 172.21.15.33:0/2915589337 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:37:49.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:49.887+0000 7f0666d9d640 1 --2- 172.21.15.33:0/2915589337 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0668106f10 0x7f066819cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:49.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:49.887+0000 7f0665d9b640 1 --2- 172.21.15.33:0/2915589337 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0668102790 0x7f0668198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:49.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:49.887+0000 7f066659c640 1 -- 172.21.15.33:0/2915589337 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0668106f10 msgr2=0x7f066819cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:49.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:49.887+0000 7f066659c640 1 --2- 172.21.15.33:0/2915589337 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0668106f10 0x7f066819cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:49.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:49.887+0000 7f066659c640 1 -- 172.21.15.33:0/2915589337 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0668102790 msgr2=0x7f0668198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:49.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:49.887+0000 7f066659c640 1 --2- 172.21.15.33:0/2915589337 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0668102790 0x7f0668198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:49.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:49.887+0000 7f066659c640 1 -- 172.21.15.33:0/2915589337 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f066819d2b0 con 0x7f0668101de0 2024-09-12T12:37:49.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:49.887+0000 7f0665d9b640 1 --2- 172.21.15.33:0/2915589337 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0668102790 0x7f0668198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:37:49.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:49.887+0000 7f0666d9d640 1 --2- 172.21.15.33:0/2915589337 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0668106f10 0x7f066819cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:37:49.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:49.887+0000 7f066659c640 1 --2- 172.21.15.33:0/2915589337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0668101de0 0x7f0668198300 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f065800d950 tx=0x7f065800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:37:49.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:49.887+0000 7f06577fe640 1 -- 172.21.15.33:0/2915589337 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0658017030 con 0x7f0668101de0 2024-09-12T12:37:49.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:49.887+0000 7f06577fe640 1 -- 172.21.15.33:0/2915589337 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0658004020 con 0x7f0668101de0 2024-09-12T12:37:49.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:49.887+0000 7f066cfca640 1 -- 172.21.15.33:0/2915589337 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f066819d5a0 con 0x7f0668101de0 2024-09-12T12:37:49.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:49.887+0000 7f06577fe640 1 -- 172.21.15.33:0/2915589337 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06580047a0 con 0x7f0668101de0 2024-09-12T12:37:49.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:49.887+0000 7f066cfca640 1 -- 172.21.15.33:0/2915589337 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06681a4e80 con 0x7f0668101de0 2024-09-12T12:37:49.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:49.888+0000 7f066cfca640 1 -- 172.21.15.33:0/2915589337 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06681021c0 con 0x7f0668101de0 2024-09-12T12:37:49.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:49.889+0000 7f06577fe640 1 -- 172.21.15.33:0/2915589337 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f06580041d0 con 0x7f0668101de0 2024-09-12T12:37:49.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:49.890+0000 7f06577fe640 1 --2- 172.21.15.33:0/2915589337 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f06500a2c00 0x7f06500a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:49.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:49.890+0000 7f0665d9b640 1 --2- 172.21.15.33:0/2915589337 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f06500a2c00 0x7f06500a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:49.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:49.890+0000 7f06577fe640 1 -- 172.21.15.33:0/2915589337 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f06580cf500 con 0x7f0668101de0 2024-09-12T12:37:49.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:49.891+0000 7f0665d9b640 1 --2- 172.21.15.33:0/2915589337 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f06500a2c00 0x7f06500a50c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f065c000c00 tx=0x7f065c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:37:49.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:49.893+0000 7f06577fe640 1 -- 172.21.15.33:0/2915589337 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f065809c150 con 0x7f0668101de0 2024-09-12T12:37:50.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:50.079+0000 7f066cfca640 1 -- 172.21.15.33:0/2915589337 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0668199660 con 0x7f0668101de0 2024-09-12T12:37:50.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:50.080+0000 7f06577fe640 1 -- 172.21.15.33:0/2915589337 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v89) ==== 81+0+591 (secure 0 0 0) 0x7f065809ba50 con 0x7f0668101de0 2024-09-12T12:37:50.081 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/3187741548 2024-09-13T12:16:57.792813+0000 2024-09-12T12:37:50.082 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6800/1381479235 2024-09-13T12:16:57.792813+0000 2024-09-12T12:37:50.082 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6801/1156183797 2024-09-13T12:16:33.559150+0000 2024-09-12T12:37:50.082 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/2222991013 2024-09-13T12:16:57.792813+0000 2024-09-12T12:37:50.082 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6801/1381479235 2024-09-13T12:16:57.792813+0000 2024-09-12T12:37:50.082 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6800/1156183797 2024-09-13T12:16:33.559150+0000 2024-09-12T12:37:50.082 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/3450458842 2024-09-13T12:16:33.559150+0000 2024-09-12T12:37:50.082 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/202580320 2024-09-13T12:16:33.559150+0000 2024-09-12T12:37:50.082 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/2441151017 2024-09-13T12:16:57.792813+0000 2024-09-12T12:37:50.082 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/1001176884 2024-09-13T12:16:33.559150+0000 2024-09-12T12:37:50.082 INFO:teuthology.orchestra.run.smithi033.stderr:listed 10 entries 2024-09-12T12:37:50.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:50.083+0000 7f066cfca640 1 -- 172.21.15.33:0/2915589337 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f06500a2c00 msgr2=0x7f06500a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:50.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:50.083+0000 7f066cfca640 1 --2- 172.21.15.33:0/2915589337 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f06500a2c00 0x7f06500a50c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f065c000c00 tx=0x7f065c031400 comp rx=0 tx=0).stop 2024-09-12T12:37:50.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:50.083+0000 7f066cfca640 1 -- 172.21.15.33:0/2915589337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0668101de0 msgr2=0x7f0668198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:50.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:50.083+0000 7f066cfca640 1 --2- 172.21.15.33:0/2915589337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0668101de0 0x7f0668198300 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f065800d950 tx=0x7f065800de10 comp rx=0 tx=0).stop 2024-09-12T12:37:50.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:50.083+0000 7f066cfca640 1 -- 172.21.15.33:0/2915589337 shutdown_connections 2024-09-12T12:37:50.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:50.083+0000 7f066cfca640 1 --2- 172.21.15.33:0/2915589337 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f06500a2c00 0x7f06500a50c0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:50.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:50.083+0000 7f066cfca640 1 --2- 172.21.15.33:0/2915589337 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0668106f10 0x7f066819cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:50.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:50.083+0000 7f066cfca640 1 --2- 172.21.15.33:0/2915589337 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0668102790 0x7f0668198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:50.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:50.083+0000 7f066cfca640 1 --2- 172.21.15.33:0/2915589337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0668101de0 0x7f0668198300 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:50.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:50.083+0000 7f066cfca640 1 -- 172.21.15.33:0/2915589337 >> 172.21.15.33:0/2915589337 conn(0x7f06680fd8c0 msgr2=0x7f06680fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:37:50.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:50.083+0000 7f066cfca640 1 -- 172.21.15.33:0/2915589337 shutdown_connections 2024-09-12T12:37:50.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:50.083+0000 7f066cfca640 1 -- 172.21.15.33:0/2915589337 wait complete. 2024-09-12T12:37:50.836 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:50 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/2915589337' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T12:37:50.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:50 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/2915589337' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T12:37:50.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:50 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/2915589337' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T12:37:50.907 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T12:37:50.907 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:37:50.925 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-12T12:37:51.225 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:37:51.647 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:51 smithi033 ceph-mon[31246]: pgmap v705: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T12:37:51.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.731+0000 7f9a4a7b1640 1 -- 172.21.15.33:0/1106798821 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a44108300 msgr2=0x7f9a4410ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:51.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.731+0000 7f9a4a7b1640 1 --2- 172.21.15.33:0/1106798821 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a44108300 0x7f9a4410ec70 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c009cd0 tx=0x7f9a3c02a8d0 comp rx=0 tx=0).stop 2024-09-12T12:37:51.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.731+0000 7f9a4a7b1640 1 -- 172.21.15.33:0/1106798821 shutdown_connections 2024-09-12T12:37:51.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.731+0000 7f9a4a7b1640 1 --2- 172.21.15.33:0/1106798821 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a44108300 0x7f9a4410ec70 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:51.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.731+0000 7f9a4a7b1640 1 --2- 172.21.15.33:0/1106798821 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a44103780 0x7f9a44107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:51.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.731+0000 7f9a4a7b1640 1 --2- 172.21.15.33:0/1106798821 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a44102dd0 0x7f9a441031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:51.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.731+0000 7f9a4a7b1640 1 -- 172.21.15.33:0/1106798821 >> 172.21.15.33:0/1106798821 conn(0x7f9a440fc7d0 msgr2=0x7f9a440febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:37:51.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.731+0000 7f9a4a7b1640 1 -- 172.21.15.33:0/1106798821 shutdown_connections 2024-09-12T12:37:51.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.731+0000 7f9a4a7b1640 1 -- 172.21.15.33:0/1106798821 wait complete. 2024-09-12T12:37:51.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.731+0000 7f9a4a7b1640 1 Processor -- start 2024-09-12T12:37:51.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.732+0000 7f9a4a7b1640 1 -- start start 2024-09-12T12:37:51.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.732+0000 7f9a4a7b1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a44102dd0 0x7f9a44198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:51.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.732+0000 7f9a4a7b1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a44103780 0x7f9a44198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:51.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.732+0000 7f9a4a7b1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a44108300 0x7f9a4419cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:51.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.732+0000 7f9a4a7b1640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9a44111f80 con 0x7f9a44108300 2024-09-12T12:37:51.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.732+0000 7f9a4a7b1640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9a44111e00 con 0x7f9a44103780 2024-09-12T12:37:51.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.732+0000 7f9a4a7b1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9a44112100 con 0x7f9a44102dd0 2024-09-12T12:37:51.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.732+0000 7f9a48d4e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a44108300 0x7f9a4419cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:51.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.732+0000 7f9a48d4e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a44108300 0x7f9a4419cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58244/0 (socket says 172.21.15.33:58244) 2024-09-12T12:37:51.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.732+0000 7f9a48d4e640 1 -- 172.21.15.33:0/3814950293 learned_addr learned my addr 172.21.15.33:0/3814950293 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:37:51.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.732+0000 7f9a437fe640 1 --2- 172.21.15.33:0/3814950293 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a44103780 0x7f9a44198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:51.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.732+0000 7f9a43fff640 1 --2- 172.21.15.33:0/3814950293 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a44102dd0 0x7f9a44198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:51.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.732+0000 7f9a48d4e640 1 -- 172.21.15.33:0/3814950293 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a44102dd0 msgr2=0x7f9a44198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:51.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.732+0000 7f9a48d4e640 1 --2- 172.21.15.33:0/3814950293 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a44102dd0 0x7f9a44198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:51.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.732+0000 7f9a48d4e640 1 -- 172.21.15.33:0/3814950293 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a44103780 msgr2=0x7f9a44198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:51.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.732+0000 7f9a48d4e640 1 --2- 172.21.15.33:0/3814950293 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a44103780 0x7f9a44198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:51.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.732+0000 7f9a48d4e640 1 -- 172.21.15.33:0/3814950293 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a4419d3f0 con 0x7f9a44108300 2024-09-12T12:37:51.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.733+0000 7f9a48d4e640 1 --2- 172.21.15.33:0/3814950293 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a44108300 0x7f9a4419cd10 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c005cc0 tx=0x7f9a3c032cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:37:51.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.733+0000 7f9a417fa640 1 -- 172.21.15.33:0/3814950293 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c003b70 con 0x7f9a44108300 2024-09-12T12:37:51.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.733+0000 7f9a4a7b1640 1 -- 172.21.15.33:0/3814950293 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a4419d680 con 0x7f9a44108300 2024-09-12T12:37:51.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.733+0000 7f9a417fa640 1 -- 172.21.15.33:0/3814950293 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9a3c003d10 con 0x7f9a44108300 2024-09-12T12:37:51.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.733+0000 7f9a417fa640 1 -- 172.21.15.33:0/3814950293 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c0307f0 con 0x7f9a44108300 2024-09-12T12:37:51.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.733+0000 7f9a4a7b1640 1 -- 172.21.15.33:0/3814950293 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a441a4fc0 con 0x7f9a44108300 2024-09-12T12:37:51.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.734+0000 7f9a4a7b1640 1 -- 172.21.15.33:0/3814950293 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a441031b0 con 0x7f9a44108300 2024-09-12T12:37:51.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.735+0000 7f9a417fa640 1 -- 172.21.15.33:0/3814950293 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9a3c004b40 con 0x7f9a44108300 2024-09-12T12:37:51.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.736+0000 7f9a417fa640 1 --2- 172.21.15.33:0/3814950293 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f9a2c0a2b80 0x7f9a2c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:51.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.736+0000 7f9a417fa640 1 -- 172.21.15.33:0/3814950293 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f9a3c0f0540 con 0x7f9a44108300 2024-09-12T12:37:51.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.736+0000 7f9a43fff640 1 --2- 172.21.15.33:0/3814950293 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f9a2c0a2b80 0x7f9a2c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:51.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.736+0000 7f9a43fff640 1 --2- 172.21.15.33:0/3814950293 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f9a2c0a2b80 0x7f9a2c0a5040 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9a3400abe0 tx=0x7f9a3400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:37:51.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.739+0000 7f9a417fa640 1 -- 172.21.15.33:0/3814950293 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9a3c0bd0b0 con 0x7f9a44108300 2024-09-12T12:37:51.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:51 smithi043 ceph-mon[34144]: pgmap v705: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T12:37:51.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:51 smithi102 ceph-mon[34799]: pgmap v705: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T12:37:51.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.934+0000 7f9a4a7b1640 1 -- 172.21.15.33:0/3814950293 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9a4410a290 con 0x7f9a44108300 2024-09-12T12:37:51.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.935+0000 7f9a417fa640 1 -- 172.21.15.33:0/3814950293 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v89) ==== 81+0+591 (secure 0 0 0) 0x7f9a3c0bc9b0 con 0x7f9a44108300 2024-09-12T12:37:51.936 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/3187741548 2024-09-13T12:16:57.792813+0000 2024-09-12T12:37:51.936 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6800/1381479235 2024-09-13T12:16:57.792813+0000 2024-09-12T12:37:51.936 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6801/1156183797 2024-09-13T12:16:33.559150+0000 2024-09-12T12:37:51.937 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/2222991013 2024-09-13T12:16:57.792813+0000 2024-09-12T12:37:51.937 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6801/1381479235 2024-09-13T12:16:57.792813+0000 2024-09-12T12:37:51.937 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6800/1156183797 2024-09-13T12:16:33.559150+0000 2024-09-12T12:37:51.937 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/3450458842 2024-09-13T12:16:33.559150+0000 2024-09-12T12:37:51.937 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/202580320 2024-09-13T12:16:33.559150+0000 2024-09-12T12:37:51.937 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/2441151017 2024-09-13T12:16:57.792813+0000 2024-09-12T12:37:51.937 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/1001176884 2024-09-13T12:16:33.559150+0000 2024-09-12T12:37:51.937 INFO:teuthology.orchestra.run.smithi033.stderr:listed 10 entries 2024-09-12T12:37:51.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.937+0000 7f9a4a7b1640 1 -- 172.21.15.33:0/3814950293 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f9a2c0a2b80 msgr2=0x7f9a2c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:51.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.937+0000 7f9a4a7b1640 1 --2- 172.21.15.33:0/3814950293 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f9a2c0a2b80 0x7f9a2c0a5040 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9a3400abe0 tx=0x7f9a3400a2d0 comp rx=0 tx=0).stop 2024-09-12T12:37:51.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.937+0000 7f9a4a7b1640 1 -- 172.21.15.33:0/3814950293 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a44108300 msgr2=0x7f9a4419cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:51.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.937+0000 7f9a4a7b1640 1 --2- 172.21.15.33:0/3814950293 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a44108300 0x7f9a4419cd10 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c005cc0 tx=0x7f9a3c032cf0 comp rx=0 tx=0).stop 2024-09-12T12:37:51.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.937+0000 7f9a4a7b1640 1 -- 172.21.15.33:0/3814950293 shutdown_connections 2024-09-12T12:37:51.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.937+0000 7f9a4a7b1640 1 --2- 172.21.15.33:0/3814950293 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f9a2c0a2b80 0x7f9a2c0a5040 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:51.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.937+0000 7f9a4a7b1640 1 --2- 172.21.15.33:0/3814950293 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a44108300 0x7f9a4419cd10 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:51.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.937+0000 7f9a4a7b1640 1 --2- 172.21.15.33:0/3814950293 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a44103780 0x7f9a44198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:51.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.937+0000 7f9a4a7b1640 1 --2- 172.21.15.33:0/3814950293 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a44102dd0 0x7f9a44198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:51.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.937+0000 7f9a4a7b1640 1 -- 172.21.15.33:0/3814950293 >> 172.21.15.33:0/3814950293 conn(0x7f9a440fc7d0 msgr2=0x7f9a44105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:37:51.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.937+0000 7f9a4a7b1640 1 -- 172.21.15.33:0/3814950293 shutdown_connections 2024-09-12T12:37:51.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:51.938+0000 7f9a4a7b1640 1 -- 172.21.15.33:0/3814950293 wait complete. 2024-09-12T12:37:52.644 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi033.front.sepia.ceph.com... 2024-09-12T12:37:52.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:37:52.644 DEBUG:teuthology.orchestra.run.smithi033:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-12T12:37:52.690 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi033.stderr:ceph-fuse[85480]: fuse finished with error 0 and tester_r 0 2024-09-12T12:37:52.691 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:37:52.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:52 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/3814950293' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T12:37:52.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:52 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/3814950293' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T12:37:52.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:52 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/3814950293' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T12:37:53.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:53 smithi033 ceph-mon[31246]: pgmap v706: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T12:37:53.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:53 smithi043 ceph-mon[34144]: pgmap v706: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T12:37:53.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:53 smithi102 ceph-mon[34799]: pgmap v706: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T12:37:55.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:55 smithi043 ceph-mon[34144]: pgmap v707: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 8 op/s 2024-09-12T12:37:55.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:55 smithi102 ceph-mon[34799]: pgmap v707: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 8 op/s 2024-09-12T12:37:55.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:55 smithi033 ceph-mon[31246]: pgmap v707: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 8 op/s 2024-09-12T12:37:57.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:57 smithi043 ceph-mon[34144]: pgmap v708: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-12T12:37:57.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:57 smithi102 ceph-mon[34799]: pgmap v708: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-12T12:37:57.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:57 smithi033 ceph-mon[31246]: pgmap v708: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-12T12:37:58.793 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi033.front.sepia.ceph.com 2024-09-12T12:37:58.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:37:58.793 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T12:37:58.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:37:58.830 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-09-12T12:37:58.906 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T12:37:58.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:37:58.906 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T12:37:58.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:37:58.979 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link delete ceph-brx 2024-09-12T12:37:59.081 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-12T12:37:59.092 INFO:tasks.cephadm:Teardown begin 2024-09-12T12:37:59.093 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T12:37:59.093 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:37:59.359 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:37:59.768 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:37:59 smithi033 ceph-mon[31246]: pgmap v709: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-12T12:37:59.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:37:59 smithi043 ceph-mon[34144]: pgmap v709: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-12T12:37:59.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:59.852+0000 7f6fbe36b640 1 -- 172.21.15.33:0/3270478658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6fb8106f20 msgr2=0x7f6fb810eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:59.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:59.852+0000 7f6fbe36b640 1 --2- 172.21.15.33:0/3270478658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6fb8106f20 0x7f6fb810eaa0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0009ca0 tx=0x7f6fb002a8c0 comp rx=0 tx=0).stop 2024-09-12T12:37:59.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:59.852+0000 7f6fbe36b640 1 -- 172.21.15.33:0/3270478658 shutdown_connections 2024-09-12T12:37:59.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:59.852+0000 7f6fbe36b640 1 --2- 172.21.15.33:0/3270478658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6fb8106f20 0x7f6fb810eaa0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:59.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:59.852+0000 7f6fbe36b640 1 --2- 172.21.15.33:0/3270478658 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fb81027a0 0x7f6fb81067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:59.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:59.852+0000 7f6fbe36b640 1 --2- 172.21.15.33:0/3270478658 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6fb8101df0 0x7f6fb81021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:59.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:59.852+0000 7f6fbe36b640 1 -- 172.21.15.33:0/3270478658 >> 172.21.15.33:0/3270478658 conn(0x7f6fb80fd8b0 msgr2=0x7f6fb80ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:37:59.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:59.852+0000 7f6fbe36b640 1 -- 172.21.15.33:0/3270478658 shutdown_connections 2024-09-12T12:37:59.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:59.852+0000 7f6fbe36b640 1 -- 172.21.15.33:0/3270478658 wait complete. 2024-09-12T12:37:59.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:59.852+0000 7f6fbe36b640 1 Processor -- start 2024-09-12T12:37:59.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:59.852+0000 7f6fbe36b640 1 -- start start 2024-09-12T12:37:59.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:59.853+0000 7f6fbe36b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6fb8101df0 0x7f6fb8198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:59.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:59.853+0000 7f6fbe36b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fb81027a0 0x7f6fb81987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:59.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:59.853+0000 7f6fbe36b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6fb8106f20 0x7f6fb819cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:59.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:59.853+0000 7f6fbe36b640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb8111e30 con 0x7f6fb8106f20 2024-09-12T12:37:59.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:59.853+0000 7f6fbe36b640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb8111cb0 con 0x7f6fb81027a0 2024-09-12T12:37:59.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:59.853+0000 7f6fbe36b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb8111fb0 con 0x7f6fb8101df0 2024-09-12T12:37:59.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:59.853+0000 7f6fbc908640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6fb8106f20 0x7f6fb819cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:59.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:59.853+0000 7f6fbc908640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6fb8106f20 0x7f6fb819cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58258/0 (socket says 172.21.15.33:58258) 2024-09-12T12:37:59.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:59.853+0000 7f6fbc908640 1 -- 172.21.15.33:0/1141592383 learned_addr learned my addr 172.21.15.33:0/1141592383 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:37:59.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:59.853+0000 7f6fb77fe640 1 --2- 172.21.15.33:0/1141592383 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fb81027a0 0x7f6fb81987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:59.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:59.853+0000 7f6fb7fff640 1 --2- 172.21.15.33:0/1141592383 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6fb8101df0 0x7f6fb8198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:59.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:59.853+0000 7f6fbc908640 1 -- 172.21.15.33:0/1141592383 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6fb8101df0 msgr2=0x7f6fb8198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:59.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:59.853+0000 7f6fbc908640 1 --2- 172.21.15.33:0/1141592383 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6fb8101df0 0x7f6fb8198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:59.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:59.853+0000 7f6fbc908640 1 -- 172.21.15.33:0/1141592383 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fb81027a0 msgr2=0x7f6fb81987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:37:59.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:59.853+0000 7f6fbc908640 1 --2- 172.21.15.33:0/1141592383 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fb81027a0 0x7f6fb81987d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:37:59.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:59.853+0000 7f6fbc908640 1 -- 172.21.15.33:0/1141592383 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fb819d240 con 0x7f6fb8106f20 2024-09-12T12:37:59.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:59.854+0000 7f6fbc908640 1 --2- 172.21.15.33:0/1141592383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6fb8106f20 0x7f6fb819cb60 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0009dc0 tx=0x7f6fb0032ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:37:59.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:59.854+0000 7f6fb57fa640 1 -- 172.21.15.33:0/1141592383 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb0003cf0 con 0x7f6fb8106f20 2024-09-12T12:37:59.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:59.854+0000 7f6fb57fa640 1 -- 172.21.15.33:0/1141592383 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6fb00044f0 con 0x7f6fb8106f20 2024-09-12T12:37:59.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:59.854+0000 7f6fbe36b640 1 -- 172.21.15.33:0/1141592383 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fb819d4d0 con 0x7f6fb8106f20 2024-09-12T12:37:59.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:59.854+0000 7f6fb57fa640 1 -- 172.21.15.33:0/1141592383 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb0030bf0 con 0x7f6fb8106f20 2024-09-12T12:37:59.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:59.854+0000 7f6fbe36b640 1 -- 172.21.15.33:0/1141592383 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fb81a4e10 con 0x7f6fb8106f20 2024-09-12T12:37:59.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:59.855+0000 7f6fbe36b640 1 -- 172.21.15.33:0/1141592383 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fb81021d0 con 0x7f6fb8106f20 2024-09-12T12:37:59.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:59.856+0000 7f6fb57fa640 1 -- 172.21.15.33:0/1141592383 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6fb0004040 con 0x7f6fb8106f20 2024-09-12T12:37:59.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:59.857+0000 7f6fb57fa640 1 --2- 172.21.15.33:0/1141592383 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f6fa00a2c00 0x7f6fa00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:37:59.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:59.857+0000 7f6fb7fff640 1 --2- 172.21.15.33:0/1141592383 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f6fa00a2c00 0x7f6fa00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:37:59.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:59.857+0000 7f6fb57fa640 1 -- 172.21.15.33:0/1141592383 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f6fb00f0900 con 0x7f6fb8106f20 2024-09-12T12:37:59.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:59.857+0000 7f6fb7fff640 1 --2- 172.21.15.33:0/1141592383 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f6fa00a2c00 0x7f6fa00a50c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8005fd0 tx=0x7f6fa800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:37:59.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:37:59.861+0000 7f6fb57fa640 1 -- 172.21.15.33:0/1141592383 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6fb00bd4d0 con 0x7f6fb8106f20 2024-09-12T12:37:59.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:37:59 smithi102 ceph-mon[34799]: pgmap v709: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-12T12:38:00.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:00.075+0000 7f6fbe36b640 1 -- 172.21.15.33:0/1141592383 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6fb8109b70 con 0x7f6fb8106f20 2024-09-12T12:38:00.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:00.075+0000 7f6fb57fa640 1 -- 172.21.15.33:0/1141592383 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11913 (secure 0 0 0) 0x7f6fb00bcdd0 con 0x7f6fb8106f20 2024-09-12T12:38:00.076 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:38:00.076 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-09-12T12:37:22:464399+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3327066342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3327066342},{"type":"v1","addr":"172.21.15.33:6835","nonce":3327066342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/19516401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":19516401},{"type":"v1","addr":"172.21.15.33:6837","nonce":19516401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1260196118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1260196118},{"type":"v1","addr":"172.21.15.33:6839","nonce":1260196118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/4288248356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4288248356},{"type":"v1","addr":"172.21.15.33:6841","nonce":4288248356}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/3051073141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3051073141},{"type":"v1","addr":"172.21.15.43:6833","nonce":3051073141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3282762800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3282762800},{"type":"v1","addr":"172.21.15.43:6835","nonce":3282762800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:23:46.400609+0000","modified":"2024-09-12T12:37:22.258221+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24490,"mds_2":24478},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3051713000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3051713000},{"type":"v1","addr":"172.21.15.102:6833","nonce":3051713000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6837/2472064883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2472064883},{"type":"v1","addr":"172.21.15.43:6837","nonce":2472064883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/1987408860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":1987408860},{"type":"v1","addr":"172.21.15.43:6839","nonce":1987408860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/4179527539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":4179527539},{"type":"v1","addr":"172.21.15.102:6835","nonce":4179527539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/2409953270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2409953270},{"type":"v1","addr":"172.21.15.102:6837","nonce":2409953270}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.102:6839/1553271340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":1553271340},{"type":"v1","addr":"172.21.15.102:6839","nonce":1553271340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24499,"qdb_cluster":[24478,24490,24499]},"id":1}]} 2024-09-12T12:38:00.076 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-09-12T12:38:00.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:00.078+0000 7f6fbe36b640 1 -- 172.21.15.33:0/1141592383 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f6fa00a2c00 msgr2=0x7f6fa00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:38:00.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:00.078+0000 7f6fbe36b640 1 --2- 172.21.15.33:0/1141592383 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f6fa00a2c00 0x7f6fa00a50c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8005fd0 tx=0x7f6fa800b390 comp rx=0 tx=0).stop 2024-09-12T12:38:00.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:00.078+0000 7f6fbe36b640 1 -- 172.21.15.33:0/1141592383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6fb8106f20 msgr2=0x7f6fb819cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:38:00.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:00.078+0000 7f6fbe36b640 1 --2- 172.21.15.33:0/1141592383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6fb8106f20 0x7f6fb819cb60 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0009dc0 tx=0x7f6fb0032ff0 comp rx=0 tx=0).stop 2024-09-12T12:38:00.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:00.078+0000 7f6fbe36b640 1 -- 172.21.15.33:0/1141592383 shutdown_connections 2024-09-12T12:38:00.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:00.078+0000 7f6fbe36b640 1 --2- 172.21.15.33:0/1141592383 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f6fa00a2c00 0x7f6fa00a50c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:00.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:00.078+0000 7f6fbe36b640 1 --2- 172.21.15.33:0/1141592383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6fb8106f20 0x7f6fb819cb60 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:00.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:00.078+0000 7f6fbe36b640 1 --2- 172.21.15.33:0/1141592383 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fb81027a0 0x7f6fb81987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:00.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:00.078+0000 7f6fbe36b640 1 --2- 172.21.15.33:0/1141592383 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6fb8101df0 0x7f6fb8198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:00.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:00.078+0000 7f6fbe36b640 1 -- 172.21.15.33:0/1141592383 >> 172.21.15.33:0/1141592383 conn(0x7f6fb80fd8b0 msgr2=0x7f6fb80febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:38:00.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:00.078+0000 7f6fbe36b640 1 -- 172.21.15.33:0/1141592383 shutdown_connections 2024-09-12T12:38:00.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:00.078+0000 7f6fbe36b640 1 -- 172.21.15.33:0/1141592383 wait complete. 2024-09-12T12:38:00.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:00 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/1141592383' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:38:00.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:00 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/1141592383' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:38:00.876 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:38:00.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:00 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/1141592383' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:38:01.143 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:38:01.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.637+0000 7fb96f417640 1 -- 172.21.15.33:0/2045470380 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb96806a370 msgr2=0x7fb9681009c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:38:01.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.637+0000 7fb96f417640 1 --2- 172.21.15.33:0/2045470380 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb96806a370 0x7fb9681009c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fb958009900 tx=0x7fb95802a410 comp rx=0 tx=0).stop 2024-09-12T12:38:01.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.637+0000 7fb96f417640 1 -- 172.21.15.33:0/2045470380 shutdown_connections 2024-09-12T12:38:01.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.637+0000 7fb96f417640 1 --2- 172.21.15.33:0/2045470380 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb968104e80 0x7fb968105330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:01.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.637+0000 7fb96f417640 1 --2- 172.21.15.33:0/2045470380 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb96806a370 0x7fb9681009c0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:01.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.637+0000 7fb96f417640 1 --2- 172.21.15.33:0/2045470380 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb968069f00 0x7fb968100480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:01.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.637+0000 7fb96f417640 1 -- 172.21.15.33:0/2045470380 >> 172.21.15.33:0/2045470380 conn(0x7fb968077210 msgr2=0x7fb9680fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:38:01.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.637+0000 7fb96f417640 1 -- 172.21.15.33:0/2045470380 shutdown_connections 2024-09-12T12:38:01.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.637+0000 7fb96f417640 1 -- 172.21.15.33:0/2045470380 wait complete. 2024-09-12T12:38:01.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.637+0000 7fb96f417640 1 Processor -- start 2024-09-12T12:38:01.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.637+0000 7fb96f417640 1 -- start start 2024-09-12T12:38:01.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.638+0000 7fb96f417640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb968069f00 0x7fb968102b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:38:01.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.638+0000 7fb96f417640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb96806a370 0x7fb968103050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:38:01.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.638+0000 7fb96f417640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb968104e80 0x7fb968103590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:38:01.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.638+0000 7fb96f417640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb968110d60 con 0x7fb968104e80 2024-09-12T12:38:01.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.638+0000 7fb96f417640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb968110be0 con 0x7fb96806a370 2024-09-12T12:38:01.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.638+0000 7fb96f417640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb968110ee0 con 0x7fb968069f00 2024-09-12T12:38:01.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.638+0000 7fb96d9b4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb968104e80 0x7fb968103590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:38:01.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.638+0000 7fb96d9b4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb968104e80 0x7fb968103590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52630/0 (socket says 172.21.15.33:52630) 2024-09-12T12:38:01.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.638+0000 7fb96d9b4640 1 -- 172.21.15.33:0/448047779 learned_addr learned my addr 172.21.15.33:0/448047779 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:38:01.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.638+0000 7fb96d1b3640 1 --2- 172.21.15.33:0/448047779 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb968069f00 0x7fb968102b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:38:01.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.638+0000 7fb96c9b2640 1 --2- 172.21.15.33:0/448047779 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb96806a370 0x7fb968103050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:38:01.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.638+0000 7fb96d9b4640 1 -- 172.21.15.33:0/448047779 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb968069f00 msgr2=0x7fb968102b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:38:01.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.638+0000 7fb96d9b4640 1 --2- 172.21.15.33:0/448047779 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb968069f00 0x7fb968102b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:01.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.638+0000 7fb96d9b4640 1 -- 172.21.15.33:0/448047779 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb96806a370 msgr2=0x7fb968103050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:38:01.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.638+0000 7fb96d9b4640 1 --2- 172.21.15.33:0/448047779 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb96806a370 0x7fb968103050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:01.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.638+0000 7fb96d9b4640 1 -- 172.21.15.33:0/448047779 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9681a6850 con 0x7fb968104e80 2024-09-12T12:38:01.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.638+0000 7fb96c9b2640 1 --2- 172.21.15.33:0/448047779 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb96806a370 0x7fb968103050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:38:01.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.638+0000 7fb96d9b4640 1 --2- 172.21.15.33:0/448047779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb968104e80 0x7fb968103590 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fb96000eaa0 tx=0x7fb96000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:38:01.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.639+0000 7fb95e7fc640 1 -- 172.21.15.33:0/448047779 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb96000cdb0 con 0x7fb968104e80 2024-09-12T12:38:01.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.639+0000 7fb95e7fc640 1 -- 172.21.15.33:0/448047779 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb960005020 con 0x7fb968104e80 2024-09-12T12:38:01.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.639+0000 7fb96f417640 1 -- 172.21.15.33:0/448047779 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9681a6b40 con 0x7fb968104e80 2024-09-12T12:38:01.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.639+0000 7fb95e7fc640 1 -- 172.21.15.33:0/448047779 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9600116d0 con 0x7fb968104e80 2024-09-12T12:38:01.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.639+0000 7fb96f417640 1 -- 172.21.15.33:0/448047779 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9681a7050 con 0x7fb968104e80 2024-09-12T12:38:01.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.640+0000 7fb96f417640 1 -- 172.21.15.33:0/448047779 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb968105330 con 0x7fb968104e80 2024-09-12T12:38:01.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.642+0000 7fb95e7fc640 1 -- 172.21.15.33:0/448047779 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fb9600051d0 con 0x7fb968104e80 2024-09-12T12:38:01.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.642+0000 7fb95e7fc640 1 --2- 172.21.15.33:0/448047779 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb9540a2b80 0x7fb9540a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:38:01.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.642+0000 7fb95e7fc640 1 -- 172.21.15.33:0/448047779 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7fb9600cf980 con 0x7fb968104e80 2024-09-12T12:38:01.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.642+0000 7fb96d1b3640 1 --2- 172.21.15.33:0/448047779 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb9540a2b80 0x7fb9540a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:38:01.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.643+0000 7fb96d1b3640 1 --2- 172.21.15.33:0/448047779 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb9540a2b80 0x7fb9540a5040 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb964005fd0 tx=0x7fb964005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:38:01.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.646+0000 7fb95e7fc640 1 -- 172.21.15.33:0/448047779 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb960016030 con 0x7fb968104e80 2024-09-12T12:38:01.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.860+0000 7fb96f417640 1 -- 172.21.15.33:0/448047779 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb968104040 con 0x7fb968104e80 2024-09-12T12:38:01.861 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:01 smithi033 ceph-mon[31246]: pgmap v710: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-12T12:38:01.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.861+0000 7fb95e7fc640 1 -- 172.21.15.33:0/448047779 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11913 (secure 0 0 0) 0x7fb968104040 con 0x7fb968104e80 2024-09-12T12:38:01.862 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:38:01.862 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-09-12T12:37:22:464399+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3327066342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3327066342},{"type":"v1","addr":"172.21.15.33:6835","nonce":3327066342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/19516401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":19516401},{"type":"v1","addr":"172.21.15.33:6837","nonce":19516401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1260196118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1260196118},{"type":"v1","addr":"172.21.15.33:6839","nonce":1260196118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/4288248356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4288248356},{"type":"v1","addr":"172.21.15.33:6841","nonce":4288248356}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/3051073141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3051073141},{"type":"v1","addr":"172.21.15.43:6833","nonce":3051073141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3282762800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3282762800},{"type":"v1","addr":"172.21.15.43:6835","nonce":3282762800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:23:46.400609+0000","modified":"2024-09-12T12:37:22.258221+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24490,"mds_2":24478},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3051713000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3051713000},{"type":"v1","addr":"172.21.15.102:6833","nonce":3051713000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6837/2472064883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2472064883},{"type":"v1","addr":"172.21.15.43:6837","nonce":2472064883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/1987408860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":1987408860},{"type":"v1","addr":"172.21.15.43:6839","nonce":1987408860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/4179527539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":4179527539},{"type":"v1","addr":"172.21.15.102:6835","nonce":4179527539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/2409953270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2409953270},{"type":"v1","addr":"172.21.15.102:6837","nonce":2409953270}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.102:6839/1553271340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":1553271340},{"type":"v1","addr":"172.21.15.102:6839","nonce":1553271340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24499,"qdb_cluster":[24478,24490,24499]},"id":1}]} 2024-09-12T12:38:01.862 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-09-12T12:38:01.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.863+0000 7fb96f417640 1 -- 172.21.15.33:0/448047779 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb9540a2b80 msgr2=0x7fb9540a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:38:01.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.863+0000 7fb96f417640 1 --2- 172.21.15.33:0/448047779 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb9540a2b80 0x7fb9540a5040 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb964005fd0 tx=0x7fb964005850 comp rx=0 tx=0).stop 2024-09-12T12:38:01.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.863+0000 7fb96f417640 1 -- 172.21.15.33:0/448047779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb968104e80 msgr2=0x7fb968103590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:38:01.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.863+0000 7fb96f417640 1 --2- 172.21.15.33:0/448047779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb968104e80 0x7fb968103590 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fb96000eaa0 tx=0x7fb96000ef60 comp rx=0 tx=0).stop 2024-09-12T12:38:01.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.863+0000 7fb96f417640 1 -- 172.21.15.33:0/448047779 shutdown_connections 2024-09-12T12:38:01.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.863+0000 7fb96f417640 1 --2- 172.21.15.33:0/448047779 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7fb9540a2b80 0x7fb9540a5040 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:01.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.863+0000 7fb96f417640 1 --2- 172.21.15.33:0/448047779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb968104e80 0x7fb968103590 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:01.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.863+0000 7fb96f417640 1 --2- 172.21.15.33:0/448047779 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb96806a370 0x7fb968103050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:01.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.863+0000 7fb96f417640 1 --2- 172.21.15.33:0/448047779 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb968069f00 0x7fb968102b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:01.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.863+0000 7fb96f417640 1 -- 172.21.15.33:0/448047779 >> 172.21.15.33:0/448047779 conn(0x7fb968077210 msgr2=0x7fb9680fc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:38:01.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.863+0000 7fb96f417640 1 -- 172.21.15.33:0/448047779 shutdown_connections 2024-09-12T12:38:01.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:01.863+0000 7fb96f417640 1 -- 172.21.15.33:0/448047779 wait complete. 2024-09-12T12:38:01.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:01 smithi043 ceph-mon[34144]: pgmap v710: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-12T12:38:01.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:01 smithi102 ceph-mon[34799]: pgmap v710: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-12T12:38:02.549 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T12:38:02.822 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:38:02.849 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:02 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/448047779' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:38:02.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:02 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/448047779' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:38:02.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:02 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/448047779' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:38:03.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.431+0000 7f09efee3640 1 -- 172.21.15.33:0/3095740457 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09e810e500 msgr2=0x7f09e8110910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:38:03.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.431+0000 7f09efee3640 1 --2- 172.21.15.33:0/3095740457 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09e810e500 0x7f09e8110910 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f09e0009900 tx=0x7f09e002a3f0 comp rx=0 tx=0).stop 2024-09-12T12:38:03.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.431+0000 7f09efee3640 1 -- 172.21.15.33:0/3095740457 shutdown_connections 2024-09-12T12:38:03.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.431+0000 7f09efee3640 1 --2- 172.21.15.33:0/3095740457 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09e810e500 0x7f09e8110910 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:03.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.431+0000 7f09efee3640 1 --2- 172.21.15.33:0/3095740457 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09e8101440 0x7f09e810df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:03.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.431+0000 7f09efee3640 1 --2- 172.21.15.33:0/3095740457 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09e8100b20 0x7f09e8100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:03.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.431+0000 7f09efee3640 1 -- 172.21.15.33:0/3095740457 >> 172.21.15.33:0/3095740457 conn(0x7f09e80fc7d0 msgr2=0x7f09e80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:38:03.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.431+0000 7f09efee3640 1 -- 172.21.15.33:0/3095740457 shutdown_connections 2024-09-12T12:38:03.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.431+0000 7f09efee3640 1 -- 172.21.15.33:0/3095740457 wait complete. 2024-09-12T12:38:03.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.431+0000 7f09efee3640 1 Processor -- start 2024-09-12T12:38:03.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.432+0000 7f09efee3640 1 -- start start 2024-09-12T12:38:03.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.432+0000 7f09efee3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09e8100b20 0x7f09e819a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:38:03.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.432+0000 7f09efee3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09e8101440 0x7f09e819aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:38:03.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.432+0000 7f09efee3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09e810e500 0x7f09e819ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:38:03.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.432+0000 7f09efee3640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f09e81140e0 con 0x7f09e8100b20 2024-09-12T12:38:03.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.432+0000 7f09efee3640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f09e8113f60 con 0x7f09e810e500 2024-09-12T12:38:03.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.432+0000 7f09efee3640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f09e8114260 con 0x7f09e8101440 2024-09-12T12:38:03.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.432+0000 7f09edc7f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09e8100b20 0x7f09e819a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:38:03.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.432+0000 7f09edc7f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09e8100b20 0x7f09e819a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52650/0 (socket says 172.21.15.33:52650) 2024-09-12T12:38:03.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.432+0000 7f09edc7f640 1 -- 172.21.15.33:0/1858024104 learned_addr learned my addr 172.21.15.33:0/1858024104 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:38:03.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.432+0000 7f09ee480640 1 --2- 172.21.15.33:0/1858024104 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09e810e500 0x7f09e819ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:38:03.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.432+0000 7f09ed47e640 1 --2- 172.21.15.33:0/1858024104 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09e8101440 0x7f09e819aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:38:03.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.432+0000 7f09edc7f640 1 -- 172.21.15.33:0/1858024104 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09e8101440 msgr2=0x7f09e819aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:38:03.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.432+0000 7f09edc7f640 1 --2- 172.21.15.33:0/1858024104 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09e8101440 0x7f09e819aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:03.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.432+0000 7f09edc7f640 1 -- 172.21.15.33:0/1858024104 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09e810e500 msgr2=0x7f09e819ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:38:03.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.432+0000 7f09edc7f640 1 --2- 172.21.15.33:0/1858024104 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09e810e500 0x7f09e819ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:03.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.432+0000 7f09edc7f640 1 -- 172.21.15.33:0/1858024104 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09e819f550 con 0x7f09e8100b20 2024-09-12T12:38:03.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.433+0000 7f09edc7f640 1 --2- 172.21.15.33:0/1858024104 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09e8100b20 0x7f09e819a5a0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f09e400cce0 tx=0x7f09e400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:38:03.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.433+0000 7f09daffd640 1 -- 172.21.15.33:0/1858024104 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e400f650 con 0x7f09e8100b20 2024-09-12T12:38:03.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.433+0000 7f09daffd640 1 -- 172.21.15.33:0/1858024104 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f09e400fca0 con 0x7f09e8100b20 2024-09-12T12:38:03.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.433+0000 7f09efee3640 1 -- 172.21.15.33:0/1858024104 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09e819f840 con 0x7f09e8100b20 2024-09-12T12:38:03.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.433+0000 7f09daffd640 1 -- 172.21.15.33:0/1858024104 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e4018b90 con 0x7f09e8100b20 2024-09-12T12:38:03.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.433+0000 7f09efee3640 1 -- 172.21.15.33:0/1858024104 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09e81a7120 con 0x7f09e8100b20 2024-09-12T12:38:03.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.434+0000 7f09efee3640 1 -- 172.21.15.33:0/1858024104 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09e8100f00 con 0x7f09e8100b20 2024-09-12T12:38:03.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.435+0000 7f09daffd640 1 -- 172.21.15.33:0/1858024104 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f09e400f7f0 con 0x7f09e8100b20 2024-09-12T12:38:03.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.436+0000 7f09daffd640 1 --2- 172.21.15.33:0/1858024104 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f09d40a2b80 0x7f09d40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:38:03.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.436+0000 7f09daffd640 1 -- 172.21.15.33:0/1858024104 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f09e40cfbb0 con 0x7f09e8100b20 2024-09-12T12:38:03.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.436+0000 7f09ed47e640 1 --2- 172.21.15.33:0/1858024104 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f09d40a2b80 0x7f09d40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:38:03.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.436+0000 7f09ed47e640 1 --2- 172.21.15.33:0/1858024104 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f09d40a2b80 0x7f09d40a5040 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f09dc005fd0 tx=0x7f09dc00b510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:38:03.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.439+0000 7f09daffd640 1 -- 172.21.15.33:0/1858024104 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f09e4014030 con 0x7f09e8100b20 2024-09-12T12:38:03.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.620+0000 7f09efee3640 1 -- 172.21.15.33:0/1858024104 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f09e819b900 con 0x7f09e8100b20 2024-09-12T12:38:03.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.622+0000 7f09daffd640 1 -- 172.21.15.33:0/1858024104 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24763 (secure 0 0 0) 0x7f09e409c810 con 0x7f09e8100b20 2024-09-12T12:38:03.626 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T12:38:03.626 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":89,"fsid":"a66dfafc-7100-11ef-bcea-c7b262605968","created":"2024-09-12T12:16:11.904815+0000","modified":"2024-09-12T12:25:59.801807+0000","last_up_change":"2024-09-12T12:22:57.476185+0000","last_in_change":"2024-09-12T12:22:35.192556+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:19:12.296305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:23:42.509774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:23:44.842852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T12:23:51.308720+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"74b68729-c97c-4da6-a659-75d6c147ad05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6803","nonce":963294466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6805","nonce":963294466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6809","nonce":963294466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":963294466},{"type":"v1","addr":"172.21.15.33:6807","nonce":963294466}]},"public_addr":"172.21.15.33:6803/963294466","cluster_addr":"172.21.15.33:6805/963294466","heartbeat_back_addr":"172.21.15.33:6809/963294466","heartbeat_front_addr":"172.21.15.33:6807/963294466","state":["exists","up"]},{"osd":1,"uuid":"2461a388-e110-420b-9404-eb54cd39119e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6801","nonce":2306025171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6803","nonce":2306025171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6807","nonce":2306025171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":2306025171},{"type":"v1","addr":"172.21.15.43:6805","nonce":2306025171}]},"public_addr":"172.21.15.43:6801/2306025171","cluster_addr":"172.21.15.43:6803/2306025171","heartbeat_back_addr":"172.21.15.43:6807/2306025171","heartbeat_front_addr":"172.21.15.43:6805/2306025171","state":["exists","up"]},{"osd":2,"uuid":"4ba9dd02-977d-45fb-b366-ade15b52232b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6801","nonce":4257223217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6803","nonce":4257223217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6807","nonce":4257223217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":4257223217},{"type":"v1","addr":"172.21.15.102:6805","nonce":4257223217}]},"public_addr":"172.21.15.102:6801/4257223217","cluster_addr":"172.21.15.102:6803/4257223217","heartbeat_back_addr":"172.21.15.102:6807/4257223217","heartbeat_front_addr":"172.21.15.102:6805/4257223217","state":["exists","up"]},{"osd":3,"uuid":"345aa854-9ea2-4103-a186-9794af34c237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6811","nonce":2483872739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6813","nonce":2483872739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6817","nonce":2483872739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2483872739},{"type":"v1","addr":"172.21.15.33:6815","nonce":2483872739}]},"public_addr":"172.21.15.33:6811/2483872739","cluster_addr":"172.21.15.33:6813/2483872739","heartbeat_back_addr":"172.21.15.33:6817/2483872739","heartbeat_front_addr":"172.21.15.33:6815/2483872739","state":["exists","up"]},{"osd":4,"uuid":"32acd6da-01d6-4a8e-9d05-3d394363d6f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6809","nonce":136043101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6811","nonce":136043101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6815","nonce":136043101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":136043101},{"type":"v1","addr":"172.21.15.43:6813","nonce":136043101}]},"public_addr":"172.21.15.43:6809/136043101","cluster_addr":"172.21.15.43:6811/136043101","heartbeat_back_addr":"172.21.15.43:6815/136043101","heartbeat_front_addr":"172.21.15.43:6813/136043101","state":["exists","up"]},{"osd":5,"uuid":"dced0037-2da2-48c2-a391-f871d6ceebb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6809","nonce":2605625792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6811","nonce":2605625792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6815","nonce":2605625792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2605625792},{"type":"v1","addr":"172.21.15.102:6813","nonce":2605625792}]},"public_addr":"172.21.15.102:6809/2605625792","cluster_addr":"172.21.15.102:6811/2605625792","heartbeat_back_addr":"172.21.15.102:6815/2605625792","heartbeat_front_addr":"172.21.15.102:6813/2605625792","state":["exists","up"]},{"osd":6,"uuid":"46e5532e-026a-4bb2-8847-2a3216e5d7a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6819","nonce":805864618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6821","nonce":805864618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6825","nonce":805864618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":805864618},{"type":"v1","addr":"172.21.15.33:6823","nonce":805864618}]},"public_addr":"172.21.15.33:6819/805864618","cluster_addr":"172.21.15.33:6821/805864618","heartbeat_back_addr":"172.21.15.33:6825/805864618","heartbeat_front_addr":"172.21.15.33:6823/805864618","state":["exists","up"]},{"osd":7,"uuid":"c8474ab4-68cd-4475-9429-b54981247ee2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6817","nonce":392537201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6819","nonce":392537201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6823","nonce":392537201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":392537201},{"type":"v1","addr":"172.21.15.43:6821","nonce":392537201}]},"public_addr":"172.21.15.43:6817/392537201","cluster_addr":"172.21.15.43:6819/392537201","heartbeat_back_addr":"172.21.15.43:6823/392537201","heartbeat_front_addr":"172.21.15.43:6821/392537201","state":["exists","up"]},{"osd":8,"uuid":"e7c2ef28-8c84-44d0-ba6d-7556ec1d02dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6817","nonce":1768219597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6819","nonce":1768219597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6823","nonce":1768219597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":1768219597},{"type":"v1","addr":"172.21.15.102:6821","nonce":1768219597}]},"public_addr":"172.21.15.102:6817/1768219597","cluster_addr":"172.21.15.102:6819/1768219597","heartbeat_back_addr":"172.21.15.102:6823/1768219597","heartbeat_front_addr":"172.21.15.102:6821/1768219597","state":["exists","up"]},{"osd":9,"uuid":"f2500273-8b21-4984-bc41-cec5cc0c883b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6827","nonce":973136168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6829","nonce":973136168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6833","nonce":973136168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":973136168},{"type":"v1","addr":"172.21.15.33:6831","nonce":973136168}]},"public_addr":"172.21.15.33:6827/973136168","cluster_addr":"172.21.15.33:6829/973136168","heartbeat_back_addr":"172.21.15.33:6833/973136168","heartbeat_front_addr":"172.21.15.33:6831/973136168","state":["exists","up"]},{"osd":10,"uuid":"954343c5-5d5b-4c30-acde-82aa695f7b04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6825","nonce":248515585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6827","nonce":248515585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6831","nonce":248515585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":248515585},{"type":"v1","addr":"172.21.15.43:6829","nonce":248515585}]},"public_addr":"172.21.15.43:6825/248515585","cluster_addr":"172.21.15.43:6827/248515585","heartbeat_back_addr":"172.21.15.43:6831/248515585","heartbeat_front_addr":"172.21.15.43:6829/248515585","state":["exists","up"]},{"osd":11,"uuid":"22b4147b-02ad-4514-be17-5bb395099eef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6825","nonce":2463068013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6827","nonce":2463068013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6831","nonce":2463068013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":2463068013},{"type":"v1","addr":"172.21.15.102:6829","nonce":2463068013}]},"public_addr":"172.21.15.102:6825/2463068013","cluster_addr":"172.21.15.102:6827/2463068013","heartbeat_back_addr":"172.21.15.102:6831/2463068013","heartbeat_front_addr":"172.21.15.102:6829/2463068013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:19.274804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:18:44.900294+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:08.885404+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:34.382089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:19:59.978538+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:25.275179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:20:49.429847+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:14.974792+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:21:40.268629+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:22:06.458679+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:22:31.813019+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:22:56.264078+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/3187741548":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6800/1381479235":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6801/1156183797":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/2222991013":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6801/1381479235":"2024-09-13T12:16:57.792813+0000","172.21.15.33:6800/1156183797":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/3450458842":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/202580320":"2024-09-13T12:16:33.559150+0000","172.21.15.33:0/2441151017":"2024-09-13T12:16:57.792813+0000","172.21.15.33:0/1001176884":"2024-09-13T12:16:33.559150+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:38:03.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.624+0000 7f09efee3640 1 -- 172.21.15.33:0/1858024104 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f09d40a2b80 msgr2=0x7f09d40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:38:03.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.624+0000 7f09efee3640 1 --2- 172.21.15.33:0/1858024104 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f09d40a2b80 0x7f09d40a5040 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f09dc005fd0 tx=0x7f09dc00b510 comp rx=0 tx=0).stop 2024-09-12T12:38:03.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.624+0000 7f09efee3640 1 -- 172.21.15.33:0/1858024104 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09e8100b20 msgr2=0x7f09e819a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:38:03.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.624+0000 7f09efee3640 1 --2- 172.21.15.33:0/1858024104 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09e8100b20 0x7f09e819a5a0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f09e400cce0 tx=0x7f09e400a620 comp rx=0 tx=0).stop 2024-09-12T12:38:03.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.624+0000 7f09efee3640 1 -- 172.21.15.33:0/1858024104 shutdown_connections 2024-09-12T12:38:03.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.624+0000 7f09efee3640 1 --2- 172.21.15.33:0/1858024104 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f09d40a2b80 0x7f09d40a5040 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:03.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.624+0000 7f09efee3640 1 --2- 172.21.15.33:0/1858024104 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09e810e500 0x7f09e819ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:03.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.624+0000 7f09efee3640 1 --2- 172.21.15.33:0/1858024104 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09e8101440 0x7f09e819aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:03.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.624+0000 7f09efee3640 1 --2- 172.21.15.33:0/1858024104 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09e8100b20 0x7f09e819a5a0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:03.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.624+0000 7f09efee3640 1 -- 172.21.15.33:0/1858024104 >> 172.21.15.33:0/1858024104 conn(0x7f09e80fc7d0 msgr2=0x7f09e80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:38:03.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.624+0000 7f09efee3640 1 -- 172.21.15.33:0/1858024104 shutdown_connections 2024-09-12T12:38:03.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:03.625+0000 7f09efee3640 1 -- 172.21.15.33:0/1858024104 wait complete. 2024-09-12T12:38:03.730 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:03 smithi033 ceph-mon[31246]: pgmap v711: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-12T12:38:03.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:03 smithi043 ceph-mon[34144]: pgmap v711: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-12T12:38:03.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:03 smithi102 ceph-mon[34799]: pgmap v711: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-12T12:38:04.467 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs fail cephfs 2024-09-12T12:38:04.729 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:38:04.730 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:04 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/1858024104' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:38:04.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:04 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/1858024104' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:38:04.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:04 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/1858024104' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:38:05.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.451+0000 7f118a915640 1 -- 172.21.15.33:0/2395638045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1184101420 msgr2=0x7f118410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:38:05.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.451+0000 7f118a915640 1 --2- 172.21.15.33:0/2395638045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1184101420 0x7f118410d950 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f117c009cd0 tx=0x7f117c02a8e0 comp rx=0 tx=0).stop 2024-09-12T12:38:05.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.451+0000 7f118a915640 1 -- 172.21.15.33:0/2395638045 shutdown_connections 2024-09-12T12:38:05.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.451+0000 7f118a915640 1 --2- 172.21.15.33:0/2395638045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1184101420 0x7f118410d950 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:05.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.451+0000 7f118a915640 1 --2- 172.21.15.33:0/2395638045 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1184100a80 0x7f1184100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:05.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.451+0000 7f118a915640 1 --2- 172.21.15.33:0/2395638045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1184106a80 0x7f1184106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:05.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.451+0000 7f118a915640 1 -- 172.21.15.33:0/2395638045 >> 172.21.15.33:0/2395638045 conn(0x7f11840fc7a0 msgr2=0x7f11840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:38:05.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.451+0000 7f118a915640 1 -- 172.21.15.33:0/2395638045 shutdown_connections 2024-09-12T12:38:05.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.451+0000 7f118a915640 1 -- 172.21.15.33:0/2395638045 wait complete. 2024-09-12T12:38:05.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.452+0000 7f118a915640 1 Processor -- start 2024-09-12T12:38:05.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.452+0000 7f118a915640 1 -- start start 2024-09-12T12:38:05.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.452+0000 7f118a915640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1184100a80 0x7f1184102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:38:05.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.452+0000 7f118a915640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1184101420 0x7f1184102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:38:05.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.452+0000 7f118a915640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1184106a80 0x7f11841030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:38:05.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.452+0000 7f118a915640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1184110d30 con 0x7f1184106a80 2024-09-12T12:38:05.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.452+0000 7f118a915640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1184110bb0 con 0x7f1184101420 2024-09-12T12:38:05.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.452+0000 7f118a915640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1184110eb0 con 0x7f1184100a80 2024-09-12T12:38:05.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.452+0000 7f1188eb2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1184106a80 0x7f11841030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:38:05.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.452+0000 7f1188eb2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1184106a80 0x7f11841030d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52662/0 (socket says 172.21.15.33:52662) 2024-09-12T12:38:05.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.452+0000 7f1188eb2640 1 -- 172.21.15.33:0/3362244831 learned_addr learned my addr 172.21.15.33:0/3362244831 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:38:05.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.452+0000 7f1183fff640 1 --2- 172.21.15.33:0/3362244831 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1184100a80 0x7f1184102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:38:05.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.453+0000 7f1188eb2640 1 -- 172.21.15.33:0/3362244831 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1184100a80 msgr2=0x7f1184102650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:38:05.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.453+0000 7f1188eb2640 1 --2- 172.21.15.33:0/3362244831 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1184100a80 0x7f1184102650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:05.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.453+0000 7f1188eb2640 1 -- 172.21.15.33:0/3362244831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1184101420 msgr2=0x7f1184102b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:38:05.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.453+0000 7f1188eb2640 1 --2- 172.21.15.33:0/3362244831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1184101420 0x7f1184102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:05.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.453+0000 7f1188eb2640 1 -- 172.21.15.33:0/3362244831 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11841a67e0 con 0x7f1184106a80 2024-09-12T12:38:05.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.453+0000 7f1188eb2640 1 --2- 172.21.15.33:0/3362244831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1184106a80 0x7f11841030d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f117c033040 tx=0x7f117c009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:38:05.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.453+0000 7f11817fa640 1 -- 172.21.15.33:0/3362244831 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c004040 con 0x7f1184106a80 2024-09-12T12:38:05.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.453+0000 7f118a915640 1 -- 172.21.15.33:0/3362244831 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11841a6a70 con 0x7f1184106a80 2024-09-12T12:38:05.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.453+0000 7f11817fa640 1 -- 172.21.15.33:0/3362244831 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f117c004690 con 0x7f1184106a80 2024-09-12T12:38:05.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.453+0000 7f11817fa640 1 -- 172.21.15.33:0/3362244831 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c030da0 con 0x7f1184106a80 2024-09-12T12:38:05.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.453+0000 7f118a915640 1 -- 172.21.15.33:0/3362244831 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11841a6fb0 con 0x7f1184106a80 2024-09-12T12:38:05.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.454+0000 7f118a915640 1 -- 172.21.15.33:0/3362244831 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1184100ee0 con 0x7f1184106a80 2024-09-12T12:38:05.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.456+0000 7f11817fa640 1 -- 172.21.15.33:0/3362244831 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f117c0041e0 con 0x7f1184106a80 2024-09-12T12:38:05.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.457+0000 7f11817fa640 1 --2- 172.21.15.33:0/3362244831 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f116c0a2b80 0x7f116c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:38:05.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.457+0000 7f1183fff640 1 --2- 172.21.15.33:0/3362244831 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f116c0a2b80 0x7f116c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:38:05.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.457+0000 7f11817fa640 1 -- 172.21.15.33:0/3362244831 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9150+0+0 (secure 0 0 0) 0x7f117c02e030 con 0x7f1184106a80 2024-09-12T12:38:05.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.457+0000 7f1183fff640 1 --2- 172.21.15.33:0/3362244831 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f116c0a2b80 0x7f116c0a5040 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1174009b50 tx=0x7f1174005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:38:05.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.460+0000 7f11817fa640 1 -- 172.21.15.33:0/3362244831 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f117c0bd1e0 con 0x7f1184106a80 2024-09-12T12:38:05.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.672+0000 7f118a915640 1 -- 172.21.15.33:0/3362244831 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f11841a7240 con 0x7f1184106a80 2024-09-12T12:38:05.673 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:05 smithi033 ceph-mon[31246]: pgmap v712: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-12T12:38:05.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.677+0000 7f11817fa640 1 -- 172.21.15.33:0/3362244831 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v29) ==== 161+0+0 (secure 0 0 0) 0x7f117c0bcae0 con 0x7f1184106a80 2024-09-12T12:38:05.677 INFO:teuthology.orchestra.run.smithi033.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T12:38:05.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.679+0000 7f118a915640 1 -- 172.21.15.33:0/3362244831 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f116c0a2b80 msgr2=0x7f116c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:38:05.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.679+0000 7f118a915640 1 --2- 172.21.15.33:0/3362244831 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f116c0a2b80 0x7f116c0a5040 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1174009b50 tx=0x7f1174005f90 comp rx=0 tx=0).stop 2024-09-12T12:38:05.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.679+0000 7f118a915640 1 -- 172.21.15.33:0/3362244831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1184106a80 msgr2=0x7f11841030d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:38:05.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.679+0000 7f118a915640 1 --2- 172.21.15.33:0/3362244831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1184106a80 0x7f11841030d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f117c033040 tx=0x7f117c009360 comp rx=0 tx=0).stop 2024-09-12T12:38:05.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.679+0000 7f118a915640 1 -- 172.21.15.33:0/3362244831 shutdown_connections 2024-09-12T12:38:05.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.679+0000 7f118a915640 1 --2- 172.21.15.33:0/3362244831 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f116c0a2b80 0x7f116c0a5040 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:05.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.679+0000 7f118a915640 1 --2- 172.21.15.33:0/3362244831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1184106a80 0x7f11841030d0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:05.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.679+0000 7f118a915640 1 --2- 172.21.15.33:0/3362244831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1184101420 0x7f1184102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:05.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.679+0000 7f118a915640 1 --2- 172.21.15.33:0/3362244831 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1184100a80 0x7f1184102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:05.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.679+0000 7f118a915640 1 -- 172.21.15.33:0/3362244831 >> 172.21.15.33:0/3362244831 conn(0x7f11840fc7a0 msgr2=0x7f1184104890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:38:05.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.679+0000 7f118a915640 1 -- 172.21.15.33:0/3362244831 shutdown_connections 2024-09-12T12:38:05.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:05.679+0000 7f118a915640 1 -- 172.21.15.33:0/3362244831 wait complete. 2024-09-12T12:38:05.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:05 smithi043 ceph-mon[34144]: pgmap v712: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-12T12:38:05.865 INFO:journalctl@ceph.mds.b.smithi043.stdout:Sep 12 12:38:05 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-b[64540]: ignoring --setuser ceph since I am not root 2024-09-12T12:38:05.866 INFO:journalctl@ceph.mds.b.smithi043.stdout:Sep 12 12:38:05 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-b[64540]: ignoring --setgroup ceph since I am not root 2024-09-12T12:38:05.866 INFO:journalctl@ceph.mds.b.smithi043.stdout:Sep 12 12:38:05 smithi043 ceph-mds[64544]: -- 172.21.15.43:0/849028203 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a529234680 con 0x55a529209400 2024-09-12T12:38:05.866 INFO:journalctl@ceph.mds.b.smithi043.stdout:Sep 12 12:38:05 smithi043 ceph-mds[64544]: -- 172.21.15.43:0/849028203 <== mon.1 v2:172.21.15.102:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a52922b860 con 0x55a529209400 2024-09-12T12:38:05.866 INFO:journalctl@ceph.mds.b.smithi043.stdout:Sep 12 12:38:05 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-b[64540]: starting mds.b at 2024-09-12T12:38:05.866 INFO:journalctl@ceph.mds.h.smithi043.stdout:Sep 12 12:38:05 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-h[64237]: ignoring --setuser ceph since I am not root 2024-09-12T12:38:05.866 INFO:journalctl@ceph.mds.h.smithi043.stdout:Sep 12 12:38:05 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-h[64237]: ignoring --setgroup ceph since I am not root 2024-09-12T12:38:05.866 INFO:journalctl@ceph.mds.h.smithi043.stdout:Sep 12 12:38:05 smithi043 ceph-mds[64241]: -- 172.21.15.43:0/44414248 <== mon.0 v2:172.21.15.33:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dc02f9f860 con 0x55dc02f7c800 2024-09-12T12:38:05.866 INFO:journalctl@ceph.mds.h.smithi043.stdout:Sep 12 12:38:05 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-h[64237]: starting mds.h at 2024-09-12T12:38:05.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:05 smithi102 ceph-mon[34799]: pgmap v712: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-12T12:38:05.896 INFO:journalctl@ceph.mds.l.smithi102.stdout:Sep 12 12:38:05 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-l[63946]: ignoring --setuser ceph since I am not root 2024-09-12T12:38:05.897 INFO:journalctl@ceph.mds.l.smithi102.stdout:Sep 12 12:38:05 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-l[63946]: ignoring --setgroup ceph since I am not root 2024-09-12T12:38:05.897 INFO:journalctl@ceph.mds.l.smithi102.stdout:Sep 12 12:38:05 smithi102 ceph-mds[63950]: -- 172.21.15.102:0/2246178283 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56002ab1e680 con 0x56002aaf3000 2024-09-12T12:38:05.897 INFO:journalctl@ceph.mds.l.smithi102.stdout:Sep 12 12:38:05 smithi102 ceph-mds[63950]: -- 172.21.15.102:0/2246178283 <== mon.1 v2:172.21.15.102:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56002ab15860 con 0x56002aaf3000 2024-09-12T12:38:05.897 INFO:journalctl@ceph.mds.l.smithi102.stdout:Sep 12 12:38:05 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-l[63946]: starting mds.l at 2024-09-12T12:38:05.897 INFO:journalctl@ceph.mds.c.smithi102.stdout:Sep 12 12:38:05 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-c[64549]: ignoring --setuser ceph since I am not root 2024-09-12T12:38:05.897 INFO:journalctl@ceph.mds.c.smithi102.stdout:Sep 12 12:38:05 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-c[64549]: ignoring --setgroup ceph since I am not root 2024-09-12T12:38:05.897 INFO:journalctl@ceph.mds.c.smithi102.stdout:Sep 12 12:38:05 smithi102 ceph-mds[64553]: -- 172.21.15.102:0/2996037073 <== mon.0 v2:172.21.15.33:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564b86185860 con 0x564b86163000 2024-09-12T12:38:05.898 INFO:journalctl@ceph.mds.c.smithi102.stdout:Sep 12 12:38:05 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-c[64549]: starting mds.c at 2024-09-12T12:38:05.898 INFO:journalctl@ceph.mds.f.smithi102.stdout:Sep 12 12:38:05 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-f[64249]: ignoring --setuser ceph since I am not root 2024-09-12T12:38:05.898 INFO:journalctl@ceph.mds.f.smithi102.stdout:Sep 12 12:38:05 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-f[64249]: ignoring --setgroup ceph since I am not root 2024-09-12T12:38:05.898 INFO:journalctl@ceph.mds.f.smithi102.stdout:Sep 12 12:38:05 smithi102 ceph-mds[64253]: -- 172.21.15.102:0/3026486500 <== mon.2 v2:172.21.15.43:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5642fd97d860 con 0x5642fd95b000 2024-09-12T12:38:05.898 INFO:journalctl@ceph.mds.f.smithi102.stdout:Sep 12 12:38:05 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-f[64249]: starting mds.f at 2024-09-12T12:38:05.898 INFO:journalctl@ceph.mds.i.smithi102.stdout:Sep 12 12:38:05 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-i[64853]: ignoring --setuser ceph since I am not root 2024-09-12T12:38:05.899 INFO:journalctl@ceph.mds.i.smithi102.stdout:Sep 12 12:38:05 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-i[64853]: ignoring --setgroup ceph since I am not root 2024-09-12T12:38:05.899 INFO:journalctl@ceph.mds.i.smithi102.stdout:Sep 12 12:38:05 smithi102 ceph-mds[64857]: -- 172.21.15.102:0/2302822032 <== mon.1 v2:172.21.15.102:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5571ecb13860 con 0x5571ecaf0800 2024-09-12T12:38:05.899 INFO:journalctl@ceph.mds.i.smithi102.stdout:Sep 12 12:38:05 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-i[64853]: starting mds.i at 2024-09-12T12:38:05.979 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:05 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mon-a[31242]: 2024-09-12T12:38:05.673+0000 7efdf41fc640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T12:38:06.346 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T12:38:06.608 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:38:06.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:06 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/3362244831' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T12:38:06.865 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:06 smithi043 ceph-mon[34144]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T12:38:06.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:06 smithi043 ceph-mon[34144]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T12:38:06.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:06 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/3362244831' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T12:38:06.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:06 smithi043 ceph-mon[34144]: osdmap e90: 12 total, 12 up, 12 in 2024-09-12T12:38:06.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:06 smithi043 ceph-mon[34144]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-12T12:38:06.883 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:06 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/3362244831' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T12:38:06.883 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:06 smithi033 ceph-mon[31246]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T12:38:06.883 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:06 smithi033 ceph-mon[31246]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T12:38:06.883 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:06 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/3362244831' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T12:38:06.883 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:06 smithi033 ceph-mon[31246]: osdmap e90: 12 total, 12 up, 12 in 2024-09-12T12:38:06.883 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:06 smithi033 ceph-mon[31246]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-12T12:38:06.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:06 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/3362244831' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T12:38:06.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:06 smithi102 ceph-mon[34799]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T12:38:06.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:06 smithi102 ceph-mon[34799]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T12:38:06.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:06 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/3362244831' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T12:38:06.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:06 smithi102 ceph-mon[34799]: osdmap e90: 12 total, 12 up, 12 in 2024-09-12T12:38:06.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:06 smithi102 ceph-mon[34799]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-12T12:38:07.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.109+0000 7f7a73708640 1 -- 172.21.15.33:0/2301481960 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a6c101420 msgr2=0x7f7a6c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:38:07.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.109+0000 7f7a73708640 1 --2- 172.21.15.33:0/2301481960 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a6c101420 0x7f7a6c10d950 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f7a64009cd0 tx=0x7f7a6402a8e0 comp rx=0 tx=0).stop 2024-09-12T12:38:07.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.110+0000 7f7a73708640 1 -- 172.21.15.33:0/2301481960 shutdown_connections 2024-09-12T12:38:07.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.110+0000 7f7a73708640 1 --2- 172.21.15.33:0/2301481960 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a6c101420 0x7f7a6c10d950 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:07.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.110+0000 7f7a73708640 1 --2- 172.21.15.33:0/2301481960 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a6c100a80 0x7f7a6c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:07.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.110+0000 7f7a73708640 1 --2- 172.21.15.33:0/2301481960 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7a6c106a80 0x7f7a6c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:07.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.110+0000 7f7a73708640 1 -- 172.21.15.33:0/2301481960 >> 172.21.15.33:0/2301481960 conn(0x7f7a6c0fc7a0 msgr2=0x7f7a6c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:38:07.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.110+0000 7f7a73708640 1 -- 172.21.15.33:0/2301481960 shutdown_connections 2024-09-12T12:38:07.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.110+0000 7f7a73708640 1 -- 172.21.15.33:0/2301481960 wait complete. 2024-09-12T12:38:07.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.110+0000 7f7a73708640 1 Processor -- start 2024-09-12T12:38:07.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.110+0000 7f7a73708640 1 -- start start 2024-09-12T12:38:07.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.111+0000 7f7a73708640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a6c100a80 0x7f7a6c199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:38:07.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.111+0000 7f7a73708640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a6c101420 0x7f7a6c199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:38:07.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.111+0000 7f7a73708640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7a6c106a80 0x7f7a6c1a41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:38:07.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.111+0000 7f7a73708640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6c110d30 con 0x7f7a6c101420 2024-09-12T12:38:07.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.111+0000 7f7a73708640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6c110bb0 con 0x7f7a6c100a80 2024-09-12T12:38:07.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.111+0000 7f7a73708640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6c110eb0 con 0x7f7a6c106a80 2024-09-12T12:38:07.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.111+0000 7f7a70ca3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a6c101420 0x7f7a6c199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:38:07.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.111+0000 7f7a70ca3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a6c101420 0x7f7a6c199660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52686/0 (socket says 172.21.15.33:52686) 2024-09-12T12:38:07.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.111+0000 7f7a70ca3640 1 -- 172.21.15.33:0/3484548463 learned_addr learned my addr 172.21.15.33:0/3484548463 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:38:07.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.111+0000 7f7a71ca5640 1 --2- 172.21.15.33:0/3484548463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7a6c106a80 0x7f7a6c1a41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:38:07.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.111+0000 7f7a714a4640 1 --2- 172.21.15.33:0/3484548463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a6c100a80 0x7f7a6c199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:38:07.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.111+0000 7f7a70ca3640 1 -- 172.21.15.33:0/3484548463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7a6c106a80 msgr2=0x7f7a6c1a41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:38:07.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.111+0000 7f7a70ca3640 1 --2- 172.21.15.33:0/3484548463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7a6c106a80 0x7f7a6c1a41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:07.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.111+0000 7f7a70ca3640 1 -- 172.21.15.33:0/3484548463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a6c100a80 msgr2=0x7f7a6c199120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:38:07.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.111+0000 7f7a70ca3640 1 --2- 172.21.15.33:0/3484548463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a6c100a80 0x7f7a6c199120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:07.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.111+0000 7f7a70ca3640 1 -- 172.21.15.33:0/3484548463 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a6c1a46e0 con 0x7f7a6c101420 2024-09-12T12:38:07.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.111+0000 7f7a70ca3640 1 --2- 172.21.15.33:0/3484548463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a6c101420 0x7f7a6c199660 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c00c920 tx=0x7f7a5c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:38:07.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.111+0000 7f7a627fc640 1 -- 172.21.15.33:0/3484548463 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c007c70 con 0x7f7a6c101420 2024-09-12T12:38:07.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.111+0000 7f7a627fc640 1 -- 172.21.15.33:0/3484548463 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7a5c007e10 con 0x7f7a6c101420 2024-09-12T12:38:07.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.111+0000 7f7a73708640 1 -- 172.21.15.33:0/3484548463 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a6c1a48b0 con 0x7f7a6c101420 2024-09-12T12:38:07.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.111+0000 7f7a627fc640 1 -- 172.21.15.33:0/3484548463 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c018820 con 0x7f7a6c101420 2024-09-12T12:38:07.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.112+0000 7f7a73708640 1 -- 172.21.15.33:0/3484548463 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a6c1a4df0 con 0x7f7a6c101420 2024-09-12T12:38:07.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.113+0000 7f7a73708640 1 -- 172.21.15.33:0/3484548463 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a6c100ee0 con 0x7f7a6c101420 2024-09-12T12:38:07.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.114+0000 7f7a627fc640 1 -- 172.21.15.33:0/3484548463 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7a5c0189c0 con 0x7f7a6c101420 2024-09-12T12:38:07.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.114+0000 7f7a627fc640 1 --2- 172.21.15.33:0/3484548463 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f7a580a2c00 0x7f7a580a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:38:07.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.115+0000 7f7a714a4640 1 --2- 172.21.15.33:0/3484548463 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f7a580a2c00 0x7f7a580a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:38:07.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.115+0000 7f7a627fc640 1 -- 172.21.15.33:0/3484548463 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9408+0+0 (secure 0 0 0) 0x7f7a5c0cf5a0 con 0x7f7a6c101420 2024-09-12T12:38:07.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.115+0000 7f7a714a4640 1 --2- 172.21.15.33:0/3484548463 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f7a580a2c00 0x7f7a580a50c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7a68005fd0 tx=0x7f7a6800b510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:38:07.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.119+0000 7f7a627fc640 1 -- 172.21.15.33:0/3484548463 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7a5c014030 con 0x7f7a6c101420 2024-09-12T12:38:07.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.330+0000 7f7a73708640 1 -- 172.21.15.33:0/3484548463 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f7a6c02d7c0 con 0x7f7a6c101420 2024-09-12T12:38:07.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.689+0000 7f7a627fc640 1 -- 172.21.15.33:0/3484548463 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v31) ==== 104+0+0 (secure 0 0 0) 0x7f7a5c09c070 con 0x7f7a6c101420 2024-09-12T12:38:07.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.692+0000 7f7a73708640 1 -- 172.21.15.33:0/3484548463 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f7a580a2c00 msgr2=0x7f7a580a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:38:07.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.692+0000 7f7a73708640 1 --2- 172.21.15.33:0/3484548463 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f7a580a2c00 0x7f7a580a50c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7a68005fd0 tx=0x7f7a6800b510 comp rx=0 tx=0).stop 2024-09-12T12:38:07.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.692+0000 7f7a73708640 1 -- 172.21.15.33:0/3484548463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a6c101420 msgr2=0x7f7a6c199660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:38:07.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.692+0000 7f7a73708640 1 --2- 172.21.15.33:0/3484548463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a6c101420 0x7f7a6c199660 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c00c920 tx=0x7f7a5c00cde0 comp rx=0 tx=0).stop 2024-09-12T12:38:07.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.692+0000 7f7a73708640 1 -- 172.21.15.33:0/3484548463 shutdown_connections 2024-09-12T12:38:07.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.692+0000 7f7a73708640 1 --2- 172.21.15.33:0/3484548463 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f7a580a2c00 0x7f7a580a50c0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:07.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.692+0000 7f7a73708640 1 --2- 172.21.15.33:0/3484548463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7a6c106a80 0x7f7a6c1a41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:07.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.692+0000 7f7a73708640 1 --2- 172.21.15.33:0/3484548463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a6c101420 0x7f7a6c199660 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:07.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.692+0000 7f7a73708640 1 --2- 172.21.15.33:0/3484548463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a6c100a80 0x7f7a6c199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:07.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.692+0000 7f7a73708640 1 -- 172.21.15.33:0/3484548463 >> 172.21.15.33:0/3484548463 conn(0x7f7a6c0fc7a0 msgr2=0x7f7a6c0fcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:38:07.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.692+0000 7f7a73708640 1 -- 172.21.15.33:0/3484548463 shutdown_connections 2024-09-12T12:38:07.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:07.692+0000 7f7a73708640 1 -- 172.21.15.33:0/3484548463 wait complete. 2024-09-12T12:38:07.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:07 smithi033 ceph-mon[31246]: pgmap v714: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-09-12T12:38:07.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:07 smithi033 ceph-mon[31246]: mds.? [v2:172.21.15.102:6833/1782428601,v1:172.21.15.102:6836/1782428601] up:boot 2024-09-12T12:38:07.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:07 smithi033 ceph-mon[31246]: mds.? [v2:172.21.15.43:6837/2940494462,v1:172.21.15.43:6839/2940494462] up:boot 2024-09-12T12:38:07.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:07 smithi033 ceph-mon[31246]: mds.? [v2:172.21.15.43:6836/2173458622,v1:172.21.15.43:6838/2173458622] up:boot 2024-09-12T12:38:07.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:07 smithi033 ceph-mon[31246]: mds.? [v2:172.21.15.102:6837/876360552,v1:172.21.15.102:6839/876360552] up:boot 2024-09-12T12:38:07.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:07 smithi033 ceph-mon[31246]: mds.? [v2:172.21.15.102:6832/2241789366,v1:172.21.15.102:6834/2241789366] up:boot 2024-09-12T12:38:07.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:07 smithi033 ceph-mon[31246]: mds.? [v2:172.21.15.102:6835/1455238664,v1:172.21.15.102:6838/1455238664] up:boot 2024-09-12T12:38:07.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:07 smithi033 ceph-mon[31246]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-12T12:38:07.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:07 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T12:38:07.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:07 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T12:38:07.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:07 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T12:38:07.983 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:07 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T12:38:07.983 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:07 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T12:38:07.983 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:07 smithi033 ceph-mon[31246]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T12:38:07.983 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:07 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/3484548463' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T12:38:08.052 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:07 smithi043 ceph-mon[34144]: pgmap v714: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-09-12T12:38:08.053 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:07 smithi043 ceph-mon[34144]: mds.? [v2:172.21.15.102:6833/1782428601,v1:172.21.15.102:6836/1782428601] up:boot 2024-09-12T12:38:08.053 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:07 smithi043 ceph-mon[34144]: mds.? [v2:172.21.15.43:6837/2940494462,v1:172.21.15.43:6839/2940494462] up:boot 2024-09-12T12:38:08.053 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:07 smithi043 ceph-mon[34144]: mds.? [v2:172.21.15.43:6836/2173458622,v1:172.21.15.43:6838/2173458622] up:boot 2024-09-12T12:38:08.053 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:07 smithi043 ceph-mon[34144]: mds.? [v2:172.21.15.102:6837/876360552,v1:172.21.15.102:6839/876360552] up:boot 2024-09-12T12:38:08.053 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:07 smithi043 ceph-mon[34144]: mds.? [v2:172.21.15.102:6832/2241789366,v1:172.21.15.102:6834/2241789366] up:boot 2024-09-12T12:38:08.054 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:07 smithi043 ceph-mon[34144]: mds.? [v2:172.21.15.102:6835/1455238664,v1:172.21.15.102:6838/1455238664] up:boot 2024-09-12T12:38:08.054 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:07 smithi043 ceph-mon[34144]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-12T12:38:08.054 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:07 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T12:38:08.054 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:07 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T12:38:08.054 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:07 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T12:38:08.054 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:07 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T12:38:08.055 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:07 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T12:38:08.055 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:07 smithi043 ceph-mon[34144]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T12:38:08.055 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:07 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/3484548463' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T12:38:08.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:07 smithi102 ceph-mon[34799]: pgmap v714: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-09-12T12:38:08.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:07 smithi102 ceph-mon[34799]: mds.? [v2:172.21.15.102:6833/1782428601,v1:172.21.15.102:6836/1782428601] up:boot 2024-09-12T12:38:08.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:07 smithi102 ceph-mon[34799]: mds.? [v2:172.21.15.43:6837/2940494462,v1:172.21.15.43:6839/2940494462] up:boot 2024-09-12T12:38:08.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:07 smithi102 ceph-mon[34799]: mds.? [v2:172.21.15.43:6836/2173458622,v1:172.21.15.43:6838/2173458622] up:boot 2024-09-12T12:38:08.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:07 smithi102 ceph-mon[34799]: mds.? [v2:172.21.15.102:6837/876360552,v1:172.21.15.102:6839/876360552] up:boot 2024-09-12T12:38:08.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:07 smithi102 ceph-mon[34799]: mds.? [v2:172.21.15.102:6832/2241789366,v1:172.21.15.102:6834/2241789366] up:boot 2024-09-12T12:38:08.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:07 smithi102 ceph-mon[34799]: mds.? [v2:172.21.15.102:6835/1455238664,v1:172.21.15.102:6838/1455238664] up:boot 2024-09-12T12:38:08.148 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:07 smithi102 ceph-mon[34799]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-12T12:38:08.148 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:07 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T12:38:08.148 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:07 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T12:38:08.148 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:07 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T12:38:08.148 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:07 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T12:38:08.148 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:07 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T12:38:08.148 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:07 smithi102 ceph-mon[34799]: from='mgr.14150 172.21.15.33:0/1751682418' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T12:38:08.148 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:07 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/3484548463' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T12:38:08.433 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T12:38:08.695 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:38:08.976 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:08 smithi033 ceph-mon[31246]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T12:38:08.976 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:08 smithi033 ceph-mon[31246]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T12:38:08.976 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:08 smithi033 ceph-mon[31246]: Cluster is now healthy 2024-09-12T12:38:08.976 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:08 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/3484548463' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T12:38:08.976 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:08 smithi033 ceph-mon[31246]: fsmap 12 up:standby 2024-09-12T12:38:09.048 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:08 smithi102 ceph-mon[34799]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T12:38:09.048 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:08 smithi102 ceph-mon[34799]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T12:38:09.048 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:08 smithi102 ceph-mon[34799]: Cluster is now healthy 2024-09-12T12:38:09.048 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:08 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/3484548463' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T12:38:09.048 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:08 smithi102 ceph-mon[34799]: fsmap 12 up:standby 2024-09-12T12:38:09.066 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:08 smithi043 ceph-mon[34144]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T12:38:09.067 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:08 smithi043 ceph-mon[34144]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T12:38:09.067 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:08 smithi043 ceph-mon[34144]: Cluster is now healthy 2024-09-12T12:38:09.067 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:08 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/3484548463' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T12:38:09.067 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:08 smithi043 ceph-mon[34144]: fsmap 12 up:standby 2024-09-12T12:38:09.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.196+0000 7f2ae77c3640 1 -- 172.21.15.33:0/2545199768 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ae0103660 msgr2=0x7f2ae010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:38:09.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.196+0000 7f2ae77c3640 1 --2- 172.21.15.33:0/2545199768 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ae0103660 0x7f2ae010bb50 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f2ad0009900 tx=0x7f2ad002a480 comp rx=0 tx=0).stop 2024-09-12T12:38:09.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.196+0000 7f2ae77c3640 1 -- 172.21.15.33:0/2545199768 shutdown_connections 2024-09-12T12:38:09.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.196+0000 7f2ae77c3640 1 --2- 172.21.15.33:0/2545199768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ae010c170 0x7f2ae010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:09.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.196+0000 7f2ae77c3640 1 --2- 172.21.15.33:0/2545199768 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ae0103660 0x7f2ae010bb50 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:09.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.196+0000 7f2ae77c3640 1 --2- 172.21.15.33:0/2545199768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ae0102d40 0x7f2ae0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:09.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.196+0000 7f2ae77c3640 1 -- 172.21.15.33:0/2545199768 >> 172.21.15.33:0/2545199768 conn(0x7f2ae00fc7a0 msgr2=0x7f2ae00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:38:09.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.196+0000 7f2ae77c3640 1 -- 172.21.15.33:0/2545199768 shutdown_connections 2024-09-12T12:38:09.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.196+0000 7f2ae77c3640 1 -- 172.21.15.33:0/2545199768 wait complete. 2024-09-12T12:38:09.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.197+0000 7f2ae77c3640 1 Processor -- start 2024-09-12T12:38:09.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.197+0000 7f2ae77c3640 1 -- start start 2024-09-12T12:38:09.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.197+0000 7f2ae77c3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ae0102d40 0x7f2ae0198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:38:09.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.197+0000 7f2ae77c3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ae0103660 0x7f2ae0198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:38:09.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.197+0000 7f2ae77c3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ae010c170 0x7f2ae019cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:38:09.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.197+0000 7f2ae77c3640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae0111e20 con 0x7f2ae0102d40 2024-09-12T12:38:09.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.197+0000 7f2ae77c3640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae0111ca0 con 0x7f2ae0103660 2024-09-12T12:38:09.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.197+0000 7f2ae77c3640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae0111fa0 con 0x7f2ae010c170 2024-09-12T12:38:09.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.197+0000 7f2ae555f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ae0102d40 0x7f2ae0198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:38:09.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.197+0000 7f2ae555f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ae0102d40 0x7f2ae0198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52706/0 (socket says 172.21.15.33:52706) 2024-09-12T12:38:09.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.197+0000 7f2ae555f640 1 -- 172.21.15.33:0/465428185 learned_addr learned my addr 172.21.15.33:0/465428185 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:38:09.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.198+0000 7f2ae5d60640 1 --2- 172.21.15.33:0/465428185 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ae010c170 0x7f2ae019cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:38:09.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.198+0000 7f2ae4d5e640 1 --2- 172.21.15.33:0/465428185 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ae0103660 0x7f2ae0198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:38:09.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.198+0000 7f2ae555f640 1 -- 172.21.15.33:0/465428185 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ae010c170 msgr2=0x7f2ae019cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:38:09.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.198+0000 7f2ae555f640 1 --2- 172.21.15.33:0/465428185 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ae010c170 0x7f2ae019cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:09.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.198+0000 7f2ae555f640 1 -- 172.21.15.33:0/465428185 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ae0103660 msgr2=0x7f2ae0198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:38:09.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.198+0000 7f2ae555f640 1 --2- 172.21.15.33:0/465428185 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ae0103660 0x7f2ae0198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:09.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.198+0000 7f2ae555f640 1 -- 172.21.15.33:0/465428185 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ae019d2b0 con 0x7f2ae0102d40 2024-09-12T12:38:09.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.198+0000 7f2ae4d5e640 1 --2- 172.21.15.33:0/465428185 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ae0103660 0x7f2ae0198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:38:09.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.198+0000 7f2ae555f640 1 --2- 172.21.15.33:0/465428185 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ae0102d40 0x7f2ae0198300 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f2adc00d950 tx=0x7f2adc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:38:09.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.198+0000 7f2ad67fc640 1 -- 172.21.15.33:0/465428185 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2adc017070 con 0x7f2ae0102d40 2024-09-12T12:38:09.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.198+0000 7f2ae77c3640 1 -- 172.21.15.33:0/465428185 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ae019d5a0 con 0x7f2ae0102d40 2024-09-12T12:38:09.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.198+0000 7f2ad67fc640 1 -- 172.21.15.33:0/465428185 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2adc009c30 con 0x7f2ae0102d40 2024-09-12T12:38:09.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.198+0000 7f2ad67fc640 1 -- 172.21.15.33:0/465428185 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2adc00f620 con 0x7f2ae0102d40 2024-09-12T12:38:09.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.198+0000 7f2ae77c3640 1 -- 172.21.15.33:0/465428185 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ae01a4e80 con 0x7f2ae0102d40 2024-09-12T12:38:09.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.200+0000 7f2ae77c3640 1 -- 172.21.15.33:0/465428185 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ae0103120 con 0x7f2ae0102d40 2024-09-12T12:38:09.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.201+0000 7f2ad67fc640 1 -- 172.21.15.33:0/465428185 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2adc0109a0 con 0x7f2ae0102d40 2024-09-12T12:38:09.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.202+0000 7f2ad67fc640 1 --2- 172.21.15.33:0/465428185 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2acc0a2b80 0x7f2acc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:38:09.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.202+0000 7f2ae4d5e640 1 --2- 172.21.15.33:0/465428185 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2acc0a2b80 0x7f2acc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:38:09.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.202+0000 7f2ad67fc640 1 -- 172.21.15.33:0/465428185 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9408+0+0 (secure 0 0 0) 0x7f2adc0cf0e0 con 0x7f2ae0102d40 2024-09-12T12:38:09.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.202+0000 7f2ae4d5e640 1 --2- 172.21.15.33:0/465428185 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2acc0a2b80 0x7f2acc0a5040 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2ad0031440 tx=0x7f2ad0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:38:09.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.205+0000 7f2ad67fc640 1 -- 172.21.15.33:0/465428185 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2adc009de0 con 0x7f2ae0102d40 2024-09-12T12:38:09.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.389+0000 7f2ae77c3640 1 -- 172.21.15.33:0/465428185 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2ae0199660 con 0x7f2ae0102d40 2024-09-12T12:38:09.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.694+0000 7f2ad67fc640 1 -- 172.21.15.33:0/465428185 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v91) ==== 181+0+0 (secure 0 0 0) 0x7f2ae0199660 con 0x7f2ae0102d40 2024-09-12T12:38:09.694 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' removed 2024-09-12T12:38:09.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.696+0000 7f2ae77c3640 1 -- 172.21.15.33:0/465428185 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2acc0a2b80 msgr2=0x7f2acc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:38:09.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.696+0000 7f2ae77c3640 1 --2- 172.21.15.33:0/465428185 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2acc0a2b80 0x7f2acc0a5040 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2ad0031440 tx=0x7f2ad0005a20 comp rx=0 tx=0).stop 2024-09-12T12:38:09.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.697+0000 7f2ae77c3640 1 -- 172.21.15.33:0/465428185 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ae0102d40 msgr2=0x7f2ae0198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:38:09.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.697+0000 7f2ae77c3640 1 --2- 172.21.15.33:0/465428185 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ae0102d40 0x7f2ae0198300 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f2adc00d950 tx=0x7f2adc00de10 comp rx=0 tx=0).stop 2024-09-12T12:38:09.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.697+0000 7f2ae77c3640 1 -- 172.21.15.33:0/465428185 shutdown_connections 2024-09-12T12:38:09.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.697+0000 7f2ae77c3640 1 --2- 172.21.15.33:0/465428185 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f2acc0a2b80 0x7f2acc0a5040 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:09.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.697+0000 7f2ae77c3640 1 --2- 172.21.15.33:0/465428185 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ae010c170 0x7f2ae019cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:09.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.697+0000 7f2ae77c3640 1 --2- 172.21.15.33:0/465428185 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ae0103660 0x7f2ae0198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:09.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.697+0000 7f2ae77c3640 1 --2- 172.21.15.33:0/465428185 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ae0102d40 0x7f2ae0198300 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:09.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.697+0000 7f2ae77c3640 1 -- 172.21.15.33:0/465428185 >> 172.21.15.33:0/465428185 conn(0x7f2ae00fc7a0 msgr2=0x7f2ae00fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:38:09.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.697+0000 7f2ae77c3640 1 -- 172.21.15.33:0/465428185 shutdown_connections 2024-09-12T12:38:09.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:09.697+0000 7f2ae77c3640 1 -- 172.21.15.33:0/465428185 wait complete. 2024-09-12T12:38:09.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:09 smithi033 ceph-mon[31246]: pgmap v715: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-12T12:38:09.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:09 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/465428185' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T12:38:10.063 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:09 smithi102 ceph-mon[34799]: pgmap v715: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-12T12:38:10.063 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:09 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/465428185' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T12:38:10.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:09 smithi043 ceph-mon[34144]: pgmap v715: 129 pgs: 129 active+clean; 1.3 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-12T12:38:10.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:09 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/465428185' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T12:38:10.442 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T12:38:10.711 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:38:10.965 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:10 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/465428185' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T12:38:10.965 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:10 smithi033 ceph-mon[31246]: osdmap e91: 12 total, 12 up, 12 in 2024-09-12T12:38:11.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:10 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/465428185' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T12:38:11.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:10 smithi043 ceph-mon[34144]: osdmap e91: 12 total, 12 up, 12 in 2024-09-12T12:38:11.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:10 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/465428185' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T12:38:11.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:10 smithi102 ceph-mon[34799]: osdmap e91: 12 total, 12 up, 12 in 2024-09-12T12:38:11.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.166+0000 7f7ef24b9640 1 -- 172.21.15.33:0/572062408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7eec101de0 msgr2=0x7f7eec1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:38:11.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.166+0000 7f7ef24b9640 1 --2- 172.21.15.33:0/572062408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7eec101de0 0x7f7eec1021c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f7edc009900 tx=0x7f7edc02a410 comp rx=0 tx=0).stop 2024-09-12T12:38:11.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.166+0000 7f7ef24b9640 1 -- 172.21.15.33:0/572062408 shutdown_connections 2024-09-12T12:38:11.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.166+0000 7f7ef24b9640 1 --2- 172.21.15.33:0/572062408 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7eec106f10 0x7f7eec10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:11.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.166+0000 7f7ef24b9640 1 --2- 172.21.15.33:0/572062408 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7eec102790 0x7f7eec1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:11.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.166+0000 7f7ef24b9640 1 --2- 172.21.15.33:0/572062408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7eec101de0 0x7f7eec1021c0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:11.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.166+0000 7f7ef24b9640 1 -- 172.21.15.33:0/572062408 >> 172.21.15.33:0/572062408 conn(0x7f7eec0fd8c0 msgr2=0x7f7eec0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:38:11.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.166+0000 7f7ef24b9640 1 -- 172.21.15.33:0/572062408 shutdown_connections 2024-09-12T12:38:11.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.166+0000 7f7ef24b9640 1 -- 172.21.15.33:0/572062408 wait complete. 2024-09-12T12:38:11.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.166+0000 7f7ef24b9640 1 Processor -- start 2024-09-12T12:38:11.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.166+0000 7f7ef24b9640 1 -- start start 2024-09-12T12:38:11.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.167+0000 7f7ef24b9640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7eec101de0 0x7f7eec198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:38:11.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.167+0000 7f7ef24b9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7eec102790 0x7f7eec1988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:38:11.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.167+0000 7f7ef24b9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7eec106f10 0x7f7eec19cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:38:11.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.167+0000 7f7ef24b9640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7eec111e20 con 0x7f7eec102790 2024-09-12T12:38:11.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.167+0000 7f7ef24b9640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7eec111ca0 con 0x7f7eec101de0 2024-09-12T12:38:11.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.167+0000 7f7ef24b9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7eec111fa0 con 0x7f7eec106f10 2024-09-12T12:38:11.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.167+0000 7f7ee3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7eec102790 0x7f7eec1988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:38:11.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.167+0000 7f7ee3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7eec102790 0x7f7eec1988c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52106/0 (socket says 172.21.15.33:52106) 2024-09-12T12:38:11.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.167+0000 7f7ee3fff640 1 -- 172.21.15.33:0/718290213 learned_addr learned my addr 172.21.15.33:0/718290213 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:38:11.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.167+0000 7f7ef0a56640 1 --2- 172.21.15.33:0/718290213 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7eec106f10 0x7f7eec19cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:38:11.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.167+0000 7f7eebfff640 1 --2- 172.21.15.33:0/718290213 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7eec101de0 0x7f7eec198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:38:11.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.167+0000 7f7ee3fff640 1 -- 172.21.15.33:0/718290213 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7eec106f10 msgr2=0x7f7eec19cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:38:11.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.167+0000 7f7ee3fff640 1 --2- 172.21.15.33:0/718290213 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7eec106f10 0x7f7eec19cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:11.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.167+0000 7f7ee3fff640 1 -- 172.21.15.33:0/718290213 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7eec101de0 msgr2=0x7f7eec198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:38:11.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.167+0000 7f7ee3fff640 1 --2- 172.21.15.33:0/718290213 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7eec101de0 0x7f7eec198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:11.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.167+0000 7f7ee3fff640 1 -- 172.21.15.33:0/718290213 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eec19d330 con 0x7f7eec102790 2024-09-12T12:38:11.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.167+0000 7f7eebfff640 1 --2- 172.21.15.33:0/718290213 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7eec101de0 0x7f7eec198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:38:11.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.167+0000 7f7ee3fff640 1 --2- 172.21.15.33:0/718290213 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7eec102790 0x7f7eec1988c0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f7ed400c970 tx=0x7f7ed400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:38:11.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.167+0000 7f7ee9ffb640 1 -- 172.21.15.33:0/718290213 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed4007bb0 con 0x7f7eec102790 2024-09-12T12:38:11.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.168+0000 7f7ee9ffb640 1 -- 172.21.15.33:0/718290213 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7ed4007d50 con 0x7f7eec102790 2024-09-12T12:38:11.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.168+0000 7f7ef24b9640 1 -- 172.21.15.33:0/718290213 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7eec19d620 con 0x7f7eec102790 2024-09-12T12:38:11.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.168+0000 7f7ee9ffb640 1 -- 172.21.15.33:0/718290213 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed400f450 con 0x7f7eec102790 2024-09-12T12:38:11.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.168+0000 7f7ef24b9640 1 -- 172.21.15.33:0/718290213 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7eec1a4f00 con 0x7f7eec102790 2024-09-12T12:38:11.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.169+0000 7f7ef24b9640 1 -- 172.21.15.33:0/718290213 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7eec1021c0 con 0x7f7eec102790 2024-09-12T12:38:11.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.170+0000 7f7ee9ffb640 1 -- 172.21.15.33:0/718290213 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7ed4004f20 con 0x7f7eec102790 2024-09-12T12:38:11.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.170+0000 7f7ee9ffb640 1 --2- 172.21.15.33:0/718290213 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f7ed80a2c00 0x7f7ed80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:38:11.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.170+0000 7f7eebfff640 1 --2- 172.21.15.33:0/718290213 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f7ed80a2c00 0x7f7ed80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:38:11.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.171+0000 7f7ee9ffb640 1 -- 172.21.15.33:0/718290213 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8854+0+0 (secure 0 0 0) 0x7f7ed40cefb0 con 0x7f7eec102790 2024-09-12T12:38:11.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.171+0000 7f7eebfff640 1 --2- 172.21.15.33:0/718290213 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f7ed80a2c00 0x7f7ed80a50c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7edc031440 tx=0x7f7edc005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:38:11.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.175+0000 7f7ee9ffb640 1 -- 172.21.15.33:0/718290213 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7ed4014030 con 0x7f7eec102790 2024-09-12T12:38:11.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.351+0000 7f7ef24b9640 1 -- 172.21.15.33:0/718290213 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7eec02d7c0 con 0x7f7eec102790 2024-09-12T12:38:11.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.709+0000 7f7ee9ffb640 1 -- 172.21.15.33:0/718290213 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v92) ==== 169+0+0 (secure 0 0 0) 0x7f7ed409bca0 con 0x7f7eec102790 2024-09-12T12:38:11.709 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' removed 2024-09-12T12:38:11.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.712+0000 7f7ef24b9640 1 -- 172.21.15.33:0/718290213 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f7ed80a2c00 msgr2=0x7f7ed80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:38:11.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.712+0000 7f7ef24b9640 1 --2- 172.21.15.33:0/718290213 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f7ed80a2c00 0x7f7ed80a50c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7edc031440 tx=0x7f7edc005a20 comp rx=0 tx=0).stop 2024-09-12T12:38:11.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.712+0000 7f7ef24b9640 1 -- 172.21.15.33:0/718290213 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7eec102790 msgr2=0x7f7eec1988c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:38:11.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.712+0000 7f7ef24b9640 1 --2- 172.21.15.33:0/718290213 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7eec102790 0x7f7eec1988c0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f7ed400c970 tx=0x7f7ed400ce30 comp rx=0 tx=0).stop 2024-09-12T12:38:11.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.713+0000 7f7ef24b9640 1 -- 172.21.15.33:0/718290213 shutdown_connections 2024-09-12T12:38:11.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.713+0000 7f7ef24b9640 1 --2- 172.21.15.33:0/718290213 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f7ed80a2c00 0x7f7ed80a50c0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:11.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.713+0000 7f7ef24b9640 1 --2- 172.21.15.33:0/718290213 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7eec106f10 0x7f7eec19cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:11.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.713+0000 7f7ef24b9640 1 --2- 172.21.15.33:0/718290213 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7eec102790 0x7f7eec1988c0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:11.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.713+0000 7f7ef24b9640 1 --2- 172.21.15.33:0/718290213 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7eec101de0 0x7f7eec198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:11.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.713+0000 7f7ef24b9640 1 -- 172.21.15.33:0/718290213 >> 172.21.15.33:0/718290213 conn(0x7f7eec0fd8c0 msgr2=0x7f7eec0fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:38:11.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.713+0000 7f7ef24b9640 1 -- 172.21.15.33:0/718290213 shutdown_connections 2024-09-12T12:38:11.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:11.713+0000 7f7ef24b9640 1 -- 172.21.15.33:0/718290213 wait complete. 2024-09-12T12:38:11.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:11 smithi033 ceph-mon[31246]: pgmap v717: 97 pgs: 97 active+clean; 577 KiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:38:11.981 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:11 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/718290213' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T12:38:12.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:11 smithi043 ceph-mon[34144]: pgmap v717: 97 pgs: 97 active+clean; 577 KiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:38:12.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:11 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/718290213' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T12:38:12.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:11 smithi102 ceph-mon[34799]: pgmap v717: 97 pgs: 97 active+clean; 577 KiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:38:12.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:11 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/718290213' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T12:38:12.450 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid a66dfafc-7100-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-12T12:38:12.713 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:38:12.975 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:12 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/718290213' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T12:38:12.976 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:12 smithi033 ceph-mon[31246]: osdmap e92: 12 total, 12 up, 12 in 2024-09-12T12:38:13.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:12 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/718290213' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T12:38:13.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:12 smithi043 ceph-mon[34144]: osdmap e92: 12 total, 12 up, 12 in 2024-09-12T12:38:13.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:12 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/718290213' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T12:38:13.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:12 smithi102 ceph-mon[34799]: osdmap e92: 12 total, 12 up, 12 in 2024-09-12T12:38:13.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:13.183+0000 7f14f6083640 1 -- 172.21.15.33:0/263169202 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14f0102790 msgr2=0x7f14f01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:38:13.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:13.183+0000 7f14f6083640 1 --2- 172.21.15.33:0/263169202 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14f0102790 0x7f14f01067e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f14e4009900 tx=0x7f14e402a410 comp rx=0 tx=0).stop 2024-09-12T12:38:13.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:13.183+0000 7f14f6083640 1 -- 172.21.15.33:0/263169202 shutdown_connections 2024-09-12T12:38:13.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:13.183+0000 7f14f6083640 1 --2- 172.21.15.33:0/263169202 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14f0106f10 0x7f14f010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:13.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:13.183+0000 7f14f6083640 1 --2- 172.21.15.33:0/263169202 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14f0102790 0x7f14f01067e0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:13.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:13.183+0000 7f14f6083640 1 --2- 172.21.15.33:0/263169202 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14f0101de0 0x7f14f01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:13.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:13.183+0000 7f14f6083640 1 -- 172.21.15.33:0/263169202 >> 172.21.15.33:0/263169202 conn(0x7f14f00fd8c0 msgr2=0x7f14f00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:38:13.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:13.183+0000 7f14f6083640 1 -- 172.21.15.33:0/263169202 shutdown_connections 2024-09-12T12:38:13.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:13.183+0000 7f14f6083640 1 -- 172.21.15.33:0/263169202 wait complete. 2024-09-12T12:38:13.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:13.184+0000 7f14f6083640 1 Processor -- start 2024-09-12T12:38:13.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:13.184+0000 7f14f6083640 1 -- start start 2024-09-12T12:38:13.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:13.184+0000 7f14f6083640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14f0101de0 0x7f14f00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:38:13.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:13.184+0000 7f14f6083640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14f0102790 0x7f14f0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:38:13.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:13.184+0000 7f14f6083640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14f0106f10 0x7f14f0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:38:13.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:13.184+0000 7f14f6083640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f14f0111e20 con 0x7f14f0102790 2024-09-12T12:38:13.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:13.184+0000 7f14f6083640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f14f0111ca0 con 0x7f14f0101de0 2024-09-12T12:38:13.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:13.184+0000 7f14f6083640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f14f0111fa0 con 0x7f14f0106f10 2024-09-12T12:38:13.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:13.185+0000 7f14eeffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14f0102790 0x7f14f0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:38:13.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:13.185+0000 7f14eeffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14f0102790 0x7f14f0074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52132/0 (socket says 172.21.15.33:52132) 2024-09-12T12:38:13.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:13.185+0000 7f14eeffd640 1 -- 172.21.15.33:0/4278076181 learned_addr learned my addr 172.21.15.33:0/4278076181 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-12T12:38:13.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:13.185+0000 7f14effff640 1 --2- 172.21.15.33:0/4278076181 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14f0106f10 0x7f14f0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:38:13.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:13.185+0000 7f14ef7fe640 1 --2- 172.21.15.33:0/4278076181 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14f0101de0 0x7f14f00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:38:13.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:13.185+0000 7f14eeffd640 1 -- 172.21.15.33:0/4278076181 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14f0106f10 msgr2=0x7f14f0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:38:13.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:13.185+0000 7f14eeffd640 1 --2- 172.21.15.33:0/4278076181 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14f0106f10 0x7f14f0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:13.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:13.185+0000 7f14eeffd640 1 -- 172.21.15.33:0/4278076181 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14f0101de0 msgr2=0x7f14f00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:38:13.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:13.185+0000 7f14eeffd640 1 --2- 172.21.15.33:0/4278076181 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14f0101de0 0x7f14f00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:13.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:13.185+0000 7f14eeffd640 1 -- 172.21.15.33:0/4278076181 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14f01a6880 con 0x7f14f0102790 2024-09-12T12:38:13.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:13.185+0000 7f14eeffd640 1 --2- 172.21.15.33:0/4278076181 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14f0102790 0x7f14f0074a30 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f14e4005940 tx=0x7f14e4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:38:13.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:13.185+0000 7f14ecff9640 1 -- 172.21.15.33:0/4278076181 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e403f030 con 0x7f14f0102790 2024-09-12T12:38:13.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:13.185+0000 7f14f6083640 1 -- 172.21.15.33:0/4278076181 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14f01a6b10 con 0x7f14f0102790 2024-09-12T12:38:13.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:13.185+0000 7f14ecff9640 1 -- 172.21.15.33:0/4278076181 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f14e4003aa0 con 0x7f14f0102790 2024-09-12T12:38:13.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:13.185+0000 7f14ecff9640 1 -- 172.21.15.33:0/4278076181 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e4035070 con 0x7f14f0102790 2024-09-12T12:38:13.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:13.185+0000 7f14f6083640 1 -- 172.21.15.33:0/4278076181 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14f01a6ff0 con 0x7f14f0102790 2024-09-12T12:38:13.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:13.186+0000 7f14f6083640 1 -- 172.21.15.33:0/4278076181 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14f01021c0 con 0x7f14f0102790 2024-09-12T12:38:13.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:13.187+0000 7f14ecff9640 1 -- 172.21.15.33:0/4278076181 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f14e4042030 con 0x7f14f0102790 2024-09-12T12:38:13.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:13.188+0000 7f14ecff9640 1 --2- 172.21.15.33:0/4278076181 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f14d80a2b80 0x7f14d80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:38:13.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:13.188+0000 7f14ef7fe640 1 --2- 172.21.15.33:0/4278076181 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f14d80a2b80 0x7f14d80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:38:13.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:13.188+0000 7f14ecff9640 1 -- 172.21.15.33:0/4278076181 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8324+0+0 (secure 0 0 0) 0x7f14e40ef7a0 con 0x7f14f0102790 2024-09-12T12:38:13.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:13.189+0000 7f14ef7fe640 1 --2- 172.21.15.33:0/4278076181 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f14d80a2b80 0x7f14d80a5040 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f14e00058c0 tx=0x7f14e000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:38:13.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:13.192+0000 7f14ecff9640 1 -- 172.21.15.33:0/4278076181 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f14e40bc050 con 0x7f14f0102790 2024-09-12T12:38:13.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:13.368+0000 7f14f6083640 1 -- 172.21.15.33:0/4278076181 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f14f0109bc0 con 0x7f14f0102790 2024-09-12T12:38:14.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:14.033+0000 7f14ecff9640 1 -- 172.21.15.33:0/4278076181 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v93) ==== 178+0+0 (secure 0 0 0) 0x7f14e40c0350 con 0x7f14f0102790 2024-09-12T12:38:14.033 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data_ec' removed 2024-09-12T12:38:14.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:14.037+0000 7f14f6083640 1 -- 172.21.15.33:0/4278076181 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f14d80a2b80 msgr2=0x7f14d80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:38:14.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:14.037+0000 7f14f6083640 1 --2- 172.21.15.33:0/4278076181 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f14d80a2b80 0x7f14d80a5040 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f14e00058c0 tx=0x7f14e000a2d0 comp rx=0 tx=0).stop 2024-09-12T12:38:14.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:14.037+0000 7f14f6083640 1 -- 172.21.15.33:0/4278076181 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14f0102790 msgr2=0x7f14f0074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:38:14.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:14.037+0000 7f14f6083640 1 --2- 172.21.15.33:0/4278076181 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14f0102790 0x7f14f0074a30 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f14e4005940 tx=0x7f14e4004270 comp rx=0 tx=0).stop 2024-09-12T12:38:14.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:14.038+0000 7f14f6083640 1 -- 172.21.15.33:0/4278076181 shutdown_connections 2024-09-12T12:38:14.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:14.038+0000 7f14f6083640 1 --2- 172.21.15.33:0/4278076181 >> [v2:172.21.15.33:6800/176202431,v1:172.21.15.33:6801/176202431] conn(0x7f14d80a2b80 0x7f14d80a5040 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:14.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:14.038+0000 7f14f6083640 1 --2- 172.21.15.33:0/4278076181 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14f0106f10 0x7f14f0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:14.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:14.038+0000 7f14f6083640 1 --2- 172.21.15.33:0/4278076181 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14f0102790 0x7f14f0074a30 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:14.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:14.038+0000 7f14f6083640 1 --2- 172.21.15.33:0/4278076181 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14f0101de0 0x7f14f00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:38:14.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:14.038+0000 7f14f6083640 1 -- 172.21.15.33:0/4278076181 >> 172.21.15.33:0/4278076181 conn(0x7f14f00fd8c0 msgr2=0x7f14f00fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:38:14.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:14.038+0000 7f14f6083640 1 -- 172.21.15.33:0/4278076181 shutdown_connections 2024-09-12T12:38:14.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T12:38:14.038+0000 7f14f6083640 1 -- 172.21.15.33:0/4278076181 wait complete. 2024-09-12T12:38:14.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:14 smithi043 ceph-mon[34144]: pgmap v719: 33 pgs: 33 active+clean; 577 KiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:38:14.365 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:14 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/4278076181' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T12:38:14.392 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:14 smithi033 ceph-mon[31246]: pgmap v719: 33 pgs: 33 active+clean; 577 KiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:38:14.393 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:14 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/4278076181' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T12:38:14.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:14 smithi102 ceph-mon[34799]: pgmap v719: 33 pgs: 33 active+clean; 577 KiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:38:14.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:14 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/4278076181' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T12:38:14.764 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T12:38:14.808 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T12:38:14.840 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T12:38:14.871 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-12T12:38:14.871 DEBUG:teuthology.orchestra.run.smithi033:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T12:38:14.887 DEBUG:teuthology.orchestra.run.smithi043:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T12:38:14.904 DEBUG:teuthology.orchestra.run.smithi102:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T12:38:14.929 INFO:tasks.cephadm:Stopping all daemons... 2024-09-12T12:38:14.929 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-12T12:38:14.929 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mon.a 2024-09-12T12:38:15.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:15 smithi043 ceph-mon[34144]: from='client.? 172.21.15.33:0/4278076181' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T12:38:15.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:15 smithi043 ceph-mon[34144]: osdmap e93: 12 total, 12 up, 12 in 2024-09-12T12:38:15.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:15 smithi102 ceph-mon[34799]: from='client.? 172.21.15.33:0/4278076181' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T12:38:15.146 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:15 smithi102 ceph-mon[34799]: osdmap e93: 12 total, 12 up, 12 in 2024-09-12T12:38:15.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:14 smithi033 systemd[1]: Stopping Ceph mon.a for a66dfafc-7100-11ef-bcea-c7b262605968... 2024-09-12T12:38:15.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:15 smithi033 ceph-mon[31246]: from='client.? 172.21.15.33:0/4278076181' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T12:38:15.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:15 smithi033 ceph-mon[31246]: osdmap e93: 12 total, 12 up, 12 in 2024-09-12T12:38:15.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:15 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mon-a[31242]: 2024-09-12T12:38:15.274+0000 7efdf9a07640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:38:15.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:15 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mon-a[31242]: 2024-09-12T12:38:15.275+0000 7efdf9a07640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-12T12:38:15.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:15 smithi033 podman[108034]: 2024-09-12 12:38:15.50088416 +0000 UTC m=+0.348681577 container died 9782252fc41214a4bf7a90e72311ab5dc113602681d9fe9950ff2dc35b43ee38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:38:16.168 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:15 smithi033 podman[108034]: 2024-09-12 12:38:15.891282231 +0000 UTC m=+0.739079650 container cleanup 9782252fc41214a4bf7a90e72311ab5dc113602681d9fe9950ff2dc35b43ee38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T12:38:16.168 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 12 12:38:15 smithi033 bash[108034]: ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mon-a 2024-09-12T12:38:16.308 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mon.a.service' 2024-09-12T12:38:16.348 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:38:16.348 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-12T12:38:16.348 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-12T12:38:16.349 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mon.b 2024-09-12T12:38:16.690 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:16 smithi043 systemd[1]: Stopping Ceph mon.b for a66dfafc-7100-11ef-bcea-c7b262605968... 2024-09-12T12:38:17.115 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:16 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mon-b[34140]: 2024-09-12T12:38:16.688+0000 7f507b657640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:38:17.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:16 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mon-b[34140]: 2024-09-12T12:38:16.688+0000 7f507b657640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-12T12:38:17.116 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:16 smithi043 podman[68822]: 2024-09-12 12:38:16.863322524 +0000 UTC m=+0.292193537 container died 9967b2583464705ff10006c80928cb92c8f3b419db8ac6fa52c3af12e1d2d4d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mon-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-12T12:38:17.598 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:17 smithi043 podman[68822]: 2024-09-12 12:38:17.347955672 +0000 UTC m=+0.776826687 container cleanup 9967b2583464705ff10006c80928cb92c8f3b419db8ac6fa52c3af12e1d2d4d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mon-b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-12T12:38:17.599 INFO:journalctl@ceph.mon.b.smithi043.stdout:Sep 12 12:38:17 smithi043 bash[68822]: ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mon-b 2024-09-12T12:38:17.730 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mon.b.service' 2024-09-12T12:38:17.780 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:38:17.780 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-12T12:38:17.780 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-12T12:38:17.781 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mon.c 2024-09-12T12:38:18.112 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:17 smithi102 systemd[1]: Stopping Ceph mon.c for a66dfafc-7100-11ef-bcea-c7b262605968... 2024-09-12T12:38:18.396 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:18 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mon-c[34795]: 2024-09-12T12:38:18.111+0000 7f48a857b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:38:18.397 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:18 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mon-c[34795]: 2024-09-12T12:38:18.111+0000 7f48a857b640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-12T12:38:18.397 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:18 smithi102 podman[69235]: 2024-09-12 12:38:18.264640571 +0000 UTC m=+0.272492609 container died 63281261a8199382a971b5e2b2284deeb14bbf2be0992b3ef9c5356ca62a9e2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mon-c, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-12T12:38:18.896 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:18 smithi102 podman[69235]: 2024-09-12 12:38:18.687366844 +0000 UTC m=+0.695218870 container cleanup 63281261a8199382a971b5e2b2284deeb14bbf2be0992b3ef9c5356ca62a9e2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mon-c, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-12T12:38:18.897 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:18 smithi102 bash[69235]: ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mon-c 2024-09-12T12:38:19.153 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mon.c.service' 2024-09-12T12:38:19.175 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:18 smithi102 podman[69247]: 2024-09-12 12:38:18.922511658 +0000 UTC m=+0.659931252 container remove 63281261a8199382a971b5e2b2284deeb14bbf2be0992b3ef9c5356ca62a9e2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mon-c, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-12T12:38:19.175 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:19 smithi102 systemd[1]: ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mon.c.service: Deactivated successfully. 2024-09-12T12:38:19.175 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:19 smithi102 systemd[1]: Stopped Ceph mon.c for a66dfafc-7100-11ef-bcea-c7b262605968. 2024-09-12T12:38:19.175 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 12 12:38:19 smithi102 systemd[1]: ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mon.c.service: Consumed 12.294s CPU time. 2024-09-12T12:38:19.202 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:38:19.203 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-12T12:38:19.203 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-12T12:38:19.203 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mgr.x 2024-09-12T12:38:19.522 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:38:19 smithi033 systemd[1]: Stopping Ceph mgr.x for a66dfafc-7100-11ef-bcea-c7b262605968... 2024-09-12T12:38:19.847 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:38:19 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x[31473]: 2024-09-12T12:38:19.521+0000 7fda133f3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:38:19.847 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:38:19 smithi033 podman[108154]: 2024-09-12 12:38:19.552397269 +0000 UTC m=+0.139810974 container died 9b12cb9dca8aea219654b28b05bc4602a5dd7fa89ca4c6706ac35c29ee0f059a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-12T12:38:20.481 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:38:20 smithi033 podman[108154]: 2024-09-12 12:38:20.231246333 +0000 UTC m=+0.818660080 container cleanup 9b12cb9dca8aea219654b28b05bc4602a5dd7fa89ca4c6706ac35c29ee0f059a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:38:20.481 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 12 12:38:20 smithi033 bash[108154]: ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-x 2024-09-12T12:38:20.664 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mgr.x.service' 2024-09-12T12:38:20.701 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:38:20.701 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-12T12:38:20.701 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-12T12:38:20.701 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mgr.y 2024-09-12T12:38:21.065 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Sep 12 12:38:20 smithi043 systemd[1]: Stopping Ceph mgr.y for a66dfafc-7100-11ef-bcea-c7b262605968... 2024-09-12T12:38:21.337 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Sep 12 12:38:21 smithi043 podman[68943]: 2024-09-12 12:38:21.065988369 +0000 UTC m=+0.157875184 container died a16592404a0db430975cb8e5f9c280f402cdf46b04f3e6f8be147c3debf15b5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-y, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T12:38:21.615 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Sep 12 12:38:21 smithi043 podman[68943]: 2024-09-12 12:38:21.553550653 +0000 UTC m=+0.645437457 container cleanup a16592404a0db430975cb8e5f9c280f402cdf46b04f3e6f8be147c3debf15b5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.build-date=20240731) 2024-09-12T12:38:21.616 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Sep 12 12:38:21 smithi043 bash[68943]: ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-y 2024-09-12T12:38:21.920 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mgr.y.service' 2024-09-12T12:38:21.956 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:38:21.956 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-12T12:38:21.957 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-12T12:38:21.957 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mgr.z 2024-09-12T12:38:22.296 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 12 12:38:22 smithi102 systemd[1]: Stopping Ceph mgr.z for a66dfafc-7100-11ef-bcea-c7b262605968... 2024-09-12T12:38:22.610 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 12 12:38:22 smithi102 podman[69356]: 2024-09-12 12:38:22.296973889 +0000 UTC m=+0.146439068 container died 503ee8567d1e56a3ad7a3dd820986ee410d2eef638f48021301b809460c39c75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:38:22.896 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 12 12:38:22 smithi102 podman[69356]: 2024-09-12 12:38:22.710348961 +0000 UTC m=+0.559814146 container cleanup 503ee8567d1e56a3ad7a3dd820986ee410d2eef638f48021301b809460c39c75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-z, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-12T12:38:22.896 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 12 12:38:22 smithi102 bash[69356]: ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mgr-z 2024-09-12T12:38:23.090 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mgr.z.service' 2024-09-12T12:38:23.125 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:38:23.125 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-12T12:38:23.125 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-12T12:38:23.125 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-a66dfafc-7100-11ef-bcea-c7b262605968@osd.0 2024-09-12T12:38:23.436 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 12 12:38:23 smithi033 systemd[1]: Stopping Ceph osd.0 for a66dfafc-7100-11ef-bcea-c7b262605968... 2024-09-12T12:38:23.731 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 12 12:38:23 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-0[45435]: 2024-09-12T12:38:23.435+0000 7f9bc684f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:38:23.731 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 12 12:38:23 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-0[45435]: 2024-09-12T12:38:23.435+0000 7f9bc684f640 -1 osd.0 93 *** Got signal Terminated *** 2024-09-12T12:38:23.731 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 12 12:38:23 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-0[45435]: 2024-09-12T12:38:23.435+0000 7f9bc684f640 -1 osd.0 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T12:38:29.212 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 12 12:38:28 smithi033 podman[108274]: 2024-09-12 12:38:28.944847643 +0000 UTC m=+5.614826927 container died 06ce36c41f1ada97443fa3cc63f7f6bd06f46016b6daad973f35242357d3c65d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T12:38:29.481 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 12 12:38:29 smithi033 podman[108274]: 2024-09-12 12:38:29.361463311 +0000 UTC m=+6.031442582 container cleanup 06ce36c41f1ada97443fa3cc63f7f6bd06f46016b6daad973f35242357d3c65d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T12:38:29.481 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 12 12:38:29 smithi033 bash[108274]: ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-0 2024-09-12T12:38:29.981 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 12 12:38:29 smithi033 podman[108292]: 2024-09-12 12:38:29.613351952 +0000 UTC m=+0.662350384 container remove 06ce36c41f1ada97443fa3cc63f7f6bd06f46016b6daad973f35242357d3c65d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T12:38:30.308 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 12 12:38:30 smithi033 podman[108381]: 2024-09-12 12:38:29.939665345 +0000 UTC m=+0.016843948 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:38:30.308 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 12 12:38:30 smithi033 podman[108381]: 2024-09-12 12:38:30.047673931 +0000 UTC m=+0.124852597 container create dc236886c100712a1c3db38802172a9969a09623c03fb38bdb69a7b8ecf52e57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-12T12:38:30.308 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 12 12:38:30 smithi033 podman[108381]: 2024-09-12 12:38:30.308947412 +0000 UTC m=+0.386126028 container init dc236886c100712a1c3db38802172a9969a09623c03fb38bdb69a7b8ecf52e57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-12T12:38:30.668 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 12 12:38:30 smithi033 podman[108381]: 2024-09-12 12:38:30.312428096 +0000 UTC m=+0.389606696 container start dc236886c100712a1c3db38802172a9969a09623c03fb38bdb69a7b8ecf52e57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-0-deactivate, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-12T12:38:30.669 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 12 12:38:30 smithi033 podman[108381]: 2024-09-12 12:38:30.417487994 +0000 UTC m=+0.494666609 container attach dc236886c100712a1c3db38802172a9969a09623c03fb38bdb69a7b8ecf52e57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-0-deactivate, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-12T12:38:30.981 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 12 12:38:30 smithi033 podman[108381]: 2024-09-12 12:38:30.669071195 +0000 UTC m=+0.746249806 container died dc236886c100712a1c3db38802172a9969a09623c03fb38bdb69a7b8ecf52e57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T12:38:31.375 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@osd.0.service' 2024-09-12T12:38:31.423 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:38:31.423 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-12T12:38:31.423 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-12T12:38:31.423 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-a66dfafc-7100-11ef-bcea-c7b262605968@osd.1 2024-09-12T12:38:31.750 INFO:journalctl@ceph.osd.1.smithi043.stdout:Sep 12 12:38:31 smithi043 systemd[1]: Stopping Ceph osd.1 for a66dfafc-7100-11ef-bcea-c7b262605968... 2024-09-12T12:38:32.115 INFO:journalctl@ceph.osd.1.smithi043.stdout:Sep 12 12:38:31 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-1[38612]: 2024-09-12T12:38:31.749+0000 7f182ef6d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:38:32.115 INFO:journalctl@ceph.osd.1.smithi043.stdout:Sep 12 12:38:31 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-1[38612]: 2024-09-12T12:38:31.749+0000 7f182ef6d640 -1 osd.1 93 *** Got signal Terminated *** 2024-09-12T12:38:32.115 INFO:journalctl@ceph.osd.1.smithi043.stdout:Sep 12 12:38:31 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-1[38612]: 2024-09-12T12:38:31.749+0000 7f182ef6d640 -1 osd.1 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T12:38:37.522 INFO:journalctl@ceph.osd.1.smithi043.stdout:Sep 12 12:38:37 smithi043 podman[69069]: 2024-09-12 12:38:37.22818839 +0000 UTC m=+5.601271061 container died 421e1ca27327f46f62e36bf5b61c940495fd23e13d2b09dbdf9a94a364afe357 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-1, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_CLEAN=True) 2024-09-12T12:38:37.865 INFO:journalctl@ceph.osd.1.smithi043.stdout:Sep 12 12:38:37 smithi043 podman[69069]: 2024-09-12 12:38:37.633213003 +0000 UTC m=+6.006295673 container cleanup 421e1ca27327f46f62e36bf5b61c940495fd23e13d2b09dbdf9a94a364afe357 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-12T12:38:37.865 INFO:journalctl@ceph.osd.1.smithi043.stdout:Sep 12 12:38:37 smithi043 bash[69069]: ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-1 2024-09-12T12:38:38.365 INFO:journalctl@ceph.osd.1.smithi043.stdout:Sep 12 12:38:38 smithi043 podman[69085]: 2024-09-12 12:38:38.018026431 +0000 UTC m=+0.780641831 container remove 421e1ca27327f46f62e36bf5b61c940495fd23e13d2b09dbdf9a94a364afe357 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-1, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-12T12:38:38.701 INFO:journalctl@ceph.osd.1.smithi043.stdout:Sep 12 12:38:38 smithi043 podman[69175]: 2024-09-12 12:38:38.311700142 +0000 UTC m=+0.016080941 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:38:38.701 INFO:journalctl@ceph.osd.1.smithi043.stdout:Sep 12 12:38:38 smithi043 podman[69175]: 2024-09-12 12:38:38.431169586 +0000 UTC m=+0.135550411 container create 3c9b9bc091bce3d547021c1e3f3c467db2db1fae0ef4ad917607bfc9d4b35a6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-12T12:38:39.053 INFO:journalctl@ceph.osd.1.smithi043.stdout:Sep 12 12:38:38 smithi043 podman[69175]: 2024-09-12 12:38:38.846712351 +0000 UTC m=+0.551093143 container init 3c9b9bc091bce3d547021c1e3f3c467db2db1fae0ef4ad917607bfc9d4b35a6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-1-deactivate, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:38:39.053 INFO:journalctl@ceph.osd.1.smithi043.stdout:Sep 12 12:38:38 smithi043 podman[69175]: 2024-09-12 12:38:38.850224643 +0000 UTC m=+0.554605429 container start 3c9b9bc091bce3d547021c1e3f3c467db2db1fae0ef4ad917607bfc9d4b35a6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T12:38:39.053 INFO:journalctl@ceph.osd.1.smithi043.stdout:Sep 12 12:38:38 smithi043 podman[69175]: 2024-09-12 12:38:38.950092227 +0000 UTC m=+0.654473047 container attach 3c9b9bc091bce3d547021c1e3f3c467db2db1fae0ef4ad917607bfc9d4b35a6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-12T12:38:39.332 INFO:journalctl@ceph.osd.1.smithi043.stdout:Sep 12 12:38:39 smithi043 podman[69175]: 2024-09-12 12:38:39.053245783 +0000 UTC m=+0.757626567 container died 3c9b9bc091bce3d547021c1e3f3c467db2db1fae0ef4ad917607bfc9d4b35a6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-12T12:38:39.695 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@osd.1.service' 2024-09-12T12:38:39.735 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:38:39.736 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-12T12:38:39.736 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-12T12:38:39.736 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-a66dfafc-7100-11ef-bcea-c7b262605968@osd.2 2024-09-12T12:38:40.057 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 12 12:38:39 smithi102 systemd[1]: Stopping Ceph osd.2 for a66dfafc-7100-11ef-bcea-c7b262605968... 2024-09-12T12:38:40.320 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 12 12:38:40 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-2[39763]: 2024-09-12T12:38:40.113+0000 7fa9a9263640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:38:40.320 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 12 12:38:40 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-2[39763]: 2024-09-12T12:38:40.113+0000 7fa9a9263640 -1 osd.2 93 *** Got signal Terminated *** 2024-09-12T12:38:40.320 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 12 12:38:40 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-2[39763]: 2024-09-12T12:38:40.113+0000 7fa9a9263640 -1 osd.2 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T12:38:45.824 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 12 12:38:45 smithi102 podman[69480]: 2024-09-12 12:38:45.567249004 +0000 UTC m=+5.644663953 container died 88263820d3a1a5c7128655642aa701b3a6f9569f7c10cd3234539f7a9307f5f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-12T12:38:46.146 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 12 12:38:45 smithi102 podman[69480]: 2024-09-12 12:38:45.932027636 +0000 UTC m=+6.009442618 container cleanup 88263820d3a1a5c7128655642aa701b3a6f9569f7c10cd3234539f7a9307f5f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T12:38:46.146 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 12 12:38:45 smithi102 bash[69480]: ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-2 2024-09-12T12:38:46.532 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 12 12:38:46 smithi102 podman[69508]: 2024-09-12 12:38:46.225180728 +0000 UTC m=+0.657137552 container remove 88263820d3a1a5c7128655642aa701b3a6f9569f7c10cd3234539f7a9307f5f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:38:46.811 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 12 12:38:46 smithi102 podman[69596]: 2024-09-12 12:38:46.43544227 +0000 UTC m=+0.015349259 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:38:46.812 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 12 12:38:46 smithi102 podman[69596]: 2024-09-12 12:38:46.551152229 +0000 UTC m=+0.131059202 container create 665c0a58ad56f5eed3e41a7a88af554c174e2cc4be2e87a51f7796a04c0edb64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-12T12:38:46.812 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 12 12:38:46 smithi102 podman[69596]: 2024-09-12 12:38:46.812117961 +0000 UTC m=+0.392024936 container init 665c0a58ad56f5eed3e41a7a88af554c174e2cc4be2e87a51f7796a04c0edb64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-12T12:38:47.146 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 12 12:38:46 smithi102 podman[69596]: 2024-09-12 12:38:46.815623668 +0000 UTC m=+0.395530643 container start 665c0a58ad56f5eed3e41a7a88af554c174e2cc4be2e87a51f7796a04c0edb64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T12:38:47.146 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 12 12:38:46 smithi102 podman[69596]: 2024-09-12 12:38:46.937492916 +0000 UTC m=+0.517399891 container attach 665c0a58ad56f5eed3e41a7a88af554c174e2cc4be2e87a51f7796a04c0edb64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True) 2024-09-12T12:38:47.147 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 12 12:38:47 smithi102 podman[69596]: 2024-09-12 12:38:47.018977097 +0000 UTC m=+0.598884084 container died 665c0a58ad56f5eed3e41a7a88af554c174e2cc4be2e87a51f7796a04c0edb64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:38:47.607 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@osd.2.service' 2024-09-12T12:38:47.646 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:38:47.646 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-12T12:38:47.646 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-12T12:38:47.646 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-a66dfafc-7100-11ef-bcea-c7b262605968@osd.3 2024-09-12T12:38:47.949 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 12 12:38:47 smithi033 systemd[1]: Stopping Ceph osd.3 for a66dfafc-7100-11ef-bcea-c7b262605968... 2024-09-12T12:38:48.223 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 12 12:38:47 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-3[52341]: 2024-09-12T12:38:47.974+0000 7f7f73c29640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:38:48.223 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 12 12:38:47 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-3[52341]: 2024-09-12T12:38:47.974+0000 7f7f73c29640 -1 osd.3 93 *** Got signal Terminated *** 2024-09-12T12:38:48.223 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 12 12:38:47 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-3[52341]: 2024-09-12T12:38:47.974+0000 7f7f73c29640 -1 osd.3 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T12:38:50.646 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:38:50 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-5[46206]: 2024-09-12T12:38:50.255+0000 7f33da1ae640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.531093+0000 front 2024-09-12T12:38:26.531077+0000 (oldest deadline 2024-09-12T12:38:49.430901+0000) 2024-09-12T12:38:51.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:38:50 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:38:50.818+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:38:51.646 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:38:51 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-5[46206]: 2024-09-12T12:38:51.237+0000 7f33da1ae640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.531093+0000 front 2024-09-12T12:38:26.531077+0000 (oldest deadline 2024-09-12T12:38:49.430901+0000) 2024-09-12T12:38:51.647 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:38:51 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:38:51.384+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:38:51.981 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:38:51 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:38:51.599+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.686750+0000 front 2024-09-12T12:38:25.686648+0000 (oldest deadline 2024-09-12T12:38:51.586814+0000) 2024-09-12T12:38:52.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:38:51 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:38:51.821+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:38:52.646 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:38:52 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:38:52.381+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:38:52.647 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:38:52 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-5[46206]: 2024-09-12T12:38:52.197+0000 7f33da1ae640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.531093+0000 front 2024-09-12T12:38:26.531077+0000 (oldest deadline 2024-09-12T12:38:49.430901+0000) 2024-09-12T12:38:52.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:38:52 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:38:52.554+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.686750+0000 front 2024-09-12T12:38:25.686648+0000 (oldest deadline 2024-09-12T12:38:51.586814+0000) 2024-09-12T12:38:52.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:38:52 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:38:52.473+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:38:53.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:38:52 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:38:52.783+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:38:53.646 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:38:53 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:38:53.337+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:38:53.647 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:38:53 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-5[46206]: 2024-09-12T12:38:53.168+0000 7f33da1ae640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.531093+0000 front 2024-09-12T12:38:26.531077+0000 (oldest deadline 2024-09-12T12:38:49.430901+0000) 2024-09-12T12:38:53.731 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 12 12:38:53 smithi033 podman[108483]: 2024-09-12 12:38:53.479602415 +0000 UTC m=+5.631667847 container died 5a54aab433d3899a390e080d7f80dfaa4e466c445e2ffdc2f4ca9505699abdc2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-3, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:38:53.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:38:53 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:38:53.575+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.686750+0000 front 2024-09-12T12:38:25.686648+0000 (oldest deadline 2024-09-12T12:38:51.586814+0000) 2024-09-12T12:38:53.732 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:38:53 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:38:53.523+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:38:54.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:38:53 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:38:53.734+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:38:54.231 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 12 12:38:53 smithi033 podman[108483]: 2024-09-12 12:38:53.983146962 +0000 UTC m=+6.135212439 container cleanup 5a54aab433d3899a390e080d7f80dfaa4e466c445e2ffdc2f4ca9505699abdc2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-3, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-12T12:38:54.231 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 12 12:38:53 smithi033 bash[108483]: ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-3 2024-09-12T12:38:54.557 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 12 12:38:54 smithi033 podman[108510]: 2024-09-12 12:38:54.268095739 +0000 UTC m=+0.777492729 container remove 5a54aab433d3899a390e080d7f80dfaa4e466c445e2ffdc2f4ca9505699abdc2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-3, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-12T12:38:54.646 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:38:54 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:38:54.317+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:38:54.646 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:38:54 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-5[46206]: 2024-09-12T12:38:54.160+0000 7f33da1ae640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.531093+0000 front 2024-09-12T12:38:26.531077+0000 (oldest deadline 2024-09-12T12:38:49.430901+0000) 2024-09-12T12:38:54.871 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:38:54 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:38:54.585+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.686750+0000 front 2024-09-12T12:38:25.686648+0000 (oldest deadline 2024-09-12T12:38:51.586814+0000) 2024-09-12T12:38:54.872 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:38:54 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:38:54.557+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:38:54.872 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 12 12:38:54 smithi033 podman[108599]: 2024-09-12 12:38:54.518064235 +0000 UTC m=+0.016578213 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:38:54.872 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 12 12:38:54 smithi033 podman[108599]: 2024-09-12 12:38:54.627554895 +0000 UTC m=+0.126068864 container create eef9e6bc66cdf5de42cae9695708effb5c579bbe2f607d1f3a3227514654ac87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-12T12:38:55.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:38:54 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:38:54.762+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:38:55.231 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 12 12:38:54 smithi033 podman[108599]: 2024-09-12 12:38:54.872128318 +0000 UTC m=+0.370642297 container init eef9e6bc66cdf5de42cae9695708effb5c579bbe2f607d1f3a3227514654ac87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3) 2024-09-12T12:38:55.231 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 12 12:38:54 smithi033 podman[108599]: 2024-09-12 12:38:54.875756122 +0000 UTC m=+0.374270098 container start eef9e6bc66cdf5de42cae9695708effb5c579bbe2f607d1f3a3227514654ac87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-12T12:38:55.231 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 12 12:38:54 smithi033 podman[108599]: 2024-09-12 12:38:54.980531413 +0000 UTC m=+0.479045395 container attach eef9e6bc66cdf5de42cae9695708effb5c579bbe2f607d1f3a3227514654ac87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:38:55.231 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 12 12:38:55 smithi033 podman[108599]: 2024-09-12 12:38:55.068970965 +0000 UTC m=+0.567484936 container died eef9e6bc66cdf5de42cae9695708effb5c579bbe2f607d1f3a3227514654ac87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-12T12:38:55.647 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:38:55 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:38:55.270+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:38:55.648 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:38:55 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-5[46206]: 2024-09-12T12:38:55.154+0000 7f33da1ae640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.531093+0000 front 2024-09-12T12:38:26.531077+0000 (oldest deadline 2024-09-12T12:38:49.430901+0000) 2024-09-12T12:38:55.668 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:38:55 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:38:55.573+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:38:55.668 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:38:55 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:38:55.549+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.686750+0000 front 2024-09-12T12:38:25.686648+0000 (oldest deadline 2024-09-12T12:38:51.586814+0000) 2024-09-12T12:38:55.685 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@osd.3.service' 2024-09-12T12:38:55.730 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:38:55.730 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-12T12:38:55.730 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-12T12:38:55.731 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-a66dfafc-7100-11ef-bcea-c7b262605968@osd.4 2024-09-12T12:38:56.053 INFO:journalctl@ceph.osd.4.smithi043.stdout:Sep 12 12:38:55 smithi043 systemd[1]: Stopping Ceph osd.4 for a66dfafc-7100-11ef-bcea-c7b262605968... 2024-09-12T12:38:56.053 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:38:55 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:38:55.809+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:38:56.365 INFO:journalctl@ceph.osd.4.smithi043.stdout:Sep 12 12:38:56 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-4[45041]: 2024-09-12T12:38:56.053+0000 7ff80035f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:38:56.365 INFO:journalctl@ceph.osd.4.smithi043.stdout:Sep 12 12:38:56 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-4[45041]: 2024-09-12T12:38:56.053+0000 7ff80035f640 -1 osd.4 93 *** Got signal Terminated *** 2024-09-12T12:38:56.365 INFO:journalctl@ceph.osd.4.smithi043.stdout:Sep 12 12:38:56 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-4[45041]: 2024-09-12T12:38:56.053+0000 7ff80035f640 -1 osd.4 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T12:38:56.396 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:38:56 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:38:56.308+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:38:56.396 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:38:56 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-5[46206]: 2024-09-12T12:38:56.125+0000 7f33da1ae640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.531093+0000 front 2024-09-12T12:38:26.531077+0000 (oldest deadline 2024-09-12T12:38:49.430901+0000) 2024-09-12T12:38:56.981 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:38:56 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:38:56.514+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.686750+0000 front 2024-09-12T12:38:25.686648+0000 (oldest deadline 2024-09-12T12:38:51.586814+0000) 2024-09-12T12:38:56.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:38:56 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:38:56.531+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:38:57.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:38:56 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:38:56.800+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:38:57.348 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:38:57 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-5[46206]: 2024-09-12T12:38:57.141+0000 7f33da1ae640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.531093+0000 front 2024-09-12T12:38:26.531077+0000 (oldest deadline 2024-09-12T12:38:49.430901+0000) 2024-09-12T12:38:57.646 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:38:57 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:38:57.347+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:38:57.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:38:57 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:38:57.524+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:38:57.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:38:57 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:38:57.470+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.686750+0000 front 2024-09-12T12:38:25.686648+0000 (oldest deadline 2024-09-12T12:38:51.586814+0000) 2024-09-12T12:38:57.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:38:57 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:38:57.470+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.887836+0000 front 2024-09-12T12:38:33.888000+0000 (oldest deadline 2024-09-12T12:38:57.388002+0000) 2024-09-12T12:38:58.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:38:57 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:38:57.801+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:38:58.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:38:57 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:38:57.801+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:38:58.396 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:38:58 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-5[46206]: 2024-09-12T12:38:58.128+0000 7f33da1ae640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.531093+0000 front 2024-09-12T12:38:26.531077+0000 (oldest deadline 2024-09-12T12:38:49.430901+0000) 2024-09-12T12:38:58.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:38:58 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:38:58.348+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:38:58.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:38:58 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:38:58.348+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:38:58.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:38:58 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:38:58.555+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:38:58.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:38:58 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:38:58.467+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.686750+0000 front 2024-09-12T12:38:25.686648+0000 (oldest deadline 2024-09-12T12:38:51.586814+0000) 2024-09-12T12:38:58.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:38:58 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:38:58.467+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.887836+0000 front 2024-09-12T12:38:33.888000+0000 (oldest deadline 2024-09-12T12:38:57.388002+0000) 2024-09-12T12:38:59.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:38:58 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:38:58.765+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:38:59.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:38:58 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:38:58.765+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:38:59.396 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:38:59 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-5[46206]: 2024-09-12T12:38:59.080+0000 7f33da1ae640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.531093+0000 front 2024-09-12T12:38:26.531077+0000 (oldest deadline 2024-09-12T12:38:49.430901+0000) 2024-09-12T12:38:59.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:38:59 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:38:59.317+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:38:59.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:38:59 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:38:59.317+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:38:59.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:38:59 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:38:59.519+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:38:59.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:38:59 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:38:59.454+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.686750+0000 front 2024-09-12T12:38:25.686648+0000 (oldest deadline 2024-09-12T12:38:51.586814+0000) 2024-09-12T12:38:59.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:38:59 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:38:59.454+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.887836+0000 front 2024-09-12T12:38:33.888000+0000 (oldest deadline 2024-09-12T12:38:57.388002+0000) 2024-09-12T12:39:00.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:38:59 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:38:59.731+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:00.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:38:59 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:38:59.731+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:00.396 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:39:00 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-5[46206]: 2024-09-12T12:39:00.124+0000 7f33da1ae640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.531093+0000 front 2024-09-12T12:38:26.531077+0000 (oldest deadline 2024-09-12T12:38:49.430901+0000) 2024-09-12T12:39:00.397 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:00 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:00.340+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.529380+0000 front 2024-09-12T12:38:36.529485+0000 (oldest deadline 2024-09-12T12:39:00.029262+0000) 2024-09-12T12:39:00.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:00 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:00.275+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:00.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:00 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:00.275+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:00.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:00 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:00.528+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:39:00.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:00 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:00.465+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.686750+0000 front 2024-09-12T12:38:25.686648+0000 (oldest deadline 2024-09-12T12:38:51.586814+0000) 2024-09-12T12:39:00.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:00 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:00.465+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.887836+0000 front 2024-09-12T12:38:33.888000+0000 (oldest deadline 2024-09-12T12:38:57.388002+0000) 2024-09-12T12:39:01.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:00 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:00.755+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:01.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:00 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:00.755+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:01.396 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:39:01 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-5[46206]: 2024-09-12T12:39:01.110+0000 7f33da1ae640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.531093+0000 front 2024-09-12T12:38:26.531077+0000 (oldest deadline 2024-09-12T12:38:49.430901+0000) 2024-09-12T12:39:01.397 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:01 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:01.309+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.529380+0000 front 2024-09-12T12:38:36.529485+0000 (oldest deadline 2024-09-12T12:39:00.029262+0000) 2024-09-12T12:39:01.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:01 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:01.278+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:01.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:01 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:01.278+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:01.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:01 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:01.423+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.686750+0000 front 2024-09-12T12:38:25.686648+0000 (oldest deadline 2024-09-12T12:38:51.586814+0000) 2024-09-12T12:39:01.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:01 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:01.423+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.887836+0000 front 2024-09-12T12:38:33.888000+0000 (oldest deadline 2024-09-12T12:38:57.388002+0000) 2024-09-12T12:39:01.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:01 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:01.575+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:39:01.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:01 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:01.575+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.555667+0000 front 2024-09-12T12:38:35.555771+0000 (oldest deadline 2024-09-12T12:39:01.455583+0000) 2024-09-12T12:39:01.970 INFO:journalctl@ceph.osd.4.smithi043.stdout:Sep 12 12:39:01 smithi043 podman[69289]: 2024-09-12 12:39:01.698077062 +0000 UTC m=+5.761541755 container died 76afde3eabe3c3f7a02ebec9e418d6dc99c2698c0747440ba9bd216657bcbe69 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:39:01.971 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:01 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:01.729+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:01.971 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:01 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:01.729+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:02.263 INFO:journalctl@ceph.osd.4.smithi043.stdout:Sep 12 12:39:02 smithi043 podman[69289]: 2024-09-12 12:39:02.078416699 +0000 UTC m=+6.141881395 container cleanup 76afde3eabe3c3f7a02ebec9e418d6dc99c2698c0747440ba9bd216657bcbe69 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-4, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux ) 2024-09-12T12:39:02.263 INFO:journalctl@ceph.osd.4.smithi043.stdout:Sep 12 12:39:02 smithi043 bash[69289]: ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-4 2024-09-12T12:39:02.615 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:02 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:02.262+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.302095+0000 front 2024-09-12T12:38:36.302126+0000 (oldest deadline 2024-09-12T12:39:02.202250+0000) 2024-09-12T12:39:02.615 INFO:journalctl@ceph.osd.4.smithi043.stdout:Sep 12 12:39:02 smithi043 podman[69305]: 2024-09-12 12:39:02.338195367 +0000 UTC m=+0.641918047 container remove 76afde3eabe3c3f7a02ebec9e418d6dc99c2698c0747440ba9bd216657bcbe69 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T12:39:02.646 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:02 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:02.289+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.529380+0000 front 2024-09-12T12:38:36.529485+0000 (oldest deadline 2024-09-12T12:39:00.029262+0000) 2024-09-12T12:39:02.647 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:02 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:02.270+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:02.647 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:02 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:02.270+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:02.647 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:39:02 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-5[46206]: 2024-09-12T12:39:02.146+0000 7f33da1ae640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.531093+0000 front 2024-09-12T12:38:26.531077+0000 (oldest deadline 2024-09-12T12:38:49.430901+0000) 2024-09-12T12:39:02.647 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:39:02 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-5[46206]: 2024-09-12T12:39:02.146+0000 7f33da1ae640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.733277+0000 front 2024-09-12T12:38:35.733127+0000 (oldest deadline 2024-09-12T12:39:01.632917+0000) 2024-09-12T12:39:02.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:02 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:02.451+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.686750+0000 front 2024-09-12T12:38:25.686648+0000 (oldest deadline 2024-09-12T12:38:51.586814+0000) 2024-09-12T12:39:02.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:02 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:02.451+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.887836+0000 front 2024-09-12T12:38:33.888000+0000 (oldest deadline 2024-09-12T12:38:57.388002+0000) 2024-09-12T12:39:02.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:02 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:02.579+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:39:02.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:02 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:02.579+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.555667+0000 front 2024-09-12T12:38:35.555771+0000 (oldest deadline 2024-09-12T12:39:01.455583+0000) 2024-09-12T12:39:02.907 INFO:journalctl@ceph.osd.4.smithi043.stdout:Sep 12 12:39:02 smithi043 podman[69394]: 2024-09-12 12:39:02.556909522 +0000 UTC m=+0.016178222 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:39:02.908 INFO:journalctl@ceph.osd.4.smithi043.stdout:Sep 12 12:39:02 smithi043 podman[69394]: 2024-09-12 12:39:02.663990148 +0000 UTC m=+0.123258833 container create 4be3a66dfac5f3b51191d5e6a966de2a500c75f8cb44dac26560d921ab5b8cee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True) 2024-09-12T12:39:02.908 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:02 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:02.760+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:02.908 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:02 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:02.760+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:03.306 INFO:journalctl@ceph.osd.4.smithi043.stdout:Sep 12 12:39:02 smithi043 podman[69394]: 2024-09-12 12:39:02.908113033 +0000 UTC m=+0.367381731 container init 4be3a66dfac5f3b51191d5e6a966de2a500c75f8cb44dac26560d921ab5b8cee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-12T12:39:03.306 INFO:journalctl@ceph.osd.4.smithi043.stdout:Sep 12 12:39:02 smithi043 podman[69394]: 2024-09-12 12:39:02.911666854 +0000 UTC m=+0.370935545 container start 4be3a66dfac5f3b51191d5e6a966de2a500c75f8cb44dac26560d921ab5b8cee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-12T12:39:03.307 INFO:journalctl@ceph.osd.4.smithi043.stdout:Sep 12 12:39:03 smithi043 podman[69394]: 2024-09-12 12:39:02.999812674 +0000 UTC m=+0.459081378 container attach 4be3a66dfac5f3b51191d5e6a966de2a500c75f8cb44dac26560d921ab5b8cee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-12T12:39:03.307 INFO:journalctl@ceph.osd.4.smithi043.stdout:Sep 12 12:39:03 smithi043 podman[69394]: 2024-09-12 12:39:03.107725509 +0000 UTC m=+0.566994196 container died 4be3a66dfac5f3b51191d5e6a966de2a500c75f8cb44dac26560d921ab5b8cee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-12T12:39:03.615 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:03 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:03.306+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.302095+0000 front 2024-09-12T12:38:36.302126+0000 (oldest deadline 2024-09-12T12:39:02.202250+0000) 2024-09-12T12:39:03.646 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:03 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:03.322+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.529380+0000 front 2024-09-12T12:38:36.529485+0000 (oldest deadline 2024-09-12T12:39:00.029262+0000) 2024-09-12T12:39:03.647 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:39:03 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-5[46206]: 2024-09-12T12:39:03.183+0000 7f33da1ae640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.531093+0000 front 2024-09-12T12:38:26.531077+0000 (oldest deadline 2024-09-12T12:38:49.430901+0000) 2024-09-12T12:39:03.647 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:39:03 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-5[46206]: 2024-09-12T12:39:03.183+0000 7f33da1ae640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.733277+0000 front 2024-09-12T12:38:35.733127+0000 (oldest deadline 2024-09-12T12:39:01.632917+0000) 2024-09-12T12:39:03.647 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:03 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:03.261+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:03.647 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:03 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:03.261+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:03.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:03 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:03.422+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.686750+0000 front 2024-09-12T12:38:25.686648+0000 (oldest deadline 2024-09-12T12:38:51.586814+0000) 2024-09-12T12:39:03.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:03 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:03.422+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.887836+0000 front 2024-09-12T12:38:33.888000+0000 (oldest deadline 2024-09-12T12:38:57.388002+0000) 2024-09-12T12:39:03.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:03 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:03.593+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:39:03.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:03 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:03.593+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.555667+0000 front 2024-09-12T12:38:35.555771+0000 (oldest deadline 2024-09-12T12:39:01.455583+0000) 2024-09-12T12:39:03.747 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@osd.4.service' 2024-09-12T12:39:03.791 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:39:03.791 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-12T12:39:03.791 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-12T12:39:03.791 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-a66dfafc-7100-11ef-bcea-c7b262605968@osd.5 2024-09-12T12:39:04.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:03 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:03.738+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:04.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:03 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:03.738+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:04.143 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:39:03 smithi102 systemd[1]: Stopping Ceph osd.5 for a66dfafc-7100-11ef-bcea-c7b262605968... 2024-09-12T12:39:04.396 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:04 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:04.328+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.529380+0000 front 2024-09-12T12:38:36.529485+0000 (oldest deadline 2024-09-12T12:39:00.029262+0000) 2024-09-12T12:39:04.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:04 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:04.259+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:04.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:04 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:04.259+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:04.397 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:39:04 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-5[46206]: 2024-09-12T12:39:04.143+0000 7f33da1ae640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.531093+0000 front 2024-09-12T12:38:26.531077+0000 (oldest deadline 2024-09-12T12:38:49.430901+0000) 2024-09-12T12:39:04.397 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:39:04 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-5[46206]: 2024-09-12T12:39:04.143+0000 7f33da1ae640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.733277+0000 front 2024-09-12T12:38:35.733127+0000 (oldest deadline 2024-09-12T12:39:01.632917+0000) 2024-09-12T12:39:04.397 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:39:04 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-5[46206]: 2024-09-12T12:39:04.194+0000 7f33e1ba0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:39:04.397 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:39:04 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-5[46206]: 2024-09-12T12:39:04.194+0000 7f33e1ba0640 -1 osd.5 93 *** Got signal Terminated *** 2024-09-12T12:39:04.397 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:39:04 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-5[46206]: 2024-09-12T12:39:04.194+0000 7f33e1ba0640 -1 osd.5 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T12:39:04.615 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:04 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:04.293+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.302095+0000 front 2024-09-12T12:38:36.302126+0000 (oldest deadline 2024-09-12T12:39:02.202250+0000) 2024-09-12T12:39:04.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:04 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:04.427+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.686750+0000 front 2024-09-12T12:38:25.686648+0000 (oldest deadline 2024-09-12T12:38:51.586814+0000) 2024-09-12T12:39:04.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:04 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:04.427+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.887836+0000 front 2024-09-12T12:38:33.888000+0000 (oldest deadline 2024-09-12T12:38:57.388002+0000) 2024-09-12T12:39:04.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:04 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:04.571+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:39:04.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:04 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:04.571+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.555667+0000 front 2024-09-12T12:38:35.555771+0000 (oldest deadline 2024-09-12T12:39:01.455583+0000) 2024-09-12T12:39:05.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:04 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:04.784+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:05.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:04 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:04.784+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:05.615 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:05 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:05.249+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.302095+0000 front 2024-09-12T12:38:36.302126+0000 (oldest deadline 2024-09-12T12:39:02.202250+0000) 2024-09-12T12:39:05.646 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:05 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:05.308+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.529380+0000 front 2024-09-12T12:38:36.529485+0000 (oldest deadline 2024-09-12T12:39:00.029262+0000) 2024-09-12T12:39:05.646 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:39:05 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-5[46206]: 2024-09-12T12:39:05.180+0000 7f33da1ae640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.531093+0000 front 2024-09-12T12:38:26.531077+0000 (oldest deadline 2024-09-12T12:38:49.430901+0000) 2024-09-12T12:39:05.647 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:39:05 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-5[46206]: 2024-09-12T12:39:05.180+0000 7f33da1ae640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.733277+0000 front 2024-09-12T12:38:35.733127+0000 (oldest deadline 2024-09-12T12:39:01.632917+0000) 2024-09-12T12:39:05.647 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:05 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:05.273+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:05.647 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:05 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:05.273+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:05.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:05 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:05.471+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.686750+0000 front 2024-09-12T12:38:25.686648+0000 (oldest deadline 2024-09-12T12:38:51.586814+0000) 2024-09-12T12:39:05.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:05 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:05.471+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.887836+0000 front 2024-09-12T12:38:33.888000+0000 (oldest deadline 2024-09-12T12:38:57.388002+0000) 2024-09-12T12:39:05.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:05 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:05.591+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:39:05.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:05 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:05.591+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.555667+0000 front 2024-09-12T12:38:35.555771+0000 (oldest deadline 2024-09-12T12:39:01.455583+0000) 2024-09-12T12:39:06.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:05 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:05.747+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:06.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:05 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:05.747+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:06.615 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:06 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:06.231+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.302095+0000 front 2024-09-12T12:38:36.302126+0000 (oldest deadline 2024-09-12T12:39:02.202250+0000) 2024-09-12T12:39:06.646 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:06 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:06.262+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.529380+0000 front 2024-09-12T12:38:36.529485+0000 (oldest deadline 2024-09-12T12:39:00.029262+0000) 2024-09-12T12:39:06.646 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:06 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:06.262+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:42.230567+0000 front 2024-09-12T12:38:42.230700+0000 (oldest deadline 2024-09-12T12:39:05.730779+0000) 2024-09-12T12:39:06.647 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:39:06 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-5[46206]: 2024-09-12T12:39:06.180+0000 7f33da1ae640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.531093+0000 front 2024-09-12T12:38:26.531077+0000 (oldest deadline 2024-09-12T12:38:49.430901+0000) 2024-09-12T12:39:06.647 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:39:06 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-5[46206]: 2024-09-12T12:39:06.180+0000 7f33da1ae640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.733277+0000 front 2024-09-12T12:38:35.733127+0000 (oldest deadline 2024-09-12T12:39:01.632917+0000) 2024-09-12T12:39:06.647 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:06 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:06.262+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:06.647 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:06 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:06.262+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:06.647 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:06 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:06.262+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:06.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:06 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:06.458+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.686750+0000 front 2024-09-12T12:38:25.686648+0000 (oldest deadline 2024-09-12T12:38:51.586814+0000) 2024-09-12T12:39:06.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:06 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:06.458+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.887836+0000 front 2024-09-12T12:38:33.888000+0000 (oldest deadline 2024-09-12T12:38:57.388002+0000) 2024-09-12T12:39:06.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:06 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:06.599+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:39:06.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:06 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:06.599+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.555667+0000 front 2024-09-12T12:38:35.555771+0000 (oldest deadline 2024-09-12T12:39:01.455583+0000) 2024-09-12T12:39:06.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:06 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:06.599+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.456136+0000 front 2024-09-12T12:38:41.456114+0000 (oldest deadline 2024-09-12T12:39:06.156072+0000) 2024-09-12T12:39:07.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:06 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:06.731+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:07.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:06 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:06.731+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:07.396 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:07 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:07.237+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.529380+0000 front 2024-09-12T12:38:36.529485+0000 (oldest deadline 2024-09-12T12:39:00.029262+0000) 2024-09-12T12:39:07.397 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:07 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:07.237+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:42.230567+0000 front 2024-09-12T12:38:42.230700+0000 (oldest deadline 2024-09-12T12:39:05.730779+0000) 2024-09-12T12:39:07.397 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:39:07 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-5[46206]: 2024-09-12T12:39:07.144+0000 7f33da1ae640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.531093+0000 front 2024-09-12T12:38:26.531077+0000 (oldest deadline 2024-09-12T12:38:49.430901+0000) 2024-09-12T12:39:07.397 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:39:07 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-5[46206]: 2024-09-12T12:39:07.144+0000 7f33da1ae640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.733277+0000 front 2024-09-12T12:38:35.733127+0000 (oldest deadline 2024-09-12T12:39:01.632917+0000) 2024-09-12T12:39:07.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:07 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:07.247+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:07.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:07 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:07.247+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:07.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:07 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:07.247+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:07.402 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:07 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:07.217+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.302095+0000 front 2024-09-12T12:38:36.302126+0000 (oldest deadline 2024-09-12T12:39:02.202250+0000) 2024-09-12T12:39:07.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:07 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:07.439+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.686750+0000 front 2024-09-12T12:38:25.686648+0000 (oldest deadline 2024-09-12T12:38:51.586814+0000) 2024-09-12T12:39:07.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:07 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:07.439+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.887836+0000 front 2024-09-12T12:38:33.888000+0000 (oldest deadline 2024-09-12T12:38:57.388002+0000) 2024-09-12T12:39:07.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:07 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:07.439+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:44.290014+0000 front 2024-09-12T12:38:44.290088+0000 (oldest deadline 2024-09-12T12:39:06.589982+0000) 2024-09-12T12:39:07.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:07 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:07.559+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:39:07.732 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:07 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:07.559+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.555667+0000 front 2024-09-12T12:38:35.555771+0000 (oldest deadline 2024-09-12T12:39:01.455583+0000) 2024-09-12T12:39:07.732 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:07 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:07.559+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.456136+0000 front 2024-09-12T12:38:41.456114+0000 (oldest deadline 2024-09-12T12:39:06.156072+0000) 2024-09-12T12:39:08.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:07 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:07.744+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:08.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:07 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:07.744+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:08.397 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:08 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:08.279+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.529380+0000 front 2024-09-12T12:38:36.529485+0000 (oldest deadline 2024-09-12T12:39:00.029262+0000) 2024-09-12T12:39:08.397 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:08 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:08.279+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:42.230567+0000 front 2024-09-12T12:38:42.230700+0000 (oldest deadline 2024-09-12T12:39:05.730779+0000) 2024-09-12T12:39:08.397 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:39:08 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-5[46206]: 2024-09-12T12:39:08.100+0000 7f33da1ae640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.531093+0000 front 2024-09-12T12:38:26.531077+0000 (oldest deadline 2024-09-12T12:38:49.430901+0000) 2024-09-12T12:39:08.397 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:39:08 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-5[46206]: 2024-09-12T12:39:08.100+0000 7f33da1ae640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.733277+0000 front 2024-09-12T12:38:35.733127+0000 (oldest deadline 2024-09-12T12:39:01.632917+0000) 2024-09-12T12:39:08.397 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:39:08 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-5[46206]: 2024-09-12T12:39:08.100+0000 7f33da1ae640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:42.634060+0000 front 2024-09-12T12:38:42.634031+0000 (oldest deadline 2024-09-12T12:39:07.934280+0000) 2024-09-12T12:39:08.398 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:08 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:08.235+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:08.398 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:08 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:08.235+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:08.398 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:08 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:08.235+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:08.615 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:08 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:08.247+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.302095+0000 front 2024-09-12T12:38:36.302126+0000 (oldest deadline 2024-09-12T12:39:02.202250+0000) 2024-09-12T12:39:08.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:08 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:08.424+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.686750+0000 front 2024-09-12T12:38:25.686648+0000 (oldest deadline 2024-09-12T12:38:51.586814+0000) 2024-09-12T12:39:08.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:08 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:08.424+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.887836+0000 front 2024-09-12T12:38:33.888000+0000 (oldest deadline 2024-09-12T12:38:57.388002+0000) 2024-09-12T12:39:08.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:08 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:08.424+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:44.290014+0000 front 2024-09-12T12:38:44.290088+0000 (oldest deadline 2024-09-12T12:39:06.589982+0000) 2024-09-12T12:39:08.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:08 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:08.577+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:39:08.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:08 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:08.577+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.555667+0000 front 2024-09-12T12:38:35.555771+0000 (oldest deadline 2024-09-12T12:39:01.455583+0000) 2024-09-12T12:39:08.732 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:08 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:08.577+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.456136+0000 front 2024-09-12T12:38:41.456114+0000 (oldest deadline 2024-09-12T12:39:06.156072+0000) 2024-09-12T12:39:09.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:08 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:08.717+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:09.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:08 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:08.717+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:09.396 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:09 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:09.235+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.529380+0000 front 2024-09-12T12:38:36.529485+0000 (oldest deadline 2024-09-12T12:39:00.029262+0000) 2024-09-12T12:39:09.397 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:09 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:09.235+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:42.230567+0000 front 2024-09-12T12:38:42.230700+0000 (oldest deadline 2024-09-12T12:39:05.730779+0000) 2024-09-12T12:39:09.397 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:39:09 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-5[46206]: 2024-09-12T12:39:09.120+0000 7f33da1ae640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.531093+0000 front 2024-09-12T12:38:26.531077+0000 (oldest deadline 2024-09-12T12:38:49.430901+0000) 2024-09-12T12:39:09.397 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:39:09 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-5[46206]: 2024-09-12T12:39:09.120+0000 7f33da1ae640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.733277+0000 front 2024-09-12T12:38:35.733127+0000 (oldest deadline 2024-09-12T12:39:01.632917+0000) 2024-09-12T12:39:09.397 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:39:09 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-5[46206]: 2024-09-12T12:39:09.120+0000 7f33da1ae640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:42.634060+0000 front 2024-09-12T12:38:42.634031+0000 (oldest deadline 2024-09-12T12:39:07.934280+0000) 2024-09-12T12:39:09.398 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:09 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:09.252+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:09.398 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:09 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:09.252+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:09.398 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:09 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:09.252+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:09.615 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:09 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:09.223+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.302095+0000 front 2024-09-12T12:38:36.302126+0000 (oldest deadline 2024-09-12T12:39:02.202250+0000) 2024-09-12T12:39:09.615 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:09 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:09.223+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:44.503602+0000 front 2024-09-12T12:38:44.503338+0000 (oldest deadline 2024-09-12T12:39:09.203408+0000) 2024-09-12T12:39:09.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:09 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:09.382+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.686750+0000 front 2024-09-12T12:38:25.686648+0000 (oldest deadline 2024-09-12T12:38:51.586814+0000) 2024-09-12T12:39:09.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:09 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:09.382+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.887836+0000 front 2024-09-12T12:38:33.888000+0000 (oldest deadline 2024-09-12T12:38:57.388002+0000) 2024-09-12T12:39:09.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:09 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:09.382+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:44.290014+0000 front 2024-09-12T12:38:44.290088+0000 (oldest deadline 2024-09-12T12:39:06.589982+0000) 2024-09-12T12:39:09.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:09 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:09.586+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:39:09.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:09 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:09.586+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.555667+0000 front 2024-09-12T12:38:35.555771+0000 (oldest deadline 2024-09-12T12:39:01.455583+0000) 2024-09-12T12:39:09.732 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:09 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:09.586+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.456136+0000 front 2024-09-12T12:38:41.456114+0000 (oldest deadline 2024-09-12T12:39:06.156072+0000) 2024-09-12T12:39:10.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:09 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:09.763+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:10.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:09 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:09.763+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:10.129 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:39:09 smithi102 podman[69697]: 2024-09-12 12:39:09.830267807 +0000 UTC m=+5.844896648 container died a1904e488cb54bd4d8d4c68375cd63a308d87d0431d4fa394dfea0aa9915eb7f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True) 2024-09-12T12:39:10.396 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:10 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:10.209+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:10.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:10 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:10.209+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:10.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:10 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:10.209+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:10.397 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:39:10 smithi102 podman[69697]: 2024-09-12 12:39:10.2200575 +0000 UTC m=+6.234686346 container cleanup a1904e488cb54bd4d8d4c68375cd63a308d87d0431d4fa394dfea0aa9915eb7f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:39:10.397 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:39:10 smithi102 bash[69697]: ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-5 2024-09-12T12:39:10.397 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:10 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:10.232+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.529380+0000 front 2024-09-12T12:38:36.529485+0000 (oldest deadline 2024-09-12T12:39:00.029262+0000) 2024-09-12T12:39:10.397 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:10 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:10.232+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:42.230567+0000 front 2024-09-12T12:38:42.230700+0000 (oldest deadline 2024-09-12T12:39:05.730779+0000) 2024-09-12T12:39:10.615 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:10 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:10.223+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.302095+0000 front 2024-09-12T12:38:36.302126+0000 (oldest deadline 2024-09-12T12:39:02.202250+0000) 2024-09-12T12:39:10.615 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:10 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:10.223+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:44.503602+0000 front 2024-09-12T12:38:44.503338+0000 (oldest deadline 2024-09-12T12:39:09.203408+0000) 2024-09-12T12:39:10.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:10 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:10.396+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.686750+0000 front 2024-09-12T12:38:25.686648+0000 (oldest deadline 2024-09-12T12:38:51.586814+0000) 2024-09-12T12:39:10.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:10 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:10.396+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.887836+0000 front 2024-09-12T12:38:33.888000+0000 (oldest deadline 2024-09-12T12:38:57.388002+0000) 2024-09-12T12:39:10.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:10 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:10.396+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:44.290014+0000 front 2024-09-12T12:38:44.290088+0000 (oldest deadline 2024-09-12T12:39:06.589982+0000) 2024-09-12T12:39:10.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:10 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:10.577+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:39:10.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:10 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:10.577+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.555667+0000 front 2024-09-12T12:38:35.555771+0000 (oldest deadline 2024-09-12T12:39:01.455583+0000) 2024-09-12T12:39:10.732 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:10 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:10.577+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.456136+0000 front 2024-09-12T12:38:41.456114+0000 (oldest deadline 2024-09-12T12:39:06.156072+0000) 2024-09-12T12:39:10.817 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:39:10 smithi102 podman[69711]: 2024-09-12 12:39:10.471850025 +0000 UTC m=+0.636830675 container remove a1904e488cb54bd4d8d4c68375cd63a308d87d0431d4fa394dfea0aa9915eb7f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-5, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-12T12:39:11.069 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:39:10 smithi102 podman[69803]: 2024-09-12 12:39:10.720340096 +0000 UTC m=+0.015752437 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:39:11.069 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:39:10 smithi102 podman[69803]: 2024-09-12 12:39:10.839343118 +0000 UTC m=+0.134755505 container create a5ee3d90cce050905f76e0a9400945dc14e2509bacd181af7ba99c3c6f3d7468 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-12T12:39:11.069 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:39:11 smithi102 podman[69803]: 2024-09-12 12:39:11.066831966 +0000 UTC m=+0.362244307 container init a5ee3d90cce050905f76e0a9400945dc14e2509bacd181af7ba99c3c6f3d7468 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-5-deactivate, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-12T12:39:11.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:10 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:10.766+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:11.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:10 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:10.766+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:11.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:10 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:10.766+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.081058+0000 front 2024-09-12T12:38:41.081081+0000 (oldest deadline 2024-09-12T12:39:09.881582+0000) 2024-09-12T12:39:11.397 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:11 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:11.211+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.529380+0000 front 2024-09-12T12:38:36.529485+0000 (oldest deadline 2024-09-12T12:39:00.029262+0000) 2024-09-12T12:39:11.397 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:11 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:11.211+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:42.230567+0000 front 2024-09-12T12:38:42.230700+0000 (oldest deadline 2024-09-12T12:39:05.730779+0000) 2024-09-12T12:39:11.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:11 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:11.179+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:11.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:11 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:11.179+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:11.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:11 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:11.179+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:11.398 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:39:11 smithi102 podman[69803]: 2024-09-12 12:39:11.070169032 +0000 UTC m=+0.365581382 container start a5ee3d90cce050905f76e0a9400945dc14e2509bacd181af7ba99c3c6f3d7468 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:39:11.398 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:39:11 smithi102 podman[69803]: 2024-09-12 12:39:11.175253606 +0000 UTC m=+0.470665956 container attach a5ee3d90cce050905f76e0a9400945dc14e2509bacd181af7ba99c3c6f3d7468 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-5-deactivate, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-12T12:39:11.398 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 12 12:39:11 smithi102 podman[69803]: 2024-09-12 12:39:11.266591216 +0000 UTC m=+0.562003565 container died a5ee3d90cce050905f76e0a9400945dc14e2509bacd181af7ba99c3c6f3d7468 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0) 2024-09-12T12:39:11.615 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:11 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:11.243+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.302095+0000 front 2024-09-12T12:38:36.302126+0000 (oldest deadline 2024-09-12T12:39:02.202250+0000) 2024-09-12T12:39:11.615 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:11 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:11.243+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:44.503602+0000 front 2024-09-12T12:38:44.503338+0000 (oldest deadline 2024-09-12T12:39:09.203408+0000) 2024-09-12T12:39:11.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:11 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:11.421+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.686750+0000 front 2024-09-12T12:38:25.686648+0000 (oldest deadline 2024-09-12T12:38:51.586814+0000) 2024-09-12T12:39:11.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:11 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:11.421+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.887836+0000 front 2024-09-12T12:38:33.888000+0000 (oldest deadline 2024-09-12T12:38:57.388002+0000) 2024-09-12T12:39:11.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:11 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:11.421+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:44.290014+0000 front 2024-09-12T12:38:44.290088+0000 (oldest deadline 2024-09-12T12:39:06.589982+0000) 2024-09-12T12:39:11.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:11 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:11.577+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:39:11.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:11 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:11.577+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.555667+0000 front 2024-09-12T12:38:35.555771+0000 (oldest deadline 2024-09-12T12:39:01.455583+0000) 2024-09-12T12:39:11.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:11 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:11.577+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.456136+0000 front 2024-09-12T12:38:41.456114+0000 (oldest deadline 2024-09-12T12:39:06.156072+0000) 2024-09-12T12:39:11.946 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@osd.5.service' 2024-09-12T12:39:11.986 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:39:11.986 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-12T12:39:11.986 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-12T12:39:11.987 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-a66dfafc-7100-11ef-bcea-c7b262605968@osd.6 2024-09-12T12:39:12.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:11 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:11.816+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:12.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:11 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:11.816+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:12.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:11 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:11.816+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.081058+0000 front 2024-09-12T12:38:41.081081+0000 (oldest deadline 2024-09-12T12:39:09.881582+0000) 2024-09-12T12:39:12.177 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:12 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:12.135+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:12.178 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:12 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:12.135+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:12.178 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:12 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:12.135+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:12.303 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:12 smithi033 systemd[1]: Stopping Ceph osd.6 for a66dfafc-7100-11ef-bcea-c7b262605968... 2024-09-12T12:39:12.494 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:12 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:12.178+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.529380+0000 front 2024-09-12T12:38:36.529485+0000 (oldest deadline 2024-09-12T12:39:00.029262+0000) 2024-09-12T12:39:12.494 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:12 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:12.178+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:42.230567+0000 front 2024-09-12T12:38:42.230700+0000 (oldest deadline 2024-09-12T12:39:05.730779+0000) 2024-09-12T12:39:12.615 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:12 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:12.272+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.302095+0000 front 2024-09-12T12:38:36.302126+0000 (oldest deadline 2024-09-12T12:39:02.202250+0000) 2024-09-12T12:39:12.615 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:12 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:12.272+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:44.503602+0000 front 2024-09-12T12:38:44.503338+0000 (oldest deadline 2024-09-12T12:39:09.203408+0000) 2024-09-12T12:39:12.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:12 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:12.303+0000 7fe50763f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:39:12.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:12 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:12.303+0000 7fe50763f640 -1 osd.6 93 *** Got signal Terminated *** 2024-09-12T12:39:12.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:12 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:12.303+0000 7fe50763f640 -1 osd.6 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T12:39:12.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:12 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:12.436+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.686750+0000 front 2024-09-12T12:38:25.686648+0000 (oldest deadline 2024-09-12T12:38:51.586814+0000) 2024-09-12T12:39:12.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:12 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:12.436+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.887836+0000 front 2024-09-12T12:38:33.888000+0000 (oldest deadline 2024-09-12T12:38:57.388002+0000) 2024-09-12T12:39:12.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:12 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:12.436+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:44.290014+0000 front 2024-09-12T12:38:44.290088+0000 (oldest deadline 2024-09-12T12:39:06.589982+0000) 2024-09-12T12:39:12.732 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:12 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:12.546+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:39:12.732 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:12 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:12.546+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.555667+0000 front 2024-09-12T12:38:35.555771+0000 (oldest deadline 2024-09-12T12:39:01.455583+0000) 2024-09-12T12:39:12.732 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:12 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:12.546+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.456136+0000 front 2024-09-12T12:38:41.456114+0000 (oldest deadline 2024-09-12T12:39:06.156072+0000) 2024-09-12T12:39:13.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:12 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:12.818+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:13.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:12 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:12.818+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:13.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:12 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:12.818+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.081058+0000 front 2024-09-12T12:38:41.081081+0000 (oldest deadline 2024-09-12T12:39:09.881582+0000) 2024-09-12T12:39:13.615 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:13 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:13.231+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.302095+0000 front 2024-09-12T12:38:36.302126+0000 (oldest deadline 2024-09-12T12:39:02.202250+0000) 2024-09-12T12:39:13.616 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:13 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:13.231+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:44.503602+0000 front 2024-09-12T12:38:44.503338+0000 (oldest deadline 2024-09-12T12:39:09.203408+0000) 2024-09-12T12:39:13.646 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:13 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:13.207+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.529380+0000 front 2024-09-12T12:38:36.529485+0000 (oldest deadline 2024-09-12T12:39:00.029262+0000) 2024-09-12T12:39:13.647 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:13 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:13.207+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:42.230567+0000 front 2024-09-12T12:38:42.230700+0000 (oldest deadline 2024-09-12T12:39:05.730779+0000) 2024-09-12T12:39:13.647 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:13 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:13.157+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:13.647 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:13 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:13.157+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:13.647 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:13 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:13.157+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:13.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:13 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:13.424+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.686750+0000 front 2024-09-12T12:38:25.686648+0000 (oldest deadline 2024-09-12T12:38:51.586814+0000) 2024-09-12T12:39:13.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:13 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:13.424+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.887836+0000 front 2024-09-12T12:38:33.888000+0000 (oldest deadline 2024-09-12T12:38:57.388002+0000) 2024-09-12T12:39:13.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:13 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:13.424+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:44.290014+0000 front 2024-09-12T12:38:44.290088+0000 (oldest deadline 2024-09-12T12:39:06.589982+0000) 2024-09-12T12:39:13.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:13 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:13.590+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:39:13.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:13 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:13.590+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.555667+0000 front 2024-09-12T12:38:35.555771+0000 (oldest deadline 2024-09-12T12:39:01.455583+0000) 2024-09-12T12:39:13.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:13 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:13.590+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.456136+0000 front 2024-09-12T12:38:41.456114+0000 (oldest deadline 2024-09-12T12:39:06.156072+0000) 2024-09-12T12:39:14.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:13 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:13.806+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:14.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:13 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:13.806+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:14.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:13 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:13.806+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.081058+0000 front 2024-09-12T12:38:41.081081+0000 (oldest deadline 2024-09-12T12:39:09.881582+0000) 2024-09-12T12:39:14.396 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:14 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:14.248+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.529380+0000 front 2024-09-12T12:38:36.529485+0000 (oldest deadline 2024-09-12T12:39:00.029262+0000) 2024-09-12T12:39:14.397 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:14 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:14.248+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:42.230567+0000 front 2024-09-12T12:38:42.230700+0000 (oldest deadline 2024-09-12T12:39:05.730779+0000) 2024-09-12T12:39:14.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:14 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:14.118+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:14.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:14 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:14.118+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:14.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:14 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:14.118+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:14.615 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:14 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:14.255+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.302095+0000 front 2024-09-12T12:38:36.302126+0000 (oldest deadline 2024-09-12T12:39:02.202250+0000) 2024-09-12T12:39:14.615 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:14 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:14.255+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:44.503602+0000 front 2024-09-12T12:38:44.503338+0000 (oldest deadline 2024-09-12T12:39:09.203408+0000) 2024-09-12T12:39:14.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:14 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:14.596+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:39:14.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:14 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:14.596+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.555667+0000 front 2024-09-12T12:38:35.555771+0000 (oldest deadline 2024-09-12T12:39:01.455583+0000) 2024-09-12T12:39:14.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:14 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:14.596+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.456136+0000 front 2024-09-12T12:38:41.456114+0000 (oldest deadline 2024-09-12T12:39:06.156072+0000) 2024-09-12T12:39:14.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:14 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:14.440+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.686750+0000 front 2024-09-12T12:38:25.686648+0000 (oldest deadline 2024-09-12T12:38:51.586814+0000) 2024-09-12T12:39:14.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:14 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:14.440+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.887836+0000 front 2024-09-12T12:38:33.888000+0000 (oldest deadline 2024-09-12T12:38:57.388002+0000) 2024-09-12T12:39:14.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:14 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:14.440+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:44.290014+0000 front 2024-09-12T12:38:44.290088+0000 (oldest deadline 2024-09-12T12:39:06.589982+0000) 2024-09-12T12:39:14.732 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:14 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:14.440+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:47.690910+0000 front 2024-09-12T12:38:47.691016+0000 (oldest deadline 2024-09-12T12:39:13.590921+0000) 2024-09-12T12:39:15.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:14 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:14.804+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:15.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:14 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:14.804+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:15.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:14 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:14.804+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.081058+0000 front 2024-09-12T12:38:41.081081+0000 (oldest deadline 2024-09-12T12:39:09.881582+0000) 2024-09-12T12:39:15.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:14 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:14.804+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.582724+0000 front 2024-09-12T12:38:51.582755+0000 (oldest deadline 2024-09-12T12:39:13.882885+0000) 2024-09-12T12:39:15.396 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:15 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:15.211+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.529380+0000 front 2024-09-12T12:38:36.529485+0000 (oldest deadline 2024-09-12T12:39:00.029262+0000) 2024-09-12T12:39:15.397 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:15 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:15.211+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:42.230567+0000 front 2024-09-12T12:38:42.230700+0000 (oldest deadline 2024-09-12T12:39:05.730779+0000) 2024-09-12T12:39:15.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:15 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:15.075+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:15.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:15 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:15.075+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:15.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:15 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:15.075+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:15.615 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:15 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:15.239+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.302095+0000 front 2024-09-12T12:38:36.302126+0000 (oldest deadline 2024-09-12T12:39:02.202250+0000) 2024-09-12T12:39:15.615 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:15 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:15.239+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:44.503602+0000 front 2024-09-12T12:38:44.503338+0000 (oldest deadline 2024-09-12T12:39:09.203408+0000) 2024-09-12T12:39:15.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:15 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:15.628+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:39:15.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:15 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:15.628+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.555667+0000 front 2024-09-12T12:38:35.555771+0000 (oldest deadline 2024-09-12T12:39:01.455583+0000) 2024-09-12T12:39:15.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:15 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:15.628+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.456136+0000 front 2024-09-12T12:38:41.456114+0000 (oldest deadline 2024-09-12T12:39:06.156072+0000) 2024-09-12T12:39:15.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:15 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:15.396+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.686750+0000 front 2024-09-12T12:38:25.686648+0000 (oldest deadline 2024-09-12T12:38:51.586814+0000) 2024-09-12T12:39:15.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:15 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:15.396+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.887836+0000 front 2024-09-12T12:38:33.888000+0000 (oldest deadline 2024-09-12T12:38:57.388002+0000) 2024-09-12T12:39:15.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:15 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:15.396+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:44.290014+0000 front 2024-09-12T12:38:44.290088+0000 (oldest deadline 2024-09-12T12:39:06.589982+0000) 2024-09-12T12:39:15.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:15 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:15.396+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:47.690910+0000 front 2024-09-12T12:38:47.691016+0000 (oldest deadline 2024-09-12T12:39:13.590921+0000) 2024-09-12T12:39:16.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:15 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:15.763+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:16.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:15 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:15.763+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:16.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:15 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:15.763+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.081058+0000 front 2024-09-12T12:38:41.081081+0000 (oldest deadline 2024-09-12T12:39:09.881582+0000) 2024-09-12T12:39:16.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:15 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:15.763+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.582724+0000 front 2024-09-12T12:38:51.582755+0000 (oldest deadline 2024-09-12T12:39:13.882885+0000) 2024-09-12T12:39:16.396 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:16 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:16.231+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.529380+0000 front 2024-09-12T12:38:36.529485+0000 (oldest deadline 2024-09-12T12:39:00.029262+0000) 2024-09-12T12:39:16.396 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:16 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:16.231+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:42.230567+0000 front 2024-09-12T12:38:42.230700+0000 (oldest deadline 2024-09-12T12:39:05.730779+0000) 2024-09-12T12:39:16.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:16 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:16.088+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:16.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:16 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:16.088+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:16.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:16 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:16.088+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:16.615 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:16 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:16.250+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.302095+0000 front 2024-09-12T12:38:36.302126+0000 (oldest deadline 2024-09-12T12:39:02.202250+0000) 2024-09-12T12:39:16.615 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:16 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:16.250+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:44.503602+0000 front 2024-09-12T12:38:44.503338+0000 (oldest deadline 2024-09-12T12:39:09.203408+0000) 2024-09-12T12:39:16.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:16 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:16.580+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:39:16.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:16 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:16.580+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.555667+0000 front 2024-09-12T12:38:35.555771+0000 (oldest deadline 2024-09-12T12:39:01.455583+0000) 2024-09-12T12:39:16.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:16 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:16.580+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.456136+0000 front 2024-09-12T12:38:41.456114+0000 (oldest deadline 2024-09-12T12:39:06.156072+0000) 2024-09-12T12:39:16.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:16 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:16.414+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.686750+0000 front 2024-09-12T12:38:25.686648+0000 (oldest deadline 2024-09-12T12:38:51.586814+0000) 2024-09-12T12:39:16.732 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:16 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:16.414+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.887836+0000 front 2024-09-12T12:38:33.888000+0000 (oldest deadline 2024-09-12T12:38:57.388002+0000) 2024-09-12T12:39:16.732 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:16 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:16.414+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:44.290014+0000 front 2024-09-12T12:38:44.290088+0000 (oldest deadline 2024-09-12T12:39:06.589982+0000) 2024-09-12T12:39:16.732 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:16 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6[58988]: 2024-09-12T12:39:16.414+0000 7fe4ffc4d640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:47.690910+0000 front 2024-09-12T12:38:47.691016+0000 (oldest deadline 2024-09-12T12:39:13.590921+0000) 2024-09-12T12:39:17.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:16 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:16.794+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:17.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:16 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:16.794+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:17.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:16 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:16.794+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.081058+0000 front 2024-09-12T12:38:41.081081+0000 (oldest deadline 2024-09-12T12:39:09.881582+0000) 2024-09-12T12:39:17.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:16 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:16.794+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.582724+0000 front 2024-09-12T12:38:51.582755+0000 (oldest deadline 2024-09-12T12:39:13.882885+0000) 2024-09-12T12:39:17.396 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:17 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:17.281+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.529380+0000 front 2024-09-12T12:38:36.529485+0000 (oldest deadline 2024-09-12T12:39:00.029262+0000) 2024-09-12T12:39:17.396 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:17 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:17.281+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:42.230567+0000 front 2024-09-12T12:38:42.230700+0000 (oldest deadline 2024-09-12T12:39:05.730779+0000) 2024-09-12T12:39:17.397 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:17 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:17.281+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.032013+0000 front 2024-09-12T12:38:51.031989+0000 (oldest deadline 2024-09-12T12:39:16.331889+0000) 2024-09-12T12:39:17.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:17 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:17.060+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:17.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:17 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:17.060+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:17.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:17 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:17.060+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:17.615 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:17 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:17.222+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.302095+0000 front 2024-09-12T12:38:36.302126+0000 (oldest deadline 2024-09-12T12:39:02.202250+0000) 2024-09-12T12:39:17.615 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:17 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:17.222+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:44.503602+0000 front 2024-09-12T12:38:44.503338+0000 (oldest deadline 2024-09-12T12:39:09.203408+0000) 2024-09-12T12:39:17.900 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:17 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:17.595+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:39:17.900 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:17 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:17.595+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.555667+0000 front 2024-09-12T12:38:35.555771+0000 (oldest deadline 2024-09-12T12:39:01.455583+0000) 2024-09-12T12:39:17.900 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:17 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:17.595+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.456136+0000 front 2024-09-12T12:38:41.456114+0000 (oldest deadline 2024-09-12T12:39:06.156072+0000) 2024-09-12T12:39:17.900 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:17 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:17.595+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:47.757549+0000 front 2024-09-12T12:38:47.757496+0000 (oldest deadline 2024-09-12T12:39:17.158071+0000) 2024-09-12T12:39:18.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:17 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:17.749+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:18.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:17 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:17.749+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:18.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:17 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:17.749+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.081058+0000 front 2024-09-12T12:38:41.081081+0000 (oldest deadline 2024-09-12T12:39:09.881582+0000) 2024-09-12T12:39:18.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:17 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:17.749+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.582724+0000 front 2024-09-12T12:38:51.582755+0000 (oldest deadline 2024-09-12T12:39:13.882885+0000) 2024-09-12T12:39:18.213 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:17 smithi033 podman[108704]: 2024-09-12 12:39:17.900353706 +0000 UTC m=+5.702010611 container died 1a3546b05d247051d3c7ca8e60e79812bf0984f1627c090da538e1d5049bb75e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-12T12:39:18.396 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:18 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:18.104+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:18.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:18 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:18.104+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:18.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:18 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:18.104+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:18.397 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:18 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:18.312+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.529380+0000 front 2024-09-12T12:38:36.529485+0000 (oldest deadline 2024-09-12T12:39:00.029262+0000) 2024-09-12T12:39:18.397 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:18 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:18.312+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:42.230567+0000 front 2024-09-12T12:38:42.230700+0000 (oldest deadline 2024-09-12T12:39:05.730779+0000) 2024-09-12T12:39:18.397 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:18 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:18.312+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.032013+0000 front 2024-09-12T12:38:51.031989+0000 (oldest deadline 2024-09-12T12:39:16.331889+0000) 2024-09-12T12:39:18.480 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:18 smithi033 podman[108704]: 2024-09-12 12:39:18.386960065 +0000 UTC m=+6.188616962 container cleanup 1a3546b05d247051d3c7ca8e60e79812bf0984f1627c090da538e1d5049bb75e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:39:18.481 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:18 smithi033 bash[108704]: ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6 2024-09-12T12:39:18.487 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:18 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:18.212+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.302095+0000 front 2024-09-12T12:38:36.302126+0000 (oldest deadline 2024-09-12T12:39:02.202250+0000) 2024-09-12T12:39:18.487 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:18 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:18.212+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:44.503602+0000 front 2024-09-12T12:38:44.503338+0000 (oldest deadline 2024-09-12T12:39:09.203408+0000) 2024-09-12T12:39:18.487 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:18 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:18.212+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.405030+0000 front 2024-09-12T12:38:51.404890+0000 (oldest deadline 2024-09-12T12:39:17.805550+0000) 2024-09-12T12:39:18.865 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:18 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:18.712+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:18.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:18 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:18.712+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:18.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:18 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:18.712+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.081058+0000 front 2024-09-12T12:38:41.081081+0000 (oldest deadline 2024-09-12T12:39:09.881582+0000) 2024-09-12T12:39:18.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:18 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:18.712+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.582724+0000 front 2024-09-12T12:38:51.582755+0000 (oldest deadline 2024-09-12T12:39:13.882885+0000) 2024-09-12T12:39:18.946 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:18 smithi033 podman[108720]: 2024-09-12 12:39:18.655183539 +0000 UTC m=+0.749308596 container remove 1a3546b05d247051d3c7ca8e60e79812bf0984f1627c090da538e1d5049bb75e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2) 2024-09-12T12:39:18.946 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:18 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:18.555+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:39:18.946 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:18 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:18.555+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.555667+0000 front 2024-09-12T12:38:35.555771+0000 (oldest deadline 2024-09-12T12:39:01.455583+0000) 2024-09-12T12:39:18.946 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:18 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:18.555+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.456136+0000 front 2024-09-12T12:38:41.456114+0000 (oldest deadline 2024-09-12T12:39:06.156072+0000) 2024-09-12T12:39:18.946 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:18 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:18.555+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:47.757549+0000 front 2024-09-12T12:38:47.757496+0000 (oldest deadline 2024-09-12T12:39:17.158071+0000) 2024-09-12T12:39:19.202 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:19 smithi033 podman[108816]: 2024-09-12 12:39:18.912584074 +0000 UTC m=+0.017084127 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:39:19.202 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:19 smithi033 podman[108816]: 2024-09-12 12:39:19.039724944 +0000 UTC m=+0.144224997 container create 77747783fba3f9aa94032cb97164b7e9c92cb204462ad9bfe225f0c17abd896d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-12T12:39:19.335 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:19 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:19.070+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:19.335 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:19 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:19.070+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:19.335 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:19 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:19.070+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:19.615 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:19 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:19.202+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.302095+0000 front 2024-09-12T12:38:36.302126+0000 (oldest deadline 2024-09-12T12:39:02.202250+0000) 2024-09-12T12:39:19.616 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:19 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:19.202+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:44.503602+0000 front 2024-09-12T12:38:44.503338+0000 (oldest deadline 2024-09-12T12:39:09.203408+0000) 2024-09-12T12:39:19.616 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:19 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:19.202+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.405030+0000 front 2024-09-12T12:38:51.404890+0000 (oldest deadline 2024-09-12T12:39:17.805550+0000) 2024-09-12T12:39:19.646 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:19 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:19.335+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.529380+0000 front 2024-09-12T12:38:36.529485+0000 (oldest deadline 2024-09-12T12:39:00.029262+0000) 2024-09-12T12:39:19.647 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:19 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:19.335+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:42.230567+0000 front 2024-09-12T12:38:42.230700+0000 (oldest deadline 2024-09-12T12:39:05.730779+0000) 2024-09-12T12:39:19.647 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:19 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:19.335+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.032013+0000 front 2024-09-12T12:38:51.031989+0000 (oldest deadline 2024-09-12T12:39:16.331889+0000) 2024-09-12T12:39:19.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:19 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:19.530+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:39:19.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:19 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:19.530+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.555667+0000 front 2024-09-12T12:38:35.555771+0000 (oldest deadline 2024-09-12T12:39:01.455583+0000) 2024-09-12T12:39:19.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:19 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:19.530+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.456136+0000 front 2024-09-12T12:38:41.456114+0000 (oldest deadline 2024-09-12T12:39:06.156072+0000) 2024-09-12T12:39:19.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:19 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:19.530+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:47.757549+0000 front 2024-09-12T12:38:47.757496+0000 (oldest deadline 2024-09-12T12:39:17.158071+0000) 2024-09-12T12:39:19.731 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:19 smithi033 podman[108816]: 2024-09-12 12:39:19.326081795 +0000 UTC m=+0.430581865 container init 77747783fba3f9aa94032cb97164b7e9c92cb204462ad9bfe225f0c17abd896d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-12T12:39:19.732 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:19 smithi033 podman[108816]: 2024-09-12 12:39:19.329667508 +0000 UTC m=+0.434167566 container start 77747783fba3f9aa94032cb97164b7e9c92cb204462ad9bfe225f0c17abd896d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-12T12:39:19.732 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:19 smithi033 podman[108816]: 2024-09-12 12:39:19.426086253 +0000 UTC m=+0.530586330 container attach 77747783fba3f9aa94032cb97164b7e9c92cb204462ad9bfe225f0c17abd896d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-12T12:39:19.732 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 12 12:39:19 smithi033 podman[108816]: 2024-09-12 12:39:19.521496812 +0000 UTC m=+0.625996866 container died 77747783fba3f9aa94032cb97164b7e9c92cb204462ad9bfe225f0c17abd896d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-12T12:39:20.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:19 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:19.759+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:20.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:19 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:19.759+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:20.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:19 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:19.759+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.081058+0000 front 2024-09-12T12:38:41.081081+0000 (oldest deadline 2024-09-12T12:39:09.881582+0000) 2024-09-12T12:39:20.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:19 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:19.759+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.582724+0000 front 2024-09-12T12:38:51.582755+0000 (oldest deadline 2024-09-12T12:39:13.882885+0000) 2024-09-12T12:39:20.168 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@osd.6.service' 2024-09-12T12:39:20.214 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:39:20.215 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-12T12:39:20.215 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-12T12:39:20.215 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-a66dfafc-7100-11ef-bcea-c7b262605968@osd.7 2024-09-12T12:39:20.361 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:20 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:20.058+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:20.361 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:20 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:20.058+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:20.361 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:20 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:20.058+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:20.539 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:20 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:20.223+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.302095+0000 front 2024-09-12T12:38:36.302126+0000 (oldest deadline 2024-09-12T12:39:02.202250+0000) 2024-09-12T12:39:20.539 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:20 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:20.223+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:44.503602+0000 front 2024-09-12T12:38:44.503338+0000 (oldest deadline 2024-09-12T12:39:09.203408+0000) 2024-09-12T12:39:20.539 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:20 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:20.223+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.405030+0000 front 2024-09-12T12:38:51.404890+0000 (oldest deadline 2024-09-12T12:39:17.805550+0000) 2024-09-12T12:39:20.540 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:20 smithi043 systemd[1]: Stopping Ceph osd.7 for a66dfafc-7100-11ef-bcea-c7b262605968... 2024-09-12T12:39:20.540 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:20 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:20.538+0000 7f6cdc2cc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:39:20.540 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:20 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:20.538+0000 7f6cdc2cc640 -1 osd.7 93 *** Got signal Terminated *** 2024-09-12T12:39:20.540 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:20 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:20.538+0000 7f6cdc2cc640 -1 osd.7 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T12:39:20.646 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:20 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:20.361+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.529380+0000 front 2024-09-12T12:38:36.529485+0000 (oldest deadline 2024-09-12T12:39:00.029262+0000) 2024-09-12T12:39:20.646 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:20 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:20.361+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:42.230567+0000 front 2024-09-12T12:38:42.230700+0000 (oldest deadline 2024-09-12T12:39:05.730779+0000) 2024-09-12T12:39:20.646 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:20 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:20.361+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.032013+0000 front 2024-09-12T12:38:51.031989+0000 (oldest deadline 2024-09-12T12:39:16.331889+0000) 2024-09-12T12:39:20.865 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:20 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:20.713+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:20.865 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:20 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:20.713+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:20.865 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:20 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:20.713+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.081058+0000 front 2024-09-12T12:38:41.081081+0000 (oldest deadline 2024-09-12T12:39:09.881582+0000) 2024-09-12T12:39:20.865 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:20 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:20.713+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.582724+0000 front 2024-09-12T12:38:51.582755+0000 (oldest deadline 2024-09-12T12:39:13.882885+0000) 2024-09-12T12:39:20.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:20 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:20.497+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:39:20.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:20 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:20.497+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.555667+0000 front 2024-09-12T12:38:35.555771+0000 (oldest deadline 2024-09-12T12:39:01.455583+0000) 2024-09-12T12:39:20.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:20 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:20.497+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.456136+0000 front 2024-09-12T12:38:41.456114+0000 (oldest deadline 2024-09-12T12:39:06.156072+0000) 2024-09-12T12:39:20.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:20 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:20.497+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:47.757549+0000 front 2024-09-12T12:38:47.757496+0000 (oldest deadline 2024-09-12T12:39:17.158071+0000) 2024-09-12T12:39:21.332 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:21 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:21.024+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:21.332 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:21 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:21.024+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:21.332 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:21 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:21.024+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:21.615 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:21 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:21.186+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.302095+0000 front 2024-09-12T12:38:36.302126+0000 (oldest deadline 2024-09-12T12:39:02.202250+0000) 2024-09-12T12:39:21.615 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:21 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:21.186+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:44.503602+0000 front 2024-09-12T12:38:44.503338+0000 (oldest deadline 2024-09-12T12:39:09.203408+0000) 2024-09-12T12:39:21.615 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:21 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:21.186+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.405030+0000 front 2024-09-12T12:38:51.404890+0000 (oldest deadline 2024-09-12T12:39:17.805550+0000) 2024-09-12T12:39:21.647 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:21 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:21.332+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.529380+0000 front 2024-09-12T12:38:36.529485+0000 (oldest deadline 2024-09-12T12:39:00.029262+0000) 2024-09-12T12:39:21.647 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:21 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:21.332+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:42.230567+0000 front 2024-09-12T12:38:42.230700+0000 (oldest deadline 2024-09-12T12:39:05.730779+0000) 2024-09-12T12:39:21.647 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:21 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:21.332+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.032013+0000 front 2024-09-12T12:38:51.031989+0000 (oldest deadline 2024-09-12T12:39:16.331889+0000) 2024-09-12T12:39:21.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:21 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:21.486+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:39:21.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:21 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:21.486+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.555667+0000 front 2024-09-12T12:38:35.555771+0000 (oldest deadline 2024-09-12T12:39:01.455583+0000) 2024-09-12T12:39:21.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:21 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:21.486+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.456136+0000 front 2024-09-12T12:38:41.456114+0000 (oldest deadline 2024-09-12T12:39:06.156072+0000) 2024-09-12T12:39:21.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:21 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:21.486+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:47.757549+0000 front 2024-09-12T12:38:47.757496+0000 (oldest deadline 2024-09-12T12:39:17.158071+0000) 2024-09-12T12:39:22.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:21 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:21.687+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:22.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:21 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:21.687+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:22.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:21 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:21.687+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.081058+0000 front 2024-09-12T12:38:41.081081+0000 (oldest deadline 2024-09-12T12:39:09.881582+0000) 2024-09-12T12:39:22.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:21 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:21.687+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.582724+0000 front 2024-09-12T12:38:51.582755+0000 (oldest deadline 2024-09-12T12:39:13.882885+0000) 2024-09-12T12:39:22.366 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:22 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:22.058+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:22.366 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:22 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:22.058+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:22.366 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:22 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:22.058+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:22.615 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:22 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:22.203+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.302095+0000 front 2024-09-12T12:38:36.302126+0000 (oldest deadline 2024-09-12T12:39:02.202250+0000) 2024-09-12T12:39:22.615 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:22 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:22.203+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:44.503602+0000 front 2024-09-12T12:38:44.503338+0000 (oldest deadline 2024-09-12T12:39:09.203408+0000) 2024-09-12T12:39:22.615 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:22 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:22.203+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.405030+0000 front 2024-09-12T12:38:51.404890+0000 (oldest deadline 2024-09-12T12:39:17.805550+0000) 2024-09-12T12:39:22.646 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:22 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:22.366+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.529380+0000 front 2024-09-12T12:38:36.529485+0000 (oldest deadline 2024-09-12T12:39:00.029262+0000) 2024-09-12T12:39:22.646 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:22 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:22.366+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:42.230567+0000 front 2024-09-12T12:38:42.230700+0000 (oldest deadline 2024-09-12T12:39:05.730779+0000) 2024-09-12T12:39:22.647 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:22 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:22.366+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.032013+0000 front 2024-09-12T12:38:51.031989+0000 (oldest deadline 2024-09-12T12:39:16.331889+0000) 2024-09-12T12:39:22.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:22 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:22.483+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:39:22.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:22 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:22.483+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.555667+0000 front 2024-09-12T12:38:35.555771+0000 (oldest deadline 2024-09-12T12:39:01.455583+0000) 2024-09-12T12:39:22.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:22 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:22.483+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.456136+0000 front 2024-09-12T12:38:41.456114+0000 (oldest deadline 2024-09-12T12:39:06.156072+0000) 2024-09-12T12:39:22.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:22 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:22.483+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:47.757549+0000 front 2024-09-12T12:38:47.757496+0000 (oldest deadline 2024-09-12T12:39:17.158071+0000) 2024-09-12T12:39:22.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:22 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:22.483+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:38:57.158754+0000 front 2024-09-12T12:38:57.158592+0000 (oldest deadline 2024-09-12T12:39:22.458650+0000) 2024-09-12T12:39:23.117 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:22 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:22.736+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:23.117 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:22 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:22.736+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:23.117 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:22 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:22.736+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.081058+0000 front 2024-09-12T12:38:41.081081+0000 (oldest deadline 2024-09-12T12:39:09.881582+0000) 2024-09-12T12:39:23.117 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:22 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:22.736+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.582724+0000 front 2024-09-12T12:38:51.582755+0000 (oldest deadline 2024-09-12T12:39:13.882885+0000) 2024-09-12T12:39:23.383 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:23 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:23.104+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:23.384 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:23 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:23.104+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:23.384 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:23 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:23.104+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:23.384 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:23 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:23.104+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.029121+0000 front 2024-09-12T12:39:00.029145+0000 (oldest deadline 2024-09-12T12:39:22.929085+0000) 2024-09-12T12:39:23.615 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:23 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:23.232+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.302095+0000 front 2024-09-12T12:38:36.302126+0000 (oldest deadline 2024-09-12T12:39:02.202250+0000) 2024-09-12T12:39:23.615 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:23 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:23.232+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:44.503602+0000 front 2024-09-12T12:38:44.503338+0000 (oldest deadline 2024-09-12T12:39:09.203408+0000) 2024-09-12T12:39:23.615 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:23 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:23.232+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.405030+0000 front 2024-09-12T12:38:51.404890+0000 (oldest deadline 2024-09-12T12:39:17.805550+0000) 2024-09-12T12:39:23.615 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:23 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:23.232+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:38:57.806055+0000 front 2024-09-12T12:38:57.806138+0000 (oldest deadline 2024-09-12T12:39:23.106159+0000) 2024-09-12T12:39:23.646 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:23 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:23.384+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.529380+0000 front 2024-09-12T12:38:36.529485+0000 (oldest deadline 2024-09-12T12:39:00.029262+0000) 2024-09-12T12:39:23.646 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:23 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:23.384+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:42.230567+0000 front 2024-09-12T12:38:42.230700+0000 (oldest deadline 2024-09-12T12:39:05.730779+0000) 2024-09-12T12:39:23.646 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:23 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:23.384+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.032013+0000 front 2024-09-12T12:38:51.031989+0000 (oldest deadline 2024-09-12T12:39:16.331889+0000) 2024-09-12T12:39:23.732 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:23 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:23.465+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:39:23.732 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:23 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:23.465+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.555667+0000 front 2024-09-12T12:38:35.555771+0000 (oldest deadline 2024-09-12T12:39:01.455583+0000) 2024-09-12T12:39:23.732 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:23 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:23.465+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.456136+0000 front 2024-09-12T12:38:41.456114+0000 (oldest deadline 2024-09-12T12:39:06.156072+0000) 2024-09-12T12:39:23.732 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:23 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:23.465+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:47.757549+0000 front 2024-09-12T12:38:47.757496+0000 (oldest deadline 2024-09-12T12:39:17.158071+0000) 2024-09-12T12:39:23.732 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:23 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:23.465+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:38:57.158754+0000 front 2024-09-12T12:38:57.158592+0000 (oldest deadline 2024-09-12T12:39:22.458650+0000) 2024-09-12T12:39:24.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:23 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:23.771+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:24.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:23 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:23.771+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:24.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:23 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:23.771+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.081058+0000 front 2024-09-12T12:38:41.081081+0000 (oldest deadline 2024-09-12T12:39:09.881582+0000) 2024-09-12T12:39:24.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:23 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:23.771+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.582724+0000 front 2024-09-12T12:38:51.582755+0000 (oldest deadline 2024-09-12T12:39:13.882885+0000) 2024-09-12T12:39:24.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:24 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:24.124+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:24.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:24 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:24.124+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:24.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:24 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:24.124+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:24.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:24 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:24.124+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.029121+0000 front 2024-09-12T12:39:00.029145+0000 (oldest deadline 2024-09-12T12:39:22.929085+0000) 2024-09-12T12:39:24.615 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:24 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:24.217+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.302095+0000 front 2024-09-12T12:38:36.302126+0000 (oldest deadline 2024-09-12T12:39:02.202250+0000) 2024-09-12T12:39:24.615 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:24 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:24.217+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:44.503602+0000 front 2024-09-12T12:38:44.503338+0000 (oldest deadline 2024-09-12T12:39:09.203408+0000) 2024-09-12T12:39:24.615 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:24 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:24.217+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.405030+0000 front 2024-09-12T12:38:51.404890+0000 (oldest deadline 2024-09-12T12:39:17.805550+0000) 2024-09-12T12:39:24.615 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:24 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:24.217+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:38:57.806055+0000 front 2024-09-12T12:38:57.806138+0000 (oldest deadline 2024-09-12T12:39:23.106159+0000) 2024-09-12T12:39:24.896 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:24 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:24.403+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.529380+0000 front 2024-09-12T12:38:36.529485+0000 (oldest deadline 2024-09-12T12:39:00.029262+0000) 2024-09-12T12:39:24.896 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:24 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:24.403+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:42.230567+0000 front 2024-09-12T12:38:42.230700+0000 (oldest deadline 2024-09-12T12:39:05.730779+0000) 2024-09-12T12:39:24.896 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:24 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:24.403+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.032013+0000 front 2024-09-12T12:38:51.031989+0000 (oldest deadline 2024-09-12T12:39:16.331889+0000) 2024-09-12T12:39:24.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:24 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:24.503+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:39:24.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:24 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:24.503+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.555667+0000 front 2024-09-12T12:38:35.555771+0000 (oldest deadline 2024-09-12T12:39:01.455583+0000) 2024-09-12T12:39:24.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:24 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:24.503+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.456136+0000 front 2024-09-12T12:38:41.456114+0000 (oldest deadline 2024-09-12T12:39:06.156072+0000) 2024-09-12T12:39:24.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:24 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:24.503+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:47.757549+0000 front 2024-09-12T12:38:47.757496+0000 (oldest deadline 2024-09-12T12:39:17.158071+0000) 2024-09-12T12:39:24.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:24 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:24.503+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:38:57.158754+0000 front 2024-09-12T12:38:57.158592+0000 (oldest deadline 2024-09-12T12:39:22.458650+0000) 2024-09-12T12:39:25.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:24 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:24.728+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:25.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:24 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:24.728+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:25.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:24 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:24.728+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.081058+0000 front 2024-09-12T12:38:41.081081+0000 (oldest deadline 2024-09-12T12:39:09.881582+0000) 2024-09-12T12:39:25.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:24 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:24.728+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.582724+0000 front 2024-09-12T12:38:51.582755+0000 (oldest deadline 2024-09-12T12:39:13.882885+0000) 2024-09-12T12:39:25.368 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:25 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:25.085+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:25.368 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:25 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:25.085+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:25.368 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:25 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:25.085+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:25.368 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:25 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:25.085+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.029121+0000 front 2024-09-12T12:39:00.029145+0000 (oldest deadline 2024-09-12T12:39:22.929085+0000) 2024-09-12T12:39:25.615 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:25 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:25.250+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.302095+0000 front 2024-09-12T12:38:36.302126+0000 (oldest deadline 2024-09-12T12:39:02.202250+0000) 2024-09-12T12:39:25.615 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:25 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:25.250+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:44.503602+0000 front 2024-09-12T12:38:44.503338+0000 (oldest deadline 2024-09-12T12:39:09.203408+0000) 2024-09-12T12:39:25.616 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:25 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:25.250+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.405030+0000 front 2024-09-12T12:38:51.404890+0000 (oldest deadline 2024-09-12T12:39:17.805550+0000) 2024-09-12T12:39:25.616 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:25 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7[51982]: 2024-09-12T12:39:25.250+0000 7f6cd48da640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:38:57.806055+0000 front 2024-09-12T12:38:57.806138+0000 (oldest deadline 2024-09-12T12:39:23.106159+0000) 2024-09-12T12:39:25.646 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:25 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:25.367+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.529380+0000 front 2024-09-12T12:38:36.529485+0000 (oldest deadline 2024-09-12T12:39:00.029262+0000) 2024-09-12T12:39:25.646 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:25 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:25.367+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:42.230567+0000 front 2024-09-12T12:38:42.230700+0000 (oldest deadline 2024-09-12T12:39:05.730779+0000) 2024-09-12T12:39:25.646 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:25 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:25.367+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.032013+0000 front 2024-09-12T12:38:51.031989+0000 (oldest deadline 2024-09-12T12:39:16.331889+0000) 2024-09-12T12:39:25.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:25 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:25.500+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:39:25.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:25 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:25.500+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.555667+0000 front 2024-09-12T12:38:35.555771+0000 (oldest deadline 2024-09-12T12:39:01.455583+0000) 2024-09-12T12:39:25.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:25 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:25.500+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.456136+0000 front 2024-09-12T12:38:41.456114+0000 (oldest deadline 2024-09-12T12:39:06.156072+0000) 2024-09-12T12:39:25.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:25 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:25.500+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:47.757549+0000 front 2024-09-12T12:38:47.757496+0000 (oldest deadline 2024-09-12T12:39:17.158071+0000) 2024-09-12T12:39:25.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:25 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:25.500+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:38:57.158754+0000 front 2024-09-12T12:38:57.158592+0000 (oldest deadline 2024-09-12T12:39:22.458650+0000) 2024-09-12T12:39:26.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:25 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:25.708+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:26.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:25 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:25.708+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:26.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:25 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:25.708+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.081058+0000 front 2024-09-12T12:38:41.081081+0000 (oldest deadline 2024-09-12T12:39:09.881582+0000) 2024-09-12T12:39:26.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:25 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:25.708+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.582724+0000 front 2024-09-12T12:38:51.582755+0000 (oldest deadline 2024-09-12T12:39:13.882885+0000) 2024-09-12T12:39:26.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:25 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:25.708+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.184732+0000 front 2024-09-12T12:39:00.184786+0000 (oldest deadline 2024-09-12T12:39:24.884860+0000) 2024-09-12T12:39:26.363 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:26 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:26.036+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:26.363 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:26 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:26.036+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:26.363 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:26 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:26.036+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:26.363 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:26 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:26.036+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.029121+0000 front 2024-09-12T12:39:00.029145+0000 (oldest deadline 2024-09-12T12:39:22.929085+0000) 2024-09-12T12:39:26.456 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:26 smithi043 podman[69510]: 2024-09-12 12:39:26.161610095 +0000 UTC m=+5.738952405 container died afebe004094b3e41f6a2fdf665a13843bb347e7a80e6b5bcbd97ab78e0f4b6ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS) 2024-09-12T12:39:26.646 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:26 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:26.363+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.529380+0000 front 2024-09-12T12:38:36.529485+0000 (oldest deadline 2024-09-12T12:39:00.029262+0000) 2024-09-12T12:39:26.646 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:26 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:26.363+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:42.230567+0000 front 2024-09-12T12:38:42.230700+0000 (oldest deadline 2024-09-12T12:39:05.730779+0000) 2024-09-12T12:39:26.647 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:26 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:26.363+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.032013+0000 front 2024-09-12T12:38:51.031989+0000 (oldest deadline 2024-09-12T12:39:16.331889+0000) 2024-09-12T12:39:26.647 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:26 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:26.363+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:01.033170+0000 front 2024-09-12T12:39:01.033202+0000 (oldest deadline 2024-09-12T12:39:26.233636+0000) 2024-09-12T12:39:26.723 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:26 smithi043 podman[69510]: 2024-09-12 12:39:26.563892329 +0000 UTC m=+6.141234639 container cleanup afebe004094b3e41f6a2fdf665a13843bb347e7a80e6b5bcbd97ab78e0f4b6ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-12T12:39:26.723 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:26 smithi043 bash[69510]: ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7 2024-09-12T12:39:26.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:26 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:26.534+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:39:26.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:26 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:26.534+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.555667+0000 front 2024-09-12T12:38:35.555771+0000 (oldest deadline 2024-09-12T12:39:01.455583+0000) 2024-09-12T12:39:26.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:26 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:26.534+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.456136+0000 front 2024-09-12T12:38:41.456114+0000 (oldest deadline 2024-09-12T12:39:06.156072+0000) 2024-09-12T12:39:26.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:26 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:26.534+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:47.757549+0000 front 2024-09-12T12:38:47.757496+0000 (oldest deadline 2024-09-12T12:39:17.158071+0000) 2024-09-12T12:39:26.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:26 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:26.534+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:38:57.158754+0000 front 2024-09-12T12:38:57.158592+0000 (oldest deadline 2024-09-12T12:39:22.458650+0000) 2024-09-12T12:39:27.115 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:26 smithi043 podman[69527]: 2024-09-12 12:39:26.723439942 +0000 UTC m=+0.560033527 container remove afebe004094b3e41f6a2fdf665a13843bb347e7a80e6b5bcbd97ab78e0f4b6ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-12T12:39:27.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:26 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:26.732+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:27.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:26 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:26.732+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:27.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:26 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:26.732+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.081058+0000 front 2024-09-12T12:38:41.081081+0000 (oldest deadline 2024-09-12T12:39:09.881582+0000) 2024-09-12T12:39:27.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:26 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:26.732+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.582724+0000 front 2024-09-12T12:38:51.582755+0000 (oldest deadline 2024-09-12T12:39:13.882885+0000) 2024-09-12T12:39:27.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:26 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:26.732+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.184732+0000 front 2024-09-12T12:39:00.184786+0000 (oldest deadline 2024-09-12T12:39:24.884860+0000) 2024-09-12T12:39:27.374 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:27 smithi043 podman[69614]: 2024-09-12 12:39:27.124110829 +0000 UTC m=+0.103116809 container create fbdf89d203a938774755424f84f4c1e2cbcbd6237e2d9641483afa95381fbf73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:39:27.374 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:27 smithi043 podman[69614]: 2024-09-12 12:39:27.037468777 +0000 UTC m=+0.016474730 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:39:27.396 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:26 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:26.992+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:27.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:26 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:26.992+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:27.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:26 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:26.992+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:27.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:26 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:26.992+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.029121+0000 front 2024-09-12T12:39:00.029145+0000 (oldest deadline 2024-09-12T12:39:22.929085+0000) 2024-09-12T12:39:27.690 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:27 smithi043 podman[69614]: 2024-09-12 12:39:27.501741439 +0000 UTC m=+0.480747381 container init fbdf89d203a938774755424f84f4c1e2cbcbd6237e2d9641483afa95381fbf73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:39:27.691 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:27 smithi043 podman[69614]: 2024-09-12 12:39:27.505439523 +0000 UTC m=+0.484445464 container start fbdf89d203a938774755424f84f4c1e2cbcbd6237e2d9641483afa95381fbf73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-12T12:39:27.691 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:27 smithi043 podman[69614]: 2024-09-12 12:39:27.584971164 +0000 UTC m=+0.563977115 container attach fbdf89d203a938774755424f84f4c1e2cbcbd6237e2d9641483afa95381fbf73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3) 2024-09-12T12:39:27.896 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:27 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:27.407+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.529380+0000 front 2024-09-12T12:38:36.529485+0000 (oldest deadline 2024-09-12T12:39:00.029262+0000) 2024-09-12T12:39:27.896 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:27 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:27.407+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:42.230567+0000 front 2024-09-12T12:38:42.230700+0000 (oldest deadline 2024-09-12T12:39:05.730779+0000) 2024-09-12T12:39:27.897 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:27 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:27.407+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.032013+0000 front 2024-09-12T12:38:51.031989+0000 (oldest deadline 2024-09-12T12:39:16.331889+0000) 2024-09-12T12:39:27.897 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:27 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:27.407+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:01.033170+0000 front 2024-09-12T12:39:01.033202+0000 (oldest deadline 2024-09-12T12:39:26.233636+0000) 2024-09-12T12:39:27.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:27 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:27.494+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:39:27.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:27 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:27.494+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.555667+0000 front 2024-09-12T12:38:35.555771+0000 (oldest deadline 2024-09-12T12:39:01.455583+0000) 2024-09-12T12:39:27.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:27 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:27.494+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.456136+0000 front 2024-09-12T12:38:41.456114+0000 (oldest deadline 2024-09-12T12:39:06.156072+0000) 2024-09-12T12:39:27.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:27 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:27.494+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:47.757549+0000 front 2024-09-12T12:38:47.757496+0000 (oldest deadline 2024-09-12T12:39:17.158071+0000) 2024-09-12T12:39:27.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:27 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:27.494+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:38:57.158754+0000 front 2024-09-12T12:38:57.158592+0000 (oldest deadline 2024-09-12T12:39:22.458650+0000) 2024-09-12T12:39:27.995 INFO:journalctl@ceph.osd.7.smithi043.stdout:Sep 12 12:39:27 smithi043 podman[69614]: 2024-09-12 12:39:27.710431881 +0000 UTC m=+0.689437822 container died fbdf89d203a938774755424f84f4c1e2cbcbd6237e2d9641483afa95381fbf73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T12:39:27.995 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:27 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:27.690+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:27.995 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:27 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:27.690+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:27.995 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:27 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:27.690+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.081058+0000 front 2024-09-12T12:38:41.081081+0000 (oldest deadline 2024-09-12T12:39:09.881582+0000) 2024-09-12T12:39:27.995 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:27 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:27.690+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.582724+0000 front 2024-09-12T12:38:51.582755+0000 (oldest deadline 2024-09-12T12:39:13.882885+0000) 2024-09-12T12:39:27.996 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:27 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:27.690+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.184732+0000 front 2024-09-12T12:39:00.184786+0000 (oldest deadline 2024-09-12T12:39:24.884860+0000) 2024-09-12T12:39:28.320 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@osd.7.service' 2024-09-12T12:39:28.365 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:28 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:28.003+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:28.366 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:28 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:28.003+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:28.366 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:28 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:28.003+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:28.366 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:28 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:28.003+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.029121+0000 front 2024-09-12T12:39:00.029145+0000 (oldest deadline 2024-09-12T12:39:22.929085+0000) 2024-09-12T12:39:28.367 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:39:28.367 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-12T12:39:28.367 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-12T12:39:28.368 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-a66dfafc-7100-11ef-bcea-c7b262605968@osd.8 2024-09-12T12:39:28.648 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:28 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:28.365+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.529380+0000 front 2024-09-12T12:38:36.529485+0000 (oldest deadline 2024-09-12T12:39:00.029262+0000) 2024-09-12T12:39:28.648 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:28 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:28.365+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:42.230567+0000 front 2024-09-12T12:38:42.230700+0000 (oldest deadline 2024-09-12T12:39:05.730779+0000) 2024-09-12T12:39:28.648 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:28 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:28.365+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.032013+0000 front 2024-09-12T12:38:51.031989+0000 (oldest deadline 2024-09-12T12:39:16.331889+0000) 2024-09-12T12:39:28.649 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:28 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:28.365+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:01.033170+0000 front 2024-09-12T12:39:01.033202+0000 (oldest deadline 2024-09-12T12:39:26.233636+0000) 2024-09-12T12:39:28.649 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:28 smithi102 systemd[1]: Stopping Ceph osd.8 for a66dfafc-7100-11ef-bcea-c7b262605968... 2024-09-12T12:39:28.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:28 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:28.536+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:39:28.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:28 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:28.536+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.555667+0000 front 2024-09-12T12:38:35.555771+0000 (oldest deadline 2024-09-12T12:39:01.455583+0000) 2024-09-12T12:39:28.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:28 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:28.536+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.456136+0000 front 2024-09-12T12:38:41.456114+0000 (oldest deadline 2024-09-12T12:39:06.156072+0000) 2024-09-12T12:39:28.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:28 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:28.536+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:47.757549+0000 front 2024-09-12T12:38:47.757496+0000 (oldest deadline 2024-09-12T12:39:17.158071+0000) 2024-09-12T12:39:28.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:28 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:28.536+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:38:57.158754+0000 front 2024-09-12T12:38:57.158592+0000 (oldest deadline 2024-09-12T12:39:22.458650+0000) 2024-09-12T12:39:28.865 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:28 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:28.686+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:28.865 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:28 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:28.686+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:28.865 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:28 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:28.686+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.081058+0000 front 2024-09-12T12:38:41.081081+0000 (oldest deadline 2024-09-12T12:39:09.881582+0000) 2024-09-12T12:39:28.865 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:28 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:28.686+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.582724+0000 front 2024-09-12T12:38:51.582755+0000 (oldest deadline 2024-09-12T12:39:13.882885+0000) 2024-09-12T12:39:28.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:28 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:28.686+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.184732+0000 front 2024-09-12T12:39:00.184786+0000 (oldest deadline 2024-09-12T12:39:24.884860+0000) 2024-09-12T12:39:29.051 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:28 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:28.681+0000 7f2217c3b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:39:29.051 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:28 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:28.681+0000 7f2217c3b640 -1 osd.8 93 *** Got signal Terminated *** 2024-09-12T12:39:29.051 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:28 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:28.681+0000 7f2217c3b640 -1 osd.8 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T12:39:29.376 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:29 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:29.049+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:29.376 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:29 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:29.049+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:29.376 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:29 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:29.049+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:29.376 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:29 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:29.049+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.029121+0000 front 2024-09-12T12:39:00.029145+0000 (oldest deadline 2024-09-12T12:39:22.929085+0000) 2024-09-12T12:39:29.646 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:29 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:29.375+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.529380+0000 front 2024-09-12T12:38:36.529485+0000 (oldest deadline 2024-09-12T12:39:00.029262+0000) 2024-09-12T12:39:29.646 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:29 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:29.375+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:42.230567+0000 front 2024-09-12T12:38:42.230700+0000 (oldest deadline 2024-09-12T12:39:05.730779+0000) 2024-09-12T12:39:29.646 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:29 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:29.375+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.032013+0000 front 2024-09-12T12:38:51.031989+0000 (oldest deadline 2024-09-12T12:39:16.331889+0000) 2024-09-12T12:39:29.646 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:29 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:29.375+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:01.033170+0000 front 2024-09-12T12:39:01.033202+0000 (oldest deadline 2024-09-12T12:39:26.233636+0000) 2024-09-12T12:39:29.865 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:29 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:29.664+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:29.865 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:29 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:29.664+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:29.865 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:29 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:29.664+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.081058+0000 front 2024-09-12T12:38:41.081081+0000 (oldest deadline 2024-09-12T12:39:09.881582+0000) 2024-09-12T12:39:29.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:29 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:29.664+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.582724+0000 front 2024-09-12T12:38:51.582755+0000 (oldest deadline 2024-09-12T12:39:13.882885+0000) 2024-09-12T12:39:29.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:29 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:29.664+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.184732+0000 front 2024-09-12T12:39:00.184786+0000 (oldest deadline 2024-09-12T12:39:24.884860+0000) 2024-09-12T12:39:29.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:29 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:29.504+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:39:29.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:29 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:29.504+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.555667+0000 front 2024-09-12T12:38:35.555771+0000 (oldest deadline 2024-09-12T12:39:01.455583+0000) 2024-09-12T12:39:29.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:29 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:29.504+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.456136+0000 front 2024-09-12T12:38:41.456114+0000 (oldest deadline 2024-09-12T12:39:06.156072+0000) 2024-09-12T12:39:29.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:29 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:29.504+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:47.757549+0000 front 2024-09-12T12:38:47.757496+0000 (oldest deadline 2024-09-12T12:39:17.158071+0000) 2024-09-12T12:39:29.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:29 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:29.504+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:38:57.158754+0000 front 2024-09-12T12:38:57.158592+0000 (oldest deadline 2024-09-12T12:39:22.458650+0000) 2024-09-12T12:39:30.370 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:30 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:30.006+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:30.370 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:30 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:30.006+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:30.370 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:30 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:30.006+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:30.370 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:30 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:30.006+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.029121+0000 front 2024-09-12T12:39:00.029145+0000 (oldest deadline 2024-09-12T12:39:22.929085+0000) 2024-09-12T12:39:30.646 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:30 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:30.369+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.529380+0000 front 2024-09-12T12:38:36.529485+0000 (oldest deadline 2024-09-12T12:39:00.029262+0000) 2024-09-12T12:39:30.646 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:30 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:30.369+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:42.230567+0000 front 2024-09-12T12:38:42.230700+0000 (oldest deadline 2024-09-12T12:39:05.730779+0000) 2024-09-12T12:39:30.646 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:30 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:30.369+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.032013+0000 front 2024-09-12T12:38:51.031989+0000 (oldest deadline 2024-09-12T12:39:16.331889+0000) 2024-09-12T12:39:30.646 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:30 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:30.369+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:01.033170+0000 front 2024-09-12T12:39:01.033202+0000 (oldest deadline 2024-09-12T12:39:26.233636+0000) 2024-09-12T12:39:30.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:30 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:30.527+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:39:30.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:30 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:30.527+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.555667+0000 front 2024-09-12T12:38:35.555771+0000 (oldest deadline 2024-09-12T12:39:01.455583+0000) 2024-09-12T12:39:30.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:30 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:30.527+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.456136+0000 front 2024-09-12T12:38:41.456114+0000 (oldest deadline 2024-09-12T12:39:06.156072+0000) 2024-09-12T12:39:30.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:30 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:30.527+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:47.757549+0000 front 2024-09-12T12:38:47.757496+0000 (oldest deadline 2024-09-12T12:39:17.158071+0000) 2024-09-12T12:39:30.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:30 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:30.527+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:38:57.158754+0000 front 2024-09-12T12:38:57.158592+0000 (oldest deadline 2024-09-12T12:39:22.458650+0000) 2024-09-12T12:39:31.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:30 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:30.699+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:31.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:30 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:30.699+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:31.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:30 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:30.699+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.081058+0000 front 2024-09-12T12:38:41.081081+0000 (oldest deadline 2024-09-12T12:39:09.881582+0000) 2024-09-12T12:39:31.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:30 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:30.699+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.582724+0000 front 2024-09-12T12:38:51.582755+0000 (oldest deadline 2024-09-12T12:39:13.882885+0000) 2024-09-12T12:39:31.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:30 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:30.699+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.184732+0000 front 2024-09-12T12:39:00.184786+0000 (oldest deadline 2024-09-12T12:39:24.884860+0000) 2024-09-12T12:39:31.396 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:31 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:31.038+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:31.396 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:31 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:31.038+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:31.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:31 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:31.038+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:31.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:31 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:31.038+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.029121+0000 front 2024-09-12T12:39:00.029145+0000 (oldest deadline 2024-09-12T12:39:22.929085+0000) 2024-09-12T12:39:31.896 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:31 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:31.396+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.529380+0000 front 2024-09-12T12:38:36.529485+0000 (oldest deadline 2024-09-12T12:39:00.029262+0000) 2024-09-12T12:39:31.897 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:31 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:31.396+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:42.230567+0000 front 2024-09-12T12:38:42.230700+0000 (oldest deadline 2024-09-12T12:39:05.730779+0000) 2024-09-12T12:39:31.897 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:31 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:31.396+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.032013+0000 front 2024-09-12T12:38:51.031989+0000 (oldest deadline 2024-09-12T12:39:16.331889+0000) 2024-09-12T12:39:31.897 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:31 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:31.396+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:01.033170+0000 front 2024-09-12T12:39:01.033202+0000 (oldest deadline 2024-09-12T12:39:26.233636+0000) 2024-09-12T12:39:31.897 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:31 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:31.396+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:06.233996+0000 front 2024-09-12T12:39:06.234105+0000 (oldest deadline 2024-09-12T12:39:30.934057+0000) 2024-09-12T12:39:31.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:31 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:31.558+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:39:31.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:31 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:31.558+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.555667+0000 front 2024-09-12T12:38:35.555771+0000 (oldest deadline 2024-09-12T12:39:01.455583+0000) 2024-09-12T12:39:31.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:31 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:31.558+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.456136+0000 front 2024-09-12T12:38:41.456114+0000 (oldest deadline 2024-09-12T12:39:06.156072+0000) 2024-09-12T12:39:31.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:31 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:31.558+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:47.757549+0000 front 2024-09-12T12:38:47.757496+0000 (oldest deadline 2024-09-12T12:39:17.158071+0000) 2024-09-12T12:39:31.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:31 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:31.558+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:38:57.158754+0000 front 2024-09-12T12:38:57.158592+0000 (oldest deadline 2024-09-12T12:39:22.458650+0000) 2024-09-12T12:39:32.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:31 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:31.706+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:32.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:31 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:31.706+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:32.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:31 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:31.706+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.081058+0000 front 2024-09-12T12:38:41.081081+0000 (oldest deadline 2024-09-12T12:39:09.881582+0000) 2024-09-12T12:39:32.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:31 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:31.706+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.582724+0000 front 2024-09-12T12:38:51.582755+0000 (oldest deadline 2024-09-12T12:39:13.882885+0000) 2024-09-12T12:39:32.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:31 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:31.706+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.184732+0000 front 2024-09-12T12:39:00.184786+0000 (oldest deadline 2024-09-12T12:39:24.884860+0000) 2024-09-12T12:39:32.366 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:31 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:31.996+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:32.366 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:31 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:31.996+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:32.366 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:31 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:31.996+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:32.367 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:31 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:31.996+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.029121+0000 front 2024-09-12T12:39:00.029145+0000 (oldest deadline 2024-09-12T12:39:22.929085+0000) 2024-09-12T12:39:32.646 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:32 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:32.365+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.529380+0000 front 2024-09-12T12:38:36.529485+0000 (oldest deadline 2024-09-12T12:39:00.029262+0000) 2024-09-12T12:39:32.647 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:32 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:32.365+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:42.230567+0000 front 2024-09-12T12:38:42.230700+0000 (oldest deadline 2024-09-12T12:39:05.730779+0000) 2024-09-12T12:39:32.647 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:32 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:32.365+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.032013+0000 front 2024-09-12T12:38:51.031989+0000 (oldest deadline 2024-09-12T12:39:16.331889+0000) 2024-09-12T12:39:32.647 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:32 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:32.365+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:01.033170+0000 front 2024-09-12T12:39:01.033202+0000 (oldest deadline 2024-09-12T12:39:26.233636+0000) 2024-09-12T12:39:32.647 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:32 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:32.365+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:06.233996+0000 front 2024-09-12T12:39:06.234105+0000 (oldest deadline 2024-09-12T12:39:30.934057+0000) 2024-09-12T12:39:32.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:32 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:32.545+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:39:32.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:32 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:32.545+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.555667+0000 front 2024-09-12T12:38:35.555771+0000 (oldest deadline 2024-09-12T12:39:01.455583+0000) 2024-09-12T12:39:32.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:32 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:32.545+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.456136+0000 front 2024-09-12T12:38:41.456114+0000 (oldest deadline 2024-09-12T12:39:06.156072+0000) 2024-09-12T12:39:32.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:32 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:32.545+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:47.757549+0000 front 2024-09-12T12:38:47.757496+0000 (oldest deadline 2024-09-12T12:39:17.158071+0000) 2024-09-12T12:39:32.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:32 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:32.545+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:38:57.158754+0000 front 2024-09-12T12:38:57.158592+0000 (oldest deadline 2024-09-12T12:39:22.458650+0000) 2024-09-12T12:39:33.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:32 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:32.731+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:33.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:32 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:32.731+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:33.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:32 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:32.731+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.081058+0000 front 2024-09-12T12:38:41.081081+0000 (oldest deadline 2024-09-12T12:39:09.881582+0000) 2024-09-12T12:39:33.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:32 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:32.731+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.582724+0000 front 2024-09-12T12:38:51.582755+0000 (oldest deadline 2024-09-12T12:39:13.882885+0000) 2024-09-12T12:39:33.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:32 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:32.731+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.184732+0000 front 2024-09-12T12:39:00.184786+0000 (oldest deadline 2024-09-12T12:39:24.884860+0000) 2024-09-12T12:39:33.366 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:33 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:33.035+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:33.366 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:33 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:33.035+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:33.366 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:33 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:33.035+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:33.366 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:33 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:33.035+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.029121+0000 front 2024-09-12T12:39:00.029145+0000 (oldest deadline 2024-09-12T12:39:22.929085+0000) 2024-09-12T12:39:33.646 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:33 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:33.363+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:36.529380+0000 front 2024-09-12T12:38:36.529485+0000 (oldest deadline 2024-09-12T12:39:00.029262+0000) 2024-09-12T12:39:33.647 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:33 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:33.363+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:42.230567+0000 front 2024-09-12T12:38:42.230700+0000 (oldest deadline 2024-09-12T12:39:05.730779+0000) 2024-09-12T12:39:33.647 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:33 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:33.363+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.032013+0000 front 2024-09-12T12:38:51.031989+0000 (oldest deadline 2024-09-12T12:39:16.331889+0000) 2024-09-12T12:39:33.647 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:33 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:33.363+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:01.033170+0000 front 2024-09-12T12:39:01.033202+0000 (oldest deadline 2024-09-12T12:39:26.233636+0000) 2024-09-12T12:39:33.647 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:33 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8[52808]: 2024-09-12T12:39:33.363+0000 7f2214251640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:06.233996+0000 front 2024-09-12T12:39:06.234105+0000 (oldest deadline 2024-09-12T12:39:30.934057+0000) 2024-09-12T12:39:33.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:33 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:33.524+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:39:33.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:33 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:33.524+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.555667+0000 front 2024-09-12T12:38:35.555771+0000 (oldest deadline 2024-09-12T12:39:01.455583+0000) 2024-09-12T12:39:33.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:33 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:33.524+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.456136+0000 front 2024-09-12T12:38:41.456114+0000 (oldest deadline 2024-09-12T12:39:06.156072+0000) 2024-09-12T12:39:33.982 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:33 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:33.524+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:47.757549+0000 front 2024-09-12T12:38:47.757496+0000 (oldest deadline 2024-09-12T12:39:17.158071+0000) 2024-09-12T12:39:33.982 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:33 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:33.524+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:38:57.158754+0000 front 2024-09-12T12:38:57.158592+0000 (oldest deadline 2024-09-12T12:39:22.458650+0000) 2024-09-12T12:39:34.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:33 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:33.692+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:34.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:33 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:33.692+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:34.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:33 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:33.692+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.081058+0000 front 2024-09-12T12:38:41.081081+0000 (oldest deadline 2024-09-12T12:39:09.881582+0000) 2024-09-12T12:39:34.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:33 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:33.692+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.582724+0000 front 2024-09-12T12:38:51.582755+0000 (oldest deadline 2024-09-12T12:39:13.882885+0000) 2024-09-12T12:39:34.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:33 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:33.692+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.184732+0000 front 2024-09-12T12:39:00.184786+0000 (oldest deadline 2024-09-12T12:39:24.884860+0000) 2024-09-12T12:39:34.390 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:34 smithi102 podman[69916]: 2024-09-12 12:39:34.103841471 +0000 UTC m=+5.539057533 container died 8fee956938af170f2bea529643ea5c660e5d2492825e9bb3d8f20e014d31ecf1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731) 2024-09-12T12:39:34.391 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:33 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:33.996+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:34.391 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:33 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:33.996+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:34.391 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:33 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:33.996+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:34.391 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:33 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:33.996+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.029121+0000 front 2024-09-12T12:39:00.029145+0000 (oldest deadline 2024-09-12T12:39:22.929085+0000) 2024-09-12T12:39:34.647 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:34 smithi102 podman[69916]: 2024-09-12 12:39:34.49900752 +0000 UTC m=+5.934223548 container cleanup 8fee956938af170f2bea529643ea5c660e5d2492825e9bb3d8f20e014d31ecf1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-12T12:39:34.647 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:34 smithi102 bash[69916]: ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8 2024-09-12T12:39:34.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:34 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:34.569+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:39:34.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:34 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:34.569+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.555667+0000 front 2024-09-12T12:38:35.555771+0000 (oldest deadline 2024-09-12T12:39:01.455583+0000) 2024-09-12T12:39:34.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:34 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:34.569+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.456136+0000 front 2024-09-12T12:38:41.456114+0000 (oldest deadline 2024-09-12T12:39:06.156072+0000) 2024-09-12T12:39:34.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:34 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:34.569+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:47.757549+0000 front 2024-09-12T12:38:47.757496+0000 (oldest deadline 2024-09-12T12:39:17.158071+0000) 2024-09-12T12:39:34.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:34 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:34.569+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:38:57.158754+0000 front 2024-09-12T12:38:57.158592+0000 (oldest deadline 2024-09-12T12:39:22.458650+0000) 2024-09-12T12:39:35.109 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:34 smithi102 podman[69931]: 2024-09-12 12:39:34.750369045 +0000 UTC m=+0.645538903 container remove 8fee956938af170f2bea529643ea5c660e5d2492825e9bb3d8f20e014d31ecf1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2) 2024-09-12T12:39:35.109 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:34 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:34.976+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:35.109 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:34 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:34.976+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:35.109 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:34 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:34.976+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:35.109 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:34 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:34.976+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.029121+0000 front 2024-09-12T12:39:00.029145+0000 (oldest deadline 2024-09-12T12:39:22.929085+0000) 2024-09-12T12:39:35.109 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:34 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:34.976+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:08.130452+0000 front 2024-09-12T12:39:08.130472+0000 (oldest deadline 2024-09-12T12:39:34.030540+0000) 2024-09-12T12:39:35.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:34 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:34.663+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:35.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:34 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:34.663+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:35.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:34 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:34.663+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.081058+0000 front 2024-09-12T12:38:41.081081+0000 (oldest deadline 2024-09-12T12:39:09.881582+0000) 2024-09-12T12:39:35.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:34 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:34.663+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.582724+0000 front 2024-09-12T12:38:51.582755+0000 (oldest deadline 2024-09-12T12:39:13.882885+0000) 2024-09-12T12:39:35.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:34 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:34.663+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.184732+0000 front 2024-09-12T12:39:00.184786+0000 (oldest deadline 2024-09-12T12:39:24.884860+0000) 2024-09-12T12:39:35.362 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:35 smithi102 podman[70024]: 2024-09-12 12:39:35.012283129 +0000 UTC m=+0.015730126 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:39:35.362 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:35 smithi102 podman[70024]: 2024-09-12 12:39:35.10961017 +0000 UTC m=+0.113057166 container create cfdcba78658238ad15625be6ec96bacf1a47a4935a56400f9ea311150c7d33d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T12:39:35.362 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:35 smithi102 podman[70024]: 2024-09-12 12:39:35.362174507 +0000 UTC m=+0.365621499 container init cfdcba78658238ad15625be6ec96bacf1a47a4935a56400f9ea311150c7d33d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-12T12:39:35.646 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:35 smithi102 podman[70024]: 2024-09-12 12:39:35.365779393 +0000 UTC m=+0.369226389 container start cfdcba78658238ad15625be6ec96bacf1a47a4935a56400f9ea311150c7d33d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-12T12:39:35.646 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:35 smithi102 podman[70024]: 2024-09-12 12:39:35.428687105 +0000 UTC m=+0.432134104 container attach cfdcba78658238ad15625be6ec96bacf1a47a4935a56400f9ea311150c7d33d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-12T12:39:35.646 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 12 12:39:35 smithi102 podman[70047]: 2024-09-12 12:39:35.576622604 +0000 UTC m=+0.016346066 container died cfdcba78658238ad15625be6ec96bacf1a47a4935a56400f9ea311150c7d33d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-12T12:39:35.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:35 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:35.559+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:39:35.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:35 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:35.559+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.555667+0000 front 2024-09-12T12:38:35.555771+0000 (oldest deadline 2024-09-12T12:39:01.455583+0000) 2024-09-12T12:39:35.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:35 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:35.559+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.456136+0000 front 2024-09-12T12:38:41.456114+0000 (oldest deadline 2024-09-12T12:39:06.156072+0000) 2024-09-12T12:39:35.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:35 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:35.559+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:47.757549+0000 front 2024-09-12T12:38:47.757496+0000 (oldest deadline 2024-09-12T12:39:17.158071+0000) 2024-09-12T12:39:35.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:35 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:35.559+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:38:57.158754+0000 front 2024-09-12T12:38:57.158592+0000 (oldest deadline 2024-09-12T12:39:22.458650+0000) 2024-09-12T12:39:35.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:35 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:35.559+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:07.159961+0000 front 2024-09-12T12:39:07.159887+0000 (oldest deadline 2024-09-12T12:39:35.360197+0000) 2024-09-12T12:39:36.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:35 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:35.640+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:36.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:35 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:35.640+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:36.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:35 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:35.640+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.081058+0000 front 2024-09-12T12:38:41.081081+0000 (oldest deadline 2024-09-12T12:39:09.881582+0000) 2024-09-12T12:39:36.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:35 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:35.640+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.582724+0000 front 2024-09-12T12:38:51.582755+0000 (oldest deadline 2024-09-12T12:39:13.882885+0000) 2024-09-12T12:39:36.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:35 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:35.640+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.184732+0000 front 2024-09-12T12:39:00.184786+0000 (oldest deadline 2024-09-12T12:39:24.884860+0000) 2024-09-12T12:39:36.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:35 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:35.640+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:06.585936+0000 front 2024-09-12T12:39:06.585972+0000 (oldest deadline 2024-09-12T12:39:34.786684+0000) 2024-09-12T12:39:36.146 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:35 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:35.965+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:36.146 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:35 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:35.965+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:36.146 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:35 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:35.965+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:36.147 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:35 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:35.965+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.029121+0000 front 2024-09-12T12:39:00.029145+0000 (oldest deadline 2024-09-12T12:39:22.929085+0000) 2024-09-12T12:39:36.147 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:35 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:35.965+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:08.130452+0000 front 2024-09-12T12:39:08.130472+0000 (oldest deadline 2024-09-12T12:39:34.030540+0000) 2024-09-12T12:39:36.184 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@osd.8.service' 2024-09-12T12:39:36.223 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:39:36.224 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-12T12:39:36.224 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-12T12:39:36.224 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-a66dfafc-7100-11ef-bcea-c7b262605968@osd.9 2024-09-12T12:39:36.520 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:36 smithi033 systemd[1]: Stopping Ceph osd.9 for a66dfafc-7100-11ef-bcea-c7b262605968... 2024-09-12T12:39:36.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:36 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:36.520+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:39:36.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:36 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:36.520+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.555667+0000 front 2024-09-12T12:38:35.555771+0000 (oldest deadline 2024-09-12T12:39:01.455583+0000) 2024-09-12T12:39:36.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:36 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:36.520+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.456136+0000 front 2024-09-12T12:38:41.456114+0000 (oldest deadline 2024-09-12T12:39:06.156072+0000) 2024-09-12T12:39:36.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:36 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:36.520+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:47.757549+0000 front 2024-09-12T12:38:47.757496+0000 (oldest deadline 2024-09-12T12:39:17.158071+0000) 2024-09-12T12:39:36.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:36 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:36.520+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:38:57.158754+0000 front 2024-09-12T12:38:57.158592+0000 (oldest deadline 2024-09-12T12:39:22.458650+0000) 2024-09-12T12:39:36.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:36 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:36.520+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:07.159961+0000 front 2024-09-12T12:39:07.159887+0000 (oldest deadline 2024-09-12T12:39:35.360197+0000) 2024-09-12T12:39:36.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:36 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:36.548+0000 7f118b5a4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:39:36.982 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:36 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:36.548+0000 7f118b5a4640 -1 osd.9 93 *** Got signal Terminated *** 2024-09-12T12:39:36.982 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:36 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:36.548+0000 7f118b5a4640 -1 osd.9 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T12:39:37.017 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:36 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:36.640+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:37.017 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:36 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:36.640+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:37.017 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:36 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:36.640+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.081058+0000 front 2024-09-12T12:38:41.081081+0000 (oldest deadline 2024-09-12T12:39:09.881582+0000) 2024-09-12T12:39:37.017 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:36 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:36.640+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.582724+0000 front 2024-09-12T12:38:51.582755+0000 (oldest deadline 2024-09-12T12:39:13.882885+0000) 2024-09-12T12:39:37.017 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:36 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:36.640+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.184732+0000 front 2024-09-12T12:39:00.184786+0000 (oldest deadline 2024-09-12T12:39:24.884860+0000) 2024-09-12T12:39:37.017 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:36 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:36.640+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:06.585936+0000 front 2024-09-12T12:39:06.585972+0000 (oldest deadline 2024-09-12T12:39:34.786684+0000) 2024-09-12T12:39:37.385 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:37 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:37.004+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:37.386 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:37 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:37.004+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:37.386 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:37 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:37.004+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:37.386 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:37 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:37.004+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.029121+0000 front 2024-09-12T12:39:00.029145+0000 (oldest deadline 2024-09-12T12:39:22.929085+0000) 2024-09-12T12:39:37.386 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:37 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:37.004+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:08.130452+0000 front 2024-09-12T12:39:08.130472+0000 (oldest deadline 2024-09-12T12:39:34.030540+0000) 2024-09-12T12:39:37.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:37 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:37.489+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:39:37.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:37 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:37.489+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.555667+0000 front 2024-09-12T12:38:35.555771+0000 (oldest deadline 2024-09-12T12:39:01.455583+0000) 2024-09-12T12:39:37.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:37 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:37.489+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.456136+0000 front 2024-09-12T12:38:41.456114+0000 (oldest deadline 2024-09-12T12:39:06.156072+0000) 2024-09-12T12:39:37.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:37 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:37.489+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:47.757549+0000 front 2024-09-12T12:38:47.757496+0000 (oldest deadline 2024-09-12T12:39:17.158071+0000) 2024-09-12T12:39:37.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:37 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:37.489+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:38:57.158754+0000 front 2024-09-12T12:38:57.158592+0000 (oldest deadline 2024-09-12T12:39:22.458650+0000) 2024-09-12T12:39:37.981 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:37 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:37.489+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:07.159961+0000 front 2024-09-12T12:39:07.159887+0000 (oldest deadline 2024-09-12T12:39:35.360197+0000) 2024-09-12T12:39:38.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:37 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:37.684+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:38.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:37 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:37.684+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:38.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:37 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:37.684+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.081058+0000 front 2024-09-12T12:38:41.081081+0000 (oldest deadline 2024-09-12T12:39:09.881582+0000) 2024-09-12T12:39:38.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:37 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:37.684+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.582724+0000 front 2024-09-12T12:38:51.582755+0000 (oldest deadline 2024-09-12T12:39:13.882885+0000) 2024-09-12T12:39:38.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:37 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:37.684+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.184732+0000 front 2024-09-12T12:39:00.184786+0000 (oldest deadline 2024-09-12T12:39:24.884860+0000) 2024-09-12T12:39:38.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:37 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:37.684+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:06.585936+0000 front 2024-09-12T12:39:06.585972+0000 (oldest deadline 2024-09-12T12:39:34.786684+0000) 2024-09-12T12:39:38.396 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:37 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:37.967+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:38.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:37 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:37.967+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:38.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:37 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:37.967+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:38.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:37 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:37.967+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.029121+0000 front 2024-09-12T12:39:00.029145+0000 (oldest deadline 2024-09-12T12:39:22.929085+0000) 2024-09-12T12:39:38.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:37 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:37.967+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:08.130452+0000 front 2024-09-12T12:39:08.130472+0000 (oldest deadline 2024-09-12T12:39:34.030540+0000) 2024-09-12T12:39:38.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:38 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:38.461+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:39:38.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:38 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:38.461+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.555667+0000 front 2024-09-12T12:38:35.555771+0000 (oldest deadline 2024-09-12T12:39:01.455583+0000) 2024-09-12T12:39:38.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:38 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:38.461+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.456136+0000 front 2024-09-12T12:38:41.456114+0000 (oldest deadline 2024-09-12T12:39:06.156072+0000) 2024-09-12T12:39:38.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:38 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:38.461+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:47.757549+0000 front 2024-09-12T12:38:47.757496+0000 (oldest deadline 2024-09-12T12:39:17.158071+0000) 2024-09-12T12:39:38.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:38 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:38.461+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:38:57.158754+0000 front 2024-09-12T12:38:57.158592+0000 (oldest deadline 2024-09-12T12:39:22.458650+0000) 2024-09-12T12:39:38.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:38 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:38.461+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:07.159961+0000 front 2024-09-12T12:39:07.159887+0000 (oldest deadline 2024-09-12T12:39:35.360197+0000) 2024-09-12T12:39:39.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:38 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:38.682+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:39.122 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:38 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:38.682+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:39.122 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:38 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:38.682+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.081058+0000 front 2024-09-12T12:38:41.081081+0000 (oldest deadline 2024-09-12T12:39:09.881582+0000) 2024-09-12T12:39:39.122 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:38 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:38.682+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.582724+0000 front 2024-09-12T12:38:51.582755+0000 (oldest deadline 2024-09-12T12:39:13.882885+0000) 2024-09-12T12:39:39.122 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:38 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:38.682+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.184732+0000 front 2024-09-12T12:39:00.184786+0000 (oldest deadline 2024-09-12T12:39:24.884860+0000) 2024-09-12T12:39:39.122 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:38 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:38.682+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:06.585936+0000 front 2024-09-12T12:39:06.585972+0000 (oldest deadline 2024-09-12T12:39:34.786684+0000) 2024-09-12T12:39:39.396 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:38 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:38.978+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:39.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:38 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:38.978+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:39.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:38 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:38.978+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:39.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:38 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:38.978+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.029121+0000 front 2024-09-12T12:39:00.029145+0000 (oldest deadline 2024-09-12T12:39:22.929085+0000) 2024-09-12T12:39:39.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:38 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:38.978+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:08.130452+0000 front 2024-09-12T12:39:08.130472+0000 (oldest deadline 2024-09-12T12:39:34.030540+0000) 2024-09-12T12:39:39.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:39 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:39.464+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:39:39.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:39 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:39.464+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.555667+0000 front 2024-09-12T12:38:35.555771+0000 (oldest deadline 2024-09-12T12:39:01.455583+0000) 2024-09-12T12:39:39.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:39 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:39.464+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.456136+0000 front 2024-09-12T12:38:41.456114+0000 (oldest deadline 2024-09-12T12:39:06.156072+0000) 2024-09-12T12:39:39.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:39 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:39.464+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:47.757549+0000 front 2024-09-12T12:38:47.757496+0000 (oldest deadline 2024-09-12T12:39:17.158071+0000) 2024-09-12T12:39:39.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:39 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:39.464+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:38:57.158754+0000 front 2024-09-12T12:38:57.158592+0000 (oldest deadline 2024-09-12T12:39:22.458650+0000) 2024-09-12T12:39:39.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:39 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:39.464+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:07.159961+0000 front 2024-09-12T12:39:07.159887+0000 (oldest deadline 2024-09-12T12:39:35.360197+0000) 2024-09-12T12:39:40.115 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:39 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:39.634+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:40.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:39 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:39.634+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:40.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:39 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:39.634+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.081058+0000 front 2024-09-12T12:38:41.081081+0000 (oldest deadline 2024-09-12T12:39:09.881582+0000) 2024-09-12T12:39:40.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:39 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:39.634+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.582724+0000 front 2024-09-12T12:38:51.582755+0000 (oldest deadline 2024-09-12T12:39:13.882885+0000) 2024-09-12T12:39:40.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:39 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:39.634+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.184732+0000 front 2024-09-12T12:39:00.184786+0000 (oldest deadline 2024-09-12T12:39:24.884860+0000) 2024-09-12T12:39:40.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:39 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:39.634+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:06.585936+0000 front 2024-09-12T12:39:06.585972+0000 (oldest deadline 2024-09-12T12:39:34.786684+0000) 2024-09-12T12:39:40.116 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:39 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:39.634+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-12T12:39:14.787370+0000 front 2024-09-12T12:39:14.787307+0000 (oldest deadline 2024-09-12T12:39:38.887001+0000) 2024-09-12T12:39:40.298 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:39 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:39.967+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:40.298 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:39 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:39.967+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:40.298 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:39 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:39.967+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:40.298 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:39 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:39.967+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.029121+0000 front 2024-09-12T12:39:00.029145+0000 (oldest deadline 2024-09-12T12:39:22.929085+0000) 2024-09-12T12:39:40.298 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:39 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:39.967+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:08.130452+0000 front 2024-09-12T12:39:08.130472+0000 (oldest deadline 2024-09-12T12:39:34.030540+0000) 2024-09-12T12:39:40.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:40 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:40.434+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:39:40.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:40 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:40.434+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.555667+0000 front 2024-09-12T12:38:35.555771+0000 (oldest deadline 2024-09-12T12:39:01.455583+0000) 2024-09-12T12:39:40.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:40 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:40.434+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.456136+0000 front 2024-09-12T12:38:41.456114+0000 (oldest deadline 2024-09-12T12:39:06.156072+0000) 2024-09-12T12:39:40.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:40 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:40.434+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:47.757549+0000 front 2024-09-12T12:38:47.757496+0000 (oldest deadline 2024-09-12T12:39:17.158071+0000) 2024-09-12T12:39:40.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:40 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:40.434+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:38:57.158754+0000 front 2024-09-12T12:38:57.158592+0000 (oldest deadline 2024-09-12T12:39:22.458650+0000) 2024-09-12T12:39:40.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:40 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:40.434+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:07.159961+0000 front 2024-09-12T12:39:07.159887+0000 (oldest deadline 2024-09-12T12:39:35.360197+0000) 2024-09-12T12:39:40.865 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:40 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:40.613+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:40.865 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:40 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:40.613+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:40.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:40 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:40.613+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.081058+0000 front 2024-09-12T12:38:41.081081+0000 (oldest deadline 2024-09-12T12:39:09.881582+0000) 2024-09-12T12:39:40.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:40 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:40.613+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.582724+0000 front 2024-09-12T12:38:51.582755+0000 (oldest deadline 2024-09-12T12:39:13.882885+0000) 2024-09-12T12:39:40.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:40 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:40.613+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.184732+0000 front 2024-09-12T12:39:00.184786+0000 (oldest deadline 2024-09-12T12:39:24.884860+0000) 2024-09-12T12:39:40.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:40 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:40.613+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:06.585936+0000 front 2024-09-12T12:39:06.585972+0000 (oldest deadline 2024-09-12T12:39:34.786684+0000) 2024-09-12T12:39:40.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:40 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:40.613+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-12T12:39:14.787370+0000 front 2024-09-12T12:39:14.787307+0000 (oldest deadline 2024-09-12T12:39:38.887001+0000) 2024-09-12T12:39:41.396 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:40 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:40.950+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:41.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:40 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:40.950+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:41.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:40 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:40.950+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:41.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:40 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:40.950+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.029121+0000 front 2024-09-12T12:39:00.029145+0000 (oldest deadline 2024-09-12T12:39:22.929085+0000) 2024-09-12T12:39:41.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:40 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:40.950+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:08.130452+0000 front 2024-09-12T12:39:08.130472+0000 (oldest deadline 2024-09-12T12:39:34.030540+0000) 2024-09-12T12:39:41.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:41 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:41.421+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:26.154161+0000 front 2024-09-12T12:38:26.154132+0000 (oldest deadline 2024-09-12T12:38:52.054312+0000) 2024-09-12T12:39:41.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:41 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:41.421+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.555667+0000 front 2024-09-12T12:38:35.555771+0000 (oldest deadline 2024-09-12T12:39:01.455583+0000) 2024-09-12T12:39:41.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:41 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:41.421+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.456136+0000 front 2024-09-12T12:38:41.456114+0000 (oldest deadline 2024-09-12T12:39:06.156072+0000) 2024-09-12T12:39:41.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:41 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:41.421+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:47.757549+0000 front 2024-09-12T12:38:47.757496+0000 (oldest deadline 2024-09-12T12:39:17.158071+0000) 2024-09-12T12:39:41.732 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:41 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:41.421+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:38:57.158754+0000 front 2024-09-12T12:38:57.158592+0000 (oldest deadline 2024-09-12T12:39:22.458650+0000) 2024-09-12T12:39:41.732 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:41 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9[65629]: 2024-09-12T12:39:41.421+0000 7f1187bba640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:07.159961+0000 front 2024-09-12T12:39:07.159887+0000 (oldest deadline 2024-09-12T12:39:35.360197+0000) 2024-09-12T12:39:41.865 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:41 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:41.571+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:41.865 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:41 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:41.571+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:41.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:41 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:41.571+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.081058+0000 front 2024-09-12T12:38:41.081081+0000 (oldest deadline 2024-09-12T12:39:09.881582+0000) 2024-09-12T12:39:41.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:41 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:41.571+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.582724+0000 front 2024-09-12T12:38:51.582755+0000 (oldest deadline 2024-09-12T12:39:13.882885+0000) 2024-09-12T12:39:41.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:41 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:41.571+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.184732+0000 front 2024-09-12T12:39:00.184786+0000 (oldest deadline 2024-09-12T12:39:24.884860+0000) 2024-09-12T12:39:41.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:41 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:41.571+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:06.585936+0000 front 2024-09-12T12:39:06.585972+0000 (oldest deadline 2024-09-12T12:39:34.786684+0000) 2024-09-12T12:39:41.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:41 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:41.571+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-12T12:39:14.787370+0000 front 2024-09-12T12:39:14.787307+0000 (oldest deadline 2024-09-12T12:39:38.887001+0000) 2024-09-12T12:39:42.273 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:41 smithi033 podman[108918]: 2024-09-12 12:39:41.994026121 +0000 UTC m=+5.559144581 container died cc7b2e9445d281e54fc26d1591d14ffb58828b2da938b716e4e0fc9f9a5fc8bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-12T12:39:42.396 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:41 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:41.909+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:42.396 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:41 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:41.909+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:42.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:41 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:41.909+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:42.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:41 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:41.909+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.029121+0000 front 2024-09-12T12:39:00.029145+0000 (oldest deadline 2024-09-12T12:39:22.929085+0000) 2024-09-12T12:39:42.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:41 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:41.909+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:08.130452+0000 front 2024-09-12T12:39:08.130472+0000 (oldest deadline 2024-09-12T12:39:34.030540+0000) 2024-09-12T12:39:42.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:42 smithi033 podman[108918]: 2024-09-12 12:39:42.490289604 +0000 UTC m=+6.055408054 container cleanup cc7b2e9445d281e54fc26d1591d14ffb58828b2da938b716e4e0fc9f9a5fc8bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-12T12:39:42.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:42 smithi033 bash[108918]: ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9 2024-09-12T12:39:42.865 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:42 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:42.593+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:42.865 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:42 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:42.593+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:42.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:42 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:42.593+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.081058+0000 front 2024-09-12T12:38:41.081081+0000 (oldest deadline 2024-09-12T12:39:09.881582+0000) 2024-09-12T12:39:42.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:42 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:42.593+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.582724+0000 front 2024-09-12T12:38:51.582755+0000 (oldest deadline 2024-09-12T12:39:13.882885+0000) 2024-09-12T12:39:42.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:42 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:42.593+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.184732+0000 front 2024-09-12T12:39:00.184786+0000 (oldest deadline 2024-09-12T12:39:24.884860+0000) 2024-09-12T12:39:42.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:42 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:42.593+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:06.585936+0000 front 2024-09-12T12:39:06.585972+0000 (oldest deadline 2024-09-12T12:39:34.786684+0000) 2024-09-12T12:39:42.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:42 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:42.593+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-12T12:39:14.787370+0000 front 2024-09-12T12:39:14.787307+0000 (oldest deadline 2024-09-12T12:39:38.887001+0000) 2024-09-12T12:39:43.073 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:42 smithi033 podman[108933]: 2024-09-12 12:39:42.733125382 +0000 UTC m=+0.734753574 container remove cc7b2e9445d281e54fc26d1591d14ffb58828b2da938b716e4e0fc9f9a5fc8bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-12T12:39:43.146 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:42 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:42.874+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:43.146 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:42 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:42.874+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:43.147 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:42 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:42.874+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:43.147 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:42 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:42.874+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.029121+0000 front 2024-09-12T12:39:00.029145+0000 (oldest deadline 2024-09-12T12:39:22.929085+0000) 2024-09-12T12:39:43.147 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:42 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:42.874+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:08.130452+0000 front 2024-09-12T12:39:08.130472+0000 (oldest deadline 2024-09-12T12:39:34.030540+0000) 2024-09-12T12:39:43.386 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:43 smithi033 podman[109022]: 2024-09-12 12:39:42.976793917 +0000 UTC m=+0.016627862 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:39:43.386 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:43 smithi033 podman[109022]: 2024-09-12 12:39:43.083992811 +0000 UTC m=+0.123826785 container create 359ac833b2c4adee4c02552ad1122cb421a85c5717d15042a8ea4881a476ed80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, ceph=True) 2024-09-12T12:39:43.386 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:43 smithi033 podman[109022]: 2024-09-12 12:39:43.311308842 +0000 UTC m=+0.351142776 container init 359ac833b2c4adee4c02552ad1122cb421a85c5717d15042a8ea4881a476ed80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-12T12:39:43.386 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:43 smithi033 podman[109022]: 2024-09-12 12:39:43.314869296 +0000 UTC m=+0.354703228 container start 359ac833b2c4adee4c02552ad1122cb421a85c5717d15042a8ea4881a476ed80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-12T12:39:43.387 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:43 smithi033 podman[109022]: 2024-09-12 12:39:43.386311847 +0000 UTC m=+0.426145791 container attach 359ac833b2c4adee4c02552ad1122cb421a85c5717d15042a8ea4881a476ed80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-12T12:39:43.731 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 12 12:39:43 smithi033 podman[109022]: 2024-09-12 12:39:43.52126336 +0000 UTC m=+0.561097301 container died 359ac833b2c4adee4c02552ad1122cb421a85c5717d15042a8ea4881a476ed80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-9-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:39:43.865 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:43 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:43.569+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:43.865 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:43 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:43.569+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:43.865 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:43 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:43.569+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.081058+0000 front 2024-09-12T12:38:41.081081+0000 (oldest deadline 2024-09-12T12:39:09.881582+0000) 2024-09-12T12:39:43.865 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:43 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:43.569+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.582724+0000 front 2024-09-12T12:38:51.582755+0000 (oldest deadline 2024-09-12T12:39:13.882885+0000) 2024-09-12T12:39:43.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:43 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:43.569+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.184732+0000 front 2024-09-12T12:39:00.184786+0000 (oldest deadline 2024-09-12T12:39:24.884860+0000) 2024-09-12T12:39:43.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:43 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:43.569+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:06.585936+0000 front 2024-09-12T12:39:06.585972+0000 (oldest deadline 2024-09-12T12:39:34.786684+0000) 2024-09-12T12:39:43.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:43 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:43.569+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-12T12:39:14.787370+0000 front 2024-09-12T12:39:14.787307+0000 (oldest deadline 2024-09-12T12:39:38.887001+0000) 2024-09-12T12:39:44.030 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@osd.9.service' 2024-09-12T12:39:44.072 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:39:44.072 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-12T12:39:44.073 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-12T12:39:44.073 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-a66dfafc-7100-11ef-bcea-c7b262605968@osd.10 2024-09-12T12:39:44.365 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:44 smithi043 systemd[1]: Stopping Ceph osd.10 for a66dfafc-7100-11ef-bcea-c7b262605968... 2024-09-12T12:39:44.396 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:43 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:43.910+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:44.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:43 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:43.910+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:44.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:43 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:43.910+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:44.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:43 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:43.910+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.029121+0000 front 2024-09-12T12:39:00.029145+0000 (oldest deadline 2024-09-12T12:39:22.929085+0000) 2024-09-12T12:39:44.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:43 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:43.910+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:08.130452+0000 front 2024-09-12T12:39:08.130472+0000 (oldest deadline 2024-09-12T12:39:34.030540+0000) 2024-09-12T12:39:44.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:43 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:43.910+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-12T12:39:16.931459+0000 front 2024-09-12T12:39:16.931497+0000 (oldest deadline 2024-09-12T12:39:43.332044+0000) 2024-09-12T12:39:44.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:44 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:44.515+0000 7f1a64826640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:39:44.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:44 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:44.515+0000 7f1a64826640 -1 osd.10 93 *** Got signal Terminated *** 2024-09-12T12:39:44.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:44 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:44.515+0000 7f1a64826640 -1 osd.10 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T12:39:44.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:44 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:44.553+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:44.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:44 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:44.553+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:44.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:44 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:44.553+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.081058+0000 front 2024-09-12T12:38:41.081081+0000 (oldest deadline 2024-09-12T12:39:09.881582+0000) 2024-09-12T12:39:44.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:44 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:44.553+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.582724+0000 front 2024-09-12T12:38:51.582755+0000 (oldest deadline 2024-09-12T12:39:13.882885+0000) 2024-09-12T12:39:44.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:44 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:44.553+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.184732+0000 front 2024-09-12T12:39:00.184786+0000 (oldest deadline 2024-09-12T12:39:24.884860+0000) 2024-09-12T12:39:44.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:44 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:44.553+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:06.585936+0000 front 2024-09-12T12:39:06.585972+0000 (oldest deadline 2024-09-12T12:39:34.786684+0000) 2024-09-12T12:39:44.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:44 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:44.553+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-12T12:39:14.787370+0000 front 2024-09-12T12:39:14.787307+0000 (oldest deadline 2024-09-12T12:39:38.887001+0000) 2024-09-12T12:39:45.396 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:44 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:44.923+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:45.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:44 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:44.923+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:45.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:44 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:44.923+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:45.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:44 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:44.923+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.029121+0000 front 2024-09-12T12:39:00.029145+0000 (oldest deadline 2024-09-12T12:39:22.929085+0000) 2024-09-12T12:39:45.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:44 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:44.923+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:08.130452+0000 front 2024-09-12T12:39:08.130472+0000 (oldest deadline 2024-09-12T12:39:34.030540+0000) 2024-09-12T12:39:45.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:44 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:44.923+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-12T12:39:16.931459+0000 front 2024-09-12T12:39:16.931497+0000 (oldest deadline 2024-09-12T12:39:43.332044+0000) 2024-09-12T12:39:45.865 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:45 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:45.590+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:45.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:45 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:45.590+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:45.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:45 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:45.590+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.081058+0000 front 2024-09-12T12:38:41.081081+0000 (oldest deadline 2024-09-12T12:39:09.881582+0000) 2024-09-12T12:39:45.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:45 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:45.590+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.582724+0000 front 2024-09-12T12:38:51.582755+0000 (oldest deadline 2024-09-12T12:39:13.882885+0000) 2024-09-12T12:39:45.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:45 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:45.590+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.184732+0000 front 2024-09-12T12:39:00.184786+0000 (oldest deadline 2024-09-12T12:39:24.884860+0000) 2024-09-12T12:39:45.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:45 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:45.590+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:06.585936+0000 front 2024-09-12T12:39:06.585972+0000 (oldest deadline 2024-09-12T12:39:34.786684+0000) 2024-09-12T12:39:45.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:45 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:45.590+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-12T12:39:14.787370+0000 front 2024-09-12T12:39:14.787307+0000 (oldest deadline 2024-09-12T12:39:38.887001+0000) 2024-09-12T12:39:46.146 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:45 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:45.880+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:46.147 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:45 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:45.880+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:46.147 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:45 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:45.880+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:46.147 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:45 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:45.880+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.029121+0000 front 2024-09-12T12:39:00.029145+0000 (oldest deadline 2024-09-12T12:39:22.929085+0000) 2024-09-12T12:39:46.147 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:45 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:45.880+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:08.130452+0000 front 2024-09-12T12:39:08.130472+0000 (oldest deadline 2024-09-12T12:39:34.030540+0000) 2024-09-12T12:39:46.147 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:45 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:45.880+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-12T12:39:16.931459+0000 front 2024-09-12T12:39:16.931497+0000 (oldest deadline 2024-09-12T12:39:43.332044+0000) 2024-09-12T12:39:46.571 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:46 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:46.569+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:46.571 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:46 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:46.569+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:46.572 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:46 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:46.569+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.081058+0000 front 2024-09-12T12:38:41.081081+0000 (oldest deadline 2024-09-12T12:39:09.881582+0000) 2024-09-12T12:39:46.572 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:46 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:46.569+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.582724+0000 front 2024-09-12T12:38:51.582755+0000 (oldest deadline 2024-09-12T12:39:13.882885+0000) 2024-09-12T12:39:46.572 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:46 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:46.569+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.184732+0000 front 2024-09-12T12:39:00.184786+0000 (oldest deadline 2024-09-12T12:39:24.884860+0000) 2024-09-12T12:39:46.572 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:46 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:46.569+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:06.585936+0000 front 2024-09-12T12:39:06.585972+0000 (oldest deadline 2024-09-12T12:39:34.786684+0000) 2024-09-12T12:39:46.572 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:46 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:46.569+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-12T12:39:14.787370+0000 front 2024-09-12T12:39:14.787307+0000 (oldest deadline 2024-09-12T12:39:38.887001+0000) 2024-09-12T12:39:47.146 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:46 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:46.860+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:47.146 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:46 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:46.860+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:47.147 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:46 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:46.860+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:47.147 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:46 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:46.860+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.029121+0000 front 2024-09-12T12:39:00.029145+0000 (oldest deadline 2024-09-12T12:39:22.929085+0000) 2024-09-12T12:39:47.147 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:46 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:46.860+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:08.130452+0000 front 2024-09-12T12:39:08.130472+0000 (oldest deadline 2024-09-12T12:39:34.030540+0000) 2024-09-12T12:39:47.147 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:46 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:46.860+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-12T12:39:16.931459+0000 front 2024-09-12T12:39:16.931497+0000 (oldest deadline 2024-09-12T12:39:43.332044+0000) 2024-09-12T12:39:47.865 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:47 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:47.570+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:47.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:47 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:47.570+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:47.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:47 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:47.570+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.081058+0000 front 2024-09-12T12:38:41.081081+0000 (oldest deadline 2024-09-12T12:39:09.881582+0000) 2024-09-12T12:39:47.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:47 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:47.570+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.582724+0000 front 2024-09-12T12:38:51.582755+0000 (oldest deadline 2024-09-12T12:39:13.882885+0000) 2024-09-12T12:39:47.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:47 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:47.570+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.184732+0000 front 2024-09-12T12:39:00.184786+0000 (oldest deadline 2024-09-12T12:39:24.884860+0000) 2024-09-12T12:39:47.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:47 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:47.571+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:06.585936+0000 front 2024-09-12T12:39:06.585972+0000 (oldest deadline 2024-09-12T12:39:34.786684+0000) 2024-09-12T12:39:47.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:47 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:47.571+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-12T12:39:14.787370+0000 front 2024-09-12T12:39:14.787307+0000 (oldest deadline 2024-09-12T12:39:38.887001+0000) 2024-09-12T12:39:48.146 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:47 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:47.883+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:48.146 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:47 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:47.883+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:48.146 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:47 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:47.883+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:48.147 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:47 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:47.883+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.029121+0000 front 2024-09-12T12:39:00.029145+0000 (oldest deadline 2024-09-12T12:39:22.929085+0000) 2024-09-12T12:39:48.147 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:47 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:47.883+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:08.130452+0000 front 2024-09-12T12:39:08.130472+0000 (oldest deadline 2024-09-12T12:39:34.030540+0000) 2024-09-12T12:39:48.147 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:47 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:47.883+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-12T12:39:16.931459+0000 front 2024-09-12T12:39:16.931497+0000 (oldest deadline 2024-09-12T12:39:43.332044+0000) 2024-09-12T12:39:48.865 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:48 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:48.524+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:48.865 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:48 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:48.524+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:48.865 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:48 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:48.524+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.081058+0000 front 2024-09-12T12:38:41.081081+0000 (oldest deadline 2024-09-12T12:39:09.881582+0000) 2024-09-12T12:39:48.865 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:48 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:48.524+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.582724+0000 front 2024-09-12T12:38:51.582755+0000 (oldest deadline 2024-09-12T12:39:13.882885+0000) 2024-09-12T12:39:48.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:48 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:48.524+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.184732+0000 front 2024-09-12T12:39:00.184786+0000 (oldest deadline 2024-09-12T12:39:24.884860+0000) 2024-09-12T12:39:48.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:48 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:48.524+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:06.585936+0000 front 2024-09-12T12:39:06.585972+0000 (oldest deadline 2024-09-12T12:39:34.786684+0000) 2024-09-12T12:39:48.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:48 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:48.524+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-12T12:39:14.787370+0000 front 2024-09-12T12:39:14.787307+0000 (oldest deadline 2024-09-12T12:39:38.887001+0000) 2024-09-12T12:39:49.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:48 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:48.909+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:49.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:48 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:48.909+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:49.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:48 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:48.909+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:49.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:48 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:48.909+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.029121+0000 front 2024-09-12T12:39:00.029145+0000 (oldest deadline 2024-09-12T12:39:22.929085+0000) 2024-09-12T12:39:49.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:48 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:48.909+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:08.130452+0000 front 2024-09-12T12:39:08.130472+0000 (oldest deadline 2024-09-12T12:39:34.030540+0000) 2024-09-12T12:39:49.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:48 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:48.909+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-12T12:39:16.931459+0000 front 2024-09-12T12:39:16.931497+0000 (oldest deadline 2024-09-12T12:39:43.332044+0000) 2024-09-12T12:39:49.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:49 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:49.481+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:27.778705+0000 front 2024-09-12T12:38:27.778929+0000 (oldest deadline 2024-09-12T12:38:50.078573+0000) 2024-09-12T12:39:49.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:49 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:49.481+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:35.979271+0000 front 2024-09-12T12:38:35.979375+0000 (oldest deadline 2024-09-12T12:38:57.679429+0000) 2024-09-12T12:39:49.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:49 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:49.481+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:41.081058+0000 front 2024-09-12T12:38:41.081081+0000 (oldest deadline 2024-09-12T12:39:09.881582+0000) 2024-09-12T12:39:49.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:49 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:49.481+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-12T12:38:51.582724+0000 front 2024-09-12T12:38:51.582755+0000 (oldest deadline 2024-09-12T12:39:13.882885+0000) 2024-09-12T12:39:49.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:49 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:49.481+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.184732+0000 front 2024-09-12T12:39:00.184786+0000 (oldest deadline 2024-09-12T12:39:24.884860+0000) 2024-09-12T12:39:49.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:49 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:49.481+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:06.585936+0000 front 2024-09-12T12:39:06.585972+0000 (oldest deadline 2024-09-12T12:39:34.786684+0000) 2024-09-12T12:39:49.866 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:49 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10[58957]: 2024-09-12T12:39:49.481+0000 7f1a60e3c640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-12T12:39:14.787370+0000 front 2024-09-12T12:39:14.787307+0000 (oldest deadline 2024-09-12T12:39:38.887001+0000) 2024-09-12T12:39:50.146 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:49 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:49.878+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:50.146 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:49 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:49.878+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:50.146 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:49 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:49.878+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:50.147 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:49 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:49.878+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.029121+0000 front 2024-09-12T12:39:00.029145+0000 (oldest deadline 2024-09-12T12:39:22.929085+0000) 2024-09-12T12:39:50.147 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:49 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:49.878+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:08.130452+0000 front 2024-09-12T12:39:08.130472+0000 (oldest deadline 2024-09-12T12:39:34.030540+0000) 2024-09-12T12:39:50.147 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:49 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:49.878+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-12T12:39:16.931459+0000 front 2024-09-12T12:39:16.931497+0000 (oldest deadline 2024-09-12T12:39:43.332044+0000) 2024-09-12T12:39:50.364 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:50 smithi043 podman[69728]: 2024-09-12 12:39:50.08227141 +0000 UTC m=+5.797564682 container died c052649645b45f5e68f15ef528aa392a4b9eedcc88af26766ff26e7a836938a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10, ceph=True, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-12T12:39:50.364 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:50 smithi043 podman[69728]: 2024-09-12 12:39:50.364717244 +0000 UTC m=+6.080010503 container cleanup c052649645b45f5e68f15ef528aa392a4b9eedcc88af26766ff26e7a836938a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-b53b6d3, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-12T12:39:50.615 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:50 smithi043 bash[69728]: ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10 2024-09-12T12:39:50.615 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:50 smithi043 podman[69744]: 2024-09-12 12:39:50.582553835 +0000 UTC m=+0.498980119 container remove c052649645b45f5e68f15ef528aa392a4b9eedcc88af26766ff26e7a836938a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-12T12:39:51.147 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:50 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:50.894+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:51.147 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:50 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:50.894+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:51.147 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:50 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:50.894+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:51.147 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:50 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:50.894+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.029121+0000 front 2024-09-12T12:39:00.029145+0000 (oldest deadline 2024-09-12T12:39:22.929085+0000) 2024-09-12T12:39:51.147 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:50 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:50.894+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:08.130452+0000 front 2024-09-12T12:39:08.130472+0000 (oldest deadline 2024-09-12T12:39:34.030540+0000) 2024-09-12T12:39:51.147 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:50 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:50.894+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-12T12:39:16.931459+0000 front 2024-09-12T12:39:16.931497+0000 (oldest deadline 2024-09-12T12:39:43.332044+0000) 2024-09-12T12:39:51.226 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:50 smithi043 podman[69833]: 2024-09-12 12:39:50.899907044 +0000 UTC m=+0.096958679 container create c37273023d97dc64d7966e21bf94fa1517b9852eae9f3f2286928cf1ca8ad718 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0) 2024-09-12T12:39:51.226 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:50 smithi043 podman[69833]: 2024-09-12 12:39:50.818995328 +0000 UTC m=+0.016046970 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:39:51.227 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:51 smithi043 podman[69833]: 2024-09-12 12:39:51.118762649 +0000 UTC m=+0.315814282 container init c37273023d97dc64d7966e21bf94fa1517b9852eae9f3f2286928cf1ca8ad718 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-12T12:39:51.227 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:51 smithi043 podman[69833]: 2024-09-12 12:39:51.122094443 +0000 UTC m=+0.319146076 container start c37273023d97dc64d7966e21bf94fa1517b9852eae9f3f2286928cf1ca8ad718 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10-deactivate, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-12T12:39:51.227 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:51 smithi043 podman[69833]: 2024-09-12 12:39:51.22715929 +0000 UTC m=+0.424210925 container attach c37273023d97dc64d7966e21bf94fa1517b9852eae9f3f2286928cf1ca8ad718 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731) 2024-09-12T12:39:51.613 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:51 smithi043 podman[69833]: 2024-09-12 12:39:51.322464794 +0000 UTC m=+0.519516428 container died c37273023d97dc64d7966e21bf94fa1517b9852eae9f3f2286928cf1ca8ad718 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, ceph=True) 2024-09-12T12:39:51.865 INFO:journalctl@ceph.osd.10.smithi043.stdout:Sep 12 12:39:51 smithi043 podman[69856]: 2024-09-12 12:39:51.855348571 +0000 UTC m=+0.523746831 container remove c37273023d97dc64d7966e21bf94fa1517b9852eae9f3f2286928cf1ca8ad718 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:39:51.884 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@osd.10.service' 2024-09-12T12:39:51.926 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:39:51.927 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-12T12:39:51.927 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-12T12:39:51.927 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-a66dfafc-7100-11ef-bcea-c7b262605968@osd.11 2024-09-12T12:39:52.235 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:51 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:51.944+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:52.235 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:51 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:51.944+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:52.236 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:51 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:51.944+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:52.236 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:51 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:51.944+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.029121+0000 front 2024-09-12T12:39:00.029145+0000 (oldest deadline 2024-09-12T12:39:22.929085+0000) 2024-09-12T12:39:52.236 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:51 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:51.944+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:08.130452+0000 front 2024-09-12T12:39:08.130472+0000 (oldest deadline 2024-09-12T12:39:34.030540+0000) 2024-09-12T12:39:52.236 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:51 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:51.944+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-12T12:39:16.931459+0000 front 2024-09-12T12:39:16.931497+0000 (oldest deadline 2024-09-12T12:39:43.332044+0000) 2024-09-12T12:39:52.236 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:51 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:51.944+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6820 osd.7 since back 2024-09-12T12:39:23.332597+0000 front 2024-09-12T12:39:23.332693+0000 (oldest deadline 2024-09-12T12:39:51.532847+0000) 2024-09-12T12:39:52.236 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:51 smithi102 systemd[1]: Stopping Ceph osd.11 for a66dfafc-7100-11ef-bcea-c7b262605968... 2024-09-12T12:39:52.236 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:52 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:52.234+0000 7fb7082e6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:39:52.236 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:52 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:52.234+0000 7fb7082e6640 -1 osd.11 93 *** Got signal Terminated *** 2024-09-12T12:39:52.236 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:52 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:52.234+0000 7fb7082e6640 -1 osd.11 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T12:39:53.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:52 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:52.972+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:53.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:52 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:52.972+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:53.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:52 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:52.972+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:53.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:52 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:52.972+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.029121+0000 front 2024-09-12T12:39:00.029145+0000 (oldest deadline 2024-09-12T12:39:22.929085+0000) 2024-09-12T12:39:53.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:52 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:52.972+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:08.130452+0000 front 2024-09-12T12:39:08.130472+0000 (oldest deadline 2024-09-12T12:39:34.030540+0000) 2024-09-12T12:39:53.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:52 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:52.972+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-12T12:39:16.931459+0000 front 2024-09-12T12:39:16.931497+0000 (oldest deadline 2024-09-12T12:39:43.332044+0000) 2024-09-12T12:39:53.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:52 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:52.972+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6820 osd.7 since back 2024-09-12T12:39:23.332597+0000 front 2024-09-12T12:39:23.332693+0000 (oldest deadline 2024-09-12T12:39:51.532847+0000) 2024-09-12T12:39:54.396 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:53 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:53.947+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:54.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:53 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:53.947+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:54.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:53 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:53.947+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:54.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:53 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:53.947+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.029121+0000 front 2024-09-12T12:39:00.029145+0000 (oldest deadline 2024-09-12T12:39:22.929085+0000) 2024-09-12T12:39:54.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:53 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:53.947+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:08.130452+0000 front 2024-09-12T12:39:08.130472+0000 (oldest deadline 2024-09-12T12:39:34.030540+0000) 2024-09-12T12:39:54.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:53 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:53.947+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-12T12:39:16.931459+0000 front 2024-09-12T12:39:16.931497+0000 (oldest deadline 2024-09-12T12:39:43.332044+0000) 2024-09-12T12:39:54.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:53 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:53.947+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6820 osd.7 since back 2024-09-12T12:39:23.332597+0000 front 2024-09-12T12:39:23.332693+0000 (oldest deadline 2024-09-12T12:39:51.532847+0000) 2024-09-12T12:39:55.396 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:54 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:54.909+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:55.396 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:54 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:54.909+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:55.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:54 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:54.909+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:55.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:54 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:54.909+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.029121+0000 front 2024-09-12T12:39:00.029145+0000 (oldest deadline 2024-09-12T12:39:22.929085+0000) 2024-09-12T12:39:55.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:54 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:54.909+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:08.130452+0000 front 2024-09-12T12:39:08.130472+0000 (oldest deadline 2024-09-12T12:39:34.030540+0000) 2024-09-12T12:39:55.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:54 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:54.909+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-12T12:39:16.931459+0000 front 2024-09-12T12:39:16.931497+0000 (oldest deadline 2024-09-12T12:39:43.332044+0000) 2024-09-12T12:39:55.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:54 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:54.909+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6820 osd.7 since back 2024-09-12T12:39:23.332597+0000 front 2024-09-12T12:39:23.332693+0000 (oldest deadline 2024-09-12T12:39:51.532847+0000) 2024-09-12T12:39:56.396 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:55 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:55.903+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:56.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:55 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:55.903+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:56.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:55 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:55.903+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:56.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:55 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:55.903+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.029121+0000 front 2024-09-12T12:39:00.029145+0000 (oldest deadline 2024-09-12T12:39:22.929085+0000) 2024-09-12T12:39:56.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:55 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:55.903+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:08.130452+0000 front 2024-09-12T12:39:08.130472+0000 (oldest deadline 2024-09-12T12:39:34.030540+0000) 2024-09-12T12:39:56.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:55 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:55.903+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-12T12:39:16.931459+0000 front 2024-09-12T12:39:16.931497+0000 (oldest deadline 2024-09-12T12:39:43.332044+0000) 2024-09-12T12:39:56.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:55 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:55.903+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6820 osd.7 since back 2024-09-12T12:39:23.332597+0000 front 2024-09-12T12:39:23.332693+0000 (oldest deadline 2024-09-12T12:39:51.532847+0000) 2024-09-12T12:39:57.396 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:56 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:56.923+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-12T12:38:25.524530+0000 front 2024-09-12T12:38:25.524586+0000 (oldest deadline 2024-09-12T12:38:50.824549+0000) 2024-09-12T12:39:57.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:56 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:56.923+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-09-12T12:38:33.125739+0000 front 2024-09-12T12:38:33.125916+0000 (oldest deadline 2024-09-12T12:38:57.825777+0000) 2024-09-12T12:39:57.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:56 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:56.923+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-12T12:38:40.126598+0000 front 2024-09-12T12:38:40.126716+0000 (oldest deadline 2024-09-12T12:39:06.026756+0000) 2024-09-12T12:39:57.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:56 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:56.923+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-09-12T12:39:00.029121+0000 front 2024-09-12T12:39:00.029145+0000 (oldest deadline 2024-09-12T12:39:22.929085+0000) 2024-09-12T12:39:57.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:56 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:56.923+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-12T12:39:08.130452+0000 front 2024-09-12T12:39:08.130472+0000 (oldest deadline 2024-09-12T12:39:34.030540+0000) 2024-09-12T12:39:57.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:56 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:56.923+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-12T12:39:16.931459+0000 front 2024-09-12T12:39:16.931497+0000 (oldest deadline 2024-09-12T12:39:43.332044+0000) 2024-09-12T12:39:57.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:56 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:56.923+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.43:6820 osd.7 since back 2024-09-12T12:39:23.332597+0000 front 2024-09-12T12:39:23.332693+0000 (oldest deadline 2024-09-12T12:39:51.532847+0000) 2024-09-12T12:39:57.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:56 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11[59335]: 2024-09-12T12:39:56.923+0000 7fb7048fc640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.102:6820 osd.8 since back 2024-09-12T12:39:32.633648+0000 front 2024-09-12T12:39:32.633703+0000 (oldest deadline 2024-09-12T12:39:56.733849+0000) 2024-09-12T12:39:58.110 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:57 smithi102 podman[70140]: 2024-09-12 12:39:57.821233727 +0000 UTC m=+5.703588698 container died 4bcbc54994d956f93af6cba36061cf14cff16cc4f40ca069b7c31137af199b90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T12:39:58.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:58 smithi102 podman[70140]: 2024-09-12 12:39:58.209748664 +0000 UTC m=+6.092103637 container cleanup 4bcbc54994d956f93af6cba36061cf14cff16cc4f40ca069b7c31137af199b90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-12T12:39:58.397 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:58 smithi102 bash[70140]: ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11 2024-09-12T12:39:58.805 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:58 smithi102 podman[70155]: 2024-09-12 12:39:58.494598953 +0000 UTC m=+0.665529032 container remove 4bcbc54994d956f93af6cba36061cf14cff16cc4f40ca069b7c31137af199b90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-12T12:39:59.089 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:58 smithi102 podman[70242]: 2024-09-12 12:39:58.705879102 +0000 UTC m=+0.015721384 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:39:59.089 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:58 smithi102 podman[70242]: 2024-09-12 12:39:58.811990357 +0000 UTC m=+0.121832675 container create c0d2479e5990b68a5e7c5f9b0833770ddff029d098e4a5feea3d1eeaaf586bfd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-12T12:39:59.089 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:59 smithi102 podman[70242]: 2024-09-12 12:39:59.039261846 +0000 UTC m=+0.349104123 container init c0d2479e5990b68a5e7c5f9b0833770ddff029d098e4a5feea3d1eeaaf586bfd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11-deactivate, ceph=True, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-12T12:39:59.089 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:59 smithi102 podman[70242]: 2024-09-12 12:39:59.042362754 +0000 UTC m=+0.352205041 container start c0d2479e5990b68a5e7c5f9b0833770ddff029d098e4a5feea3d1eeaaf586bfd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731) 2024-09-12T12:39:59.090 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:59 smithi102 podman[70242]: 2024-09-12 12:39:59.089065205 +0000 UTC m=+0.398907484 container attach c0d2479e5990b68a5e7c5f9b0833770ddff029d098e4a5feea3d1eeaaf586bfd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-12T12:39:59.396 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 12 12:39:59 smithi102 podman[70242]: 2024-09-12 12:39:59.235164625 +0000 UTC m=+0.545006900 container died c0d2479e5990b68a5e7c5f9b0833770ddff029d098e4a5feea3d1eeaaf586bfd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-12T12:39:59.812 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@osd.11.service' 2024-09-12T12:39:59.854 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:39:59.854 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-12T12:39:59.854 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-12T12:39:59.854 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mds.a 2024-09-12T12:40:00.184 INFO:journalctl@ceph.mds.a.smithi033.stdout:Sep 12 12:39:59 smithi033 systemd[1]: Stopping Ceph mds.a for a66dfafc-7100-11ef-bcea-c7b262605968... 2024-09-12T12:40:00.481 INFO:journalctl@ceph.mds.a.smithi033.stdout:Sep 12 12:40:00 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-a[72581]: 2024-09-12T12:40:00.182+0000 7f5e2acb7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:40:00.481 INFO:journalctl@ceph.mds.a.smithi033.stdout:Sep 12 12:40:00 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-a[72581]: 2024-09-12T12:40:00.182+0000 7f5e2acb7640 -1 mds.a *** got signal Terminated *** 2024-09-12T12:40:01.724 INFO:journalctl@ceph.mds.a.smithi033.stdout:Sep 12 12:40:01 smithi033 podman[109140]: 2024-09-12 12:40:01.403895354 +0000 UTC m=+1.340126266 container died 81dda58d444e9b5f08360487b978e90f0448465dcfe9004034139dec4c03246e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-a, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T12:40:01.725 INFO:journalctl@ceph.mds.a.smithi033.stdout:Sep 12 12:40:01 smithi033 podman[109140]: 2024-09-12 12:40:01.725129895 +0000 UTC m=+1.661360731 container cleanup 81dda58d444e9b5f08360487b978e90f0448465dcfe9004034139dec4c03246e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-a, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:40:01.981 INFO:journalctl@ceph.mds.a.smithi033.stdout:Sep 12 12:40:01 smithi033 bash[109140]: ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-a 2024-09-12T12:40:01.981 INFO:journalctl@ceph.mds.a.smithi033.stdout:Sep 12 12:40:01 smithi033 podman[109154]: 2024-09-12 12:40:01.909441306 +0000 UTC m=+0.497928209 container remove 81dda58d444e9b5f08360487b978e90f0448465dcfe9004034139dec4c03246e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-a, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3) 2024-09-12T12:40:02.166 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mds.a.service' 2024-09-12T12:40:02.204 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:40:02.204 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-12T12:40:02.204 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-12T12:40:02.204 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mds.d 2024-09-12T12:40:02.481 INFO:journalctl@ceph.mds.d.smithi033.stdout:Sep 12 12:40:02 smithi033 systemd[1]: Stopping Ceph mds.d for a66dfafc-7100-11ef-bcea-c7b262605968... 2024-09-12T12:40:02.981 INFO:journalctl@ceph.mds.d.smithi033.stdout:Sep 12 12:40:02 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-d[71496]: 2024-09-12T12:40:02.527+0000 7f01da3aa640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:40:02.981 INFO:journalctl@ceph.mds.d.smithi033.stdout:Sep 12 12:40:02 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-d[71496]: 2024-09-12T12:40:02.527+0000 7f01da3aa640 -1 mds.d *** got signal Terminated *** 2024-09-12T12:40:06.731 INFO:journalctl@ceph.mds.d.smithi033.stdout:Sep 12 12:40:06 smithi033 podman[109261]: 2024-09-12 12:40:06.441508509 +0000 UTC m=+4.010743634 container died 81299e4097b5981dcef894b702fcabfcadedfb8b117f6e538f475114b457270a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-d, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-12T12:40:07.154 INFO:journalctl@ceph.mds.d.smithi033.stdout:Sep 12 12:40:06 smithi033 podman[109261]: 2024-09-12 12:40:06.97030522 +0000 UTC m=+4.539540379 container cleanup 81299e4097b5981dcef894b702fcabfcadedfb8b117f6e538f475114b457270a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-d, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-12T12:40:07.155 INFO:journalctl@ceph.mds.d.smithi033.stdout:Sep 12 12:40:06 smithi033 bash[109261]: ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-d 2024-09-12T12:40:07.406 INFO:journalctl@ceph.mds.d.smithi033.stdout:Sep 12 12:40:07 smithi033 podman[109274]: 2024-09-12 12:40:07.155119191 +0000 UTC m=+0.708518716 container remove 81299e4097b5981dcef894b702fcabfcadedfb8b117f6e538f475114b457270a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-d, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-12T12:40:07.410 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mds.d.service' 2024-09-12T12:40:07.446 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:40:07.447 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-12T12:40:07.447 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-12T12:40:07.447 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mds.g 2024-09-12T12:40:07.731 INFO:journalctl@ceph.mds.g.smithi033.stdout:Sep 12 12:40:07 smithi033 systemd[1]: Stopping Ceph mds.g for a66dfafc-7100-11ef-bcea-c7b262605968... 2024-09-12T12:40:08.231 INFO:journalctl@ceph.mds.g.smithi033.stdout:Sep 12 12:40:07 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-g[72272]: 2024-09-12T12:40:07.773+0000 7ff938063640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:40:08.231 INFO:journalctl@ceph.mds.g.smithi033.stdout:Sep 12 12:40:07 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-g[72272]: 2024-09-12T12:40:07.773+0000 7ff938063640 -1 mds.g *** got signal Terminated *** 2024-09-12T12:40:10.731 INFO:journalctl@ceph.mds.g.smithi033.stdout:Sep 12 12:40:10 smithi033 podman[109382]: 2024-09-12 12:40:10.413088106 +0000 UTC m=+2.744116447 container died 5908ad7e8bb75452db9161029c2e412abb2ec0a3d6a5fc7539f1d1dd05a7cbd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-g, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T12:40:11.051 INFO:journalctl@ceph.mds.g.smithi033.stdout:Sep 12 12:40:10 smithi033 podman[109382]: 2024-09-12 12:40:10.799293988 +0000 UTC m=+3.130322372 container cleanup 5908ad7e8bb75452db9161029c2e412abb2ec0a3d6a5fc7539f1d1dd05a7cbd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-g, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-12T12:40:11.051 INFO:journalctl@ceph.mds.g.smithi033.stdout:Sep 12 12:40:10 smithi033 bash[109382]: ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-g 2024-09-12T12:40:11.200 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mds.g.service' 2024-09-12T12:40:11.233 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:40:11.233 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-12T12:40:11.234 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-12T12:40:11.234 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mds.j 2024-09-12T12:40:11.628 INFO:journalctl@ceph.mds.j.smithi033.stdout:Sep 12 12:40:11 smithi033 systemd[1]: Stopping Ceph mds.j for a66dfafc-7100-11ef-bcea-c7b262605968... 2024-09-12T12:40:11.980 INFO:journalctl@ceph.mds.j.smithi033.stdout:Sep 12 12:40:11 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-j[71083]: 2024-09-12T12:40:11.628+0000 7f705821c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:40:11.981 INFO:journalctl@ceph.mds.j.smithi033.stdout:Sep 12 12:40:11 smithi033 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-j[71083]: 2024-09-12T12:40:11.628+0000 7f705821c640 -1 mds.j *** got signal Terminated *** 2024-09-12T12:40:15.637 INFO:journalctl@ceph.mds.j.smithi033.stdout:Sep 12 12:40:15 smithi033 podman[109502]: 2024-09-12 12:40:15.364573075 +0000 UTC m=+3.909135988 container died d5fe62fc2d5727917ae935f49a70653ff57f3255a5a1054b395c5bcd709037ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-j, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True) 2024-09-12T12:40:15.981 INFO:journalctl@ceph.mds.j.smithi033.stdout:Sep 12 12:40:15 smithi033 podman[109502]: 2024-09-12 12:40:15.828566747 +0000 UTC m=+4.373129615 container cleanup d5fe62fc2d5727917ae935f49a70653ff57f3255a5a1054b395c5bcd709037ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-j, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T12:40:15.981 INFO:journalctl@ceph.mds.j.smithi033.stdout:Sep 12 12:40:15 smithi033 bash[109502]: ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-j 2024-09-12T12:40:16.245 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mds.j.service' 2024-09-12T12:40:16.278 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:40:16.278 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-12T12:40:16.278 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-12T12:40:16.278 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mds.b 2024-09-12T12:40:16.572 INFO:journalctl@ceph.mds.b.smithi043.stdout:Sep 12 12:40:16 smithi043 systemd[1]: Stopping Ceph mds.b for a66dfafc-7100-11ef-bcea-c7b262605968... 2024-09-12T12:40:16.846 INFO:journalctl@ceph.mds.b.smithi043.stdout:Sep 12 12:40:16 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-b[64540]: 2024-09-12T12:40:16.571+0000 7f51b2526640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:40:16.846 INFO:journalctl@ceph.mds.b.smithi043.stdout:Sep 12 12:40:16 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-b[64540]: 2024-09-12T12:40:16.571+0000 7f51b2526640 -1 mds.b *** got signal Terminated *** 2024-09-12T12:40:17.997 INFO:journalctl@ceph.mds.b.smithi043.stdout:Sep 12 12:40:17 smithi043 podman[69936]: 2024-09-12 12:40:17.741746368 +0000 UTC m=+1.263625368 container died c860099f1dcc491f3b77b9627ba609d321e11a3131e14060470fc92b3ef71dc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=) 2024-09-12T12:40:18.339 INFO:journalctl@ceph.mds.b.smithi043.stdout:Sep 12 12:40:18 smithi043 podman[69936]: 2024-09-12 12:40:18.088701697 +0000 UTC m=+1.610580698 container cleanup c860099f1dcc491f3b77b9627ba609d321e11a3131e14060470fc92b3ef71dc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-12T12:40:18.339 INFO:journalctl@ceph.mds.b.smithi043.stdout:Sep 12 12:40:18 smithi043 bash[69936]: ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-b 2024-09-12T12:40:18.510 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mds.b.service' 2024-09-12T12:40:18.548 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:40:18.548 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-12T12:40:18.548 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-12T12:40:18.548 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mds.e 2024-09-12T12:40:18.865 INFO:journalctl@ceph.mds.e.smithi043.stdout:Sep 12 12:40:18 smithi043 systemd[1]: Stopping Ceph mds.e for a66dfafc-7100-11ef-bcea-c7b262605968... 2024-09-12T12:40:19.365 INFO:journalctl@ceph.mds.e.smithi043.stdout:Sep 12 12:40:18 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-e[63934]: 2024-09-12T12:40:18.867+0000 7ff3f32c8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:40:19.365 INFO:journalctl@ceph.mds.e.smithi043.stdout:Sep 12 12:40:18 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-e[63934]: 2024-09-12T12:40:18.867+0000 7ff3f32c8640 -1 mds.e *** got signal Terminated *** 2024-09-12T12:40:21.393 INFO:journalctl@ceph.mds.e.smithi043.stdout:Sep 12 12:40:21 smithi043 podman[70070]: 2024-09-12 12:40:21.12484759 +0000 UTC m=+2.354536811 container died 4e4042335ac0b843a2ed94ca99fcc674b93cb967c47733f7046259ea1f2860cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-e, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2) 2024-09-12T12:40:21.651 INFO:journalctl@ceph.mds.e.smithi043.stdout:Sep 12 12:40:21 smithi043 podman[70070]: 2024-09-12 12:40:21.475211075 +0000 UTC m=+2.704900284 container cleanup 4e4042335ac0b843a2ed94ca99fcc674b93cb967c47733f7046259ea1f2860cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-e, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-12T12:40:21.651 INFO:journalctl@ceph.mds.e.smithi043.stdout:Sep 12 12:40:21 smithi043 bash[70070]: ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-e 2024-09-12T12:40:21.901 INFO:journalctl@ceph.mds.e.smithi043.stdout:Sep 12 12:40:21 smithi043 podman[70083]: 2024-09-12 12:40:21.651479536 +0000 UTC m=+0.519464478 container remove 4e4042335ac0b843a2ed94ca99fcc674b93cb967c47733f7046259ea1f2860cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-e, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-12T12:40:21.901 INFO:journalctl@ceph.mds.e.smithi043.stdout:Sep 12 12:40:21 smithi043 systemd[1]: ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mds.e.service: Deactivated successfully. 2024-09-12T12:40:21.904 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mds.e.service' 2024-09-12T12:40:21.938 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:40:21.938 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-12T12:40:21.939 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-12T12:40:21.939 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mds.h 2024-09-12T12:40:22.262 INFO:journalctl@ceph.mds.h.smithi043.stdout:Sep 12 12:40:22 smithi043 systemd[1]: Stopping Ceph mds.h for a66dfafc-7100-11ef-bcea-c7b262605968... 2024-09-12T12:40:22.615 INFO:journalctl@ceph.mds.h.smithi043.stdout:Sep 12 12:40:22 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-h[64237]: 2024-09-12T12:40:22.261+0000 7fdb6e15e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:40:22.615 INFO:journalctl@ceph.mds.h.smithi043.stdout:Sep 12 12:40:22 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-h[64237]: 2024-09-12T12:40:22.261+0000 7fdb6e15e640 -1 mds.h *** got signal Terminated *** 2024-09-12T12:40:26.104 INFO:journalctl@ceph.mds.h.smithi043.stdout:Sep 12 12:40:25 smithi043 podman[70192]: 2024-09-12 12:40:25.741343394 +0000 UTC m=+3.578082630 container died c8566af98aa5b894ffebd483a74929f40accb232a3fcc83859117489250ab20e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-h, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-12T12:40:26.365 INFO:journalctl@ceph.mds.h.smithi043.stdout:Sep 12 12:40:26 smithi043 podman[70192]: 2024-09-12 12:40:26.195236475 +0000 UTC m=+4.031975700 container cleanup c8566af98aa5b894ffebd483a74929f40accb232a3fcc83859117489250ab20e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-h, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True) 2024-09-12T12:40:26.365 INFO:journalctl@ceph.mds.h.smithi043.stdout:Sep 12 12:40:26 smithi043 bash[70192]: ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-h 2024-09-12T12:40:26.626 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mds.h.service' 2024-09-12T12:40:26.649 INFO:journalctl@ceph.mds.h.smithi043.stdout:Sep 12 12:40:26 smithi043 podman[70205]: 2024-09-12 12:40:26.379617408 +0000 UTC m=+0.634238049 container remove c8566af98aa5b894ffebd483a74929f40accb232a3fcc83859117489250ab20e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-12T12:40:26.649 INFO:journalctl@ceph.mds.h.smithi043.stdout:Sep 12 12:40:26 smithi043 systemd[1]: ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mds.h.service: Deactivated successfully. 2024-09-12T12:40:26.649 INFO:journalctl@ceph.mds.h.smithi043.stdout:Sep 12 12:40:26 smithi043 systemd[1]: Stopped Ceph mds.h for a66dfafc-7100-11ef-bcea-c7b262605968. 2024-09-12T12:40:26.649 INFO:journalctl@ceph.mds.h.smithi043.stdout:Sep 12 12:40:26 smithi043 systemd[1]: ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mds.h.service: Consumed 2.064s CPU time. 2024-09-12T12:40:26.661 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:40:26.661 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-12T12:40:26.661 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-12T12:40:26.661 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mds.k 2024-09-12T12:40:26.999 INFO:journalctl@ceph.mds.k.smithi043.stdout:Sep 12 12:40:26 smithi043 systemd[1]: Stopping Ceph mds.k for a66dfafc-7100-11ef-bcea-c7b262605968... 2024-09-12T12:40:27.333 INFO:journalctl@ceph.mds.k.smithi043.stdout:Sep 12 12:40:26 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-k[63615]: 2024-09-12T12:40:26.998+0000 7fab0048c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:40:27.333 INFO:journalctl@ceph.mds.k.smithi043.stdout:Sep 12 12:40:26 smithi043 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-k[63615]: 2024-09-12T12:40:26.998+0000 7fab0048c640 -1 mds.k *** got signal Terminated *** 2024-09-12T12:40:28.600 INFO:journalctl@ceph.mds.k.smithi043.stdout:Sep 12 12:40:28 smithi043 podman[70313]: 2024-09-12 12:40:28.342772327 +0000 UTC m=+1.459125699 container died 10eabded262488cece1bcd1460fc9d96b75f749f1bdfce1f02a6047b2f8ddbc6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-k, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-12T12:40:28.851 INFO:journalctl@ceph.mds.k.smithi043.stdout:Sep 12 12:40:28 smithi043 podman[70313]: 2024-09-12 12:40:28.682408709 +0000 UTC m=+1.798762083 container cleanup 10eabded262488cece1bcd1460fc9d96b75f749f1bdfce1f02a6047b2f8ddbc6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-k, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-b53b6d3, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-12T12:40:28.851 INFO:journalctl@ceph.mds.k.smithi043.stdout:Sep 12 12:40:28 smithi043 bash[70313]: ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-k 2024-09-12T12:40:28.851 INFO:journalctl@ceph.mds.k.smithi043.stdout:Sep 12 12:40:28 smithi043 podman[70326]: 2024-09-12 12:40:28.850023452 +0000 UTC m=+0.500213892 container remove 10eabded262488cece1bcd1460fc9d96b75f749f1bdfce1f02a6047b2f8ddbc6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-k, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-12T12:40:29.101 INFO:journalctl@ceph.mds.k.smithi043.stdout:Sep 12 12:40:29 smithi043 systemd[1]: ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mds.k.service: Deactivated successfully. 2024-09-12T12:40:29.101 INFO:journalctl@ceph.mds.k.smithi043.stdout:Sep 12 12:40:29 smithi043 systemd[1]: Stopped Ceph mds.k for a66dfafc-7100-11ef-bcea-c7b262605968. 2024-09-12T12:40:29.103 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mds.k.service' 2024-09-12T12:40:29.137 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:40:29.137 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-12T12:40:29.137 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-12T12:40:29.138 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mds.c 2024-09-12T12:40:29.443 INFO:journalctl@ceph.mds.c.smithi102.stdout:Sep 12 12:40:29 smithi102 systemd[1]: Stopping Ceph mds.c for a66dfafc-7100-11ef-bcea-c7b262605968... 2024-09-12T12:40:29.703 INFO:journalctl@ceph.mds.c.smithi102.stdout:Sep 12 12:40:29 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-c[64549]: 2024-09-12T12:40:29.442+0000 7f9db1ade640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:40:29.703 INFO:journalctl@ceph.mds.c.smithi102.stdout:Sep 12 12:40:29 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-c[64549]: 2024-09-12T12:40:29.442+0000 7f9db1ade640 -1 mds.c *** got signal Terminated *** 2024-09-12T12:40:33.776 INFO:journalctl@ceph.mds.c.smithi102.stdout:Sep 12 12:40:33 smithi102 podman[70345]: 2024-09-12 12:40:33.448342688 +0000 UTC m=+4.115708893 container died 8b36d0a05f75c46f23706177ecbb61d7dfb8ca16fef06f21254645e0a865237f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-c, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-12T12:40:34.101 INFO:journalctl@ceph.mds.c.smithi102.stdout:Sep 12 12:40:33 smithi102 podman[70345]: 2024-09-12 12:40:33.867404515 +0000 UTC m=+4.534770715 container cleanup 8b36d0a05f75c46f23706177ecbb61d7dfb8ca16fef06f21254645e0a865237f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-c, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-12T12:40:34.102 INFO:journalctl@ceph.mds.c.smithi102.stdout:Sep 12 12:40:33 smithi102 bash[70345]: ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-c 2024-09-12T12:40:34.342 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mds.c.service' 2024-09-12T12:40:34.365 INFO:journalctl@ceph.mds.c.smithi102.stdout:Sep 12 12:40:34 smithi102 podman[70369]: 2024-09-12 12:40:34.102244136 +0000 UTC m=+0.646611959 container remove 8b36d0a05f75c46f23706177ecbb61d7dfb8ca16fef06f21254645e0a865237f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-c, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-12T12:40:34.365 INFO:journalctl@ceph.mds.c.smithi102.stdout:Sep 12 12:40:34 smithi102 systemd[1]: ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mds.c.service: Deactivated successfully. 2024-09-12T12:40:34.365 INFO:journalctl@ceph.mds.c.smithi102.stdout:Sep 12 12:40:34 smithi102 systemd[1]: Stopped Ceph mds.c for a66dfafc-7100-11ef-bcea-c7b262605968. 2024-09-12T12:40:34.365 INFO:journalctl@ceph.mds.c.smithi102.stdout:Sep 12 12:40:34 smithi102 systemd[1]: ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mds.c.service: Consumed 1.871s CPU time. 2024-09-12T12:40:34.379 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:40:34.379 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-12T12:40:34.379 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-12T12:40:34.380 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mds.f 2024-09-12T12:40:34.646 INFO:journalctl@ceph.mds.f.smithi102.stdout:Sep 12 12:40:34 smithi102 systemd[1]: Stopping Ceph mds.f for a66dfafc-7100-11ef-bcea-c7b262605968... 2024-09-12T12:40:35.146 INFO:journalctl@ceph.mds.f.smithi102.stdout:Sep 12 12:40:34 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-f[64249]: 2024-09-12T12:40:34.712+0000 7f6c5367c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:40:35.146 INFO:journalctl@ceph.mds.f.smithi102.stdout:Sep 12 12:40:34 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-f[64249]: 2024-09-12T12:40:34.712+0000 7f6c5367c640 -1 mds.f *** got signal Terminated *** 2024-09-12T12:40:37.996 INFO:journalctl@ceph.mds.f.smithi102.stdout:Sep 12 12:40:37 smithi102 podman[70480]: 2024-09-12 12:40:37.745952354 +0000 UTC m=+3.148774941 container died eea3bb9da805cd817fc39fe371265e3fb80af030950c8b38835867baf56bf6c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-f, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-12T12:40:38.280 INFO:journalctl@ceph.mds.f.smithi102.stdout:Sep 12 12:40:38 smithi102 podman[70480]: 2024-09-12 12:40:38.063182241 +0000 UTC m=+3.466004863 container cleanup eea3bb9da805cd817fc39fe371265e3fb80af030950c8b38835867baf56bf6c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-f, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-12T12:40:38.280 INFO:journalctl@ceph.mds.f.smithi102.stdout:Sep 12 12:40:38 smithi102 bash[70480]: ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-f 2024-09-12T12:40:38.501 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mds.f.service' 2024-09-12T12:40:38.534 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:40:38.534 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-12T12:40:38.534 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-12T12:40:38.534 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mds.i 2024-09-12T12:40:38.841 INFO:journalctl@ceph.mds.i.smithi102.stdout:Sep 12 12:40:38 smithi102 systemd[1]: Stopping Ceph mds.i for a66dfafc-7100-11ef-bcea-c7b262605968... 2024-09-12T12:40:39.146 INFO:journalctl@ceph.mds.i.smithi102.stdout:Sep 12 12:40:38 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-i[64853]: 2024-09-12T12:40:38.840+0000 7f8178117640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:40:39.146 INFO:journalctl@ceph.mds.i.smithi102.stdout:Sep 12 12:40:38 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-i[64853]: 2024-09-12T12:40:38.840+0000 7f8178117640 -1 mds.i *** got signal Terminated *** 2024-09-12T12:40:42.010 INFO:journalctl@ceph.mds.i.smithi102.stdout:Sep 12 12:40:41 smithi102 podman[70598]: 2024-09-12 12:40:41.747282554 +0000 UTC m=+2.999044626 container died fbb800153a71a9acf887c0f9a6a1dbd2de26c88e1cb7961d5877668a6ba9e454 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-i, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-12T12:40:42.375 INFO:journalctl@ceph.mds.i.smithi102.stdout:Sep 12 12:40:42 smithi102 podman[70598]: 2024-09-12 12:40:42.108249247 +0000 UTC m=+3.360011319 container cleanup fbb800153a71a9acf887c0f9a6a1dbd2de26c88e1cb7961d5877668a6ba9e454 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-i, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-12T12:40:42.376 INFO:journalctl@ceph.mds.i.smithi102.stdout:Sep 12 12:40:42 smithi102 bash[70598]: ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-i 2024-09-12T12:40:42.555 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mds.i.service' 2024-09-12T12:40:42.588 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:40:42.588 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-12T12:40:42.588 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-12T12:40:42.589 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mds.l 2024-09-12T12:40:42.903 INFO:journalctl@ceph.mds.l.smithi102.stdout:Sep 12 12:40:42 smithi102 systemd[1]: Stopping Ceph mds.l for a66dfafc-7100-11ef-bcea-c7b262605968... 2024-09-12T12:40:43.396 INFO:journalctl@ceph.mds.l.smithi102.stdout:Sep 12 12:40:42 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-l[63946]: 2024-09-12T12:40:42.903+0000 7fd057069640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:40:43.396 INFO:journalctl@ceph.mds.l.smithi102.stdout:Sep 12 12:40:42 smithi102 ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-l[63946]: 2024-09-12T12:40:42.903+0000 7fd057069640 -1 mds.l *** got signal Terminated *** 2024-09-12T12:40:46.020 INFO:journalctl@ceph.mds.l.smithi102.stdout:Sep 12 12:40:45 smithi102 podman[70719]: 2024-09-12 12:40:45.74043406 +0000 UTC m=+2.935877424 container died 2f116b64dca27020c945d3d148f8a3b26dcb353b6dd44c1a0ba160e9634e1d77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-l, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2) 2024-09-12T12:40:46.387 INFO:journalctl@ceph.mds.l.smithi102.stdout:Sep 12 12:40:46 smithi102 podman[70719]: 2024-09-12 12:40:46.120149952 +0000 UTC m=+3.315593304 container cleanup 2f116b64dca27020c945d3d148f8a3b26dcb353b6dd44c1a0ba160e9634e1d77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-l, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-12T12:40:46.388 INFO:journalctl@ceph.mds.l.smithi102.stdout:Sep 12 12:40:46 smithi102 bash[70719]: ceph-a66dfafc-7100-11ef-bcea-c7b262605968-mds-l 2024-09-12T12:40:46.507 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a66dfafc-7100-11ef-bcea-c7b262605968@mds.l.service' 2024-09-12T12:40:46.541 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:40:46.542 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-12T12:40:46.542 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a66dfafc-7100-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T12:40:46.754 INFO:teuthology.orchestra.run.smithi033.stdout:Deleting cluster with fsid: a66dfafc-7100-11ef-bcea-c7b262605968 2024-09-12T12:40:49.463 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a66dfafc-7100-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T12:40:49.674 INFO:teuthology.orchestra.run.smithi043.stdout:Deleting cluster with fsid: a66dfafc-7100-11ef-bcea-c7b262605968 2024-09-12T12:40:52.340 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a66dfafc-7100-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T12:40:52.539 INFO:teuthology.orchestra.run.smithi102.stdout:Deleting cluster with fsid: a66dfafc-7100-11ef-bcea-c7b262605968 2024-09-12T12:40:54.935 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T12:40:54.970 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T12:40:55.005 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T12:40:55.032 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-12T12:40:55.034 DEBUG:teuthology.misc:Transferring archived files from smithi033:/var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901717/remote/smithi033/crash 2024-09-12T12:40:55.034 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar c -f - -C /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/crash -- . 2024-09-12T12:40:55.077 INFO:teuthology.orchestra.run.smithi033.stderr:tar: /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T12:40:55.077 INFO:teuthology.orchestra.run.smithi033.stderr:tar: Error is not recoverable: exiting now 2024-09-12T12:40:55.078 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901717/remote/smithi043/crash 2024-09-12T12:40:55.079 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar c -f - -C /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/crash -- . 2024-09-12T12:40:55.127 INFO:teuthology.orchestra.run.smithi043.stderr:tar: /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T12:40:55.127 INFO:teuthology.orchestra.run.smithi043.stderr:tar: Error is not recoverable: exiting now 2024-09-12T12:40:55.129 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901717/remote/smithi102/crash 2024-09-12T12:40:55.130 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/crash -- . 2024-09-12T12:40:55.170 INFO:teuthology.orchestra.run.smithi102.stderr:tar: /var/lib/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T12:40:55.170 INFO:teuthology.orchestra.run.smithi102.stderr:tar: Error is not recoverable: exiting now 2024-09-12T12:40:55.171 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-12T12:40:55.171 DEBUG:teuthology.orchestra.run.smithi033:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-12T12:40:55.277 INFO:tasks.cephadm:Compressing logs... 2024-09-12T12:40:55.277 DEBUG:teuthology.orchestra.run.smithi033:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T12:40:55.280 DEBUG:teuthology.orchestra.run.smithi043:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T12:40:55.282 DEBUG:teuthology.orchestra.run.smithi102:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T12:40:55.311 INFO:teuthology.orchestra.run.smithi102.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T12:40:55.311 INFO:teuthology.orchestra.run.smithi102.stderr:: No such file or directory 2024-09-12T12:40:55.311 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T12:40:55.311 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mds.i.log/var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-volume.log: 2024-09-12T12:40:55.311 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mon.c.log 2024-09-12T12:40:55.311 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T12:40:55.311 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-osd.11.log 2024-09-12T12:40:55.311 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-12T12:40:55.311 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-12T12:40:55.311 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph.log 2024-09-12T12:40:55.312 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mds.l.log 2024-09-12T12:40:55.312 INFO:teuthology.orchestra.run.smithi102.stderr:gzip/var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph.log: -5 --verbose -- /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-osd.8.log 2024-09-12T12:40:55.312 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mgr.z.log 2024-09-12T12:40:55.312 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mds.c.log 2024-09-12T12:40:55.312 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mds.f.log 2024-09-12T12:40:55.312 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T12:40:55.320 INFO:teuthology.orchestra.run.smithi043.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-osd.10.log 2024-09-12T12:40:55.320 INFO:teuthology.orchestra.run.smithi043.stderr:: No such file or directory 2024-09-12T12:40:55.321 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-12T12:40:55.321 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-osd.7.log 2024-09-12T12:40:55.321 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-osd.10.log: /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T12:40:55.321 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mds.b.log 2024-09-12T12:40:55.321 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mds.k.log 2024-09-12T12:40:55.321 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-12T12:40:55.321 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T12:40:55.321 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mds.k.log: /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T12:40:55.321 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mgr.y.log 2024-09-12T12:40:55.321 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph.log 2024-09-12T12:40:55.321 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mds.h.log 2024-09-12T12:40:55.321 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mon.b.log 2024-09-12T12:40:55.322 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mds.e.log 2024-09-12T12:40:55.322 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mds.h.log: /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T12:40:55.322 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 94.5% -- replaced with /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mds.k.log.gz 2024-09-12T12:40:55.322 INFO:teuthology.orchestra.run.smithi043.stderr: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T12:40:55.322 INFO:teuthology.orchestra.run.smithi043.stderr: 94.6% -- replaced with /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mds.e.log.gz 2024-09-12T12:40:55.322 INFO:teuthology.orchestra.run.smithi043.stderr: 92.8% -- replaced with /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mgr.y.log.gz 2024-09-12T12:40:55.323 INFO:teuthology.orchestra.run.smithi033.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-12T12:40:55.323 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-09-12T12:40:55.323 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-12T12:40:55.323 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-osd.9.log 2024-09-12T12:40:55.323 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T12:40:55.323 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T12:40:55.324 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mds.a.log 2024-09-12T12:40:55.324 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T12:40:55.324 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mon.a.log 2024-09-12T12:40:55.324 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mds.g.log 2024-09-12T12:40:55.324 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-osd.6.log 2024-09-12T12:40:55.324 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph.log 2024-09-12T12:40:55.324 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mds.d.log 2024-09-12T12:40:55.324 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mgr.x.log 2024-09-12T12:40:55.324 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mds.j.log 2024-09-12T12:40:55.324 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-osd.3.log 2024-09-12T12:40:55.324 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mds.j.log: /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-09-12T12:40:55.324 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T12:40:55.324 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.log: 94.6% -- replaced with /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mds.a.log.gz 2024-09-12T12:40:55.324 INFO:teuthology.orchestra.run.smithi033.stderr: 86.8% -- replaced with /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T12:40:55.325 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/cephadm.log: 94.7% -- replaced with /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mds.g.log.gz 2024-09-12T12:40:55.325 INFO:teuthology.orchestra.run.smithi033.stderr: 94.5% -- replaced with /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mds.d.log.gz 2024-09-12T12:40:55.325 INFO:teuthology.orchestra.run.smithi033.stderr: 94.6% -- replaced with /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mds.j.log.gz 2024-09-12T12:40:55.325 INFO:teuthology.orchestra.run.smithi033.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-09-12T12:40:55.337 INFO:teuthology.orchestra.run.smithi043.stderr: 82.8% -- replaced with /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T12:40:55.349 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 93.0% -- replaced with /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mds.f.log.gz 2024-09-12T12:40:55.374 INFO:teuthology.orchestra.run.smithi102.stderr: 93.0% -- replaced with /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mgr.z.log.gz 2024-09-12T12:40:55.382 INFO:teuthology.orchestra.run.smithi043.stderr: 86.8% 90.4% -- replaced with /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph.log.gz -- replaced with /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T12:40:55.382 INFO:teuthology.orchestra.run.smithi043.stderr: 2024-09-12T12:40:55.383 INFO:teuthology.orchestra.run.smithi102.stderr: 82.7% -- replaced with /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T12:40:55.384 INFO:teuthology.orchestra.run.smithi102.stderr: 86.8% -- replaced with /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T12:40:55.397 INFO:teuthology.orchestra.run.smithi043.stderr: 94.3% -- replaced with /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mds.h.log.gz 2024-09-12T12:40:55.406 INFO:teuthology.orchestra.run.smithi102.stderr: 90.4% -- replaced with /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T12:40:55.440 INFO:teuthology.orchestra.run.smithi043.stderr: 90.8% -- replaced with /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T12:40:55.454 INFO:teuthology.orchestra.run.smithi033.stderr: 91.1% -- replaced with /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T12:40:55.467 INFO:teuthology.orchestra.run.smithi033.stderr: 90.3% -- replaced with /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T12:40:55.503 INFO:teuthology.orchestra.run.smithi043.stderr: 93.7% -- replaced with /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mds.b.log.gz 2024-09-12T12:40:55.509 INFO:teuthology.orchestra.run.smithi102.stderr: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T12:40:55.560 INFO:teuthology.orchestra.run.smithi033.stderr: 82.7% -- replaced with /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T12:40:55.561 INFO:teuthology.orchestra.run.smithi102.stderr: 91.0% -- replaced with /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T12:40:55.562 INFO:teuthology.orchestra.run.smithi102.stderr: 94.5% -- replaced with /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mds.l.log.gz 2024-09-12T12:40:55.729 INFO:teuthology.orchestra.run.smithi043.stderr: 91.8% -- replaced with /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mon.b.log.gz 2024-09-12T12:40:55.822 INFO:teuthology.orchestra.run.smithi102.stderr: 92.5% -- replaced with /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mds.c.log.gz 2024-09-12T12:40:55.913 INFO:teuthology.orchestra.run.smithi033.stderr: 94.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T12:40:55.972 INFO:teuthology.orchestra.run.smithi102.stderr: 92.9% -- replaced with /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mds.i.log.gz 2024-09-12T12:40:55.984 INFO:teuthology.orchestra.run.smithi102.stderr: 91.8% -- replaced with /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mon.c.log.gz 2024-09-12T12:40:56.671 INFO:teuthology.orchestra.run.smithi033.stderr: 90.3% -- replaced with /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mgr.x.log.gz 2024-09-12T12:41:09.031 INFO:teuthology.orchestra.run.smithi033.stderr: 90.3% -- replaced with /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-mon.a.log.gz 2024-09-12T12:41:28.773 INFO:teuthology.orchestra.run.smithi043.stderr: 91.1% -- replaced with /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-osd.10.log.gz 2024-09-12T12:41:32.549 INFO:teuthology.orchestra.run.smithi102.stderr: 90.7% -- replaced with /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-osd.8.log.gz 2024-09-12T12:41:53.122 INFO:teuthology.orchestra.run.smithi102.stderr: 90.6% -- replaced with /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-osd.11.log.gz 2024-09-12T12:41:53.430 INFO:teuthology.orchestra.run.smithi043.stderr: 90.6% -- replaced with /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-12T12:42:00.803 INFO:teuthology.orchestra.run.smithi043.stderr: 90.6% -- replaced with /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-osd.7.log.gz 2024-09-12T12:42:03.548 INFO:teuthology.orchestra.run.smithi102.stderr: 90.6% -- replaced with /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-12T12:42:22.979 INFO:teuthology.orchestra.run.smithi043.stderr: 90.7% -- replaced with /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-12T12:42:22.981 INFO:teuthology.orchestra.run.smithi043.stderr: 2024-09-12T12:42:22.981 INFO:teuthology.orchestra.run.smithi043.stderr:real 1m27.683s 2024-09-12T12:42:22.981 INFO:teuthology.orchestra.run.smithi043.stderr:user 3m50.511s 2024-09-12T12:42:22.981 INFO:teuthology.orchestra.run.smithi043.stderr:sys 0m6.624s 2024-09-12T12:42:29.959 INFO:teuthology.orchestra.run.smithi102.stderr: 90.5% -- replaced with /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-12T12:42:29.961 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-09-12T12:42:29.961 INFO:teuthology.orchestra.run.smithi102.stderr:real 1m34.664s 2024-09-12T12:42:29.961 INFO:teuthology.orchestra.run.smithi102.stderr:user 3m52.895s 2024-09-12T12:42:29.961 INFO:teuthology.orchestra.run.smithi102.stderr:sys 0m7.201s 2024-09-12T12:45:43.444 INFO:teuthology.orchestra.run.smithi033.stderr: 90.4% -- replaced with /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-12T12:46:11.325 INFO:teuthology.orchestra.run.smithi033.stderr: 90.4% -- replaced with /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-12T12:49:48.421 INFO:teuthology.orchestra.run.smithi033.stderr: 90.4% -- replaced with /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-osd.6.log.gz 2024-09-12T12:50:39.023 INFO:teuthology.orchestra.run.smithi033.stderr: 90.4% -- replaced with /var/log/ceph/a66dfafc-7100-11ef-bcea-c7b262605968/ceph-osd.9.log.gz 2024-09-12T12:51:12.314 INFO:teuthology.orchestra.run.smithi033.stderr: 94.6% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-12T12:51:12.317 INFO:teuthology.orchestra.run.smithi033.stderr: 2024-09-12T12:51:12.317 INFO:teuthology.orchestra.run.smithi033.stderr:real 10m17.022s 2024-09-12T12:51:12.317 INFO:teuthology.orchestra.run.smithi033.stderr:user 6m22.844s 2024-09-12T12:51:12.317 INFO:teuthology.orchestra.run.smithi033.stderr:sys 0m15.053s 2024-09-12T12:51:12.317 INFO:tasks.cephadm:Archiving logs... 2024-09-12T12:51:12.318 DEBUG:teuthology.misc:Transferring archived files from smithi033:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901717/remote/smithi033/log 2024-09-12T12:51:12.536 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T12:52:14.450 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901717/remote/smithi043/log 2024-09-12T12:52:14.451 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T12:52:57.027 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901717/remote/smithi102/log 2024-09-12T12:52:57.028 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T12:53:40.807 INFO:tasks.cephadm:Removing cluster... 2024-09-12T12:53:40.807 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a66dfafc-7100-11ef-bcea-c7b262605968 --force 2024-09-12T12:53:41.023 INFO:teuthology.orchestra.run.smithi033.stdout:Deleting cluster with fsid: a66dfafc-7100-11ef-bcea-c7b262605968 2024-09-12T12:53:41.658 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a66dfafc-7100-11ef-bcea-c7b262605968 --force 2024-09-12T12:53:41.871 INFO:teuthology.orchestra.run.smithi043.stdout:Deleting cluster with fsid: a66dfafc-7100-11ef-bcea-c7b262605968 2024-09-12T12:53:42.508 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a66dfafc-7100-11ef-bcea-c7b262605968 --force 2024-09-12T12:53:42.713 INFO:teuthology.orchestra.run.smithi102.stdout:Deleting cluster with fsid: a66dfafc-7100-11ef-bcea-c7b262605968 2024-09-12T12:53:43.371 INFO:tasks.cephadm:Removing cephadm ... 2024-09-12T12:53:43.371 DEBUG:teuthology.orchestra.run.smithi033:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T12:53:43.391 DEBUG:teuthology.orchestra.run.smithi043:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T12:53:43.408 DEBUG:teuthology.orchestra.run.smithi102:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T12:53:43.424 INFO:tasks.cephadm:Teardown complete 2024-09-12T12:53:43.424 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T12:53:43.442 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T12:53:43.443 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T12:53:43.445 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T12:53:43.450 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T12:53:43.569 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T12:53:43.580 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T12:53:43.580 DEBUG:teuthology.orchestra.run.smithi033:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T12:53:43.583 DEBUG:teuthology.orchestra.run.smithi043:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T12:53:43.585 DEBUG:teuthology.orchestra.run.smithi102:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T12:53:43.597 INFO:teuthology.orchestra.run.smithi043.stderr:bash: line 1: ntpq: command not found 2024-09-12T12:53:43.599 INFO:teuthology.orchestra.run.smithi033.stderr:bash: line 1: ntpq: command not found 2024-09-12T12:53:43.599 INFO:teuthology.orchestra.run.smithi102.stderr:bash: line 1: ntpq: command not found 2024-09-12T12:53:43.601 INFO:teuthology.orchestra.run.smithi043.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T12:53:43.601 INFO:teuthology.orchestra.run.smithi043.stdout:=============================================================================== 2024-09-12T12:53:43.601 INFO:teuthology.orchestra.run.smithi043.stdout:^* hv01.front.sepia.ceph.com 3 6 377 26 -1431us[-1419us] +/- 67ms 2024-09-12T12:53:43.601 INFO:teuthology.orchestra.run.smithi043.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 29 +927us[ +938us] +/- 77ms 2024-09-12T12:53:43.601 INFO:teuthology.orchestra.run.smithi043.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 31 +748us[ +760us] +/- 79ms 2024-09-12T12:53:43.601 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T12:53:43.603 INFO:teuthology.orchestra.run.smithi033.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T12:53:43.603 INFO:teuthology.orchestra.run.smithi033.stdout:=============================================================================== 2024-09-12T12:53:43.603 INFO:teuthology.orchestra.run.smithi033.stdout:^* hv01.front.sepia.ceph.com 3 6 377 33 -1416us[-1413us] +/- 67ms 2024-09-12T12:53:43.603 INFO:teuthology.orchestra.run.smithi033.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 29 +920us[ +920us] +/- 77ms 2024-09-12T12:53:43.604 INFO:teuthology.orchestra.run.smithi033.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 27 +755us[ +755us] +/- 79ms 2024-09-12T12:53:43.604 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T12:53:43.618 INFO:teuthology.orchestra.run.smithi102.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T12:53:43.618 INFO:teuthology.orchestra.run.smithi102.stdout:=============================================================================== 2024-09-12T12:53:43.618 INFO:teuthology.orchestra.run.smithi102.stdout:^* hv01.front.sepia.ceph.com 3 6 377 30 -1418us[-1408us] +/- 67ms 2024-09-12T12:53:43.619 INFO:teuthology.orchestra.run.smithi102.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 31 +911us[ +921us] +/- 77ms 2024-09-12T12:53:43.619 INFO:teuthology.orchestra.run.smithi102.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 31 +748us[ +757us] +/- 79ms 2024-09-12T12:53:43.619 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T12:53:43.620 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T12:53:43.629 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T12:53:43.630 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T12:53:43.644 DEBUG:teuthology.orchestra.run.smithi033:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T12:53:43.772 DEBUG:teuthology.orchestra.run.smithi043:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T12:53:43.842 DEBUG:teuthology.orchestra.run.smithi102:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T12:53:43.950 DEBUG:teuthology.orchestra.run.smithi033:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T12:53:43.982 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:53:43.983 DEBUG:teuthology.orchestra.run.smithi043:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T12:53:44.011 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:53:44.012 DEBUG:teuthology.orchestra.run.smithi102:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T12:53:44.039 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:53:44.040 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T12:53:44.050 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T12:53:44.061 INFO:teuthology.task.internal:Duration was 2672.625820 seconds 2024-09-12T12:53:44.061 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T12:53:44.072 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T12:53:44.072 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T12:53:44.075 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T12:53:44.078 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T12:53:44.116 INFO:teuthology.orchestra.run.smithi043.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T12:53:44.129 INFO:teuthology.orchestra.run.smithi102.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T12:53:44.143 INFO:teuthology.orchestra.run.smithi033.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T12:53:44.546 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T12:53:44.547 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi033.front.sepia.ceph.com 2024-09-12T12:53:44.547 DEBUG:teuthology.orchestra.run.smithi033:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T12:53:44.573 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi043.front.sepia.ceph.com 2024-09-12T12:53:44.573 DEBUG:teuthology.orchestra.run.smithi043:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T12:53:44.598 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi102.front.sepia.ceph.com 2024-09-12T12:53:44.598 DEBUG:teuthology.orchestra.run.smithi102:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T12:53:44.629 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T12:53:44.629 DEBUG:teuthology.orchestra.run.smithi033:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T12:53:44.632 DEBUG:teuthology.orchestra.run.smithi043:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T12:53:44.641 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T12:53:44.697 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T12:53:44.698 DEBUG:teuthology.orchestra.run.smithi033:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T12:53:44.705 DEBUG:teuthology.orchestra.run.smithi043:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T12:53:44.709 DEBUG:teuthology.orchestra.run.smithi102:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T12:53:45.617 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T12:53:45.760 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T12:53:45.761 DEBUG:teuthology.orchestra.run.smithi033:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T12:53:45.801 DEBUG:teuthology.orchestra.run.smithi043:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T12:53:45.832 DEBUG:teuthology.orchestra.run.smithi102:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T12:53:45.862 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T12:53:45.872 DEBUG:teuthology.orchestra.run.smithi033:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T12:53:45.875 DEBUG:teuthology.orchestra.run.smithi043:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T12:53:45.878 DEBUG:teuthology.orchestra.run.smithi102:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T12:53:45.900 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern = core 2024-09-12T12:53:45.903 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern = core 2024-09-12T12:53:45.928 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = core 2024-09-12T12:53:46.013 DEBUG:teuthology.orchestra.run.smithi033:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T12:53:46.028 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:53:46.029 DEBUG:teuthology.orchestra.run.smithi043:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T12:53:46.045 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:53:46.046 DEBUG:teuthology.orchestra.run.smithi102:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T12:53:46.069 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:53:46.070 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T12:53:46.081 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T12:53:46.082 DEBUG:teuthology.misc:Transferring archived files from smithi033:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901717/remote/smithi033 2024-09-12T12:53:46.083 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T12:53:46.141 DEBUG:teuthology.misc:Transferring archived files from smithi043:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901717/remote/smithi043 2024-09-12T12:53:46.142 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T12:53:46.181 DEBUG:teuthology.misc:Transferring archived files from smithi102:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901717/remote/smithi102 2024-09-12T12:53:46.182 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T12:53:46.221 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T12:53:46.222 DEBUG:teuthology.orchestra.run.smithi033:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T12:53:46.224 DEBUG:teuthology.orchestra.run.smithi043:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T12:53:46.227 DEBUG:teuthology.orchestra.run.smithi102:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T12:53:46.271 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T12:53:46.285 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T12:53:46.285 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T12:53:46.303 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T12:53:46.303 DEBUG:teuthology.orchestra.run.smithi033:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T12:53:46.306 DEBUG:teuthology.orchestra.run.smithi043:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T12:53:46.308 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T12:53:46.319 INFO:teuthology.orchestra.run.smithi033.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 12:53 /home/ubuntu/cephtest 2024-09-12T12:53:46.323 INFO:teuthology.orchestra.run.smithi043.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 12:53 /home/ubuntu/cephtest 2024-09-12T12:53:46.328 INFO:teuthology.orchestra.run.smithi102.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 12:53 /home/ubuntu/cephtest 2024-09-12T12:53:46.329 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T12:53:46.340 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T12:53:46.388 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/suites/iogen}} duration: 2672.6258199214935 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-12T12:53:46.388 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T12:53:46.481 INFO:teuthology.run:pass